2023-10-16T12:50:51.355 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-16T12:50:51.356 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/norstats}} --name rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi --verbose --archive /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428999 -- /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428999/orig.config.yaml 2023-10-16T12:50:51.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:50:51.495 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428999 branch: rishabh-2023oct13 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/norstats}} email: null first_in_suite: false job_id: '7428999' kernel: client: sha1: distro flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: rishabh-2023oct13 ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - nowsync rbytes: false syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023oct13-b2 sha1: 33be745ec4531df08cd1bb70b4c9c1f89be58078 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6006 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 sleep_before_teardown: 0 subset: 402/512 suite: fs suite_branch: rishabh-2023oct13-b2 suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 33be745ec4531df08cd1bb70b4c9c1f89be58078 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-16_12:17:50 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-16T12:50:51.495 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa; will attempt to use it 2023-10-16T12:50:51.496 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks 2023-10-16T12:50:51.497 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-16T12:50:51.498 INFO:teuthology.task.internal:Checking packages... 2023-10-16T12:50:51.520 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0' 2023-10-16T12:50:51.521 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-16T12:50:51.521 INFO:teuthology.packaging:ref: None 2023-10-16T12:50:51.522 INFO:teuthology.packaging:tag: None 2023-10-16T12:50:51.522 INFO:teuthology.packaging:branch: rishabh-2023oct13 2023-10-16T12:50:51.522 INFO:teuthology.packaging:sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T12:50:51.522 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=rishabh-2023oct13 2023-10-16T12:50:51.670 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6730.g4ba8a190 2023-10-16T12:50:51.671 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-16T12:50:51.678 INFO:teuthology.task.internal:no buildpackages task found 2023-10-16T12:50:51.678 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-16T12:50:51.685 INFO:teuthology.task.internal:Saving configuration 2023-10-16T12:50:51.704 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-16T12:50:51.711 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T12:50:51.732 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428999', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 12:45:19.455333', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T12:50:51.752 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428999', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 12:45:19.457355', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T12:50:51.774 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428999', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 12:45:19.458539', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T12:50:51.775 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-16T12:50:51.781 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-10-16T12:50:51.781 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-10-16T12:50:51.782 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-10-16T12:50:51.782 INFO:teuthology.run_tasks:Running task console_log... 2023-10-16T12:50:51.880 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f81b18eeaf0>, signals=[15]) 2023-10-16T12:50:51.881 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-16T12:50:51.887 INFO:teuthology.task.internal:Opening connections... 2023-10-16T12:50:51.887 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2023-10-16T12:50:51.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T12:50:51.958 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2023-10-16T12:50:51.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T12:50:52.025 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2023-10-16T12:50:52.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T12:50:52.093 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-16T12:50:52.100 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-10-16T12:50:52.121 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-10-16T12:50:52.122 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-10-16T12:50:52.181 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T12:50:52.181 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T12:50:52.181 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel" 2023-10-16T12:50:52.181 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora" 2023-10-16T12:50:52.182 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.6" 2023-10-16T12:50:52.182 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-10-16T12:50:52.182 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T12:50:52.182 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-10-16T12:50:52.182 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T12:50:52.183 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T12:50:52.183 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T12:50:52.183 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T12:50:52.183 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T12:50:52.183 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T12:50:52.184 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T12:50:52.184 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T12:50:52.184 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T12:50:52.185 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-10-16T12:50:52.207 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-10-16T12:50:52.227 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-10-16T12:50:52.228 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-10-16T12:50:52.287 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T12:50:52.288 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T12:50:52.288 INFO:teuthology.orchestra.run.smithi118.stdout:ID="rhel" 2023-10-16T12:50:52.288 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="fedora" 2023-10-16T12:50:52.288 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8.6" 2023-10-16T12:50:52.289 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8" 2023-10-16T12:50:52.289 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T12:50:52.289 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-10-16T12:50:52.289 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T12:50:52.289 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T12:50:52.289 INFO:teuthology.orchestra.run.smithi118.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T12:50:52.290 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T12:50:52.290 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-16T12:50:52.290 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T12:50:52.290 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T12:50:52.291 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T12:50:52.291 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T12:50:52.291 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-10-16T12:50:52.315 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2023-10-16T12:50:52.335 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2023-10-16T12:50:52.336 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-10-16T12:50:52.395 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T12:50:52.395 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T12:50:52.396 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel" 2023-10-16T12:50:52.396 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora" 2023-10-16T12:50:52.396 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.6" 2023-10-16T12:50:52.396 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-10-16T12:50:52.396 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T12:50:52.396 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-10-16T12:50:52.397 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T12:50:52.397 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T12:50:52.397 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T12:50:52.397 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T12:50:52.397 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T12:50:52.398 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T12:50:52.398 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T12:50:52.398 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T12:50:52.398 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T12:50:52.399 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-10-16T12:50:52.423 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-16T12:50:52.434 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-16T12:50:52.442 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-16T12:50:52.442 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2023-10-16T12:50:52.445 DEBUG:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2023-10-16T12:50:52.447 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2023-10-16T12:50:52.466 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-16T12:50:52.473 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-16T12:50:52.473 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2023-10-16T12:50:52.504 DEBUG:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2023-10-16T12:50:52.506 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2023-10-16T12:50:52.537 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-16T12:50:52.611 INFO:teuthology.run_tasks:Running task kernel... 2023-10-16T12:50:52.626 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-16T12:50:52.626 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2023-10-16T12:50:52.627 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2023-10-16T12:50:52.627 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T12:50:52.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:50:52.647 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2023-10-16T12:50:52.705 INFO:teuthology.orchestra.run.smithi092.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-16T12:50:52.706 INFO:teuthology.task.kernel:Running kernel on smithi092: 4.18.0-372.9.1.el8.x86_64 2023-10-16T12:50:52.706 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum install -y kernel 2023-10-16T12:50:53.933 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-16T12:50:53.934 INFO:teuthology.orchestra.run.smithi092.stdout:Unable to read consumer identity 2023-10-16T12:50:55.396 INFO:teuthology.orchestra.run.smithi092.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2023-10-16T12:50:56.080 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 24 MB/s | 16 MB 00:00 2023-10-16T12:50:59.513 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 395 kB/s | 24 kB 00:00 2023-10-16T12:51:00.257 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-16T12:51:00.314 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-10-16T12:51:00.315 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2023-10-16T12:51:00.316 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-10-16T12:51:00.443 DEBUG:teuthology.orchestra.run.smithi092:> echo no | sudo yum reinstall kernel || true 2023-10-16T12:51:00.773 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-16T12:51:00.773 INFO:teuthology.orchestra.run.smithi092.stdout:Unable to read consumer identity 2023-10-16T12:51:01.038 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:02 ago on Mon 16 Oct 2023 12:50:59 PM UTC. 2023-10-16T12:51:01.087 INFO:teuthology.orchestra.run.smithi092.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T12:51:01.122 INFO:teuthology.orchestra.run.smithi092.stderr:Error: No packages marked for reinstall. 2023-10-16T12:51:01.168 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum reinstall -y kernel || true 2023-10-16T12:51:01.499 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-16T12:51:01.499 INFO:teuthology.orchestra.run.smithi092.stdout:Unable to read consumer identity 2023-10-16T12:51:01.760 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:02 ago on Mon 16 Oct 2023 12:50:59 PM UTC. 2023-10-16T12:51:01.805 INFO:teuthology.orchestra.run.smithi092.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T12:51:01.821 INFO:teuthology.orchestra.run.smithi092.stderr:Error: No packages marked for reinstall. 2023-10-16T12:51:01.873 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2023-10-16T12:51:01.952 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-16T12:51:01.952 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-16T12:51:01.953 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-16T12:51:01.953 DEBUG:teuthology.parallel:result is None 2023-10-16T12:51:01.953 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-16T12:51:01.961 INFO:teuthology.task.internal:Creating test directory... 2023-10-16T12:51:01.962 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T12:51:01.964 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T12:51:01.966 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T12:51:01.987 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-16T12:51:01.993 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-16T12:51:02.060 INFO:teuthology.task.internal:Creating archive directory... 2023-10-16T12:51:02.061 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T12:51:02.063 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T12:51:02.065 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T12:51:02.132 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-16T12:51:02.138 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-16T12:51:02.138 DEBUG:teuthology.orchestra.run.smithi118:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T12:51:02.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:51:02.158 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T12:51:02.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:51:02.177 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T12:51:02.179 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T12:51:02.200 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T12:51:02.210 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T12:51:02.221 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T12:51:02.250 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T12:51:02.267 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T12:51:02.272 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T12:51:02.292 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T12:51:02.294 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-16T12:51:02.301 INFO:teuthology.task.internal:Configuring sudo... 2023-10-16T12:51:02.302 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T12:51:02.304 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T12:51:02.307 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T12:51:02.337 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-16T12:51:02.346 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-16T12:51:02.346 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T12:51:02.370 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T12:51:02.380 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T12:51:02.398 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T12:51:02.469 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T12:51:02.516 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T12:51:02.601 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T12:51:02.642 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T12:51:02.643 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T12:51:02.709 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T12:51:02.755 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T12:51:02.816 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T12:51:02.900 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T12:51:02.946 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-16T12:51:02.947 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T12:51:03.016 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T12:51:03.065 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T12:51:03.116 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T12:51:03.199 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T12:51:03.244 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T12:51:03.245 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T12:51:03.313 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2023-10-16T12:51:03.315 DEBUG:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2023-10-16T12:51:03.318 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2023-10-16T12:51:03.367 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T12:51:03.408 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T12:51:03.411 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T12:51:03.797 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-16T12:51:03.807 INFO:teuthology.task.internal:Starting timer... 2023-10-16T12:51:03.807 INFO:teuthology.run_tasks:Running task pcp... 2023-10-16T12:51:03.817 INFO:teuthology.run_tasks:Running task selinux... 2023-10-16T12:51:03.826 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-16T12:51:03.827 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2023-10-16T12:51:03.888 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2023-10-16T12:51:03.889 DEBUG:teuthology.orchestra.run.smithi118:> sudo service auditd rotate 2023-10-16T12:51:03.955 INFO:teuthology.orchestra.run.smithi118.stdout:Rotating logs: 2023-10-16T12:51:03.957 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2023-10-16T12:51:04.020 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: 2023-10-16T12:51:04.022 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-16T12:51:04.022 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2023-10-16T12:51:04.051 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2023-10-16T12:51:04.051 DEBUG:teuthology.orchestra.run.smithi118:> /usr/sbin/getenforce 2023-10-16T12:51:04.076 INFO:teuthology.orchestra.run.smithi118.stdout:Permissive 2023-10-16T12:51:04.076 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2023-10-16T12:51:04.095 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2023-10-16T12:51:04.095 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi092.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi118.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi152.front.sepia.ceph.com': 'permissive'} 2023-10-16T12:51:04.096 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T12:51:04.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:51:04.124 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T12:51:04.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:51:04.152 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T12:51:04.180 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:51:04.180 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-16T12:51:04.181 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2023-10-16T12:51:04.208 DEBUG:teuthology.orchestra.run.smithi118:> sudo /usr/sbin/setenforce permissive 2023-10-16T12:51:04.245 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2023-10-16T12:51:04.272 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-16T12:51:04.282 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-16T12:51:04.288 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-16T12:51:04.437 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-16T12:51:04.451 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-16T12:51:04.453 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi092.front.sepia.ceph.com,smithi118.front.sepia.ceph.com,smithi152.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-16T13:00:01.377 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi092.front.sepia.ceph.com'), Remote(name='ubuntu@smithi118.front.sepia.ceph.com'), Remote(name='ubuntu@smithi152.front.sepia.ceph.com')] 2023-10-16T13:00:01.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-16T13:00:01.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T13:00:01.450 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-10-16T13:00:01.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-16T13:00:01.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-10-16T13:00:01.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T13:00:01.584 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-10-16T13:00:01.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-10-16T13:00:01.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-10-16T13:00:01.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T13:00:01.723 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-10-16T13:00:01.795 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-10-16T13:00:01.795 INFO:teuthology.run_tasks:Running task clock... 2023-10-16T13:00:01.804 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-16T13:00:01.805 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T13:00:01.806 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T13:00:01.808 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T13:00:01.808 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T13:00:01.810 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T13:00:01.811 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T13:00:01.838 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-16T13:00:01.843 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-16T13:00:01.853 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-16T13:00:01.858 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-16T13:00:01.866 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-16T13:00:01.880 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-16T13:00:01.928 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2023-10-16T13:00:01.929 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: ntpd: command not found 2023-10-16T13:00:01.940 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2023-10-16T13:00:01.941 INFO:teuthology.orchestra.run.smithi118.stdout:506 Cannot talk to daemon 2023-10-16T13:00:01.954 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-16T13:00:01.956 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-16T13:00:01.967 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2023-10-16T13:00:01.968 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-16T13:00:01.970 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-16T13:00:01.978 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2023-10-16T13:00:01.992 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-16T13:00:02.006 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-16T13:00:02.034 INFO:teuthology.orchestra.run.smithi092.stderr:bash: ntpq: command not found 2023-10-16T13:00:02.037 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T13:00:02.037 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2023-10-16T13:00:02.038 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:00:02.038 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:00:02.038 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:00:02.038 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:00:02.039 INFO:teuthology.orchestra.run.smithi118.stderr:bash: ntpq: command not found 2023-10-16T13:00:02.041 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T13:00:02.042 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2023-10-16T13:00:02.042 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:00:02.042 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:00:02.042 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:00:02.042 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:00:02.080 INFO:teuthology.orchestra.run.smithi152.stderr:bash: ntpq: command not found 2023-10-16T13:00:02.084 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T13:00:02.084 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2023-10-16T13:00:02.084 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:00:02.084 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:00:02.085 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:00:02.085 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:00:02.086 INFO:teuthology.run_tasks:Running task pexec... 2023-10-16T13:00:02.097 INFO:teuthology.task.pexec:Executing custom commands... 2023-10-16T13:00:02.098 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi092.front.sepia.ceph.com 2023-10-16T13:00:02.098 DEBUG:teuthology.orchestra.run.smithi092:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-16T13:00:02.099 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi118.front.sepia.ceph.com 2023-10-16T13:00:02.100 DEBUG:teuthology.orchestra.run.smithi118:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-16T13:00:02.100 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi152.front.sepia.ceph.com 2023-10-16T13:00:02.101 DEBUG:teuthology.orchestra.run.smithi152:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-16T13:00:02.474 INFO:teuthology.orchestra.run.smithi118.stdout:Updating Subscription Management repositories. 2023-10-16T13:00:02.474 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-16T13:00:02.502 INFO:teuthology.orchestra.run.smithi152.stdout:Updating Subscription Management repositories. 2023-10-16T13:00:03.327 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:42 ago on Mon 16 Oct 2023 12:58:20 PM UTC. 2023-10-16T13:00:03.328 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:24 ago on Mon 16 Oct 2023 12:58:38 PM UTC. 2023-10-16T13:00:03.344 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:26 ago on Mon 16 Oct 2023 12:58:36 PM UTC. 2023-10-16T13:00:05.040 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-10-16T13:00:05.041 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-10-16T13:00:05.042 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2023-10-16T13:00:05.042 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-10-16T13:00:05.042 INFO:teuthology.orchestra.run.smithi092.stdout:Resetting modules: 2023-10-16T13:00:05.042 INFO:teuthology.orchestra.run.smithi092.stdout: container-tools 2023-10-16T13:00:05.042 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:00:05.043 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-10-16T13:00:05.043 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-10-16T13:00:05.043 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:00:05.076 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2023-10-16T13:00:05.077 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2023-10-16T13:00:05.077 INFO:teuthology.orchestra.run.smithi118.stdout: Package Architecture Version Repository Size 2023-10-16T13:00:05.077 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2023-10-16T13:00:05.078 INFO:teuthology.orchestra.run.smithi118.stdout:Resetting modules: 2023-10-16T13:00:05.078 INFO:teuthology.orchestra.run.smithi118.stdout: container-tools 2023-10-16T13:00:05.078 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-16T13:00:05.078 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2023-10-16T13:00:05.078 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2023-10-16T13:00:05.079 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-16T13:00:05.229 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-10-16T13:00:05.230 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-10-16T13:00:05.231 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2023-10-16T13:00:05.231 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-10-16T13:00:05.231 INFO:teuthology.orchestra.run.smithi152.stdout:Resetting modules: 2023-10-16T13:00:05.231 INFO:teuthology.orchestra.run.smithi152.stdout: container-tools 2023-10-16T13:00:05.231 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T13:00:05.232 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-10-16T13:00:05.232 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-10-16T13:00:05.232 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T13:00:06.065 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:45 ago on Mon 16 Oct 2023 12:58:20 PM UTC. 2023-10-16T13:00:06.066 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:27 ago on Mon 16 Oct 2023 12:58:38 PM UTC. 2023-10-16T13:00:06.176 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:29 ago on Mon 16 Oct 2023 12:58:36 PM UTC. 2023-10-16T13:00:08.880 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-10-16T13:00:08.889 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2023-10-16T13:00:08.973 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-10-16T13:00:09.328 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-16T13:00:09.368 INFO:teuthology.orchestra.run.smithi118.stdout:Updating Subscription Management repositories. 2023-10-16T13:00:09.451 INFO:teuthology.orchestra.run.smithi152.stdout:Updating Subscription Management repositories. 2023-10-16T13:00:10.130 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:49 ago on Mon 16 Oct 2023 12:58:20 PM UTC. 2023-10-16T13:00:10.172 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:31 ago on Mon 16 Oct 2023 12:58:38 PM UTC. 2023-10-16T13:00:10.255 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:33 ago on Mon 16 Oct 2023 12:58:36 PM UTC. 2023-10-16T13:00:11.881 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2023-10-16T13:00:11.965 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-10-16T13:00:11.973 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================================================ 2023-10-16T13:00:11.973 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2023-10-16T13:00:11.973 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================================================ 2023-10-16T13:00:11.973 INFO:teuthology.orchestra.run.smithi118.stdout:Installing group/module packages: 2023-10-16T13:00:11.974 INFO:teuthology.orchestra.run.smithi118.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-16T13:00:11.974 INFO:teuthology.orchestra.run.smithi118.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-16T13:00:11.974 INFO:teuthology.orchestra.run.smithi118.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-16T13:00:11.974 INFO:teuthology.orchestra.run.smithi118.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-16T13:00:11.975 INFO:teuthology.orchestra.run.smithi118.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-16T13:00:11.975 INFO:teuthology.orchestra.run.smithi118.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-16T13:00:11.975 INFO:teuthology.orchestra.run.smithi118.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-16T13:00:11.975 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2023-10-16T13:00:11.975 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-16T13:00:11.976 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-16T13:00:11.976 INFO:teuthology.orchestra.run.smithi118.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-16T13:00:11.976 INFO:teuthology.orchestra.run.smithi118.stdout:Installing module profiles: 2023-10-16T13:00:11.976 INFO:teuthology.orchestra.run.smithi118.stdout: container-tools/common 2023-10-16T13:00:11.976 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-16T13:00:11.976 INFO:teuthology.orchestra.run.smithi118.stdout:Enabling module streams: 2023-10-16T13:00:11.977 INFO:teuthology.orchestra.run.smithi118.stdout: container-tools rhel8 2023-10-16T13:00:11.977 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-16T13:00:11.977 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2023-10-16T13:00:11.977 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================================================ 2023-10-16T13:00:11.977 INFO:teuthology.orchestra.run.smithi118.stdout:Install 10 Packages 2023-10-16T13:00:11.978 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-16T13:00:11.978 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 18 M 2023-10-16T13:00:11.978 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 65 M 2023-10-16T13:00:11.979 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2023-10-16T13:00:11.998 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-10-16T13:00:12.058 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================================================ 2023-10-16T13:00:12.059 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-10-16T13:00:12.059 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================================================ 2023-10-16T13:00:12.059 INFO:teuthology.orchestra.run.smithi152.stdout:Installing group/module packages: 2023-10-16T13:00:12.059 INFO:teuthology.orchestra.run.smithi152.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-16T13:00:12.060 INFO:teuthology.orchestra.run.smithi152.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-16T13:00:12.060 INFO:teuthology.orchestra.run.smithi152.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-16T13:00:12.060 INFO:teuthology.orchestra.run.smithi152.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-16T13:00:12.060 INFO:teuthology.orchestra.run.smithi152.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-16T13:00:12.060 INFO:teuthology.orchestra.run.smithi152.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-16T13:00:12.061 INFO:teuthology.orchestra.run.smithi152.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-16T13:00:12.061 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-10-16T13:00:12.061 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-16T13:00:12.061 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-16T13:00:12.061 INFO:teuthology.orchestra.run.smithi152.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-16T13:00:12.062 INFO:teuthology.orchestra.run.smithi152.stdout:Installing module profiles: 2023-10-16T13:00:12.062 INFO:teuthology.orchestra.run.smithi152.stdout: container-tools/common 2023-10-16T13:00:12.062 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T13:00:12.062 INFO:teuthology.orchestra.run.smithi152.stdout:Enabling module streams: 2023-10-16T13:00:12.062 INFO:teuthology.orchestra.run.smithi152.stdout: container-tools rhel8 2023-10-16T13:00:12.063 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T13:00:12.063 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-10-16T13:00:12.063 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================================================ 2023-10-16T13:00:12.063 INFO:teuthology.orchestra.run.smithi152.stdout:Install 10 Packages 2023-10-16T13:00:12.063 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T13:00:12.064 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 18 M 2023-10-16T13:00:12.064 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 65 M 2023-10-16T13:00:12.064 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-10-16T13:00:12.090 INFO:teuthology.orchestra.run.smithi092.stdout:============================================================================================================ 2023-10-16T13:00:12.090 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-10-16T13:00:12.090 INFO:teuthology.orchestra.run.smithi092.stdout:============================================================================================================ 2023-10-16T13:00:12.091 INFO:teuthology.orchestra.run.smithi092.stdout:Installing group/module packages: 2023-10-16T13:00:12.091 INFO:teuthology.orchestra.run.smithi092.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-16T13:00:12.091 INFO:teuthology.orchestra.run.smithi092.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-16T13:00:12.091 INFO:teuthology.orchestra.run.smithi092.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-16T13:00:12.091 INFO:teuthology.orchestra.run.smithi092.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-16T13:00:12.092 INFO:teuthology.orchestra.run.smithi092.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-16T13:00:12.092 INFO:teuthology.orchestra.run.smithi092.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-16T13:00:12.092 INFO:teuthology.orchestra.run.smithi092.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-16T13:00:12.092 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-10-16T13:00:12.093 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-16T13:00:12.093 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-16T13:00:12.093 INFO:teuthology.orchestra.run.smithi092.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-16T13:00:12.093 INFO:teuthology.orchestra.run.smithi092.stdout:Installing module profiles: 2023-10-16T13:00:12.093 INFO:teuthology.orchestra.run.smithi092.stdout: container-tools/common 2023-10-16T13:00:12.093 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:00:12.094 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling module streams: 2023-10-16T13:00:12.094 INFO:teuthology.orchestra.run.smithi092.stdout: container-tools rhel8 2023-10-16T13:00:12.094 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:00:12.094 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-10-16T13:00:12.094 INFO:teuthology.orchestra.run.smithi092.stdout:============================================================================================================ 2023-10-16T13:00:12.095 INFO:teuthology.orchestra.run.smithi092.stdout:Install 10 Packages 2023-10-16T13:00:12.095 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:00:12.095 INFO:teuthology.orchestra.run.smithi118.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 209 kB/s | 25 kB 00:00 2023-10-16T13:00:12.096 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 18 M 2023-10-16T13:00:12.096 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 65 M 2023-10-16T13:00:12.096 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-10-16T13:00:12.119 INFO:teuthology.orchestra.run.smithi118.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 284 kB/s | 41 kB 00:00 2023-10-16T13:00:12.145 INFO:teuthology.orchestra.run.smithi118.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 555 kB/s | 94 kB 00:00 2023-10-16T13:00:12.159 INFO:teuthology.orchestra.run.smithi152.stdout:(1/10): yajl-2.1.0-10.el8.x86_64.rpm 416 kB/s | 41 kB 00:00 2023-10-16T13:00:12.170 INFO:teuthology.orchestra.run.smithi118.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 654 kB/s | 49 kB 00:00 2023-10-16T13:00:12.184 INFO:teuthology.orchestra.run.smithi152.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 201 kB/s | 25 kB 00:00 2023-10-16T13:00:12.191 INFO:teuthology.orchestra.run.smithi092.stdout:(1/10): yajl-2.1.0-10.el8.x86_64.rpm 418 kB/s | 41 kB 00:00 2023-10-16T13:00:12.203 INFO:teuthology.orchestra.run.smithi118.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-10-16T13:00:12.243 INFO:teuthology.orchestra.run.smithi152.stdout:(3/10): udica-0.2.6-4.module+el8.6.0+16771+28df 589 kB/s | 49 kB 00:00 2023-10-16T13:00:12.244 INFO:teuthology.orchestra.run.smithi092.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 164 kB/s | 25 kB 00:00 2023-10-16T13:00:12.262 INFO:teuthology.orchestra.run.smithi118.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.6 MB/s | 149 kB 00:00 2023-10-16T13:00:12.268 INFO:teuthology.orchestra.run.smithi152.stdout:(4/10): python3-pyxdg-0.25-16.el8.noarch.rpm 453 kB/s | 94 kB 00:00 2023-10-16T13:00:12.274 INFO:teuthology.orchestra.run.smithi092.stdout:(3/10): udica-0.2.6-4.module+el8.6.0+16771+28df 590 kB/s | 49 kB 00:00 2023-10-16T13:00:12.279 INFO:teuthology.orchestra.run.smithi118.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 2.8 MB/s | 213 kB 00:00 2023-10-16T13:00:12.300 INFO:teuthology.orchestra.run.smithi092.stdout:(4/10): python3-pyxdg-0.25-16.el8.noarch.rpm 453 kB/s | 94 kB 00:00 2023-10-16T13:00:12.302 INFO:teuthology.orchestra.run.smithi152.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 4.4 MB/s | 524 kB 00:00 2023-10-16T13:00:12.327 INFO:teuthology.orchestra.run.smithi152.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-10-16T13:00:12.333 INFO:teuthology.orchestra.run.smithi092.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 5.8 MB/s | 524 kB 00:00 2023-10-16T13:00:12.359 INFO:teuthology.orchestra.run.smithi092.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-10-16T13:00:12.361 INFO:teuthology.orchestra.run.smithi152.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 3.5 MB/s | 213 kB 00:00 2023-10-16T13:00:12.384 INFO:teuthology.orchestra.run.smithi092.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-10-16T13:00:12.429 INFO:teuthology.orchestra.run.smithi118.stdout:(8/10): buildah-1.26.2-1.module+el8.6.0+16771+2 28 MB/s | 8.0 MB 00:00 2023-10-16T13:00:12.461 INFO:teuthology.orchestra.run.smithi152.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 22 MB/s | 2.2 MB 00:00 2023-10-16T13:00:12.479 INFO:teuthology.orchestra.run.smithi118.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 11 MB/s | 2.2 MB 00:00 2023-10-16T13:00:12.506 INFO:teuthology.orchestra.run.smithi092.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 18 MB/s | 2.2 MB 00:00 2023-10-16T13:00:12.571 INFO:teuthology.orchestra.run.smithi118.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 23 MB/s | 7.0 MB 00:00 2023-10-16T13:00:12.572 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2023-10-16T13:00:12.572 INFO:teuthology.orchestra.run.smithi118.stdout:Total 31 MB/s | 18 MB 00:00 2023-10-16T13:00:12.578 INFO:teuthology.orchestra.run.smithi152.stdout:(9/10): buildah-1.26.2-1.module+el8.6.0+16771+2 24 MB/s | 8.0 MB 00:00 2023-10-16T13:00:12.626 INFO:teuthology.orchestra.run.smithi092.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 26 MB/s | 7.0 MB 00:00 2023-10-16T13:00:12.679 INFO:teuthology.orchestra.run.smithi152.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 20 MB/s | 7.0 MB 00:00 2023-10-16T13:00:12.680 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-10-16T13:00:12.680 INFO:teuthology.orchestra.run.smithi152.stdout:Total 29 MB/s | 18 MB 00:00 2023-10-16T13:00:12.718 INFO:teuthology.orchestra.run.smithi092.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 18 MB/s | 8.0 MB 00:00 2023-10-16T13:00:12.719 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-10-16T13:00:12.719 INFO:teuthology.orchestra.run.smithi092.stdout:Total 29 MB/s | 18 MB 00:00 2023-10-16T13:00:12.773 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2023-10-16T13:00:12.791 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2023-10-16T13:00:12.792 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2023-10-16T13:00:12.880 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-10-16T13:00:12.899 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-10-16T13:00:12.899 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-10-16T13:00:12.918 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-10-16T13:00:12.937 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-10-16T13:00:12.937 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-10-16T13:00:12.974 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2023-10-16T13:00:12.978 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2023-10-16T13:00:13.081 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-10-16T13:00:13.085 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-10-16T13:00:13.120 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-10-16T13:00:13.124 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-10-16T13:00:13.607 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-10-16T13:00:13.619 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2023-10-16T13:00:13.721 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-10-16T13:00:13.778 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-16T13:00:13.840 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-16T13:00:13.927 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-16T13:00:13.939 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-16T13:00:14.007 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-16T13:00:14.120 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-16T13:00:14.150 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-16T13:00:14.243 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-16T13:00:14.307 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-16T13:00:14.358 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-16T13:00:14.454 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-16T13:00:14.498 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-16T13:00:14.743 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-16T13:00:14.835 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-16T13:00:14.874 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-16T13:00:15.564 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-16T13:00:15.606 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-16T13:00:15.668 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-16T13:00:16.443 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-16T13:00:16.481 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-16T13:00:16.575 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-16T13:00:16.678 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-16T13:00:16.713 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-16T13:00:16.810 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-16T13:00:16.888 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-16T13:00:16.888 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-16T13:00:16.976 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-16T13:00:17.048 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-16T13:00:17.090 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-16T13:00:17.195 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-16T13:00:17.315 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-16T13:00:17.316 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-16T13:00:17.316 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-16T13:00:17.316 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-16T13:00:17.316 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-16T13:00:17.316 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-16T13:00:17.317 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-16T13:00:17.317 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-16T13:00:17.317 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-16T13:00:17.317 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-16T13:00:17.357 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-16T13:00:17.357 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-16T13:00:17.358 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-16T13:00:17.358 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-16T13:00:17.358 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-16T13:00:17.358 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-16T13:00:17.358 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-16T13:00:17.359 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-16T13:00:17.359 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-16T13:00:17.359 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-16T13:00:17.463 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-16T13:00:17.464 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-16T13:00:17.464 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-16T13:00:17.464 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-16T13:00:17.464 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-16T13:00:17.464 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-16T13:00:17.465 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-16T13:00:17.465 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-16T13:00:17.465 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-16T13:00:17.465 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-16T13:00:18.436 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-16T13:00:18.436 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:41 ago on Mon 16 Oct 2023 12:58:36 PM UTC. 2023-10-16T13:00:18.608 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-16T13:00:18.609 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:58 ago on Mon 16 Oct 2023 12:58:20 PM UTC. 2023-10-16T13:00:18.694 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-16T13:00:18.695 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:40 ago on Mon 16 Oct 2023 12:58:38 PM UTC. 2023-10-16T13:00:21.084 INFO:teuthology.orchestra.run.smithi152.stdout:Installed products updated. 2023-10-16T13:00:21.274 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T13:00:21.274 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-10-16T13:00:21.274 INFO:teuthology.orchestra.run.smithi152.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-16T13:00:21.274 INFO:teuthology.orchestra.run.smithi152.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-16T13:00:21.275 INFO:teuthology.orchestra.run.smithi152.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-16T13:00:21.275 INFO:teuthology.orchestra.run.smithi152.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-16T13:00:21.275 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-16T13:00:21.275 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-16T13:00:21.275 INFO:teuthology.orchestra.run.smithi152.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-16T13:00:21.276 INFO:teuthology.orchestra.run.smithi152.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-16T13:00:21.276 INFO:teuthology.orchestra.run.smithi152.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-16T13:00:21.276 INFO:teuthology.orchestra.run.smithi152.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-16T13:00:21.276 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T13:00:21.276 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-10-16T13:00:21.418 DEBUG:teuthology.parallel:result is None 2023-10-16T13:00:21.701 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-10-16T13:00:21.736 INFO:teuthology.orchestra.run.smithi118.stdout:Installed products updated. 2023-10-16T13:00:21.909 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:00:21.910 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-10-16T13:00:21.910 INFO:teuthology.orchestra.run.smithi092.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-16T13:00:21.910 INFO:teuthology.orchestra.run.smithi092.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-16T13:00:21.910 INFO:teuthology.orchestra.run.smithi092.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-16T13:00:21.911 INFO:teuthology.orchestra.run.smithi092.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-16T13:00:21.911 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-16T13:00:21.911 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-16T13:00:21.911 INFO:teuthology.orchestra.run.smithi092.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-16T13:00:21.912 INFO:teuthology.orchestra.run.smithi092.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-16T13:00:21.912 INFO:teuthology.orchestra.run.smithi092.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-16T13:00:21.912 INFO:teuthology.orchestra.run.smithi092.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-16T13:00:21.912 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:00:21.912 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-10-16T13:00:21.945 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-16T13:00:21.945 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2023-10-16T13:00:21.945 INFO:teuthology.orchestra.run.smithi118.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-16T13:00:21.945 INFO:teuthology.orchestra.run.smithi118.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-16T13:00:21.946 INFO:teuthology.orchestra.run.smithi118.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-16T13:00:21.946 INFO:teuthology.orchestra.run.smithi118.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-16T13:00:21.946 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-16T13:00:21.947 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-16T13:00:21.947 INFO:teuthology.orchestra.run.smithi118.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-16T13:00:21.947 INFO:teuthology.orchestra.run.smithi118.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-16T13:00:21.947 INFO:teuthology.orchestra.run.smithi118.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-16T13:00:21.948 INFO:teuthology.orchestra.run.smithi118.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-16T13:00:21.948 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-16T13:00:21.948 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2023-10-16T13:00:22.041 DEBUG:teuthology.parallel:result is None 2023-10-16T13:00:22.107 DEBUG:teuthology.parallel:result is None 2023-10-16T13:00:22.107 INFO:teuthology.run_tasks:Running task install... 2023-10-16T13:00:22.117 DEBUG:teuthology.task.install:project ceph 2023-10-16T13:00:22.118 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}} 2023-10-16T13:00:22.118 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'} 2023-10-16T13:00:22.119 INFO:teuthology.task.install:Using flavor: default 2023-10-16T13:00:22.125 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-16T13:00:22.125 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-16T13:00:22.126 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-16T13:00:22.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T13:00:22.129 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-16T13:00:22.129 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T13:00:22.130 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-16T13:00:22.131 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T13:00:22.275 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-16T13:00:22.275 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-16T13:00:22.280 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-16T13:00:22.280 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-16T13:00:22.375 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-16T13:00:22.375 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-16T13:00:22.384 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-16T13:00:22.385 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T13:00:22.385 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-16T13:00:22.390 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-16T13:00:22.390 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-16T13:00:22.390 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-16T13:00:22.413 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-16T13:00:22.414 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-16T13:00:22.418 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-16T13:00:22.418 DEBUG:teuthology.orchestra.run.smithi118:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-16T13:00:22.481 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-16T13:00:22.483 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-16T13:00:22.484 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T13:00:22.484 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-16T13:00:22.485 DEBUG:teuthology.orchestra.run.smithi118:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-16T13:00:22.517 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-16T13:00:22.518 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-16T13:00:22.558 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-16T13:00:22.562 DEBUG:teuthology.orchestra.run.smithi118:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-16T13:00:22.591 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-16T13:00:22.624 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2023-10-16T13:00:22.625 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2023-10-16T13:00:22.628 INFO:teuthology.orchestra.run.smithi118.stdout:check_obsoletes = 1 2023-10-16T13:00:22.629 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum clean all 2023-10-16T13:00:22.670 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-16T13:00:22.738 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2023-10-16T13:00:22.739 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2023-10-16T13:00:22.997 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-16T13:00:23.000 INFO:teuthology.orchestra.run.smithi118.stdout:Updating Subscription Management repositories. 2023-10-16T13:00:23.113 INFO:teuthology.orchestra.run.smithi152.stdout:Updating Subscription Management repositories. 2023-10-16T13:00:23.248 INFO:teuthology.orchestra.run.smithi092.stdout:44 files removed 2023-10-16T13:00:23.264 INFO:teuthology.orchestra.run.smithi118.stdout:44 files removed 2023-10-16T13:00:23.293 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-16T13:00:23.311 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-16T13:00:23.365 INFO:teuthology.orchestra.run.smithi152.stdout:44 files removed 2023-10-16T13:00:23.412 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-16T13:00:23.625 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-16T13:00:23.642 INFO:teuthology.orchestra.run.smithi118.stdout:Updating Subscription Management repositories. 2023-10-16T13:00:23.747 INFO:teuthology.orchestra.run.smithi152.stdout:Updating Subscription Management repositories. 2023-10-16T13:00:24.348 INFO:teuthology.orchestra.run.smithi118.stdout:ceph packages for x86_64 266 kB/s | 81 kB 00:00 2023-10-16T13:00:24.411 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 199 kB/s | 81 kB 00:00 2023-10-16T13:00:24.468 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 246 kB/s | 81 kB 00:00 2023-10-16T13:00:24.707 INFO:teuthology.orchestra.run.smithi118.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-10-16T13:00:24.769 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 35 kB/s | 9.4 kB 00:00 2023-10-16T13:00:24.837 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 24 kB/s | 9.4 kB 00:00 2023-10-16T13:00:25.049 INFO:teuthology.orchestra.run.smithi118.stdout:ceph source packages 4.6 kB/s | 1.5 kB 00:00 2023-10-16T13:00:25.053 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 5.7 kB/s | 1.5 kB 00:00 2023-10-16T13:00:25.180 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 4.7 kB/s | 1.5 kB 00:00 2023-10-16T13:00:25.229 INFO:teuthology.orchestra.run.smithi152.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-10-16T13:00:25.241 INFO:teuthology.orchestra.run.smithi118.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-10-16T13:00:25.363 INFO:teuthology.orchestra.run.smithi092.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-10-16T13:00:26.515 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-10-16T13:00:27.430 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 7.8 MB/s | 16 MB 00:02 2023-10-16T13:00:27.592 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 6.8 MB/s | 16 MB 00:02 2023-10-16T13:00:30.031 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 427 kB/s | 24 kB 00:00 2023-10-16T13:00:30.897 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 402 kB/s | 24 kB 00:00 2023-10-16T13:00:30.999 INFO:teuthology.orchestra.run.smithi152.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 MB/s | 53 MB 00:00 2023-10-16T13:00:31.159 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 475 kB/s | 24 kB 00:00 2023-10-16T13:00:31.815 INFO:teuthology.orchestra.run.smithi092.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 MB/s | 53 MB 00:00 2023-10-16T13:00:32.153 INFO:teuthology.orchestra.run.smithi118.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 58 MB/s | 53 MB 00:00 2023-10-16T13:00:39.084 INFO:teuthology.orchestra.run.smithi152.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 56 MB/s | 47 MB 00:00 2023-10-16T13:00:39.941 INFO:teuthology.orchestra.run.smithi092.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 54 MB/s | 47 MB 00:00 2023-10-16T13:00:40.378 INFO:teuthology.orchestra.run.smithi118.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 50 MB/s | 47 MB 00:00 2023-10-16T13:00:50.094 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T13:00:50.095 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T13:00:50.109 INFO:teuthology.orchestra.run.smithi152.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-16T13:00:50.110 INFO:teuthology.orchestra.run.smithi152.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-16T13:00:50.111 INFO:teuthology.orchestra.run.smithi152.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-16T13:00:50.112 INFO:teuthology.orchestra.run.smithi152.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-16T13:00:50.114 INFO:teuthology.orchestra.run.smithi152.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-16T13:00:50.117 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-16T13:00:50.118 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-16T13:00:50.254 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-10-16T13:00:50.266 INFO:teuthology.orchestra.run.smithi152.stdout:=========================================================================================================================== 2023-10-16T13:00:50.266 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-10-16T13:00:50.267 INFO:teuthology.orchestra.run.smithi152.stdout:=========================================================================================================================== 2023-10-16T13:00:50.267 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-10-16T13:00:50.267 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-16T13:00:50.267 INFO:teuthology.orchestra.run.smithi152.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-16T13:00:50.267 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-16T13:00:50.268 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-16T13:00:50.268 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-16T13:00:50.268 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-16T13:00:50.268 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-16T13:00:50.268 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-16T13:00:50.269 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-16T13:00:50.269 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-16T13:00:50.269 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-16T13:00:50.269 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-16T13:00:50.269 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-16T13:00:50.270 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-16T13:00:50.270 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-16T13:00:50.270 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-16T13:00:50.270 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-16T13:00:50.271 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-16T13:00:50.271 INFO:teuthology.orchestra.run.smithi152.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-16T13:00:50.271 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-16T13:00:50.271 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-16T13:00:50.271 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-16T13:00:50.272 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-16T13:00:50.272 INFO:teuthology.orchestra.run.smithi152.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-16T13:00:50.272 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-16T13:00:50.272 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-16T13:00:50.272 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-16T13:00:50.273 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-16T13:00:50.273 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-16T13:00:50.273 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-16T13:00:50.273 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-16T13:00:50.274 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-16T13:00:50.274 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-16T13:00:50.274 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-16T13:00:50.274 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-16T13:00:50.274 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-16T13:00:50.275 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-16T13:00:50.275 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2023-10-16T13:00:50.275 INFO:teuthology.orchestra.run.smithi152.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-16T13:00:50.275 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T13:00:50.275 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T13:00:50.276 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-10-16T13:00:50.276 INFO:teuthology.orchestra.run.smithi152.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-16T13:00:50.276 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-16T13:00:50.276 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-16T13:00:50.276 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-16T13:00:50.277 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-16T13:00:50.277 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-16T13:00:50.277 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-16T13:00:50.277 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-16T13:00:50.277 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-16T13:00:50.278 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-16T13:00:50.278 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-16T13:00:50.278 INFO:teuthology.orchestra.run.smithi152.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-16T13:00:50.278 INFO:teuthology.orchestra.run.smithi152.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-16T13:00:50.278 INFO:teuthology.orchestra.run.smithi152.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-16T13:00:50.279 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-16T13:00:50.279 INFO:teuthology.orchestra.run.smithi152.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-16T13:00:50.279 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-16T13:00:50.279 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-16T13:00:50.279 INFO:teuthology.orchestra.run.smithi152.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-16T13:00:50.280 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-16T13:00:50.280 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-16T13:00:50.280 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-16T13:00:50.280 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-16T13:00:50.280 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-16T13:00:50.281 INFO:teuthology.orchestra.run.smithi152.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-16T13:00:50.281 INFO:teuthology.orchestra.run.smithi152.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-16T13:00:50.281 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-16T13:00:50.281 INFO:teuthology.orchestra.run.smithi152.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-16T13:00:50.282 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-16T13:00:50.282 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-16T13:00:50.282 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-16T13:00:50.282 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-16T13:00:50.282 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-16T13:00:50.283 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-16T13:00:50.283 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-16T13:00:50.283 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-16T13:00:50.283 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-16T13:00:50.283 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-16T13:00:50.284 INFO:teuthology.orchestra.run.smithi152.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-16T13:00:50.284 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-16T13:00:50.284 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-16T13:00:50.285 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-16T13:00:50.285 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-16T13:00:50.285 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-16T13:00:50.285 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-16T13:00:50.285 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-16T13:00:50.286 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-16T13:00:50.286 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-16T13:00:50.286 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-16T13:00:50.286 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-16T13:00:50.286 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-16T13:00:50.287 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-16T13:00:50.287 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-16T13:00:50.287 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T13:00:50.287 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-16T13:00:50.287 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-16T13:00:50.288 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-16T13:00:50.288 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-16T13:00:50.288 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-16T13:00:50.288 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-16T13:00:50.288 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-16T13:00:50.289 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-16T13:00:50.289 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-16T13:00:50.289 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-16T13:00:50.289 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-16T13:00:50.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-16T13:00:50.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-16T13:00:50.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-16T13:00:50.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-16T13:00:50.291 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-16T13:00:50.291 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-16T13:00:50.291 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-16T13:00:50.291 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T13:00:50.291 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-16T13:00:50.292 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-16T13:00:50.292 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-16T13:00:50.292 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-16T13:00:50.292 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-16T13:00:50.292 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-16T13:00:50.293 INFO:teuthology.orchestra.run.smithi152.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-16T13:00:50.293 INFO:teuthology.orchestra.run.smithi152.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-16T13:00:50.293 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-16T13:00:50.293 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-16T13:00:50.293 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-16T13:00:50.294 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-16T13:00:50.294 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-16T13:00:50.294 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-16T13:00:50.294 INFO:teuthology.orchestra.run.smithi152.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-16T13:00:50.294 INFO:teuthology.orchestra.run.smithi152.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-16T13:00:50.295 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-16T13:00:50.295 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-16T13:00:50.295 INFO:teuthology.orchestra.run.smithi152.stdout:Enabling module streams: 2023-10-16T13:00:50.295 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql 10 2023-10-16T13:00:50.295 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T13:00:50.296 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-10-16T13:00:50.296 INFO:teuthology.orchestra.run.smithi152.stdout:=========================================================================================================================== 2023-10-16T13:00:50.296 INFO:teuthology.orchestra.run.smithi152.stdout:Install 128 Packages 2023-10-16T13:00:50.296 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 3 Packages 2023-10-16T13:00:50.296 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T13:00:50.297 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 209 M 2023-10-16T13:00:50.297 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-10-16T13:00:50.826 INFO:teuthology.orchestra.run.smithi152.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 23 kB/s | 6.4 kB 00:00 2023-10-16T13:00:51.014 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T13:00:51.015 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T13:00:51.029 INFO:teuthology.orchestra.run.smithi092.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-16T13:00:51.030 INFO:teuthology.orchestra.run.smithi092.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-16T13:00:51.031 INFO:teuthology.orchestra.run.smithi092.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-16T13:00:51.033 INFO:teuthology.orchestra.run.smithi092.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-16T13:00:51.035 INFO:teuthology.orchestra.run.smithi092.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-16T13:00:51.038 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-16T13:00:51.039 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-16T13:00:51.170 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-10-16T13:00:51.182 INFO:teuthology.orchestra.run.smithi092.stdout:=========================================================================================================================== 2023-10-16T13:00:51.183 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-10-16T13:00:51.183 INFO:teuthology.orchestra.run.smithi092.stdout:=========================================================================================================================== 2023-10-16T13:00:51.183 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-10-16T13:00:51.183 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-16T13:00:51.183 INFO:teuthology.orchestra.run.smithi092.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-16T13:00:51.184 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-16T13:00:51.184 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-16T13:00:51.184 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-16T13:00:51.184 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-16T13:00:51.184 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-16T13:00:51.185 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-16T13:00:51.185 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-16T13:00:51.185 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-16T13:00:51.186 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-16T13:00:51.186 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-16T13:00:51.186 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-16T13:00:51.186 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-16T13:00:51.186 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-16T13:00:51.187 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-16T13:00:51.187 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-16T13:00:51.187 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-16T13:00:51.187 INFO:teuthology.orchestra.run.smithi092.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-16T13:00:51.187 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-16T13:00:51.188 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-16T13:00:51.188 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-16T13:00:51.188 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-16T13:00:51.188 INFO:teuthology.orchestra.run.smithi092.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-16T13:00:51.188 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-16T13:00:51.189 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-16T13:00:51.189 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-16T13:00:51.189 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-16T13:00:51.190 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-16T13:00:51.190 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-16T13:00:51.190 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-16T13:00:51.190 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-16T13:00:51.190 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-16T13:00:51.191 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-16T13:00:51.191 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-16T13:00:51.192 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-16T13:00:51.192 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-16T13:00:51.192 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2023-10-16T13:00:51.192 INFO:teuthology.orchestra.run.smithi092.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-16T13:00:51.192 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T13:00:51.193 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T13:00:51.193 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-10-16T13:00:51.193 INFO:teuthology.orchestra.run.smithi092.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-16T13:00:51.193 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-16T13:00:51.193 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-16T13:00:51.194 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-16T13:00:51.194 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-16T13:00:51.195 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-16T13:00:51.195 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-16T13:00:51.195 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-16T13:00:51.196 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-16T13:00:51.196 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-16T13:00:51.196 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-16T13:00:51.197 INFO:teuthology.orchestra.run.smithi092.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-16T13:00:51.197 INFO:teuthology.orchestra.run.smithi092.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-16T13:00:51.197 INFO:teuthology.orchestra.run.smithi092.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-16T13:00:51.197 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-16T13:00:51.198 INFO:teuthology.orchestra.run.smithi092.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-16T13:00:51.198 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-16T13:00:51.198 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-16T13:00:51.198 INFO:teuthology.orchestra.run.smithi092.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-16T13:00:51.199 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-16T13:00:51.199 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-16T13:00:51.199 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-16T13:00:51.200 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-16T13:00:51.200 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-16T13:00:51.200 INFO:teuthology.orchestra.run.smithi092.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-16T13:00:51.200 INFO:teuthology.orchestra.run.smithi092.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-16T13:00:51.201 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-16T13:00:51.201 INFO:teuthology.orchestra.run.smithi092.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-16T13:00:51.201 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-16T13:00:51.201 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-16T13:00:51.202 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-16T13:00:51.202 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-16T13:00:51.202 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-16T13:00:51.202 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-16T13:00:51.202 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-16T13:00:51.203 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-16T13:00:51.203 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-16T13:00:51.203 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-16T13:00:51.203 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-16T13:00:51.203 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-16T13:00:51.204 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-16T13:00:51.204 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-16T13:00:51.204 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-16T13:00:51.205 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-16T13:00:51.205 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-16T13:00:51.205 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-16T13:00:51.206 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-16T13:00:51.206 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-16T13:00:51.206 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-16T13:00:51.207 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-16T13:00:51.207 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-16T13:00:51.207 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-16T13:00:51.207 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-16T13:00:51.207 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T13:00:51.208 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-16T13:00:51.208 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-16T13:00:51.208 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-16T13:00:51.208 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-16T13:00:51.208 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-16T13:00:51.209 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-16T13:00:51.209 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-16T13:00:51.209 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-16T13:00:51.209 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-16T13:00:51.209 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-16T13:00:51.210 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-16T13:00:51.210 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-16T13:00:51.210 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-16T13:00:51.211 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-16T13:00:51.211 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-16T13:00:51.211 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-16T13:00:51.211 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-16T13:00:51.211 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-16T13:00:51.212 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T13:00:51.212 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-16T13:00:51.212 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-16T13:00:51.212 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-16T13:00:51.212 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-16T13:00:51.212 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-16T13:00:51.213 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-16T13:00:51.213 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-16T13:00:51.213 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-16T13:00:51.213 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-16T13:00:51.213 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-16T13:00:51.214 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-16T13:00:51.214 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-16T13:00:51.214 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-16T13:00:51.214 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-16T13:00:51.214 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-16T13:00:51.215 INFO:teuthology.orchestra.run.smithi092.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-16T13:00:51.215 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-16T13:00:51.215 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-16T13:00:51.215 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling module streams: 2023-10-16T13:00:51.215 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql 10 2023-10-16T13:00:51.216 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:00:51.216 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-10-16T13:00:51.216 INFO:teuthology.orchestra.run.smithi092.stdout:=========================================================================================================================== 2023-10-16T13:00:51.216 INFO:teuthology.orchestra.run.smithi092.stdout:Install 128 Packages 2023-10-16T13:00:51.217 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 3 Packages 2023-10-16T13:00:51.217 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:00:51.217 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 209 M 2023-10-16T13:00:51.218 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-10-16T13:00:51.243 INFO:teuthology.orchestra.run.smithi152.stdout:(2/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 2.2 MB/s | 918 kB 00:00 2023-10-16T13:00:51.318 INFO:teuthology.orchestra.run.smithi152.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 2.2 MB/s | 167 kB 00:00 2023-10-16T13:00:51.451 INFO:teuthology.orchestra.run.smithi118.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T13:00:51.452 INFO:teuthology.orchestra.run.smithi118.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T13:00:51.465 INFO:teuthology.orchestra.run.smithi118.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-16T13:00:51.467 INFO:teuthology.orchestra.run.smithi118.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-16T13:00:51.467 INFO:teuthology.orchestra.run.smithi118.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-16T13:00:51.468 INFO:teuthology.orchestra.run.smithi118.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-16T13:00:51.470 INFO:teuthology.orchestra.run.smithi118.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-16T13:00:51.473 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-16T13:00:51.475 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-16T13:00:51.524 INFO:teuthology.orchestra.run.smithi092.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 24 kB/s | 6.4 kB 00:00 2023-10-16T13:00:51.605 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2023-10-16T13:00:51.618 INFO:teuthology.orchestra.run.smithi118.stdout:=========================================================================================================================== 2023-10-16T13:00:51.618 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2023-10-16T13:00:51.618 INFO:teuthology.orchestra.run.smithi118.stdout:=========================================================================================================================== 2023-10-16T13:00:51.619 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2023-10-16T13:00:51.619 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-16T13:00:51.619 INFO:teuthology.orchestra.run.smithi118.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-16T13:00:51.619 INFO:teuthology.orchestra.run.smithi118.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-16T13:00:51.619 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-16T13:00:51.620 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-16T13:00:51.620 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-16T13:00:51.620 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-16T13:00:51.620 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-16T13:00:51.620 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-16T13:00:51.621 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-16T13:00:51.621 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-16T13:00:51.621 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-16T13:00:51.621 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-16T13:00:51.621 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-16T13:00:51.622 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-16T13:00:51.622 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-16T13:00:51.622 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-16T13:00:51.622 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-16T13:00:51.623 INFO:teuthology.orchestra.run.smithi118.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-16T13:00:51.623 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-16T13:00:51.623 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-16T13:00:51.623 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-16T13:00:51.623 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-16T13:00:51.624 INFO:teuthology.orchestra.run.smithi118.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-16T13:00:51.624 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-16T13:00:51.624 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-16T13:00:51.625 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-16T13:00:51.625 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-16T13:00:51.625 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-16T13:00:51.625 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-16T13:00:51.626 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-16T13:00:51.626 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-16T13:00:51.626 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-16T13:00:51.627 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-16T13:00:51.627 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-16T13:00:51.627 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-16T13:00:51.627 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-16T13:00:51.628 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrading: 2023-10-16T13:00:51.628 INFO:teuthology.orchestra.run.smithi118.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-16T13:00:51.628 INFO:teuthology.orchestra.run.smithi118.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T13:00:51.628 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T13:00:51.629 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2023-10-16T13:00:51.629 INFO:teuthology.orchestra.run.smithi118.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-16T13:00:51.629 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-16T13:00:51.629 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-16T13:00:51.630 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-16T13:00:51.630 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-16T13:00:51.630 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-16T13:00:51.630 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-16T13:00:51.631 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-16T13:00:51.631 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-16T13:00:51.631 INFO:teuthology.orchestra.run.smithi118.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-16T13:00:51.631 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-16T13:00:51.632 INFO:teuthology.orchestra.run.smithi118.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-16T13:00:51.632 INFO:teuthology.orchestra.run.smithi118.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-16T13:00:51.632 INFO:teuthology.orchestra.run.smithi118.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-16T13:00:51.633 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-16T13:00:51.633 INFO:teuthology.orchestra.run.smithi118.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-16T13:00:51.633 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-16T13:00:51.633 INFO:teuthology.orchestra.run.smithi118.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-16T13:00:51.633 INFO:teuthology.orchestra.run.smithi118.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-16T13:00:51.634 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-16T13:00:51.634 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-16T13:00:51.634 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-16T13:00:51.634 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-16T13:00:51.635 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-16T13:00:51.635 INFO:teuthology.orchestra.run.smithi118.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-16T13:00:51.635 INFO:teuthology.orchestra.run.smithi118.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-16T13:00:51.635 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-16T13:00:51.635 INFO:teuthology.orchestra.run.smithi118.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-16T13:00:51.636 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-16T13:00:51.636 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-16T13:00:51.636 INFO:teuthology.orchestra.run.smithi118.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-16T13:00:51.636 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-16T13:00:51.636 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-16T13:00:51.637 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-16T13:00:51.637 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-16T13:00:51.637 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-16T13:00:51.637 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-16T13:00:51.637 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-16T13:00:51.637 INFO:teuthology.orchestra.run.smithi118.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-16T13:00:51.638 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-16T13:00:51.638 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-16T13:00:51.638 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-16T13:00:51.638 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-16T13:00:51.638 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-16T13:00:51.639 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-16T13:00:51.639 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-16T13:00:51.639 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-16T13:00:51.639 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-16T13:00:51.639 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-16T13:00:51.640 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-16T13:00:51.640 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-16T13:00:51.640 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-16T13:00:51.640 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-16T13:00:51.640 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T13:00:51.641 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-16T13:00:51.641 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-16T13:00:51.641 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-16T13:00:51.641 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-16T13:00:51.641 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-16T13:00:51.641 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-16T13:00:51.642 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-16T13:00:51.642 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-16T13:00:51.642 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-16T13:00:51.642 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-16T13:00:51.642 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-16T13:00:51.643 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-16T13:00:51.643 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-16T13:00:51.643 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-16T13:00:51.643 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-16T13:00:51.644 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-16T13:00:51.644 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-16T13:00:51.644 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-16T13:00:51.644 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T13:00:51.644 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-16T13:00:51.644 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-16T13:00:51.645 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-16T13:00:51.645 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-16T13:00:51.645 INFO:teuthology.orchestra.run.smithi118.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-16T13:00:51.645 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-16T13:00:51.645 INFO:teuthology.orchestra.run.smithi118.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-16T13:00:51.646 INFO:teuthology.orchestra.run.smithi118.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-16T13:00:51.646 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-16T13:00:51.646 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-16T13:00:51.646 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-16T13:00:51.646 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-16T13:00:51.647 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-16T13:00:51.647 INFO:teuthology.orchestra.run.smithi118.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-16T13:00:51.647 INFO:teuthology.orchestra.run.smithi118.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-16T13:00:51.647 INFO:teuthology.orchestra.run.smithi118.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-16T13:00:51.647 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-16T13:00:51.648 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-16T13:00:51.648 INFO:teuthology.orchestra.run.smithi118.stdout:Enabling module streams: 2023-10-16T13:00:51.648 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql 10 2023-10-16T13:00:51.648 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-16T13:00:51.648 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2023-10-16T13:00:51.649 INFO:teuthology.orchestra.run.smithi118.stdout:=========================================================================================================================== 2023-10-16T13:00:51.649 INFO:teuthology.orchestra.run.smithi118.stdout:Install 128 Packages 2023-10-16T13:00:51.649 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrade 3 Packages 2023-10-16T13:00:51.649 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-16T13:00:51.650 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 209 M 2023-10-16T13:00:51.650 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2023-10-16T13:00:51.835 INFO:teuthology.orchestra.run.smithi152.stdout:(4/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 4.5 MB/s | 2.3 MB 00:00 2023-10-16T13:00:51.874 INFO:teuthology.orchestra.run.smithi092.stdout:(2/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 2.6 MB/s | 918 kB 00:00 2023-10-16T13:00:52.016 INFO:teuthology.orchestra.run.smithi092.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 1.2 MB/s | 167 kB 00:00 2023-10-16T13:00:52.062 INFO:teuthology.orchestra.run.smithi118.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 30 kB/s | 6.4 kB 00:00 2023-10-16T13:00:52.344 INFO:teuthology.orchestra.run.smithi152.stdout:(5/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 3.2 MB/s | 1.6 MB 00:00 2023-10-16T13:00:52.908 INFO:teuthology.orchestra.run.smithi092.stdout:(4/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 2.6 MB/s | 2.3 MB 00:00 2023-10-16T13:00:52.929 INFO:teuthology.orchestra.run.smithi118.stdout:(2/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.0 MB/s | 918 kB 00:00 2023-10-16T13:00:52.996 INFO:teuthology.orchestra.run.smithi118.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 2.5 MB/s | 167 kB 00:00 2023-10-16T13:00:53.150 INFO:teuthology.orchestra.run.smithi092.stdout:(5/131): ceph-common-18.0.0-6730.g4ba8a190.el8. 12 MB/s | 23 MB 00:01 2023-10-16T13:00:53.269 INFO:teuthology.orchestra.run.smithi152.stdout:(6/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 2.0 MB/s | 5.4 MB 00:02 2023-10-16T13:00:53.550 INFO:teuthology.orchestra.run.smithi092.stdout:(6/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 2.5 MB/s | 1.6 MB 00:00 2023-10-16T13:00:53.628 INFO:teuthology.orchestra.run.smithi152.stdout:(7/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 3.6 MB/s | 4.6 MB 00:01 2023-10-16T13:00:53.634 INFO:teuthology.orchestra.run.smithi092.stdout:(7/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 9.6 MB/s | 4.6 MB 00:00 2023-10-16T13:00:53.755 INFO:teuthology.orchestra.run.smithi118.stdout:(4/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 3.0 MB/s | 2.3 MB 00:00 2023-10-16T13:00:54.161 INFO:teuthology.orchestra.run.smithi118.stdout:(5/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 2.3 MB/s | 5.4 MB 00:02 2023-10-16T13:00:54.680 INFO:teuthology.orchestra.run.smithi118.stdout:(6/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 1.8 MB/s | 1.6 MB 00:00 2023-10-16T13:00:55.125 INFO:teuthology.orchestra.run.smithi092.stdout:(8/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 1.4 MB/s | 5.4 MB 00:03 2023-10-16T13:00:55.267 INFO:teuthology.orchestra.run.smithi092.stdout:(9/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el8 8.5 MB/s | 14 MB 00:01 2023-10-16T13:00:55.293 INFO:teuthology.orchestra.run.smithi092.stdout:(10/131): ceph-selinux-18.0.0-6730.g4ba8a190.el 146 kB/s | 24 kB 00:00 2023-10-16T13:00:55.410 INFO:teuthology.orchestra.run.smithi092.stdout:(11/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 2.2 MB/s | 261 kB 00:00 2023-10-16T13:00:55.526 INFO:teuthology.orchestra.run.smithi092.stdout:(12/131): libcephfs-devel-18.0.0-6730.g4ba8a190 266 kB/s | 31 kB 00:00 2023-10-16T13:00:55.638 INFO:teuthology.orchestra.run.smithi118.stdout:(7/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 3.1 MB/s | 4.6 MB 00:01 2023-10-16T13:00:55.830 INFO:teuthology.orchestra.run.smithi092.stdout:(13/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 2.7 MB/s | 839 kB 00:00 2023-10-16T13:00:55.943 INFO:teuthology.orchestra.run.smithi092.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 1.6 MB/s | 184 kB 00:00 2023-10-16T13:00:56.052 INFO:teuthology.orchestra.run.smithi092.stdout:(15/131): librados-devel-18.0.0-6730.g4ba8a190. 1.3 MB/s | 139 kB 00:00 2023-10-16T13:00:56.269 INFO:teuthology.orchestra.run.smithi092.stdout:(16/131): libradosstriper1-18.0.0-6730.g4ba8a19 2.3 MB/s | 518 kB 00:00 2023-10-16T13:00:57.536 INFO:teuthology.orchestra.run.smithi092.stdout:(17/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 5.5 MB/s | 6.9 MB 00:01 2023-10-16T13:00:57.544 INFO:teuthology.orchestra.run.smithi152.stdout:(8/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el8 3.5 MB/s | 14 MB 00:03 2023-10-16T13:00:57.628 INFO:teuthology.orchestra.run.smithi092.stdout:(18/131): python3-ceph-argparse-18.0.0-6730.g4b 488 kB/s | 45 kB 00:00 2023-10-16T13:00:57.636 INFO:teuthology.orchestra.run.smithi152.stdout:(9/131): ceph-selinux-18.0.0-6730.g4ba8a190.el8 266 kB/s | 24 kB 00:00 2023-10-16T13:00:57.737 INFO:teuthology.orchestra.run.smithi092.stdout:(19/131): python3-ceph-common-18.0.0-6730.g4ba8 1.1 MB/s | 126 kB 00:00 2023-10-16T13:00:57.870 INFO:teuthology.orchestra.run.smithi092.stdout:(20/131): python3-cephfs-18.0.0-6730.g4ba8a190. 1.4 MB/s | 197 kB 00:00 2023-10-16T13:00:58.004 INFO:teuthology.orchestra.run.smithi092.stdout:(21/131): python3-rados-18.0.0-6730.g4ba8a190.e 2.7 MB/s | 371 kB 00:00 2023-10-16T13:00:58.146 INFO:teuthology.orchestra.run.smithi092.stdout:(22/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 2.5 MB/s | 365 kB 00:00 2023-10-16T13:00:58.271 INFO:teuthology.orchestra.run.smithi092.stdout:(23/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 853 kB/s | 107 kB 00:00 2023-10-16T13:00:58.388 INFO:teuthology.orchestra.run.smithi092.stdout:(24/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 803 kB/s | 94 kB 00:00 2023-10-16T13:00:59.122 INFO:teuthology.orchestra.run.smithi092.stdout:(25/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 4.9 MB/s | 3.6 MB 00:00 2023-10-16T13:00:59.247 INFO:teuthology.orchestra.run.smithi092.stdout:(26/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 1.4 MB/s | 179 kB 00:00 2023-10-16T13:00:59.381 INFO:teuthology.orchestra.run.smithi092.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6730.g 173 kB/s | 23 kB 00:00 2023-10-16T13:00:59.455 INFO:teuthology.orchestra.run.smithi118.stdout:(8/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el8 3.6 MB/s | 14 MB 00:03 2023-10-16T13:00:59.513 INFO:teuthology.orchestra.run.smithi118.stdout:(9/131): ceph-selinux-18.0.0-6730.g4ba8a190.el8 420 kB/s | 24 kB 00:00 2023-10-16T13:00:59.653 INFO:teuthology.orchestra.run.smithi152.stdout:(10/131): ceph-common-18.0.0-6730.g4ba8a190.el8 2.5 MB/s | 23 MB 00:09 2023-10-16T13:00:59.847 INFO:teuthology.orchestra.run.smithi092.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 283 kB/s | 132 kB 00:00 2023-10-16T13:00:59.978 INFO:teuthology.orchestra.run.smithi152.stdout:(11/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 803 kB/s | 261 kB 00:00 2023-10-16T13:01:00.079 INFO:teuthology.orchestra.run.smithi152.stdout:(12/131): libcephfs-devel-18.0.0-6730.g4ba8a190 310 kB/s | 31 kB 00:00 2023-10-16T13:01:00.239 INFO:teuthology.orchestra.run.smithi092.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 4.5 MB/s | 1.8 MB 00:00 2023-10-16T13:01:00.662 INFO:teuthology.orchestra.run.smithi152.stdout:(13/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 1.4 MB/s | 839 kB 00:00 2023-10-16T13:01:00.779 INFO:teuthology.orchestra.run.smithi152.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 1.5 MB/s | 184 kB 00:00 2023-10-16T13:01:00.831 INFO:teuthology.orchestra.run.smithi092.stdout:(30/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 8.8 MB/s | 49 MB 00:05 2023-10-16T13:01:00.905 INFO:teuthology.orchestra.run.smithi152.stdout:(15/131): librados-devel-18.0.0-6730.g4ba8a190. 1.1 MB/s | 139 kB 00:00 2023-10-16T13:01:00.940 INFO:teuthology.orchestra.run.smithi092.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 2.2 MB/s | 242 kB 00:00 2023-10-16T13:01:01.007 INFO:teuthology.orchestra.run.smithi092.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 715 kB/s | 47 kB 00:00 2023-10-16T13:01:01.074 INFO:teuthology.orchestra.run.smithi092.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6730.g4 224 kB/s | 15 kB 00:00 2023-10-16T13:01:01.174 INFO:teuthology.orchestra.run.smithi092.stdout:(34/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 2.6 MB/s | 261 kB 00:00 2023-10-16T13:01:01.258 INFO:teuthology.orchestra.run.smithi092.stdout:(35/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 2.3 MB/s | 192 kB 00:00 2023-10-16T13:01:01.317 INFO:teuthology.orchestra.run.smithi092.stdout:(36/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 310 kB/s | 18 kB 00:00 2023-10-16T13:01:01.322 INFO:teuthology.orchestra.run.smithi152.stdout:(16/131): libradosstriper1-18.0.0-6730.g4ba8a19 1.2 MB/s | 518 kB 00:00 2023-10-16T13:01:01.542 INFO:teuthology.orchestra.run.smithi092.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 5.7 MB/s | 7.4 MB 00:01 2023-10-16T13:01:01.855 INFO:teuthology.orchestra.run.smithi118.stdout:(10/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x8 2.5 MB/s | 18 MB 00:07 2023-10-16T13:01:01.939 INFO:teuthology.orchestra.run.smithi118.stdout:(11/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 3.1 MB/s | 261 kB 00:00 2023-10-16T13:01:01.968 INFO:teuthology.orchestra.run.smithi092.stdout:(38/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x8 2.1 MB/s | 18 MB 00:08 2023-10-16T13:01:01.981 INFO:teuthology.orchestra.run.smithi118.stdout:(12/131): libcephfs-devel-18.0.0-6730.g4ba8a190 749 kB/s | 31 kB 00:00 2023-10-16T13:01:02.148 INFO:teuthology.orchestra.run.smithi118.stdout:(13/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 4.9 MB/s | 839 kB 00:00 2023-10-16T13:01:02.223 INFO:teuthology.orchestra.run.smithi118.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 2.4 MB/s | 184 kB 00:00 2023-10-16T13:01:02.274 INFO:teuthology.orchestra.run.smithi118.stdout:(15/131): librados-devel-18.0.0-6730.g4ba8a190. 2.7 MB/s | 139 kB 00:00 2023-10-16T13:01:02.407 INFO:teuthology.orchestra.run.smithi118.stdout:(16/131): libradosstriper1-18.0.0-6730.g4ba8a19 3.8 MB/s | 518 kB 00:00 2023-10-16T13:01:02.641 INFO:teuthology.orchestra.run.smithi118.stdout:(17/131): ceph-common-18.0.0-6730.g4ba8a190.el8 2.1 MB/s | 23 MB 00:10 2023-10-16T13:01:02.691 INFO:teuthology.orchestra.run.smithi118.stdout:(18/131): python3-ceph-argparse-18.0.0-6730.g4b 903 kB/s | 45 kB 00:00 2023-10-16T13:01:02.767 INFO:teuthology.orchestra.run.smithi118.stdout:(19/131): python3-ceph-common-18.0.0-6730.g4ba8 1.6 MB/s | 126 kB 00:00 2023-10-16T13:01:02.850 INFO:teuthology.orchestra.run.smithi118.stdout:(20/131): python3-cephfs-18.0.0-6730.g4ba8a190. 2.3 MB/s | 197 kB 00:00 2023-10-16T13:01:02.918 INFO:teuthology.orchestra.run.smithi092.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 43 kB/s | 59 kB 00:01 2023-10-16T13:01:02.959 INFO:teuthology.orchestra.run.smithi118.stdout:(21/131): python3-rados-18.0.0-6730.g4ba8a190.e 3.3 MB/s | 371 kB 00:00 2023-10-16T13:01:03.059 INFO:teuthology.orchestra.run.smithi118.stdout:(22/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 3.6 MB/s | 365 kB 00:00 2023-10-16T13:01:03.118 INFO:teuthology.orchestra.run.smithi118.stdout:(23/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 1.8 MB/s | 107 kB 00:00 2023-10-16T13:01:03.176 INFO:teuthology.orchestra.run.smithi118.stdout:(24/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.6 MB/s | 94 kB 00:00 2023-10-16T13:01:03.198 INFO:teuthology.orchestra.run.smithi152.stdout:(17/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x8 1.8 MB/s | 18 MB 00:09 2023-10-16T13:01:03.209 INFO:teuthology.orchestra.run.smithi092.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.6 MB/s | 476 kB 00:00 2023-10-16T13:01:03.264 INFO:teuthology.orchestra.run.smithi152.stdout:(18/131): python3-ceph-argparse-18.0.0-6730.g4b 679 kB/s | 45 kB 00:00 2023-10-16T13:01:03.268 INFO:teuthology.orchestra.run.smithi092.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 748 kB/s | 44 kB 00:00 2023-10-16T13:01:03.381 INFO:teuthology.orchestra.run.smithi152.stdout:(19/131): python3-ceph-common-18.0.0-6730.g4ba8 1.1 MB/s | 126 kB 00:00 2023-10-16T13:01:03.410 INFO:teuthology.orchestra.run.smithi092.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.3 MB/s | 185 kB 00:00 2023-10-16T13:01:03.468 INFO:teuthology.orchestra.run.smithi092.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 566 kB/s | 33 kB 00:00 2023-10-16T13:01:03.498 INFO:teuthology.orchestra.run.smithi152.stdout:(20/131): python3-cephfs-18.0.0-6730.g4ba8a190. 1.7 MB/s | 197 kB 00:00 2023-10-16T13:01:03.527 INFO:teuthology.orchestra.run.smithi092.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 279 kB/s | 16 kB 00:00 2023-10-16T13:01:03.661 INFO:teuthology.orchestra.run.smithi092.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2023-10-16T13:01:03.698 INFO:teuthology.orchestra.run.smithi152.stdout:(21/131): python3-rados-18.0.0-6730.g4ba8a190.e 1.8 MB/s | 371 kB 00:00 2023-10-16T13:01:03.701 INFO:teuthology.orchestra.run.smithi118.stdout:(25/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 5.4 MB/s | 6.9 MB 00:01 2023-10-16T13:01:03.768 INFO:teuthology.orchestra.run.smithi118.stdout:(26/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 2.6 MB/s | 179 kB 00:00 2023-10-16T13:01:03.818 INFO:teuthology.orchestra.run.smithi118.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6730.g 464 kB/s | 23 kB 00:00 2023-10-16T13:01:03.865 INFO:teuthology.orchestra.run.smithi152.stdout:(22/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 2.1 MB/s | 365 kB 00:00 2023-10-16T13:01:03.903 INFO:teuthology.orchestra.run.smithi092.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.6 MB/s | 384 kB 00:00 2023-10-16T13:01:03.932 INFO:teuthology.orchestra.run.smithi152.stdout:(23/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 1.6 MB/s | 107 kB 00:00 2023-10-16T13:01:03.951 INFO:teuthology.orchestra.run.smithi118.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.0 MB/s | 132 kB 00:00 2023-10-16T13:01:03.995 INFO:teuthology.orchestra.run.smithi092.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 889 kB/s | 81 kB 00:00 2023-10-16T13:01:03.999 INFO:teuthology.orchestra.run.smithi152.stdout:(24/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.4 MB/s | 94 kB 00:00 2023-10-16T13:01:04.053 INFO:teuthology.orchestra.run.smithi092.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 189 kB/s | 11 kB 00:00 2023-10-16T13:01:04.139 INFO:teuthology.orchestra.run.smithi118.stdout:(29/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 3.7 MB/s | 3.6 MB 00:00 2023-10-16T13:01:04.143 INFO:teuthology.orchestra.run.smithi092.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 196 kB/s | 18 kB 00:00 2023-10-16T13:01:04.353 INFO:teuthology.orchestra.run.smithi118.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 4.4 MB/s | 1.8 MB 00:00 2023-10-16T13:01:04.425 INFO:teuthology.orchestra.run.smithi152.stdout:(25/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 2.2 MB/s | 6.9 MB 00:03 2023-10-16T13:01:04.429 INFO:teuthology.orchestra.run.smithi118.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 3.2 MB/s | 242 kB 00:00 2023-10-16T13:01:04.488 INFO:teuthology.orchestra.run.smithi118.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 814 kB/s | 47 kB 00:00 2023-10-16T13:01:04.538 INFO:teuthology.orchestra.run.smithi118.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6730.g4 301 kB/s | 15 kB 00:00 2023-10-16T13:01:04.568 INFO:teuthology.orchestra.run.smithi152.stdout:(26/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 1.2 MB/s | 179 kB 00:00 2023-10-16T13:01:04.638 INFO:teuthology.orchestra.run.smithi118.stdout:(34/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 2.6 MB/s | 261 kB 00:00 2023-10-16T13:01:04.651 INFO:teuthology.orchestra.run.smithi152.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6730.g 277 kB/s | 23 kB 00:00 2023-10-16T13:01:04.697 INFO:teuthology.orchestra.run.smithi118.stdout:(35/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 3.2 MB/s | 192 kB 00:00 2023-10-16T13:01:04.752 INFO:teuthology.orchestra.run.smithi118.stdout:(36/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 362 kB/s | 18 kB 00:00 2023-10-16T13:01:04.760 INFO:teuthology.orchestra.run.smithi152.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.2 MB/s | 132 kB 00:00 2023-10-16T13:01:05.088 INFO:teuthology.orchestra.run.smithi092.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 1.2 MB/s | 1.2 MB 00:00 2023-10-16T13:01:05.179 INFO:teuthology.orchestra.run.smithi092.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 532 kB/s | 49 kB 00:00 2023-10-16T13:01:05.279 INFO:teuthology.orchestra.run.smithi092.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 587 kB/s | 59 kB 00:00 2023-10-16T13:01:05.314 INFO:teuthology.orchestra.run.smithi118.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 6.3 MB/s | 7.4 MB 00:01 2023-10-16T13:01:05.396 INFO:teuthology.orchestra.run.smithi092.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 516 kB/s | 60 kB 00:00 2023-10-16T13:01:05.672 INFO:teuthology.orchestra.run.smithi152.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 1.9 MB/s | 1.8 MB 00:00 2023-10-16T13:01:05.692 INFO:teuthology.orchestra.run.smithi092.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 970 kB/s | 283 kB 00:00 2023-10-16T13:01:05.755 INFO:teuthology.orchestra.run.smithi092.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 234 kB/s | 16 kB 00:00 2023-10-16T13:01:05.797 INFO:teuthology.orchestra.run.smithi118.stdout:(38/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 7.8 MB/s | 49 MB 00:06 2023-10-16T13:01:05.831 INFO:teuthology.orchestra.run.smithi118.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 283 kB/s | 306 kB 00:01 2023-10-16T13:01:05.840 INFO:teuthology.orchestra.run.smithi092.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 403 kB/s | 34 kB 00:00 2023-10-16T13:01:05.869 INFO:teuthology.orchestra.run.smithi152.stdout:(30/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 1.9 MB/s | 3.6 MB 00:01 2023-10-16T13:01:05.986 INFO:teuthology.orchestra.run.smithi152.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 2.0 MB/s | 242 kB 00:00 2023-10-16T13:01:05.989 INFO:teuthology.orchestra.run.smithi092.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 1.3 MB/s | 196 kB 00:00 2023-10-16T13:01:06.047 INFO:teuthology.orchestra.run.smithi092.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2023-10-16T13:01:06.054 INFO:teuthology.orchestra.run.smithi152.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 712 kB/s | 47 kB 00:00 2023-10-16T13:01:06.056 INFO:teuthology.orchestra.run.smithi118.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-10-16T13:01:06.120 INFO:teuthology.orchestra.run.smithi152.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6730.g4 225 kB/s | 15 kB 00:00 2023-10-16T13:01:06.126 INFO:teuthology.orchestra.run.smithi092.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 239 kB/s | 19 kB 00:00 2023-10-16T13:01:06.165 INFO:teuthology.orchestra.run.smithi118.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 403 kB/s | 44 kB 00:00 2023-10-16T13:01:06.190 INFO:teuthology.orchestra.run.smithi092.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 376 kB/s | 24 kB 00:00 2023-10-16T13:01:06.215 INFO:teuthology.orchestra.run.smithi118.stdout:(42/131): liboath-2.6.2-3.el8.x86_64.rpm 65 kB/s | 59 kB 00:00 2023-10-16T13:01:06.220 INFO:teuthology.orchestra.run.smithi152.stdout:(34/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 2.6 MB/s | 261 kB 00:00 2023-10-16T13:01:06.241 INFO:teuthology.orchestra.run.smithi118.stdout:(43/131): libunwind-1.3.1-3.el8.x86_64.rpm 171 kB/s | 75 kB 00:00 2023-10-16T13:01:06.249 INFO:teuthology.orchestra.run.smithi092.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 502 kB/s | 29 kB 00:00 2023-10-16T13:01:06.269 INFO:teuthology.orchestra.run.smithi118.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.8 MB/s | 185 kB 00:00 2023-10-16T13:01:06.308 INFO:teuthology.orchestra.run.smithi092.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 470 kB/s | 27 kB 00:00 2023-10-16T13:01:06.326 INFO:teuthology.orchestra.run.smithi118.stdout:(45/131): python3-cachetools-3.1.1-4.el8.noarch 328 kB/s | 33 kB 00:00 2023-10-16T13:01:06.337 INFO:teuthology.orchestra.run.smithi152.stdout:(35/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 1.6 MB/s | 192 kB 00:00 2023-10-16T13:01:06.341 INFO:teuthology.orchestra.run.smithi118.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 162 kB/s | 16 kB 00:00 2023-10-16T13:01:06.367 INFO:teuthology.orchestra.run.smithi118.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2023-10-16T13:01:06.404 INFO:teuthology.orchestra.run.smithi152.stdout:(36/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 272 kB/s | 18 kB 00:00 2023-10-16T13:01:06.472 INFO:teuthology.orchestra.run.smithi092.stdout:(63/131): python3-waitress-1.4.3-1.el8.noarch.r 1.6 MB/s | 255 kB 00:00 2023-10-16T13:01:06.483 INFO:teuthology.orchestra.run.smithi118.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-10-16T13:01:06.526 INFO:teuthology.orchestra.run.smithi118.stdout:(49/131): python3-google-auth-1.1.1-10.el8.noar 442 kB/s | 81 kB 00:00 2023-10-16T13:01:06.601 INFO:teuthology.orchestra.run.smithi118.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 150 kB/s | 18 kB 00:00 2023-10-16T13:01:06.629 INFO:teuthology.orchestra.run.smithi118.stdout:(51/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.2 MB/s | 384 kB 00:00 2023-10-16T13:01:06.657 INFO:teuthology.orchestra.run.smithi092.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.3 MB/s | 251 kB 00:00 2023-10-16T13:01:06.701 INFO:teuthology.orchestra.run.smithi118.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 487 kB/s | 49 kB 00:00 2023-10-16T13:01:06.725 INFO:teuthology.orchestra.run.smithi092.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-10-16T13:01:06.737 INFO:teuthology.orchestra.run.smithi118.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 540 kB/s | 59 kB 00:00 2023-10-16T13:01:06.799 INFO:teuthology.orchestra.run.smithi092.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2023-10-16T13:01:06.801 INFO:teuthology.orchestra.run.smithi118.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 601 kB/s | 60 kB 00:00 2023-10-16T13:01:06.848 INFO:teuthology.orchestra.run.smithi118.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2023-10-16T13:01:06.882 INFO:teuthology.orchestra.run.smithi092.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 285 kB/s | 23 kB 00:00 2023-10-16T13:01:06.886 INFO:teuthology.orchestra.run.smithi118.stdout:(56/131): python3-kubernetes-11.0.0-6.el8.noarc 3.2 MB/s | 1.2 MB 00:00 2023-10-16T13:01:06.910 INFO:teuthology.orchestra.run.smithi118.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-10-16T13:01:06.936 INFO:teuthology.orchestra.run.smithi118.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 364 kB/s | 34 kB 00:00 2023-10-16T13:01:06.995 INFO:teuthology.orchestra.run.smithi118.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-10-16T13:01:07.037 INFO:teuthology.orchestra.run.smithi118.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 511 kB/s | 64 kB 00:00 2023-10-16T13:01:07.053 INFO:teuthology.orchestra.run.smithi118.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 160 kB/s | 19 kB 00:00 2023-10-16T13:01:07.095 INFO:teuthology.orchestra.run.smithi118.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 238 kB/s | 24 kB 00:00 2023-10-16T13:01:07.154 INFO:teuthology.orchestra.run.smithi118.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 249 kB/s | 29 kB 00:00 2023-10-16T13:01:07.171 INFO:teuthology.orchestra.run.smithi118.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 235 kB/s | 27 kB 00:00 2023-10-16T13:01:07.213 INFO:teuthology.orchestra.run.smithi118.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.1 MB/s | 255 kB 00:00 2023-10-16T13:01:07.255 INFO:teuthology.orchestra.run.smithi118.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.4 MB/s | 251 kB 00:00 2023-10-16T13:01:07.280 INFO:teuthology.orchestra.run.smithi118.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 562 kB/s | 61 kB 00:00 2023-10-16T13:01:07.322 INFO:teuthology.orchestra.run.smithi118.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 786 kB/s | 85 kB 00:00 2023-10-16T13:01:07.347 INFO:teuthology.orchestra.run.smithi118.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-16T13:01:07.372 INFO:teuthology.orchestra.run.smithi118.stdout:(70/131): python3-zc-lockfile-2.0-2.el8.noarch. 195 kB/s | 23 kB 00:00 2023-10-16T13:01:07.431 INFO:teuthology.orchestra.run.smithi118.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 561 kB/s | 47 kB 00:00 2023-10-16T13:01:07.456 INFO:teuthology.orchestra.run.smithi118.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.3 MB/s | 200 kB 00:00 2023-10-16T13:01:07.482 INFO:teuthology.orchestra.run.smithi118.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 845 kB/s | 43 kB 00:00 2023-10-16T13:01:07.507 INFO:teuthology.orchestra.run.smithi118.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-16T13:01:07.532 INFO:teuthology.orchestra.run.smithi118.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 960 kB/s | 48 kB 00:00 2023-10-16T13:01:07.558 INFO:teuthology.orchestra.run.smithi118.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-16T13:01:07.614 INFO:teuthology.orchestra.run.smithi118.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 524 kB/s | 43 kB 00:00 2023-10-16T13:01:07.650 INFO:teuthology.orchestra.run.smithi118.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 1.2 MB/s | 109 kB 00:00 2023-10-16T13:01:07.675 INFO:teuthology.orchestra.run.smithi118.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.7 MB/s | 229 kB 00:00 2023-10-16T13:01:07.704 INFO:teuthology.orchestra.run.smithi152.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 3.6 MB/s | 7.4 MB 00:02 2023-10-16T13:01:07.717 INFO:teuthology.orchestra.run.smithi118.stdout:(80/131): thrift-0.13.0-2.el8.x86_64.rpm 4.0 MB/s | 1.7 MB 00:00 2023-10-16T13:01:07.742 INFO:teuthology.orchestra.run.smithi118.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 279 kB/s | 19 kB 00:00 2023-10-16T13:01:07.776 INFO:teuthology.orchestra.run.smithi118.stdout:(82/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.3 MB/s | 560 kB 00:00 2023-10-16T13:01:07.801 INFO:teuthology.orchestra.run.smithi118.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.8 MB/s | 155 kB 00:00 2023-10-16T13:01:07.827 INFO:teuthology.orchestra.run.smithi118.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 357 kB/s | 18 kB 00:00 2023-10-16T13:01:07.833 INFO:teuthology.orchestra.run.smithi092.stdout:(68/131): thrift-0.13.0-2.el8.x86_64.rpm 1.8 MB/s | 1.7 MB 00:00 2023-10-16T13:01:07.861 INFO:teuthology.orchestra.run.smithi118.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 4.9 MB/s | 559 kB 00:00 2023-10-16T13:01:07.892 INFO:teuthology.orchestra.run.smithi092.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 70 kB 00:00 2023-10-16T13:01:07.894 INFO:teuthology.orchestra.run.smithi118.stdout:(86/131): pcre2-devel-10.32-2.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2023-10-16T13:01:07.919 INFO:teuthology.orchestra.run.smithi118.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2023-10-16T13:01:07.945 INFO:teuthology.orchestra.run.smithi118.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-10-16T13:01:07.950 INFO:teuthology.orchestra.run.smithi092.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 804 kB/s | 47 kB 00:00 2023-10-16T13:01:07.970 INFO:teuthology.orchestra.run.smithi118.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-16T13:01:07.992 INFO:teuthology.orchestra.run.smithi092.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2023-10-16T13:01:07.995 INFO:teuthology.orchestra.run.smithi118.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-10-16T13:01:08.004 INFO:teuthology.orchestra.run.smithi152.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 191 kB/s | 306 kB 00:01 2023-10-16T13:01:08.020 INFO:teuthology.orchestra.run.smithi118.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-10-16T13:01:08.026 INFO:teuthology.orchestra.run.smithi092.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.3 MB/s | 43 kB 00:00 2023-10-16T13:01:08.046 INFO:teuthology.orchestra.run.smithi118.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-10-16T13:01:08.069 INFO:teuthology.orchestra.run.smithi092.stdout:(73/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2023-10-16T13:01:08.093 INFO:teuthology.orchestra.run.smithi092.stdout:(74/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.9 MB/s | 48 kB 00:00 2023-10-16T13:01:08.096 INFO:teuthology.orchestra.run.smithi118.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 512 kB/s | 39 kB 00:00 2023-10-16T13:01:08.130 INFO:teuthology.orchestra.run.smithi118.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 7.5 MB/s | 644 kB 00:00 2023-10-16T13:01:08.155 INFO:teuthology.orchestra.run.smithi118.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-10-16T13:01:08.160 INFO:teuthology.orchestra.run.smithi092.stdout:(75/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2023-10-16T13:01:08.180 INFO:teuthology.orchestra.run.smithi118.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-10-16T13:01:08.194 INFO:teuthology.orchestra.run.smithi092.stdout:(76/131): python3-requests-oauthlib-1.0.0-1.el8 1.2 MB/s | 43 kB 00:00 2023-10-16T13:01:08.235 INFO:teuthology.orchestra.run.smithi092.stdout:(77/131): python3-pycparser-2.14-14.el8.noarch. 2.6 MB/s | 109 kB 00:00 2023-10-16T13:01:08.238 INFO:teuthology.orchestra.run.smithi118.stdout:(97/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.2 MB/s | 2.3 MB 00:00 2023-10-16T13:01:08.264 INFO:teuthology.orchestra.run.smithi118.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.3 MB/s | 110 kB 00:00 2023-10-16T13:01:08.271 INFO:teuthology.orchestra.run.smithi152.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 282 kB/s | 75 kB 00:00 2023-10-16T13:01:08.278 INFO:teuthology.orchestra.run.smithi092.stdout:(78/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.3 MB/s | 229 kB 00:00 2023-10-16T13:01:08.281 INFO:teuthology.orchestra.run.smithi118.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-10-16T13:01:08.314 INFO:teuthology.orchestra.run.smithi118.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2023-10-16T13:01:08.319 INFO:teuthology.orchestra.run.smithi092.stdout:(79/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 13 MB/s | 560 kB 00:00 2023-10-16T13:01:08.348 INFO:teuthology.orchestra.run.smithi118.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-10-16T13:01:08.353 INFO:teuthology.orchestra.run.smithi092.stdout:(80/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 562 kB/s | 19 kB 00:00 2023-10-16T13:01:08.365 INFO:teuthology.orchestra.run.smithi118.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 773 kB/s | 39 kB 00:00 2023-10-16T13:01:08.407 INFO:teuthology.orchestra.run.smithi118.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-10-16T13:01:08.412 INFO:teuthology.orchestra.run.smithi092.stdout:(81/131): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2023-10-16T13:01:08.440 INFO:teuthology.orchestra.run.smithi118.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.0 MB/s | 538 kB 00:00 2023-10-16T13:01:08.465 INFO:teuthology.orchestra.run.smithi118.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-16T13:01:08.470 INFO:teuthology.orchestra.run.smithi092.stdout:(82/131): python3-cryptography-3.2.1-5.el8.x86_ 9.4 MB/s | 559 kB 00:00 2023-10-16T13:01:08.491 INFO:teuthology.orchestra.run.smithi118.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-10-16T13:01:08.495 INFO:teuthology.orchestra.run.smithi092.stdout:(83/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 720 kB/s | 18 kB 00:00 2023-10-16T13:01:08.546 INFO:teuthology.orchestra.run.smithi092.stdout:(84/131): pcre2-devel-10.32-2.el8.x86_64.rpm 12 MB/s | 605 kB 00:00 2023-10-16T13:01:08.552 INFO:teuthology.orchestra.run.smithi118.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 8.1 MB/s | 713 kB 00:00 2023-10-16T13:01:08.588 INFO:teuthology.orchestra.run.smithi092.stdout:(85/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 5.6 MB/s | 238 kB 00:00 2023-10-16T13:01:08.608 INFO:teuthology.orchestra.run.smithi118.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 481 kB/s | 27 kB 00:00 2023-10-16T13:01:08.659 INFO:teuthology.orchestra.run.smithi118.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-10-16T13:01:08.680 INFO:teuthology.orchestra.run.smithi092.stdout:(86/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 25 MB/s | 2.3 MB 00:00 2023-10-16T13:01:08.713 INFO:teuthology.orchestra.run.smithi092.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 2.1 MB/s | 72 kB 00:00 2023-10-16T13:01:08.734 INFO:teuthology.orchestra.run.smithi118.stdout:(110/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-10-16T13:01:08.755 INFO:teuthology.orchestra.run.smithi092.stdout:(88/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-10-16T13:01:08.759 INFO:teuthology.orchestra.run.smithi118.stdout:(111/131): python3-prettytable-0.7.2-14.el8.noa 439 kB/s | 44 kB 00:00 2023-10-16T13:01:08.763 INFO:teuthology.orchestra.run.smithi152.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 968 kB/s | 476 kB 00:00 2023-10-16T13:01:08.780 INFO:teuthology.orchestra.run.smithi092.stdout:(89/131): elfutils-libelf-devel-0.186-1.el8.x86 2.4 MB/s | 60 kB 00:00 2023-10-16T13:01:08.788 INFO:teuthology.orchestra.run.smithi152.stdout:(41/131): liboath-2.6.2-3.el8.x86_64.rpm 54 kB/s | 59 kB 00:01 2023-10-16T13:01:08.806 INFO:teuthology.orchestra.run.smithi092.stdout:(90/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 3.8 MB/s | 98 kB 00:00 2023-10-16T13:01:08.818 INFO:teuthology.orchestra.run.smithi118.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2023-10-16T13:01:08.839 INFO:teuthology.orchestra.run.smithi092.stdout:(91/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2023-10-16T13:01:08.906 INFO:teuthology.orchestra.run.smithi092.stdout:(92/131): libcom_err-devel-1.45.6-4.el8.x86_64. 578 kB/s | 39 kB 00:00 2023-10-16T13:01:08.965 INFO:teuthology.orchestra.run.smithi092.stdout:(93/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-10-16T13:01:08.977 INFO:teuthology.orchestra.run.smithi118.stdout:(113/131): python3-scipy-1.0.0-21.module+el8.5. 17 MB/s | 14 MB 00:00 2023-10-16T13:01:09.007 INFO:teuthology.orchestra.run.smithi092.stdout:(94/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 4.0 MB/s | 171 kB 00:00 2023-10-16T13:01:09.014 INFO:teuthology.orchestra.run.smithi152.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 174 kB/s | 44 kB 00:00 2023-10-16T13:01:09.030 INFO:teuthology.orchestra.run.smithi118.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.0 MB/s | 225 kB 00:00 2023-10-16T13:01:09.040 INFO:teuthology.orchestra.run.smithi092.stdout:(95/131): NetworkManager-initscripts-updown-1.3 4.1 MB/s | 138 kB 00:00 2023-10-16T13:01:09.094 INFO:teuthology.orchestra.run.smithi118.stdout:(115/131): python3-numpy-1.14.3-10.el8.x86_64.r 10 MB/s | 3.7 MB 00:00 2023-10-16T13:01:09.119 INFO:teuthology.orchestra.run.smithi118.stdout:(116/131): uuid-1.6.2-43.el8.x86_64.rpm 451 kB/s | 64 kB 00:00 2023-10-16T13:01:09.144 INFO:teuthology.orchestra.run.smithi118.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 399 kB/s | 20 kB 00:00 2023-10-16T13:01:09.169 INFO:teuthology.orchestra.run.smithi118.stdout:(118/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 910 kB/s | 126 kB 00:00 2023-10-16T13:01:09.203 INFO:teuthology.orchestra.run.smithi118.stdout:(119/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.2 MB/s | 103 kB 00:00 2023-10-16T13:01:09.245 INFO:teuthology.orchestra.run.smithi118.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 6.9 MB/s | 709 kB 00:00 2023-10-16T13:01:09.264 INFO:teuthology.orchestra.run.smithi152.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 132 kB/s | 33 kB 00:00 2023-10-16T13:01:09.270 INFO:teuthology.orchestra.run.smithi118.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 2.9 MB/s | 198 kB 00:00 2023-10-16T13:01:09.291 INFO:teuthology.orchestra.run.smithi092.stdout:(96/131): python3-scipy-1.0.0-21.module+el8.5.0 55 MB/s | 14 MB 00:00 2023-10-16T13:01:09.321 INFO:teuthology.orchestra.run.smithi118.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.0 MB/s | 202 kB 00:00 2023-10-16T13:01:09.332 INFO:teuthology.orchestra.run.smithi092.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-10-16T13:01:09.400 INFO:teuthology.orchestra.run.smithi092.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 810 kB/s | 54 kB 00:00 2023-10-16T13:01:09.412 INFO:teuthology.orchestra.run.smithi118.stdout:(123/131): openblas-threads-0.3.15-3.el8.x86_64 20 MB/s | 4.9 MB 00:00 2023-10-16T13:01:09.442 INFO:teuthology.orchestra.run.smithi092.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-10-16T13:01:09.446 INFO:teuthology.orchestra.run.smithi118.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.8 MB/s | 354 kB 00:00 2023-10-16T13:01:09.456 INFO:teuthology.orchestra.run.smithi152.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 278 kB/s | 185 kB 00:00 2023-10-16T13:01:09.483 INFO:teuthology.orchestra.run.smithi092.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-10-16T13:01:09.498 INFO:teuthology.orchestra.run.smithi152.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 70 kB/s | 16 kB 00:00 2023-10-16T13:01:09.517 INFO:teuthology.orchestra.run.smithi092.stdout:(101/131): python3-markupsafe-0.23-19.el8.x86_6 1.1 MB/s | 39 kB 00:00 2023-10-16T13:01:09.559 INFO:teuthology.orchestra.run.smithi092.stdout:(102/131): bison-3.0.4-10.el8.x86_64.rpm 16 MB/s | 688 kB 00:00 2023-10-16T13:01:09.601 INFO:teuthology.orchestra.run.smithi092.stdout:(103/131): python3-jinja2-2.10.1-3.el8.noarch.r 13 MB/s | 538 kB 00:00 2023-10-16T13:01:09.668 INFO:teuthology.orchestra.run.smithi092.stdout:(104/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-10-16T13:01:09.710 INFO:teuthology.orchestra.run.smithi092.stdout:(105/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-10-16T13:01:09.741 INFO:teuthology.orchestra.run.smithi118.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 9.6 MB/s | 4.7 MB 00:00 2023-10-16T13:01:09.751 INFO:teuthology.orchestra.run.smithi092.stdout:(106/131): automake-1.16.1-7.el8.noarch.rpm 17 MB/s | 713 kB 00:00 2023-10-16T13:01:09.815 INFO:teuthology.orchestra.run.smithi152.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.2 MB/s | 384 kB 00:00 2023-10-16T13:01:09.830 INFO:teuthology.orchestra.run.smithi118.stdout:(126/131): postgresql-contrib-10.21-2.module+el 2.1 MB/s | 808 kB 00:00 2023-10-16T13:01:09.840 INFO:teuthology.orchestra.run.smithi152.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 449 kB/s | 173 kB 00:00 2023-10-16T13:01:09.889 INFO:teuthology.orchestra.run.smithi118.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 10 MB/s | 1.5 MB 00:00 2023-10-16T13:01:09.902 INFO:teuthology.orchestra.run.smithi092.stdout:(107/131): python3-babel-2.5.1-7.el8.noarch.rpm 32 MB/s | 4.8 MB 00:00 2023-10-16T13:01:09.944 INFO:teuthology.orchestra.run.smithi092.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 639 kB/s | 27 kB 00:00 2023-10-16T13:01:09.986 INFO:teuthology.orchestra.run.smithi092.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.4 MB/s | 320 kB 00:00 2023-10-16T13:01:10.014 INFO:teuthology.orchestra.run.smithi118.stdout:(128/131): postgresql-server-10.21-2.module+el8 8.4 MB/s | 5.1 MB 00:00 2023-10-16T13:01:10.020 INFO:teuthology.orchestra.run.smithi092.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-10-16T13:01:10.064 INFO:teuthology.orchestra.run.smithi118.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-10-16T13:01:10.111 INFO:teuthology.orchestra.run.smithi092.stdout:(111/131): python3-numpy-1.14.3-10.el8.x86_64.r 41 MB/s | 3.7 MB 00:00 2023-10-16T13:01:10.178 INFO:teuthology.orchestra.run.smithi092.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 6.7 MB/s | 457 kB 00:00 2023-10-16T13:01:10.216 INFO:teuthology.orchestra.run.smithi152.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 30 kB/s | 11 kB 00:00 2023-10-16T13:01:10.220 INFO:teuthology.orchestra.run.smithi092.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-10-16T13:01:10.258 INFO:teuthology.orchestra.run.smithi152.stdout:(49/131): python3-google-auth-1.1.1-10.el8.noar 184 kB/s | 81 kB 00:00 2023-10-16T13:01:10.262 INFO:teuthology.orchestra.run.smithi092.stdout:(114/131): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-10-16T13:01:10.304 INFO:teuthology.orchestra.run.smithi092.stdout:(115/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 3.0 MB/s | 126 kB 00:00 2023-10-16T13:01:10.346 INFO:teuthology.orchestra.run.smithi092.stdout:(116/131): python3-jsonpointer-1.10-11.el8.noar 478 kB/s | 20 kB 00:00 2023-10-16T13:01:10.348 INFO:teuthology.orchestra.run.smithi118.stdout:(130/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 8.1 MB/s | 3.7 MB 00:00 2023-10-16T13:01:10.413 INFO:teuthology.orchestra.run.smithi092.stdout:(117/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.5 MB/s | 103 kB 00:00 2023-10-16T13:01:10.455 INFO:teuthology.orchestra.run.smithi092.stdout:(118/131): libtool-2.4.6-25.el8.x86_64.rpm 17 MB/s | 709 kB 00:00 2023-10-16T13:01:10.475 INFO:teuthology.orchestra.run.smithi152.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 68 kB/s | 18 kB 00:00 2023-10-16T13:01:10.506 INFO:teuthology.orchestra.run.smithi118.stdout:(131/131): librados2-18.0.0-6730.g4ba8a190.el8. 5.5 MB/s | 3.7 MB 00:00 2023-10-16T13:01:10.511 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2023-10-16T13:01:10.511 INFO:teuthology.orchestra.run.smithi118.stdout:Total 11 MB/s | 209 MB 00:18 2023-10-16T13:01:10.564 INFO:teuthology.orchestra.run.smithi092.stdout:(119/131): openblas-threads-0.3.15-3.el8.x86_64 45 MB/s | 4.9 MB 00:00 2023-10-16T13:01:10.597 INFO:teuthology.orchestra.run.smithi092.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 5.8 MB/s | 198 kB 00:00 2023-10-16T13:01:10.714 INFO:teuthology.orchestra.run.smithi092.stdout:(121/131): openblas-0.3.15-3.el8.x86_64.rpm 41 MB/s | 4.7 MB 00:00 2023-10-16T13:01:10.742 INFO:teuthology.orchestra.run.smithi152.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 183 kB/s | 49 kB 00:00 2023-10-16T13:01:10.756 INFO:teuthology.orchestra.run.smithi092.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-16T13:01:10.798 INFO:teuthology.orchestra.run.smithi092.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-16T13:01:10.809 INFO:teuthology.orchestra.run.smithi152.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 2.1 MB/s | 1.2 MB 00:00 2023-10-16T13:01:10.948 INFO:teuthology.orchestra.run.smithi092.stdout:(124/131): postgresql-server-10.21-2.module+el8 34 MB/s | 5.1 MB 00:00 2023-10-16T13:01:10.999 INFO:teuthology.orchestra.run.smithi092.stdout:(125/131): postgresql-contrib-10.21-2.module+el 16 MB/s | 808 kB 00:00 2023-10-16T13:01:11.026 INFO:teuthology.orchestra.run.smithi152.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 207 kB/s | 59 kB 00:00 2023-10-16T13:01:11.057 INFO:teuthology.orchestra.run.smithi092.stdout:(126/131): postgresql-10.21-2.module+el8.6.0+15 26 MB/s | 1.5 MB 00:00 2023-10-16T13:01:11.059 INFO:teuthology.orchestra.run.smithi152.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 241 kB/s | 60 kB 00:00 2023-10-16T13:01:11.318 INFO:teuthology.orchestra.run.smithi152.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 60 kB/s | 16 kB 00:00 2023-10-16T13:01:11.336 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2023-10-16T13:01:11.456 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2023-10-16T13:01:11.457 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2023-10-16T13:01:11.683 INFO:teuthology.orchestra.run.smithi092.stdout:(127/131): librados2-18.0.0-6730.g4ba8a190.el8. 6.0 MB/s | 3.7 MB 00:00 2023-10-16T13:01:11.910 INFO:teuthology.orchestra.run.smithi152.stdout:(56/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 3.4 MB/s | 49 MB 00:14 2023-10-16T13:01:11.935 INFO:teuthology.orchestra.run.smithi152.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 311 kB/s | 283 kB 00:00 2023-10-16T13:01:11.952 INFO:teuthology.orchestra.run.smithi152.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 53 kB/s | 34 kB 00:00 2023-10-16T13:01:12.195 INFO:teuthology.orchestra.run.smithi152.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 248 kB/s | 64 kB 00:00 2023-10-16T13:01:12.207 INFO:teuthology.orchestra.run.smithi092.stdout:(128/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 7.1 MB/s | 3.7 MB 00:00 2023-10-16T13:01:12.211 INFO:teuthology.orchestra.run.smithi152.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 72 kB/s | 19 kB 00:00 2023-10-16T13:01:12.258 INFO:teuthology.orchestra.run.smithi092.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-10-16T13:01:12.445 INFO:teuthology.orchestra.run.smithi152.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 96 kB/s | 24 kB 00:00 2023-10-16T13:01:12.462 INFO:teuthology.orchestra.run.smithi152.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 117 kB/s | 29 kB 00:00 2023-10-16T13:01:12.603 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2023-10-16T13:01:12.608 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2023-10-16T13:01:12.704 INFO:teuthology.orchestra.run.smithi152.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 106 kB/s | 27 kB 00:00 2023-10-16T13:01:12.846 INFO:teuthology.orchestra.run.smithi152.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 666 kB/s | 255 kB 00:00 2023-10-16T13:01:12.971 INFO:teuthology.orchestra.run.smithi152.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 941 kB/s | 251 kB 00:00 2023-10-16T13:01:13.105 INFO:teuthology.orchestra.run.smithi152.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 237 kB/s | 61 kB 00:00 2023-10-16T13:01:13.213 INFO:teuthology.orchestra.run.smithi152.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 353 kB/s | 85 kB 00:00 2023-10-16T13:01:13.347 INFO:teuthology.orchestra.run.smithi152.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 95 kB/s | 23 kB 00:00 2023-10-16T13:01:13.381 INFO:teuthology.orchestra.run.smithi152.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.0 MB/s | 70 kB 00:00 2023-10-16T13:01:13.406 INFO:teuthology.orchestra.run.smithi152.stdout:(70/131): python3-routes-2.4.1-12.el8.noarch.rp 131 kB/s | 196 kB 00:01 2023-10-16T13:01:13.457 INFO:teuthology.orchestra.run.smithi152.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 621 kB/s | 47 kB 00:00 2023-10-16T13:01:13.482 INFO:teuthology.orchestra.run.smithi152.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.6 MB/s | 200 kB 00:00 2023-10-16T13:01:13.507 INFO:teuthology.orchestra.run.smithi152.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 843 kB/s | 43 kB 00:00 2023-10-16T13:01:13.533 INFO:teuthology.orchestra.run.smithi152.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-16T13:01:13.558 INFO:teuthology.orchestra.run.smithi152.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 958 kB/s | 48 kB 00:00 2023-10-16T13:01:13.625 INFO:teuthology.orchestra.run.smithi152.stdout:(76/131): thrift-0.13.0-2.el8.x86_64.rpm 4.2 MB/s | 1.7 MB 00:00 2023-10-16T13:01:13.651 INFO:teuthology.orchestra.run.smithi152.stdout:(77/131): libsepol-devel-2.9-3.el8.x86_64.rpm 741 kB/s | 87 kB 00:00 2023-10-16T13:01:13.684 INFO:teuthology.orchestra.run.smithi152.stdout:(78/131): python3-requests-oauthlib-1.0.0-1.el8 339 kB/s | 43 kB 00:00 2023-10-16T13:01:13.710 INFO:teuthology.orchestra.run.smithi152.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.3 MB/s | 109 kB 00:00 2023-10-16T13:01:13.735 INFO:teuthology.orchestra.run.smithi152.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.9 MB/s | 229 kB 00:00 2023-10-16T13:01:13.760 INFO:teuthology.orchestra.run.smithi152.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 372 kB/s | 19 kB 00:00 2023-10-16T13:01:13.777 INFO:teuthology.orchestra.run.smithi152.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.6 MB/s | 155 kB 00:00 2023-10-16T13:01:13.811 INFO:teuthology.orchestra.run.smithi152.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.3 MB/s | 560 kB 00:00 2023-10-16T13:01:13.836 INFO:teuthology.orchestra.run.smithi152.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 305 kB/s | 18 kB 00:00 2023-10-16T13:01:13.869 INFO:teuthology.orchestra.run.smithi152.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 5.0 MB/s | 559 kB 00:00 2023-10-16T13:01:13.895 INFO:teuthology.orchestra.run.smithi152.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-10-16T13:01:13.929 INFO:teuthology.orchestra.run.smithi152.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2023-10-16T13:01:13.970 INFO:teuthology.orchestra.run.smithi152.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 962 kB/s | 72 kB 00:00 2023-10-16T13:01:13.996 INFO:teuthology.orchestra.run.smithi152.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2023-10-16T13:01:14.013 INFO:teuthology.orchestra.run.smithi152.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.4 MB/s | 60 kB 00:00 2023-10-16T13:01:14.062 INFO:teuthology.orchestra.run.smithi152.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.5 MB/s | 98 kB 00:00 2023-10-16T13:01:14.089 INFO:teuthology.orchestra.run.smithi152.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 766 kB/s | 58 kB 00:00 2023-10-16T13:01:14.114 INFO:teuthology.orchestra.run.smithi152.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 748 kB/s | 39 kB 00:00 2023-10-16T13:01:14.147 INFO:teuthology.orchestra.run.smithi152.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-10-16T13:01:14.173 INFO:teuthology.orchestra.run.smithi152.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-10-16T13:01:14.198 INFO:teuthology.orchestra.run.smithi152.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-10-16T13:01:14.257 INFO:teuthology.orchestra.run.smithi152.stdout:(97/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.0 MB/s | 2.3 MB 00:00 2023-10-16T13:01:14.274 INFO:teuthology.orchestra.run.smithi152.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2023-10-16T13:01:14.299 INFO:teuthology.orchestra.run.smithi152.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-10-16T13:01:14.325 INFO:teuthology.orchestra.run.smithi152.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2023-10-16T13:01:14.358 INFO:teuthology.orchestra.run.smithi152.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-10-16T13:01:14.383 INFO:teuthology.orchestra.run.smithi152.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 664 kB/s | 39 kB 00:00 2023-10-16T13:01:14.425 INFO:teuthology.orchestra.run.smithi152.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-10-16T13:01:14.459 INFO:teuthology.orchestra.run.smithi152.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.0 MB/s | 538 kB 00:00 2023-10-16T13:01:14.484 INFO:teuthology.orchestra.run.smithi152.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-16T13:01:14.535 INFO:teuthology.orchestra.run.smithi152.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 2.4 MB/s | 187 kB 00:00 2023-10-16T13:01:14.577 INFO:teuthology.orchestra.run.smithi152.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 7.6 MB/s | 713 kB 00:00 2023-10-16T13:01:14.610 INFO:teuthology.orchestra.run.smithi152.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 796 kB/s | 27 kB 00:00 2023-10-16T13:01:14.652 INFO:teuthology.orchestra.run.smithi152.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-16T13:01:14.686 INFO:teuthology.orchestra.run.smithi152.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-10-16T13:01:14.787 INFO:teuthology.orchestra.run.smithi152.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2023-10-16T13:01:14.828 INFO:teuthology.orchestra.run.smithi152.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2023-10-16T13:01:14.870 INFO:teuthology.orchestra.run.smithi152.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-10-16T13:01:14.929 INFO:teuthology.orchestra.run.smithi152.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 15 MB/s | 3.7 MB 00:00 2023-10-16T13:01:14.987 INFO:teuthology.orchestra.run.smithi152.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 550 kB/s | 64 kB 00:00 2023-10-16T13:01:15.013 INFO:teuthology.orchestra.run.smithi152.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.5 MB/s | 126 kB 00:00 2023-10-16T13:01:15.038 INFO:teuthology.orchestra.run.smithi152.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 393 kB/s | 20 kB 00:00 2023-10-16T13:01:15.064 INFO:teuthology.orchestra.run.smithi152.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-10-16T13:01:15.097 INFO:teuthology.orchestra.run.smithi152.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-10-16T13:01:15.140 INFO:teuthology.orchestra.run.smithi152.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-10-16T13:01:15.290 INFO:teuthology.orchestra.run.smithi152.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 12 MB/s | 14 MB 00:01 2023-10-16T13:01:15.331 INFO:teuthology.orchestra.run.smithi152.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-16T13:01:15.373 INFO:teuthology.orchestra.run.smithi152.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-16T13:01:15.499 INFO:teuthology.orchestra.run.smithi152.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 11 MB/s | 4.9 MB 00:00 2023-10-16T13:01:15.816 INFO:teuthology.orchestra.run.smithi152.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 7.0 MB/s | 4.7 MB 00:00 2023-10-16T13:01:15.933 INFO:teuthology.orchestra.run.smithi152.stdout:(126/131): postgresql-contrib-10.21-2.module+el 1.8 MB/s | 808 kB 00:00 2023-10-16T13:01:15.992 INFO:teuthology.orchestra.run.smithi152.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 8.6 MB/s | 1.5 MB 00:00 2023-10-16T13:01:16.084 INFO:teuthology.orchestra.run.smithi152.stdout:(128/131): postgresql-server-10.21-2.module+el8 7.1 MB/s | 5.1 MB 00:00 2023-10-16T13:01:16.134 INFO:teuthology.orchestra.run.smithi152.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-10-16T13:01:17.542 INFO:teuthology.orchestra.run.smithi152.stdout:(130/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 2.4 MB/s | 3.7 MB 00:01 2023-10-16T13:01:17.714 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2023-10-16T13:01:17.865 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-16T13:01:18.039 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-16T13:01:18.234 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-16T13:01:18.337 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-16T13:01:18.459 INFO:teuthology.orchestra.run.smithi152.stdout:(131/131): librados2-18.0.0-6730.g4ba8a190.el8. 1.5 MB/s | 3.7 MB 00:02 2023-10-16T13:01:18.464 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-10-16T13:01:18.464 INFO:teuthology.orchestra.run.smithi152.stdout:Total 7.4 MB/s | 209 MB 00:28 2023-10-16T13:01:18.584 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-16T13:01:18.993 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-16T13:01:19.267 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-16T13:01:19.327 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-10-16T13:01:19.448 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-10-16T13:01:19.449 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-10-16T13:01:19.661 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-16T13:01:19.833 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T13:01:19.960 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T13:01:20.142 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T13:01:20.244 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T13:01:20.590 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-10-16T13:01:20.595 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-10-16T13:01:20.705 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T13:01:20.878 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-16T13:01:21.133 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-16T13:01:21.329 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-16T13:01:21.730 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-16T13:01:21.998 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-16T13:01:22.133 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T13:01:22.234 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T13:01:22.411 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T13:01:22.550 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T13:01:22.770 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-16T13:01:22.974 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-16T13:01:23.130 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-16T13:01:23.249 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-16T13:01:23.407 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-16T13:01:23.557 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-16T13:01:24.173 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-16T13:01:24.383 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-16T13:01:24.980 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-16T13:01:25.215 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-16T13:01:25.591 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-10-16T13:01:25.771 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-16T13:01:25.905 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-16T13:01:25.996 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-16T13:01:26.155 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-16T13:01:26.156 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-16T13:01:26.256 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-16T13:01:26.346 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-16T13:01:26.490 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-16T13:01:26.585 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-16T13:01:26.797 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-16T13:01:26.906 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-16T13:01:26.926 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-16T13:01:27.106 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-16T13:01:27.170 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-16T13:01:27.374 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-16T13:01:27.536 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-16T13:01:27.731 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T13:01:27.855 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T13:01:28.031 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T13:01:28.153 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T13:01:28.334 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T13:01:28.491 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-16T13:01:28.745 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-16T13:01:28.959 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-16T13:01:29.130 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-16T13:01:29.380 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-16T13:01:29.630 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-16T13:01:29.748 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T13:01:29.855 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T13:01:30.023 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T13:01:30.143 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-16T13:01:30.165 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T13:01:30.435 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-16T13:01:30.454 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-16T13:01:30.610 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-16T13:01:30.717 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-16T13:01:30.782 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-16T13:01:30.947 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-16T13:01:31.011 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-16T13:01:31.085 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-16T13:01:31.239 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-16T13:01:31.511 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-16T13:01:31.692 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-16T13:01:31.883 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-16T13:01:31.887 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-16T13:01:32.031 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-16T13:01:32.046 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-16T13:01:32.189 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-16T13:01:32.356 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-16T13:01:32.531 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-16T13:01:32.607 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-16T13:01:32.614 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-16T13:01:32.805 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-16T13:01:32.840 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-16T13:01:33.060 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-16T13:01:33.198 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-16T13:01:33.302 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-16T13:01:33.484 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-16T13:01:33.506 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-16T13:01:33.546 INFO:teuthology.orchestra.run.smithi092.stdout:(130/131): gperftools-libs-2.7-9.el8.x86_64.rpm 9.5 kB/s | 306 kB 00:32 2023-10-16T13:01:33.652 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-16T13:01:33.737 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-16T13:01:33.840 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-16T13:01:33.928 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-16T13:01:34.009 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-16T13:01:34.182 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-16T13:01:34.183 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-16T13:01:34.359 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-16T13:01:34.361 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-16T13:01:34.516 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-16T13:01:34.571 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-16T13:01:34.726 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-16T13:01:34.794 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-16T13:01:34.947 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-16T13:01:35.150 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-16T13:01:35.465 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-16T13:01:35.700 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-16T13:01:35.935 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-16T13:01:36.186 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-16T13:01:36.488 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-16T13:01:36.712 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-16T13:01:36.755 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-16T13:01:36.953 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-16T13:01:37.211 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-16T13:01:37.367 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-16T13:01:37.575 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-16T13:01:37.686 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-16T13:01:37.871 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-16T13:01:38.003 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-16T13:01:38.125 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-16T13:01:38.299 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-16T13:01:38.360 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-16T13:01:38.506 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-16T13:01:38.615 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-16T13:01:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-16T13:01:38.746 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-16T13:01:38.915 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-16T13:01:38.916 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-16T13:01:39.102 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-16T13:01:39.218 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-16T13:01:39.261 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-16T13:01:39.422 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-16T13:01:39.441 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-16T13:01:39.597 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-16T13:01:39.619 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-16T13:01:39.754 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-16T13:01:39.765 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-16T13:01:39.827 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-16T13:01:39.988 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-16T13:01:40.070 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-16T13:01:40.185 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-16T13:01:40.283 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-16T13:01:40.414 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-16T13:01:40.456 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-16T13:01:40.513 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-16T13:01:40.583 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-16T13:01:40.724 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-16T13:01:40.731 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-16T13:01:40.891 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-16T13:01:40.979 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-16T13:01:41.036 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-16T13:01:41.197 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-16T13:01:41.209 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-16T13:01:41.390 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-16T13:01:41.428 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-16T13:01:41.541 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-16T13:01:41.659 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-16T13:01:41.946 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-16T13:01:42.096 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-16T13:01:42.120 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-16T13:01:42.269 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-16T13:01:42.338 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-16T13:01:42.634 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-16T13:01:42.947 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-16T13:01:43.198 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-16T13:01:43.417 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-16T13:01:43.441 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-16T13:01:43.675 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-16T13:01:43.725 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-16T13:01:43.971 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-16T13:01:43.978 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-16T13:01:44.236 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-16T13:01:44.256 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-16T13:01:44.413 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-16T13:01:44.535 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-16T13:01:44.658 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-16T13:01:44.764 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-16T13:01:44.816 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-16T13:01:45.015 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-16T13:01:45.288 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-16T13:01:45.561 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-16T13:01:45.566 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-16T13:01:45.771 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T13:01:45.816 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-16T13:01:45.840 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T13:01:45.996 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-16T13:01:46.080 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-16T13:01:46.236 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-16T13:01:46.431 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-16T13:01:46.688 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-16T13:01:46.951 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-16T13:01:47.082 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-16T13:01:47.222 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-16T13:01:47.429 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-16T13:01:47.623 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-16T13:01:47.840 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-16T13:01:48.026 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-16T13:01:48.201 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-16T13:01:48.426 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-16T13:01:48.699 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-16T13:01:48.876 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-16T13:01:49.111 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-16T13:01:49.302 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-16T13:01:49.468 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-16T13:01:49.727 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-16T13:01:49.754 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T13:01:49.987 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T13:01:50.575 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T13:01:50.807 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T13:01:50.834 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-16T13:01:50.912 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T13:01:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T13:01:51.123 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-16T13:01:51.378 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-16T13:01:51.680 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-16T13:01:51.993 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-16T13:01:52.190 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-16T13:01:53.061 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-16T13:01:53.261 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T13:01:53.335 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T13:01:53.477 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-16T13:01:57.256 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T13:01:57.452 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T13:01:58.040 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T13:01:58.344 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T13:01:58.430 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T13:01:58.560 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T13:02:06.264 INFO:teuthology.orchestra.run.smithi092.stdout:(131/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.2 kB/s | 75 kB 01:04 2023-10-16T13:02:06.270 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-10-16T13:02:06.270 INFO:teuthology.orchestra.run.smithi092.stdout:Total 2.8 MB/s | 209 MB 01:15 2023-10-16T13:02:07.047 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-10-16T13:02:07.167 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-10-16T13:02:07.167 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-10-16T13:02:08.297 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-10-16T13:02:08.301 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-10-16T13:02:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T13:02:09.987 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /sys 2023-10-16T13:02:09.987 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /proc 2023-10-16T13:02:09.987 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /dev 2023-10-16T13:02:09.987 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /run 2023-10-16T13:02:09.988 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /mnt 2023-10-16T13:02:09.988 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /var/tmp 2023-10-16T13:02:09.988 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /home 2023-10-16T13:02:09.988 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /tmp 2023-10-16T13:02:09.988 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /dev 2023-10-16T13:02:09.989 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-16T13:02:10.334 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T13:02:11.920 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T13:02:12.087 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T13:02:12.306 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T13:02:12.467 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T13:02:12.937 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T13:02:13.075 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T13:02:13.091 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T13:02:13.503 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-10-16T13:02:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-16T13:02:13.886 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-16T13:02:14.055 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-16T13:02:14.193 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-16T13:02:14.430 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-16T13:02:14.816 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T13:02:14.854 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-16T13:02:15.014 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T13:02:15.080 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-16T13:02:15.130 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-16T13:02:15.348 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-16T13:02:15.522 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-16T13:02:15.533 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T13:02:15.738 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T13:02:15.754 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T13:02:15.872 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T13:02:16.044 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T13:02:16.130 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T13:02:16.252 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T13:02:16.396 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T13:02:16.589 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-16T13:02:16.825 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-16T13:02:17.004 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T13:02:17.041 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-16T13:02:17.232 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T13:02:17.323 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T13:02:17.405 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-16T13:02:17.661 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-16T13:02:17.739 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-16T13:02:17.778 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T13:02:17.779 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2023-10-16T13:02:17.779 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2023-10-16T13:02:17.779 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /dev 2023-10-16T13:02:17.779 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /run 2023-10-16T13:02:17.779 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2023-10-16T13:02:17.780 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2023-10-16T13:02:17.780 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2023-10-16T13:02:17.780 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2023-10-16T13:02:17.780 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /dev 2023-10-16T13:02:17.780 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T13:02:17.838 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T13:02:17.934 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T13:02:17.946 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T13:02:17.970 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T13:02:18.115 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T13:02:18.129 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T13:02:18.157 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T13:02:18.169 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T13:02:18.274 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T13:02:18.533 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-16T13:02:18.702 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-16T13:02:18.910 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-16T13:02:19.070 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-16T13:02:19.212 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-16T13:02:19.412 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-16T13:02:19.504 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-16T13:02:19.705 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T13:02:19.708 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T13:02:19.741 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T13:02:19.866 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T13:02:19.891 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T13:02:19.933 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T13:02:20.028 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-16T13:02:20.083 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T13:02:20.085 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T13:02:20.196 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-16T13:02:20.273 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T13:02:20.455 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T13:02:20.599 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T13:02:20.740 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T13:02:20.787 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-16T13:02:20.890 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T13:02:20.906 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T13:02:20.953 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-16T13:02:21.682 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-16T13:02:21.943 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-16T13:02:22.151 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-16T13:02:22.413 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-16T13:02:22.618 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-16T13:02:22.642 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T13:02:22.739 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-16T13:02:22.835 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T13:02:22.983 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-16T13:02:22.987 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-16T13:02:23.172 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-16T13:02:23.195 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-16T13:02:23.389 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T13:02:23.611 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T13:02:23.915 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T13:02:24.879 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T13:02:24.942 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-16T13:02:25.055 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T13:02:25.149 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T13:02:25.244 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T13:02:25.558 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-16T13:02:25.796 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T13:02:25.832 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T13:02:25.980 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T13:02:25.991 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T13:02:25.999 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-16T13:02:26.108 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-16T13:02:26.426 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-16T13:02:26.510 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-16T13:02:26.625 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 117/134 2023-10-16T13:02:26.799 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-16T13:02:26.887 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-16T13:02:27.046 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-16T13:02:27.072 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-16T13:02:27.266 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-16T13:02:27.281 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-16T13:02:27.365 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-16T13:02:27.454 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-16T13:02:27.527 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-16T13:02:27.582 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T13:02:27.616 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T13:02:27.641 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-16T13:02:27.710 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-16T13:02:27.764 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T13:02:27.806 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T13:02:27.825 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-16T13:02:27.857 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-16T13:02:27.989 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T13:02:27.992 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-16T13:02:28.120 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-16T13:02:28.335 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-16T13:02:28.366 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T13:02:28.406 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-16T13:02:28.505 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T13:02:28.660 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-16T13:02:28.901 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-16T13:02:29.077 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-16T13:02:29.143 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-16T13:02:29.364 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-16T13:02:29.547 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-16T13:02:29.700 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-16T13:02:29.920 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-16T13:02:30.092 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T13:02:30.129 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-16T13:02:30.263 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-16T13:02:30.357 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T13:02:30.376 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T13:02:30.482 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-16T13:02:30.531 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-16T13:02:30.699 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-16T13:02:30.805 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-16T13:02:31.105 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-16T13:02:31.107 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-16T13:02:31.411 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-16T13:02:31.480 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-16T13:02:31.662 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-16T13:02:31.663 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-16T13:02:31.744 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-16T13:02:31.922 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-16T13:02:31.956 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-16T13:02:31.968 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-16T13:02:32.114 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-16T13:02:32.122 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-16T13:02:32.172 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-16T13:02:32.282 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-16T13:02:32.283 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T13:02:32.491 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T13:02:32.492 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T13:02:32.526 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-16T13:02:32.751 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T13:02:32.775 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-16T13:02:32.946 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T13:02:32.996 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-16T13:02:33.149 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T13:02:33.230 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-16T13:02:33.429 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-16T13:02:33.462 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T13:02:33.463 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-16T13:02:33.463 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-16T13:02:33.463 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-16T13:02:33.463 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-16T13:02:33.463 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-16T13:02:33.464 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T13:02:33.464 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T13:02:33.464 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T13:02:33.464 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-16T13:02:33.464 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-16T13:02:33.465 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-16T13:02:33.465 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-16T13:02:33.465 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-16T13:02:33.465 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-16T13:02:33.465 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-16T13:02:33.466 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-16T13:02:33.466 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-16T13:02:33.466 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-16T13:02:33.466 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-16T13:02:33.466 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-16T13:02:33.467 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-16T13:02:33.467 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-16T13:02:33.467 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-16T13:02:33.467 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-16T13:02:33.467 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-16T13:02:33.468 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-16T13:02:33.468 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-16T13:02:33.468 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-16T13:02:33.468 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-16T13:02:33.468 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-16T13:02:33.468 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-16T13:02:33.469 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-16T13:02:33.469 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-16T13:02:33.469 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-16T13:02:33.469 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-16T13:02:33.469 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-16T13:02:33.470 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-16T13:02:33.470 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-16T13:02:33.470 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-16T13:02:33.470 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-16T13:02:33.470 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-16T13:02:33.471 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-16T13:02:33.471 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-16T13:02:33.471 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-16T13:02:33.471 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-16T13:02:33.471 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-16T13:02:33.472 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-16T13:02:33.472 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-16T13:02:33.472 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-16T13:02:33.472 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-16T13:02:33.472 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-16T13:02:33.473 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-16T13:02:33.473 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-16T13:02:33.473 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-16T13:02:33.473 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-16T13:02:33.473 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-16T13:02:33.473 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-16T13:02:33.474 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-16T13:02:33.474 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-16T13:02:33.474 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-16T13:02:33.474 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-16T13:02:33.474 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-16T13:02:33.475 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-16T13:02:33.475 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-16T13:02:33.475 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-16T13:02:33.475 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-16T13:02:33.475 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-16T13:02:33.476 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-16T13:02:33.476 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-16T13:02:33.476 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-16T13:02:33.476 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-16T13:02:33.476 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-16T13:02:33.477 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-16T13:02:33.477 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-16T13:02:33.477 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-16T13:02:33.477 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-16T13:02:33.477 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-16T13:02:33.478 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-16T13:02:33.478 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-16T13:02:33.478 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-16T13:02:33.478 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-16T13:02:33.478 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-16T13:02:33.479 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-16T13:02:33.479 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-16T13:02:33.479 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-16T13:02:33.479 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-16T13:02:33.479 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-16T13:02:33.480 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-16T13:02:33.480 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-16T13:02:33.480 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-16T13:02:33.480 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-16T13:02:33.480 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-16T13:02:33.480 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-16T13:02:33.481 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-16T13:02:33.481 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-16T13:02:33.481 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-16T13:02:33.481 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-16T13:02:33.481 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-16T13:02:33.482 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-16T13:02:33.482 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-16T13:02:33.482 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-16T13:02:33.482 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-16T13:02:33.482 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-16T13:02:33.483 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-16T13:02:33.483 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-16T13:02:33.483 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-16T13:02:33.483 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-16T13:02:33.483 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-16T13:02:33.484 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-16T13:02:33.484 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-16T13:02:33.484 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-16T13:02:33.484 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-16T13:02:33.484 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-16T13:02:33.485 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-16T13:02:33.485 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-16T13:02:33.485 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-16T13:02:33.485 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-16T13:02:33.485 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-16T13:02:33.485 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-16T13:02:33.486 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-16T13:02:33.486 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-16T13:02:33.486 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-16T13:02:33.486 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-16T13:02:33.486 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-16T13:02:33.487 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-16T13:02:33.487 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-16T13:02:33.487 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-16T13:02:33.487 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-16T13:02:33.487 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-16T13:02:33.488 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-16T13:02:33.488 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-16T13:02:33.488 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T13:02:33.488 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-16T13:02:33.595 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-16T13:02:33.923 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-16T13:02:34.046 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-16T13:02:34.179 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-16T13:02:34.391 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-16T13:02:34.422 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-16T13:02:34.565 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 117/134 2023-10-16T13:02:34.678 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-16T13:02:34.825 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-16T13:02:34.827 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-16T13:02:34.978 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-16T13:02:35.036 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-16T13:02:35.172 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-16T13:02:35.301 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-16T13:02:35.400 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-16T13:02:35.548 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-16T13:02:35.588 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-16T13:02:35.737 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-16T13:02:35.738 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-16T13:02:35.888 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T13:02:35.888 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:56 ago on Mon 16 Oct 2023 01:00:39 PM UTC. 2023-10-16T13:02:35.893 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-16T13:02:36.117 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-16T13:02:36.336 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-16T13:02:36.552 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-16T13:02:36.719 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-16T13:02:36.899 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-16T13:02:37.158 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-16T13:02:37.462 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-16T13:02:37.672 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-16T13:02:37.946 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-16T13:02:37.978 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T13:02:38.165 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-16T13:02:38.212 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T13:02:38.229 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T13:02:38.374 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-16T13:02:38.404 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-16T13:02:38.445 INFO:teuthology.orchestra.run.smithi118.stdout:Installed products updated. 2023-10-16T13:02:38.642 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-16T13:02:38.657 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-16T13:02:38.657 INFO:teuthology.orchestra.run.smithi118.stdout:Upgraded: 2023-10-16T13:02:38.658 INFO:teuthology.orchestra.run.smithi118.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-16T13:02:38.658 INFO:teuthology.orchestra.run.smithi118.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.658 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.658 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2023-10-16T13:02:38.658 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-16T13:02:38.659 INFO:teuthology.orchestra.run.smithi118.stdout: automake-1.16.1-7.el8.noarch 2023-10-16T13:02:38.659 INFO:teuthology.orchestra.run.smithi118.stdout: bison-3.0.4-10.el8.x86_64 2023-10-16T13:02:38.659 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.659 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.659 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.660 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.660 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:38.660 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.660 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.660 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.661 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:38.661 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:38.661 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:38.661 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:38.661 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:38.661 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.662 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.662 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:38.662 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.663 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.663 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.663 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:38.663 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:38.663 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.664 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:38.664 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-16T13:02:38.664 INFO:teuthology.orchestra.run.smithi118.stdout: flex-2.6.1-9.el8.x86_64 2023-10-16T13:02:38.664 INFO:teuthology.orchestra.run.smithi118.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-16T13:02:38.664 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-16T13:02:38.665 INFO:teuthology.orchestra.run.smithi118.stdout: jq-1.6-3.el8.x86_64 2023-10-16T13:02:38.665 INFO:teuthology.orchestra.run.smithi118.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-16T13:02:38.665 INFO:teuthology.orchestra.run.smithi118.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-16T13:02:38.665 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-16T13:02:38.665 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.666 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.666 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.666 INFO:teuthology.orchestra.run.smithi118.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-16T13:02:38.666 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-16T13:02:38.666 INFO:teuthology.orchestra.run.smithi118.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-16T13:02:38.667 INFO:teuthology.orchestra.run.smithi118.stdout: libpq-13.5-1.el8.x86_64 2023-10-16T13:02:38.667 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-16T13:02:38.667 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-16T13:02:38.667 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.667 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.668 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-16T13:02:38.668 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.668 INFO:teuthology.orchestra.run.smithi118.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-16T13:02:38.668 INFO:teuthology.orchestra.run.smithi118.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-16T13:02:38.668 INFO:teuthology.orchestra.run.smithi118.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-16T13:02:38.668 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-16T13:02:38.669 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-16T13:02:38.669 INFO:teuthology.orchestra.run.smithi118.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-16T13:02:38.669 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-16T13:02:38.669 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-16T13:02:38.669 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-16T13:02:38.670 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-16T13:02:38.670 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-16T13:02:38.670 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-16T13:02:38.670 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-16T13:02:38.670 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-16T13:02:38.671 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T13:02:38.671 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T13:02:38.671 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T13:02:38.671 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-16T13:02:38.671 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-16T13:02:38.672 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-16T13:02:38.672 INFO:teuthology.orchestra.run.smithi118.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-16T13:02:38.672 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-16T13:02:38.672 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.672 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.673 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.673 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-16T13:02:38.673 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-16T13:02:38.673 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-16T13:02:38.673 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-16T13:02:38.673 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-16T13:02:38.674 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-16T13:02:38.674 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-16T13:02:38.674 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-16T13:02:38.674 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-16T13:02:38.674 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-16T13:02:38.675 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-16T13:02:38.675 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-16T13:02:38.675 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-16T13:02:38.675 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-16T13:02:38.675 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-16T13:02:38.676 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-16T13:02:38.676 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-16T13:02:38.676 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-16T13:02:38.676 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-16T13:02:38.676 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-16T13:02:38.676 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-16T13:02:38.677 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-16T13:02:38.677 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend-2.6-1.el8.noarch 2023-10-16T13:02:38.677 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-16T13:02:38.677 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-16T13:02:38.677 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-16T13:02:38.678 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-16T13:02:38.678 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-16T13:02:38.678 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-16T13:02:38.678 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.678 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.678 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-16T13:02:38.679 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-16T13:02:38.679 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.679 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-16T13:02:38.679 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-16T13:02:38.679 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-16T13:02:38.680 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-16T13:02:38.680 INFO:teuthology.orchestra.run.smithi118.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-16T13:02:38.680 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-16T13:02:38.680 INFO:teuthology.orchestra.run.smithi118.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-16T13:02:38.680 INFO:teuthology.orchestra.run.smithi118.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-16T13:02:38.680 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-16T13:02:38.681 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-16T13:02:38.681 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-16T13:02:38.681 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-16T13:02:38.681 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-16T13:02:38.681 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.682 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.682 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:38.682 INFO:teuthology.orchestra.run.smithi118.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-16T13:02:38.682 INFO:teuthology.orchestra.run.smithi118.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-16T13:02:38.682 INFO:teuthology.orchestra.run.smithi118.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-16T13:02:38.683 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-16T13:02:38.683 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-16T13:02:38.683 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-16T13:02:38.683 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-16T13:02:38.684 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2023-10-16T13:02:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-16T13:02:38.865 DEBUG:teuthology.parallel:result is None 2023-10-16T13:02:39.020 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-16T13:02:39.422 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-16T13:02:39.594 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-16T13:02:39.674 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-16T13:02:39.779 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-16T13:02:39.886 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-16T13:02:39.900 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-16T13:02:40.053 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-16T13:02:40.061 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-16T13:02:40.078 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-16T13:02:40.222 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-16T13:02:40.222 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T13:02:40.391 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-16T13:02:40.414 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T13:02:40.415 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T13:02:40.659 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T13:02:40.694 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-16T13:02:40.827 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T13:02:40.997 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-16T13:02:41.232 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-16T13:02:41.338 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T13:02:41.339 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-16T13:02:41.339 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-16T13:02:41.339 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-16T13:02:41.339 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-16T13:02:41.340 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-16T13:02:41.340 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T13:02:41.340 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T13:02:41.340 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T13:02:41.340 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-16T13:02:41.341 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-16T13:02:41.341 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-16T13:02:41.341 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-16T13:02:41.341 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-16T13:02:41.341 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-16T13:02:41.342 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-16T13:02:41.342 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-16T13:02:41.342 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-16T13:02:41.342 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-16T13:02:41.342 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-16T13:02:41.343 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-16T13:02:41.343 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-16T13:02:41.343 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-16T13:02:41.343 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-16T13:02:41.343 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-16T13:02:41.344 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-16T13:02:41.344 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-16T13:02:41.344 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-16T13:02:41.344 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-16T13:02:41.344 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-16T13:02:41.345 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-16T13:02:41.345 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-16T13:02:41.354 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-16T13:02:41.354 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-16T13:02:41.355 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-16T13:02:41.355 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-16T13:02:41.355 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-16T13:02:41.355 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-16T13:02:41.355 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-16T13:02:41.356 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-16T13:02:41.356 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-16T13:02:41.356 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-16T13:02:41.356 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-16T13:02:41.356 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-16T13:02:41.357 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-16T13:02:41.357 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-16T13:02:41.357 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-16T13:02:41.357 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-16T13:02:41.357 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-16T13:02:41.358 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-16T13:02:41.358 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-16T13:02:41.358 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-16T13:02:41.358 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-16T13:02:41.358 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-16T13:02:41.359 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-16T13:02:41.359 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-16T13:02:41.359 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-16T13:02:41.359 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-16T13:02:41.359 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-16T13:02:41.360 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-16T13:02:41.360 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-16T13:02:41.360 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-16T13:02:41.360 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-16T13:02:41.360 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-16T13:02:41.361 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-16T13:02:41.361 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-16T13:02:41.361 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-16T13:02:41.361 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-16T13:02:41.361 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-16T13:02:41.362 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-16T13:02:41.362 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-16T13:02:41.362 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-16T13:02:41.362 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-16T13:02:41.362 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-16T13:02:41.363 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-16T13:02:41.363 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-16T13:02:41.363 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-16T13:02:41.363 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-16T13:02:41.363 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-16T13:02:41.364 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-16T13:02:41.364 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-16T13:02:41.364 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-16T13:02:41.364 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-16T13:02:41.364 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-16T13:02:41.365 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-16T13:02:41.365 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-16T13:02:41.365 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-16T13:02:41.365 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-16T13:02:41.365 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-16T13:02:41.366 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-16T13:02:41.366 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-16T13:02:41.366 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-16T13:02:41.366 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-16T13:02:41.366 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-16T13:02:41.367 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-16T13:02:41.367 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-16T13:02:41.367 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-16T13:02:41.367 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-16T13:02:41.367 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-16T13:02:41.367 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-16T13:02:41.368 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-16T13:02:41.368 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-16T13:02:41.368 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-16T13:02:41.368 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-16T13:02:41.368 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-16T13:02:41.369 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-16T13:02:41.369 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-16T13:02:41.369 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-16T13:02:41.369 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-16T13:02:41.369 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-16T13:02:41.369 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-16T13:02:41.370 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-16T13:02:41.370 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-16T13:02:41.370 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-16T13:02:41.370 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-16T13:02:41.370 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-16T13:02:41.371 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-16T13:02:41.371 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-16T13:02:41.371 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-16T13:02:41.371 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-16T13:02:41.371 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-16T13:02:41.372 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-16T13:02:41.372 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-16T13:02:41.372 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-16T13:02:41.372 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-16T13:02:41.372 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-16T13:02:41.373 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-16T13:02:41.373 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-16T13:02:41.373 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-16T13:02:41.373 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-16T13:02:41.373 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-16T13:02:41.374 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-16T13:02:41.374 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T13:02:41.374 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-16T13:02:42.117 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-16T13:02:42.273 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T13:02:42.332 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T13:02:42.516 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-16T13:02:43.963 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T13:02:43.963 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:05 ago on Mon 16 Oct 2023 01:00:38 PM UTC. 2023-10-16T13:02:46.293 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T13:02:46.712 INFO:teuthology.orchestra.run.smithi152.stdout:Installed products updated. 2023-10-16T13:02:46.925 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T13:02:46.926 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2023-10-16T13:02:46.926 INFO:teuthology.orchestra.run.smithi152.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-16T13:02:46.926 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.926 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.927 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-10-16T13:02:46.927 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-16T13:02:46.927 INFO:teuthology.orchestra.run.smithi152.stdout: automake-1.16.1-7.el8.noarch 2023-10-16T13:02:46.927 INFO:teuthology.orchestra.run.smithi152.stdout: bison-3.0.4-10.el8.x86_64 2023-10-16T13:02:46.927 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.928 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.928 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.928 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.928 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:46.928 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.929 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.929 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.929 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:46.929 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:46.929 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:46.930 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:46.930 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:46.930 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.930 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.930 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:46.931 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.931 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.931 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.931 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:46.931 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:46.931 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.932 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:02:46.932 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-16T13:02:46.932 INFO:teuthology.orchestra.run.smithi152.stdout: flex-2.6.1-9.el8.x86_64 2023-10-16T13:02:46.932 INFO:teuthology.orchestra.run.smithi152.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-16T13:02:46.932 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-16T13:02:46.933 INFO:teuthology.orchestra.run.smithi152.stdout: jq-1.6-3.el8.x86_64 2023-10-16T13:02:46.933 INFO:teuthology.orchestra.run.smithi152.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-16T13:02:46.933 INFO:teuthology.orchestra.run.smithi152.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-16T13:02:46.933 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-16T13:02:46.933 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.934 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.934 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.934 INFO:teuthology.orchestra.run.smithi152.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-16T13:02:46.934 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-16T13:02:46.934 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-16T13:02:46.935 INFO:teuthology.orchestra.run.smithi152.stdout: libpq-13.5-1.el8.x86_64 2023-10-16T13:02:46.935 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-16T13:02:46.935 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-16T13:02:46.935 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.935 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.936 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-16T13:02:46.936 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.936 INFO:teuthology.orchestra.run.smithi152.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-16T13:02:46.936 INFO:teuthology.orchestra.run.smithi152.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-16T13:02:46.936 INFO:teuthology.orchestra.run.smithi152.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-16T13:02:46.936 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-16T13:02:46.937 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-16T13:02:46.937 INFO:teuthology.orchestra.run.smithi152.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-16T13:02:46.937 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-16T13:02:46.937 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-16T13:02:46.937 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-16T13:02:46.938 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-16T13:02:46.938 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-16T13:02:46.938 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-16T13:02:46.938 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-16T13:02:46.938 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-16T13:02:46.939 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T13:02:46.939 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T13:02:46.939 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T13:02:46.939 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-16T13:02:46.939 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-16T13:02:46.940 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-16T13:02:46.940 INFO:teuthology.orchestra.run.smithi152.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-16T13:02:46.940 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-16T13:02:46.940 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.940 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.941 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.941 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-16T13:02:46.941 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-16T13:02:46.941 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-16T13:02:46.941 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-16T13:02:46.942 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-16T13:02:46.942 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-16T13:02:46.942 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-16T13:02:46.942 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-16T13:02:46.942 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-16T13:02:46.942 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-16T13:02:46.943 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-16T13:02:46.943 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-16T13:02:46.943 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-16T13:02:46.944 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-16T13:02:46.944 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-16T13:02:46.944 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-16T13:02:46.944 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-16T13:02:46.944 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-16T13:02:46.945 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-16T13:02:46.945 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-16T13:02:46.945 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-16T13:02:46.945 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-16T13:02:46.945 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-2.6-1.el8.noarch 2023-10-16T13:02:46.946 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-16T13:02:46.946 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-16T13:02:46.946 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-16T13:02:46.946 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-16T13:02:46.947 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-16T13:02:46.947 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-16T13:02:46.947 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.947 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.947 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-16T13:02:46.947 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-16T13:02:46.948 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.948 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-16T13:02:46.948 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-16T13:02:46.948 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-16T13:02:46.948 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-16T13:02:46.949 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-16T13:02:46.949 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-16T13:02:46.949 INFO:teuthology.orchestra.run.smithi152.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-16T13:02:46.949 INFO:teuthology.orchestra.run.smithi152.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-16T13:02:46.949 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-16T13:02:46.950 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-16T13:02:46.950 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-16T13:02:46.950 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-16T13:02:46.950 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-16T13:02:46.950 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.951 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.951 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:02:46.951 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-16T13:02:46.951 INFO:teuthology.orchestra.run.smithi152.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-16T13:02:46.951 INFO:teuthology.orchestra.run.smithi152.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-16T13:02:46.952 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-16T13:02:46.952 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-16T13:02:46.952 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-16T13:02:46.953 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T13:02:46.953 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-10-16T13:02:47.090 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T13:02:47.133 DEBUG:teuthology.parallel:result is None 2023-10-16T13:02:47.684 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T13:02:47.999 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T13:02:48.094 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T13:02:48.256 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T13:03:07.015 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T13:03:07.016 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2023-10-16T13:03:07.016 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2023-10-16T13:03:07.017 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2023-10-16T13:03:07.017 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /run 2023-10-16T13:03:07.017 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2023-10-16T13:03:07.018 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2023-10-16T13:03:07.018 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2023-10-16T13:03:07.019 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2023-10-16T13:03:07.019 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2023-10-16T13:03:07.019 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:03:07.360 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T13:03:08.949 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T13:03:09.128 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T13:03:09.347 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T13:03:09.546 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T13:03:10.003 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T13:03:10.184 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T13:03:10.200 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T13:03:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T13:03:12.230 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T13:03:12.382 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-16T13:03:12.549 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-16T13:03:12.750 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T13:03:12.971 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T13:03:13.268 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T13:03:14.227 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T13:03:14.425 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T13:03:14.516 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T13:03:14.904 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-16T13:03:15.159 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T13:03:15.194 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T13:03:15.366 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T13:03:15.377 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T13:03:16.698 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-16T13:03:16.893 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T13:03:16.926 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T13:03:17.058 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T13:03:17.100 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T13:03:17.258 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T13:03:17.629 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T13:03:17.791 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T13:03:22.437 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T13:03:23.332 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-16T13:03:23.701 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-16T13:03:23.917 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 117/134 2023-10-16T13:03:24.201 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-16T13:03:24.398 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-16T13:03:24.587 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-16T13:03:24.894 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-16T13:03:25.060 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-16T13:03:25.232 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-16T13:03:27.516 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T13:03:27.772 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T13:03:27.794 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T13:03:27.997 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-16T13:03:28.280 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-16T13:03:28.633 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-16T13:03:29.068 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-16T13:03:29.271 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-16T13:03:29.355 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-16T13:03:29.588 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-16T13:03:29.600 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-16T13:03:29.797 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-16T13:03:29.804 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-16T13:03:29.932 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-16T13:03:29.932 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T13:03:30.141 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T13:03:30.142 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T13:03:30.393 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T13:03:30.612 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T13:03:31.108 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T13:03:31.109 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-16T13:03:31.109 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-16T13:03:31.109 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-16T13:03:31.109 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-16T13:03:31.110 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-16T13:03:31.110 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T13:03:31.110 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T13:03:31.110 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T13:03:31.110 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-16T13:03:31.111 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-16T13:03:31.111 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-16T13:03:31.111 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-16T13:03:31.112 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-16T13:03:31.112 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-16T13:03:31.112 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-16T13:03:31.112 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-16T13:03:31.112 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-16T13:03:31.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-16T13:03:31.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-16T13:03:31.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-16T13:03:31.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-16T13:03:31.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-16T13:03:31.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-16T13:03:31.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-16T13:03:31.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-16T13:03:31.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-16T13:03:31.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-16T13:03:31.115 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-16T13:03:31.115 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-16T13:03:31.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-16T13:03:31.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-16T13:03:31.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-16T13:03:31.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-16T13:03:31.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-16T13:03:31.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-16T13:03:31.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-16T13:03:31.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-16T13:03:31.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-16T13:03:31.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-16T13:03:31.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-16T13:03:31.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-16T13:03:31.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-16T13:03:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-16T13:03:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-16T13:03:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-16T13:03:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-16T13:03:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-16T13:03:31.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-16T13:03:31.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-16T13:03:31.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-16T13:03:31.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-16T13:03:31.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-16T13:03:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-16T13:03:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-16T13:03:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-16T13:03:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-16T13:03:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-16T13:03:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-16T13:03:31.130 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-16T13:03:31.130 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-16T13:03:31.130 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-16T13:03:31.130 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-16T13:03:31.130 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-16T13:03:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-16T13:03:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-16T13:03:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-16T13:03:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-16T13:03:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-16T13:03:31.132 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-16T13:03:31.132 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-16T13:03:31.132 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-16T13:03:31.132 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-16T13:03:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-16T13:03:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-16T13:03:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-16T13:03:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-16T13:03:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-16T13:03:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-16T13:03:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-16T13:03:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-16T13:03:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-16T13:03:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-16T13:03:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-16T13:03:31.135 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-16T13:03:31.135 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-16T13:03:31.135 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-16T13:03:31.135 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-16T13:03:31.135 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-16T13:03:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-16T13:03:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-16T13:03:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-16T13:03:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-16T13:03:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-16T13:03:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-16T13:03:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-16T13:03:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-16T13:03:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-16T13:03:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-16T13:03:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-16T13:03:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-16T13:03:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-16T13:03:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-16T13:03:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-16T13:03:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-16T13:03:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-16T13:03:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-16T13:03:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-16T13:03:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-16T13:03:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-16T13:03:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-16T13:03:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-16T13:03:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-16T13:03:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-16T13:03:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-16T13:03:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-16T13:03:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-16T13:03:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-16T13:03:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-16T13:03:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-16T13:03:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-16T13:03:31.142 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-16T13:03:31.142 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-16T13:03:31.142 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-16T13:03:31.142 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-16T13:03:31.143 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-16T13:03:31.143 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-16T13:03:31.143 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-16T13:03:31.143 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-16T13:03:31.143 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-16T13:03:31.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-16T13:03:31.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-16T13:03:31.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T13:03:31.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-16T13:03:33.765 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T13:03:33.766 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:54 ago on Mon 16 Oct 2023 01:00:39 PM UTC. 2023-10-16T13:03:36.253 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-10-16T13:03:36.463 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:03:36.464 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2023-10-16T13:03:36.464 INFO:teuthology.orchestra.run.smithi092.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-16T13:03:36.464 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.464 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.465 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-10-16T13:03:36.465 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-16T13:03:36.465 INFO:teuthology.orchestra.run.smithi092.stdout: automake-1.16.1-7.el8.noarch 2023-10-16T13:03:36.465 INFO:teuthology.orchestra.run.smithi092.stdout: bison-3.0.4-10.el8.x86_64 2023-10-16T13:03:36.465 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.466 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.466 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.466 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.466 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:03:36.466 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.467 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.467 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.467 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:03:36.467 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:03:36.467 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:03:36.468 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:03:36.468 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:03:36.468 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.468 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.468 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:03:36.468 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.469 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.469 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.469 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:03:36.469 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:03:36.469 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.470 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:03:36.470 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-16T13:03:36.470 INFO:teuthology.orchestra.run.smithi092.stdout: flex-2.6.1-9.el8.x86_64 2023-10-16T13:03:36.470 INFO:teuthology.orchestra.run.smithi092.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-16T13:03:36.470 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-16T13:03:36.471 INFO:teuthology.orchestra.run.smithi092.stdout: jq-1.6-3.el8.x86_64 2023-10-16T13:03:36.471 INFO:teuthology.orchestra.run.smithi092.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-16T13:03:36.471 INFO:teuthology.orchestra.run.smithi092.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-16T13:03:36.471 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-16T13:03:36.471 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.472 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.472 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.472 INFO:teuthology.orchestra.run.smithi092.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-16T13:03:36.472 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-16T13:03:36.473 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-16T13:03:36.473 INFO:teuthology.orchestra.run.smithi092.stdout: libpq-13.5-1.el8.x86_64 2023-10-16T13:03:36.473 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-16T13:03:36.473 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-16T13:03:36.473 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.474 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.474 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-16T13:03:36.474 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.474 INFO:teuthology.orchestra.run.smithi092.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-16T13:03:36.474 INFO:teuthology.orchestra.run.smithi092.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-16T13:03:36.475 INFO:teuthology.orchestra.run.smithi092.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-16T13:03:36.475 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-16T13:03:36.475 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-16T13:03:36.475 INFO:teuthology.orchestra.run.smithi092.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-16T13:03:36.475 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-16T13:03:36.476 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-16T13:03:36.476 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-16T13:03:36.476 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-16T13:03:36.476 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-16T13:03:36.476 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-16T13:03:36.477 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-16T13:03:36.477 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-16T13:03:36.477 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T13:03:36.477 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T13:03:36.477 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T13:03:36.477 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-16T13:03:36.478 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-16T13:03:36.478 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-16T13:03:36.478 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-16T13:03:36.478 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-16T13:03:36.478 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.479 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.479 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.479 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-16T13:03:36.479 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-16T13:03:36.479 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-16T13:03:36.480 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-16T13:03:36.480 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-16T13:03:36.480 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-16T13:03:36.480 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-16T13:03:36.480 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-16T13:03:36.481 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-16T13:03:36.481 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-16T13:03:36.481 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-16T13:03:36.481 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-16T13:03:36.481 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-16T13:03:36.482 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-16T13:03:36.482 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-16T13:03:36.482 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-16T13:03:36.482 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-16T13:03:36.483 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-16T13:03:36.483 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-16T13:03:36.483 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-16T13:03:36.483 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-16T13:03:36.483 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-16T13:03:36.484 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-2.6-1.el8.noarch 2023-10-16T13:03:36.484 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-16T13:03:36.484 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-16T13:03:36.484 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-16T13:03:36.484 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-16T13:03:36.485 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-16T13:03:36.485 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-16T13:03:36.485 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.485 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.485 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-16T13:03:36.486 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-16T13:03:36.486 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.486 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-16T13:03:36.486 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-16T13:03:36.486 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-16T13:03:36.487 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-16T13:03:36.487 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-16T13:03:36.487 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-16T13:03:36.487 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-16T13:03:36.487 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-16T13:03:36.488 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-16T13:03:36.488 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-16T13:03:36.488 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-16T13:03:36.488 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-16T13:03:36.488 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-16T13:03:36.489 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.489 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.489 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:03:36.489 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-16T13:03:36.489 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-16T13:03:36.490 INFO:teuthology.orchestra.run.smithi092.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-16T13:03:36.490 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-16T13:03:36.490 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-16T13:03:36.491 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-16T13:03:36.491 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:03:36.491 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-10-16T13:03:36.666 DEBUG:teuthology.parallel:result is None 2023-10-16T13:03:36.667 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T13:03:36.832 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-16T13:03:36.856 INFO:teuthology.orchestra.run.smithi092.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-16T13:03:36.857 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-16T13:03:36.857 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-16T13:03:36.858 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T13:03:37.079 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-16T13:03:37.108 INFO:teuthology.orchestra.run.smithi118.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-16T13:03:37.109 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-16T13:03:37.109 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-16T13:03:37.110 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T13:03:37.252 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-16T13:03:37.280 INFO:teuthology.orchestra.run.smithi152.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-16T13:03:37.281 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-16T13:03:37.281 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-16T13:03:37.282 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-16T13:03:37.282 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T13:03:37.283 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T13:03:37.324 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-16T13:03:37.325 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T13:03:37.374 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T13:03:37.374 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T13:03:37.421 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-16T13:03:37.422 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T13:03:37.422 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T13:03:37.450 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T13:03:37.517 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-16T13:03:37.517 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T13:03:37.550 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T13:03:37.626 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T13:03:37.627 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T13:03:37.660 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T13:03:37.730 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-16T13:03:37.731 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T13:03:37.731 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T13:03:37.758 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T13:03:37.824 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-16T13:03:37.825 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T13:03:37.857 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T13:03:37.929 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T13:03:37.930 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T13:03:37.962 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T13:03:38.032 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-16T13:03:38.033 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T13:03:38.033 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T13:03:38.059 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T13:03:38.125 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-16T13:03:38.126 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T13:03:38.158 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T13:03:38.230 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T13:03:38.231 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T13:03:38.264 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T13:03:38.334 INFO:teuthology.run_tasks:Running task cephadm... 2023-10-16T13:03:38.419 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-10-16T13:03:38.420 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T13:03:38.421 INFO:tasks.cephadm:Cluster fsid is 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:03:38.421 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-10-16T13:03:38.421 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.92', 'mon.b': '172.21.15.118', 'mon.c': '172.21.15.152'} 2023-10-16T13:03:38.422 INFO:tasks.cephadm:First mon is mon.a on smithi092 2023-10-16T13:03:38.422 INFO:tasks.cephadm:First mgr is x 2023-10-16T13:03:38.422 INFO:tasks.cephadm:Normalizing hostnames... 2023-10-16T13:03:38.423 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname $(hostname -s) 2023-10-16T13:03:38.452 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname $(hostname -s) 2023-10-16T13:03:38.485 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname $(hostname -s) 2023-10-16T13:03:38.517 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-10-16T13:03:38.518 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T13:03:38.668 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/73317/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-6730-g4ba8a190', 'node_name': '172.21.4.66+confusa04', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-6730.g4ba8a190'}, 'url': 'https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-10-13 15:58:27.010264', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'rishabh-2023oct13', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/', 'archs': ['source', 'x86_64', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/73317/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-6730-g4ba8a190', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-6730.g4ba8a190'}, 'url': 'https://4.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-10-13 15:04:44.383342', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'rishabh-2023oct13', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2023-10-16T13:03:38.817 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref rishabh-2023oct13, sha1 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T13:03:38.818 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/x86_64/flavors/default/cephadm 2023-10-16T13:03:38.818 DEBUG:teuthology.orchestra.run.smithi092:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-16T13:03:39.447 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 16 13:03 /home/ubuntu/cephtest/cephadm 2023-10-16T13:03:39.447 DEBUG:teuthology.orchestra.run.smithi118:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-16T13:03:39.851 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 16 13:03 /home/ubuntu/cephtest/cephadm 2023-10-16T13:03:39.851 DEBUG:teuthology.orchestra.run.smithi152:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-16T13:03:40.249 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 16 13:03 /home/ubuntu/cephtest/cephadm 2023-10-16T13:03:40.250 DEBUG:teuthology.orchestra.run.smithi092:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-16T13:03:40.271 DEBUG:teuthology.orchestra.run.smithi118:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-16T13:03:40.294 DEBUG:teuthology.orchestra.run.smithi152:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-16T13:03:40.330 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 on all hosts... 2023-10-16T13:03:40.331 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 pull 2023-10-16T13:03:40.333 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 pull 2023-10-16T13:03:40.336 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 pull 2023-10-16T13:03:41.643 INFO:teuthology.orchestra.run.smithi152.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0... 2023-10-16T13:03:41.680 INFO:teuthology.orchestra.run.smithi118.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0... 2023-10-16T13:03:46.701 INFO:teuthology.orchestra.run.smithi092.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0... 2023-10-16T13:04:17.089 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:04:17.090 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-16T13:04:17.090 INFO:teuthology.orchestra.run.smithi092.stdout: "image_id": "6c414e27a22dd493601dbea027b085af1f7a6d0d2000c05baef3637f1554baac", 2023-10-16T13:04:17.090 INFO:teuthology.orchestra.run.smithi092.stdout: "repo_digests": [ 2023-10-16T13:04:17.090 INFO:teuthology.orchestra.run.smithi092.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6730639e35896afbb2563e998f4d6436eacd40f6e8724777584c413b142f6992" 2023-10-16T13:04:17.091 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-10-16T13:04:17.091 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:04:22.428 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-10-16T13:04:22.429 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-16T13:04:22.429 INFO:teuthology.orchestra.run.smithi118.stdout: "image_id": "6c414e27a22dd493601dbea027b085af1f7a6d0d2000c05baef3637f1554baac", 2023-10-16T13:04:22.429 INFO:teuthology.orchestra.run.smithi118.stdout: "repo_digests": [ 2023-10-16T13:04:22.429 INFO:teuthology.orchestra.run.smithi118.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6730639e35896afbb2563e998f4d6436eacd40f6e8724777584c413b142f6992" 2023-10-16T13:04:22.429 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2023-10-16T13:04:22.429 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-10-16T13:04:31.334 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-10-16T13:04:31.334 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-16T13:04:31.335 INFO:teuthology.orchestra.run.smithi152.stdout: "image_id": "6c414e27a22dd493601dbea027b085af1f7a6d0d2000c05baef3637f1554baac", 2023-10-16T13:04:31.335 INFO:teuthology.orchestra.run.smithi152.stdout: "repo_digests": [ 2023-10-16T13:04:31.335 INFO:teuthology.orchestra.run.smithi152.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6730639e35896afbb2563e998f4d6436eacd40f6e8724777584c413b142f6992" 2023-10-16T13:04:31.335 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2023-10-16T13:04:31.335 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-10-16T13:04:31.354 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph 2023-10-16T13:04:31.391 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph 2023-10-16T13:04:31.430 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph 2023-10-16T13:04:31.461 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /etc/ceph 2023-10-16T13:04:31.491 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 777 /etc/ceph 2023-10-16T13:04:31.522 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /etc/ceph 2023-10-16T13:04:31.549 INFO:tasks.cephadm:Writing seed config... 2023-10-16T13:04:31.550 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2023-10-16T13:04:31.551 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-10-16T13:04:31.551 INFO:tasks.cephadm: override: [client] debug client = 20 2023-10-16T13:04:31.551 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-10-16T13:04:31.552 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-10-16T13:04:31.552 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-10-16T13:04:31.552 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2023-10-16T13:04:31.552 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-10-16T13:04:31.553 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-10-16T13:04:31.553 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-10-16T13:04:31.553 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-10-16T13:04:31.553 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-10-16T13:04:31.554 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-10-16T13:04:31.554 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-10-16T13:04:31.554 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-10-16T13:04:31.554 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-10-16T13:04:31.555 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-10-16T13:04:31.555 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-10-16T13:04:31.555 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-10-16T13:04:31.555 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-10-16T13:04:31.556 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-10-16T13:04:31.556 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-10-16T13:04:31.556 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-10-16T13:04:31.557 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-10-16T13:04:31.557 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-10-16T13:04:31.557 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-10-16T13:04:31.557 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-10-16T13:04:31.558 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-10-16T13:04:31.558 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-10-16T13:04:31.558 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-10-16T13:04:31.558 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-10-16T13:04:31.559 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-10-16T13:04:31.559 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-10-16T13:04:31.559 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-10-16T13:04:31.560 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-10-16T13:04:31.560 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-10-16T13:04:31.560 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-10-16T13:04:31.560 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-10-16T13:04:31.561 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-10-16T13:04:31.561 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-10-16T13:04:31.561 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-10-16T13:04:31.561 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-10-16T13:04:31.562 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-10-16T13:04:31.562 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-10-16T13:04:31.562 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-10-16T13:04:31.563 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2023-10-16T13:04:31.564 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T13:04:31.564 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-10-16T13:04:31.582 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 6c276d7e-6c24-11ee-8db6-212e2dc638e7 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-10-16T13:04:31.583 DEBUG:teuthology.orchestra.run.smithi092:mon.a> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mon.a.service 2023-10-16T13:04:31.625 DEBUG:teuthology.orchestra.run.smithi092:mgr.x> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mgr.x.service 2023-10-16T13:04:31.653 INFO:journalctl@ceph.mon.a.smithi092.stdout:-- Logs begin at Mon 2023-10-16 12:49:18 UTC. -- 2023-10-16T13:04:31.654 INFO:tasks.cephadm:Bootstrapping... 2023-10-16T13:04:31.655 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 -v bootstrap --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.92 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-10-16T13:04:31.681 INFO:journalctl@ceph.mgr.x.smithi092.stdout:-- Logs begin at Mon 2023-10-16 12:49:18 UTC. -- 2023-10-16T13:04:31.821 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-10-16T13:04:31.821 INFO:teuthology.orchestra.run.smithi092.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', '-v', 'bootstrap', '--fsid', '6c276d7e-6c24-11ee-8db6-212e2dc638e7', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.92', '--skip-admin-label'] 2023-10-16T13:04:31.970 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stdout 4.1.1 2023-10-16T13:04:31.971 INFO:teuthology.orchestra.run.smithi092.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-10-16T13:04:31.971 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying podman|docker is present... 2023-10-16T13:04:32.112 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stdout 4.1.1 2023-10-16T13:04:32.113 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying lvm2 is present... 2023-10-16T13:04:32.113 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying time synchronization is in place... 2023-10-16T13:04:32.119 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-16T13:04:32.120 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-16T13:04:32.125 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-16T13:04:32.125 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2023-10-16T13:04:32.131 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout enabled 2023-10-16T13:04:32.137 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout active 2023-10-16T13:04:32.137 INFO:teuthology.orchestra.run.smithi092.stdout:Unit chronyd.service is enabled and running 2023-10-16T13:04:32.137 INFO:teuthology.orchestra.run.smithi092.stdout:Repeating the final host check... 2023-10-16T13:04:32.278 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stdout 4.1.1 2023-10-16T13:04:32.279 INFO:teuthology.orchestra.run.smithi092.stdout:podman (/bin/podman) version 4.1.1 is present 2023-10-16T13:04:32.279 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl is present 2023-10-16T13:04:32.279 INFO:teuthology.orchestra.run.smithi092.stdout:lvcreate is present 2023-10-16T13:04:32.285 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-16T13:04:32.285 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-16T13:04:32.291 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-16T13:04:32.291 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2023-10-16T13:04:32.296 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout enabled 2023-10-16T13:04:32.303 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout active 2023-10-16T13:04:32.303 INFO:teuthology.orchestra.run.smithi092.stdout:Unit chronyd.service is enabled and running 2023-10-16T13:04:32.303 INFO:teuthology.orchestra.run.smithi092.stdout:Host looks OK 2023-10-16T13:04:32.303 INFO:teuthology.orchestra.run.smithi092.stdout:Cluster fsid: 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:04:32.304 INFO:teuthology.orchestra.run.smithi092.stdout:Acquiring lock 140035819883040 on /run/cephadm/6c276d7e-6c24-11ee-8db6-212e2dc638e7.lock 2023-10-16T13:04:32.304 INFO:teuthology.orchestra.run.smithi092.stdout:Lock 140035819883040 acquired on /run/cephadm/6c276d7e-6c24-11ee-8db6-212e2dc638e7.lock 2023-10-16T13:04:32.305 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying IP 172.21.15.92 port 3300 ... 2023-10-16T13:04:32.305 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying IP 172.21.15.92 port 6789 ... 2023-10-16T13:04:32.305 INFO:teuthology.orchestra.run.smithi092.stdout:Base mon IP(s) is [172.21.15.92:3300, 172.21.15.92:6789], mon addrv is [v2:172.21.15.92:3300,v1:172.21.15.92:6789] 2023-10-16T13:04:32.308 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2023-10-16T13:04:32.308 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.92 metric 100 2023-10-16T13:04:32.310 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-10-16T13:04:32.311 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2023-10-16T13:04:32.311 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2023-10-16T13:04:32.313 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-10-16T13:04:32.313 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-10-16T13:04:32.313 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-16T13:04:32.313 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-10-16T13:04:32.314 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout inet6 fe80::1f37:ebd:1c03:1568/64 scope link noprefixroute 2023-10-16T13:04:32.314 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-16T13:04:32.315 INFO:teuthology.orchestra.run.smithi092.stdout:Mon IP `172.21.15.92` is in CIDR network `172.21.0.0/20` 2023-10-16T13:04:32.315 INFO:teuthology.orchestra.run.smithi092.stdout:Mon IP `172.21.15.92` is in CIDR network `172.21.0.0/20` 2023-10-16T13:04:32.315 INFO:teuthology.orchestra.run.smithi092.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-10-16T13:04:32.315 INFO:teuthology.orchestra.run.smithi092.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-10-16T13:04:32.316 INFO:teuthology.orchestra.run.smithi092.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0... 2023-10-16T13:04:32.763 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stdout 6c414e27a22dd493601dbea027b085af1f7a6d0d2000c05baef3637f1554baac 2023-10-16T13:04:32.764 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0... 2023-10-16T13:04:32.764 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Getting image source signatures 2023-10-16T13:04:32.764 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Copying blob sha256:a436693b466fb7b19e09eee08a577fdd5da6c190e9ac5a29f91603f2f63125a2 2023-10-16T13:04:32.764 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Copying blob sha256:8ed15414cb45b8b895a21f106743ceee45272cee0d9e7e5b1f49bd1e877e4a11 2023-10-16T13:04:32.764 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Copying config sha256:6c414e27a22dd493601dbea027b085af1f7a6d0d2000c05baef3637f1554baac 2023-10-16T13:04:32.765 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Writing manifest to image destination 2023-10-16T13:04:32.765 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Storing signatures 2023-10-16T13:04:33.717 INFO:teuthology.orchestra.run.smithi092.stdout:ceph: stdout ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-16T13:04:33.717 INFO:teuthology.orchestra.run.smithi092.stdout:Ceph version: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-16T13:04:33.717 INFO:teuthology.orchestra.run.smithi092.stdout:Extracting ceph user uid/gid from container image... 2023-10-16T13:04:34.771 INFO:teuthology.orchestra.run.smithi092.stdout:stat: stdout 167 167 2023-10-16T13:04:34.771 INFO:teuthology.orchestra.run.smithi092.stdout:Creating initial keys... 2023-10-16T13:04:35.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph-authtool: stdout AQDjNC1lKKpDFRAAMfvUFzjblRuBN4lWbzYE2w== 2023-10-16T13:04:36.467 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph-authtool: stdout AQDkNC1lMd+mBRAA+Isg75riZbq7VHNgViY5/Q== 2023-10-16T13:04:37.213 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph-authtool: stdout AQDkNC1ll6nMMRAAefm1vScSivh5AOPkTg8HMQ== 2023-10-16T13:04:37.214 INFO:teuthology.orchestra.run.smithi092.stdout:Creating initial monmap... 2023-10-16T13:04:37.971 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-16T13:04:37.971 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-10-16T13:04:37.972 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:04:37.972 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-16T13:04:37.972 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool for a [v2:172.21.15.92:3300,v1:172.21.15.92:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-16T13:04:37.972 INFO:teuthology.orchestra.run.smithi092.stdout:setting min_mon_release = pacific 2023-10-16T13:04:37.972 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: set fsid to 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:04:37.972 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-16T13:04:37.973 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:04:37.973 INFO:teuthology.orchestra.run.smithi092.stdout:Creating mon... 2023-10-16T13:04:38.819 INFO:teuthology.orchestra.run.smithi092.stdout:create mon.a on 2023-10-16T13:04:38.944 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-10-16T13:04:39.034 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-10-16T13:04:39.190 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7.target → /etc/systemd/system/ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7.target. 2023-10-16T13:04:39.191 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7.target → /etc/systemd/system/ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7.target. 2023-10-16T13:04:39.365 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mon.a 2023-10-16T13:04:39.366 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mon.a.service: Unit ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mon.a.service not loaded. 2023-10-16T13:04:39.451 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7.target.wants/ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mon.a.service → /etc/systemd/system/ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@.service. 2023-10-16T13:04:39.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:39 smithi092 systemd[1]: Starting Ceph mon.a for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:04:39.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:39 smithi092 podman[98999]: 2023-10-16T13:04:39.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:39 smithi092 bash[98999]: 3b78845d76dcf3fb11da38f72c7a99f8ee80745341601f0dd968a74d39b06a1e 2023-10-16T13:04:40.056 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-16T13:04:40.056 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2023-10-16T13:04:40.063 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-16T13:04:40.063 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2023-10-16T13:04:40.063 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2023-10-16T13:04:40.064 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to enable service . firewalld.service is not available 2023-10-16T13:04:40.064 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mon to start... 2023-10-16T13:04:40.064 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mon... 2023-10-16T13:04:40.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:39 smithi092 ceph-mon[99039]: mkfs 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:04:40.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:39 smithi092 ceph-mon[99039]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-16T13:04:40.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:40 smithi092 systemd[1]: Started Ceph mon.a for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:04:41.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:40 smithi092 ceph-mon[99039]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-16T13:04:41.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:40 smithi092 ceph-mon[99039]: monmap e1: 1 mons at {a=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0]} removed_ranks: {} 2023-10-16T13:04:41.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:40 smithi092 ceph-mon[99039]: fsmap 2023-10-16T13:04:41.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:40 smithi092 ceph-mon[99039]: osdmap e1: 0 total, 0 up, 0 in 2023-10-16T13:04:41.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:40 smithi092 ceph-mon[99039]: mgrmap e1: no daemons active 2023-10-16T13:04:42.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:42 smithi092 ceph-mon[99039]: from='client.? 172.21.15.92:0/3977922562' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-10-16T13:04:45.329 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout cluster: 2023-10-16T13:04:45.330 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout id: 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:04:45.330 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-10-16T13:04:45.330 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2023-10-16T13:04:45.330 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout services: 2023-10-16T13:04:45.330 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 2s) 2023-10-16T13:04:45.331 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-10-16T13:04:45.331 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-10-16T13:04:45.331 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2023-10-16T13:04:45.331 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout data: 2023-10-16T13:04:45.331 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-10-16T13:04:45.332 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-10-16T13:04:45.332 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-10-16T13:04:45.332 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout pgs: 2023-10-16T13:04:45.332 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2023-10-16T13:04:45.332 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.610+0000 7faab45cb700 1 Processor -- start 2023-10-16T13:04:45.333 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.610+0000 7faab45cb700 1 -- start start 2023-10-16T13:04:45.333 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.610+0000 7faab45cb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac07bec0 0x7faaac07a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:04:45.333 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.610+0000 7faab45cb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac07a8f0 con 0x7faaac07bec0 2023-10-16T13:04:45.333 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.611+0000 7faab2367700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac07bec0 0x7faaac07a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:04:45.333 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.611+0000 7faab2367700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac07bec0 0x7faaac07a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33858/0 (socket says 172.21.15.92:33858) 2023-10-16T13:04:45.334 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.611+0000 7faab2367700 1 -- 172.21.15.92:0/2691965019 learned_addr learned my addr 172.21.15.92:0/2691965019 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:04:45.334 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.611+0000 7faab2367700 1 -- 172.21.15.92:0/2691965019 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac07aa30 con 0x7faaac07bec0 2023-10-16T13:04:45.334 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.611+0000 7faab2367700 1 --2- 172.21.15.92:0/2691965019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac07bec0 0x7faaac07a320 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0098a0 tx=0x7faa9c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9fd820a7d07c40 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:04:45.334 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.611+0000 7faab1365700 1 -- 172.21.15.92:0/2691965019 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa9c004160 con 0x7faaac07bec0 2023-10-16T13:04:45.334 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.611+0000 7faab1365700 1 -- 172.21.15.92:0/2691965019 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c0042c0 con 0x7faaac07bec0 2023-10-16T13:04:45.335 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.611+0000 7faab1365700 1 -- 172.21.15.92:0/2691965019 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa9c0045a0 con 0x7faaac07bec0 2023-10-16T13:04:45.335 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.612+0000 7faab45cb700 1 -- 172.21.15.92:0/2691965019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac07bec0 msgr2=0x7faaac07a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:04:45.335 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.612+0000 7faab45cb700 1 --2- 172.21.15.92:0/2691965019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac07bec0 0x7faaac07a320 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0098a0 tx=0x7faa9c009bb0 comp rx=0 tx=0).stop 2023-10-16T13:04:45.335 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.612+0000 7faab45cb700 1 -- 172.21.15.92:0/2691965019 shutdown_connections 2023-10-16T13:04:45.335 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.612+0000 7faab45cb700 1 --2- 172.21.15.92:0/2691965019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac07bec0 0x7faaac07a320 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:04:45.336 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.612+0000 7faab45cb700 1 -- 172.21.15.92:0/2691965019 >> 172.21.15.92:0/2691965019 conn(0x7faaac101e60 msgr2=0x7faaac1042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:04:45.336 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.612+0000 7faab45cb700 1 -- 172.21.15.92:0/2691965019 shutdown_connections 2023-10-16T13:04:45.336 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.612+0000 7faab45cb700 1 -- 172.21.15.92:0/2691965019 wait complete. 2023-10-16T13:04:45.336 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.612+0000 7faab45cb700 1 Processor -- start 2023-10-16T13:04:45.336 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.613+0000 7faab45cb700 1 -- start start 2023-10-16T13:04:45.336 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.613+0000 7faab45cb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac07bec0 0x7faaac19bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:04:45.337 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.613+0000 7faab45cb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac19c420 con 0x7faaac07bec0 2023-10-16T13:04:45.337 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.613+0000 7faab2367700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac07bec0 0x7faaac19bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:04:45.337 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.613+0000 7faab2367700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac07bec0 0x7faaac19bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33860/0 (socket says 172.21.15.92:33860) 2023-10-16T13:04:45.337 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.613+0000 7faab2367700 1 -- 172.21.15.92:0/3977922562 learned_addr learned my addr 172.21.15.92:0/3977922562 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:04:45.337 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.613+0000 7faab2367700 1 -- 172.21.15.92:0/3977922562 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9c009550 con 0x7faaac07bec0 2023-10-16T13:04:45.338 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.613+0000 7faab2367700 1 --2- 172.21.15.92:0/3977922562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac07bec0 0x7faaac19bee0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7faa9c004000 tx=0x7faa9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:04:45.338 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.613+0000 7faaa37fe700 1 -- 172.21.15.92:0/3977922562 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa9c011630 con 0x7faaac07bec0 2023-10-16T13:04:45.338 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.613+0000 7faaa37fe700 1 -- 172.21.15.92:0/3977922562 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c011790 con 0x7faaac07bec0 2023-10-16T13:04:45.338 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.613+0000 7faab45cb700 1 -- 172.21.15.92:0/3977922562 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaac19c620 con 0x7faaac07bec0 2023-10-16T13:04:45.338 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.613+0000 7faaa37fe700 1 -- 172.21.15.92:0/3977922562 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa9c011a30 con 0x7faaac07bec0 2023-10-16T13:04:45.339 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.613+0000 7faab45cb700 1 -- 172.21.15.92:0/3977922562 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaac19cac0 con 0x7faaac07bec0 2023-10-16T13:04:45.339 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.614+0000 7faaa37fe700 1 -- 172.21.15.92:0/3977922562 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faa9c022070 con 0x7faaac07bec0 2023-10-16T13:04:45.339 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.614+0000 7faaa37fe700 1 -- 172.21.15.92:0/3977922562 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7faa9c01c450 con 0x7faaac07bec0 2023-10-16T13:04:45.339 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.614+0000 7faab45cb700 1 -- 172.21.15.92:0/3977922562 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaac195e60 con 0x7faaac07bec0 2023-10-16T13:04:45.339 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.617+0000 7faaa37fe700 1 -- 172.21.15.92:0/3977922562 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7faa9c01b450 con 0x7faaac07bec0 2023-10-16T13:04:45.340 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.686+0000 7faab45cb700 1 -- 172.21.15.92:0/3977922562 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7faaac07ada0 con 0x7faaac07bec0 2023-10-16T13:04:45.340 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.686+0000 7faaa37fe700 1 -- 172.21.15.92:0/3977922562 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+310 (secure 0 0 0) 0x7faa9c01b5f0 con 0x7faaac07bec0 2023-10-16T13:04:45.340 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.687+0000 7faab45cb700 1 -- 172.21.15.92:0/3977922562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac07bec0 msgr2=0x7faaac19bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:04:45.340 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.687+0000 7faab45cb700 1 --2- 172.21.15.92:0/3977922562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac07bec0 0x7faaac19bee0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7faa9c004000 tx=0x7faa9c004750 comp rx=0 tx=0).stop 2023-10-16T13:04:45.341 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.687+0000 7faab45cb700 1 -- 172.21.15.92:0/3977922562 shutdown_connections 2023-10-16T13:04:45.341 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.687+0000 7faab45cb700 1 --2- 172.21.15.92:0/3977922562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaac07bec0 0x7faaac19bee0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:04:45.341 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.687+0000 7faab45cb700 1 -- 172.21.15.92:0/3977922562 >> 172.21.15.92:0/3977922562 conn(0x7faaac101e60 msgr2=0x7faaac103770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:04:45.341 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.687+0000 7faab45cb700 1 -- 172.21.15.92:0/3977922562 shutdown_connections 2023-10-16T13:04:45.341 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:42.687+0000 7faab45cb700 1 -- 172.21.15.92:0/3977922562 wait complete. 2023-10-16T13:04:45.341 INFO:teuthology.orchestra.run.smithi092.stdout:mon is available 2023-10-16T13:04:45.342 INFO:teuthology.orchestra.run.smithi092.stdout:Assimilating anything we can from ceph.conf... 2023-10-16T13:04:47.664 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:47 smithi092 ceph-mon[99039]: from='client.? 172.21.15.92:0/2393093293' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-16T13:04:47.665 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:47 smithi092 ceph-mon[99039]: from='client.? 172.21.15.92:0/2393093293' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-10-16T13:04:47.679 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2023-10-16T13:04:47.679 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [global] 2023-10-16T13:04:47.680 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout fsid = 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:04:47.680 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.92:3300,v1:172.21.15.92:6789] 2023-10-16T13:04:47.680 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-16T13:04:47.680 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-16T13:04:47.680 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-16T13:04:47.681 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-16T13:04:47.681 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2023-10-16T13:04:47.681 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-16T13:04:47.681 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-16T13:04:47.681 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2023-10-16T13:04:47.682 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [osd] 2023-10-16T13:04:47.682 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-16T13:04:47.682 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-16T13:04:47.682 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-16T13:04:47.682 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-16T13:04:47.683 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-16T13:04:47.683 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.186+0000 7f100737d700 1 Processor -- start 2023-10-16T13:04:47.683 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.187+0000 7f100737d700 1 -- start start 2023-10-16T13:04:47.683 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.187+0000 7f100737d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1000106d80 0x7f10001071a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:04:47.683 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.187+0000 7f100737d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1000107770 con 0x7f1000106d80 2023-10-16T13:04:47.683 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.187+0000 7f1005119700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1000106d80 0x7f10001071a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:04:47.684 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.187+0000 7f1005119700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1000106d80 0x7f10001071a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33862/0 (socket says 172.21.15.92:33862) 2023-10-16T13:04:47.684 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.187+0000 7f1005119700 1 -- 172.21.15.92:0/2035776581 learned_addr learned my addr 172.21.15.92:0/2035776581 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:04:47.684 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.187+0000 7f1005119700 1 -- 172.21.15.92:0/2035776581 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10001059e0 con 0x7f1000106d80 2023-10-16T13:04:47.684 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.188+0000 7f1005119700 1 --2- 172.21.15.92:0/2035776581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1000106d80 0x7f10001071a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00098a0 tx=0x7f0ff0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e715e6590143ed6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:04:47.684 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.188+0000 7f0ff7fff700 1 -- 172.21.15.92:0/2035776581 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ff0004160 con 0x7f1000106d80 2023-10-16T13:04:47.685 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.188+0000 7f0ff7fff700 1 -- 172.21.15.92:0/2035776581 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff00042c0 con 0x7f1000106d80 2023-10-16T13:04:47.685 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.188+0000 7f0ff7fff700 1 -- 172.21.15.92:0/2035776581 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ff00045a0 con 0x7f1000106d80 2023-10-16T13:04:47.685 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.188+0000 7f100737d700 1 -- 172.21.15.92:0/2035776581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1000106d80 msgr2=0x7f10001071a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:04:47.685 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.188+0000 7f100737d700 1 --2- 172.21.15.92:0/2035776581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1000106d80 0x7f10001071a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00098a0 tx=0x7f0ff0009bb0 comp rx=0 tx=0).stop 2023-10-16T13:04:47.685 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.188+0000 7f100737d700 1 -- 172.21.15.92:0/2035776581 shutdown_connections 2023-10-16T13:04:47.686 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.188+0000 7f100737d700 1 --2- 172.21.15.92:0/2035776581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1000106d80 0x7f10001071a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:04:47.686 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.188+0000 7f100737d700 1 -- 172.21.15.92:0/2035776581 >> 172.21.15.92:0/2035776581 conn(0x7f10001004f0 msgr2=0x7f1000102930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:04:47.686 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.188+0000 7f100737d700 1 -- 172.21.15.92:0/2035776581 shutdown_connections 2023-10-16T13:04:47.686 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.188+0000 7f100737d700 1 -- 172.21.15.92:0/2035776581 wait complete. 2023-10-16T13:04:47.686 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.189+0000 7f100737d700 1 Processor -- start 2023-10-16T13:04:47.687 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.189+0000 7f100737d700 1 -- start start 2023-10-16T13:04:47.687 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.189+0000 7f100737d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1000106d80 0x7f1000198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:04:47.687 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.189+0000 7f100737d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10001990f0 con 0x7f1000106d80 2023-10-16T13:04:47.687 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.189+0000 7f1005119700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1000106d80 0x7f1000198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:04:47.687 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.189+0000 7f1005119700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1000106d80 0x7f1000198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33864/0 (socket says 172.21.15.92:33864) 2023-10-16T13:04:47.688 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.189+0000 7f1005119700 1 -- 172.21.15.92:0/2393093293 learned_addr learned my addr 172.21.15.92:0/2393093293 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:04:47.688 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.190+0000 7f1005119700 1 -- 172.21.15.92:0/2393093293 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff0009550 con 0x7f1000106d80 2023-10-16T13:04:47.688 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.190+0000 7f1005119700 1 --2- 172.21.15.92:0/2393093293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1000106d80 0x7f1000198bb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009fb0 tx=0x7f0ff0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:04:47.688 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.190+0000 7f0ff67fc700 1 -- 172.21.15.92:0/2393093293 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ff0003dd0 con 0x7f1000106d80 2023-10-16T13:04:47.688 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.190+0000 7f0ff67fc700 1 -- 172.21.15.92:0/2393093293 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff0011630 con 0x7f1000106d80 2023-10-16T13:04:47.688 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.190+0000 7f100737d700 1 -- 172.21.15.92:0/2393093293 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10001992f0 con 0x7f1000106d80 2023-10-16T13:04:47.689 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.190+0000 7f0ff67fc700 1 -- 172.21.15.92:0/2393093293 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ff0011910 con 0x7f1000106d80 2023-10-16T13:04:47.689 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.190+0000 7f100737d700 1 -- 172.21.15.92:0/2393093293 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1000199790 con 0x7f1000106d80 2023-10-16T13:04:47.689 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.190+0000 7f0ff67fc700 1 -- 172.21.15.92:0/2393093293 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0ff001c460 con 0x7f1000106d80 2023-10-16T13:04:47.689 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.190+0000 7f0ff67fc700 1 -- 172.21.15.92:0/2393093293 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0ff001a7e0 con 0x7f1000106d80 2023-10-16T13:04:47.689 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.191+0000 7f100737d700 1 -- 172.21.15.92:0/2393093293 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1000105d50 con 0x7f1000106d80 2023-10-16T13:04:47.690 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.193+0000 7f0ff67fc700 1 -- 172.21.15.92:0/2393093293 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0ff001aaf0 con 0x7f1000106d80 2023-10-16T13:04:47.690 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.259+0000 7f100737d700 1 -- 172.21.15.92:0/2393093293 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f1000105f40 con 0x7f1000106d80 2023-10-16T13:04:47.690 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.262+0000 7f0ff67fc700 1 -- 172.21.15.92:0/2393093293 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f0ff001ad40 con 0x7f1000106d80 2023-10-16T13:04:47.690 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.263+0000 7f0ff67fc700 1 -- 172.21.15.92:0/2393093293 <== mon.0 v2:172.21.15.92:3300/0 8 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f0ff001cd60 con 0x7f1000106d80 2023-10-16T13:04:47.690 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.264+0000 7f100737d700 1 -- 172.21.15.92:0/2393093293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1000106d80 msgr2=0x7f1000198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:04:47.691 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.264+0000 7f100737d700 1 --2- 172.21.15.92:0/2393093293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1000106d80 0x7f1000198bb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009fb0 tx=0x7f0ff0004750 comp rx=0 tx=0).stop 2023-10-16T13:04:47.691 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.264+0000 7f100737d700 1 -- 172.21.15.92:0/2393093293 shutdown_connections 2023-10-16T13:04:47.691 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.264+0000 7f100737d700 1 --2- 172.21.15.92:0/2393093293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1000106d80 0x7f1000198bb0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:04:47.692 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.264+0000 7f100737d700 1 -- 172.21.15.92:0/2393093293 >> 172.21.15.92:0/2393093293 conn(0x7f10001004f0 msgr2=0x7f100018d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:04:47.692 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.264+0000 7f100737d700 1 -- 172.21.15.92:0/2393093293 shutdown_connections 2023-10-16T13:04:47.692 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:47.264+0000 7f100737d700 1 -- 172.21.15.92:0/2393093293 wait complete. 2023-10-16T13:04:47.692 INFO:teuthology.orchestra.run.smithi092.stdout:Generating new minimal ceph.conf... 2023-10-16T13:04:48.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:48 smithi092 ceph-mon[99039]: from='client.? 172.21.15.92:0/930688713' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:04:48.619 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.137+0000 7f9f324fe700 1 Processor -- start 2023-10-16T13:04:48.619 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.137+0000 7f9f324fe700 1 -- start start 2023-10-16T13:04:48.620 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.137+0000 7f9f324fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f2c104bc0 0x7f9f2c104fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:04:48.620 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.137+0000 7f9f324fe700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c1055b0 con 0x7f9f2c104bc0 2023-10-16T13:04:48.620 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.138+0000 7f9f2bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f2c104bc0 0x7f9f2c104fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:04:48.620 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.138+0000 7f9f2bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f2c104bc0 0x7f9f2c104fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33866/0 (socket says 172.21.15.92:33866) 2023-10-16T13:04:48.620 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.138+0000 7f9f2bfff700 1 -- 172.21.15.92:0/1088350006 learned_addr learned my addr 172.21.15.92:0/1088350006 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:04:48.621 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.138+0000 7f9f2bfff700 1 -- 172.21.15.92:0/1088350006 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c107b50 con 0x7f9f2c104bc0 2023-10-16T13:04:48.621 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.138+0000 7f9f2bfff700 1 --2- 172.21.15.92:0/1088350006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f2c104bc0 0x7f9f2c104fe0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c0098a0 tx=0x7f9f1c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80edbe3b6d137dd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:04:48.621 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.138+0000 7f9f2affd700 1 -- 172.21.15.92:0/1088350006 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f1c004160 con 0x7f9f2c104bc0 2023-10-16T13:04:48.621 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.138+0000 7f9f2affd700 1 -- 172.21.15.92:0/1088350006 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f9f1c0042c0 con 0x7f9f2c104bc0 2023-10-16T13:04:48.621 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.138+0000 7f9f2affd700 1 -- 172.21.15.92:0/1088350006 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f1c011ac0 con 0x7f9f2c104bc0 2023-10-16T13:04:48.622 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.139+0000 7f9f324fe700 1 -- 172.21.15.92:0/1088350006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f2c104bc0 msgr2=0x7f9f2c104fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:04:48.622 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.139+0000 7f9f324fe700 1 --2- 172.21.15.92:0/1088350006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f2c104bc0 0x7f9f2c104fe0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c0098a0 tx=0x7f9f1c009bb0 comp rx=0 tx=0).stop 2023-10-16T13:04:48.622 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.139+0000 7f9f324fe700 1 -- 172.21.15.92:0/1088350006 shutdown_connections 2023-10-16T13:04:48.622 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.139+0000 7f9f324fe700 1 --2- 172.21.15.92:0/1088350006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f2c104bc0 0x7f9f2c104fe0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:04:48.622 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.139+0000 7f9f324fe700 1 -- 172.21.15.92:0/1088350006 >> 172.21.15.92:0/1088350006 conn(0x7f9f2c1004f0 msgr2=0x7f9f2c102930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:04:48.623 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.139+0000 7f9f324fe700 1 -- 172.21.15.92:0/1088350006 shutdown_connections 2023-10-16T13:04:48.623 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.139+0000 7f9f324fe700 1 -- 172.21.15.92:0/1088350006 wait complete. 2023-10-16T13:04:48.623 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.139+0000 7f9f324fe700 1 Processor -- start 2023-10-16T13:04:48.623 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.140+0000 7f9f324fe700 1 -- start start 2023-10-16T13:04:48.623 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.140+0000 7f9f324fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f2c19a6f0 0x7f9f2c19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:04:48.624 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.140+0000 7f9f324fe700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c19b050 con 0x7f9f2c19a6f0 2023-10-16T13:04:48.624 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.140+0000 7f9f2bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f2c19a6f0 0x7f9f2c19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:04:48.624 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.140+0000 7f9f2bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f2c19a6f0 0x7f9f2c19ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33868/0 (socket says 172.21.15.92:33868) 2023-10-16T13:04:48.624 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.140+0000 7f9f2bfff700 1 -- 172.21.15.92:0/930688713 learned_addr learned my addr 172.21.15.92:0/930688713 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:04:48.624 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.140+0000 7f9f2bfff700 1 -- 172.21.15.92:0/930688713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c009550 con 0x7f9f2c19a6f0 2023-10-16T13:04:48.624 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.140+0000 7f9f2bfff700 1 --2- 172.21.15.92:0/930688713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f2c19a6f0 0x7f9f2c19ab10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c003f70 tx=0x7f9f1c011860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:04:48.625 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.140+0000 7f9f297fa700 1 -- 172.21.15.92:0/930688713 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f1c011b40 con 0x7f9f2c19a6f0 2023-10-16T13:04:48.625 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.140+0000 7f9f297fa700 1 -- 172.21.15.92:0/930688713 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f9f1c01a440 con 0x7f9f2c19a6f0 2023-10-16T13:04:48.625 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.140+0000 7f9f324fe700 1 -- 172.21.15.92:0/930688713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f2c19b250 con 0x7f9f2c19a6f0 2023-10-16T13:04:48.625 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.140+0000 7f9f297fa700 1 -- 172.21.15.92:0/930688713 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f1c01b5d0 con 0x7f9f2c19a6f0 2023-10-16T13:04:48.625 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.141+0000 7f9f324fe700 1 -- 172.21.15.92:0/930688713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f2c19dea0 con 0x7f9f2c19a6f0 2023-10-16T13:04:48.626 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.141+0000 7f9f297fa700 1 -- 172.21.15.92:0/930688713 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9f1c023030 con 0x7f9f2c19a6f0 2023-10-16T13:04:48.626 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.141+0000 7f9f297fa700 1 -- 172.21.15.92:0/930688713 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9f1c021070 con 0x7f9f2c19a6f0 2023-10-16T13:04:48.626 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.142+0000 7f9f324fe700 1 -- 172.21.15.92:0/930688713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2c0624e0 con 0x7f9f2c19a6f0 2023-10-16T13:04:48.626 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.144+0000 7f9f297fa700 1 -- 172.21.15.92:0/930688713 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f9f1c02b060 con 0x7f9f2c19a6f0 2023-10-16T13:04:48.627 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.211+0000 7f9f324fe700 1 -- 172.21.15.92:0/930688713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f9f2c10ad80 con 0x7f9f2c19a6f0 2023-10-16T13:04:48.627 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.211+0000 7f9f297fa700 1 -- 172.21.15.92:0/930688713 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f9f1c01bd20 con 0x7f9f2c19a6f0 2023-10-16T13:04:48.627 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.212+0000 7f9f324fe700 1 -- 172.21.15.92:0/930688713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f2c19a6f0 msgr2=0x7f9f2c19ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:04:48.627 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.212+0000 7f9f324fe700 1 --2- 172.21.15.92:0/930688713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f2c19a6f0 0x7f9f2c19ab10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c003f70 tx=0x7f9f1c011860 comp rx=0 tx=0).stop 2023-10-16T13:04:48.628 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.212+0000 7f9f324fe700 1 -- 172.21.15.92:0/930688713 shutdown_connections 2023-10-16T13:04:48.628 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.212+0000 7f9f324fe700 1 --2- 172.21.15.92:0/930688713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f2c19a6f0 0x7f9f2c19ab10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:04:48.628 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.212+0000 7f9f324fe700 1 -- 172.21.15.92:0/930688713 >> 172.21.15.92:0/930688713 conn(0x7f9f2c1004f0 msgr2=0x7f9f2c101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:04:48.628 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.212+0000 7f9f324fe700 1 -- 172.21.15.92:0/930688713 shutdown_connections 2023-10-16T13:04:48.628 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:48.212+0000 7f9f324fe700 1 -- 172.21.15.92:0/930688713 wait complete. 2023-10-16T13:04:48.629 INFO:teuthology.orchestra.run.smithi092.stdout:Restarting the monitor... 2023-10-16T13:04:48.955 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:48 smithi092 systemd[1]: Stopping Ceph mon.a for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:04:49.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:48 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mon-a[99015]: 2023-10-16T13:04:48.953+0000 7fdc2aff7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:04:49.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:48 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mon-a[99015]: 2023-10-16T13:04:48.953+0000 7fdc2aff7700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-16T13:04:49.518 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:49 smithi092 bash[99381]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mon-a 2023-10-16T13:04:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:49 smithi092 systemd[1]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mon.a.service: Succeeded. 2023-10-16T13:04:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:49 smithi092 systemd[1]: Stopped Ceph mon.a for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:04:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:49 smithi092 systemd[1]: Starting Ceph mon.a for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:04:50.274 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 podman[99502]: 2023-10-16T13:04:50.275 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: set uid:gid to 167:167 (ceph:ceph) 2023-10-16T13:04:50.275 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev), process ceph-mon, pid 7 2023-10-16T13:04:50.275 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: pidfile_write: ignore empty --pid-file 2023-10-16T13:04:50.276 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 bash[99502]: 3506140c9aa2fcc5ddcc970fd5336b50b77a4a05cd161c80ba3611c188a6f737 2023-10-16T13:04:50.276 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: load: jerasure load: lrc 2023-10-16T13:04:50.276 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: RocksDB version: 7.9.2 2023-10-16T13:04:50.276 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Git sha 0 2023-10-16T13:04:50.276 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Compile date 2023-10-13 13:48:46 2023-10-16T13:04:50.277 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: DB SUMMARY 2023-10-16T13:04:50.277 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: DB Session ID: 63LE1QHT5OYB4579O8SR 2023-10-16T13:04:50.277 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: CURRENT file: CURRENT 2023-10-16T13:04:50.277 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: IDENTITY file: IDENTITY 2023-10-16T13:04:50.277 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-10-16T13:04:50.278 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-10-16T13:04:50.278 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 100413 ; 2023-10-16T13:04:50.278 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.error_if_exists: 0 2023-10-16T13:04:50.278 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.create_if_missing: 0 2023-10-16T13:04:50.278 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.paranoid_checks: 1 2023-10-16T13:04:50.279 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-16T13:04:50.279 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-16T13:04:50.279 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-16T13:04:50.279 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.env: 0x5560d9310da0 2023-10-16T13:04:50.280 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.fs: PosixFileSystem 2023-10-16T13:04:50.280 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.info_log: 0x5560daf1d5e0 2023-10-16T13:04:50.280 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_file_opening_threads: 16 2023-10-16T13:04:50.280 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.statistics: (nil) 2023-10-16T13:04:50.280 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.use_fsync: 0 2023-10-16T13:04:50.280 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_log_file_size: 0 2023-10-16T13:04:50.281 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-16T13:04:50.281 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-16T13:04:50.281 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.keep_log_file_num: 1000 2023-10-16T13:04:50.281 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.recycle_log_file_num: 0 2023-10-16T13:04:50.282 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.allow_fallocate: 1 2023-10-16T13:04:50.282 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.allow_mmap_reads: 0 2023-10-16T13:04:50.282 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.allow_mmap_writes: 0 2023-10-16T13:04:50.282 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.use_direct_reads: 0 2023-10-16T13:04:50.283 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-16T13:04:50.283 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.create_missing_column_families: 0 2023-10-16T13:04:50.283 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.db_log_dir: 2023-10-16T13:04:50.283 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.wal_dir: 2023-10-16T13:04:50.284 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-16T13:04:50.284 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-16T13:04:50.284 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-16T13:04:50.284 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-16T13:04:50.284 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-16T13:04:50.285 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-16T13:04:50.285 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.advise_random_on_open: 1 2023-10-16T13:04:50.285 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.db_write_buffer_size: 0 2023-10-16T13:04:50.285 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.write_buffer_manager: 0x5560daed5360 2023-10-16T13:04:50.286 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-16T13:04:50.286 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-16T13:04:50.286 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-16T13:04:50.286 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.rate_limiter: (nil) 2023-10-16T13:04:50.287 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-16T13:04:50.287 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.wal_recovery_mode: 2 2023-10-16T13:04:50.287 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.enable_thread_tracking: 0 2023-10-16T13:04:50.287 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.enable_pipelined_write: 0 2023-10-16T13:04:50.288 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.unordered_write: 0 2023-10-16T13:04:50.288 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-16T13:04:50.288 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-16T13:04:50.288 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-16T13:04:50.288 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-16T13:04:50.288 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.row_cache: None 2023-10-16T13:04:50.289 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.wal_filter: None 2023-10-16T13:04:50.289 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-16T13:04:50.289 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.allow_ingest_behind: 0 2023-10-16T13:04:50.289 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.two_write_queues: 0 2023-10-16T13:04:50.289 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.manual_wal_flush: 0 2023-10-16T13:04:50.290 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.wal_compression: 0 2023-10-16T13:04:50.290 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.atomic_flush: 0 2023-10-16T13:04:50.290 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-16T13:04:50.290 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-16T13:04:50.290 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-16T13:04:50.291 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.log_readahead_size: 0 2023-10-16T13:04:50.291 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-16T13:04:50.291 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.best_efforts_recovery: 0 2023-10-16T13:04:50.291 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-16T13:04:50.291 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-16T13:04:50.292 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.allow_data_in_errors: 0 2023-10-16T13:04:50.293 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.db_host_id: __hostname__ 2023-10-16T13:04:50.293 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-16T13:04:50.293 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_background_jobs: 2 2023-10-16T13:04:50.294 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_background_compactions: -1 2023-10-16T13:04:50.294 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_subcompactions: 1 2023-10-16T13:04:50.294 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-16T13:04:50.294 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-16T13:04:50.295 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-16T13:04:50.295 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_total_wal_size: 0 2023-10-16T13:04:50.295 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-16T13:04:50.295 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-16T13:04:50.295 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-16T13:04:50.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-16T13:04:50.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_open_files: -1 2023-10-16T13:04:50.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.bytes_per_sync: 0 2023-10-16T13:04:50.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-16T13:04:50.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-16T13:04:50.297 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compaction_readahead_size: 0 2023-10-16T13:04:50.297 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_background_flushes: -1 2023-10-16T13:04:50.297 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Compression algorithms supported: 2023-10-16T13:04:50.297 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-16T13:04:50.297 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: kZSTD supported: 0 2023-10-16T13:04:50.298 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: kXpressCompression supported: 0 2023-10-16T13:04:50.298 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: kLZ4HCCompression supported: 1 2023-10-16T13:04:50.298 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: kZlibCompression supported: 1 2023-10-16T13:04:50.298 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: kSnappyCompression supported: 1 2023-10-16T13:04:50.298 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: kLZ4Compression supported: 1 2023-10-16T13:04:50.299 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: kBZip2Compression supported: 0 2023-10-16T13:04:50.299 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-16T13:04:50.299 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-16T13:04:50.299 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-10-16T13:04:50.299 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-16T13:04:50.300 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-16T13:04:50.300 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.merge_operator: 2023-10-16T13:04:50.300 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compaction_filter: None 2023-10-16T13:04:50.300 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compaction_filter_factory: None 2023-10-16T13:04:50.300 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.sst_partitioner_factory: None 2023-10-16T13:04:50.301 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-16T13:04:50.301 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-16T13:04:50.301 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5560daf1d6e0) 2023-10-16T13:04:50.301 INFO:journalctl@ceph.mon.a.smithi092.stdout: cache_index_and_filter_blocks: 1 2023-10-16T13:04:50.302 INFO:journalctl@ceph.mon.a.smithi092.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-16T13:04:50.302 INFO:journalctl@ceph.mon.a.smithi092.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-16T13:04:50.302 INFO:journalctl@ceph.mon.a.smithi092.stdout: pin_top_level_index_and_filter: 1 2023-10-16T13:04:50.302 INFO:journalctl@ceph.mon.a.smithi092.stdout: index_type: 0 2023-10-16T13:04:50.302 INFO:journalctl@ceph.mon.a.smithi092.stdout: data_block_index_type: 0 2023-10-16T13:04:50.303 INFO:journalctl@ceph.mon.a.smithi092.stdout: index_shortening: 1 2023-10-16T13:04:50.303 INFO:journalctl@ceph.mon.a.smithi092.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-16T13:04:50.303 INFO:journalctl@ceph.mon.a.smithi092.stdout: checksum: 4 2023-10-16T13:04:50.303 INFO:journalctl@ceph.mon.a.smithi092.stdout: no_block_cache: 0 2023-10-16T13:04:50.303 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache: 0x5560daf731f0 2023-10-16T13:04:50.304 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache_name: BinnedLRUCache 2023-10-16T13:04:50.304 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache_options: 2023-10-16T13:04:50.304 INFO:journalctl@ceph.mon.a.smithi092.stdout: capacity : 536870912 2023-10-16T13:04:50.304 INFO:journalctl@ceph.mon.a.smithi092.stdout: num_shard_bits : 4 2023-10-16T13:04:50.305 INFO:journalctl@ceph.mon.a.smithi092.stdout: strict_capacity_limit : 0 2023-10-16T13:04:50.305 INFO:journalctl@ceph.mon.a.smithi092.stdout: high_pri_pool_ratio: 0.000 2023-10-16T13:04:50.305 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache_compressed: (nil) 2023-10-16T13:04:50.305 INFO:journalctl@ceph.mon.a.smithi092.stdout: persistent_cache: (nil) 2023-10-16T13:04:50.305 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_size: 4096 2023-10-16T13:04:50.306 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_size_deviation: 10 2023-10-16T13:04:50.306 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_restart_interval: 16 2023-10-16T13:04:50.306 INFO:journalctl@ceph.mon.a.smithi092.stdout: index_block_restart_interval: 1 2023-10-16T13:04:50.306 INFO:journalctl@ceph.mon.a.smithi092.stdout: metadata_block_size: 4096 2023-10-16T13:04:50.306 INFO:journalctl@ceph.mon.a.smithi092.stdout: partition_filters: 0 2023-10-16T13:04:50.307 INFO:journalctl@ceph.mon.a.smithi092.stdout: use_delta_encoding: 1 2023-10-16T13:04:50.307 INFO:journalctl@ceph.mon.a.smithi092.stdout: filter_policy: bloomfilter 2023-10-16T13:04:50.307 INFO:journalctl@ceph.mon.a.smithi092.stdout: whole_key_filtering: 1 2023-10-16T13:04:50.307 INFO:journalctl@ceph.mon.a.smithi092.stdout: verify_compression: 0 2023-10-16T13:04:50.307 INFO:journalctl@ceph.mon.a.smithi092.stdout: read_amp_bytes_per_bit: 0 2023-10-16T13:04:50.308 INFO:journalctl@ceph.mon.a.smithi092.stdout: format_version: 5 2023-10-16T13:04:50.308 INFO:journalctl@ceph.mon.a.smithi092.stdout: enable_index_compression: 1 2023-10-16T13:04:50.308 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_align: 0 2023-10-16T13:04:50.308 INFO:journalctl@ceph.mon.a.smithi092.stdout: max_auto_readahead_size: 262144 2023-10-16T13:04:50.309 INFO:journalctl@ceph.mon.a.smithi092.stdout: prepopulate_block_cache: 0 2023-10-16T13:04:50.309 INFO:journalctl@ceph.mon.a.smithi092.stdout: initial_auto_readahead_size: 8192 2023-10-16T13:04:50.309 INFO:journalctl@ceph.mon.a.smithi092.stdout: num_file_reads_for_auto_readahead: 2 2023-10-16T13:04:50.309 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.write_buffer_size: 33554432 2023-10-16T13:04:50.309 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_write_buffer_number: 2 2023-10-16T13:04:50.310 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compression: NoCompression 2023-10-16T13:04:50.310 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.bottommost_compression: Disabled 2023-10-16T13:04:50.310 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.prefix_extractor: nullptr 2023-10-16T13:04:50.311 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-16T13:04:50.311 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.num_levels: 7 2023-10-16T13:04:50.311 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-16T13:04:50.312 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-16T13:04:50.312 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-16T13:04:50.313 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-16T13:04:50.313 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-16T13:04:50.313 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-16T13:04:50.313 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-16T13:04:50.313 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-16T13:04:50.314 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-16T13:04:50.314 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-16T13:04:50.314 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-16T13:04:50.314 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-16T13:04:50.314 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-16T13:04:50.315 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compression_opts.level: 32767 2023-10-16T13:04:50.315 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compression_opts.strategy: 0 2023-10-16T13:04:50.315 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-16T13:04:50.315 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-16T13:04:50.316 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-16T13:04:50.316 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-16T13:04:50.316 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compression_opts.enabled: false 2023-10-16T13:04:50.316 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-16T13:04:50.316 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-16T13:04:50.316 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-16T13:04:50.317 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-16T13:04:50.317 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.target_file_size_base: 67108864 2023-10-16T13:04:50.317 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-16T13:04:50.317 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-16T13:04:50.317 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-16T13:04:50.318 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-16T13:04:50.318 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-16T13:04:50.318 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-16T13:04:50.318 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-16T13:04:50.318 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-16T13:04:50.319 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-16T13:04:50.319 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-16T13:04:50.319 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-16T13:04:50.319 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-16T13:04:50.319 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-16T13:04:50.320 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-16T13:04:50.320 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.arena_block_size: 1048576 2023-10-16T13:04:50.320 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-16T13:04:50.320 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-16T13:04:50.320 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.disable_auto_compactions: 0 2023-10-16T13:04:50.320 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-16T13:04:50.321 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-16T13:04:50.321 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-16T13:04:50.321 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-16T13:04:50.321 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-16T13:04:50.321 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-16T13:04:50.322 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-16T13:04:50.322 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-16T13:04:50.322 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-16T13:04:50.323 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-16T13:04:50.323 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.table_properties_collectors: 2023-10-16T13:04:50.323 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.inplace_update_support: 0 2023-10-16T13:04:50.324 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-16T13:04:50.324 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-16T13:04:50.324 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-16T13:04:50.324 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-16T13:04:50.325 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.bloom_locality: 0 2023-10-16T13:04:50.325 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.max_successive_merges: 0 2023-10-16T13:04:50.325 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-16T13:04:50.325 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.paranoid_file_checks: 0 2023-10-16T13:04:50.325 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.force_consistency_checks: 1 2023-10-16T13:04:50.325 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.report_bg_io_stats: 0 2023-10-16T13:04:50.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.ttl: 2592000 2023-10-16T13:04:50.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-16T13:04:50.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-16T13:04:50.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-16T13:04:50.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.enable_blob_files: false 2023-10-16T13:04:50.327 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.min_blob_size: 0 2023-10-16T13:04:50.327 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.blob_file_size: 268435456 2023-10-16T13:04:50.327 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-16T13:04:50.327 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-16T13:04:50.327 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-16T13:04:50.328 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-16T13:04:50.328 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-16T13:04:50.328 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.blob_file_starting_level: 0 2023-10-16T13:04:50.328 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-16T13:04:50.328 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-10-16T13:04:50.329 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-10-16T13:04:50.329 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: bb36996a-a402-4068-844b-d25dcf97d560 2023-10-16T13:04:50.329 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697461490201625, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-10-16T13:04:50.329 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-10-16T13:04:50.329 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697461490202613, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 95193, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 333, "table_properties": {"data_size": 93198, "index_size": 277, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13920, "raw_average_key_size": 49, "raw_value_size": 85579, "raw_average_value_size": 305, "num_data_blocks": 11, "num_entries": 280, "num_filter_entries": 280, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1697461490, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "bb36996a-a402-4068-844b-d25dcf97d560", "db_session_id": "63LE1QHT5OYB4579O8SR", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-10-16T13:04:50.329 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697461490202681, "job": 1, "event": "recovery_finished"} 2023-10-16T13:04:50.330 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-10-16T13:04:50.330 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-16T13:04:50.330 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5560db010000 2023-10-16T13:04:50.330 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: DB pointer 0x5560daffc000 2023-10-16T13:04:50.330 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-16T13:04:50.331 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-16T13:04:50.331 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** DB Stats ** 2023-10-16T13:04:50.331 INFO:journalctl@ceph.mon.a.smithi092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-16T13:04:50.331 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-16T13:04:50.332 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-16T13:04:50.332 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-16T13:04:50.332 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-16T13:04:50.332 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-16T13:04:50.332 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-16T13:04:50.333 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2023-10-16T13:04:50.333 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** Compaction Stats [default] ** 2023-10-16T13:04:50.333 INFO:journalctl@ceph.mon.a.smithi092.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-16T13:04:50.333 INFO:journalctl@ceph.mon.a.smithi092.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-16T13:04:50.333 INFO:journalctl@ceph.mon.a.smithi092.stdout: L0 2/0 94.80 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-16T13:04:50.334 INFO:journalctl@ceph.mon.a.smithi092.stdout: Sum 2/0 94.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-16T13:04:50.334 INFO:journalctl@ceph.mon.a.smithi092.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-16T13:04:50.334 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2023-10-16T13:04:50.334 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** Compaction Stats [default] ** 2023-10-16T13:04:50.334 INFO:journalctl@ceph.mon.a.smithi092.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-16T13:04:50.334 INFO:journalctl@ceph.mon.a.smithi092.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-16T13:04:50.335 INFO:journalctl@ceph.mon.a.smithi092.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 139.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-16T13:04:50.335 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2023-10-16T13:04:50.335 INFO:journalctl@ceph.mon.a.smithi092.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-16T13:04:50.335 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2023-10-16T13:04:50.335 INFO:journalctl@ceph.mon.a.smithi092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-16T13:04:50.336 INFO:journalctl@ceph.mon.a.smithi092.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-16T13:04:50.336 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-16T13:04:50.336 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-16T13:04:50.336 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-16T13:04:50.336 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-16T13:04:50.336 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative compaction: 0.00 GB write, 31.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-16T13:04:50.337 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval compaction: 0.00 GB write, 31.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-16T13:04:50.337 INFO:journalctl@ceph.mon.a.smithi092.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-16T13:04:50.337 INFO:journalctl@ceph.mon.a.smithi092.stdout: Block cache BinnedLRUCache@0x5560daf731f0#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-10-16T13:04:50.337 INFO:journalctl@ceph.mon.a.smithi092.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-10-16T13:04:50.337 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2023-10-16T13:04:50.338 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-16T13:04:50.338 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: starting mon.a rank 0 at public addrs [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] at bind addrs [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:04:50.338 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: mon.a@-1(???) e1 preinit fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:04:50.338 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: mon.a@-1(???).mds e1 new map 2023-10-16T13:04:50.338 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: mon.a@-1(???).mds e1 print_map 2023-10-16T13:04:50.339 INFO:journalctl@ceph.mon.a.smithi092.stdout: e1 2023-10-16T13:04:50.339 INFO:journalctl@ceph.mon.a.smithi092.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-16T13:04:50.339 INFO:journalctl@ceph.mon.a.smithi092.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-16T13:04:50.339 INFO:journalctl@ceph.mon.a.smithi092.stdout: legacy client fscid: -1 2023-10-16T13:04:50.339 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2023-10-16T13:04:50.340 INFO:journalctl@ceph.mon.a.smithi092.stdout: No filesystems configured 2023-10-16T13:04:50.340 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-16T13:04:50.340 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-16T13:04:50.340 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-16T13:04:50.340 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-16T13:04:50.341 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-10-16T13:04:50.341 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: expand_channel_meta expand map: {default=false} 2023-10-16T13:04:50.341 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: expand_channel_meta from 'false' to 'false' 2023-10-16T13:04:50.341 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: expand_channel_meta expanded map: {default=false} 2023-10-16T13:04:50.341 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: expand_channel_meta expand map: {default=info} 2023-10-16T13:04:50.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: expand_channel_meta from 'info' to 'info' 2023-10-16T13:04:50.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: expand_channel_meta expanded map: {default=info} 2023-10-16T13:04:50.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: expand_channel_meta expand map: {default=daemon} 2023-10-16T13:04:50.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: expand_channel_meta from 'daemon' to 'daemon' 2023-10-16T13:04:50.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: expand_channel_meta expanded map: {default=daemon} 2023-10-16T13:04:50.343 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: expand_channel_meta expand map: {default=debug} 2023-10-16T13:04:50.343 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: expand_channel_meta from 'debug' to 'debug' 2023-10-16T13:04:50.343 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: expand_channel_meta expanded map: {default=debug} 2023-10-16T13:04:50.343 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-16T13:04:50.343 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: monmap e1: 1 mons at {a=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0]} removed_ranks: {} 2023-10-16T13:04:50.344 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: fsmap 2023-10-16T13:04:50.344 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: osdmap e1: 0 total, 0 up, 0 in 2023-10-16T13:04:50.344 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 ceph-mon[99542]: mgrmap e1: no daemons active 2023-10-16T13:04:50.344 INFO:teuthology.orchestra.run.smithi092.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-10-16T13:04:50.526 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:50 smithi092 systemd[1]: Started Ceph mon.a for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:04:51.228 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.725+0000 7fd8cbebd700 1 Processor -- start 2023-10-16T13:04:51.229 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.726+0000 7fd8cbebd700 1 -- start start 2023-10-16T13:04:51.229 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.726+0000 7fd8cbebd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c4107380 0x7fd8c4109770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:04:51.229 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.726+0000 7fd8cbebd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c4079e70 con 0x7fd8c4107380 2023-10-16T13:04:51.229 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.727+0000 7fd8c9c59700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c4107380 0x7fd8c4109770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:04:51.230 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.727+0000 7fd8c9c59700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c4107380 0x7fd8c4109770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33870/0 (socket says 172.21.15.92:33870) 2023-10-16T13:04:51.230 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.727+0000 7fd8c9c59700 1 -- 172.21.15.92:0/1336162587 learned_addr learned my addr 172.21.15.92:0/1336162587 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:04:51.230 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.727+0000 7fd8c9c59700 1 -- 172.21.15.92:0/1336162587 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c4109cb0 con 0x7fd8c4107380 2023-10-16T13:04:51.230 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.727+0000 7fd8c9c59700 1 --2- 172.21.15.92:0/1336162587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c4107380 0x7fd8c4109770 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40098a0 tx=0x7fd8b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9942b68af0b44dee server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:04:51.230 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.727+0000 7fd8c8c57700 1 -- 172.21.15.92:0/1336162587 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8b4004160 con 0x7fd8c4107380 2023-10-16T13:04:51.231 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.727+0000 7fd8c8c57700 1 -- 172.21.15.92:0/1336162587 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fd8b40042c0 con 0x7fd8c4107380 2023-10-16T13:04:51.231 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.727+0000 7fd8c8c57700 1 -- 172.21.15.92:0/1336162587 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8b4011ac0 con 0x7fd8c4107380 2023-10-16T13:04:51.231 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.728+0000 7fd8cbebd700 1 -- 172.21.15.92:0/1336162587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c4107380 msgr2=0x7fd8c4109770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:04:51.231 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.728+0000 7fd8cbebd700 1 --2- 172.21.15.92:0/1336162587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c4107380 0x7fd8c4109770 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40098a0 tx=0x7fd8b4009bb0 comp rx=0 tx=0).stop 2023-10-16T13:04:51.231 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.728+0000 7fd8cbebd700 1 -- 172.21.15.92:0/1336162587 shutdown_connections 2023-10-16T13:04:51.232 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.728+0000 7fd8cbebd700 1 --2- 172.21.15.92:0/1336162587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c4107380 0x7fd8c4109770 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:04:51.232 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.728+0000 7fd8cbebd700 1 -- 172.21.15.92:0/1336162587 >> 172.21.15.92:0/1336162587 conn(0x7fd8c4100d70 msgr2=0x7fd8c41031b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:04:51.232 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.728+0000 7fd8cbebd700 1 -- 172.21.15.92:0/1336162587 shutdown_connections 2023-10-16T13:04:51.232 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.728+0000 7fd8cbebd700 1 -- 172.21.15.92:0/1336162587 wait complete. 2023-10-16T13:04:51.232 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.728+0000 7fd8cbebd700 1 Processor -- start 2023-10-16T13:04:51.232 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.728+0000 7fd8cbebd700 1 -- start start 2023-10-16T13:04:51.233 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.729+0000 7fd8cbebd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c4107380 0x7fd8c4106ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:04:51.233 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.729+0000 7fd8cbebd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c4107220 con 0x7fd8c4107380 2023-10-16T13:04:51.233 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.729+0000 7fd8c9c59700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c4107380 0x7fd8c4106ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:04:51.233 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.729+0000 7fd8c9c59700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c4107380 0x7fd8c4106ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33872/0 (socket says 172.21.15.92:33872) 2023-10-16T13:04:51.233 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.729+0000 7fd8c9c59700 1 -- 172.21.15.92:0/1596494263 learned_addr learned my addr 172.21.15.92:0/1596494263 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:04:51.234 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.729+0000 7fd8c9c59700 1 -- 172.21.15.92:0/1596494263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b4009550 con 0x7fd8c4107380 2023-10-16T13:04:51.234 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.729+0000 7fd8c9c59700 1 --2- 172.21.15.92:0/1596494263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c4107380 0x7fd8c4106ce0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4003f70 tx=0x7fd8b4011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:04:51.234 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.729+0000 7fd8baffd700 1 -- 172.21.15.92:0/1596494263 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8b4003b20 con 0x7fd8c4107380 2023-10-16T13:04:51.234 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.729+0000 7fd8baffd700 1 -- 172.21.15.92:0/1596494263 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fd8b4003c80 con 0x7fd8c4107380 2023-10-16T13:04:51.235 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.729+0000 7fd8baffd700 1 -- 172.21.15.92:0/1596494263 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8b4024880 con 0x7fd8c4107380 2023-10-16T13:04:51.235 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.729+0000 7fd8cbebd700 1 -- 172.21.15.92:0/1596494263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c4105330 con 0x7fd8c4107380 2023-10-16T13:04:51.235 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.729+0000 7fd8cbebd700 1 -- 172.21.15.92:0/1596494263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c41057d0 con 0x7fd8c4107380 2023-10-16T13:04:51.235 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.730+0000 7fd8baffd700 1 -- 172.21.15.92:0/1596494263 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd8b402d3f0 con 0x7fd8c4107380 2023-10-16T13:04:51.235 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.730+0000 7fd8baffd700 1 -- 172.21.15.92:0/1596494263 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd8b40194e0 con 0x7fd8c4107380 2023-10-16T13:04:51.235 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.730+0000 7fd8cbebd700 1 -- 172.21.15.92:0/1596494263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c410aab0 con 0x7fd8c4107380 2023-10-16T13:04:51.236 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.733+0000 7fd8baffd700 1 -- 172.21.15.92:0/1596494263 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fd8b401abf0 con 0x7fd8c4107380 2023-10-16T13:04:51.236 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.800+0000 7fd8cbebd700 1 -- 172.21.15.92:0/1596494263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fd8c4105f00 con 0x7fd8c4107380 2023-10-16T13:04:51.236 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.802+0000 7fd8baffd700 1 -- 172.21.15.92:0/1596494263 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd8b401ad90 con 0x7fd8c4107380 2023-10-16T13:04:51.236 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.802+0000 7fd8cbebd700 1 -- 172.21.15.92:0/1596494263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c4107380 msgr2=0x7fd8c4106ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:04:51.236 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.802+0000 7fd8cbebd700 1 --2- 172.21.15.92:0/1596494263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c4107380 0x7fd8c4106ce0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4003f70 tx=0x7fd8b4011b40 comp rx=0 tx=0).stop 2023-10-16T13:04:51.237 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.802+0000 7fd8cbebd700 1 -- 172.21.15.92:0/1596494263 shutdown_connections 2023-10-16T13:04:51.237 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.803+0000 7fd8cbebd700 1 --2- 172.21.15.92:0/1596494263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c4107380 0x7fd8c4106ce0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:04:51.237 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.803+0000 7fd8cbebd700 1 -- 172.21.15.92:0/1596494263 >> 172.21.15.92:0/1596494263 conn(0x7fd8c4100d70 msgr2=0x7fd8c4101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:04:51.237 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.803+0000 7fd8cbebd700 1 -- 172.21.15.92:0/1596494263 shutdown_connections 2023-10-16T13:04:51.238 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:50.803+0000 7fd8cbebd700 1 -- 172.21.15.92:0/1596494263 wait complete. 2023-10-16T13:04:51.238 INFO:teuthology.orchestra.run.smithi092.stdout:Wrote config to /etc/ceph/ceph.conf 2023-10-16T13:04:51.270 INFO:teuthology.orchestra.run.smithi092.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-10-16T13:04:51.270 INFO:teuthology.orchestra.run.smithi092.stdout:Creating mgr... 2023-10-16T13:04:51.271 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying port 0.0.0.0:9283 ... 2023-10-16T13:04:51.271 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying port 0.0.0.0:8765 ... 2023-10-16T13:04:51.475 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mgr.x 2023-10-16T13:04:51.475 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mgr.x.service: Unit ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mgr.x.service not loaded. 2023-10-16T13:04:51.563 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7.target.wants/ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mgr.x.service → /etc/systemd/system/ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@.service. 2023-10-16T13:04:51.848 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:51 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1596494263' entity='client.admin' 2023-10-16T13:04:51.849 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:51 smithi092 systemd[1]: Starting Ceph mgr.x for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:04:52.105 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:51 smithi092 podman[99772]: 2023-10-16T13:04:52.165 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-16T13:04:52.165 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2023-10-16T13:04:52.173 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-16T13:04:52.173 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2023-10-16T13:04:52.173 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2023-10-16T13:04:52.173 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to enable service . firewalld.service is not available 2023-10-16T13:04:52.182 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-16T13:04:52.182 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2023-10-16T13:04:52.190 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-16T13:04:52.190 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2023-10-16T13:04:52.191 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2023-10-16T13:04:52.191 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-10-16T13:04:52.191 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr to start... 2023-10-16T13:04:52.191 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr... 2023-10-16T13:04:52.409 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:52 smithi092 bash[99772]: 55a02c55940efa78e18ff71b786c0076cf43dafb367eedecb9298ce24e57c2e5 2023-10-16T13:04:52.410 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:52 smithi092 systemd[1]: Started Ceph mgr.x for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:04:52.410 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:52 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:52.236+0000 7ff896ac2200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T13:04:52.410 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:52 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:52.316+0000 7ff896ac2200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T13:04:52.411 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:52 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:52.407+0000 7ff896ac2200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T13:04:52.690 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:52 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:52.508+0000 7ff896ac2200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T13:04:52.691 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:52 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:52.688+0000 7ff896ac2200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T13:04:52.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:52 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/645952623' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-16T13:04:53.208 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:53 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:53.076+0000 7ff896ac2200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T13:04:53.243 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2023-10-16T13:04:53.243 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2023-10-16T13:04:53.243 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsid": "6c276d7e-6c24-11ee-8db6-212e2dc638e7", 2023-10-16T13:04:53.243 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "health": { 2023-10-16T13:04:53.244 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-16T13:04:53.244 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-16T13:04:53.244 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-16T13:04:53.244 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:53.244 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-16T13:04:53.245 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-16T13:04:53.245 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 0 2023-10-16T13:04:53.245 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2023-10-16T13:04:53.245 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-16T13:04:53.245 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "a" 2023-10-16T13:04:53.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2023-10-16T13:04:53.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-10-16T13:04:53.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-16T13:04:53.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-16T13:04:53.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-16T13:04:53.247 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-16T13:04:53.247 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:53.247 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-16T13:04:53.247 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-16T13:04:53.247 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-16T13:04:53.247 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-16T13:04:53.248 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-16T13:04:53.258 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-16T13:04:53.258 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-16T13:04:53.258 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-16T13:04:53.258 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:53.259 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-16T13:04:53.259 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-16T13:04:53.259 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-16T13:04:53.259 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-16T13:04:53.259 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-16T13:04:53.260 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-16T13:04:53.260 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-16T13:04:53.260 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-16T13:04:53.260 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-16T13:04:53.260 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:53.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-16T13:04:53.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-16T13:04:53.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-16T13:04:53.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-16T13:04:53.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:53.262 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-16T13:04:53.262 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-16T13:04:53.262 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-16T13:04:53.262 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-16T13:04:53.262 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-16T13:04:53.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-16T13:04:53.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "restful" 2023-10-16T13:04:53.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2023-10-16T13:04:53.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-16T13:04:53.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:53.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-16T13:04:53.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-16T13:04:53.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modified": "2023-10-16T13:04:39.975990+0000", 2023-10-16T13:04:53.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-16T13:04:53.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:53.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-16T13:04:53.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2023-10-16T13:04:53.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.738+0000 7f9291dbf700 1 Processor -- start 2023-10-16T13:04:53.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.738+0000 7f9291dbf700 1 -- start start 2023-10-16T13:04:53.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.738+0000 7f9291dbf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f928c1073c0 0x7f928c1097b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:04:53.266 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.738+0000 7f9291dbf700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c079e30 con 0x7f928c1073c0 2023-10-16T13:04:53.266 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.738+0000 7f928b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f928c1073c0 0x7f928c1097b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:04:53.266 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.738+0000 7f928b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f928c1073c0 0x7f928c1097b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33878/0 (socket says 172.21.15.92:33878) 2023-10-16T13:04:53.266 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.738+0000 7f928b7fe700 1 -- 172.21.15.92:0/544840024 learned_addr learned my addr 172.21.15.92:0/544840024 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:04:53.266 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.739+0000 7f928b7fe700 1 -- 172.21.15.92:0/544840024 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c109cf0 con 0x7f928c1073c0 2023-10-16T13:04:53.267 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.739+0000 7f928b7fe700 1 --2- 172.21.15.92:0/544840024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f928c1073c0 0x7f928c1097b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f927c0098a0 tx=0x7f927c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a255423e8d97d59 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:04:53.267 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.739+0000 7f928a7fc700 1 -- 172.21.15.92:0/544840024 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f927c004160 con 0x7f928c1073c0 2023-10-16T13:04:53.267 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.739+0000 7f928a7fc700 1 -- 172.21.15.92:0/544840024 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f927c0042c0 con 0x7f928c1073c0 2023-10-16T13:04:53.267 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.739+0000 7f928a7fc700 1 -- 172.21.15.92:0/544840024 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f927c011ac0 con 0x7f928c1073c0 2023-10-16T13:04:53.267 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.740+0000 7f9291dbf700 1 -- 172.21.15.92:0/544840024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f928c1073c0 msgr2=0x7f928c1097b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:04:53.268 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.740+0000 7f9291dbf700 1 --2- 172.21.15.92:0/544840024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f928c1073c0 0x7f928c1097b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f927c0098a0 tx=0x7f927c009bb0 comp rx=0 tx=0).stop 2023-10-16T13:04:53.268 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.740+0000 7f9291dbf700 1 -- 172.21.15.92:0/544840024 shutdown_connections 2023-10-16T13:04:53.268 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.740+0000 7f9291dbf700 1 --2- 172.21.15.92:0/544840024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f928c1073c0 0x7f928c1097b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:04:53.268 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.740+0000 7f9291dbf700 1 -- 172.21.15.92:0/544840024 >> 172.21.15.92:0/544840024 conn(0x7f928c100d70 msgr2=0x7f928c1031b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:04:53.268 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.740+0000 7f9291dbf700 1 -- 172.21.15.92:0/544840024 shutdown_connections 2023-10-16T13:04:53.268 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.740+0000 7f9291dbf700 1 -- 172.21.15.92:0/544840024 wait complete. 2023-10-16T13:04:53.269 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.740+0000 7f9291dbf700 1 Processor -- start 2023-10-16T13:04:53.269 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.740+0000 7f9291dbf700 1 -- start start 2023-10-16T13:04:53.269 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.741+0000 7f9291dbf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f928c1073c0 0x7f928c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:04:53.269 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.741+0000 7f9291dbf700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c19aa20 con 0x7f928c1073c0 2023-10-16T13:04:53.269 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.741+0000 7f928b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f928c1073c0 0x7f928c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:04:53.270 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.741+0000 7f928b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f928c1073c0 0x7f928c19a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33880/0 (socket says 172.21.15.92:33880) 2023-10-16T13:04:53.270 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.741+0000 7f928b7fe700 1 -- 172.21.15.92:0/645952623 learned_addr learned my addr 172.21.15.92:0/645952623 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:04:53.270 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.741+0000 7f928b7fe700 1 -- 172.21.15.92:0/645952623 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c009550 con 0x7f928c1073c0 2023-10-16T13:04:53.270 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.741+0000 7f928b7fe700 1 --2- 172.21.15.92:0/645952623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f928c1073c0 0x7f928c19a4e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f927c003f70 tx=0x7f927c011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:04:53.270 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.741+0000 7f9288ff9700 1 -- 172.21.15.92:0/645952623 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f927c003b20 con 0x7f928c1073c0 2023-10-16T13:04:53.271 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.741+0000 7f9288ff9700 1 -- 172.21.15.92:0/645952623 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f927c003c80 con 0x7f928c1073c0 2023-10-16T13:04:53.271 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.741+0000 7f9291dbf700 1 -- 172.21.15.92:0/645952623 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928c19ac20 con 0x7f928c1073c0 2023-10-16T13:04:53.271 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.741+0000 7f9288ff9700 1 -- 172.21.15.92:0/645952623 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f927c0248c0 con 0x7f928c1073c0 2023-10-16T13:04:53.271 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.741+0000 7f9291dbf700 1 -- 172.21.15.92:0/645952623 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928c19b0c0 con 0x7f928c1073c0 2023-10-16T13:04:53.271 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.742+0000 7f9288ff9700 1 -- 172.21.15.92:0/645952623 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f927c02d3f0 con 0x7f928c1073c0 2023-10-16T13:04:53.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.742+0000 7f9288ff9700 1 -- 172.21.15.92:0/645952623 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f927c019460 con 0x7f928c1073c0 2023-10-16T13:04:53.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.742+0000 7f9291dbf700 1 -- 172.21.15.92:0/645952623 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928c0624e0 con 0x7f928c1073c0 2023-10-16T13:04:53.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.744+0000 7f9288ff9700 1 -- 172.21.15.92:0/645952623 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f927c01ac40 con 0x7f928c1073c0 2023-10-16T13:04:53.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.818+0000 7f9291dbf700 1 -- 172.21.15.92:0/645952623 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f928c10aaa0 con 0x7f928c1073c0 2023-10-16T13:04:53.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.818+0000 7f9288ff9700 1 -- 172.21.15.92:0/645952623 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f927c01ade0 con 0x7f928c1073c0 2023-10-16T13:04:53.273 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.819+0000 7f9291dbf700 1 -- 172.21.15.92:0/645952623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f928c1073c0 msgr2=0x7f928c19a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:04:53.273 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.819+0000 7f9291dbf700 1 --2- 172.21.15.92:0/645952623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f928c1073c0 0x7f928c19a4e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f927c003f70 tx=0x7f927c011a90 comp rx=0 tx=0).stop 2023-10-16T13:04:53.273 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.819+0000 7f9291dbf700 1 -- 172.21.15.92:0/645952623 shutdown_connections 2023-10-16T13:04:53.273 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.819+0000 7f9291dbf700 1 --2- 172.21.15.92:0/645952623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f928c1073c0 0x7f928c19a4e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:04:53.273 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.819+0000 7f9291dbf700 1 -- 172.21.15.92:0/645952623 >> 172.21.15.92:0/645952623 conn(0x7f928c100d70 msgr2=0x7f928c101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:04:53.274 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.819+0000 7f9291dbf700 1 -- 172.21.15.92:0/645952623 shutdown_connections 2023-10-16T13:04:53.274 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:52.819+0000 7f9291dbf700 1 -- 172.21.15.92:0/645952623 wait complete. 2023-10-16T13:04:53.274 INFO:teuthology.orchestra.run.smithi092.stdout:mgr not available, waiting (1/15)... 2023-10-16T13:04:53.496 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:53 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:53.207+0000 7ff896ac2200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T13:04:53.497 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:53 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:53.298+0000 7ff896ac2200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T13:04:53.497 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:53 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:53.392+0000 7ff896ac2200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T13:04:54.246 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:53 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:53.810+0000 7ff896ac2200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T13:04:54.746 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:54 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:54.470+0000 7ff896ac2200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T13:04:54.747 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:54 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:54.550+0000 7ff896ac2200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T13:04:55.606 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:55 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:55.330+0000 7ff896ac2200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T13:04:55.606 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:55 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:55.423+0000 7ff896ac2200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T13:04:55.905 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:55 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:55.603+0000 7ff896ac2200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T13:04:56.179 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:55 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:55.909+0000 7ff896ac2200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T13:04:56.179 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:56 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:56.138+0000 7ff896ac2200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T13:04:56.190 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2023-10-16T13:04:56.193 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2023-10-16T13:04:56.193 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsid": "6c276d7e-6c24-11ee-8db6-212e2dc638e7", 2023-10-16T13:04:56.193 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "health": { 2023-10-16T13:04:56.194 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-16T13:04:56.194 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-16T13:04:56.194 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-16T13:04:56.194 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:56.194 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-16T13:04:56.195 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-16T13:04:56.195 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 0 2023-10-16T13:04:56.195 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2023-10-16T13:04:56.195 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-16T13:04:56.195 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "a" 2023-10-16T13:04:56.196 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2023-10-16T13:04:56.196 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-10-16T13:04:56.196 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-16T13:04:56.196 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-16T13:04:56.196 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-16T13:04:56.197 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-16T13:04:56.197 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:56.197 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-16T13:04:56.197 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-16T13:04:56.197 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-16T13:04:56.198 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-16T13:04:56.198 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-16T13:04:56.205 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-16T13:04:56.205 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-16T13:04:56.205 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-16T13:04:56.205 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:56.205 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-16T13:04:56.206 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-16T13:04:56.206 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-16T13:04:56.206 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-16T13:04:56.206 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-16T13:04:56.206 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-16T13:04:56.207 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-16T13:04:56.207 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-16T13:04:56.207 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-16T13:04:56.207 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:56.207 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-16T13:04:56.208 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-16T13:04:56.208 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-16T13:04:56.208 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-16T13:04:56.208 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:56.208 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-16T13:04:56.209 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-16T13:04:56.209 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-16T13:04:56.209 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-16T13:04:56.209 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-16T13:04:56.209 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-16T13:04:56.210 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "restful" 2023-10-16T13:04:56.210 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2023-10-16T13:04:56.210 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-16T13:04:56.210 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:56.211 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-16T13:04:56.211 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-16T13:04:56.211 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modified": "2023-10-16T13:04:39.975990+0000", 2023-10-16T13:04:56.211 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-16T13:04:56.211 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:56.212 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-16T13:04:56.212 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2023-10-16T13:04:56.212 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.692+0000 7f80a7768700 1 Processor -- start 2023-10-16T13:04:56.212 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.692+0000 7f80a7768700 1 -- start start 2023-10-16T13:04:56.213 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.692+0000 7f80a7768700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a01057c0 0x7f80a0105be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:04:56.213 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.692+0000 7f80a7768700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a01061b0 con 0x7f80a01057c0 2023-10-16T13:04:56.213 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.693+0000 7f80a5504700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a01057c0 0x7f80a0105be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:04:56.213 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.693+0000 7f80a5504700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a01057c0 0x7f80a0105be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33882/0 (socket says 172.21.15.92:33882) 2023-10-16T13:04:56.213 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.693+0000 7f80a5504700 1 -- 172.21.15.92:0/969754161 learned_addr learned my addr 172.21.15.92:0/969754161 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:04:56.214 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.693+0000 7f80a5504700 1 -- 172.21.15.92:0/969754161 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a01069c0 con 0x7f80a01057c0 2023-10-16T13:04:56.214 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.693+0000 7f80a5504700 1 --2- 172.21.15.92:0/969754161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a01057c0 0x7f80a0105be0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f809c0098a0 tx=0x7f809c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ef9790c5d2c62f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:04:56.214 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.693+0000 7f8097fff700 1 -- 172.21.15.92:0/969754161 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f809c004160 con 0x7f80a01057c0 2023-10-16T13:04:56.214 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.693+0000 7f8097fff700 1 -- 172.21.15.92:0/969754161 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f809c0042c0 con 0x7f80a01057c0 2023-10-16T13:04:56.214 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.693+0000 7f8097fff700 1 -- 172.21.15.92:0/969754161 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f809c011ac0 con 0x7f80a01057c0 2023-10-16T13:04:56.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.694+0000 7f80a7768700 1 -- 172.21.15.92:0/969754161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a01057c0 msgr2=0x7f80a0105be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:04:56.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.694+0000 7f80a7768700 1 --2- 172.21.15.92:0/969754161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a01057c0 0x7f80a0105be0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f809c0098a0 tx=0x7f809c009bb0 comp rx=0 tx=0).stop 2023-10-16T13:04:56.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.694+0000 7f80a7768700 1 -- 172.21.15.92:0/969754161 shutdown_connections 2023-10-16T13:04:56.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.694+0000 7f80a7768700 1 --2- 172.21.15.92:0/969754161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a01057c0 0x7f80a0105be0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:04:56.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.694+0000 7f80a7768700 1 -- 172.21.15.92:0/969754161 >> 172.21.15.92:0/969754161 conn(0x7f80a0100d80 msgr2=0x7f80a01031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:04:56.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.694+0000 7f80a7768700 1 -- 172.21.15.92:0/969754161 shutdown_connections 2023-10-16T13:04:56.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.694+0000 7f80a7768700 1 -- 172.21.15.92:0/969754161 wait complete. 2023-10-16T13:04:56.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.694+0000 7f80a7768700 1 Processor -- start 2023-10-16T13:04:56.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.695+0000 7f80a7768700 1 -- start start 2023-10-16T13:04:56.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.695+0000 7f80a7768700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a01057c0 0x7f80a0074490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:04:56.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.695+0000 7f80a7768700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a019d2e0 con 0x7f80a01057c0 2023-10-16T13:04:56.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.695+0000 7f80a5504700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a01057c0 0x7f80a0074490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:04:56.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.695+0000 7f80a5504700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a01057c0 0x7f80a0074490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33884/0 (socket says 172.21.15.92:33884) 2023-10-16T13:04:56.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.695+0000 7f80a5504700 1 -- 172.21.15.92:0/3685781814 learned_addr learned my addr 172.21.15.92:0/3685781814 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:04:56.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.695+0000 7f80a5504700 1 -- 172.21.15.92:0/3685781814 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c009550 con 0x7f80a01057c0 2023-10-16T13:04:56.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.695+0000 7f80a5504700 1 --2- 172.21.15.92:0/3685781814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a01057c0 0x7f80a0074490 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f809c003f70 tx=0x7f809c011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:04:56.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.695+0000 7f80967fc700 1 -- 172.21.15.92:0/3685781814 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f809c0039f0 con 0x7f80a01057c0 2023-10-16T13:04:56.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.695+0000 7f80a7768700 1 -- 172.21.15.92:0/3685781814 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a019d420 con 0x7f80a01057c0 2023-10-16T13:04:56.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.695+0000 7f80967fc700 1 -- 172.21.15.92:0/3685781814 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f809c003b50 con 0x7f80a01057c0 2023-10-16T13:04:56.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.695+0000 7f80967fc700 1 -- 172.21.15.92:0/3685781814 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f809c01a690 con 0x7f80a01057c0 2023-10-16T13:04:56.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.695+0000 7f80a7768700 1 -- 172.21.15.92:0/3685781814 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a019d8c0 con 0x7f80a01057c0 2023-10-16T13:04:56.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.696+0000 7f80967fc700 1 -- 172.21.15.92:0/3685781814 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f809c01ac70 con 0x7f80a01057c0 2023-10-16T13:04:56.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.696+0000 7f80967fc700 1 -- 172.21.15.92:0/3685781814 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f809c019700 con 0x7f80a01057c0 2023-10-16T13:04:56.220 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.696+0000 7f80a7768700 1 -- 172.21.15.92:0/3685781814 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a0109bf0 con 0x7f80a01057c0 2023-10-16T13:04:56.220 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.699+0000 7f80967fc700 1 -- 172.21.15.92:0/3685781814 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f809c0249f0 con 0x7f80a01057c0 2023-10-16T13:04:56.220 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.770+0000 7f80a7768700 1 -- 172.21.15.92:0/3685781814 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f80a019dab0 con 0x7f80a01057c0 2023-10-16T13:04:56.220 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.770+0000 7f80967fc700 1 -- 172.21.15.92:0/3685781814 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f809c024430 con 0x7f80a01057c0 2023-10-16T13:04:56.220 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.771+0000 7f80a7768700 1 -- 172.21.15.92:0/3685781814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a01057c0 msgr2=0x7f80a0074490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:04:56.221 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.771+0000 7f80a7768700 1 --2- 172.21.15.92:0/3685781814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a01057c0 0x7f80a0074490 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f809c003f70 tx=0x7f809c011b40 comp rx=0 tx=0).stop 2023-10-16T13:04:56.221 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.771+0000 7f80a7768700 1 -- 172.21.15.92:0/3685781814 shutdown_connections 2023-10-16T13:04:56.221 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.771+0000 7f80a7768700 1 --2- 172.21.15.92:0/3685781814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a01057c0 0x7f80a0074490 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:04:56.221 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.771+0000 7f80a7768700 1 -- 172.21.15.92:0/3685781814 >> 172.21.15.92:0/3685781814 conn(0x7f80a0100d80 msgr2=0x7f80a0101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:04:56.221 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.771+0000 7f80a7768700 1 -- 172.21.15.92:0/3685781814 shutdown_connections 2023-10-16T13:04:56.222 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:55.771+0000 7f80a7768700 1 -- 172.21.15.92:0/3685781814 wait complete. 2023-10-16T13:04:56.222 INFO:teuthology.orchestra.run.smithi092.stdout:mgr not available, waiting (2/15)... 2023-10-16T13:04:56.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:56 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3685781814' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-16T13:04:56.497 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:56 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:56.288+0000 7ff896ac2200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T13:04:56.996 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:56 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:56.551+0000 7ff896ac2200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T13:04:57.575 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:57 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:57.248+0000 7ff896ac2200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T13:04:57.575 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:57 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:57.380+0000 7ff896ac2200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T13:04:57.905 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:57 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:57.572+0000 7ff896ac2200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T13:04:57.905 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:57 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:57.685+0000 7ff896ac2200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T13:04:57.905 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:57 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:57.902+0000 7ff896ac2200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T13:04:59.183 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:04:58 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:04:58.797+0000 7ff896ac2200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T13:04:59.183 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:58 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1058264332' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-16T13:04:59.184 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:58 smithi092 ceph-mon[99542]: Activating manager daemon x 2023-10-16T13:04:59.184 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:58 smithi092 ceph-mon[99542]: mgrmap e2: x(active, starting, since 0.00320653s) 2023-10-16T13:04:59.184 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:58 smithi092 ceph-mon[99542]: from='mgr.14100 172.21.15.92:0/2450672658' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-16T13:04:59.184 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:58 smithi092 ceph-mon[99542]: from='mgr.14100 172.21.15.92:0/2450672658' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-16T13:04:59.184 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:58 smithi092 ceph-mon[99542]: from='mgr.14100 172.21.15.92:0/2450672658' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-16T13:04:59.185 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:58 smithi092 ceph-mon[99542]: from='mgr.14100 172.21.15.92:0/2450672658' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-16T13:04:59.185 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:58 smithi092 ceph-mon[99542]: from='mgr.14100 172.21.15.92:0/2450672658' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-16T13:04:59.249 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2023-10-16T13:04:59.250 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2023-10-16T13:04:59.250 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsid": "6c276d7e-6c24-11ee-8db6-212e2dc638e7", 2023-10-16T13:04:59.250 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "health": { 2023-10-16T13:04:59.250 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-16T13:04:59.251 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-16T13:04:59.251 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-16T13:04:59.251 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:59.251 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-16T13:04:59.251 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-16T13:04:59.252 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 0 2023-10-16T13:04:59.252 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2023-10-16T13:04:59.252 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-16T13:04:59.252 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "a" 2023-10-16T13:04:59.253 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2023-10-16T13:04:59.253 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2023-10-16T13:04:59.253 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-16T13:04:59.253 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-16T13:04:59.253 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-16T13:04:59.253 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-16T13:04:59.254 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:59.254 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-16T13:04:59.254 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-16T13:04:59.254 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-16T13:04:59.255 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-16T13:04:59.255 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-16T13:04:59.255 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-16T13:04:59.255 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-16T13:04:59.255 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-16T13:04:59.256 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:59.256 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-16T13:04:59.256 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-16T13:04:59.256 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-16T13:04:59.256 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-16T13:04:59.256 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-16T13:04:59.257 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-16T13:04:59.257 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-16T13:04:59.257 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-16T13:04:59.257 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-16T13:04:59.258 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:59.258 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-16T13:04:59.258 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-16T13:04:59.258 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-16T13:04:59.258 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-16T13:04:59.259 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:59.259 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-16T13:04:59.259 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-16T13:04:59.259 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-16T13:04:59.259 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-16T13:04:59.260 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-16T13:04:59.260 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-16T13:04:59.260 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "restful" 2023-10-16T13:04:59.260 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2023-10-16T13:04:59.260 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-16T13:04:59.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:59.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-16T13:04:59.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-16T13:04:59.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modified": "2023-10-16T13:04:39.975990+0000", 2023-10-16T13:04:59.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-16T13:04:59.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:04:59.262 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-16T13:04:59.262 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2023-10-16T13:04:59.262 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.698+0000 7fbbee7b1700 1 Processor -- start 2023-10-16T13:04:59.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.698+0000 7fbbee7b1700 1 -- start start 2023-10-16T13:04:59.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.698+0000 7fbbee7b1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbe81057c0 0x7fbbe8105be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:04:59.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.698+0000 7fbbee7b1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe81061b0 con 0x7fbbe81057c0 2023-10-16T13:04:59.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.698+0000 7fbbe7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbe81057c0 0x7fbbe8105be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:04:59.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.698+0000 7fbbe7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbe81057c0 0x7fbbe8105be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33886/0 (socket says 172.21.15.92:33886) 2023-10-16T13:04:59.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.698+0000 7fbbe7fff700 1 -- 172.21.15.92:0/421969058 learned_addr learned my addr 172.21.15.92:0/421969058 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:04:59.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.698+0000 7fbbe7fff700 1 -- 172.21.15.92:0/421969058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe81069c0 con 0x7fbbe81057c0 2023-10-16T13:04:59.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.698+0000 7fbbe7fff700 1 --2- 172.21.15.92:0/421969058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbe81057c0 0x7fbbe8105be0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80098a0 tx=0x7fbbd8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b1a1aa0d1642a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:04:59.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.699+0000 7fbbe6ffd700 1 -- 172.21.15.92:0/421969058 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbd8004160 con 0x7fbbe81057c0 2023-10-16T13:04:59.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.699+0000 7fbbe6ffd700 1 -- 172.21.15.92:0/421969058 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fbbd80042c0 con 0x7fbbe81057c0 2023-10-16T13:04:59.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.699+0000 7fbbe6ffd700 1 -- 172.21.15.92:0/421969058 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbd8011ac0 con 0x7fbbe81057c0 2023-10-16T13:04:59.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.699+0000 7fbbee7b1700 1 -- 172.21.15.92:0/421969058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbe81057c0 msgr2=0x7fbbe8105be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:04:59.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.699+0000 7fbbee7b1700 1 --2- 172.21.15.92:0/421969058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbe81057c0 0x7fbbe8105be0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80098a0 tx=0x7fbbd8009bb0 comp rx=0 tx=0).stop 2023-10-16T13:04:59.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.699+0000 7fbbee7b1700 1 -- 172.21.15.92:0/421969058 shutdown_connections 2023-10-16T13:04:59.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.699+0000 7fbbee7b1700 1 --2- 172.21.15.92:0/421969058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbe81057c0 0x7fbbe8105be0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:04:59.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.699+0000 7fbbee7b1700 1 -- 172.21.15.92:0/421969058 >> 172.21.15.92:0/421969058 conn(0x7fbbe8100d80 msgr2=0x7fbbe81031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:04:59.266 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.699+0000 7fbbee7b1700 1 -- 172.21.15.92:0/421969058 shutdown_connections 2023-10-16T13:04:59.266 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.700+0000 7fbbee7b1700 1 -- 172.21.15.92:0/421969058 wait complete. 2023-10-16T13:04:59.266 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.700+0000 7fbbee7b1700 1 Processor -- start 2023-10-16T13:04:59.266 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.700+0000 7fbbee7b1700 1 -- start start 2023-10-16T13:04:59.266 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.700+0000 7fbbee7b1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbe81057c0 0x7fbbe819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:04:59.267 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.700+0000 7fbbee7b1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe819ab00 con 0x7fbbe81057c0 2023-10-16T13:04:59.267 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.701+0000 7fbbe7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbe81057c0 0x7fbbe819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:04:59.267 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.701+0000 7fbbe7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbe81057c0 0x7fbbe819a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33888/0 (socket says 172.21.15.92:33888) 2023-10-16T13:04:59.267 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.701+0000 7fbbe7fff700 1 -- 172.21.15.92:0/1058264332 learned_addr learned my addr 172.21.15.92:0/1058264332 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:04:59.267 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.701+0000 7fbbe7fff700 1 -- 172.21.15.92:0/1058264332 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd8009550 con 0x7fbbe81057c0 2023-10-16T13:04:59.267 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.701+0000 7fbbe7fff700 1 --2- 172.21.15.92:0/1058264332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbe81057c0 0x7fbbe819a5c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8003f70 tx=0x7fbbd8011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:04:59.268 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.701+0000 7fbbe57fa700 1 -- 172.21.15.92:0/1058264332 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbd80039f0 con 0x7fbbe81057c0 2023-10-16T13:04:59.268 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.701+0000 7fbbee7b1700 1 -- 172.21.15.92:0/1058264332 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe819ad00 con 0x7fbbe81057c0 2023-10-16T13:04:59.268 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.701+0000 7fbbee7b1700 1 -- 172.21.15.92:0/1058264332 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe819b1a0 con 0x7fbbe81057c0 2023-10-16T13:04:59.268 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.701+0000 7fbbe57fa700 1 -- 172.21.15.92:0/1058264332 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fbbd8003b50 con 0x7fbbe81057c0 2023-10-16T13:04:59.268 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.701+0000 7fbbe57fa700 1 -- 172.21.15.92:0/1058264332 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbd801a5e0 con 0x7fbbe81057c0 2023-10-16T13:04:59.269 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.701+0000 7fbbe57fa700 1 -- 172.21.15.92:0/1058264332 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbbd801abc0 con 0x7fbbe81057c0 2023-10-16T13:04:59.269 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.701+0000 7fbbe57fa700 1 -- 172.21.15.92:0/1058264332 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbbd8019700 con 0x7fbbe81057c0 2023-10-16T13:04:59.269 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.702+0000 7fbbee7b1700 1 -- 172.21.15.92:0/1058264332 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd4005320 con 0x7fbbe81057c0 2023-10-16T13:04:59.269 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.706+0000 7fbbe57fa700 1 -- 172.21.15.92:0/1058264332 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fbbd8019960 con 0x7fbbe81057c0 2023-10-16T13:04:59.269 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.778+0000 7fbbee7b1700 1 -- 172.21.15.92:0/1058264332 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fbbd40058a0 con 0x7fbbe81057c0 2023-10-16T13:04:59.269 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.779+0000 7fbbe57fa700 1 -- 172.21.15.92:0/1058264332 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fbbd8019b00 con 0x7fbbe81057c0 2023-10-16T13:04:59.270 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.780+0000 7fbbee7b1700 1 -- 172.21.15.92:0/1058264332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbe81057c0 msgr2=0x7fbbe819a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:04:59.270 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.780+0000 7fbbee7b1700 1 --2- 172.21.15.92:0/1058264332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbe81057c0 0x7fbbe819a5c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8003f70 tx=0x7fbbd8011b40 comp rx=0 tx=0).stop 2023-10-16T13:04:59.270 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.780+0000 7fbbee7b1700 1 -- 172.21.15.92:0/1058264332 shutdown_connections 2023-10-16T13:04:59.270 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.780+0000 7fbbee7b1700 1 --2- 172.21.15.92:0/1058264332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbe81057c0 0x7fbbe819a5c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:04:59.270 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.780+0000 7fbbee7b1700 1 -- 172.21.15.92:0/1058264332 >> 172.21.15.92:0/1058264332 conn(0x7fbbe8100d80 msgr2=0x7fbbe80741e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:04:59.271 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.780+0000 7fbbee7b1700 1 -- 172.21.15.92:0/1058264332 shutdown_connections 2023-10-16T13:04:59.271 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:04:58.780+0000 7fbbee7b1700 1 -- 172.21.15.92:0/1058264332 wait complete. 2023-10-16T13:04:59.271 INFO:teuthology.orchestra.run.smithi092.stdout:mgr not available, waiting (3/15)... 2023-10-16T13:05:00.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:59 smithi092 ceph-mon[99542]: Manager daemon x is now available 2023-10-16T13:05:00.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:59 smithi092 ceph-mon[99542]: from='mgr.14100 172.21.15.92:0/2450672658' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-16T13:05:00.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:59 smithi092 ceph-mon[99542]: from='mgr.14100 172.21.15.92:0/2450672658' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-16T13:05:00.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:59 smithi092 ceph-mon[99542]: from='mgr.14100 172.21.15.92:0/2450672658' entity='mgr.x' 2023-10-16T13:05:00.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:59 smithi092 ceph-mon[99542]: from='mgr.14100 172.21.15.92:0/2450672658' entity='mgr.x' 2023-10-16T13:05:00.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:59 smithi092 ceph-mon[99542]: from='mgr.14100 172.21.15.92:0/2450672658' entity='mgr.x' 2023-10-16T13:05:00.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:04:59 smithi092 ceph-mon[99542]: mgrmap e3: x(active, since 1.00724s) 2023-10-16T13:05:02.445 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:02 smithi092 ceph-mon[99542]: mgrmap e4: x(active, since 2s) 2023-10-16T13:05:02.445 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:02 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2062383562' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-16T13:05:02.497 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2023-10-16T13:05:02.497 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2023-10-16T13:05:02.498 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsid": "6c276d7e-6c24-11ee-8db6-212e2dc638e7", 2023-10-16T13:05:02.498 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "health": { 2023-10-16T13:05:02.498 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-16T13:05:02.498 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-16T13:05:02.498 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-16T13:05:02.499 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:05:02.499 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-16T13:05:02.499 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-16T13:05:02.499 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 0 2023-10-16T13:05:02.499 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2023-10-16T13:05:02.499 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-16T13:05:02.500 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "a" 2023-10-16T13:05:02.500 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2023-10-16T13:05:02.500 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2023-10-16T13:05:02.500 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-16T13:05:02.500 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-16T13:05:02.501 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-16T13:05:02.501 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-16T13:05:02.501 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:05:02.501 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-16T13:05:02.501 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-16T13:05:02.501 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-16T13:05:02.502 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-16T13:05:02.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-16T13:05:02.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-16T13:05:02.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-16T13:05:02.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-16T13:05:02.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:05:02.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-16T13:05:02.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-16T13:05:02.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-16T13:05:02.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-16T13:05:02.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-16T13:05:02.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-16T13:05:02.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-16T13:05:02.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-16T13:05:02.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-16T13:05:02.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:05:02.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-16T13:05:02.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-16T13:05:02.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-16T13:05:02.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-16T13:05:02.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:05:02.514 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-16T13:05:02.514 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-16T13:05:02.514 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-16T13:05:02.514 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-16T13:05:02.514 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-16T13:05:02.515 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-16T13:05:02.515 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "restful" 2023-10-16T13:05:02.515 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2023-10-16T13:05:02.515 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-16T13:05:02.515 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:05:02.515 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-16T13:05:02.516 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-16T13:05:02.516 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modified": "2023-10-16T13:04:39.975990+0000", 2023-10-16T13:05:02.516 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-16T13:05:02.516 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2023-10-16T13:05:02.516 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-16T13:05:02.517 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2023-10-16T13:05:02.517 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.763+0000 7f0ddeea1700 1 Processor -- start 2023-10-16T13:05:02.517 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.763+0000 7f0ddeea1700 1 -- start start 2023-10-16T13:05:02.517 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.763+0000 7f0ddeea1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd81057d0 0x7f0dd8105bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:02.517 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.763+0000 7f0ddeea1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd81061c0 con 0x7f0dd81057d0 2023-10-16T13:05:02.517 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.763+0000 7f0ddcc3d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd81057d0 0x7f0dd8105bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:02.518 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.763+0000 7f0ddcc3d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd81057d0 0x7f0dd8105bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33916/0 (socket says 172.21.15.92:33916) 2023-10-16T13:05:02.518 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.763+0000 7f0ddcc3d700 1 -- 172.21.15.92:0/1503158876 learned_addr learned my addr 172.21.15.92:0/1503158876 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:02.518 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.763+0000 7f0ddcc3d700 1 -- 172.21.15.92:0/1503158876 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd81069d0 con 0x7f0dd81057d0 2023-10-16T13:05:02.518 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.764+0000 7f0ddcc3d700 1 --2- 172.21.15.92:0/1503158876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd81057d0 0x7f0dd8105bf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0098a0 tx=0x7f0dcc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fd1d5e7733262e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:02.518 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.764+0000 7f0dd77fe700 1 -- 172.21.15.92:0/1503158876 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0dcc004160 con 0x7f0dd81057d0 2023-10-16T13:05:02.519 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.764+0000 7f0dd77fe700 1 -- 172.21.15.92:0/1503158876 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f0dcc0042c0 con 0x7f0dd81057d0 2023-10-16T13:05:02.519 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.764+0000 7f0dd77fe700 1 -- 172.21.15.92:0/1503158876 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0dcc011ac0 con 0x7f0dd81057d0 2023-10-16T13:05:02.519 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.764+0000 7f0ddeea1700 1 -- 172.21.15.92:0/1503158876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd81057d0 msgr2=0x7f0dd8105bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:02.519 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.764+0000 7f0ddeea1700 1 --2- 172.21.15.92:0/1503158876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd81057d0 0x7f0dd8105bf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0098a0 tx=0x7f0dcc009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:02.519 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.764+0000 7f0ddeea1700 1 -- 172.21.15.92:0/1503158876 shutdown_connections 2023-10-16T13:05:02.520 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.764+0000 7f0ddeea1700 1 --2- 172.21.15.92:0/1503158876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd81057d0 0x7f0dd8105bf0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:02.520 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.764+0000 7f0ddeea1700 1 -- 172.21.15.92:0/1503158876 >> 172.21.15.92:0/1503158876 conn(0x7f0dd8100d70 msgr2=0x7f0dd81031b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:02.520 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.764+0000 7f0ddeea1700 1 -- 172.21.15.92:0/1503158876 shutdown_connections 2023-10-16T13:05:02.520 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.764+0000 7f0ddeea1700 1 -- 172.21.15.92:0/1503158876 wait complete. 2023-10-16T13:05:02.520 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.765+0000 7f0ddeea1700 1 Processor -- start 2023-10-16T13:05:02.521 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.765+0000 7f0ddeea1700 1 -- start start 2023-10-16T13:05:02.521 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.765+0000 7f0ddeea1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd81057d0 0x7f0dd819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:02.521 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.765+0000 7f0ddeea1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd819aa90 con 0x7f0dd81057d0 2023-10-16T13:05:02.521 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.765+0000 7f0ddcc3d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd81057d0 0x7f0dd819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:02.521 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.765+0000 7f0ddcc3d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd81057d0 0x7f0dd819a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33918/0 (socket says 172.21.15.92:33918) 2023-10-16T13:05:02.521 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.765+0000 7f0ddcc3d700 1 -- 172.21.15.92:0/2062383562 learned_addr learned my addr 172.21.15.92:0/2062383562 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:02.522 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.765+0000 7f0ddcc3d700 1 -- 172.21.15.92:0/2062383562 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc009550 con 0x7f0dd81057d0 2023-10-16T13:05:02.522 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.765+0000 7f0ddcc3d700 1 --2- 172.21.15.92:0/2062383562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd81057d0 0x7f0dd819a550 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc003f70 tx=0x7f0dcc011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:02.522 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.766+0000 7f0dd5ffb700 1 -- 172.21.15.92:0/2062383562 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0dcc003af0 con 0x7f0dd81057d0 2023-10-16T13:05:02.522 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.766+0000 7f0dd5ffb700 1 -- 172.21.15.92:0/2062383562 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f0dcc003c50 con 0x7f0dd81057d0 2023-10-16T13:05:02.522 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.766+0000 7f0ddeea1700 1 -- 172.21.15.92:0/2062383562 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd819ac90 con 0x7f0dd81057d0 2023-10-16T13:05:02.523 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.766+0000 7f0dd5ffb700 1 -- 172.21.15.92:0/2062383562 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0dcc024880 con 0x7f0dd81057d0 2023-10-16T13:05:02.523 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.766+0000 7f0ddeea1700 1 -- 172.21.15.92:0/2062383562 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd819b130 con 0x7f0dd81057d0 2023-10-16T13:05:02.523 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.767+0000 7f0dd5ffb700 1 -- 172.21.15.92:0/2062383562 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 45568+0+0 (secure 0 0 0) 0x7f0dcc024af0 con 0x7f0dd81057d0 2023-10-16T13:05:02.523 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.767+0000 7f0ddeea1700 1 -- 172.21.15.92:0/2062383562 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd8109c00 con 0x7f0dd81057d0 2023-10-16T13:05:02.523 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.767+0000 7f0dd5ffb700 1 --2- 172.21.15.92:0/2062383562 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f0dc80387d0 0x7f0dc803ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:02.524 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.767+0000 7f0dd5ffb700 1 -- 172.21.15.92:0/2062383562 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0dcc04c600 con 0x7f0dd81057d0 2023-10-16T13:05:02.524 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.767+0000 7f0dd7fff700 1 --2- 172.21.15.92:0/2062383562 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f0dc80387d0 0x7f0dc803ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:02.524 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.767+0000 7f0dd7fff700 1 --2- 172.21.15.92:0/2062383562 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f0dc80387d0 0x7f0dc803ac90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4006fd0 tx=0x7f0dc4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:02.524 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:01.772+0000 7f0dd5ffb700 1 -- 172.21.15.92:0/2062383562 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0dcc024da0 con 0x7f0dd81057d0 2023-10-16T13:05:02.524 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:02.036+0000 7f0ddeea1700 1 -- 172.21.15.92:0/2062383562 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f0dd819daf0 con 0x7f0dd81057d0 2023-10-16T13:05:02.525 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:02.037+0000 7f0dd5ffb700 1 -- 172.21.15.92:0/2062383562 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f0dcc018b40 con 0x7f0dd81057d0 2023-10-16T13:05:02.525 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:02.039+0000 7f0ddeea1700 1 -- 172.21.15.92:0/2062383562 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f0dc80387d0 msgr2=0x7f0dc803ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:02.525 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:02.039+0000 7f0ddeea1700 1 --2- 172.21.15.92:0/2062383562 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f0dc80387d0 0x7f0dc803ac90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4006fd0 tx=0x7f0dc4006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:02.525 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:02.039+0000 7f0ddeea1700 1 -- 172.21.15.92:0/2062383562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd81057d0 msgr2=0x7f0dd819a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:02.525 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:02.039+0000 7f0ddeea1700 1 --2- 172.21.15.92:0/2062383562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd81057d0 0x7f0dd819a550 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc003f70 tx=0x7f0dcc011a90 comp rx=0 tx=0).stop 2023-10-16T13:05:02.525 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:02.039+0000 7f0ddeea1700 1 -- 172.21.15.92:0/2062383562 shutdown_connections 2023-10-16T13:05:02.526 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:02.039+0000 7f0ddeea1700 1 --2- 172.21.15.92:0/2062383562 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f0dc80387d0 0x7f0dc803ac90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:02.526 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:02.039+0000 7f0ddeea1700 1 --2- 172.21.15.92:0/2062383562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd81057d0 0x7f0dd819a550 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:02.526 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:02.039+0000 7f0ddeea1700 1 -- 172.21.15.92:0/2062383562 >> 172.21.15.92:0/2062383562 conn(0x7f0dd8100d70 msgr2=0x7f0dd8079920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:02.526 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:02.039+0000 7f0ddeea1700 1 -- 172.21.15.92:0/2062383562 shutdown_connections 2023-10-16T13:05:02.526 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:02.039+0000 7f0ddeea1700 1 -- 172.21.15.92:0/2062383562 wait complete. 2023-10-16T13:05:02.526 INFO:teuthology.orchestra.run.smithi092.stdout:mgr is available 2023-10-16T13:05:03.640 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:03 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1915456472' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-16T13:05:03.647 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2023-10-16T13:05:03.647 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [global] 2023-10-16T13:05:03.647 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout fsid = 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:05:03.648 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-16T13:05:03.648 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-16T13:05:03.648 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-16T13:05:03.648 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-16T13:05:03.648 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2023-10-16T13:05:03.648 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-16T13:05:03.649 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-16T13:05:03.649 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2023-10-16T13:05:03.649 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [osd] 2023-10-16T13:05:03.649 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-16T13:05:03.649 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-16T13:05:03.650 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-16T13:05:03.650 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-16T13:05:03.650 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-16T13:05:03.650 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.053+0000 7f21c814e700 1 Processor -- start 2023-10-16T13:05:03.650 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.054+0000 7f21c814e700 1 -- start start 2023-10-16T13:05:03.651 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.054+0000 7f21c814e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21c007bec0 0x7f21c007a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:03.651 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.054+0000 7f21c814e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c007a8f0 con 0x7f21c007bec0 2023-10-16T13:05:03.651 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.054+0000 7f21c5eea700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21c007bec0 0x7f21c007a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:03.651 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.054+0000 7f21c5eea700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21c007bec0 0x7f21c007a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33922/0 (socket says 172.21.15.92:33922) 2023-10-16T13:05:03.651 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.054+0000 7f21c5eea700 1 -- 172.21.15.92:0/1335240806 learned_addr learned my addr 172.21.15.92:0/1335240806 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:03.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.054+0000 7f21c5eea700 1 -- 172.21.15.92:0/1335240806 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c007aa30 con 0x7f21c007bec0 2023-10-16T13:05:03.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.054+0000 7f21c5eea700 1 --2- 172.21.15.92:0/1335240806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21c007bec0 0x7f21c007a320 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f21b00098a0 tx=0x7f21b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6e09b312c71c28 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:03.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.055+0000 7f21c4ee8700 1 -- 172.21.15.92:0/1335240806 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21b0004160 con 0x7f21c007bec0 2023-10-16T13:05:03.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.055+0000 7f21c4ee8700 1 -- 172.21.15.92:0/1335240806 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f21b00042c0 con 0x7f21c007bec0 2023-10-16T13:05:03.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.055+0000 7f21c4ee8700 1 -- 172.21.15.92:0/1335240806 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21b0011ac0 con 0x7f21c007bec0 2023-10-16T13:05:03.653 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.055+0000 7f21c814e700 1 -- 172.21.15.92:0/1335240806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21c007bec0 msgr2=0x7f21c007a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:03.653 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.055+0000 7f21c814e700 1 --2- 172.21.15.92:0/1335240806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21c007bec0 0x7f21c007a320 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f21b00098a0 tx=0x7f21b0009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:03.653 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.055+0000 7f21c814e700 1 -- 172.21.15.92:0/1335240806 shutdown_connections 2023-10-16T13:05:03.653 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.055+0000 7f21c814e700 1 --2- 172.21.15.92:0/1335240806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21c007bec0 0x7f21c007a320 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:03.653 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.055+0000 7f21c814e700 1 -- 172.21.15.92:0/1335240806 >> 172.21.15.92:0/1335240806 conn(0x7f21c0101e90 msgr2=0x7f21c01042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:03.653 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.055+0000 7f21c814e700 1 -- 172.21.15.92:0/1335240806 shutdown_connections 2023-10-16T13:05:03.654 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.055+0000 7f21c814e700 1 -- 172.21.15.92:0/1335240806 wait complete. 2023-10-16T13:05:03.654 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.056+0000 7f21c814e700 1 Processor -- start 2023-10-16T13:05:03.654 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.056+0000 7f21c814e700 1 -- start start 2023-10-16T13:05:03.654 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.056+0000 7f21c814e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21c007bec0 0x7f21c019c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:03.654 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.056+0000 7f21c814e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c019cca0 con 0x7f21c007bec0 2023-10-16T13:05:03.655 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.056+0000 7f21c5eea700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21c007bec0 0x7f21c019c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:03.655 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.056+0000 7f21c5eea700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21c007bec0 0x7f21c019c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33924/0 (socket says 172.21.15.92:33924) 2023-10-16T13:05:03.655 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.056+0000 7f21c5eea700 1 -- 172.21.15.92:0/1915456472 learned_addr learned my addr 172.21.15.92:0/1915456472 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:03.655 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.057+0000 7f21c5eea700 1 -- 172.21.15.92:0/1915456472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b0009550 con 0x7f21c007bec0 2023-10-16T13:05:03.655 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.057+0000 7f21c5eea700 1 --2- 172.21.15.92:0/1915456472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21c007bec0 0x7f21c019c760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f21b0003f70 tx=0x7f21b0011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:03.656 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.057+0000 7f21b6ffd700 1 -- 172.21.15.92:0/1915456472 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21b0003af0 con 0x7f21c007bec0 2023-10-16T13:05:03.656 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.057+0000 7f21c814e700 1 -- 172.21.15.92:0/1915456472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c019cea0 con 0x7f21c007bec0 2023-10-16T13:05:03.656 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.057+0000 7f21b6ffd700 1 -- 172.21.15.92:0/1915456472 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f21b0003c50 con 0x7f21c007bec0 2023-10-16T13:05:03.656 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.057+0000 7f21b6ffd700 1 -- 172.21.15.92:0/1915456472 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21b0024880 con 0x7f21c007bec0 2023-10-16T13:05:03.656 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.057+0000 7f21c814e700 1 -- 172.21.15.92:0/1915456472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c019d340 con 0x7f21c007bec0 2023-10-16T13:05:03.657 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.058+0000 7f21b6ffd700 1 -- 172.21.15.92:0/1915456472 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 45568+0+0 (secure 0 0 0) 0x7f21b001a430 con 0x7f21c007bec0 2023-10-16T13:05:03.657 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.058+0000 7f21c814e700 1 -- 172.21.15.92:0/1915456472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c010cd00 con 0x7f21c007bec0 2023-10-16T13:05:03.657 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.058+0000 7f21b6ffd700 1 --2- 172.21.15.92:0/1915456472 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f21ac038780 0x7f21ac03ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:03.657 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.058+0000 7f21b6ffd700 1 -- 172.21.15.92:0/1915456472 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f21b004c600 con 0x7f21c007bec0 2023-10-16T13:05:03.657 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.058+0000 7f21c56e9700 1 --2- 172.21.15.92:0/1915456472 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f21ac038780 0x7f21ac03ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:03.657 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.059+0000 7f21c56e9700 1 --2- 172.21.15.92:0/1915456472 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f21ac038780 0x7f21ac03ac40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f21bc006fd0 tx=0x7f21bc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:03.658 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.063+0000 7f21b6ffd700 1 -- 172.21.15.92:0/1915456472 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f21b002cb00 con 0x7f21c007bec0 2023-10-16T13:05:03.658 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.247+0000 7f21c814e700 1 -- 172.21.15.92:0/1915456472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f21c010cf70 con 0x7f21c007bec0 2023-10-16T13:05:03.658 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.248+0000 7f21b6ffd700 1 -- 172.21.15.92:0/1915456472 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f21b002cb00 con 0x7f21c007bec0 2023-10-16T13:05:03.658 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.250+0000 7f21c814e700 1 -- 172.21.15.92:0/1915456472 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f21ac038780 msgr2=0x7f21ac03ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:03.659 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.250+0000 7f21c814e700 1 --2- 172.21.15.92:0/1915456472 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f21ac038780 0x7f21ac03ac40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f21bc006fd0 tx=0x7f21bc006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:03.659 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.250+0000 7f21c814e700 1 -- 172.21.15.92:0/1915456472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21c007bec0 msgr2=0x7f21c019c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:03.659 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.250+0000 7f21c814e700 1 --2- 172.21.15.92:0/1915456472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21c007bec0 0x7f21c019c760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f21b0003f70 tx=0x7f21b0011a90 comp rx=0 tx=0).stop 2023-10-16T13:05:03.659 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.250+0000 7f21c814e700 1 -- 172.21.15.92:0/1915456472 shutdown_connections 2023-10-16T13:05:03.659 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.250+0000 7f21c814e700 1 --2- 172.21.15.92:0/1915456472 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f21ac038780 0x7f21ac03ac40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:03.660 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.250+0000 7f21c814e700 1 --2- 172.21.15.92:0/1915456472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21c007bec0 0x7f21c019c760 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:03.660 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.250+0000 7f21c814e700 1 -- 172.21.15.92:0/1915456472 >> 172.21.15.92:0/1915456472 conn(0x7f21c0101e90 msgr2=0x7f21c0102be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:03.660 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.250+0000 7f21c814e700 1 -- 172.21.15.92:0/1915456472 shutdown_connections 2023-10-16T13:05:03.660 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:03.250+0000 7f21c814e700 1 -- 172.21.15.92:0/1915456472 wait complete. 2023-10-16T13:05:03.660 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling cephadm module... 2023-10-16T13:05:04.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:04 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/810308142' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-10-16T13:05:04.747 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:04 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: ignoring --setuser ceph since I am not root 2023-10-16T13:05:04.747 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:04 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: ignoring --setgroup ceph since I am not root 2023-10-16T13:05:04.748 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:04 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:04.602+0000 7f65df703200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T13:05:04.748 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:04 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:04.682+0000 7f65df703200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T13:05:04.890 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.134+0000 7f62cf80f700 1 Processor -- start 2023-10-16T13:05:04.890 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.134+0000 7f62cf80f700 1 -- start start 2023-10-16T13:05:04.891 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.134+0000 7f62cf80f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62c81068f0 0x7f62c8106d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:04.891 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.134+0000 7f62cf80f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c81072e0 con 0x7f62c81068f0 2023-10-16T13:05:04.891 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.134+0000 7f62cd5ab700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62c81068f0 0x7f62c8106d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:04.891 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.135+0000 7f62cd5ab700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62c81068f0 0x7f62c8106d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33928/0 (socket says 172.21.15.92:33928) 2023-10-16T13:05:04.891 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.135+0000 7f62cd5ab700 1 -- 172.21.15.92:0/4028008454 learned_addr learned my addr 172.21.15.92:0/4028008454 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:04.892 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.135+0000 7f62cd5ab700 1 -- 172.21.15.92:0/4028008454 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c8107af0 con 0x7f62c81068f0 2023-10-16T13:05:04.892 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.135+0000 7f62cd5ab700 1 --2- 172.21.15.92:0/4028008454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62c81068f0 0x7f62c8106d10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009e80 tx=0x7f62c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f76e822b1637a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:04.892 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.135+0000 7f62c7fff700 1 -- 172.21.15.92:0/4028008454 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62c000e070 con 0x7f62c81068f0 2023-10-16T13:05:04.892 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.135+0000 7f62c7fff700 1 -- 172.21.15.92:0/4028008454 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f62c000b8c0 con 0x7f62c81068f0 2023-10-16T13:05:04.892 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.135+0000 7f62c7fff700 1 -- 172.21.15.92:0/4028008454 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62c0004550 con 0x7f62c81068f0 2023-10-16T13:05:04.893 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.136+0000 7f62cf80f700 1 -- 172.21.15.92:0/4028008454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62c81068f0 msgr2=0x7f62c8106d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:04.893 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.136+0000 7f62cf80f700 1 --2- 172.21.15.92:0/4028008454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62c81068f0 0x7f62c8106d10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009e80 tx=0x7f62c000b330 comp rx=0 tx=0).stop 2023-10-16T13:05:04.893 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.136+0000 7f62cf80f700 1 -- 172.21.15.92:0/4028008454 shutdown_connections 2023-10-16T13:05:04.893 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.136+0000 7f62cf80f700 1 --2- 172.21.15.92:0/4028008454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62c81068f0 0x7f62c8106d10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:04.893 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.136+0000 7f62cf80f700 1 -- 172.21.15.92:0/4028008454 >> 172.21.15.92:0/4028008454 conn(0x7f62c8101e90 msgr2=0x7f62c81042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:04.894 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.136+0000 7f62cf80f700 1 -- 172.21.15.92:0/4028008454 shutdown_connections 2023-10-16T13:05:04.894 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.136+0000 7f62cf80f700 1 -- 172.21.15.92:0/4028008454 wait complete. 2023-10-16T13:05:04.894 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.136+0000 7f62cf80f700 1 Processor -- start 2023-10-16T13:05:04.894 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.136+0000 7f62cf80f700 1 -- start start 2023-10-16T13:05:04.894 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.137+0000 7f62cf80f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62c81068f0 0x7f62c819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:04.895 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.137+0000 7f62cf80f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c819a9a0 con 0x7f62c81068f0 2023-10-16T13:05:04.895 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.137+0000 7f62cd5ab700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62c81068f0 0x7f62c819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:04.895 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.137+0000 7f62cd5ab700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62c81068f0 0x7f62c819a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33930/0 (socket says 172.21.15.92:33930) 2023-10-16T13:05:04.895 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.137+0000 7f62cd5ab700 1 -- 172.21.15.92:0/810308142 learned_addr learned my addr 172.21.15.92:0/810308142 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:04.895 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.137+0000 7f62cd5ab700 1 -- 172.21.15.92:0/810308142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c0009b30 con 0x7f62c81068f0 2023-10-16T13:05:04.895 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.137+0000 7f62cd5ab700 1 --2- 172.21.15.92:0/810308142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62c81068f0 0x7f62c819a460 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f62c000d010 tx=0x7f62c0003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:04.896 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.137+0000 7f62c67fc700 1 -- 172.21.15.92:0/810308142 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62c000e040 con 0x7f62c81068f0 2023-10-16T13:05:04.896 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.137+0000 7f62c67fc700 1 -- 172.21.15.92:0/810308142 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f62c000bd70 con 0x7f62c81068f0 2023-10-16T13:05:04.896 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.137+0000 7f62cf80f700 1 -- 172.21.15.92:0/810308142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c819aba0 con 0x7f62c81068f0 2023-10-16T13:05:04.896 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.137+0000 7f62c67fc700 1 -- 172.21.15.92:0/810308142 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62c001c8e0 con 0x7f62c81068f0 2023-10-16T13:05:04.896 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.137+0000 7f62cf80f700 1 -- 172.21.15.92:0/810308142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c819b020 con 0x7f62c81068f0 2023-10-16T13:05:04.897 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.138+0000 7f62c67fc700 1 -- 172.21.15.92:0/810308142 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 45568+0+0 (secure 0 0 0) 0x7f62c001ca90 con 0x7f62c81068f0 2023-10-16T13:05:04.897 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.138+0000 7f62cf80f700 1 -- 172.21.15.92:0/810308142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c8062550 con 0x7f62c81068f0 2023-10-16T13:05:04.897 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.138+0000 7f62c67fc700 1 --2- 172.21.15.92:0/810308142 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f62b00387d0 0x7f62b003ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:04.897 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.138+0000 7f62c67fc700 1 -- 172.21.15.92:0/810308142 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f62c004c940 con 0x7f62c81068f0 2023-10-16T13:05:04.897 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.138+0000 7f62ccdaa700 1 --2- 172.21.15.92:0/810308142 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f62b00387d0 0x7f62b003ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:04.898 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.139+0000 7f62ccdaa700 1 --2- 172.21.15.92:0/810308142 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f62b00387d0 0x7f62b003ac90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f62bc006fd0 tx=0x7f62bc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:04.898 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.143+0000 7f62c67fc700 1 -- 172.21.15.92:0/810308142 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f62c8062550 con 0x7f62c81068f0 2023-10-16T13:05:04.898 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.382+0000 7f62cf80f700 1 -- 172.21.15.92:0/810308142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f62c810ad30 con 0x7f62c81068f0 2023-10-16T13:05:04.898 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.434+0000 7f62c67fc700 1 -- 172.21.15.92:0/810308142 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f62c0017070 con 0x7f62c81068f0 2023-10-16T13:05:04.898 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.435+0000 7f62c67fc700 1 -- 172.21.15.92:0/810308142 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mgrmap(e 5) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f62c001cd40 con 0x7f62c81068f0 2023-10-16T13:05:04.898 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.437+0000 7f62cf80f700 1 -- 172.21.15.92:0/810308142 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f62b00387d0 msgr2=0x7f62b003ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:04.899 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.437+0000 7f62cf80f700 1 --2- 172.21.15.92:0/810308142 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f62b00387d0 0x7f62b003ac90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f62bc006fd0 tx=0x7f62bc006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:04.899 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.437+0000 7f62cf80f700 1 -- 172.21.15.92:0/810308142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62c81068f0 msgr2=0x7f62c819a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:04.899 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.437+0000 7f62cf80f700 1 --2- 172.21.15.92:0/810308142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62c81068f0 0x7f62c819a460 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f62c000d010 tx=0x7f62c0003d00 comp rx=0 tx=0).stop 2023-10-16T13:05:04.899 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.437+0000 7f62cf80f700 1 -- 172.21.15.92:0/810308142 shutdown_connections 2023-10-16T13:05:04.899 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.437+0000 7f62cf80f700 1 --2- 172.21.15.92:0/810308142 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f62b00387d0 0x7f62b003ac90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:04.900 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.437+0000 7f62cf80f700 1 --2- 172.21.15.92:0/810308142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62c81068f0 0x7f62c819a460 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:04.900 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.437+0000 7f62cf80f700 1 -- 172.21.15.92:0/810308142 >> 172.21.15.92:0/810308142 conn(0x7f62c8101e90 msgr2=0x7f62c8102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:04.900 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.437+0000 7f62cf80f700 1 -- 172.21.15.92:0/810308142 shutdown_connections 2023-10-16T13:05:04.900 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:04.437+0000 7f62cf80f700 1 -- 172.21.15.92:0/810308142 wait complete. 2023-10-16T13:05:05.048 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:04 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:04.772+0000 7f65df703200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T13:05:05.048 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:04 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:04.866+0000 7f65df703200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T13:05:05.443 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:05 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:05.045+0000 7f65df703200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T13:05:05.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:05 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/810308142' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-10-16T13:05:05.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:05 smithi092 ceph-mon[99542]: mgrmap e5: x(active, since 5s) 2023-10-16T13:05:05.747 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:05 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:05.442+0000 7f65df703200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T13:05:05.747 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:05 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:05.575+0000 7f65df703200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T13:05:05.748 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:05 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:05.668+0000 7f65df703200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T13:05:06.034 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2023-10-16T13:05:06.034 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-10-16T13:05:06.035 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-16T13:05:06.035 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-16T13:05:06.035 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-16T13:05:06.035 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2023-10-16T13:05:06.036 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.378+0000 7f10f0365700 1 Processor -- start 2023-10-16T13:05:06.036 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.379+0000 7f10f0365700 1 -- start start 2023-10-16T13:05:06.036 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.379+0000 7f10f0365700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e8105180 0x7f10e81055a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:06.036 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.379+0000 7f10f0365700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e8074790 con 0x7f10e8105180 2023-10-16T13:05:06.036 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.379+0000 7f10ee101700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e8105180 0x7f10e81055a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:06.037 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.379+0000 7f10ee101700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e8105180 0x7f10e81055a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33944/0 (socket says 172.21.15.92:33944) 2023-10-16T13:05:06.037 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.379+0000 7f10ee101700 1 -- 172.21.15.92:0/446172148 learned_addr learned my addr 172.21.15.92:0/446172148 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:06.037 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.379+0000 7f10ee101700 1 -- 172.21.15.92:0/446172148 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e8105ae0 con 0x7f10e8105180 2023-10-16T13:05:06.037 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.379+0000 7f10ee101700 1 --2- 172.21.15.92:0/446172148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e8105180 0x7f10e81055a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f10d80098a0 tx=0x7f10d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc87dd9405e2fb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:06.038 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.380+0000 7f10ed0ff700 1 -- 172.21.15.92:0/446172148 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10d8004160 con 0x7f10e8105180 2023-10-16T13:05:06.038 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.380+0000 7f10ed0ff700 1 -- 172.21.15.92:0/446172148 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f10d80042c0 con 0x7f10e8105180 2023-10-16T13:05:06.038 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.380+0000 7f10ed0ff700 1 -- 172.21.15.92:0/446172148 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10d8011ac0 con 0x7f10e8105180 2023-10-16T13:05:06.038 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.380+0000 7f10f0365700 1 -- 172.21.15.92:0/446172148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e8105180 msgr2=0x7f10e81055a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:06.039 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.380+0000 7f10f0365700 1 --2- 172.21.15.92:0/446172148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e8105180 0x7f10e81055a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f10d80098a0 tx=0x7f10d8009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:06.039 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.380+0000 7f10f0365700 1 -- 172.21.15.92:0/446172148 shutdown_connections 2023-10-16T13:05:06.039 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.380+0000 7f10f0365700 1 --2- 172.21.15.92:0/446172148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e8105180 0x7f10e81055a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:06.039 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.380+0000 7f10f0365700 1 -- 172.21.15.92:0/446172148 >> 172.21.15.92:0/446172148 conn(0x7f10e8100d80 msgr2=0x7f10e81031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:06.039 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.380+0000 7f10f0365700 1 -- 172.21.15.92:0/446172148 shutdown_connections 2023-10-16T13:05:06.040 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.380+0000 7f10f0365700 1 -- 172.21.15.92:0/446172148 wait complete. 2023-10-16T13:05:06.040 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.381+0000 7f10f0365700 1 Processor -- start 2023-10-16T13:05:06.040 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.381+0000 7f10f0365700 1 -- start start 2023-10-16T13:05:06.040 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.381+0000 7f10f0365700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e8105180 0x7f10e819c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:06.040 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.381+0000 7f10f0365700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e819cca0 con 0x7f10e8105180 2023-10-16T13:05:06.041 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.381+0000 7f10ee101700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e8105180 0x7f10e819c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:06.041 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.381+0000 7f10ee101700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e8105180 0x7f10e819c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33946/0 (socket says 172.21.15.92:33946) 2023-10-16T13:05:06.041 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.381+0000 7f10ee101700 1 -- 172.21.15.92:0/2288177199 learned_addr learned my addr 172.21.15.92:0/2288177199 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:06.041 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.382+0000 7f10ee101700 1 -- 172.21.15.92:0/2288177199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d8009550 con 0x7f10e8105180 2023-10-16T13:05:06.041 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.382+0000 7f10ee101700 1 --2- 172.21.15.92:0/2288177199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e8105180 0x7f10e819c760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009130 tx=0x7f10d8011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:06.041 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.382+0000 7f10e77fe700 1 -- 172.21.15.92:0/2288177199 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10d8003aa0 con 0x7f10e8105180 2023-10-16T13:05:06.042 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.382+0000 7f10e77fe700 1 -- 172.21.15.92:0/2288177199 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f10d8003c00 con 0x7f10e8105180 2023-10-16T13:05:06.042 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.382+0000 7f10f0365700 1 -- 172.21.15.92:0/2288177199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e819cea0 con 0x7f10e8105180 2023-10-16T13:05:06.042 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.382+0000 7f10e77fe700 1 -- 172.21.15.92:0/2288177199 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10d8024800 con 0x7f10e8105180 2023-10-16T13:05:06.042 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:05 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:05.770+0000 7f65df703200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T13:05:06.045 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.382+0000 7f10f0365700 1 -- 172.21.15.92:0/2288177199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e819d340 con 0x7f10e8105180 2023-10-16T13:05:06.045 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.383+0000 7f10e77fe700 1 -- 172.21.15.92:0/2288177199 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f10d8024a70 con 0x7f10e8105180 2023-10-16T13:05:06.045 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.383+0000 7f10e77fe700 1 --2- 172.21.15.92:0/2288177199 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f10d0038870 0x7f10d003ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:06.045 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.383+0000 7f10f0365700 1 -- 172.21.15.92:0/2288177199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e8196030 con 0x7f10e8105180 2023-10-16T13:05:06.046 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.383+0000 7f10ed900700 1 -- 172.21.15.92:0/2288177199 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f10d0038870 msgr2=0x7f10d003ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/184191966 2023-10-16T13:05:06.046 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.383+0000 7f10e77fe700 1 -- 172.21.15.92:0/2288177199 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f10d804c540 con 0x7f10e8105180 2023-10-16T13:05:06.046 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.383+0000 7f10ed900700 1 --2- 172.21.15.92:0/2288177199 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f10d0038870 0x7f10d003ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T13:05:06.046 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.388+0000 7f10e77fe700 1 -- 172.21.15.92:0/2288177199 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f10d8024d20 con 0x7f10e8105180 2023-10-16T13:05:06.046 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.584+0000 7f10ed900700 1 -- 172.21.15.92:0/2288177199 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f10d0038870 msgr2=0x7f10d003ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/184191966 2023-10-16T13:05:06.047 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.584+0000 7f10ed900700 1 --2- 172.21.15.92:0/2288177199 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f10d0038870 0x7f10d003ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T13:05:06.047 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.637+0000 7f10f0365700 1 -- 172.21.15.92:0/2288177199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f10e81069b0 con 0x7f10e8105180 2023-10-16T13:05:06.047 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.638+0000 7f10e77fe700 1 -- 172.21.15.92:0/2288177199 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f10d801c0d0 con 0x7f10e8105180 2023-10-16T13:05:06.047 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.640+0000 7f10f0365700 1 -- 172.21.15.92:0/2288177199 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f10d0038870 msgr2=0x7f10d003ad30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T13:05:06.047 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.640+0000 7f10f0365700 1 --2- 172.21.15.92:0/2288177199 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f10d0038870 0x7f10d003ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:06.048 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.640+0000 7f10f0365700 1 -- 172.21.15.92:0/2288177199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e8105180 msgr2=0x7f10e819c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:06.048 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.640+0000 7f10f0365700 1 --2- 172.21.15.92:0/2288177199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e8105180 0x7f10e819c760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009130 tx=0x7f10d8011b40 comp rx=0 tx=0).stop 2023-10-16T13:05:06.048 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.640+0000 7f10f0365700 1 -- 172.21.15.92:0/2288177199 shutdown_connections 2023-10-16T13:05:06.048 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.640+0000 7f10f0365700 1 --2- 172.21.15.92:0/2288177199 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f10d0038870 0x7f10d003ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:06.048 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.640+0000 7f10f0365700 1 --2- 172.21.15.92:0/2288177199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e8105180 0x7f10e819c760 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:06.049 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.640+0000 7f10f0365700 1 -- 172.21.15.92:0/2288177199 >> 172.21.15.92:0/2288177199 conn(0x7f10e8100d80 msgr2=0x7f10e8190d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:06.049 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.640+0000 7f10f0365700 1 -- 172.21.15.92:0/2288177199 shutdown_connections 2023-10-16T13:05:06.049 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:05.640+0000 7f10f0365700 1 -- 172.21.15.92:0/2288177199 wait complete. 2023-10-16T13:05:06.049 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for the mgr to restart... 2023-10-16T13:05:06.049 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr epoch 5... 2023-10-16T13:05:06.284 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:06 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:06.202+0000 7f65df703200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T13:05:06.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:06 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2288177199' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-16T13:05:07.246 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:06 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:06.872+0000 7f65df703200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T13:05:07.247 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:06 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:06.953+0000 7f65df703200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T13:05:07.980 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:07 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:07.716+0000 7f65df703200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T13:05:07.980 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:07 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:07.806+0000 7f65df703200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T13:05:08.246 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:07 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:07.977+0000 7f65df703200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T13:05:08.626 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:08 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:08.254+0000 7f65df703200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T13:05:08.626 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:08 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:08.477+0000 7f65df703200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T13:05:08.886 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:08 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:08.623+0000 7f65df703200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T13:05:09.246 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:08 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:08.884+0000 7f65df703200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T13:05:09.902 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:09 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:09.576+0000 7f65df703200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T13:05:09.902 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:09 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:09.706+0000 7f65df703200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T13:05:10.229 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:09 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:09.899+0000 7f65df703200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T13:05:10.230 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:10 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:10.011+0000 7f65df703200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T13:05:10.496 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:10 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:10.226+0000 7f65df703200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T13:05:11.496 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:11 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:11.090+0000 7f65df703200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T13:05:11.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:11 smithi092 ceph-mon[99542]: Active manager daemon x restarted 2023-10-16T13:05:11.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:11 smithi092 ceph-mon[99542]: Activating manager daemon x 2023-10-16T13:05:11.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:11 smithi092 ceph-mon[99542]: osdmap e2: 0 total, 0 up, 0 in 2023-10-16T13:05:11.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:11 smithi092 ceph-mon[99542]: mgrmap e6: x(active, starting, since 0.0032196s) 2023-10-16T13:05:11.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:11 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-16T13:05:11.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:11 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-16T13:05:11.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:11 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-16T13:05:11.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:11 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-16T13:05:11.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:11 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-16T13:05:11.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:11 smithi092 ceph-mon[99542]: Manager daemon x is now available 2023-10-16T13:05:11.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:11 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' 2023-10-16T13:05:11.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:11 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' 2023-10-16T13:05:11.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:11 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:05:11.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:11 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:05:11.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:11 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:05:11.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:11 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-16T13:05:11.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:11 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-16T13:05:12.496 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2023-10-16T13:05:12.497 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-10-16T13:05:12.497 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-16T13:05:12.497 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2023-10-16T13:05:12.497 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.538+0000 7f8546174700 1 Processor -- start 2023-10-16T13:05:12.498 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.538+0000 7f8546174700 1 -- start start 2023-10-16T13:05:12.498 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.538+0000 7f8546174700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85401068c0 0x7f8540106ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:12.498 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.538+0000 7f8546174700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85401072b0 con 0x7f85401068c0 2023-10-16T13:05:12.498 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.538+0000 7f853f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85401068c0 0x7f8540106ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:12.498 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.538+0000 7f853f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85401068c0 0x7f8540106ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33954/0 (socket says 172.21.15.92:33954) 2023-10-16T13:05:12.499 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.538+0000 7f853f7fe700 1 -- 172.21.15.92:0/3602425035 learned_addr learned my addr 172.21.15.92:0/3602425035 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:12.499 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.539+0000 7f853f7fe700 1 -- 172.21.15.92:0/3602425035 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8540107ac0 con 0x7f85401068c0 2023-10-16T13:05:12.499 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.539+0000 7f853f7fe700 1 --2- 172.21.15.92:0/3602425035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85401068c0 0x7f8540106ce0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f85300098a0 tx=0x7f8530009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9161eac421728953 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:12.500 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.539+0000 7f853e7fc700 1 -- 172.21.15.92:0/3602425035 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8530004160 con 0x7f85401068c0 2023-10-16T13:05:12.500 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.539+0000 7f853e7fc700 1 -- 172.21.15.92:0/3602425035 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f85300042c0 con 0x7f85401068c0 2023-10-16T13:05:12.500 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.539+0000 7f853e7fc700 1 -- 172.21.15.92:0/3602425035 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8530011ac0 con 0x7f85401068c0 2023-10-16T13:05:12.500 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.540+0000 7f8546174700 1 -- 172.21.15.92:0/3602425035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85401068c0 msgr2=0x7f8540106ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:12.500 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.540+0000 7f8546174700 1 --2- 172.21.15.92:0/3602425035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85401068c0 0x7f8540106ce0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f85300098a0 tx=0x7f8530009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:12.501 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.540+0000 7f8546174700 1 -- 172.21.15.92:0/3602425035 shutdown_connections 2023-10-16T13:05:12.501 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.540+0000 7f8546174700 1 --2- 172.21.15.92:0/3602425035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85401068c0 0x7f8540106ce0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:12.501 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.540+0000 7f8546174700 1 -- 172.21.15.92:0/3602425035 >> 172.21.15.92:0/3602425035 conn(0x7f8540101e40 msgr2=0x7f85401042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:12.501 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.540+0000 7f8546174700 1 -- 172.21.15.92:0/3602425035 shutdown_connections 2023-10-16T13:05:12.501 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.540+0000 7f8546174700 1 -- 172.21.15.92:0/3602425035 wait complete. 2023-10-16T13:05:12.502 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.540+0000 7f8546174700 1 Processor -- start 2023-10-16T13:05:12.502 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.540+0000 7f8546174700 1 -- start start 2023-10-16T13:05:12.502 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.541+0000 7f8546174700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85401068c0 0x7f854019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:12.502 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.541+0000 7f8546174700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854019aad0 con 0x7f85401068c0 2023-10-16T13:05:12.502 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.541+0000 7f853f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85401068c0 0x7f854019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:12.503 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.541+0000 7f853f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85401068c0 0x7f854019a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33956/0 (socket says 172.21.15.92:33956) 2023-10-16T13:05:12.503 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.541+0000 7f853f7fe700 1 -- 172.21.15.92:0/498661951 learned_addr learned my addr 172.21.15.92:0/498661951 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:12.503 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.541+0000 7f853f7fe700 1 -- 172.21.15.92:0/498661951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8530009550 con 0x7f85401068c0 2023-10-16T13:05:12.503 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.541+0000 7f853f7fe700 1 --2- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85401068c0 0x7f854019a590 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8530000c00 tx=0x7f8530011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:12.503 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.541+0000 7f853cff9700 1 -- 172.21.15.92:0/498661951 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8530003aa0 con 0x7f85401068c0 2023-10-16T13:05:12.503 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.541+0000 7f853cff9700 1 -- 172.21.15.92:0/498661951 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f8530003c00 con 0x7f85401068c0 2023-10-16T13:05:12.504 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.541+0000 7f8546174700 1 -- 172.21.15.92:0/498661951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854019acd0 con 0x7f85401068c0 2023-10-16T13:05:12.504 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.541+0000 7f853cff9700 1 -- 172.21.15.92:0/498661951 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85300248a0 con 0x7f85401068c0 2023-10-16T13:05:12.504 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.541+0000 7f8546174700 1 -- 172.21.15.92:0/498661951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854019b170 con 0x7f85401068c0 2023-10-16T13:05:12.504 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.542+0000 7f853cff9700 1 -- 172.21.15.92:0/498661951 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f853002d3f0 con 0x7f85401068c0 2023-10-16T13:05:12.504 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.543+0000 7f853cff9700 1 --2- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f8528038870 0x7f852803ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:12.505 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.543+0000 7f853cff9700 1 -- 172.21.15.92:0/498661951 --> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f852803b440 con 0x7f8528038870 2023-10-16T13:05:12.505 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.543+0000 7f853cff9700 1 -- 172.21.15.92:0/498661951 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f853004c560 con 0x7f85401068c0 2023-10-16T13:05:12.505 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.543+0000 7f853effd700 1 -- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f8528038870 msgr2=0x7f852803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/184191966 2023-10-16T13:05:12.505 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.543+0000 7f853effd700 1 --2- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f8528038870 0x7f852803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T13:05:12.505 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.744+0000 7f853effd700 1 -- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f8528038870 msgr2=0x7f852803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/184191966 2023-10-16T13:05:12.505 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:06.744+0000 7f853effd700 1 --2- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f8528038870 0x7f852803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T13:05:12.506 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:07.145+0000 7f853effd700 1 -- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f8528038870 msgr2=0x7f852803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/184191966 2023-10-16T13:05:12.506 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:07.145+0000 7f853effd700 1 --2- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f8528038870 0x7f852803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T13:05:12.506 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:07.946+0000 7f853effd700 1 -- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f8528038870 msgr2=0x7f852803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/184191966 2023-10-16T13:05:12.506 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:07.946+0000 7f853effd700 1 --2- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f8528038870 0x7f852803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T13:05:12.506 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:09.547+0000 7f853effd700 1 -- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f8528038870 msgr2=0x7f852803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/184191966 2023-10-16T13:05:12.507 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:09.547+0000 7f853effd700 1 --2- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f8528038870 0x7f852803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-16T13:05:12.507 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:11.104+0000 7f853cff9700 1 -- 172.21.15.92:0/498661951 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mgrmap(e 6) v1 ==== 45346+0+0 (secure 0 0 0) 0x7f8530018c70 con 0x7f85401068c0 2023-10-16T13:05:12.507 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:11.105+0000 7f853cff9700 1 -- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f8528038870 msgr2=0x7f852803ad30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T13:05:12.507 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:11.105+0000 7f853cff9700 1 --2- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f8528038870 0x7f852803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:12.507 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.106+0000 7f853cff9700 1 -- 172.21.15.92:0/498661951 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 7) v1 ==== 45473+0+0 (secure 0 0 0) 0x7f853004df20 con 0x7f85401068c0 2023-10-16T13:05:12.508 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.106+0000 7f853cff9700 1 --2- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f852803bfd0 0x7f852803e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:12.508 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.106+0000 7f853cff9700 1 -- 172.21.15.92:0/498661951 --> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f852803b440 con 0x7f852803bfd0 2023-10-16T13:05:12.508 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.106+0000 7f853effd700 1 --2- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f852803bfd0 0x7f852803e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:12.508 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.107+0000 7f853effd700 1 --2- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f852803bfd0 0x7f852803e3c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8534003a10 tx=0x7f85340092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:12.508 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.107+0000 7f853cff9700 1 -- 172.21.15.92:0/498661951 <== mgr.14120 v2:172.21.15.92:6800/1487044137 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f852803b440 con 0x7f852803bfd0 2023-10-16T13:05:12.509 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.118+0000 7f8546174700 1 -- 172.21.15.92:0/498661951 --> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f854019b8d0 con 0x7f852803bfd0 2023-10-16T13:05:12.509 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.118+0000 7f853cff9700 1 -- 172.21.15.92:0/498661951 <== mgr.14120 v2:172.21.15.92:6800/1487044137 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f854019b8d0 con 0x7f852803bfd0 2023-10-16T13:05:12.509 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.118+0000 7f8546174700 1 -- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f852803bfd0 msgr2=0x7f852803e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:12.509 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.118+0000 7f8546174700 1 --2- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f852803bfd0 0x7f852803e3c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8534003a10 tx=0x7f85340092b0 comp rx=0 tx=0).stop 2023-10-16T13:05:12.509 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.118+0000 7f8546174700 1 -- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85401068c0 msgr2=0x7f854019a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:12.509 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.118+0000 7f8546174700 1 --2- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85401068c0 0x7f854019a590 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8530000c00 tx=0x7f8530011b40 comp rx=0 tx=0).stop 2023-10-16T13:05:12.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.119+0000 7f8546174700 1 -- 172.21.15.92:0/498661951 shutdown_connections 2023-10-16T13:05:12.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.119+0000 7f8546174700 1 --2- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f852803bfd0 0x7f852803e3c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:12.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.119+0000 7f8546174700 1 --2- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85401068c0 0x7f854019a590 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:12.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.119+0000 7f8546174700 1 --2- 172.21.15.92:0/498661951 >> [v2:172.21.15.92:6800/184191966,v1:172.21.15.92:6801/184191966] conn(0x7f8528038870 0x7f852803ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:12.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.119+0000 7f8546174700 1 -- 172.21.15.92:0/498661951 >> 172.21.15.92:0/498661951 conn(0x7f8540101e40 msgr2=0x7f8540102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:12.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.119+0000 7f8546174700 1 -- 172.21.15.92:0/498661951 shutdown_connections 2023-10-16T13:05:12.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.119+0000 7f8546174700 1 -- 172.21.15.92:0/498661951 wait complete. 2023-10-16T13:05:12.511 INFO:teuthology.orchestra.run.smithi092.stdout:mgr epoch 5 is available 2023-10-16T13:05:12.511 INFO:teuthology.orchestra.run.smithi092.stdout:Setting orchestrator backend to cephadm... 2023-10-16T13:05:12.511 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:12 smithi092 ceph-mon[99542]: Found migration_current of "None". Setting to last migration. 2023-10-16T13:05:12.512 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:12 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' 2023-10-16T13:05:12.512 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:12 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' 2023-10-16T13:05:12.512 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:12 smithi092 ceph-mon[99542]: mgrmap e7: x(active, since 1.00531s) 2023-10-16T13:05:13.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:13 smithi092 ceph-mon[99542]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-16T13:05:13.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:13 smithi092 ceph-mon[99542]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-16T13:05:13.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:13 smithi092 ceph-mon[99542]: [16/Oct/2023:13:05:12] ENGINE Bus STARTING 2023-10-16T13:05:13.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:13 smithi092 ceph-mon[99542]: [16/Oct/2023:13:05:12] ENGINE Serving on https://172.21.15.92:7150 2023-10-16T13:05:13.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:13 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:05:13.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:13 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' 2023-10-16T13:05:13.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.971+0000 7fc0d1a41700 1 Processor -- start 2023-10-16T13:05:13.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.971+0000 7fc0d1a41700 1 -- start start 2023-10-16T13:05:13.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.971+0000 7fc0d1a41700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0cc106db0 0x7fc0cc1071d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:13.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.971+0000 7fc0d1a41700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc1077a0 con 0x7fc0cc106db0 2023-10-16T13:05:13.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.971+0000 7fc0caffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0cc106db0 0x7fc0cc1071d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:13.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.971+0000 7fc0caffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0cc106db0 0x7fc0cc1071d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34008/0 (socket says 172.21.15.92:34008) 2023-10-16T13:05:13.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.971+0000 7fc0caffd700 1 -- 172.21.15.92:0/4012866184 learned_addr learned my addr 172.21.15.92:0/4012866184 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:13.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.972+0000 7fc0caffd700 1 -- 172.21.15.92:0/4012866184 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0cc1059c0 con 0x7fc0cc106db0 2023-10-16T13:05:13.742 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.972+0000 7fc0caffd700 1 --2- 172.21.15.92:0/4012866184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0cc106db0 0x7fc0cc1071d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0098a0 tx=0x7fc0bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c997541eb5d5c20 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:13.742 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.972+0000 7fc0c9ffb700 1 -- 172.21.15.92:0/4012866184 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0bc004160 con 0x7fc0cc106db0 2023-10-16T13:05:13.742 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.972+0000 7fc0c9ffb700 1 -- 172.21.15.92:0/4012866184 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fc0bc0042c0 con 0x7fc0cc106db0 2023-10-16T13:05:13.742 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.972+0000 7fc0c9ffb700 1 -- 172.21.15.92:0/4012866184 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0bc011ac0 con 0x7fc0cc106db0 2023-10-16T13:05:13.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.972+0000 7fc0d1a41700 1 -- 172.21.15.92:0/4012866184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0cc106db0 msgr2=0x7fc0cc1071d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:13.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.972+0000 7fc0d1a41700 1 --2- 172.21.15.92:0/4012866184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0cc106db0 0x7fc0cc1071d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0098a0 tx=0x7fc0bc009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:13.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.972+0000 7fc0d1a41700 1 -- 172.21.15.92:0/4012866184 shutdown_connections 2023-10-16T13:05:13.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.972+0000 7fc0d1a41700 1 --2- 172.21.15.92:0/4012866184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0cc106db0 0x7fc0cc1071d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:13.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.972+0000 7fc0d1a41700 1 -- 172.21.15.92:0/4012866184 >> 172.21.15.92:0/4012866184 conn(0x7fc0cc1004f0 msgr2=0x7fc0cc102930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:13.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.972+0000 7fc0d1a41700 1 -- 172.21.15.92:0/4012866184 shutdown_connections 2023-10-16T13:05:13.744 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.973+0000 7fc0d1a41700 1 -- 172.21.15.92:0/4012866184 wait complete. 2023-10-16T13:05:13.744 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.973+0000 7fc0d1a41700 1 Processor -- start 2023-10-16T13:05:13.744 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.973+0000 7fc0d1a41700 1 -- start start 2023-10-16T13:05:13.744 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.973+0000 7fc0d1a41700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0cc106db0 0x7fc0cc190a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:13.744 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.973+0000 7fc0d1a41700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc190f60 con 0x7fc0cc106db0 2023-10-16T13:05:13.745 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.973+0000 7fc0caffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0cc106db0 0x7fc0cc190a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:13.745 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.973+0000 7fc0caffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0cc106db0 0x7fc0cc190a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34010/0 (socket says 172.21.15.92:34010) 2023-10-16T13:05:13.745 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.974+0000 7fc0caffd700 1 -- 172.21.15.92:0/3382748343 learned_addr learned my addr 172.21.15.92:0/3382748343 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:13.745 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.974+0000 7fc0caffd700 1 -- 172.21.15.92:0/3382748343 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0bc009550 con 0x7fc0cc106db0 2023-10-16T13:05:13.745 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.974+0000 7fc0caffd700 1 --2- 172.21.15.92:0/3382748343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0cc106db0 0x7fc0cc190a20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc003f70 tx=0x7fc0bc011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:13.746 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.974+0000 7fc0d0a3f700 1 -- 172.21.15.92:0/3382748343 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0bc003b20 con 0x7fc0cc106db0 2023-10-16T13:05:13.746 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.974+0000 7fc0d0a3f700 1 -- 172.21.15.92:0/3382748343 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fc0bc003c80 con 0x7fc0cc106db0 2023-10-16T13:05:13.746 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.974+0000 7fc0d1a41700 1 -- 172.21.15.92:0/3382748343 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0cc18f070 con 0x7fc0cc106db0 2023-10-16T13:05:13.746 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.974+0000 7fc0d0a3f700 1 -- 172.21.15.92:0/3382748343 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0bc024860 con 0x7fc0cc106db0 2023-10-16T13:05:13.746 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.974+0000 7fc0d1a41700 1 -- 172.21.15.92:0/3382748343 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0cc18f510 con 0x7fc0cc106db0 2023-10-16T13:05:13.747 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.975+0000 7fc0d0a3f700 1 -- 172.21.15.92:0/3382748343 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 7) v1 ==== 45473+0+0 (secure 0 0 0) 0x7fc0bc02d3f0 con 0x7fc0cc106db0 2023-10-16T13:05:13.747 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.975+0000 7fc0d1a41700 1 -- 172.21.15.92:0/3382748343 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0cc109c00 con 0x7fc0cc106db0 2023-10-16T13:05:13.747 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.975+0000 7fc0d0a3f700 1 --2- 172.21.15.92:0/3382748343 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7fc0b4038740 0x7fc0b403ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:13.747 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.975+0000 7fc0d0a3f700 1 -- 172.21.15.92:0/3382748343 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc0bc04c910 con 0x7fc0cc106db0 2023-10-16T13:05:13.747 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.975+0000 7fc0ca7fc700 1 --2- 172.21.15.92:0/3382748343 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7fc0b4038740 0x7fc0b403ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:13.748 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.975+0000 7fc0ca7fc700 1 --2- 172.21.15.92:0/3382748343 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7fc0b4038740 0x7fc0b403ac00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0006fd0 tx=0x7fc0c0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:13.748 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:12.980+0000 7fc0d0a3f700 1 -- 172.21.15.92:0/3382748343 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc0bc010970 con 0x7fc0cc106db0 2023-10-16T13:05:13.748 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:13.183+0000 7fc0d1a41700 1 -- 172.21.15.92:0/3382748343 --> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0cc18fc80 con 0x7fc0b4038740 2023-10-16T13:05:13.748 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:13.189+0000 7fc0d0a3f700 1 -- 172.21.15.92:0/3382748343 <== mgr.14120 v2:172.21.15.92:6800/1487044137 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc0cc18fc80 con 0x7fc0b4038740 2023-10-16T13:05:13.748 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:13.191+0000 7fc0d1a41700 1 -- 172.21.15.92:0/3382748343 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7fc0b4038740 msgr2=0x7fc0b403ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:13.749 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:13.191+0000 7fc0d1a41700 1 --2- 172.21.15.92:0/3382748343 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7fc0b4038740 0x7fc0b403ac00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0006fd0 tx=0x7fc0c0006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:13.749 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:13.191+0000 7fc0d1a41700 1 -- 172.21.15.92:0/3382748343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0cc106db0 msgr2=0x7fc0cc190a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:13.749 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:13.191+0000 7fc0d1a41700 1 --2- 172.21.15.92:0/3382748343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0cc106db0 0x7fc0cc190a20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc003f70 tx=0x7fc0bc011b40 comp rx=0 tx=0).stop 2023-10-16T13:05:13.749 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:13.191+0000 7fc0d1a41700 1 -- 172.21.15.92:0/3382748343 shutdown_connections 2023-10-16T13:05:13.749 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:13.191+0000 7fc0d1a41700 1 --2- 172.21.15.92:0/3382748343 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7fc0b4038740 0x7fc0b403ac00 secure :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0006fd0 tx=0x7fc0c0006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:13.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:13.191+0000 7fc0d1a41700 1 --2- 172.21.15.92:0/3382748343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0cc106db0 0x7fc0cc190a20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:13.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:13.191+0000 7fc0d1a41700 1 -- 172.21.15.92:0/3382748343 >> 172.21.15.92:0/3382748343 conn(0x7fc0cc1004f0 msgr2=0x7fc0cc105180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:13.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:13.191+0000 7fc0d1a41700 1 -- 172.21.15.92:0/3382748343 shutdown_connections 2023-10-16T13:05:13.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:13.191+0000 7fc0d1a41700 1 -- 172.21.15.92:0/3382748343 wait complete. 2023-10-16T13:05:14.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:14 smithi092 ceph-mon[99542]: [16/Oct/2023:13:05:12] ENGINE Serving on http://172.21.15.92:8765 2023-10-16T13:05:14.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:14 smithi092 ceph-mon[99542]: [16/Oct/2023:13:05:12] ENGINE Bus STARTED 2023-10-16T13:05:14.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:14 smithi092 ceph-mon[99542]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:05:14.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:14 smithi092 ceph-mon[99542]: mgrmap e8: x(active, since 2s) 2023-10-16T13:05:14.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:14 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:05:14.885 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout value unchanged 2023-10-16T13:05:14.885 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.245+0000 7f25964af700 1 Processor -- start 2023-10-16T13:05:14.885 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.245+0000 7f25964af700 1 -- start start 2023-10-16T13:05:14.886 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.245+0000 7f25964af700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2590104f00 0x7f2590105340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:14.886 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.245+0000 7f25964af700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2590105880 con 0x7f2590104f00 2023-10-16T13:05:14.886 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.245+0000 7f258ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2590104f00 0x7f2590105340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:14.886 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.245+0000 7f258ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2590104f00 0x7f2590105340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34014/0 (socket says 172.21.15.92:34014) 2023-10-16T13:05:14.887 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.245+0000 7f258ffff700 1 -- 172.21.15.92:0/450216757 learned_addr learned my addr 172.21.15.92:0/450216757 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:14.887 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.245+0000 7f258ffff700 1 -- 172.21.15.92:0/450216757 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25901059c0 con 0x7f2590104f00 2023-10-16T13:05:14.887 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.245+0000 7f258ffff700 1 --2- 172.21.15.92:0/450216757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2590104f00 0x7f2590105340 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f25800098a0 tx=0x7f2580009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68df317f06d9ff87 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:14.887 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.246+0000 7f258effd700 1 -- 172.21.15.92:0/450216757 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2580004160 con 0x7f2590104f00 2023-10-16T13:05:14.887 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.246+0000 7f258effd700 1 -- 172.21.15.92:0/450216757 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f25800042c0 con 0x7f2590104f00 2023-10-16T13:05:14.888 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.246+0000 7f258effd700 1 -- 172.21.15.92:0/450216757 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2580011ac0 con 0x7f2590104f00 2023-10-16T13:05:14.888 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.246+0000 7f25964af700 1 -- 172.21.15.92:0/450216757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2590104f00 msgr2=0x7f2590105340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:14.888 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.246+0000 7f25964af700 1 --2- 172.21.15.92:0/450216757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2590104f00 0x7f2590105340 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f25800098a0 tx=0x7f2580009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:14.888 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.246+0000 7f25964af700 1 -- 172.21.15.92:0/450216757 shutdown_connections 2023-10-16T13:05:14.888 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.246+0000 7f25964af700 1 --2- 172.21.15.92:0/450216757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2590104f00 0x7f2590105340 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:14.889 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.246+0000 7f25964af700 1 -- 172.21.15.92:0/450216757 >> 172.21.15.92:0/450216757 conn(0x7f25901004f0 msgr2=0x7f2590102930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:14.889 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.246+0000 7f25964af700 1 -- 172.21.15.92:0/450216757 shutdown_connections 2023-10-16T13:05:14.889 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.246+0000 7f25964af700 1 -- 172.21.15.92:0/450216757 wait complete. 2023-10-16T13:05:14.889 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.247+0000 7f25964af700 1 Processor -- start 2023-10-16T13:05:14.889 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.247+0000 7f25964af700 1 -- start start 2023-10-16T13:05:14.890 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.247+0000 7f25964af700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2590104f00 0x7f2590101c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:14.890 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.247+0000 7f25964af700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259019b040 con 0x7f2590104f00 2023-10-16T13:05:14.890 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.247+0000 7f258ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2590104f00 0x7f2590101c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:14.890 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.247+0000 7f258ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2590104f00 0x7f2590101c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34016/0 (socket says 172.21.15.92:34016) 2023-10-16T13:05:14.890 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.247+0000 7f258ffff700 1 -- 172.21.15.92:0/2998978426 learned_addr learned my addr 172.21.15.92:0/2998978426 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:14.891 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.247+0000 7f258ffff700 1 -- 172.21.15.92:0/2998978426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2580009550 con 0x7f2590104f00 2023-10-16T13:05:14.891 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.248+0000 7f258ffff700 1 --2- 172.21.15.92:0/2998978426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2590104f00 0x7f2590101c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2580003f70 tx=0x7f2580011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:14.891 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.248+0000 7f258d7fa700 1 -- 172.21.15.92:0/2998978426 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2580003b20 con 0x7f2590104f00 2023-10-16T13:05:14.891 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.248+0000 7f258d7fa700 1 -- 172.21.15.92:0/2998978426 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f2580003c80 con 0x7f2590104f00 2023-10-16T13:05:14.891 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.248+0000 7f25964af700 1 -- 172.21.15.92:0/2998978426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259019f650 con 0x7f2590104f00 2023-10-16T13:05:14.892 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.248+0000 7f258d7fa700 1 -- 172.21.15.92:0/2998978426 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25800247a0 con 0x7f2590104f00 2023-10-16T13:05:14.892 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.248+0000 7f25964af700 1 -- 172.21.15.92:0/2998978426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259019fa90 con 0x7f2590104f00 2023-10-16T13:05:14.892 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.248+0000 7f258d7fa700 1 -- 172.21.15.92:0/2998978426 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f258002d3f0 con 0x7f2590104f00 2023-10-16T13:05:14.892 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.249+0000 7f258d7fa700 1 --2- 172.21.15.92:0/2998978426 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f2578038870 0x7f257803ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:14.892 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.249+0000 7f258d7fa700 1 -- 172.21.15.92:0/2998978426 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f258004c900 con 0x7f2590104f00 2023-10-16T13:05:14.893 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.249+0000 7f258f7fe700 1 --2- 172.21.15.92:0/2998978426 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f2578038870 0x7f257803ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:14.893 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.249+0000 7f25964af700 1 -- 172.21.15.92:0/2998978426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25901933d0 con 0x7f2590104f00 2023-10-16T13:05:14.893 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.249+0000 7f258f7fe700 1 --2- 172.21.15.92:0/2998978426 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f2578038870 0x7f257803ad30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2584006fd0 tx=0x7f2584006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:14.893 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.254+0000 7f258d7fa700 1 -- 172.21.15.92:0/2998978426 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2580010970 con 0x7f2590104f00 2023-10-16T13:05:14.893 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.442+0000 7f25964af700 1 -- 172.21.15.92:0/2998978426 --> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f259002d080 con 0x7f2578038870 2023-10-16T13:05:14.894 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.443+0000 7f258d7fa700 1 -- 172.21.15.92:0/2998978426 <== mgr.14120 v2:172.21.15.92:6800/1487044137 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f259002d080 con 0x7f2578038870 2023-10-16T13:05:14.894 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.445+0000 7f25964af700 1 -- 172.21.15.92:0/2998978426 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f2578038870 msgr2=0x7f257803ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:14.894 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.445+0000 7f25964af700 1 --2- 172.21.15.92:0/2998978426 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f2578038870 0x7f257803ad30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2584006fd0 tx=0x7f2584006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:14.894 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.445+0000 7f25964af700 1 -- 172.21.15.92:0/2998978426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2590104f00 msgr2=0x7f2590101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:14.895 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.445+0000 7f25964af700 1 --2- 172.21.15.92:0/2998978426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2590104f00 0x7f2590101c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2580003f70 tx=0x7f2580011b40 comp rx=0 tx=0).stop 2023-10-16T13:05:14.895 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.445+0000 7f25964af700 1 -- 172.21.15.92:0/2998978426 shutdown_connections 2023-10-16T13:05:14.895 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.445+0000 7f25964af700 1 --2- 172.21.15.92:0/2998978426 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f2578038870 0x7f257803ad30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:14.895 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.445+0000 7f25964af700 1 --2- 172.21.15.92:0/2998978426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2590104f00 0x7f2590101c60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:14.895 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.445+0000 7f25964af700 1 -- 172.21.15.92:0/2998978426 >> 172.21.15.92:0/2998978426 conn(0x7f25901004f0 msgr2=0x7f2590190510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:14.895 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.445+0000 7f25964af700 1 -- 172.21.15.92:0/2998978426 shutdown_connections 2023-10-16T13:05:14.896 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:14.445+0000 7f25964af700 1 -- 172.21.15.92:0/2998978426 wait complete. 2023-10-16T13:05:14.896 INFO:teuthology.orchestra.run.smithi092.stdout:Generating ssh key... 2023-10-16T13:05:15.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:15 smithi092 ceph-mon[99542]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:05:16.247 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:15 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: Generating public/private rsa key pair. 2023-10-16T13:05:16.247 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:15 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: Your identification has been saved in /tmp/tmpi8h0grv8/key. 2023-10-16T13:05:16.247 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:15 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: Your public key has been saved in /tmp/tmpi8h0grv8/key.pub. 2023-10-16T13:05:16.248 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:15 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: The key fingerprint is: 2023-10-16T13:05:16.248 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:15 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: SHA256:O0u6vQS0tZhFNy7ztm+qw329idtuP+fq9raYmYKE/CY ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:05:16.248 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:15 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: The key's randomart image is: 2023-10-16T13:05:16.248 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:15 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: +---[RSA 3072]----+ 2023-10-16T13:05:16.248 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:15 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: | . o | 2023-10-16T13:05:16.249 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:15 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: | . o . | 2023-10-16T13:05:16.249 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:15 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: | . = . | 2023-10-16T13:05:16.249 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:15 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: | . * = | 2023-10-16T13:05:16.249 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:15 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: | * S o | 2023-10-16T13:05:16.249 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:15 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: | + + . | 2023-10-16T13:05:16.250 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:15 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: | .B.o . | 2023-10-16T13:05:16.250 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:15 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: | Eo*.oooOoo| 2023-10-16T13:05:16.250 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:15 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: | o.B+.+=@BOB| 2023-10-16T13:05:16.250 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:15 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: +----[SHA256]-----+ 2023-10-16T13:05:16.332 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.338+0000 7f524ee3c700 1 Processor -- start 2023-10-16T13:05:16.332 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.338+0000 7f524ee3c700 1 -- start start 2023-10-16T13:05:16.332 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.338+0000 7f524ee3c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5248104b70 0x7f5248104f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:16.333 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.338+0000 7f524ee3c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5248105560 con 0x7f5248104b70 2023-10-16T13:05:16.333 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.338+0000 7f524cbd8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5248104b70 0x7f5248104f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:16.333 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.338+0000 7f524cbd8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5248104b70 0x7f5248104f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34020/0 (socket says 172.21.15.92:34020) 2023-10-16T13:05:16.333 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.338+0000 7f524cbd8700 1 -- 172.21.15.92:0/1062546772 learned_addr learned my addr 172.21.15.92:0/1062546772 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:16.334 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.339+0000 7f524cbd8700 1 -- 172.21.15.92:0/1062546772 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5248107b00 con 0x7f5248104b70 2023-10-16T13:05:16.334 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.339+0000 7f524cbd8700 1 --2- 172.21.15.92:0/1062546772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5248104b70 0x7f5248104f90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f523c0098a0 tx=0x7f523c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c916cb40cb0c32 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:16.334 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.339+0000 7f52477fe700 1 -- 172.21.15.92:0/1062546772 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f523c004160 con 0x7f5248104b70 2023-10-16T13:05:16.334 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.339+0000 7f52477fe700 1 -- 172.21.15.92:0/1062546772 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f523c0042c0 con 0x7f5248104b70 2023-10-16T13:05:16.334 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.339+0000 7f52477fe700 1 -- 172.21.15.92:0/1062546772 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f523c011ac0 con 0x7f5248104b70 2023-10-16T13:05:16.335 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.339+0000 7f524ee3c700 1 -- 172.21.15.92:0/1062546772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5248104b70 msgr2=0x7f5248104f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:16.335 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.339+0000 7f524ee3c700 1 --2- 172.21.15.92:0/1062546772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5248104b70 0x7f5248104f90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f523c0098a0 tx=0x7f523c009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:16.335 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.340+0000 7f524ee3c700 1 -- 172.21.15.92:0/1062546772 shutdown_connections 2023-10-16T13:05:16.335 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.340+0000 7f524ee3c700 1 --2- 172.21.15.92:0/1062546772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5248104b70 0x7f5248104f90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:16.335 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.340+0000 7f524ee3c700 1 -- 172.21.15.92:0/1062546772 >> 172.21.15.92:0/1062546772 conn(0x7f52481004c0 msgr2=0x7f52481028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:16.336 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.340+0000 7f524ee3c700 1 -- 172.21.15.92:0/1062546772 shutdown_connections 2023-10-16T13:05:16.336 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.340+0000 7f524ee3c700 1 -- 172.21.15.92:0/1062546772 wait complete. 2023-10-16T13:05:16.336 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.340+0000 7f524ee3c700 1 Processor -- start 2023-10-16T13:05:16.336 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.340+0000 7f524ee3c700 1 -- start start 2023-10-16T13:05:16.336 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.340+0000 7f524ee3c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5248104b70 0x7f524819c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:16.337 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.340+0000 7f524ee3c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524819cc70 con 0x7f5248104b70 2023-10-16T13:05:16.337 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.340+0000 7f524cbd8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5248104b70 0x7f524819c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:16.337 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.340+0000 7f524cbd8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5248104b70 0x7f524819c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34022/0 (socket says 172.21.15.92:34022) 2023-10-16T13:05:16.337 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.340+0000 7f524cbd8700 1 -- 172.21.15.92:0/3635032626 learned_addr learned my addr 172.21.15.92:0/3635032626 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:16.337 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.341+0000 7f524cbd8700 1 -- 172.21.15.92:0/3635032626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c009550 con 0x7f5248104b70 2023-10-16T13:05:16.338 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.341+0000 7f524cbd8700 1 --2- 172.21.15.92:0/3635032626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5248104b70 0x7f524819c730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f523c003f70 tx=0x7f523c011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:16.338 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.341+0000 7f5245ffb700 1 -- 172.21.15.92:0/3635032626 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f523c003b20 con 0x7f5248104b70 2023-10-16T13:05:16.338 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.341+0000 7f524ee3c700 1 -- 172.21.15.92:0/3635032626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524819ce70 con 0x7f5248104b70 2023-10-16T13:05:16.338 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.341+0000 7f5245ffb700 1 -- 172.21.15.92:0/3635032626 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f523c003c80 con 0x7f5248104b70 2023-10-16T13:05:16.338 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.341+0000 7f5245ffb700 1 -- 172.21.15.92:0/3635032626 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f523c024860 con 0x7f5248104b70 2023-10-16T13:05:16.339 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.341+0000 7f524ee3c700 1 -- 172.21.15.92:0/3635032626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524819d310 con 0x7f5248104b70 2023-10-16T13:05:16.339 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.342+0000 7f5245ffb700 1 -- 172.21.15.92:0/3635032626 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f523c02d3f0 con 0x7f5248104b70 2023-10-16T13:05:16.339 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.342+0000 7f524ee3c700 1 -- 172.21.15.92:0/3635032626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524810ad30 con 0x7f5248104b70 2023-10-16T13:05:16.339 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.342+0000 7f5245ffb700 1 --2- 172.21.15.92:0/3635032626 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f5238038820 0x7f523803ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:16.339 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.342+0000 7f5245ffb700 1 -- 172.21.15.92:0/3635032626 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f523c04caf0 con 0x7f5248104b70 2023-10-16T13:05:16.340 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.342+0000 7f5247fff700 1 --2- 172.21.15.92:0/3635032626 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f5238038820 0x7f523803ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:16.340 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.343+0000 7f5247fff700 1 --2- 172.21.15.92:0/3635032626 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f5238038820 0x7f523803ace0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5234006fd0 tx=0x7f5234006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:16.340 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.347+0000 7f5245ffb700 1 -- 172.21.15.92:0/3635032626 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f523c010970 con 0x7f5248104b70 2023-10-16T13:05:16.340 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.540+0000 7f524ee3c700 1 -- 172.21.15.92:0/3635032626 --> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f5248101930 con 0x7f5238038820 2023-10-16T13:05:16.340 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.858+0000 7f5245ffb700 1 -- 172.21.15.92:0/3635032626 <== mgr.14120 v2:172.21.15.92:6800/1487044137 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5248101930 con 0x7f5238038820 2023-10-16T13:05:16.340 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.861+0000 7f524ee3c700 1 -- 172.21.15.92:0/3635032626 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f5238038820 msgr2=0x7f523803ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:16.341 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.861+0000 7f524ee3c700 1 --2- 172.21.15.92:0/3635032626 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f5238038820 0x7f523803ace0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5234006fd0 tx=0x7f5234006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:16.341 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.861+0000 7f524ee3c700 1 -- 172.21.15.92:0/3635032626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5248104b70 msgr2=0x7f524819c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:16.341 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.861+0000 7f524ee3c700 1 --2- 172.21.15.92:0/3635032626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5248104b70 0x7f524819c730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f523c003f70 tx=0x7f523c011b40 comp rx=0 tx=0).stop 2023-10-16T13:05:16.341 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.861+0000 7f524ee3c700 1 -- 172.21.15.92:0/3635032626 shutdown_connections 2023-10-16T13:05:16.341 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.861+0000 7f524ee3c700 1 --2- 172.21.15.92:0/3635032626 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f5238038820 0x7f523803ace0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:16.342 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.861+0000 7f524ee3c700 1 --2- 172.21.15.92:0/3635032626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5248104b70 0x7f524819c730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:16.342 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.861+0000 7f524ee3c700 1 -- 172.21.15.92:0/3635032626 >> 172.21.15.92:0/3635032626 conn(0x7f52481004c0 msgr2=0x7f5248101220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:16.342 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.861+0000 7f524ee3c700 1 -- 172.21.15.92:0/3635032626 shutdown_connections 2023-10-16T13:05:16.342 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:15.861+0000 7f524ee3c700 1 -- 172.21.15.92:0/3635032626 wait complete. 2023-10-16T13:05:17.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:16 smithi092 ceph-mon[99542]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:05:17.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:16 smithi092 ceph-mon[99542]: Generating ssh key... 2023-10-16T13:05:17.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:16 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' 2023-10-16T13:05:17.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:16 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' 2023-10-16T13:05:17.469 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJFlwkzIEqJ+q0dYk9AgUghryKolBLLzd5xSHUX1X6pMkBgTz+HFCdIkyemtwVl3pR76l0G/4/gjByqROPDKLCkBcHGoeerQ9PKD4dzeR5dJP1dWM/65gZMxo/C8zRmARt0iuOomg0FWRQuVJlBFe919eH3CkiizvV2pJLV4HuRtJXFiSjCW7/69LA5yDN5TscVnZHlnfR2kmEwm9QQy8S5wkVk/Rdyxei7fQIULotDKLauxKOyVCsn9XNeprwfNuv48BqsOcAD6ZFyL5N713chDhPWZpl6+KUQ1y2rByHgzJSyfb4xrOsYGPJVUEe7TeMwZJF7vAFaKQM+c+wFoBpJ7Jga9tDPtMox54lW6X/zlq3HiXPhzm7ynWC44RhBp3ideAugIZKyp74AGYp9C6oxfLrUX6GC9NwEtwy1z0OCkL6F0765KYjHWpEu4ZheBDnKv6HXHXc/kJq3VQ0JGSf7zfNmZkEqBHSyGBCKPALsWc7S/C5xlnRZc5/f/nnB/c= ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:05:17.475 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.843+0000 7f7120974700 1 Processor -- start 2023-10-16T13:05:17.475 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.843+0000 7f7120974700 1 -- start start 2023-10-16T13:05:17.475 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.843+0000 7f7120974700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c107380 0x7f711c109770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:17.475 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.843+0000 7f7120974700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c079e70 con 0x7f711c107380 2023-10-16T13:05:17.476 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.843+0000 7f711a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c107380 0x7f711c109770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:17.476 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.843+0000 7f711a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c107380 0x7f711c109770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34026/0 (socket says 172.21.15.92:34026) 2023-10-16T13:05:17.476 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.843+0000 7f711a59c700 1 -- 172.21.15.92:0/3216938002 learned_addr learned my addr 172.21.15.92:0/3216938002 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:17.476 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.843+0000 7f711a59c700 1 -- 172.21.15.92:0/3216938002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c109cb0 con 0x7f711c107380 2023-10-16T13:05:17.476 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.843+0000 7f711a59c700 1 --2- 172.21.15.92:0/3216938002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c107380 0x7f711c109770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f710c0098a0 tx=0x7f710c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc3023cf8864c0d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:17.477 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.843+0000 7f711959a700 1 -- 172.21.15.92:0/3216938002 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f710c004160 con 0x7f711c107380 2023-10-16T13:05:17.477 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.843+0000 7f711959a700 1 -- 172.21.15.92:0/3216938002 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f710c0042c0 con 0x7f711c107380 2023-10-16T13:05:17.477 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.843+0000 7f711959a700 1 -- 172.21.15.92:0/3216938002 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f710c011ac0 con 0x7f711c107380 2023-10-16T13:05:17.477 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.843+0000 7f7120974700 1 -- 172.21.15.92:0/3216938002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c107380 msgr2=0x7f711c109770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:17.477 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.843+0000 7f7120974700 1 --2- 172.21.15.92:0/3216938002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c107380 0x7f711c109770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f710c0098a0 tx=0x7f710c009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:17.478 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.843+0000 7f7120974700 1 -- 172.21.15.92:0/3216938002 shutdown_connections 2023-10-16T13:05:17.478 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.843+0000 7f7120974700 1 --2- 172.21.15.92:0/3216938002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c107380 0x7f711c109770 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:17.478 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.843+0000 7f7120974700 1 -- 172.21.15.92:0/3216938002 >> 172.21.15.92:0/3216938002 conn(0x7f711c100d70 msgr2=0x7f711c1031b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:17.478 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.844+0000 7f7120974700 1 -- 172.21.15.92:0/3216938002 shutdown_connections 2023-10-16T13:05:17.478 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.844+0000 7f7120974700 1 -- 172.21.15.92:0/3216938002 wait complete. 2023-10-16T13:05:17.479 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.844+0000 7f7120974700 1 Processor -- start 2023-10-16T13:05:17.479 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.844+0000 7f7120974700 1 -- start start 2023-10-16T13:05:17.479 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.844+0000 7f7120974700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c107380 0x7f711c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:17.479 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.844+0000 7f7120974700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c19aa30 con 0x7f711c107380 2023-10-16T13:05:17.479 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.845+0000 7f711a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c107380 0x7f711c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:17.480 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.845+0000 7f711a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c107380 0x7f711c19a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34028/0 (socket says 172.21.15.92:34028) 2023-10-16T13:05:17.480 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.845+0000 7f711a59c700 1 -- 172.21.15.92:0/3039532417 learned_addr learned my addr 172.21.15.92:0/3039532417 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:17.480 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.845+0000 7f711a59c700 1 -- 172.21.15.92:0/3039532417 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c009550 con 0x7f711c107380 2023-10-16T13:05:17.480 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.845+0000 7f711a59c700 1 --2- 172.21.15.92:0/3039532417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c107380 0x7f711c19a4f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f710c003f70 tx=0x7f710c011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:17.480 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.845+0000 7f710b7fe700 1 -- 172.21.15.92:0/3039532417 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f710c003b20 con 0x7f711c107380 2023-10-16T13:05:17.481 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.845+0000 7f710b7fe700 1 -- 172.21.15.92:0/3039532417 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f710c003c80 con 0x7f711c107380 2023-10-16T13:05:17.481 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.845+0000 7f710b7fe700 1 -- 172.21.15.92:0/3039532417 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f710c0248c0 con 0x7f711c107380 2023-10-16T13:05:17.481 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.845+0000 7f7120974700 1 -- 172.21.15.92:0/3039532417 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c19ac30 con 0x7f711c107380 2023-10-16T13:05:17.481 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.845+0000 7f7120974700 1 -- 172.21.15.92:0/3039532417 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711c19b0d0 con 0x7f711c107380 2023-10-16T13:05:17.481 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.846+0000 7f710b7fe700 1 -- 172.21.15.92:0/3039532417 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f710c024b30 con 0x7f711c107380 2023-10-16T13:05:17.482 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.846+0000 7f710b7fe700 1 --2- 172.21.15.92:0/3039532417 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f7104038820 0x7f710403ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:17.482 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.846+0000 7f710b7fe700 1 -- 172.21.15.92:0/3039532417 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f710c04c9d0 con 0x7f711c107380 2023-10-16T13:05:17.482 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.846+0000 7f7120974700 1 -- 172.21.15.92:0/3039532417 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711c10aab0 con 0x7f711c107380 2023-10-16T13:05:17.482 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.846+0000 7f7119d9b700 1 --2- 172.21.15.92:0/3039532417 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f7104038820 0x7f710403ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:17.482 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.847+0000 7f7119d9b700 1 --2- 172.21.15.92:0/3039532417 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f7104038820 0x7f710403ace0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7110006fd0 tx=0x7f7110006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:17.483 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:16.852+0000 7f710b7fe700 1 -- 172.21.15.92:0/3039532417 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f710c024de0 con 0x7f711c107380 2023-10-16T13:05:17.483 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:17.042+0000 7f7120974700 1 -- 172.21.15.92:0/3039532417 --> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f711c102180 con 0x7f7104038820 2023-10-16T13:05:17.483 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:17.043+0000 7f710b7fe700 1 -- 172.21.15.92:0/3039532417 <== mgr.14120 v2:172.21.15.92:6800/1487044137 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f711c102180 con 0x7f7104038820 2023-10-16T13:05:17.483 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:17.045+0000 7f7120974700 1 -- 172.21.15.92:0/3039532417 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f7104038820 msgr2=0x7f710403ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:17.483 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:17.045+0000 7f7120974700 1 --2- 172.21.15.92:0/3039532417 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f7104038820 0x7f710403ace0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7110006fd0 tx=0x7f7110006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:17.484 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:17.045+0000 7f7120974700 1 -- 172.21.15.92:0/3039532417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c107380 msgr2=0x7f711c19a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:17.484 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:17.045+0000 7f7120974700 1 --2- 172.21.15.92:0/3039532417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c107380 0x7f711c19a4f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f710c003f70 tx=0x7f710c011a90 comp rx=0 tx=0).stop 2023-10-16T13:05:17.484 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:17.045+0000 7f7120974700 1 -- 172.21.15.92:0/3039532417 shutdown_connections 2023-10-16T13:05:17.484 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:17.045+0000 7f7120974700 1 --2- 172.21.15.92:0/3039532417 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f7104038820 0x7f710403ace0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:17.484 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:17.045+0000 7f7120974700 1 --2- 172.21.15.92:0/3039532417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c107380 0x7f711c19a4f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:17.485 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:17.045+0000 7f7120974700 1 -- 172.21.15.92:0/3039532417 >> 172.21.15.92:0/3039532417 conn(0x7f711c100d70 msgr2=0x7f711c101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:17.485 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:17.045+0000 7f7120974700 1 -- 172.21.15.92:0/3039532417 shutdown_connections 2023-10-16T13:05:17.485 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:17.045+0000 7f7120974700 1 -- 172.21.15.92:0/3039532417 wait complete. 2023-10-16T13:05:17.485 INFO:teuthology.orchestra.run.smithi092.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-10-16T13:05:17.485 INFO:teuthology.orchestra.run.smithi092.stdout:Adding key to root@localhost authorized_keys... 2023-10-16T13:05:17.486 INFO:teuthology.orchestra.run.smithi092.stdout:Adding host smithi092... 2023-10-16T13:05:17.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:17 smithi092 ceph-mon[99542]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:05:19.090 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:18 smithi092 ceph-mon[99542]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi092", "addr": "172.21.15.92", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:05:20.162 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:19 smithi092 ceph-mon[99542]: Deploying cephadm binary to smithi092 2023-10-16T13:05:21.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:21 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' 2023-10-16T13:05:21.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:21 smithi092 ceph-mon[99542]: Added host smithi092 2023-10-16T13:05:21.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:21 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:05:21.928 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout Added host 'smithi092' with addr '172.21.15.92' 2023-10-16T13:05:21.928 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.009+0000 7fbc9c453700 1 Processor -- start 2023-10-16T13:05:21.928 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.009+0000 7fbc9c453700 1 -- start start 2023-10-16T13:05:21.929 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.009+0000 7fbc9c453700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc94105160 0x7fbc94105580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:21.929 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.009+0000 7fbc9c453700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc940747b0 con 0x7fbc94105160 2023-10-16T13:05:21.929 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.009+0000 7fbc9a1ef700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc94105160 0x7fbc94105580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:21.929 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.009+0000 7fbc9a1ef700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc94105160 0x7fbc94105580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34032/0 (socket says 172.21.15.92:34032) 2023-10-16T13:05:21.929 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.009+0000 7fbc9a1ef700 1 -- 172.21.15.92:0/1193240268 learned_addr learned my addr 172.21.15.92:0/1193240268 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:21.930 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.009+0000 7fbc9a1ef700 1 -- 172.21.15.92:0/1193240268 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc94105ac0 con 0x7fbc94105160 2023-10-16T13:05:21.930 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.010+0000 7fbc9a1ef700 1 --2- 172.21.15.92:0/1193240268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc94105160 0x7fbc94105580 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbc840098a0 tx=0x7fbc84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eddc6e390e22cd99 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:21.930 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.010+0000 7fbc991ed700 1 -- 172.21.15.92:0/1193240268 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc84004160 con 0x7fbc94105160 2023-10-16T13:05:21.930 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.010+0000 7fbc991ed700 1 -- 172.21.15.92:0/1193240268 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fbc840042c0 con 0x7fbc94105160 2023-10-16T13:05:21.931 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.010+0000 7fbc991ed700 1 -- 172.21.15.92:0/1193240268 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc84011ac0 con 0x7fbc94105160 2023-10-16T13:05:21.931 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.010+0000 7fbc9c453700 1 -- 172.21.15.92:0/1193240268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc94105160 msgr2=0x7fbc94105580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:21.931 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.010+0000 7fbc9c453700 1 --2- 172.21.15.92:0/1193240268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc94105160 0x7fbc94105580 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbc840098a0 tx=0x7fbc84009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:21.931 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.010+0000 7fbc9c453700 1 -- 172.21.15.92:0/1193240268 shutdown_connections 2023-10-16T13:05:21.931 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.010+0000 7fbc9c453700 1 --2- 172.21.15.92:0/1193240268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc94105160 0x7fbc94105580 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:21.931 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.010+0000 7fbc9c453700 1 -- 172.21.15.92:0/1193240268 >> 172.21.15.92:0/1193240268 conn(0x7fbc94100d80 msgr2=0x7fbc941031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:21.932 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.010+0000 7fbc9c453700 1 -- 172.21.15.92:0/1193240268 shutdown_connections 2023-10-16T13:05:21.932 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.011+0000 7fbc9c453700 1 -- 172.21.15.92:0/1193240268 wait complete. 2023-10-16T13:05:21.932 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.011+0000 7fbc9c453700 1 Processor -- start 2023-10-16T13:05:21.932 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.011+0000 7fbc9c453700 1 -- start start 2023-10-16T13:05:21.932 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.011+0000 7fbc9c453700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc94105160 0x7fbc9419c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:21.933 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.011+0000 7fbc9c453700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9419cce0 con 0x7fbc94105160 2023-10-16T13:05:21.933 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.011+0000 7fbc9a1ef700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc94105160 0x7fbc9419c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:21.933 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.011+0000 7fbc9a1ef700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc94105160 0x7fbc9419c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34034/0 (socket says 172.21.15.92:34034) 2023-10-16T13:05:21.933 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.011+0000 7fbc9a1ef700 1 -- 172.21.15.92:0/3440643709 learned_addr learned my addr 172.21.15.92:0/3440643709 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:21.933 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.012+0000 7fbc9a1ef700 1 -- 172.21.15.92:0/3440643709 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc84009550 con 0x7fbc94105160 2023-10-16T13:05:21.934 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.012+0000 7fbc9a1ef700 1 --2- 172.21.15.92:0/3440643709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc94105160 0x7fbc9419c7a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbc84009130 tx=0x7fbc84011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:21.934 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.012+0000 7fbc8b7fe700 1 -- 172.21.15.92:0/3440643709 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc84003aa0 con 0x7fbc94105160 2023-10-16T13:05:21.934 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.012+0000 7fbc8b7fe700 1 -- 172.21.15.92:0/3440643709 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fbc84003c00 con 0x7fbc94105160 2023-10-16T13:05:21.934 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.012+0000 7fbc9c453700 1 -- 172.21.15.92:0/3440643709 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9419cee0 con 0x7fbc94105160 2023-10-16T13:05:21.934 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.012+0000 7fbc8b7fe700 1 -- 172.21.15.92:0/3440643709 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc84024800 con 0x7fbc94105160 2023-10-16T13:05:21.934 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.012+0000 7fbc9c453700 1 -- 172.21.15.92:0/3440643709 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9419d380 con 0x7fbc94105160 2023-10-16T13:05:21.935 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.013+0000 7fbc8b7fe700 1 -- 172.21.15.92:0/3440643709 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7fbc8401abd0 con 0x7fbc94105160 2023-10-16T13:05:21.935 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.013+0000 7fbc9c453700 1 -- 172.21.15.92:0/3440643709 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc94196050 con 0x7fbc94105160 2023-10-16T13:05:21.935 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.013+0000 7fbc8b7fe700 1 --2- 172.21.15.92:0/3440643709 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7fbc80038870 0x7fbc8003ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:21.935 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.013+0000 7fbc8b7fe700 1 -- 172.21.15.92:0/3440643709 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbc8404c8c0 con 0x7fbc94105160 2023-10-16T13:05:21.935 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.013+0000 7fbc999ee700 1 --2- 172.21.15.92:0/3440643709 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7fbc80038870 0x7fbc8003ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:21.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.013+0000 7fbc999ee700 1 --2- 172.21.15.92:0/3440643709 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7fbc80038870 0x7fbc8003ad30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbc90006fd0 tx=0x7fbc90006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:21.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.018+0000 7fbc8b7fe700 1 -- 172.21.15.92:0/3440643709 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbc84018760 con 0x7fbc94105160 2023-10-16T13:05:21.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:18.209+0000 7fbc9c453700 1 -- 172.21.15.92:0/3440643709 --> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi092", "addr": "172.21.15.92", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc9402d230 con 0x7fbc80038870 2023-10-16T13:05:21.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:20.576+0000 7fbc8b7fe700 1 -- 172.21.15.92:0/3440643709 <== mgr.14120 v2:172.21.15.92:6800/1487044137 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fbc9402d230 con 0x7fbc80038870 2023-10-16T13:05:21.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:20.579+0000 7fbc9c453700 1 -- 172.21.15.92:0/3440643709 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7fbc80038870 msgr2=0x7fbc8003ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:21.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:20.579+0000 7fbc9c453700 1 --2- 172.21.15.92:0/3440643709 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7fbc80038870 0x7fbc8003ad30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbc90006fd0 tx=0x7fbc90006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:21.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:20.579+0000 7fbc9c453700 1 -- 172.21.15.92:0/3440643709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc94105160 msgr2=0x7fbc9419c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:21.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:20.579+0000 7fbc9c453700 1 --2- 172.21.15.92:0/3440643709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc94105160 0x7fbc9419c7a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbc84009130 tx=0x7fbc84011b40 comp rx=0 tx=0).stop 2023-10-16T13:05:21.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:20.579+0000 7fbc9c453700 1 -- 172.21.15.92:0/3440643709 shutdown_connections 2023-10-16T13:05:21.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:20.579+0000 7fbc9c453700 1 --2- 172.21.15.92:0/3440643709 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7fbc80038870 0x7fbc8003ad30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:21.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:20.579+0000 7fbc9c453700 1 --2- 172.21.15.92:0/3440643709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc94105160 0x7fbc9419c7a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:21.938 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:20.579+0000 7fbc9c453700 1 -- 172.21.15.92:0/3440643709 >> 172.21.15.92:0/3440643709 conn(0x7fbc94100d80 msgr2=0x7fbc94190d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:21.938 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:20.579+0000 7fbc9c453700 1 -- 172.21.15.92:0/3440643709 shutdown_connections 2023-10-16T13:05:21.938 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:20.579+0000 7fbc9c453700 1 -- 172.21.15.92:0/3440643709 wait complete. 2023-10-16T13:05:21.938 INFO:teuthology.orchestra.run.smithi092.stdout:Deploying unmanaged mon service... 2023-10-16T13:05:23.278 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-10-16T13:05:23.278 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.437+0000 7f176f59a700 1 Processor -- start 2023-10-16T13:05:23.278 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.437+0000 7f176f59a700 1 -- start start 2023-10-16T13:05:23.279 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.438+0000 7f176f59a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768107350 0x7f1768109740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:23.279 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.438+0000 7f176f59a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17680747d0 con 0x7f1768107350 2023-10-16T13:05:23.279 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.438+0000 7f176d336700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768107350 0x7f1768109740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:23.279 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.438+0000 7f176d336700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768107350 0x7f1768109740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34068/0 (socket says 172.21.15.92:34068) 2023-10-16T13:05:23.279 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.438+0000 7f176d336700 1 -- 172.21.15.92:0/11285690 learned_addr learned my addr 172.21.15.92:0/11285690 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:23.279 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.438+0000 7f176d336700 1 -- 172.21.15.92:0/11285690 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1768109c80 con 0x7f1768107350 2023-10-16T13:05:23.280 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.438+0000 7f176d336700 1 --2- 172.21.15.92:0/11285690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768107350 0x7f1768109740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f17580098a0 tx=0x7f1758009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdaeb5e23b975153 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:23.280 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.439+0000 7f175ffff700 1 -- 172.21.15.92:0/11285690 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1758004160 con 0x7f1768107350 2023-10-16T13:05:23.280 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.439+0000 7f175ffff700 1 -- 172.21.15.92:0/11285690 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f17580042c0 con 0x7f1768107350 2023-10-16T13:05:23.280 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.439+0000 7f175ffff700 1 -- 172.21.15.92:0/11285690 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1758011ac0 con 0x7f1768107350 2023-10-16T13:05:23.280 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.439+0000 7f176f59a700 1 -- 172.21.15.92:0/11285690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768107350 msgr2=0x7f1768109740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:23.281 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.439+0000 7f176f59a700 1 --2- 172.21.15.92:0/11285690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768107350 0x7f1768109740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f17580098a0 tx=0x7f1758009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:23.281 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.439+0000 7f176f59a700 1 -- 172.21.15.92:0/11285690 shutdown_connections 2023-10-16T13:05:23.281 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.439+0000 7f176f59a700 1 --2- 172.21.15.92:0/11285690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768107350 0x7f1768109740 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:23.281 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.439+0000 7f176f59a700 1 -- 172.21.15.92:0/11285690 >> 172.21.15.92:0/11285690 conn(0x7f1768100d80 msgr2=0x7f17681031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:23.281 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.439+0000 7f176f59a700 1 -- 172.21.15.92:0/11285690 shutdown_connections 2023-10-16T13:05:23.282 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.439+0000 7f176f59a700 1 -- 172.21.15.92:0/11285690 wait complete. 2023-10-16T13:05:23.282 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.440+0000 7f176f59a700 1 Processor -- start 2023-10-16T13:05:23.282 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.440+0000 7f176f59a700 1 -- start start 2023-10-16T13:05:23.282 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.440+0000 7f176f59a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768107350 0x7f176819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:23.282 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.440+0000 7f176f59a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176819aa80 con 0x7f1768107350 2023-10-16T13:05:23.283 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.440+0000 7f176d336700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768107350 0x7f176819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:23.283 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.440+0000 7f176d336700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768107350 0x7f176819a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34070/0 (socket says 172.21.15.92:34070) 2023-10-16T13:05:23.283 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.440+0000 7f176d336700 1 -- 172.21.15.92:0/3592821628 learned_addr learned my addr 172.21.15.92:0/3592821628 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:23.283 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.440+0000 7f176d336700 1 -- 172.21.15.92:0/3592821628 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1758009550 con 0x7f1768107350 2023-10-16T13:05:23.283 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.441+0000 7f176d336700 1 --2- 172.21.15.92:0/3592821628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768107350 0x7f176819a540 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1758009130 tx=0x7f1758011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:23.284 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.441+0000 7f175e7fc700 1 -- 172.21.15.92:0/3592821628 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1758003aa0 con 0x7f1768107350 2023-10-16T13:05:23.284 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.441+0000 7f175e7fc700 1 -- 172.21.15.92:0/3592821628 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f1758003c00 con 0x7f1768107350 2023-10-16T13:05:23.284 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.441+0000 7f176f59a700 1 -- 172.21.15.92:0/3592821628 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176819ac80 con 0x7f1768107350 2023-10-16T13:05:23.284 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.441+0000 7f175e7fc700 1 -- 172.21.15.92:0/3592821628 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1758024800 con 0x7f1768107350 2023-10-16T13:05:23.284 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.441+0000 7f176f59a700 1 -- 172.21.15.92:0/3592821628 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176819b120 con 0x7f1768107350 2023-10-16T13:05:23.284 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.442+0000 7f175e7fc700 1 -- 172.21.15.92:0/3592821628 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f1758024ac0 con 0x7f1768107350 2023-10-16T13:05:23.285 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.442+0000 7f175e7fc700 1 --2- 172.21.15.92:0/3592821628 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f1754038820 0x7f175403ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:23.285 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.442+0000 7f175e7fc700 1 -- 172.21.15.92:0/3592821628 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f175804c930 con 0x7f1768107350 2023-10-16T13:05:23.285 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.442+0000 7f176f59a700 1 -- 172.21.15.92:0/3592821628 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176810aa90 con 0x7f1768107350 2023-10-16T13:05:23.285 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.442+0000 7f176cb35700 1 --2- 172.21.15.92:0/3592821628 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f1754038820 0x7f175403ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:23.285 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.442+0000 7f176cb35700 1 --2- 172.21.15.92:0/3592821628 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f1754038820 0x7f175403ace0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1764006fd0 tx=0x7f1764006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:23.286 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.447+0000 7f175e7fc700 1 -- 172.21.15.92:0/3592821628 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1758024d70 con 0x7f1768107350 2023-10-16T13:05:23.286 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.664+0000 7f176f59a700 1 -- 172.21.15.92:0/3592821628 --> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f1768102220 con 0x7f1754038820 2023-10-16T13:05:23.286 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.669+0000 7f175e7fc700 1 -- 172.21.15.92:0/3592821628 <== mgr.14120 v2:172.21.15.92:6800/1487044137 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f1768102220 con 0x7f1754038820 2023-10-16T13:05:23.286 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.671+0000 7f176f59a700 1 -- 172.21.15.92:0/3592821628 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f1754038820 msgr2=0x7f175403ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:23.286 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.671+0000 7f176f59a700 1 --2- 172.21.15.92:0/3592821628 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f1754038820 0x7f175403ace0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1764006fd0 tx=0x7f1764006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:23.287 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.671+0000 7f176f59a700 1 -- 172.21.15.92:0/3592821628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768107350 msgr2=0x7f176819a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:23.287 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.671+0000 7f176f59a700 1 --2- 172.21.15.92:0/3592821628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768107350 0x7f176819a540 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1758009130 tx=0x7f1758011b40 comp rx=0 tx=0).stop 2023-10-16T13:05:23.287 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.671+0000 7f176f59a700 1 -- 172.21.15.92:0/3592821628 shutdown_connections 2023-10-16T13:05:23.287 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.671+0000 7f176f59a700 1 --2- 172.21.15.92:0/3592821628 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f1754038820 0x7f175403ace0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:23.287 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.671+0000 7f176f59a700 1 --2- 172.21.15.92:0/3592821628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768107350 0x7f176819a540 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:23.287 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.671+0000 7f176f59a700 1 -- 172.21.15.92:0/3592821628 >> 172.21.15.92:0/3592821628 conn(0x7f1768100d80 msgr2=0x7f1768101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:23.288 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.671+0000 7f176f59a700 1 -- 172.21.15.92:0/3592821628 shutdown_connections 2023-10-16T13:05:23.288 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:22.671+0000 7f176f59a700 1 -- 172.21.15.92:0/3592821628 wait complete. 2023-10-16T13:05:23.288 INFO:teuthology.orchestra.run.smithi092.stdout:Deploying unmanaged mgr service... 2023-10-16T13:05:23.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:23 smithi092 ceph-mon[99542]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:05:23.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:23 smithi092 ceph-mon[99542]: Saving service mon spec with placement count:5 2023-10-16T13:05:23.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:23 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' 2023-10-16T13:05:24.572 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-10-16T13:05:24.573 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.939+0000 7fe001a8e700 1 Processor -- start 2023-10-16T13:05:24.573 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.939+0000 7fe001a8e700 1 -- start start 2023-10-16T13:05:24.573 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.939+0000 7fe001a8e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdffc07bea0 0x7fdffc07a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:24.573 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.939+0000 7fe001a8e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc07a8d0 con 0x7fdffc07bea0 2023-10-16T13:05:24.573 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.940+0000 7fdffb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdffc07bea0 0x7fdffc07a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:24.574 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.940+0000 7fdffb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdffc07bea0 0x7fdffc07a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34074/0 (socket says 172.21.15.92:34074) 2023-10-16T13:05:24.574 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.940+0000 7fdffb7fe700 1 -- 172.21.15.92:0/1108951126 learned_addr learned my addr 172.21.15.92:0/1108951126 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:24.574 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.940+0000 7fdffb7fe700 1 -- 172.21.15.92:0/1108951126 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc07aa10 con 0x7fdffc07bea0 2023-10-16T13:05:24.574 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.940+0000 7fdffb7fe700 1 --2- 172.21.15.92:0/1108951126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdffc07bea0 0x7fdffc07a300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdff00098a0 tx=0x7fdff0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15ce6544ebb9ba4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:24.574 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.940+0000 7fdffa7fc700 1 -- 172.21.15.92:0/1108951126 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdff0004160 con 0x7fdffc07bea0 2023-10-16T13:05:24.575 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.940+0000 7fdffa7fc700 1 -- 172.21.15.92:0/1108951126 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fdff00042c0 con 0x7fdffc07bea0 2023-10-16T13:05:24.575 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.940+0000 7fdffa7fc700 1 -- 172.21.15.92:0/1108951126 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdff0011ac0 con 0x7fdffc07bea0 2023-10-16T13:05:24.575 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.941+0000 7fe001a8e700 1 -- 172.21.15.92:0/1108951126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdffc07bea0 msgr2=0x7fdffc07a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:24.575 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.941+0000 7fe001a8e700 1 --2- 172.21.15.92:0/1108951126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdffc07bea0 0x7fdffc07a300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdff00098a0 tx=0x7fdff0009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:24.576 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.941+0000 7fe001a8e700 1 -- 172.21.15.92:0/1108951126 shutdown_connections 2023-10-16T13:05:24.576 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.941+0000 7fe001a8e700 1 --2- 172.21.15.92:0/1108951126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdffc07bea0 0x7fdffc07a300 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:24.576 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.941+0000 7fe001a8e700 1 -- 172.21.15.92:0/1108951126 >> 172.21.15.92:0/1108951126 conn(0x7fdffc101e90 msgr2=0x7fdffc1042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:24.576 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.941+0000 7fe001a8e700 1 -- 172.21.15.92:0/1108951126 shutdown_connections 2023-10-16T13:05:24.576 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.941+0000 7fe001a8e700 1 -- 172.21.15.92:0/1108951126 wait complete. 2023-10-16T13:05:24.576 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.941+0000 7fe001a8e700 1 Processor -- start 2023-10-16T13:05:24.577 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.942+0000 7fe001a8e700 1 -- start start 2023-10-16T13:05:24.577 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.942+0000 7fe001a8e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdffc07bea0 0x7fdffc19c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:24.577 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.942+0000 7fe001a8e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc19cc90 con 0x7fdffc07bea0 2023-10-16T13:05:24.577 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.942+0000 7fdffb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdffc07bea0 0x7fdffc19c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:24.577 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.942+0000 7fdffb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdffc07bea0 0x7fdffc19c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34076/0 (socket says 172.21.15.92:34076) 2023-10-16T13:05:24.578 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.942+0000 7fdffb7fe700 1 -- 172.21.15.92:0/604087964 learned_addr learned my addr 172.21.15.92:0/604087964 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:24.578 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.942+0000 7fdffb7fe700 1 -- 172.21.15.92:0/604087964 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff0009550 con 0x7fdffc07bea0 2023-10-16T13:05:24.578 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.942+0000 7fdffb7fe700 1 --2- 172.21.15.92:0/604087964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdffc07bea0 0x7fdffc19c750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdff0003f70 tx=0x7fdff0011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:24.578 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.942+0000 7fdff8ff9700 1 -- 172.21.15.92:0/604087964 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdff0003b20 con 0x7fdffc07bea0 2023-10-16T13:05:24.578 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.942+0000 7fdff8ff9700 1 -- 172.21.15.92:0/604087964 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fdff0003c80 con 0x7fdffc07bea0 2023-10-16T13:05:24.579 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.942+0000 7fe001a8e700 1 -- 172.21.15.92:0/604087964 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdffc19ce90 con 0x7fdffc07bea0 2023-10-16T13:05:24.579 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.942+0000 7fdff8ff9700 1 -- 172.21.15.92:0/604087964 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdff0024860 con 0x7fdffc07bea0 2023-10-16T13:05:24.579 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.943+0000 7fe001a8e700 1 -- 172.21.15.92:0/604087964 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdffc19d330 con 0x7fdffc07bea0 2023-10-16T13:05:24.579 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.943+0000 7fdff8ff9700 1 -- 172.21.15.92:0/604087964 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7fdff002d3f0 con 0x7fdffc07bea0 2023-10-16T13:05:24.579 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.943+0000 7fdff8ff9700 1 --2- 172.21.15.92:0/604087964 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7fdfe4038820 0x7fdfe403ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:24.580 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.943+0000 7fdff8ff9700 1 -- 172.21.15.92:0/604087964 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdff004cb10 con 0x7fdffc07bea0 2023-10-16T13:05:24.580 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.943+0000 7fe001a8e700 1 -- 172.21.15.92:0/604087964 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdffc0624e0 con 0x7fdffc07bea0 2023-10-16T13:05:24.580 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.943+0000 7fdffaffd700 1 --2- 172.21.15.92:0/604087964 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7fdfe4038820 0x7fdfe403ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:24.580 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.944+0000 7fdffaffd700 1 --2- 172.21.15.92:0/604087964 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7fdfe4038820 0x7fdfe403ace0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdfec006fd0 tx=0x7fdfec006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:24.580 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.948+0000 7fdff8ff9700 1 -- 172.21.15.92:0/604087964 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdff0010970 con 0x7fdffc07bea0 2023-10-16T13:05:24.581 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:23.987+0000 7fdff8ff9700 1 -- 172.21.15.92:0/604087964 <== mon.0 v2:172.21.15.92:3300/0 7 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdff0010970 con 0x7fdffc07bea0 2023-10-16T13:05:24.581 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:24.172+0000 7fe001a8e700 1 -- 172.21.15.92:0/604087964 --> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fdffc103330 con 0x7fdfe4038820 2023-10-16T13:05:24.581 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:24.178+0000 7fdff8ff9700 1 -- 172.21.15.92:0/604087964 <== mgr.14120 v2:172.21.15.92:6800/1487044137 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fdffc103330 con 0x7fdfe4038820 2023-10-16T13:05:24.581 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:24.180+0000 7fe001a8e700 1 -- 172.21.15.92:0/604087964 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7fdfe4038820 msgr2=0x7fdfe403ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:24.581 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:24.180+0000 7fe001a8e700 1 --2- 172.21.15.92:0/604087964 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7fdfe4038820 0x7fdfe403ace0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdfec006fd0 tx=0x7fdfec006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:24.582 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:24.180+0000 7fe001a8e700 1 -- 172.21.15.92:0/604087964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdffc07bea0 msgr2=0x7fdffc19c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:24.582 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:24.180+0000 7fe001a8e700 1 --2- 172.21.15.92:0/604087964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdffc07bea0 0x7fdffc19c750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdff0003f70 tx=0x7fdff0011b40 comp rx=0 tx=0).stop 2023-10-16T13:05:24.582 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:24.180+0000 7fe001a8e700 1 -- 172.21.15.92:0/604087964 shutdown_connections 2023-10-16T13:05:24.582 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:24.180+0000 7fe001a8e700 1 --2- 172.21.15.92:0/604087964 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7fdfe4038820 0x7fdfe403ace0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:24.582 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:24.180+0000 7fe001a8e700 1 --2- 172.21.15.92:0/604087964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdffc07bea0 0x7fdffc19c750 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:24.583 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:24.180+0000 7fe001a8e700 1 -- 172.21.15.92:0/604087964 >> 172.21.15.92:0/604087964 conn(0x7fdffc101e90 msgr2=0x7fdffc102c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:24.583 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:24.180+0000 7fe001a8e700 1 -- 172.21.15.92:0/604087964 shutdown_connections 2023-10-16T13:05:24.583 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:24.180+0000 7fe001a8e700 1 -- 172.21.15.92:0/604087964 wait complete. 2023-10-16T13:05:25.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:24 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' 2023-10-16T13:05:25.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:24 smithi092 ceph-mon[99542]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:05:25.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:24 smithi092 ceph-mon[99542]: Saving service mgr spec with placement count:2 2023-10-16T13:05:25.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:24 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' 2023-10-16T13:05:25.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:24 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' 2023-10-16T13:05:25.716 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.078+0000 7efebbb85700 1 Processor -- start 2023-10-16T13:05:25.716 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.078+0000 7efebbb85700 1 -- start start 2023-10-16T13:05:25.717 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.079+0000 7efebbb85700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efeb4105180 0x7efeb41055a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:25.717 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.079+0000 7efebbb85700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb4074790 con 0x7efeb4105180 2023-10-16T13:05:25.717 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.079+0000 7efeb9921700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efeb4105180 0x7efeb41055a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:25.717 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.079+0000 7efeb9921700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efeb4105180 0x7efeb41055a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34080/0 (socket says 172.21.15.92:34080) 2023-10-16T13:05:25.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.079+0000 7efeb9921700 1 -- 172.21.15.92:0/2800799340 learned_addr learned my addr 172.21.15.92:0/2800799340 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:25.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.079+0000 7efeb9921700 1 -- 172.21.15.92:0/2800799340 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb4105ae0 con 0x7efeb4105180 2023-10-16T13:05:25.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.079+0000 7efeb9921700 1 --2- 172.21.15.92:0/2800799340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efeb4105180 0x7efeb41055a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efeb00098a0 tx=0x7efeb0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9b9141404d94f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:25.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.079+0000 7efeb891f700 1 -- 172.21.15.92:0/2800799340 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efeb0004160 con 0x7efeb4105180 2023-10-16T13:05:25.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.079+0000 7efeb891f700 1 -- 172.21.15.92:0/2800799340 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efeb00042c0 con 0x7efeb4105180 2023-10-16T13:05:25.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.079+0000 7efeb891f700 1 -- 172.21.15.92:0/2800799340 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efeb0011a80 con 0x7efeb4105180 2023-10-16T13:05:25.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.080+0000 7efebbb85700 1 -- 172.21.15.92:0/2800799340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efeb4105180 msgr2=0x7efeb41055a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:25.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.080+0000 7efebbb85700 1 --2- 172.21.15.92:0/2800799340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efeb4105180 0x7efeb41055a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efeb00098a0 tx=0x7efeb0009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:25.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.080+0000 7efebbb85700 1 -- 172.21.15.92:0/2800799340 shutdown_connections 2023-10-16T13:05:25.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.080+0000 7efebbb85700 1 --2- 172.21.15.92:0/2800799340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efeb4105180 0x7efeb41055a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:25.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.080+0000 7efebbb85700 1 -- 172.21.15.92:0/2800799340 >> 172.21.15.92:0/2800799340 conn(0x7efeb4100d80 msgr2=0x7efeb41031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:25.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.080+0000 7efebbb85700 1 -- 172.21.15.92:0/2800799340 shutdown_connections 2023-10-16T13:05:25.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.080+0000 7efebbb85700 1 -- 172.21.15.92:0/2800799340 wait complete. 2023-10-16T13:05:25.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.081+0000 7efebbb85700 1 Processor -- start 2023-10-16T13:05:25.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.081+0000 7efebbb85700 1 -- start start 2023-10-16T13:05:25.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.081+0000 7efebbb85700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efeb4105180 0x7efeb419c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:25.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.081+0000 7efebbb85700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb419cd40 con 0x7efeb4105180 2023-10-16T13:05:25.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.081+0000 7efeb9921700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efeb4105180 0x7efeb419c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:25.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.081+0000 7efeb9921700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efeb4105180 0x7efeb419c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34082/0 (socket says 172.21.15.92:34082) 2023-10-16T13:05:25.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.081+0000 7efeb9921700 1 -- 172.21.15.92:0/2514068744 learned_addr learned my addr 172.21.15.92:0/2514068744 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:25.722 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.082+0000 7efeb9921700 1 -- 172.21.15.92:0/2514068744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb0009550 con 0x7efeb4105180 2023-10-16T13:05:25.722 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.082+0000 7efeb9921700 1 --2- 172.21.15.92:0/2514068744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efeb4105180 0x7efeb419c800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efeb0003f20 tx=0x7efeb0011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:25.722 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.082+0000 7efeaaffd700 1 -- 172.21.15.92:0/2514068744 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efeb0003b20 con 0x7efeb4105180 2023-10-16T13:05:25.722 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.082+0000 7efeaaffd700 1 -- 172.21.15.92:0/2514068744 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efeb001a910 con 0x7efeb4105180 2023-10-16T13:05:25.722 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.082+0000 7efebbb85700 1 -- 172.21.15.92:0/2514068744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb419cf40 con 0x7efeb4105180 2023-10-16T13:05:25.722 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.082+0000 7efeaaffd700 1 -- 172.21.15.92:0/2514068744 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efeb0024900 con 0x7efeb4105180 2023-10-16T13:05:25.723 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.083+0000 7efebbb85700 1 -- 172.21.15.92:0/2514068744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb419dbd0 con 0x7efeb4105180 2023-10-16T13:05:25.723 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.084+0000 7efeaaffd700 1 -- 172.21.15.92:0/2514068744 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7efeb001aa80 con 0x7efeb4105180 2023-10-16T13:05:25.723 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.084+0000 7efebbb85700 1 -- 172.21.15.92:0/2514068744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb419d3e0 con 0x7efeb4105180 2023-10-16T13:05:25.723 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.084+0000 7efeaaffd700 1 --2- 172.21.15.92:0/2514068744 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7efea0038820 0x7efea003ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:25.723 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.084+0000 7efeaaffd700 1 -- 172.21.15.92:0/2514068744 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7efeb004ca10 con 0x7efeb4105180 2023-10-16T13:05:25.724 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.084+0000 7efeb9120700 1 --2- 172.21.15.92:0/2514068744 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7efea0038820 0x7efea003ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:25.724 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.084+0000 7efeb9120700 1 --2- 172.21.15.92:0/2514068744 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7efea0038820 0x7efea003ace0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efea4006fd0 tx=0x7efea4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:25.724 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.089+0000 7efeaaffd700 1 -- 172.21.15.92:0/2514068744 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efeb419d3e0 con 0x7efeb4105180 2023-10-16T13:05:25.724 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.292+0000 7efebbb85700 1 -- 172.21.15.92:0/2514068744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7efeb4106bc0 con 0x7efeb4105180 2023-10-16T13:05:25.724 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.297+0000 7efeaaffd700 1 -- 172.21.15.92:0/2514068744 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7efeb001ae10 con 0x7efeb4105180 2023-10-16T13:05:25.725 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.300+0000 7efebbb85700 1 -- 172.21.15.92:0/2514068744 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7efea0038820 msgr2=0x7efea003ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:25.725 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.300+0000 7efebbb85700 1 --2- 172.21.15.92:0/2514068744 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7efea0038820 0x7efea003ace0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efea4006fd0 tx=0x7efea4006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:25.725 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.300+0000 7efebbb85700 1 -- 172.21.15.92:0/2514068744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efeb4105180 msgr2=0x7efeb419c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:25.725 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.300+0000 7efebbb85700 1 --2- 172.21.15.92:0/2514068744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efeb4105180 0x7efeb419c800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efeb0003f20 tx=0x7efeb0011a50 comp rx=0 tx=0).stop 2023-10-16T13:05:25.725 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.300+0000 7efebbb85700 1 -- 172.21.15.92:0/2514068744 shutdown_connections 2023-10-16T13:05:25.726 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.300+0000 7efebbb85700 1 --2- 172.21.15.92:0/2514068744 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7efea0038820 0x7efea003ace0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:25.726 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.300+0000 7efebbb85700 1 --2- 172.21.15.92:0/2514068744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efeb4105180 0x7efeb419c800 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:25.726 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.300+0000 7efebbb85700 1 -- 172.21.15.92:0/2514068744 >> 172.21.15.92:0/2514068744 conn(0x7efeb4100d80 msgr2=0x7efeb4190d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:25.726 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.300+0000 7efebbb85700 1 -- 172.21.15.92:0/2514068744 shutdown_connections 2023-10-16T13:05:25.726 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:25.300+0000 7efebbb85700 1 -- 172.21.15.92:0/2514068744 wait complete. 2023-10-16T13:05:26.609 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:26 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2514068744' entity='client.admin' 2023-10-16T13:05:27.063 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.364+0000 7f1819472700 1 Processor -- start 2023-10-16T13:05:27.064 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.364+0000 7f1819472700 1 -- start start 2023-10-16T13:05:27.064 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.364+0000 7f1819472700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814107390 0x7f1814109780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:27.064 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.364+0000 7f1819472700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1814074790 con 0x7f1814107390 2023-10-16T13:05:27.065 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.364+0000 7f1812ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814107390 0x7f1814109780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:27.065 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.364+0000 7f1812ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814107390 0x7f1814109780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34086/0 (socket says 172.21.15.92:34086) 2023-10-16T13:05:27.065 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.364+0000 7f1812ffd700 1 -- 172.21.15.92:0/3095554693 learned_addr learned my addr 172.21.15.92:0/3095554693 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:27.065 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.365+0000 7f1812ffd700 1 -- 172.21.15.92:0/3095554693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1814109cc0 con 0x7f1814107390 2023-10-16T13:05:27.066 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.365+0000 7f1812ffd700 1 --2- 172.21.15.92:0/3095554693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814107390 0x7f1814109780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f180c009e80 tx=0x7f180c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5eff029df43b1f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:27.066 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.365+0000 7f1811ffb700 1 -- 172.21.15.92:0/3095554693 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f180c00e070 con 0x7f1814107390 2023-10-16T13:05:27.066 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.365+0000 7f1811ffb700 1 -- 172.21.15.92:0/3095554693 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f180c00b8c0 con 0x7f1814107390 2023-10-16T13:05:27.066 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.365+0000 7f1811ffb700 1 -- 172.21.15.92:0/3095554693 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f180c0044a0 con 0x7f1814107390 2023-10-16T13:05:27.066 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.365+0000 7f1819472700 1 -- 172.21.15.92:0/3095554693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814107390 msgr2=0x7f1814109780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:27.067 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.365+0000 7f1819472700 1 --2- 172.21.15.92:0/3095554693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814107390 0x7f1814109780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f180c009e80 tx=0x7f180c00b330 comp rx=0 tx=0).stop 2023-10-16T13:05:27.067 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.366+0000 7f1819472700 1 -- 172.21.15.92:0/3095554693 shutdown_connections 2023-10-16T13:05:27.067 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.366+0000 7f1819472700 1 --2- 172.21.15.92:0/3095554693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814107390 0x7f1814109780 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:27.067 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.366+0000 7f1819472700 1 -- 172.21.15.92:0/3095554693 >> 172.21.15.92:0/3095554693 conn(0x7f1814100d80 msgr2=0x7f18141031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:27.067 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.366+0000 7f1819472700 1 -- 172.21.15.92:0/3095554693 shutdown_connections 2023-10-16T13:05:27.068 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.366+0000 7f1819472700 1 -- 172.21.15.92:0/3095554693 wait complete. 2023-10-16T13:05:27.068 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.366+0000 7f1819472700 1 Processor -- start 2023-10-16T13:05:27.068 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.366+0000 7f1819472700 1 -- start start 2023-10-16T13:05:27.068 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.367+0000 7f1819472700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814107390 0x7f1814106cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:27.069 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.367+0000 7f1819472700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1814107230 con 0x7f1814107390 2023-10-16T13:05:27.069 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.367+0000 7f1812ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814107390 0x7f1814106cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:27.069 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.367+0000 7f1812ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814107390 0x7f1814106cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34088/0 (socket says 172.21.15.92:34088) 2023-10-16T13:05:27.069 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.367+0000 7f1812ffd700 1 -- 172.21.15.92:0/331122397 learned_addr learned my addr 172.21.15.92:0/331122397 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:27.069 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.367+0000 7f1812ffd700 1 -- 172.21.15.92:0/331122397 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c009b30 con 0x7f1814107390 2023-10-16T13:05:27.070 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.367+0000 7f1812ffd700 1 --2- 172.21.15.92:0/331122397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814107390 0x7f1814106cf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f180c004110 tx=0x7f180c00bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:27.070 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.367+0000 7f17fbfff700 1 -- 172.21.15.92:0/331122397 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f180c00e040 con 0x7f1814107390 2023-10-16T13:05:27.070 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.367+0000 7f1819472700 1 -- 172.21.15.92:0/331122397 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1814105340 con 0x7f1814107390 2023-10-16T13:05:27.070 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.367+0000 7f17fbfff700 1 -- 172.21.15.92:0/331122397 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f180c003de0 con 0x7f1814107390 2023-10-16T13:05:27.070 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.367+0000 7f17fbfff700 1 -- 172.21.15.92:0/331122397 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f180c01c7d0 con 0x7f1814107390 2023-10-16T13:05:27.071 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.367+0000 7f1819472700 1 -- 172.21.15.92:0/331122397 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1814105840 con 0x7f1814107390 2023-10-16T13:05:27.071 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.368+0000 7f17fbfff700 1 -- 172.21.15.92:0/331122397 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f180c01ca90 con 0x7f1814107390 2023-10-16T13:05:27.071 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.368+0000 7f17fbfff700 1 --2- 172.21.15.92:0/331122397 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f17fc0387d0 0x7f17fc03ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:27.071 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.368+0000 7f17fbfff700 1 -- 172.21.15.92:0/331122397 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f180c04c700 con 0x7f1814107390 2023-10-16T13:05:27.072 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.368+0000 7f18127fc700 1 --2- 172.21.15.92:0/331122397 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f17fc0387d0 0x7f17fc03ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:27.072 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.368+0000 7f1819472700 1 -- 172.21.15.92:0/331122397 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181410ab00 con 0x7f1814107390 2023-10-16T13:05:27.072 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.369+0000 7f18127fc700 1 --2- 172.21.15.92:0/331122397 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f17fc0387d0 0x7f17fc03ac90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1808006fd0 tx=0x7f1808006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:27.072 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.373+0000 7f17fbfff700 1 -- 172.21.15.92:0/331122397 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f180c017070 con 0x7f1814107390 2023-10-16T13:05:27.073 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.573+0000 7f1819472700 1 -- 172.21.15.92:0/331122397 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f181410acf0 con 0x7f1814107390 2023-10-16T13:05:27.073 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.578+0000 7f17fbfff700 1 -- 172.21.15.92:0/331122397 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f180c020070 con 0x7f1814107390 2023-10-16T13:05:27.073 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.580+0000 7f1819472700 1 -- 172.21.15.92:0/331122397 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f17fc0387d0 msgr2=0x7f17fc03ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:27.073 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.581+0000 7f1819472700 1 --2- 172.21.15.92:0/331122397 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f17fc0387d0 0x7f17fc03ac90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1808006fd0 tx=0x7f1808006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:27.073 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.581+0000 7f1819472700 1 -- 172.21.15.92:0/331122397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814107390 msgr2=0x7f1814106cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:27.074 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.581+0000 7f1819472700 1 --2- 172.21.15.92:0/331122397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814107390 0x7f1814106cf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f180c004110 tx=0x7f180c00bd80 comp rx=0 tx=0).stop 2023-10-16T13:05:27.074 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.581+0000 7f1819472700 1 -- 172.21.15.92:0/331122397 shutdown_connections 2023-10-16T13:05:27.074 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.581+0000 7f1819472700 1 --2- 172.21.15.92:0/331122397 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f17fc0387d0 0x7f17fc03ac90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:27.074 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.581+0000 7f1819472700 1 --2- 172.21.15.92:0/331122397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814107390 0x7f1814106cf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:27.074 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.581+0000 7f1819472700 1 -- 172.21.15.92:0/331122397 >> 172.21.15.92:0/331122397 conn(0x7f1814100d80 msgr2=0x7f1814101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:27.075 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.581+0000 7f1819472700 1 -- 172.21.15.92:0/331122397 shutdown_connections 2023-10-16T13:05:27.075 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:26.581+0000 7f1819472700 1 -- 172.21.15.92:0/331122397 wait complete. 2023-10-16T13:05:27.075 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling the dashboard module... 2023-10-16T13:05:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:27 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' 2023-10-16T13:05:27.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:27 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/331122397' entity='client.admin' 2023-10-16T13:05:27.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:27 smithi092 ceph-mon[99542]: from='mgr.14120 172.21.15.92:0/2563131706' entity='mgr.x' 2023-10-16T13:05:28.648 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:28 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2150386774' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-10-16T13:05:28.649 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:28 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: ignoring --setuser ceph since I am not root 2023-10-16T13:05:28.649 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:28 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: ignoring --setgroup ceph since I am not root 2023-10-16T13:05:28.942 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:28 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:28.675+0000 7f2a3c541200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T13:05:28.942 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:28 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:28.755+0000 7f2a3c541200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T13:05:28.942 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:28 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:28.846+0000 7f2a3c541200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T13:05:29.009 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.583+0000 7f3507d74700 1 Processor -- start 2023-10-16T13:05:29.015 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.584+0000 7f3507d74700 1 -- start start 2023-10-16T13:05:29.015 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.584+0000 7f3507d74700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3500107350 0x7f3500109740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:29.015 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.584+0000 7f3507d74700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35000747d0 con 0x7f3500107350 2023-10-16T13:05:29.016 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.584+0000 7f3505b10700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3500107350 0x7f3500109740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:29.016 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.584+0000 7f3505b10700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3500107350 0x7f3500109740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34092/0 (socket says 172.21.15.92:34092) 2023-10-16T13:05:29.016 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.584+0000 7f3505b10700 1 -- 172.21.15.92:0/1826028269 learned_addr learned my addr 172.21.15.92:0/1826028269 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:29.016 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.584+0000 7f3505b10700 1 -- 172.21.15.92:0/1826028269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3500109c80 con 0x7f3500107350 2023-10-16T13:05:29.016 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.584+0000 7f3505b10700 1 --2- 172.21.15.92:0/1826028269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3500107350 0x7f3500109740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0098a0 tx=0x7f34fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a19213907488e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:29.017 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.585+0000 7f3504b0e700 1 -- 172.21.15.92:0/1826028269 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34fc004160 con 0x7f3500107350 2023-10-16T13:05:29.017 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.585+0000 7f3504b0e700 1 -- 172.21.15.92:0/1826028269 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f34fc0042c0 con 0x7f3500107350 2023-10-16T13:05:29.017 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.585+0000 7f3504b0e700 1 -- 172.21.15.92:0/1826028269 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34fc011a80 con 0x7f3500107350 2023-10-16T13:05:29.017 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.585+0000 7f3507d74700 1 -- 172.21.15.92:0/1826028269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3500107350 msgr2=0x7f3500109740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:29.017 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.585+0000 7f3507d74700 1 --2- 172.21.15.92:0/1826028269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3500107350 0x7f3500109740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0098a0 tx=0x7f34fc009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:29.018 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.585+0000 7f3507d74700 1 -- 172.21.15.92:0/1826028269 shutdown_connections 2023-10-16T13:05:29.018 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.585+0000 7f3507d74700 1 --2- 172.21.15.92:0/1826028269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3500107350 0x7f3500109740 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:29.018 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.585+0000 7f3507d74700 1 -- 172.21.15.92:0/1826028269 >> 172.21.15.92:0/1826028269 conn(0x7f3500100d80 msgr2=0x7f35001031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:29.018 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.585+0000 7f3507d74700 1 -- 172.21.15.92:0/1826028269 shutdown_connections 2023-10-16T13:05:29.018 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.585+0000 7f3507d74700 1 -- 172.21.15.92:0/1826028269 wait complete. 2023-10-16T13:05:29.019 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.586+0000 7f3507d74700 1 Processor -- start 2023-10-16T13:05:29.019 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.586+0000 7f3507d74700 1 -- start start 2023-10-16T13:05:29.019 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.586+0000 7f3507d74700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3500107350 0x7f350019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:29.019 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.586+0000 7f3507d74700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350019aa50 con 0x7f3500107350 2023-10-16T13:05:29.019 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.586+0000 7f3505b10700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3500107350 0x7f350019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:29.020 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.586+0000 7f3505b10700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3500107350 0x7f350019a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34094/0 (socket says 172.21.15.92:34094) 2023-10-16T13:05:29.020 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.586+0000 7f3505b10700 1 -- 172.21.15.92:0/2150386774 learned_addr learned my addr 172.21.15.92:0/2150386774 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:29.020 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.587+0000 7f3505b10700 1 -- 172.21.15.92:0/2150386774 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc009550 con 0x7f3500107350 2023-10-16T13:05:29.020 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.587+0000 7f3505b10700 1 --2- 172.21.15.92:0/2150386774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3500107350 0x7f350019a510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34fc003f20 tx=0x7f34fc011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:29.021 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.587+0000 7f34f6ffd700 1 -- 172.21.15.92:0/2150386774 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34fc003b20 con 0x7f3500107350 2023-10-16T13:05:29.021 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.587+0000 7f34f6ffd700 1 -- 172.21.15.92:0/2150386774 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f34fc01a910 con 0x7f3500107350 2023-10-16T13:05:29.021 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.587+0000 7f3507d74700 1 -- 172.21.15.92:0/2150386774 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350019ac50 con 0x7f3500107350 2023-10-16T13:05:29.021 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.587+0000 7f3507d74700 1 -- 172.21.15.92:0/2150386774 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350019b0f0 con 0x7f3500107350 2023-10-16T13:05:29.021 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.587+0000 7f34f6ffd700 1 -- 172.21.15.92:0/2150386774 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34fc0248c0 con 0x7f3500107350 2023-10-16T13:05:29.022 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.588+0000 7f34f6ffd700 1 -- 172.21.15.92:0/2150386774 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f34fc02d3f0 con 0x7f3500107350 2023-10-16T13:05:29.022 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.588+0000 7f3507d74700 1 -- 172.21.15.92:0/2150386774 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e4005320 con 0x7f3500107350 2023-10-16T13:05:29.022 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.588+0000 7f34f6ffd700 1 --2- 172.21.15.92:0/2150386774 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f34ec038820 0x7f34ec03ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:29.022 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.588+0000 7f34f6ffd700 1 -- 172.21.15.92:0/2150386774 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f34fc04cc00 con 0x7f3500107350 2023-10-16T13:05:29.022 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.588+0000 7f350530f700 1 --2- 172.21.15.92:0/2150386774 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f34ec038820 0x7f34ec03ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:29.023 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.589+0000 7f350530f700 1 --2- 172.21.15.92:0/2150386774 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f34ec038820 0x7f34ec03ace0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f34f0006fd0 tx=0x7f34f0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:29.023 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.593+0000 7f34f6ffd700 1 -- 172.21.15.92:0/2150386774 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f34fc053080 con 0x7f3500107350 2023-10-16T13:05:29.023 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:27.847+0000 7f3507d74700 1 -- 172.21.15.92:0/2150386774 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f34e40055d0 con 0x7f3500107350 2023-10-16T13:05:29.023 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:28.491+0000 7f34f6ffd700 1 -- 172.21.15.92:0/2150386774 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f34fc010970 con 0x7f3500107350 2023-10-16T13:05:29.023 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:28.493+0000 7f34f6ffd700 1 -- 172.21.15.92:0/2150386774 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mgrmap(e 9) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f34fc016d60 con 0x7f3500107350 2023-10-16T13:05:29.024 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:28.494+0000 7f3507d74700 1 -- 172.21.15.92:0/2150386774 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f34ec038820 msgr2=0x7f34ec03ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:29.024 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:28.494+0000 7f3507d74700 1 --2- 172.21.15.92:0/2150386774 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f34ec038820 0x7f34ec03ace0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f34f0006fd0 tx=0x7f34f0006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:29.024 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:28.494+0000 7f3507d74700 1 -- 172.21.15.92:0/2150386774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3500107350 msgr2=0x7f350019a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:29.024 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:28.494+0000 7f3507d74700 1 --2- 172.21.15.92:0/2150386774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3500107350 0x7f350019a510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34fc003f20 tx=0x7f34fc011b00 comp rx=0 tx=0).stop 2023-10-16T13:05:29.024 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:28.494+0000 7f3507d74700 1 -- 172.21.15.92:0/2150386774 shutdown_connections 2023-10-16T13:05:29.025 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:28.494+0000 7f3507d74700 1 --2- 172.21.15.92:0/2150386774 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f34ec038820 0x7f34ec03ace0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:29.025 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:28.494+0000 7f3507d74700 1 --2- 172.21.15.92:0/2150386774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3500107350 0x7f350019a510 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:29.025 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:28.494+0000 7f3507d74700 1 -- 172.21.15.92:0/2150386774 >> 172.21.15.92:0/2150386774 conn(0x7f3500100d80 msgr2=0x7f3500101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:29.025 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:28.494+0000 7f3507d74700 1 -- 172.21.15.92:0/2150386774 shutdown_connections 2023-10-16T13:05:29.025 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:28.494+0000 7f3507d74700 1 -- 172.21.15.92:0/2150386774 wait complete. 2023-10-16T13:05:29.246 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:28 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:28.940+0000 7f2a3c541200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T13:05:29.247 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:29 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:29.120+0000 7f2a3c541200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T13:05:29.641 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:29 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2150386774' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-10-16T13:05:29.642 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:29 smithi092 ceph-mon[99542]: mgrmap e9: x(active, since 17s) 2023-10-16T13:05:29.642 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:29 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:29.501+0000 7f2a3c541200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T13:05:29.932 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:29 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:29.638+0000 7f2a3c541200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T13:05:29.932 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:29 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:29.731+0000 7f2a3c541200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T13:05:29.933 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:29 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:29.827+0000 7f2a3c541200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T13:05:30.290 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2023-10-16T13:05:30.291 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-10-16T13:05:30.291 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-16T13:05:30.291 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-16T13:05:30.291 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-16T13:05:30.291 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2023-10-16T13:05:30.292 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.644+0000 7f075021a700 1 Processor -- start 2023-10-16T13:05:30.292 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.644+0000 7f075021a700 1 -- start start 2023-10-16T13:05:30.292 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.644+0000 7f075021a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0748107350 0x7f0748109740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:30.292 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.644+0000 7f075021a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07480747d0 con 0x7f0748107350 2023-10-16T13:05:30.293 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.645+0000 7f074dfb6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0748107350 0x7f0748109740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:30.293 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.645+0000 7f074dfb6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0748107350 0x7f0748109740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34108/0 (socket says 172.21.15.92:34108) 2023-10-16T13:05:30.293 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.645+0000 7f074dfb6700 1 -- 172.21.15.92:0/3466313321 learned_addr learned my addr 172.21.15.92:0/3466313321 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:30.293 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.645+0000 7f074dfb6700 1 -- 172.21.15.92:0/3466313321 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0748109c80 con 0x7f0748107350 2023-10-16T13:05:30.293 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.645+0000 7f074dfb6700 1 --2- 172.21.15.92:0/3466313321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0748107350 0x7f0748109740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f07440098a0 tx=0x7f0744009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c548eaa1573f281 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:30.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.645+0000 7f074cfb4700 1 -- 172.21.15.92:0/3466313321 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0744004160 con 0x7f0748107350 2023-10-16T13:05:30.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.645+0000 7f074cfb4700 1 -- 172.21.15.92:0/3466313321 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f07440042c0 con 0x7f0748107350 2023-10-16T13:05:30.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.645+0000 7f074cfb4700 1 -- 172.21.15.92:0/3466313321 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0744011a80 con 0x7f0748107350 2023-10-16T13:05:30.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.646+0000 7f075021a700 1 -- 172.21.15.92:0/3466313321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0748107350 msgr2=0x7f0748109740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:30.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.646+0000 7f075021a700 1 --2- 172.21.15.92:0/3466313321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0748107350 0x7f0748109740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f07440098a0 tx=0x7f0744009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:30.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.646+0000 7f075021a700 1 -- 172.21.15.92:0/3466313321 shutdown_connections 2023-10-16T13:05:30.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.646+0000 7f075021a700 1 --2- 172.21.15.92:0/3466313321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0748107350 0x7f0748109740 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:30.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.646+0000 7f075021a700 1 -- 172.21.15.92:0/3466313321 >> 172.21.15.92:0/3466313321 conn(0x7f0748100d80 msgr2=0x7f07481031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:30.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.646+0000 7f075021a700 1 -- 172.21.15.92:0/3466313321 shutdown_connections 2023-10-16T13:05:30.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.646+0000 7f075021a700 1 -- 172.21.15.92:0/3466313321 wait complete. 2023-10-16T13:05:30.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.647+0000 7f075021a700 1 Processor -- start 2023-10-16T13:05:30.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.647+0000 7f075021a700 1 -- start start 2023-10-16T13:05:30.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.647+0000 7f075021a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0748107350 0x7f074819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:30.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.647+0000 7f075021a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074819aa60 con 0x7f0748107350 2023-10-16T13:05:30.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.647+0000 7f074dfb6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0748107350 0x7f074819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:30.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.647+0000 7f074dfb6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0748107350 0x7f074819a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34110/0 (socket says 172.21.15.92:34110) 2023-10-16T13:05:30.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.647+0000 7f074dfb6700 1 -- 172.21.15.92:0/2239102133 learned_addr learned my addr 172.21.15.92:0/2239102133 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:30.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.647+0000 7f074dfb6700 1 -- 172.21.15.92:0/2239102133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0744009550 con 0x7f0748107350 2023-10-16T13:05:30.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.647+0000 7f074dfb6700 1 --2- 172.21.15.92:0/2239102133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0748107350 0x7f074819a520 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0744003f20 tx=0x7f0744011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:30.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.648+0000 7f073effd700 1 -- 172.21.15.92:0/2239102133 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0744003b20 con 0x7f0748107350 2023-10-16T13:05:30.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.648+0000 7f073effd700 1 -- 172.21.15.92:0/2239102133 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f074401a910 con 0x7f0748107350 2023-10-16T13:05:30.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.648+0000 7f075021a700 1 -- 172.21.15.92:0/2239102133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074819ac60 con 0x7f0748107350 2023-10-16T13:05:30.298 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.648+0000 7f073effd700 1 -- 172.21.15.92:0/2239102133 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0744024900 con 0x7f0748107350 2023-10-16T13:05:30.298 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.648+0000 7f075021a700 1 -- 172.21.15.92:0/2239102133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074819b100 con 0x7f0748107350 2023-10-16T13:05:30.298 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.649+0000 7f075021a700 1 -- 172.21.15.92:0/2239102133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074810aad0 con 0x7f0748107350 2023-10-16T13:05:30.298 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.649+0000 7f073effd700 1 -- 172.21.15.92:0/2239102133 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 9) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f0744024b70 con 0x7f0748107350 2023-10-16T13:05:30.299 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.649+0000 7f073effd700 1 --2- 172.21.15.92:0/2239102133 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f0734038820 0x7f073403ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:30.299 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.649+0000 7f073effd700 1 -- 172.21.15.92:0/2239102133 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f074404cab0 con 0x7f0748107350 2023-10-16T13:05:30.299 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.649+0000 7f074d7b5700 1 -- 172.21.15.92:0/2239102133 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f0734038820 msgr2=0x7f073403ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1487044137 2023-10-16T13:05:30.299 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.649+0000 7f074d7b5700 1 --2- 172.21.15.92:0/2239102133 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f0734038820 0x7f073403ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T13:05:30.299 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.653+0000 7f073effd700 1 -- 172.21.15.92:0/2239102133 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0744018530 con 0x7f0748107350 2023-10-16T13:05:30.299 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.850+0000 7f074d7b5700 1 -- 172.21.15.92:0/2239102133 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f0734038820 msgr2=0x7f073403ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1487044137 2023-10-16T13:05:30.300 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.850+0000 7f074d7b5700 1 --2- 172.21.15.92:0/2239102133 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f0734038820 0x7f073403ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T13:05:30.300 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.903+0000 7f075021a700 1 -- 172.21.15.92:0/2239102133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f074810ad40 con 0x7f0748107350 2023-10-16T13:05:30.300 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.903+0000 7f073effd700 1 -- 172.21.15.92:0/2239102133 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f0744018350 con 0x7f0748107350 2023-10-16T13:05:30.300 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.905+0000 7f075021a700 1 -- 172.21.15.92:0/2239102133 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f0734038820 msgr2=0x7f073403ace0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T13:05:30.300 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.905+0000 7f075021a700 1 --2- 172.21.15.92:0/2239102133 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f0734038820 0x7f073403ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:30.301 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.905+0000 7f075021a700 1 -- 172.21.15.92:0/2239102133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0748107350 msgr2=0x7f074819a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:30.301 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.905+0000 7f075021a700 1 --2- 172.21.15.92:0/2239102133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0748107350 0x7f074819a520 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0744003f20 tx=0x7f0744011a50 comp rx=0 tx=0).stop 2023-10-16T13:05:30.301 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.906+0000 7f075021a700 1 -- 172.21.15.92:0/2239102133 shutdown_connections 2023-10-16T13:05:30.301 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.906+0000 7f075021a700 1 --2- 172.21.15.92:0/2239102133 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f0734038820 0x7f073403ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:30.301 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.906+0000 7f075021a700 1 --2- 172.21.15.92:0/2239102133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0748107350 0x7f074819a520 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:30.302 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.906+0000 7f075021a700 1 -- 172.21.15.92:0/2239102133 >> 172.21.15.92:0/2239102133 conn(0x7f0748100d80 msgr2=0x7f0748101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:30.302 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.906+0000 7f075021a700 1 -- 172.21.15.92:0/2239102133 shutdown_connections 2023-10-16T13:05:30.302 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:29.906+0000 7f075021a700 1 -- 172.21.15.92:0/2239102133 wait complete. 2023-10-16T13:05:30.302 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for the mgr to restart... 2023-10-16T13:05:30.302 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr epoch 9... 2023-10-16T13:05:30.530 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:30 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2239102133' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-16T13:05:30.531 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:30 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:30.262+0000 7f2a3c541200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T13:05:31.246 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:30 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:30.944+0000 7f2a3c541200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T13:05:31.247 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:31 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:31.026+0000 7f2a3c541200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T13:05:32.061 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:31 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:31.792+0000 7f2a3c541200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T13:05:32.062 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:31 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:31.884+0000 7f2a3c541200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T13:05:32.342 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:32 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:32.059+0000 7f2a3c541200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T13:05:32.711 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:32 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:32.339+0000 7f2a3c541200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T13:05:32.711 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:32 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:32.562+0000 7f2a3c541200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T13:05:32.711 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:32 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:32.708+0000 7f2a3c541200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T13:05:33.247 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:32 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:32.971+0000 7f2a3c541200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T13:05:33.991 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:33 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:33.665+0000 7f2a3c541200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T13:05:33.992 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:33 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:33.795+0000 7f2a3c541200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T13:05:34.246 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:33 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:33.989+0000 7f2a3c541200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T13:05:34.247 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:34 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:34.102+0000 7f2a3c541200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T13:05:34.746 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:34 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:34.319+0000 7f2a3c541200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T13:05:35.496 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:05:35 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:05:35.172+0000 7f2a3c541200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T13:05:35.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:35 smithi092 ceph-mon[99542]: Active manager daemon x restarted 2023-10-16T13:05:35.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:35 smithi092 ceph-mon[99542]: Activating manager daemon x 2023-10-16T13:05:35.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:35 smithi092 ceph-mon[99542]: osdmap e3: 0 total, 0 up, 0 in 2023-10-16T13:05:35.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:35 smithi092 ceph-mon[99542]: mgrmap e10: x(active, starting, since 0.00374396s) 2023-10-16T13:05:35.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-16T13:05:35.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-16T13:05:35.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-16T13:05:35.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-16T13:05:35.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-16T13:05:35.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:35 smithi092 ceph-mon[99542]: Manager daemon x is now available 2023-10-16T13:05:35.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:05:35.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:05:36.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-16T13:05:36.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-16T13:05:36.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:36 smithi092 ceph-mon[99542]: mgrmap e11: x(active, since 1.00545s) 2023-10-16T13:05:36.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2023-10-16T13:05:36.676 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-10-16T13:05:36.676 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-16T13:05:36.677 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2023-10-16T13:05:36.677 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.856+0000 7f804ba7b700 1 Processor -- start 2023-10-16T13:05:36.677 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.856+0000 7f804ba7b700 1 -- start start 2023-10-16T13:05:36.677 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.856+0000 7f804ba7b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8044107380 0x7f8044109770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:36.677 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.856+0000 7f804ba7b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8044079e70 con 0x7f8044107380 2023-10-16T13:05:36.678 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.857+0000 7f8049817700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8044107380 0x7f8044109770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:36.678 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.857+0000 7f8049817700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8044107380 0x7f8044109770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34118/0 (socket says 172.21.15.92:34118) 2023-10-16T13:05:36.678 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.857+0000 7f8049817700 1 -- 172.21.15.92:0/1806604188 learned_addr learned my addr 172.21.15.92:0/1806604188 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:36.678 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.857+0000 7f8049817700 1 -- 172.21.15.92:0/1806604188 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8044109cb0 con 0x7f8044107380 2023-10-16T13:05:36.678 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.857+0000 7f8049817700 1 --2- 172.21.15.92:0/1806604188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8044107380 0x7f8044109770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80400098a0 tx=0x7f8040009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def6d560428d8497 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:36.679 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.857+0000 7f8048815700 1 -- 172.21.15.92:0/1806604188 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8040004160 con 0x7f8044107380 2023-10-16T13:05:36.679 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.857+0000 7f8048815700 1 -- 172.21.15.92:0/1806604188 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f80400042c0 con 0x7f8044107380 2023-10-16T13:05:36.679 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.857+0000 7f8048815700 1 -- 172.21.15.92:0/1806604188 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8040011a80 con 0x7f8044107380 2023-10-16T13:05:36.679 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.858+0000 7f804ba7b700 1 -- 172.21.15.92:0/1806604188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8044107380 msgr2=0x7f8044109770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:36.680 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.858+0000 7f804ba7b700 1 --2- 172.21.15.92:0/1806604188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8044107380 0x7f8044109770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80400098a0 tx=0x7f8040009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:36.680 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.858+0000 7f804ba7b700 1 -- 172.21.15.92:0/1806604188 shutdown_connections 2023-10-16T13:05:36.680 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.858+0000 7f804ba7b700 1 --2- 172.21.15.92:0/1806604188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8044107380 0x7f8044109770 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:36.680 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.858+0000 7f804ba7b700 1 -- 172.21.15.92:0/1806604188 >> 172.21.15.92:0/1806604188 conn(0x7f8044100d70 msgr2=0x7f80441031b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:36.680 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.858+0000 7f804ba7b700 1 -- 172.21.15.92:0/1806604188 shutdown_connections 2023-10-16T13:05:36.680 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.858+0000 7f804ba7b700 1 -- 172.21.15.92:0/1806604188 wait complete. 2023-10-16T13:05:36.681 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.859+0000 7f804ba7b700 1 Processor -- start 2023-10-16T13:05:36.681 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.859+0000 7f804ba7b700 1 -- start start 2023-10-16T13:05:36.681 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.859+0000 7f804ba7b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8044107380 0x7f804419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:36.681 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.859+0000 7f804ba7b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804419a9e0 con 0x7f8044107380 2023-10-16T13:05:36.681 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.859+0000 7f8049817700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8044107380 0x7f804419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:36.682 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.859+0000 7f8049817700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8044107380 0x7f804419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34120/0 (socket says 172.21.15.92:34120) 2023-10-16T13:05:36.682 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.859+0000 7f8049817700 1 -- 172.21.15.92:0/2236444754 learned_addr learned my addr 172.21.15.92:0/2236444754 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:36.682 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.859+0000 7f8049817700 1 -- 172.21.15.92:0/2236444754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8040009550 con 0x7f8044107380 2023-10-16T13:05:36.682 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.859+0000 7f8049817700 1 --2- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8044107380 0x7f804419a4a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8040006ba0 tx=0x7f8040011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:36.683 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.860+0000 7f803affd700 1 -- 172.21.15.92:0/2236444754 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80400039b0 con 0x7f8044107380 2023-10-16T13:05:36.683 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.860+0000 7f803affd700 1 -- 172.21.15.92:0/2236444754 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8040003b10 con 0x7f8044107380 2023-10-16T13:05:36.683 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.860+0000 7f803affd700 1 -- 172.21.15.92:0/2236444754 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8040019820 con 0x7f8044107380 2023-10-16T13:05:36.683 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.860+0000 7f804ba7b700 1 -- 172.21.15.92:0/2236444754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804419abe0 con 0x7f8044107380 2023-10-16T13:05:36.683 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.860+0000 7f804ba7b700 1 -- 172.21.15.92:0/2236444754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804419b080 con 0x7f8044107380 2023-10-16T13:05:36.684 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.860+0000 7f803affd700 1 -- 172.21.15.92:0/2236444754 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 9) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f8040019ae0 con 0x7f8044107380 2023-10-16T13:05:36.684 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.861+0000 7f803affd700 1 --2- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f8030038820 0x7f803003ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:36.684 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.861+0000 7f804ba7b700 1 -- 172.21.15.92:0/2236444754 --> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f804410aaf0 con 0x7f8030038820 2023-10-16T13:05:36.684 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.861+0000 7f803affd700 1 -- 172.21.15.92:0/2236444754 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f804004cab0 con 0x7f8044107380 2023-10-16T13:05:36.685 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.861+0000 7f8049016700 1 -- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f8030038820 msgr2=0x7f803003ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1487044137 2023-10-16T13:05:36.685 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:30.861+0000 7f8049016700 1 --2- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f8030038820 0x7f803003ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T13:05:36.685 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:31.062+0000 7f8049016700 1 -- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f8030038820 msgr2=0x7f803003ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1487044137 2023-10-16T13:05:36.685 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:31.062+0000 7f8049016700 1 --2- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f8030038820 0x7f803003ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T13:05:36.685 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:31.463+0000 7f8049016700 1 -- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f8030038820 msgr2=0x7f803003ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1487044137 2023-10-16T13:05:36.686 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:31.463+0000 7f8049016700 1 --2- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f8030038820 0x7f803003ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T13:05:36.686 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:32.264+0000 7f8049016700 1 -- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f8030038820 msgr2=0x7f803003ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1487044137 2023-10-16T13:05:36.686 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:32.264+0000 7f8049016700 1 --2- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f8030038820 0x7f803003ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T13:05:36.686 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:33.865+0000 7f8049016700 1 -- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f8030038820 msgr2=0x7f803003ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1487044137 2023-10-16T13:05:36.686 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:33.865+0000 7f8049016700 1 --2- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f8030038820 0x7f803003ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-16T13:05:36.687 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:35.187+0000 7f803affd700 1 -- 172.21.15.92:0/2236444754 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mgrmap(e 10) v1 ==== 45359+0+0 (secure 0 0 0) 0x7f804002dce0 con 0x7f8044107380 2023-10-16T13:05:36.687 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:35.187+0000 7f803affd700 1 -- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f8030038820 msgr2=0x7f803003ace0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T13:05:36.687 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:35.187+0000 7f803affd700 1 --2- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f8030038820 0x7f803003ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:36.687 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:36.188+0000 7f803affd700 1 -- 172.21.15.92:0/2236444754 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 11) v1 ==== 45486+0+0 (secure 0 0 0) 0x7f804004ec00 con 0x7f8044107380 2023-10-16T13:05:36.688 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:36.189+0000 7f803affd700 1 --2- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f803003bfd0 0x7f803003e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:36.688 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:36.189+0000 7f803affd700 1 -- 172.21.15.92:0/2236444754 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f804410aaf0 con 0x7f803003bfd0 2023-10-16T13:05:36.688 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:36.189+0000 7f8049016700 1 --2- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f803003bfd0 0x7f803003e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:36.688 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:36.190+0000 7f8049016700 1 --2- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f803003bfd0 0x7f803003e3c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8034003a10 tx=0x7f80340092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:36.688 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:36.190+0000 7f803affd700 1 -- 172.21.15.92:0/2236444754 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f804410aaf0 con 0x7f803003bfd0 2023-10-16T13:05:36.689 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:36.196+0000 7f804ba7b700 1 -- 172.21.15.92:0/2236444754 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f804419b7e0 con 0x7f803003bfd0 2023-10-16T13:05:36.689 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:36.197+0000 7f803affd700 1 -- 172.21.15.92:0/2236444754 <== mgr.14152 v2:172.21.15.92:6800/2605982588 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f804419b7e0 con 0x7f803003bfd0 2023-10-16T13:05:36.689 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:36.197+0000 7f804ba7b700 1 -- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f803003bfd0 msgr2=0x7f803003e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:36.689 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:36.197+0000 7f804ba7b700 1 --2- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f803003bfd0 0x7f803003e3c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8034003a10 tx=0x7f80340092b0 comp rx=0 tx=0).stop 2023-10-16T13:05:36.689 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:36.197+0000 7f804ba7b700 1 -- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8044107380 msgr2=0x7f804419a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:36.690 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:36.197+0000 7f804ba7b700 1 --2- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8044107380 0x7f804419a4a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8040006ba0 tx=0x7f8040011b00 comp rx=0 tx=0).stop 2023-10-16T13:05:36.690 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:36.197+0000 7f804ba7b700 1 -- 172.21.15.92:0/2236444754 shutdown_connections 2023-10-16T13:05:36.690 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:36.197+0000 7f804ba7b700 1 --2- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f803003bfd0 0x7f803003e3c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:36.690 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:36.197+0000 7f804ba7b700 1 --2- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8044107380 0x7f804419a4a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:36.690 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:36.197+0000 7f804ba7b700 1 --2- 172.21.15.92:0/2236444754 >> [v2:172.21.15.92:6800/1487044137,v1:172.21.15.92:6801/1487044137] conn(0x7f8030038820 0x7f803003ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:36.691 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:36.197+0000 7f804ba7b700 1 -- 172.21.15.92:0/2236444754 >> 172.21.15.92:0/2236444754 conn(0x7f8044100d70 msgr2=0x7f80441019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:36.691 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:36.197+0000 7f804ba7b700 1 -- 172.21.15.92:0/2236444754 shutdown_connections 2023-10-16T13:05:36.691 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:36.197+0000 7f804ba7b700 1 -- 172.21.15.92:0/2236444754 wait complete. 2023-10-16T13:05:36.691 INFO:teuthology.orchestra.run.smithi092.stdout:mgr epoch 9 is available 2023-10-16T13:05:36.692 INFO:teuthology.orchestra.run.smithi092.stdout:Generating a dashboard self-signed certificate... 2023-10-16T13:05:37.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:37 smithi092 ceph-mon[99542]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-16T13:05:37.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:37 smithi092 ceph-mon[99542]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-16T13:05:38.199 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-10-16T13:05:38.199 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.461+0000 7f6a77aa5700 1 Processor -- start 2023-10-16T13:05:38.199 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.461+0000 7f6a77aa5700 1 -- start start 2023-10-16T13:05:38.199 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.461+0000 7f6a77aa5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a70105160 0x7f6a70105580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:38.200 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.461+0000 7f6a77aa5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a70079e70 con 0x7f6a70105160 2023-10-16T13:05:38.200 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.462+0000 7f6a75841700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a70105160 0x7f6a70105580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:38.200 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.462+0000 7f6a75841700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a70105160 0x7f6a70105580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34168/0 (socket says 172.21.15.92:34168) 2023-10-16T13:05:38.200 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.462+0000 7f6a75841700 1 -- 172.21.15.92:0/2974605010 learned_addr learned my addr 172.21.15.92:0/2974605010 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:38.200 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.462+0000 7f6a75841700 1 -- 172.21.15.92:0/2974605010 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a70105ac0 con 0x7f6a70105160 2023-10-16T13:05:38.201 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.462+0000 7f6a75841700 1 --2- 172.21.15.92:0/2974605010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a70105160 0x7f6a70105580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0098a0 tx=0x7f6a6c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9debf72365dba72 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:38.201 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.462+0000 7f6a7483f700 1 -- 172.21.15.92:0/2974605010 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a6c004160 con 0x7f6a70105160 2023-10-16T13:05:38.201 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.462+0000 7f6a7483f700 1 -- 172.21.15.92:0/2974605010 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6a6c0042c0 con 0x7f6a70105160 2023-10-16T13:05:38.201 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.462+0000 7f6a7483f700 1 -- 172.21.15.92:0/2974605010 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a6c011a80 con 0x7f6a70105160 2023-10-16T13:05:38.201 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.463+0000 7f6a77aa5700 1 -- 172.21.15.92:0/2974605010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a70105160 msgr2=0x7f6a70105580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:38.202 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.463+0000 7f6a77aa5700 1 --2- 172.21.15.92:0/2974605010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a70105160 0x7f6a70105580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0098a0 tx=0x7f6a6c009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:38.202 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.463+0000 7f6a77aa5700 1 -- 172.21.15.92:0/2974605010 shutdown_connections 2023-10-16T13:05:38.202 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.463+0000 7f6a77aa5700 1 --2- 172.21.15.92:0/2974605010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a70105160 0x7f6a70105580 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:38.202 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.463+0000 7f6a77aa5700 1 -- 172.21.15.92:0/2974605010 >> 172.21.15.92:0/2974605010 conn(0x7f6a70100d40 msgr2=0x7f6a701031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:38.202 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.463+0000 7f6a77aa5700 1 -- 172.21.15.92:0/2974605010 shutdown_connections 2023-10-16T13:05:38.203 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.463+0000 7f6a77aa5700 1 -- 172.21.15.92:0/2974605010 wait complete. 2023-10-16T13:05:38.203 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.464+0000 7f6a77aa5700 1 Processor -- start 2023-10-16T13:05:38.203 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.464+0000 7f6a77aa5700 1 -- start start 2023-10-16T13:05:38.203 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.464+0000 7f6a77aa5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a70105160 0x7f6a7019c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:38.203 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.464+0000 7f6a77aa5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7019cd10 con 0x7f6a70105160 2023-10-16T13:05:38.203 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.464+0000 7f6a75841700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a70105160 0x7f6a7019c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:38.204 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.464+0000 7f6a75841700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a70105160 0x7f6a7019c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34170/0 (socket says 172.21.15.92:34170) 2023-10-16T13:05:38.204 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.464+0000 7f6a75841700 1 -- 172.21.15.92:0/3162812622 learned_addr learned my addr 172.21.15.92:0/3162812622 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:38.204 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.465+0000 7f6a75841700 1 -- 172.21.15.92:0/3162812622 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c009550 con 0x7f6a70105160 2023-10-16T13:05:38.204 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.465+0000 7f6a75841700 1 --2- 172.21.15.92:0/3162812622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a70105160 0x7f6a7019c7d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c003f20 tx=0x7f6a6c011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:38.204 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.465+0000 7f6a66ffd700 1 -- 172.21.15.92:0/3162812622 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a6c003b20 con 0x7f6a70105160 2023-10-16T13:05:38.205 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.465+0000 7f6a66ffd700 1 -- 172.21.15.92:0/3162812622 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6a6c01a910 con 0x7f6a70105160 2023-10-16T13:05:38.205 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.465+0000 7f6a77aa5700 1 -- 172.21.15.92:0/3162812622 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7019cf10 con 0x7f6a70105160 2023-10-16T13:05:38.205 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.465+0000 7f6a66ffd700 1 -- 172.21.15.92:0/3162812622 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a6c024900 con 0x7f6a70105160 2023-10-16T13:05:38.205 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.465+0000 7f6a77aa5700 1 -- 172.21.15.92:0/3162812622 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7019dba0 con 0x7f6a70105160 2023-10-16T13:05:38.205 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.466+0000 7f6a66ffd700 1 -- 172.21.15.92:0/3162812622 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 12) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f6a6c024b70 con 0x7f6a70105160 2023-10-16T13:05:38.206 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.466+0000 7f6a77aa5700 1 -- 172.21.15.92:0/3162812622 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7019d3b0 con 0x7f6a70105160 2023-10-16T13:05:38.206 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.466+0000 7f6a66ffd700 1 --2- 172.21.15.92:0/3162812622 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6a5c038820 0x7f6a5c03ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:38.206 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.466+0000 7f6a66ffd700 1 -- 172.21.15.92:0/3162812622 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6a6c04cb90 con 0x7f6a70105160 2023-10-16T13:05:38.206 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.467+0000 7f6a75040700 1 --2- 172.21.15.92:0/3162812622 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6a5c038820 0x7f6a5c03ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:38.206 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.467+0000 7f6a75040700 1 --2- 172.21.15.92:0/3162812622 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6a5c038820 0x7f6a5c03ace0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6a60006fd0 tx=0x7f6a60006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:38.207 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.471+0000 7f6a66ffd700 1 -- 172.21.15.92:0/3162812622 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6a7019d3b0 con 0x7f6a70105160 2023-10-16T13:05:38.207 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.685+0000 7f6a77aa5700 1 -- 172.21.15.92:0/3162812622 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a7019d3b0 con 0x7f6a5c038820 2023-10-16T13:05:38.207 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.810+0000 7f6a66ffd700 1 -- 172.21.15.92:0/3162812622 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f6a7019d3b0 con 0x7f6a5c038820 2023-10-16T13:05:38.207 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.813+0000 7f6a77aa5700 1 -- 172.21.15.92:0/3162812622 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6a5c038820 msgr2=0x7f6a5c03ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:38.207 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.813+0000 7f6a77aa5700 1 --2- 172.21.15.92:0/3162812622 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6a5c038820 0x7f6a5c03ace0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6a60006fd0 tx=0x7f6a60006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:38.208 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.813+0000 7f6a77aa5700 1 -- 172.21.15.92:0/3162812622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a70105160 msgr2=0x7f6a7019c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:38.208 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.813+0000 7f6a77aa5700 1 --2- 172.21.15.92:0/3162812622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a70105160 0x7f6a7019c7d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c003f20 tx=0x7f6a6c011a50 comp rx=0 tx=0).stop 2023-10-16T13:05:38.208 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.813+0000 7f6a77aa5700 1 -- 172.21.15.92:0/3162812622 shutdown_connections 2023-10-16T13:05:38.208 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.813+0000 7f6a77aa5700 1 --2- 172.21.15.92:0/3162812622 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6a5c038820 0x7f6a5c03ace0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:38.208 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.813+0000 7f6a77aa5700 1 --2- 172.21.15.92:0/3162812622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a70105160 0x7f6a7019c7d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:38.208 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.813+0000 7f6a77aa5700 1 -- 172.21.15.92:0/3162812622 >> 172.21.15.92:0/3162812622 conn(0x7f6a70100d40 msgr2=0x7f6a70190d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:38.209 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.813+0000 7f6a77aa5700 1 -- 172.21.15.92:0/3162812622 shutdown_connections 2023-10-16T13:05:38.209 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:37.813+0000 7f6a77aa5700 1 -- 172.21.15.92:0/3162812622 wait complete. 2023-10-16T13:05:38.209 INFO:teuthology.orchestra.run.smithi092.stdout:Creating initial admin user... 2023-10-16T13:05:38.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:38 smithi092 ceph-mon[99542]: mgrmap e12: x(active, since 2s) 2023-10-16T13:05:38.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:38 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:05:38.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:38 smithi092 ceph-mon[99542]: [16/Oct/2023:13:05:37] ENGINE Bus STARTING 2023-10-16T13:05:38.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:38 smithi092 ceph-mon[99542]: [16/Oct/2023:13:05:37] ENGINE Serving on http://172.21.15.92:8765 2023-10-16T13:05:38.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:38 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:05:38.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:38 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:05:39.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:39 smithi092 ceph-mon[99542]: [16/Oct/2023:13:05:37] ENGINE Serving on https://172.21.15.92:7150 2023-10-16T13:05:39.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:39 smithi092 ceph-mon[99542]: [16/Oct/2023:13:05:37] ENGINE Bus STARTED 2023-10-16T13:05:39.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:39 smithi092 ceph-mon[99542]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:05:39.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:39 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:05:39.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:39 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:05:39.746 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$p6I5Vehz.jSHT5ek010VB.MD8LNs2qlEe/C9JQGTnUUjxAToqscj.", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1697461539, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-10-16T13:05:39.746 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.650+0000 7f0678256700 1 Processor -- start 2023-10-16T13:05:39.747 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.650+0000 7f0678256700 1 -- start start 2023-10-16T13:05:39.747 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.650+0000 7f0678256700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f067007bec0 0x7f067007a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:39.747 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.650+0000 7f0678256700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067007a8f0 con 0x7f067007bec0 2023-10-16T13:05:39.747 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.650+0000 7f0675ff2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f067007bec0 0x7f067007a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:39.747 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.650+0000 7f0675ff2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f067007bec0 0x7f067007a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34180/0 (socket says 172.21.15.92:34180) 2023-10-16T13:05:39.748 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.650+0000 7f0675ff2700 1 -- 172.21.15.92:0/2740501646 learned_addr learned my addr 172.21.15.92:0/2740501646 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:39.748 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.651+0000 7f0675ff2700 1 -- 172.21.15.92:0/2740501646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f067007aa30 con 0x7f067007bec0 2023-10-16T13:05:39.748 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.651+0000 7f0675ff2700 1 --2- 172.21.15.92:0/2740501646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f067007bec0 0x7f067007a320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f066c0098a0 tx=0x7f066c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c98475070839039 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:39.748 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.651+0000 7f0674ff0700 1 -- 172.21.15.92:0/2740501646 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f066c004160 con 0x7f067007bec0 2023-10-16T13:05:39.748 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.651+0000 7f0674ff0700 1 -- 172.21.15.92:0/2740501646 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f066c0042c0 con 0x7f067007bec0 2023-10-16T13:05:39.749 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.651+0000 7f0674ff0700 1 -- 172.21.15.92:0/2740501646 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f066c011a80 con 0x7f067007bec0 2023-10-16T13:05:39.749 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.652+0000 7f0678256700 1 -- 172.21.15.92:0/2740501646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f067007bec0 msgr2=0x7f067007a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:39.749 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.652+0000 7f0678256700 1 --2- 172.21.15.92:0/2740501646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f067007bec0 0x7f067007a320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f066c0098a0 tx=0x7f066c009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:39.749 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.652+0000 7f0678256700 1 -- 172.21.15.92:0/2740501646 shutdown_connections 2023-10-16T13:05:39.749 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.652+0000 7f0678256700 1 --2- 172.21.15.92:0/2740501646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f067007bec0 0x7f067007a320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:39.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.652+0000 7f0678256700 1 -- 172.21.15.92:0/2740501646 >> 172.21.15.92:0/2740501646 conn(0x7f0670101e90 msgr2=0x7f06701042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:39.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.652+0000 7f0678256700 1 -- 172.21.15.92:0/2740501646 shutdown_connections 2023-10-16T13:05:39.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.652+0000 7f0678256700 1 -- 172.21.15.92:0/2740501646 wait complete. 2023-10-16T13:05:39.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.652+0000 7f0678256700 1 Processor -- start 2023-10-16T13:05:39.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.652+0000 7f0678256700 1 -- start start 2023-10-16T13:05:39.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.653+0000 7f0678256700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f067007bec0 0x7f067019c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:39.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.653+0000 7f0678256700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067019cc50 con 0x7f067007bec0 2023-10-16T13:05:39.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.653+0000 7f0675ff2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f067007bec0 0x7f067019c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:39.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.653+0000 7f0675ff2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f067007bec0 0x7f067019c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34182/0 (socket says 172.21.15.92:34182) 2023-10-16T13:05:39.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.653+0000 7f0675ff2700 1 -- 172.21.15.92:0/1338686304 learned_addr learned my addr 172.21.15.92:0/1338686304 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:39.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.653+0000 7f0675ff2700 1 -- 172.21.15.92:0/1338686304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c009550 con 0x7f067007bec0 2023-10-16T13:05:39.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.653+0000 7f0675ff2700 1 --2- 172.21.15.92:0/1338686304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f067007bec0 0x7f067019c710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f066c003f20 tx=0x7f066c011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:39.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.653+0000 7f0666ffd700 1 -- 172.21.15.92:0/1338686304 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f066c003b20 con 0x7f067007bec0 2023-10-16T13:05:39.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.653+0000 7f0666ffd700 1 -- 172.21.15.92:0/1338686304 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f066c01a910 con 0x7f067007bec0 2023-10-16T13:05:39.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.653+0000 7f0678256700 1 -- 172.21.15.92:0/1338686304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f067019ce50 con 0x7f067007bec0 2023-10-16T13:05:39.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.653+0000 7f0666ffd700 1 -- 172.21.15.92:0/1338686304 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f066c024850 con 0x7f067007bec0 2023-10-16T13:05:39.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.653+0000 7f0678256700 1 -- 172.21.15.92:0/1338686304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067019d2f0 con 0x7f067007bec0 2023-10-16T13:05:39.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.654+0000 7f0678256700 1 -- 172.21.15.92:0/1338686304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f067010cd10 con 0x7f067007bec0 2023-10-16T13:05:39.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.655+0000 7f0666ffd700 1 -- 172.21.15.92:0/1338686304 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 12) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f066c01aa80 con 0x7f067007bec0 2023-10-16T13:05:39.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.655+0000 7f0666ffd700 1 --2- 172.21.15.92:0/1338686304 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f065c0388c0 0x7f065c03ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:39.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.655+0000 7f0666ffd700 1 -- 172.21.15.92:0/1338686304 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f066c04cff0 con 0x7f067007bec0 2023-10-16T13:05:39.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.655+0000 7f06757f1700 1 --2- 172.21.15.92:0/1338686304 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f065c0388c0 0x7f065c03ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:39.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.655+0000 7f06757f1700 1 --2- 172.21.15.92:0/1338686304 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f065c0388c0 0x7f065c03ad80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0660006fd0 tx=0x7f0660006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:39.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.660+0000 7f0666ffd700 1 -- 172.21.15.92:0/1338686304 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f066c01ae10 con 0x7f067007bec0 2023-10-16T13:05:39.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:38.873+0000 7f0678256700 1 -- 172.21.15.92:0/1338686304 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f0670062300 con 0x7f065c0388c0 2023-10-16T13:05:39.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:39.096+0000 7f0666ffd700 1 -- 172.21.15.92:0/1338686304 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f0670062300 con 0x7f065c0388c0 2023-10-16T13:05:39.755 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:39.098+0000 7f0678256700 1 -- 172.21.15.92:0/1338686304 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f065c0388c0 msgr2=0x7f065c03ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:39.755 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:39.098+0000 7f0678256700 1 --2- 172.21.15.92:0/1338686304 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f065c0388c0 0x7f065c03ad80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0660006fd0 tx=0x7f0660006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:39.755 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:39.098+0000 7f0678256700 1 -- 172.21.15.92:0/1338686304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f067007bec0 msgr2=0x7f067019c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:39.755 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:39.098+0000 7f0678256700 1 --2- 172.21.15.92:0/1338686304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f067007bec0 0x7f067019c710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f066c003f20 tx=0x7f066c011b00 comp rx=0 tx=0).stop 2023-10-16T13:05:39.755 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:39.098+0000 7f0678256700 1 -- 172.21.15.92:0/1338686304 shutdown_connections 2023-10-16T13:05:39.756 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:39.098+0000 7f0678256700 1 --2- 172.21.15.92:0/1338686304 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f065c0388c0 0x7f065c03ad80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:39.756 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:39.098+0000 7f0678256700 1 --2- 172.21.15.92:0/1338686304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f067007bec0 0x7f067019c710 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:39.756 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:39.098+0000 7f0678256700 1 -- 172.21.15.92:0/1338686304 >> 172.21.15.92:0/1338686304 conn(0x7f0670101e90 msgr2=0x7f0670102bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:39.756 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:39.098+0000 7f0678256700 1 -- 172.21.15.92:0/1338686304 shutdown_connections 2023-10-16T13:05:39.756 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:39.098+0000 7f0678256700 1 -- 172.21.15.92:0/1338686304 wait complete. 2023-10-16T13:05:39.757 INFO:teuthology.orchestra.run.smithi092.stdout:Fetching dashboard port number... 2023-10-16T13:05:40.666 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:40 smithi092 ceph-mon[99542]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:05:41.101 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 8443 2023-10-16T13:05:41.101 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.427+0000 7f002540c700 1 Processor -- start 2023-10-16T13:05:41.101 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.427+0000 7f002540c700 1 -- start start 2023-10-16T13:05:41.102 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.427+0000 7f002540c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0020105cd0 0x7f00201060f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:41.102 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.427+0000 7f002540c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00201066c0 con 0x7f0020105cd0 2023-10-16T13:05:41.102 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.427+0000 7f001effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0020105cd0 0x7f00201060f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:41.102 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.427+0000 7f001effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0020105cd0 0x7f00201060f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34186/0 (socket says 172.21.15.92:34186) 2023-10-16T13:05:41.102 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.427+0000 7f001effd700 1 -- 172.21.15.92:0/3850849759 learned_addr learned my addr 172.21.15.92:0/3850849759 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:41.103 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.428+0000 7f001effd700 1 -- 172.21.15.92:0/3850849759 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00201069f0 con 0x7f0020105cd0 2023-10-16T13:05:41.103 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.428+0000 7f001effd700 1 --2- 172.21.15.92:0/3850849759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0020105cd0 0x7f00201060f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f00100098a0 tx=0x7f0010009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ab2eccc670e4c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:41.103 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.428+0000 7f001e7fc700 1 -- 172.21.15.92:0/3850849759 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0010004160 con 0x7f0020105cd0 2023-10-16T13:05:41.103 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.428+0000 7f001e7fc700 1 -- 172.21.15.92:0/3850849759 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f00100042c0 con 0x7f0020105cd0 2023-10-16T13:05:41.104 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.428+0000 7f001e7fc700 1 -- 172.21.15.92:0/3850849759 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0010011a80 con 0x7f0020105cd0 2023-10-16T13:05:41.104 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.429+0000 7f002540c700 1 -- 172.21.15.92:0/3850849759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0020105cd0 msgr2=0x7f00201060f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:41.104 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.429+0000 7f002540c700 1 --2- 172.21.15.92:0/3850849759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0020105cd0 0x7f00201060f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f00100098a0 tx=0x7f0010009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:41.104 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.429+0000 7f002540c700 1 -- 172.21.15.92:0/3850849759 shutdown_connections 2023-10-16T13:05:41.104 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.429+0000 7f002540c700 1 --2- 172.21.15.92:0/3850849759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0020105cd0 0x7f00201060f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:41.104 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.429+0000 7f002540c700 1 -- 172.21.15.92:0/3850849759 >> 172.21.15.92:0/3850849759 conn(0x7f00201004f0 msgr2=0x7f0020102930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:41.105 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.429+0000 7f002540c700 1 -- 172.21.15.92:0/3850849759 shutdown_connections 2023-10-16T13:05:41.105 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.429+0000 7f002540c700 1 -- 172.21.15.92:0/3850849759 wait complete. 2023-10-16T13:05:41.105 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.430+0000 7f002540c700 1 Processor -- start 2023-10-16T13:05:41.105 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.430+0000 7f002540c700 1 -- start start 2023-10-16T13:05:41.105 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.430+0000 7f002540c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0020105cd0 0x7f00201053b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:41.106 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.430+0000 7f002540c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002019d1b0 con 0x7f0020105cd0 2023-10-16T13:05:41.106 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.430+0000 7f001effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0020105cd0 0x7f00201053b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:41.106 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.430+0000 7f001effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0020105cd0 0x7f00201053b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34188/0 (socket says 172.21.15.92:34188) 2023-10-16T13:05:41.106 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.430+0000 7f001effd700 1 -- 172.21.15.92:0/3831488573 learned_addr learned my addr 172.21.15.92:0/3831488573 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:41.106 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.430+0000 7f001effd700 1 -- 172.21.15.92:0/3831488573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0010009550 con 0x7f0020105cd0 2023-10-16T13:05:41.107 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.430+0000 7f001effd700 1 --2- 172.21.15.92:0/3831488573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0020105cd0 0x7f00201053b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0010006ba0 tx=0x7f0010011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:41.107 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.431+0000 7f001cff9700 1 -- 172.21.15.92:0/3831488573 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00100039b0 con 0x7f0020105cd0 2023-10-16T13:05:41.107 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.431+0000 7f001cff9700 1 -- 172.21.15.92:0/3831488573 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0010003b10 con 0x7f0020105cd0 2023-10-16T13:05:41.107 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.431+0000 7f001cff9700 1 -- 172.21.15.92:0/3831488573 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0010019820 con 0x7f0020105cd0 2023-10-16T13:05:41.107 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.431+0000 7f002540c700 1 -- 172.21.15.92:0/3831488573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f002019d2f0 con 0x7f0020105cd0 2023-10-16T13:05:41.108 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.431+0000 7f002540c700 1 -- 172.21.15.92:0/3831488573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f002019d790 con 0x7f0020105cd0 2023-10-16T13:05:41.108 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.431+0000 7f001cff9700 1 -- 172.21.15.92:0/3831488573 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 12) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f0010019a90 con 0x7f0020105cd0 2023-10-16T13:05:41.108 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.432+0000 7f001cff9700 1 --2- 172.21.15.92:0/3831488573 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f000c038870 0x7f000c03ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:41.108 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.432+0000 7f001cff9700 1 -- 172.21.15.92:0/3831488573 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f001004cf10 con 0x7f0020105cd0 2023-10-16T13:05:41.108 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.432+0000 7f0017fff700 1 --2- 172.21.15.92:0/3831488573 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f000c038870 0x7f000c03ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:41.109 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.432+0000 7f002540c700 1 -- 172.21.15.92:0/3831488573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0020109be0 con 0x7f0020105cd0 2023-10-16T13:05:41.109 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.432+0000 7f0017fff700 1 --2- 172.21.15.92:0/3831488573 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f000c038870 0x7f000c03ad30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0008006fd0 tx=0x7f0008006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:41.109 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.437+0000 7f001cff9700 1 -- 172.21.15.92:0/3831488573 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f001002c3a0 con 0x7f0020105cd0 2023-10-16T13:05:41.109 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.628+0000 7f002540c700 1 -- 172.21.15.92:0/3831488573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f0020109dd0 con 0x7f0020105cd0 2023-10-16T13:05:41.109 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.628+0000 7f001cff9700 1 -- 172.21.15.92:0/3831488573 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f00100350b0 con 0x7f0020105cd0 2023-10-16T13:05:41.110 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.630+0000 7f002540c700 1 -- 172.21.15.92:0/3831488573 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f000c038870 msgr2=0x7f000c03ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:41.110 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.630+0000 7f002540c700 1 --2- 172.21.15.92:0/3831488573 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f000c038870 0x7f000c03ad30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0008006fd0 tx=0x7f0008006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:41.110 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.630+0000 7f002540c700 1 -- 172.21.15.92:0/3831488573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0020105cd0 msgr2=0x7f00201053b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:41.110 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.630+0000 7f002540c700 1 --2- 172.21.15.92:0/3831488573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0020105cd0 0x7f00201053b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0010006ba0 tx=0x7f0010011b00 comp rx=0 tx=0).stop 2023-10-16T13:05:41.110 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.630+0000 7f002540c700 1 -- 172.21.15.92:0/3831488573 shutdown_connections 2023-10-16T13:05:41.111 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.630+0000 7f002540c700 1 --2- 172.21.15.92:0/3831488573 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f000c038870 0x7f000c03ad30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:41.111 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.630+0000 7f002540c700 1 --2- 172.21.15.92:0/3831488573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0020105cd0 0x7f00201053b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:41.111 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.630+0000 7f002540c700 1 -- 172.21.15.92:0/3831488573 >> 172.21.15.92:0/3831488573 conn(0x7f00201004f0 msgr2=0x7f00201011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:41.111 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.630+0000 7f002540c700 1 -- 172.21.15.92:0/3831488573 shutdown_connections 2023-10-16T13:05:41.111 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:40.630+0000 7f002540c700 1 -- 172.21.15.92:0/3831488573 wait complete. 2023-10-16T13:05:41.112 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-16T13:05:41.112 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2023-10-16T13:05:41.115 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-16T13:05:41.115 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2023-10-16T13:05:41.116 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2023-10-16T13:05:41.116 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-10-16T13:05:41.117 INFO:teuthology.orchestra.run.smithi092.stdout:Ceph Dashboard is now available at: 2023-10-16T13:05:41.117 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:05:41.117 INFO:teuthology.orchestra.run.smithi092.stdout: URL: https://smithi092.front.sepia.ceph.com:8443/ 2023-10-16T13:05:41.117 INFO:teuthology.orchestra.run.smithi092.stdout: User: admin 2023-10-16T13:05:41.118 INFO:teuthology.orchestra.run.smithi092.stdout: Password: vbg5gn8xc7 2023-10-16T13:05:41.118 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:05:41.118 INFO:teuthology.orchestra.run.smithi092.stdout:Saving cluster configuration to /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config directory 2023-10-16T13:05:41.119 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling autotune for osd_memory_target 2023-10-16T13:05:41.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:41 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3831488573' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-10-16T13:05:42.464 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.649+0000 7ff35f960700 1 Processor -- start 2023-10-16T13:05:42.465 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.649+0000 7ff35f960700 1 -- start start 2023-10-16T13:05:42.465 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.649+0000 7ff35f960700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff358107380 0x7ff358109770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:42.465 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.650+0000 7ff35f960700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff358079e70 con 0x7ff358107380 2023-10-16T13:05:42.465 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.650+0000 7ff35d6fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff358107380 0x7ff358109770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:42.466 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.650+0000 7ff35d6fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff358107380 0x7ff358109770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34196/0 (socket says 172.21.15.92:34196) 2023-10-16T13:05:42.466 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.650+0000 7ff35d6fc700 1 -- 172.21.15.92:0/2221996414 learned_addr learned my addr 172.21.15.92:0/2221996414 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:42.466 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.650+0000 7ff35d6fc700 1 -- 172.21.15.92:0/2221996414 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff358109cb0 con 0x7ff358107380 2023-10-16T13:05:42.466 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.650+0000 7ff35d6fc700 1 --2- 172.21.15.92:0/2221996414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff358107380 0x7ff358109770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff3480098a0 tx=0x7ff348009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d321d34a56e99c18 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:42.466 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.650+0000 7ff34ffff700 1 -- 172.21.15.92:0/2221996414 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff348004160 con 0x7ff358107380 2023-10-16T13:05:42.467 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.650+0000 7ff34ffff700 1 -- 172.21.15.92:0/2221996414 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff3480042c0 con 0x7ff358107380 2023-10-16T13:05:42.467 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.650+0000 7ff34ffff700 1 -- 172.21.15.92:0/2221996414 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff348011a80 con 0x7ff358107380 2023-10-16T13:05:42.467 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.651+0000 7ff35f960700 1 -- 172.21.15.92:0/2221996414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff358107380 msgr2=0x7ff358109770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:42.467 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.651+0000 7ff35f960700 1 --2- 172.21.15.92:0/2221996414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff358107380 0x7ff358109770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff3480098a0 tx=0x7ff348009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:42.467 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.651+0000 7ff35f960700 1 -- 172.21.15.92:0/2221996414 shutdown_connections 2023-10-16T13:05:42.468 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.651+0000 7ff35f960700 1 --2- 172.21.15.92:0/2221996414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff358107380 0x7ff358109770 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:42.468 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.651+0000 7ff35f960700 1 -- 172.21.15.92:0/2221996414 >> 172.21.15.92:0/2221996414 conn(0x7ff358100d70 msgr2=0x7ff3581031b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:42.468 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.651+0000 7ff35f960700 1 -- 172.21.15.92:0/2221996414 shutdown_connections 2023-10-16T13:05:42.468 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.651+0000 7ff35f960700 1 -- 172.21.15.92:0/2221996414 wait complete. 2023-10-16T13:05:42.468 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.651+0000 7ff35f960700 1 Processor -- start 2023-10-16T13:05:42.468 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.652+0000 7ff35f960700 1 -- start start 2023-10-16T13:05:42.469 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.652+0000 7ff35f960700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff358107380 0x7ff35819c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:42.469 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.652+0000 7ff35f960700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35819cbe0 con 0x7ff358107380 2023-10-16T13:05:42.469 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.652+0000 7ff35d6fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff358107380 0x7ff35819c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:42.469 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.652+0000 7ff35d6fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff358107380 0x7ff35819c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34198/0 (socket says 172.21.15.92:34198) 2023-10-16T13:05:42.469 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.652+0000 7ff35d6fc700 1 -- 172.21.15.92:0/58929504 learned_addr learned my addr 172.21.15.92:0/58929504 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:42.470 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.652+0000 7ff35d6fc700 1 -- 172.21.15.92:0/58929504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff348009550 con 0x7ff358107380 2023-10-16T13:05:42.470 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.652+0000 7ff35d6fc700 1 --2- 172.21.15.92:0/58929504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff358107380 0x7ff35819c6a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff348006ba0 tx=0x7ff348011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:42.470 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.652+0000 7ff34e7fc700 1 -- 172.21.15.92:0/58929504 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3480039b0 con 0x7ff358107380 2023-10-16T13:05:42.470 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.652+0000 7ff35f960700 1 -- 172.21.15.92:0/58929504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35819cde0 con 0x7ff358107380 2023-10-16T13:05:42.471 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.652+0000 7ff34e7fc700 1 -- 172.21.15.92:0/58929504 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff348003b10 con 0x7ff358107380 2023-10-16T13:05:42.471 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.652+0000 7ff34e7fc700 1 -- 172.21.15.92:0/58929504 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff348019820 con 0x7ff358107380 2023-10-16T13:05:42.471 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.652+0000 7ff35f960700 1 -- 172.21.15.92:0/58929504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35819d280 con 0x7ff358107380 2023-10-16T13:05:42.471 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.653+0000 7ff34e7fc700 1 -- 172.21.15.92:0/58929504 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7ff348019ae0 con 0x7ff358107380 2023-10-16T13:05:42.472 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.653+0000 7ff34e7fc700 1 --2- 172.21.15.92:0/58929504 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff3440388c0 0x7ff34403ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:42.472 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.653+0000 7ff34e7fc700 1 -- 172.21.15.92:0/58929504 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff34804cd30 con 0x7ff358107380 2023-10-16T13:05:42.472 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.654+0000 7ff35cefb700 1 --2- 172.21.15.92:0/58929504 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff3440388c0 0x7ff34403ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:42.472 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.654+0000 7ff35f960700 1 -- 172.21.15.92:0/58929504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3580624e0 con 0x7ff358107380 2023-10-16T13:05:42.472 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.654+0000 7ff35cefb700 1 --2- 172.21.15.92:0/58929504 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff3440388c0 0x7ff34403ad80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff354006fd0 tx=0x7ff354006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:42.472 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.658+0000 7ff34e7fc700 1 -- 172.21.15.92:0/58929504 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff34802c3a0 con 0x7ff358107380 2023-10-16T13:05:42.473 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.845+0000 7ff35f960700 1 -- 172.21.15.92:0/58929504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7ff35810abe0 con 0x7ff358107380 2023-10-16T13:05:42.473 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.846+0000 7ff34e7fc700 1 -- 172.21.15.92:0/58929504 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7ff3480172b0 con 0x7ff358107380 2023-10-16T13:05:42.473 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.848+0000 7ff35f960700 1 -- 172.21.15.92:0/58929504 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff3440388c0 msgr2=0x7ff34403ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:42.473 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.848+0000 7ff35f960700 1 --2- 172.21.15.92:0/58929504 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff3440388c0 0x7ff34403ad80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff354006fd0 tx=0x7ff354006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:42.473 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.848+0000 7ff35f960700 1 -- 172.21.15.92:0/58929504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff358107380 msgr2=0x7ff35819c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:42.474 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.848+0000 7ff35f960700 1 --2- 172.21.15.92:0/58929504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff358107380 0x7ff35819c6a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff348006ba0 tx=0x7ff348011b00 comp rx=0 tx=0).stop 2023-10-16T13:05:42.474 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.848+0000 7ff35f960700 1 -- 172.21.15.92:0/58929504 shutdown_connections 2023-10-16T13:05:42.474 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.848+0000 7ff35f960700 1 --2- 172.21.15.92:0/58929504 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff3440388c0 0x7ff34403ad80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:42.474 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.848+0000 7ff35f960700 1 --2- 172.21.15.92:0/58929504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff358107380 0x7ff35819c6a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:42.474 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.848+0000 7ff35f960700 1 -- 172.21.15.92:0/58929504 >> 172.21.15.92:0/58929504 conn(0x7ff358100d70 msgr2=0x7ff3581019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:42.475 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.848+0000 7ff35f960700 1 -- 172.21.15.92:0/58929504 shutdown_connections 2023-10-16T13:05:42.475 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:41.848+0000 7ff35f960700 1 -- 172.21.15.92:0/58929504 wait complete. 2023-10-16T13:05:42.686 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:42 smithi092 ceph-mon[99542]: mgrmap e13: x(active, since 6s) 2023-10-16T13:05:43.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.935+0000 7f7d2b123700 1 Processor -- start 2023-10-16T13:05:43.715 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.935+0000 7f7d2b123700 1 -- start start 2023-10-16T13:05:43.715 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.935+0000 7f7d2b123700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d24107410 0x7f7d24109800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:43.715 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.935+0000 7f7d2b123700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d24074710 con 0x7f7d24107410 2023-10-16T13:05:43.715 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.936+0000 7f7d28ebf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d24107410 0x7f7d24109800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:43.716 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.936+0000 7f7d28ebf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d24107410 0x7f7d24109800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34202/0 (socket says 172.21.15.92:34202) 2023-10-16T13:05:43.716 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.936+0000 7f7d28ebf700 1 -- 172.21.15.92:0/4116350815 learned_addr learned my addr 172.21.15.92:0/4116350815 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:43.716 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.936+0000 7f7d28ebf700 1 -- 172.21.15.92:0/4116350815 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d24074850 con 0x7f7d24107410 2023-10-16T13:05:43.716 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.936+0000 7f7d28ebf700 1 --2- 172.21.15.92:0/4116350815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d24107410 0x7f7d24109800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7d180098a0 tx=0x7f7d18009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92583e0b75813bd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:43.716 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.936+0000 7f7d237fe700 1 -- 172.21.15.92:0/4116350815 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d18004160 con 0x7f7d24107410 2023-10-16T13:05:43.717 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.936+0000 7f7d237fe700 1 -- 172.21.15.92:0/4116350815 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7d180042c0 con 0x7f7d24107410 2023-10-16T13:05:43.717 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.936+0000 7f7d237fe700 1 -- 172.21.15.92:0/4116350815 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d18011a80 con 0x7f7d24107410 2023-10-16T13:05:43.717 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.937+0000 7f7d2b123700 1 -- 172.21.15.92:0/4116350815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d24107410 msgr2=0x7f7d24109800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:43.717 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.937+0000 7f7d2b123700 1 --2- 172.21.15.92:0/4116350815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d24107410 0x7f7d24109800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7d180098a0 tx=0x7f7d18009bb0 comp rx=0 tx=0).stop 2023-10-16T13:05:43.717 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.937+0000 7f7d2b123700 1 -- 172.21.15.92:0/4116350815 shutdown_connections 2023-10-16T13:05:43.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.937+0000 7f7d2b123700 1 --2- 172.21.15.92:0/4116350815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d24107410 0x7f7d24109800 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:43.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.937+0000 7f7d2b123700 1 -- 172.21.15.92:0/4116350815 >> 172.21.15.92:0/4116350815 conn(0x7f7d24100d80 msgr2=0x7f7d241031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:43.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.937+0000 7f7d2b123700 1 -- 172.21.15.92:0/4116350815 shutdown_connections 2023-10-16T13:05:43.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.937+0000 7f7d2b123700 1 -- 172.21.15.92:0/4116350815 wait complete. 2023-10-16T13:05:43.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.938+0000 7f7d2b123700 1 Processor -- start 2023-10-16T13:05:43.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.938+0000 7f7d2b123700 1 -- start start 2023-10-16T13:05:43.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.938+0000 7f7d2b123700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d24107410 0x7f7d24106d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:43.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.938+0000 7f7d2b123700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d241072b0 con 0x7f7d24107410 2023-10-16T13:05:43.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.938+0000 7f7d28ebf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d24107410 0x7f7d24106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:43.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.938+0000 7f7d28ebf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d24107410 0x7f7d24106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34204/0 (socket says 172.21.15.92:34204) 2023-10-16T13:05:43.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.938+0000 7f7d28ebf700 1 -- 172.21.15.92:0/3225053966 learned_addr learned my addr 172.21.15.92:0/3225053966 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:43.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.938+0000 7f7d28ebf700 1 -- 172.21.15.92:0/3225053966 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d18009550 con 0x7f7d24107410 2023-10-16T13:05:43.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.938+0000 7f7d28ebf700 1 --2- 172.21.15.92:0/3225053966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d24107410 0x7f7d24106d70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7d18003f20 tx=0x7f7d18011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:43.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.938+0000 7f7d21ffb700 1 -- 172.21.15.92:0/3225053966 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d18003b20 con 0x7f7d24107410 2023-10-16T13:05:43.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.938+0000 7f7d21ffb700 1 -- 172.21.15.92:0/3225053966 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7d1801a910 con 0x7f7d24107410 2023-10-16T13:05:43.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.938+0000 7f7d2b123700 1 -- 172.21.15.92:0/3225053966 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d241053c0 con 0x7f7d24107410 2023-10-16T13:05:43.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.938+0000 7f7d21ffb700 1 -- 172.21.15.92:0/3225053966 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d180248c0 con 0x7f7d24107410 2023-10-16T13:05:43.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.939+0000 7f7d2b123700 1 -- 172.21.15.92:0/3225053966 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d24105860 con 0x7f7d24107410 2023-10-16T13:05:43.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.939+0000 7f7d21ffb700 1 -- 172.21.15.92:0/3225053966 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f7d1802d3f0 con 0x7f7d24107410 2023-10-16T13:05:43.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.939+0000 7f7d2b123700 1 -- 172.21.15.92:0/3225053966 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d2410ab10 con 0x7f7d24107410 2023-10-16T13:05:43.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.940+0000 7f7d21ffb700 1 --2- 172.21.15.92:0/3225053966 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7d14038960 0x7f7d1403ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:43.722 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.940+0000 7f7d21ffb700 1 -- 172.21.15.92:0/3225053966 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7d1804ccd0 con 0x7f7d24107410 2023-10-16T13:05:43.722 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.940+0000 7f7d23fff700 1 --2- 172.21.15.92:0/3225053966 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7d14038960 0x7f7d1403ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:43.722 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.940+0000 7f7d23fff700 1 --2- 172.21.15.92:0/3225053966 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7d14038960 0x7f7d1403ae20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7d10006fd0 tx=0x7f7d10006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:43.722 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:42.944+0000 7f7d21ffb700 1 -- 172.21.15.92:0/3225053966 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7d18010c00 con 0x7f7d24107410 2023-10-16T13:05:43.722 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:43.241+0000 7f7d2b123700 1 -- 172.21.15.92:0/3225053966 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f7d2410ad50 con 0x7f7d24107410 2023-10-16T13:05:43.723 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:43.243+0000 7f7d21ffb700 1 -- 172.21.15.92:0/3225053966 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f7d180107f0 con 0x7f7d24107410 2023-10-16T13:05:43.723 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:43.246+0000 7f7d2b123700 1 -- 172.21.15.92:0/3225053966 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7d14038960 msgr2=0x7f7d1403ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:43.723 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:43.246+0000 7f7d2b123700 1 --2- 172.21.15.92:0/3225053966 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7d14038960 0x7f7d1403ae20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7d10006fd0 tx=0x7f7d10006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:43.723 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:43.246+0000 7f7d2b123700 1 -- 172.21.15.92:0/3225053966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d24107410 msgr2=0x7f7d24106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:43.723 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:43.246+0000 7f7d2b123700 1 --2- 172.21.15.92:0/3225053966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d24107410 0x7f7d24106d70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7d18003f20 tx=0x7f7d18011b00 comp rx=0 tx=0).stop 2023-10-16T13:05:43.724 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:43.246+0000 7f7d2b123700 1 -- 172.21.15.92:0/3225053966 shutdown_connections 2023-10-16T13:05:43.724 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:43.246+0000 7f7d2b123700 1 --2- 172.21.15.92:0/3225053966 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7d14038960 0x7f7d1403ae20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:43.724 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:43.246+0000 7f7d2b123700 1 --2- 172.21.15.92:0/3225053966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d24107410 0x7f7d24106d70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:43.724 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:43.246+0000 7f7d2b123700 1 -- 172.21.15.92:0/3225053966 >> 172.21.15.92:0/3225053966 conn(0x7f7d24100d80 msgr2=0x7f7d24101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:43.724 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:43.246+0000 7f7d2b123700 1 -- 172.21.15.92:0/3225053966 shutdown_connections 2023-10-16T13:05:43.724 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2023-10-16T13:05:43.246+0000 7f7d2b123700 1 -- 172.21.15.92:0/3225053966 wait complete. 2023-10-16T13:05:43.725 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-10-16T13:05:43.725 INFO:teuthology.orchestra.run.smithi092.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-10-16T13:05:43.725 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:05:43.725 INFO:teuthology.orchestra.run.smithi092.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-10-16T13:05:43.725 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:05:43.725 INFO:teuthology.orchestra.run.smithi092.stdout:Or, if you are only running a single cluster on this host: 2023-10-16T13:05:43.726 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:05:43.726 INFO:teuthology.orchestra.run.smithi092.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-10-16T13:05:43.726 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:05:43.726 INFO:teuthology.orchestra.run.smithi092.stdout:Please consider enabling telemetry to help improve Ceph: 2023-10-16T13:05:43.726 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:05:43.726 INFO:teuthology.orchestra.run.smithi092.stdout: ceph telemetry on 2023-10-16T13:05:43.727 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:05:43.727 INFO:teuthology.orchestra.run.smithi092.stdout:For more information see: 2023-10-16T13:05:43.727 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:05:43.727 INFO:teuthology.orchestra.run.smithi092.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-10-16T13:05:43.727 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:05:43.727 INFO:teuthology.orchestra.run.smithi092.stdout:Bootstrap complete. 2023-10-16T13:05:43.745 INFO:tasks.cephadm:Fetching config... 2023-10-16T13:05:43.746 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T13:05:43.746 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-10-16T13:05:43.763 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-10-16T13:05:43.763 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T13:05:43.764 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-10-16T13:05:43.821 INFO:tasks.cephadm:Fetching mon keyring... 2023-10-16T13:05:43.821 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T13:05:43.821 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/keyring of=/dev/stdout 2023-10-16T13:05:43.888 INFO:tasks.cephadm:Fetching pub ssh key... 2023-10-16T13:05:43.889 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T13:05:43.889 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-10-16T13:05:43.946 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-10-16T13:05:43.946 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJFlwkzIEqJ+q0dYk9AgUghryKolBLLzd5xSHUX1X6pMkBgTz+HFCdIkyemtwVl3pR76l0G/4/gjByqROPDKLCkBcHGoeerQ9PKD4dzeR5dJP1dWM/65gZMxo/C8zRmARt0iuOomg0FWRQuVJlBFe919eH3CkiizvV2pJLV4HuRtJXFiSjCW7/69LA5yDN5TscVnZHlnfR2kmEwm9QQy8S5wkVk/Rdyxei7fQIULotDKLauxKOyVCsn9XNeprwfNuv48BqsOcAD6ZFyL5N713chDhPWZpl6+KUQ1y2rByHgzJSyfb4xrOsYGPJVUEe7TeMwZJF7vAFaKQM+c+wFoBpJ7Jga9tDPtMox54lW6X/zlq3HiXPhzm7ynWC44RhBp3ideAugIZKyp74AGYp9C6oxfLrUX6GC9NwEtwy1z0OCkL6F0765KYjHWpEu4ZheBDnKv6HXHXc/kJq3VQ0JGSf7zfNmZkEqBHSyGBCKPALsWc7S/C5xlnRZc5/f/nnB/c= ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-16T13:05:44.033 INFO:teuthology.orchestra.run.smithi092.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJFlwkzIEqJ+q0dYk9AgUghryKolBLLzd5xSHUX1X6pMkBgTz+HFCdIkyemtwVl3pR76l0G/4/gjByqROPDKLCkBcHGoeerQ9PKD4dzeR5dJP1dWM/65gZMxo/C8zRmARt0iuOomg0FWRQuVJlBFe919eH3CkiizvV2pJLV4HuRtJXFiSjCW7/69LA5yDN5TscVnZHlnfR2kmEwm9QQy8S5wkVk/Rdyxei7fQIULotDKLauxKOyVCsn9XNeprwfNuv48BqsOcAD6ZFyL5N713chDhPWZpl6+KUQ1y2rByHgzJSyfb4xrOsYGPJVUEe7TeMwZJF7vAFaKQM+c+wFoBpJ7Jga9tDPtMox54lW6X/zlq3HiXPhzm7ynWC44RhBp3ideAugIZKyp74AGYp9C6oxfLrUX6GC9NwEtwy1z0OCkL6F0765KYjHWpEu4ZheBDnKv6HXHXc/kJq3VQ0JGSf7zfNmZkEqBHSyGBCKPALsWc7S/C5xlnRZc5/f/nnB/c= ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:05:44.045 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJFlwkzIEqJ+q0dYk9AgUghryKolBLLzd5xSHUX1X6pMkBgTz+HFCdIkyemtwVl3pR76l0G/4/gjByqROPDKLCkBcHGoeerQ9PKD4dzeR5dJP1dWM/65gZMxo/C8zRmARt0iuOomg0FWRQuVJlBFe919eH3CkiizvV2pJLV4HuRtJXFiSjCW7/69LA5yDN5TscVnZHlnfR2kmEwm9QQy8S5wkVk/Rdyxei7fQIULotDKLauxKOyVCsn9XNeprwfNuv48BqsOcAD6ZFyL5N713chDhPWZpl6+KUQ1y2rByHgzJSyfb4xrOsYGPJVUEe7TeMwZJF7vAFaKQM+c+wFoBpJ7Jga9tDPtMox54lW6X/zlq3HiXPhzm7ynWC44RhBp3ideAugIZKyp74AGYp9C6oxfLrUX6GC9NwEtwy1z0OCkL6F0765KYjHWpEu4ZheBDnKv6HXHXc/kJq3VQ0JGSf7zfNmZkEqBHSyGBCKPALsWc7S/C5xlnRZc5/f/nnB/c= ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-16T13:05:44.094 INFO:teuthology.orchestra.run.smithi118.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJFlwkzIEqJ+q0dYk9AgUghryKolBLLzd5xSHUX1X6pMkBgTz+HFCdIkyemtwVl3pR76l0G/4/gjByqROPDKLCkBcHGoeerQ9PKD4dzeR5dJP1dWM/65gZMxo/C8zRmARt0iuOomg0FWRQuVJlBFe919eH3CkiizvV2pJLV4HuRtJXFiSjCW7/69LA5yDN5TscVnZHlnfR2kmEwm9QQy8S5wkVk/Rdyxei7fQIULotDKLauxKOyVCsn9XNeprwfNuv48BqsOcAD6ZFyL5N713chDhPWZpl6+KUQ1y2rByHgzJSyfb4xrOsYGPJVUEe7TeMwZJF7vAFaKQM+c+wFoBpJ7Jga9tDPtMox54lW6X/zlq3HiXPhzm7ynWC44RhBp3ideAugIZKyp74AGYp9C6oxfLrUX6GC9NwEtwy1z0OCkL6F0765KYjHWpEu4ZheBDnKv6HXHXc/kJq3VQ0JGSf7zfNmZkEqBHSyGBCKPALsWc7S/C5xlnRZc5/f/nnB/c= ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:05:44.107 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJFlwkzIEqJ+q0dYk9AgUghryKolBLLzd5xSHUX1X6pMkBgTz+HFCdIkyemtwVl3pR76l0G/4/gjByqROPDKLCkBcHGoeerQ9PKD4dzeR5dJP1dWM/65gZMxo/C8zRmARt0iuOomg0FWRQuVJlBFe919eH3CkiizvV2pJLV4HuRtJXFiSjCW7/69LA5yDN5TscVnZHlnfR2kmEwm9QQy8S5wkVk/Rdyxei7fQIULotDKLauxKOyVCsn9XNeprwfNuv48BqsOcAD6ZFyL5N713chDhPWZpl6+KUQ1y2rByHgzJSyfb4xrOsYGPJVUEe7TeMwZJF7vAFaKQM+c+wFoBpJ7Jga9tDPtMox54lW6X/zlq3HiXPhzm7ynWC44RhBp3ideAugIZKyp74AGYp9C6oxfLrUX6GC9NwEtwy1z0OCkL6F0765KYjHWpEu4ZheBDnKv6HXHXc/kJq3VQ0JGSf7zfNmZkEqBHSyGBCKPALsWc7S/C5xlnRZc5/f/nnB/c= ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-16T13:05:44.155 INFO:teuthology.orchestra.run.smithi152.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJFlwkzIEqJ+q0dYk9AgUghryKolBLLzd5xSHUX1X6pMkBgTz+HFCdIkyemtwVl3pR76l0G/4/gjByqROPDKLCkBcHGoeerQ9PKD4dzeR5dJP1dWM/65gZMxo/C8zRmARt0iuOomg0FWRQuVJlBFe919eH3CkiizvV2pJLV4HuRtJXFiSjCW7/69LA5yDN5TscVnZHlnfR2kmEwm9QQy8S5wkVk/Rdyxei7fQIULotDKLauxKOyVCsn9XNeprwfNuv48BqsOcAD6ZFyL5N713chDhPWZpl6+KUQ1y2rByHgzJSyfb4xrOsYGPJVUEe7TeMwZJF7vAFaKQM+c+wFoBpJ7Jga9tDPtMox54lW6X/zlq3HiXPhzm7ynWC44RhBp3ideAugIZKyp74AGYp9C6oxfLrUX6GC9NwEtwy1z0OCkL6F0765KYjHWpEu4ZheBDnKv6HXHXc/kJq3VQ0JGSf7zfNmZkEqBHSyGBCKPALsWc7S/C5xlnRZc5/f/nnB/c= ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:05:44.168 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-10-16T13:05:44.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:44 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3225053966' entity='client.admin' 2023-10-16T13:05:44.730 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:05:46.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.618+0000 7f95f7130700 1 -- 172.21.15.92:0/199336943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95f0100fc0 msgr2=0x7f95f01013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:46.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.618+0000 7f95f7130700 1 --2- 172.21.15.92:0/199336943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95f0100fc0 0x7f95f01013e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009910 tx=0x7f95e4009c20 comp rx=0 tx=0).stop 2023-10-16T13:05:46.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.618+0000 7f95f7130700 1 -- 172.21.15.92:0/199336943 shutdown_connections 2023-10-16T13:05:46.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.618+0000 7f95f7130700 1 --2- 172.21.15.92:0/199336943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95f0100fc0 0x7f95f01013e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:46.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.618+0000 7f95f7130700 1 -- 172.21.15.92:0/199336943 >> 172.21.15.92:0/199336943 conn(0x7f95f00fae80 msgr2=0x7f95f00fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:46.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.618+0000 7f95f7130700 1 -- 172.21.15.92:0/199336943 shutdown_connections 2023-10-16T13:05:46.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.618+0000 7f95f7130700 1 -- 172.21.15.92:0/199336943 wait complete. 2023-10-16T13:05:46.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.619+0000 7f95f7130700 1 Processor -- start 2023-10-16T13:05:46.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.619+0000 7f95f7130700 1 -- start start 2023-10-16T13:05:46.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.619+0000 7f95f7130700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95f0100fc0 0x7f95f0194ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:46.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.619+0000 7f95f7130700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f01950e0 con 0x7f95f0100fc0 2023-10-16T13:05:46.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.619+0000 7f95f4ecc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95f0100fc0 0x7f95f0194ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:46.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.619+0000 7f95f4ecc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95f0100fc0 0x7f95f0194ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34210/0 (socket says 172.21.15.92:34210) 2023-10-16T13:05:46.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.619+0000 7f95f4ecc700 1 -- 172.21.15.92:0/993025359 learned_addr learned my addr 172.21.15.92:0/993025359 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:46.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.620+0000 7f95f4ecc700 1 -- 172.21.15.92:0/993025359 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e40095f0 con 0x7f95f0100fc0 2023-10-16T13:05:46.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.620+0000 7f95f4ecc700 1 --2- 172.21.15.92:0/993025359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95f0100fc0 0x7f95f0194ba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f95e4006010 tx=0x7f95e4004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:46.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.620+0000 7f95edffb700 1 -- 172.21.15.92:0/993025359 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95e401d070 con 0x7f95f0100fc0 2023-10-16T13:05:46.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.620+0000 7f95f7130700 1 -- 172.21.15.92:0/993025359 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f01952e0 con 0x7f95f0100fc0 2023-10-16T13:05:46.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.620+0000 7f95edffb700 1 -- 172.21.15.92:0/993025359 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f95e4004500 con 0x7f95f0100fc0 2023-10-16T13:05:46.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.620+0000 7f95edffb700 1 -- 172.21.15.92:0/993025359 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95e4003b10 con 0x7f95f0100fc0 2023-10-16T13:05:46.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.620+0000 7f95f7130700 1 -- 172.21.15.92:0/993025359 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f0195720 con 0x7f95f0100fc0 2023-10-16T13:05:46.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.621+0000 7f95edffb700 1 -- 172.21.15.92:0/993025359 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f95e4022470 con 0x7f95f0100fc0 2023-10-16T13:05:46.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.621+0000 7f95edffb700 1 --2- 172.21.15.92:0/993025359 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f95e0038910 0x7f95e003add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:46.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.621+0000 7f95f7130700 1 -- 172.21.15.92:0/993025359 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f018e640 con 0x7f95f0100fc0 2023-10-16T13:05:46.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.621+0000 7f95edffb700 1 -- 172.21.15.92:0/993025359 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f95e404ca20 con 0x7f95f0100fc0 2023-10-16T13:05:46.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.621+0000 7f95effff700 1 --2- 172.21.15.92:0/993025359 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f95e0038910 0x7f95e003add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:46.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.622+0000 7f95effff700 1 --2- 172.21.15.92:0/993025359 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f95e0038910 0x7f95e003add0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f95dc006fd0 tx=0x7f95dc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:46.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.626+0000 7f95edffb700 1 -- 172.21.15.92:0/993025359 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f95e407d100 con 0x7f95f0100fc0 2023-10-16T13:05:46.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.836+0000 7f95f7130700 1 -- 172.21.15.92:0/993025359 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f95f0105880 con 0x7f95f0100fc0 2023-10-16T13:05:46.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.838+0000 7f95edffb700 1 -- 172.21.15.92:0/993025359 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f95e402a950 con 0x7f95f0100fc0 2023-10-16T13:05:46.843 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.840+0000 7f95f7130700 1 -- 172.21.15.92:0/993025359 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f95e0038910 msgr2=0x7f95e003add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:46.843 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.840+0000 7f95f7130700 1 --2- 172.21.15.92:0/993025359 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f95e0038910 0x7f95e003add0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f95dc006fd0 tx=0x7f95dc006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:46.843 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.840+0000 7f95f7130700 1 -- 172.21.15.92:0/993025359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95f0100fc0 msgr2=0x7f95f0194ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:46.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.840+0000 7f95f7130700 1 --2- 172.21.15.92:0/993025359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95f0100fc0 0x7f95f0194ba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f95e4006010 tx=0x7f95e4004ff0 comp rx=0 tx=0).stop 2023-10-16T13:05:46.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.840+0000 7f95f7130700 1 -- 172.21.15.92:0/993025359 shutdown_connections 2023-10-16T13:05:46.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.840+0000 7f95f7130700 1 --2- 172.21.15.92:0/993025359 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f95e0038910 0x7f95e003add0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:46.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.840+0000 7f95f7130700 1 --2- 172.21.15.92:0/993025359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95f0100fc0 0x7f95f0194ba0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:46.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.840+0000 7f95f7130700 1 -- 172.21.15.92:0/993025359 >> 172.21.15.92:0/993025359 conn(0x7f95f00fae80 msgr2=0x7f95f00fbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:46.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.841+0000 7f95f7130700 1 -- 172.21.15.92:0/993025359 shutdown_connections 2023-10-16T13:05:46.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:46.841+0000 7f95f7130700 1 -- 172.21.15.92:0/993025359 wait complete. 2023-10-16T13:05:47.604 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-10-16T13:05:47.604 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-10-16T13:05:48.168 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:05:48.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:47 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/993025359' entity='client.admin' 2023-10-16T13:05:48.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:05:48.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:05:48.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:05:48.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:05:48.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:05:48.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:05:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.504+0000 7fdf1f1f5700 1 -- 172.21.15.92:0/793923159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf180ff8d0 msgr2=0x7fdf180ffcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.504+0000 7fdf1f1f5700 1 --2- 172.21.15.92:0/793923159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf180ff8d0 0x7fdf180ffcf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009910 tx=0x7fdf0c009c20 comp rx=0 tx=0).stop 2023-10-16T13:05:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.504+0000 7fdf1f1f5700 1 -- 172.21.15.92:0/793923159 shutdown_connections 2023-10-16T13:05:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.504+0000 7fdf1f1f5700 1 --2- 172.21.15.92:0/793923159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf180ff8d0 0x7fdf180ffcf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.504+0000 7fdf1f1f5700 1 -- 172.21.15.92:0/793923159 >> 172.21.15.92:0/793923159 conn(0x7fdf180fae50 msgr2=0x7fdf180fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.504+0000 7fdf1f1f5700 1 -- 172.21.15.92:0/793923159 shutdown_connections 2023-10-16T13:05:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.505+0000 7fdf1f1f5700 1 -- 172.21.15.92:0/793923159 wait complete. 2023-10-16T13:05:49.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.506+0000 7fdf1f1f5700 1 Processor -- start 2023-10-16T13:05:49.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.506+0000 7fdf1f1f5700 1 -- start start 2023-10-16T13:05:49.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.506+0000 7fdf1f1f5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf180ff8d0 0x7fdf18194a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:49.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.506+0000 7fdf1f1f5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf18194fc0 con 0x7fdf180ff8d0 2023-10-16T13:05:49.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.506+0000 7fdf1cf91700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf180ff8d0 0x7fdf18194a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:49.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.506+0000 7fdf1cf91700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf180ff8d0 0x7fdf18194a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34216/0 (socket says 172.21.15.92:34216) 2023-10-16T13:05:49.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.506+0000 7fdf1cf91700 1 -- 172.21.15.92:0/1237523925 learned_addr learned my addr 172.21.15.92:0/1237523925 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:49.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.507+0000 7fdf1cf91700 1 -- 172.21.15.92:0/1237523925 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c0095f0 con 0x7fdf180ff8d0 2023-10-16T13:05:49.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.507+0000 7fdf1cf91700 1 --2- 172.21.15.92:0/1237523925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf180ff8d0 0x7fdf18194a80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c006010 tx=0x7fdf0c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:49.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.507+0000 7fdf15ffb700 1 -- 172.21.15.92:0/1237523925 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf0c01d070 con 0x7fdf180ff8d0 2023-10-16T13:05:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.507+0000 7fdf15ffb700 1 -- 172.21.15.92:0/1237523925 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdf0c004500 con 0x7fdf180ff8d0 2023-10-16T13:05:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.507+0000 7fdf15ffb700 1 -- 172.21.15.92:0/1237523925 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf0c003b10 con 0x7fdf180ff8d0 2023-10-16T13:05:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.507+0000 7fdf1f1f5700 1 -- 172.21.15.92:0/1237523925 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf181951c0 con 0x7fdf180ff8d0 2023-10-16T13:05:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.507+0000 7fdf1f1f5700 1 -- 172.21.15.92:0/1237523925 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf18195600 con 0x7fdf180ff8d0 2023-10-16T13:05:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.508+0000 7fdf15ffb700 1 -- 172.21.15.92:0/1237523925 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fdf0c00bc20 con 0x7fdf180ff8d0 2023-10-16T13:05:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.508+0000 7fdf1f1f5700 1 -- 172.21.15.92:0/1237523925 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1818e520 con 0x7fdf180ff8d0 2023-10-16T13:05:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.508+0000 7fdf15ffb700 1 --2- 172.21.15.92:0/1237523925 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdf08038960 0x7fdf0803ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.508+0000 7fdf15ffb700 1 -- 172.21.15.92:0/1237523925 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fdf0c04ca10 con 0x7fdf180ff8d0 2023-10-16T13:05:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.508+0000 7fdf17fff700 1 --2- 172.21.15.92:0/1237523925 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdf08038960 0x7fdf0803ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:49.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.509+0000 7fdf17fff700 1 --2- 172.21.15.92:0/1237523925 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdf08038960 0x7fdf0803ae20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdf04006fd0 tx=0x7fdf04006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:49.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.513+0000 7fdf15ffb700 1 -- 172.21.15.92:0/1237523925 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdf0c02a750 con 0x7fdf180ff8d0 2023-10-16T13:05:49.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.706+0000 7fdf1f1f5700 1 -- 172.21.15.92:0/1237523925 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf1802d160 con 0x7fdf08038960 2023-10-16T13:05:49.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.709+0000 7fdf15ffb700 1 -- 172.21.15.92:0/1237523925 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fdf1802d160 con 0x7fdf08038960 2023-10-16T13:05:49.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.711+0000 7fdf1f1f5700 1 -- 172.21.15.92:0/1237523925 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdf08038960 msgr2=0x7fdf0803ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:49.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.711+0000 7fdf1f1f5700 1 --2- 172.21.15.92:0/1237523925 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdf08038960 0x7fdf0803ae20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdf04006fd0 tx=0x7fdf04006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:49.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.711+0000 7fdf1f1f5700 1 -- 172.21.15.92:0/1237523925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf180ff8d0 msgr2=0x7fdf18194a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:49.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.711+0000 7fdf1f1f5700 1 --2- 172.21.15.92:0/1237523925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf180ff8d0 0x7fdf18194a80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c006010 tx=0x7fdf0c004ff0 comp rx=0 tx=0).stop 2023-10-16T13:05:49.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.711+0000 7fdf1f1f5700 1 -- 172.21.15.92:0/1237523925 shutdown_connections 2023-10-16T13:05:49.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.711+0000 7fdf1f1f5700 1 --2- 172.21.15.92:0/1237523925 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdf08038960 0x7fdf0803ae20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:49.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.711+0000 7fdf1f1f5700 1 --2- 172.21.15.92:0/1237523925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf180ff8d0 0x7fdf18194a80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:49.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.711+0000 7fdf1f1f5700 1 -- 172.21.15.92:0/1237523925 >> 172.21.15.92:0/1237523925 conn(0x7fdf180fae50 msgr2=0x7fdf180fbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:49.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.711+0000 7fdf1f1f5700 1 -- 172.21.15.92:0/1237523925 shutdown_connections 2023-10-16T13:05:49.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:49.711+0000 7fdf1f1f5700 1 -- 172.21.15.92:0/1237523925 wait complete. 2023-10-16T13:05:50.226 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi118 2023-10-16T13:05:50.227 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-16T13:05:50.227 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/etc/ceph/ceph.conf 2023-10-16T13:05:50.247 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-16T13:05:50.248 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-16T13:05:50.312 INFO:tasks.cephadm:Adding host smithi118 to orchestrator... 2023-10-16T13:05:50.313 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch host add smithi118 2023-10-16T13:05:50.879 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:05:50.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:50 smithi092 ceph-mon[99542]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:05:50.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:05:50.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:05:50.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:05:50.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:05:50.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:50 smithi092 ceph-mon[99542]: Updating smithi092:/etc/ceph/ceph.conf 2023-10-16T13:05:50.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:50 smithi092 ceph-mon[99542]: Updating smithi092:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-16T13:05:50.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:50 smithi092 ceph-mon[99542]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2023-10-16T13:05:50.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:50 smithi092 ceph-mon[99542]: Updating smithi092:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-16T13:05:50.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:05:50.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:05:50.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:05:52.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.120+0000 7fecac488700 1 -- 172.21.15.92:0/899615696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feca4106970 msgr2=0x7feca4106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:52.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.120+0000 7fecac488700 1 --2- 172.21.15.92:0/899615696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feca4106970 0x7feca4106d50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec94009910 tx=0x7fec94009c20 comp rx=0 tx=0).stop 2023-10-16T13:05:52.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.120+0000 7fecac488700 1 -- 172.21.15.92:0/899615696 shutdown_connections 2023-10-16T13:05:52.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.120+0000 7fecac488700 1 --2- 172.21.15.92:0/899615696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feca4106970 0x7feca4106d50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:52.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.120+0000 7fecac488700 1 -- 172.21.15.92:0/899615696 >> 172.21.15.92:0/899615696 conn(0x7feca40fc4a0 msgr2=0x7feca40fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:52.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.120+0000 7fecac488700 1 -- 172.21.15.92:0/899615696 shutdown_connections 2023-10-16T13:05:52.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.120+0000 7fecac488700 1 -- 172.21.15.92:0/899615696 wait complete. 2023-10-16T13:05:52.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.121+0000 7fecac488700 1 Processor -- start 2023-10-16T13:05:52.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.121+0000 7fecac488700 1 -- start start 2023-10-16T13:05:52.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.122+0000 7fecac488700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feca4106970 0x7feca4195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:52.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.122+0000 7fecac488700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca4196450 con 0x7feca4106970 2023-10-16T13:05:52.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.122+0000 7fecaa224700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feca4106970 0x7feca4195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:52.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.122+0000 7fecaa224700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feca4106970 0x7feca4195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34222/0 (socket says 172.21.15.92:34222) 2023-10-16T13:05:52.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.122+0000 7fecaa224700 1 -- 172.21.15.92:0/535398928 learned_addr learned my addr 172.21.15.92:0/535398928 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:52.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.122+0000 7fecaa224700 1 -- 172.21.15.92:0/535398928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec940095f0 con 0x7feca4106970 2023-10-16T13:05:52.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.122+0000 7fecaa224700 1 --2- 172.21.15.92:0/535398928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feca4106970 0x7feca4195f10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fec94005850 tx=0x7fec94004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:52.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.122+0000 7fec9b7fe700 1 -- 172.21.15.92:0/535398928 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec9401d070 con 0x7feca4106970 2023-10-16T13:05:52.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.122+0000 7fec9b7fe700 1 -- 172.21.15.92:0/535398928 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fec94004500 con 0x7feca4106970 2023-10-16T13:05:52.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.122+0000 7fecac488700 1 -- 172.21.15.92:0/535398928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca4196650 con 0x7feca4106970 2023-10-16T13:05:52.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.122+0000 7fecac488700 1 -- 172.21.15.92:0/535398928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca4196ad0 con 0x7feca4106970 2023-10-16T13:05:52.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.122+0000 7fec9b7fe700 1 -- 172.21.15.92:0/535398928 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec940039f0 con 0x7feca4106970 2023-10-16T13:05:52.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.123+0000 7fec9b7fe700 1 -- 172.21.15.92:0/535398928 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fec94003c60 con 0x7feca4106970 2023-10-16T13:05:52.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.123+0000 7fecac488700 1 -- 172.21.15.92:0/535398928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec88005320 con 0x7feca4106970 2023-10-16T13:05:52.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.123+0000 7fec9b7fe700 1 --2- 172.21.15.92:0/535398928 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fec90038910 0x7fec9003add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:52.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.123+0000 7fec9b7fe700 1 -- 172.21.15.92:0/535398928 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fec9404c780 con 0x7feca4106970 2023-10-16T13:05:52.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.123+0000 7feca9a23700 1 --2- 172.21.15.92:0/535398928 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fec90038910 0x7fec9003add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:52.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.124+0000 7feca9a23700 1 --2- 172.21.15.92:0/535398928 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fec90038910 0x7fec9003add0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feca0006fd0 tx=0x7feca0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:52.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.128+0000 7fec9b7fe700 1 -- 172.21.15.92:0/535398928 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fec9402a950 con 0x7feca4106970 2023-10-16T13:05:52.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:52.323+0000 7fecac488700 1 -- 172.21.15.92:0/535398928 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi118", "target": ["mon-mgr", ""]}) v1 -- 0x7fec88000bf0 con 0x7fec90038910 2023-10-16T13:05:52.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:52 smithi092 ceph-mon[99542]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi118", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:05:53.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:53 smithi092 ceph-mon[99542]: Deploying cephadm binary to smithi118 2023-10-16T13:05:54.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:54.733+0000 7fec9b7fe700 1 -- 172.21.15.92:0/535398928 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fec88000bf0 con 0x7fec90038910 2023-10-16T13:05:54.735 INFO:teuthology.orchestra.run.smithi092.stdout:Added host 'smithi118' with addr '172.21.15.118' 2023-10-16T13:05:54.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:54.735+0000 7fecac488700 1 -- 172.21.15.92:0/535398928 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fec90038910 msgr2=0x7fec9003add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:54.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:54.735+0000 7fecac488700 1 --2- 172.21.15.92:0/535398928 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fec90038910 0x7fec9003add0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feca0006fd0 tx=0x7feca0006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:54.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:54.735+0000 7fecac488700 1 -- 172.21.15.92:0/535398928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feca4106970 msgr2=0x7feca4195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:54.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:54.735+0000 7fecac488700 1 --2- 172.21.15.92:0/535398928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feca4106970 0x7feca4195f10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fec94005850 tx=0x7fec94004ff0 comp rx=0 tx=0).stop 2023-10-16T13:05:54.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:54.735+0000 7fecac488700 1 -- 172.21.15.92:0/535398928 shutdown_connections 2023-10-16T13:05:54.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:54.735+0000 7fecac488700 1 --2- 172.21.15.92:0/535398928 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fec90038910 0x7fec9003add0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:54.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:54.735+0000 7fecac488700 1 --2- 172.21.15.92:0/535398928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feca4106970 0x7feca4195f10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:54.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:54.735+0000 7fecac488700 1 -- 172.21.15.92:0/535398928 >> 172.21.15.92:0/535398928 conn(0x7feca40fc4a0 msgr2=0x7feca4108d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:54.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:54.735+0000 7fecac488700 1 -- 172.21.15.92:0/535398928 shutdown_connections 2023-10-16T13:05:54.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:54.735+0000 7fecac488700 1 -- 172.21.15.92:0/535398928 wait complete. 2023-10-16T13:05:55.142 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-16T13:05:55.702 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:05:55.985 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:55 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:05:55.985 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:55 smithi092 ceph-mon[99542]: Added host smithi118 2023-10-16T13:05:55.985 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:55 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:05:55.986 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:55 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:05:55.986 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:55 smithi092 ceph-mon[99542]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:05:57.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.046+0000 7f930d188700 1 -- 172.21.15.92:0/2952931898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9308105860 msgr2=0x7f9308105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:57.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.046+0000 7f930d188700 1 --2- 172.21.15.92:0/2952931898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9308105860 0x7f9308105c40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009910 tx=0x7f92f8009c20 comp rx=0 tx=0).stop 2023-10-16T13:05:57.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.046+0000 7f930d188700 1 -- 172.21.15.92:0/2952931898 shutdown_connections 2023-10-16T13:05:57.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.046+0000 7f930d188700 1 --2- 172.21.15.92:0/2952931898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9308105860 0x7f9308105c40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:57.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.046+0000 7f930d188700 1 -- 172.21.15.92:0/2952931898 >> 172.21.15.92:0/2952931898 conn(0x7f9308075370 msgr2=0x7f9308075780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:57.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.046+0000 7f930d188700 1 -- 172.21.15.92:0/2952931898 shutdown_connections 2023-10-16T13:05:57.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.046+0000 7f930d188700 1 -- 172.21.15.92:0/2952931898 wait complete. 2023-10-16T13:05:57.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.047+0000 7f930d188700 1 Processor -- start 2023-10-16T13:05:57.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.047+0000 7f930d188700 1 -- start start 2023-10-16T13:05:57.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.047+0000 7f930d188700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9308105860 0x7f9308195f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:57.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.047+0000 7f930d188700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9308196440 con 0x7f9308105860 2023-10-16T13:05:57.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.047+0000 7f9306d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9308105860 0x7f9308195f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:57.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.048+0000 7f9306d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9308105860 0x7f9308195f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34248/0 (socket says 172.21.15.92:34248) 2023-10-16T13:05:57.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.048+0000 7f9306d9d700 1 -- 172.21.15.92:0/4072965710 learned_addr learned my addr 172.21.15.92:0/4072965710 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:57.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.048+0000 7f9306d9d700 1 -- 172.21.15.92:0/4072965710 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f80095f0 con 0x7f9308105860 2023-10-16T13:05:57.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.048+0000 7f9306d9d700 1 --2- 172.21.15.92:0/4072965710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9308105860 0x7f9308195f00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f92f8005850 tx=0x7f92f8004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:57.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.048+0000 7f92effff700 1 -- 172.21.15.92:0/4072965710 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92f801d070 con 0x7f9308105860 2023-10-16T13:05:57.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.048+0000 7f92effff700 1 -- 172.21.15.92:0/4072965710 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f92f8004500 con 0x7f9308105860 2023-10-16T13:05:57.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.048+0000 7f92effff700 1 -- 172.21.15.92:0/4072965710 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92f80039f0 con 0x7f9308105860 2023-10-16T13:05:57.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.048+0000 7f930d188700 1 -- 172.21.15.92:0/4072965710 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9308196640 con 0x7f9308105860 2023-10-16T13:05:57.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.048+0000 7f930d188700 1 -- 172.21.15.92:0/4072965710 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9308196ac0 con 0x7f9308105860 2023-10-16T13:05:57.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.049+0000 7f92effff700 1 -- 172.21.15.92:0/4072965710 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f92f8003c60 con 0x7f9308105860 2023-10-16T13:05:57.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.049+0000 7f92effff700 1 --2- 172.21.15.92:0/4072965710 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f92f0038910 0x7f92f003add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:57.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.049+0000 7f930d188700 1 -- 172.21.15.92:0/4072965710 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93080624e0 con 0x7f9308105860 2023-10-16T13:05:57.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.049+0000 7f930659c700 1 --2- 172.21.15.92:0/4072965710 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f92f0038910 0x7f92f003add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:57.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.049+0000 7f92effff700 1 -- 172.21.15.92:0/4072965710 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f92f804c7a0 con 0x7f9308105860 2023-10-16T13:05:57.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.050+0000 7f930659c700 1 --2- 172.21.15.92:0/4072965710 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f92f0038910 0x7f92f003add0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f92fc006fd0 tx=0x7f92fc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:57.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.054+0000 7f92effff700 1 -- 172.21.15.92:0/4072965710 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f92f802a950 con 0x7f9308105860 2023-10-16T13:05:57.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:56 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:05:57.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.261+0000 7f930d188700 1 -- 172.21.15.92:0/4072965710 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f930810af10 con 0x7f92f0038910 2023-10-16T13:05:57.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.262+0000 7f92effff700 1 -- 172.21.15.92:0/4072965710 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f930810af10 con 0x7f92f0038910 2023-10-16T13:05:57.264 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:05:57.264 INFO:teuthology.orchestra.run.smithi092.stdout:[{"addr": "172.21.15.92", "hostname": "smithi092", "labels": [], "status": ""}, {"addr": "172.21.15.118", "hostname": "smithi118", "labels": [], "status": ""}] 2023-10-16T13:05:57.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.264+0000 7f930d188700 1 -- 172.21.15.92:0/4072965710 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f92f0038910 msgr2=0x7f92f003add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:57.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.264+0000 7f930d188700 1 --2- 172.21.15.92:0/4072965710 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f92f0038910 0x7f92f003add0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f92fc006fd0 tx=0x7f92fc006e40 comp rx=0 tx=0).stop 2023-10-16T13:05:57.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.264+0000 7f930d188700 1 -- 172.21.15.92:0/4072965710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9308105860 msgr2=0x7f9308195f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:57.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.264+0000 7f930d188700 1 --2- 172.21.15.92:0/4072965710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9308105860 0x7f9308195f00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f92f8005850 tx=0x7f92f8004ff0 comp rx=0 tx=0).stop 2023-10-16T13:05:57.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.264+0000 7f930d188700 1 -- 172.21.15.92:0/4072965710 shutdown_connections 2023-10-16T13:05:57.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.264+0000 7f930d188700 1 --2- 172.21.15.92:0/4072965710 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f92f0038910 0x7f92f003add0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:57.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.264+0000 7f930d188700 1 --2- 172.21.15.92:0/4072965710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9308105860 0x7f9308195f00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:57.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.264+0000 7f930d188700 1 -- 172.21.15.92:0/4072965710 >> 172.21.15.92:0/4072965710 conn(0x7f9308075370 msgr2=0x7f93080fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:57.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.265+0000 7f930d188700 1 -- 172.21.15.92:0/4072965710 shutdown_connections 2023-10-16T13:05:57.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:57.265+0000 7f930d188700 1 -- 172.21.15.92:0/4072965710 wait complete. 2023-10-16T13:05:57.744 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi152 2023-10-16T13:05:57.744 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T13:05:57.745 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/etc/ceph/ceph.conf 2023-10-16T13:05:57.765 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T13:05:57.766 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-16T13:05:57.825 INFO:tasks.cephadm:Adding host smithi152 to orchestrator... 2023-10-16T13:05:57.826 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch host add smithi152 2023-10-16T13:05:58.382 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:05:58.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:58 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:05:58.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:58 smithi092 ceph-mon[99542]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:05:58.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:05:58 smithi092 ceph-mon[99542]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:05:59.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.586+0000 7f4d66148700 1 -- 172.21.15.92:0/3862050488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d60105860 msgr2=0x7f4d60105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:05:59.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.586+0000 7f4d66148700 1 --2- 172.21.15.92:0/3862050488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d60105860 0x7f4d60105c40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4d54009910 tx=0x7f4d54009c20 comp rx=0 tx=0).stop 2023-10-16T13:05:59.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.586+0000 7f4d66148700 1 -- 172.21.15.92:0/3862050488 shutdown_connections 2023-10-16T13:05:59.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.586+0000 7f4d66148700 1 --2- 172.21.15.92:0/3862050488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d60105860 0x7f4d60105c40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:05:59.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.586+0000 7f4d66148700 1 -- 172.21.15.92:0/3862050488 >> 172.21.15.92:0/3862050488 conn(0x7f4d60075370 msgr2=0x7f4d60075780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:05:59.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.586+0000 7f4d66148700 1 -- 172.21.15.92:0/3862050488 shutdown_connections 2023-10-16T13:05:59.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.586+0000 7f4d66148700 1 -- 172.21.15.92:0/3862050488 wait complete. 2023-10-16T13:05:59.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.586+0000 7f4d66148700 1 Processor -- start 2023-10-16T13:05:59.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.587+0000 7f4d66148700 1 -- start start 2023-10-16T13:05:59.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.587+0000 7f4d66148700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d60105860 0x7f4d60196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:59.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.587+0000 7f4d66148700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d60196560 con 0x7f4d60105860 2023-10-16T13:05:59.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.587+0000 7f4d5f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d60105860 0x7f4d60196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:59.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.587+0000 7f4d5f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d60105860 0x7f4d60196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34254/0 (socket says 172.21.15.92:34254) 2023-10-16T13:05:59.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.587+0000 7f4d5f7fe700 1 -- 172.21.15.92:0/3961834924 learned_addr learned my addr 172.21.15.92:0/3961834924 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:05:59.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.587+0000 7f4d5f7fe700 1 -- 172.21.15.92:0/3961834924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d540095f0 con 0x7f4d60105860 2023-10-16T13:05:59.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.587+0000 7f4d5f7fe700 1 --2- 172.21.15.92:0/3961834924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d60105860 0x7f4d60196020 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4d54005850 tx=0x7f4d54004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:59.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.587+0000 7f4d5cff9700 1 -- 172.21.15.92:0/3961834924 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d5401d070 con 0x7f4d60105860 2023-10-16T13:05:59.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.587+0000 7f4d5cff9700 1 -- 172.21.15.92:0/3961834924 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4d54004500 con 0x7f4d60105860 2023-10-16T13:05:59.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.587+0000 7f4d66148700 1 -- 172.21.15.92:0/3961834924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d60196760 con 0x7f4d60105860 2023-10-16T13:05:59.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.587+0000 7f4d5cff9700 1 -- 172.21.15.92:0/3961834924 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d540039f0 con 0x7f4d60105860 2023-10-16T13:05:59.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.587+0000 7f4d66148700 1 -- 172.21.15.92:0/3961834924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d60196be0 con 0x7f4d60105860 2023-10-16T13:05:59.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.588+0000 7f4d5cff9700 1 -- 172.21.15.92:0/3961834924 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f4d54003cb0 con 0x7f4d60105860 2023-10-16T13:05:59.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.588+0000 7f4d66148700 1 -- 172.21.15.92:0/3961834924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d600624e0 con 0x7f4d60105860 2023-10-16T13:05:59.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.588+0000 7f4d5cff9700 1 --2- 172.21.15.92:0/3961834924 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4d480388c0 0x7f4d4803ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:05:59.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.588+0000 7f4d5cff9700 1 -- 172.21.15.92:0/3961834924 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4d5404c780 con 0x7f4d60105860 2023-10-16T13:05:59.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.589+0000 7f4d5effd700 1 --2- 172.21.15.92:0/3961834924 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4d480388c0 0x7f4d4803ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:05:59.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.589+0000 7f4d5effd700 1 --2- 172.21.15.92:0/3961834924 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4d480388c0 0x7f4d4803ad80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4d50006fd0 tx=0x7f4d50006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:05:59.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.593+0000 7f4d5cff9700 1 -- 172.21.15.92:0/3961834924 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4d5402a770 con 0x7f4d60105860 2023-10-16T13:05:59.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:05:59.785+0000 7f4d66148700 1 -- 172.21.15.92:0/3961834924 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi152", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d60109dd0 con 0x7f4d480388c0 2023-10-16T13:06:00.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:00 smithi092 ceph-mon[99542]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:00.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:00 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:00.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:00 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:00.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:00 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:00.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:00 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:00.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:00 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi118", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:06:00.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:00 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:00.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:00 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:06:01.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:01 smithi092 ceph-mon[99542]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi152", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:06:01.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:01 smithi092 ceph-mon[99542]: Updating smithi118:/etc/ceph/ceph.conf 2023-10-16T13:06:01.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:01 smithi092 ceph-mon[99542]: Deploying cephadm binary to smithi152 2023-10-16T13:06:01.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:01 smithi092 ceph-mon[99542]: Updating smithi118:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-16T13:06:02.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:02.207+0000 7f4d5cff9700 1 -- 172.21.15.92:0/3961834924 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f4d60109dd0 con 0x7f4d480388c0 2023-10-16T13:06:02.209 INFO:teuthology.orchestra.run.smithi092.stdout:Added host 'smithi152' with addr '172.21.15.152' 2023-10-16T13:06:02.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:02.209+0000 7f4d66148700 1 -- 172.21.15.92:0/3961834924 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4d480388c0 msgr2=0x7f4d4803ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:02.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:02.209+0000 7f4d66148700 1 --2- 172.21.15.92:0/3961834924 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4d480388c0 0x7f4d4803ad80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4d50006fd0 tx=0x7f4d50006e40 comp rx=0 tx=0).stop 2023-10-16T13:06:02.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:02.209+0000 7f4d66148700 1 -- 172.21.15.92:0/3961834924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d60105860 msgr2=0x7f4d60196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:02.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:02.209+0000 7f4d66148700 1 --2- 172.21.15.92:0/3961834924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d60105860 0x7f4d60196020 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4d54005850 tx=0x7f4d54004ff0 comp rx=0 tx=0).stop 2023-10-16T13:06:02.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:02.209+0000 7f4d66148700 1 -- 172.21.15.92:0/3961834924 shutdown_connections 2023-10-16T13:06:02.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:02.209+0000 7f4d66148700 1 --2- 172.21.15.92:0/3961834924 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4d480388c0 0x7f4d4803ad80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:02.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:02.209+0000 7f4d66148700 1 --2- 172.21.15.92:0/3961834924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d60105860 0x7f4d60196020 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:02.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:02.209+0000 7f4d66148700 1 -- 172.21.15.92:0/3961834924 >> 172.21.15.92:0/3961834924 conn(0x7f4d60075370 msgr2=0x7f4d60103370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:06:02.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:02.209+0000 7f4d66148700 1 -- 172.21.15.92:0/3961834924 shutdown_connections 2023-10-16T13:06:02.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:02.209+0000 7f4d66148700 1 -- 172.21.15.92:0/3961834924 wait complete. 2023-10-16T13:06:02.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:02 smithi092 ceph-mon[99542]: Updating smithi118:/etc/ceph/ceph.client.admin.keyring 2023-10-16T13:06:02.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:02 smithi092 ceph-mon[99542]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:02.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:02 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:02.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:02 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:02.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:02 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:02.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:02 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:02.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:02 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:02.641 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-16T13:06:03.196 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:06:03.631 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:03 smithi092 ceph-mon[99542]: Updating smithi118:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-16T13:06:03.632 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:03 smithi092 ceph-mon[99542]: Added host smithi152 2023-10-16T13:06:03.632 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:03 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:04.346 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:04 smithi092 ceph-mon[99542]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:04.347 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:04 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:04.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.579+0000 7fae91fad700 1 -- 172.21.15.92:0/2655158247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae8c105940 msgr2=0x7fae8c105d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:04.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.579+0000 7fae91fad700 1 --2- 172.21.15.92:0/2655158247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae8c105940 0x7fae8c105d20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fae7c009910 tx=0x7fae7c009c20 comp rx=0 tx=0).stop 2023-10-16T13:06:04.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.579+0000 7fae91fad700 1 -- 172.21.15.92:0/2655158247 shutdown_connections 2023-10-16T13:06:04.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.579+0000 7fae91fad700 1 --2- 172.21.15.92:0/2655158247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae8c105940 0x7fae8c105d20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:04.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.579+0000 7fae91fad700 1 -- 172.21.15.92:0/2655158247 >> 172.21.15.92:0/2655158247 conn(0x7fae8c075fa0 msgr2=0x7fae8c0763b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:06:04.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.579+0000 7fae91fad700 1 -- 172.21.15.92:0/2655158247 shutdown_connections 2023-10-16T13:06:04.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.579+0000 7fae91fad700 1 -- 172.21.15.92:0/2655158247 wait complete. 2023-10-16T13:06:04.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.580+0000 7fae91fad700 1 Processor -- start 2023-10-16T13:06:04.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.581+0000 7fae91fad700 1 -- start start 2023-10-16T13:06:04.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.581+0000 7fae91fad700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae8c105940 0x7fae8c195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:04.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.581+0000 7fae91fad700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c196450 con 0x7fae8c105940 2023-10-16T13:06:04.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.581+0000 7fae8b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae8c105940 0x7fae8c195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:04.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.581+0000 7fae8b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae8c105940 0x7fae8c195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34280/0 (socket says 172.21.15.92:34280) 2023-10-16T13:06:04.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.581+0000 7fae8b7fe700 1 -- 172.21.15.92:0/2579883745 learned_addr learned my addr 172.21.15.92:0/2579883745 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:06:04.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.581+0000 7fae8b7fe700 1 -- 172.21.15.92:0/2579883745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c0095f0 con 0x7fae8c105940 2023-10-16T13:06:04.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.581+0000 7fae8b7fe700 1 --2- 172.21.15.92:0/2579883745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae8c105940 0x7fae8c195f10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fae7c005850 tx=0x7fae7c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:06:04.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.581+0000 7fae88ff9700 1 -- 172.21.15.92:0/2579883745 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae7c01d070 con 0x7fae8c105940 2023-10-16T13:06:04.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.581+0000 7fae88ff9700 1 -- 172.21.15.92:0/2579883745 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fae7c004500 con 0x7fae8c105940 2023-10-16T13:06:04.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.581+0000 7fae91fad700 1 -- 172.21.15.92:0/2579883745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8c196650 con 0x7fae8c105940 2023-10-16T13:06:04.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.581+0000 7fae88ff9700 1 -- 172.21.15.92:0/2579883745 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae7c0039f0 con 0x7fae8c105940 2023-10-16T13:06:04.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.582+0000 7fae91fad700 1 -- 172.21.15.92:0/2579883745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8c196ad0 con 0x7fae8c105940 2023-10-16T13:06:04.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.582+0000 7fae88ff9700 1 -- 172.21.15.92:0/2579883745 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fae7c003cb0 con 0x7fae8c105940 2023-10-16T13:06:04.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.582+0000 7fae88ff9700 1 --2- 172.21.15.92:0/2579883745 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fae740388c0 0x7fae7403ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:04.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.582+0000 7fae91fad700 1 -- 172.21.15.92:0/2579883745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae8c0624e0 con 0x7fae8c105940 2023-10-16T13:06:04.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.582+0000 7fae88ff9700 1 -- 172.21.15.92:0/2579883745 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fae7c04c640 con 0x7fae8c105940 2023-10-16T13:06:04.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.583+0000 7fae8affd700 1 --2- 172.21.15.92:0/2579883745 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fae740388c0 0x7fae7403ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:04.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.583+0000 7fae8affd700 1 --2- 172.21.15.92:0/2579883745 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fae740388c0 0x7fae7403ad80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fae80006fd0 tx=0x7fae80006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:06:04.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.587+0000 7fae88ff9700 1 -- 172.21.15.92:0/2579883745 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fae7c02a540 con 0x7fae8c105940 2023-10-16T13:06:04.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.780+0000 7fae91fad700 1 -- 172.21.15.92:0/2579883745 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae8c106430 con 0x7fae740388c0 2023-10-16T13:06:04.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.781+0000 7fae88ff9700 1 -- 172.21.15.92:0/2579883745 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+240 (secure 0 0 0) 0x7fae8c106430 con 0x7fae740388c0 2023-10-16T13:06:04.784 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:06:04.784 INFO:teuthology.orchestra.run.smithi092.stdout:[{"addr": "172.21.15.92", "hostname": "smithi092", "labels": [], "status": ""}, {"addr": "172.21.15.118", "hostname": "smithi118", "labels": [], "status": ""}, {"addr": "172.21.15.152", "hostname": "smithi152", "labels": [], "status": ""}] 2023-10-16T13:06:04.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.783+0000 7fae91fad700 1 -- 172.21.15.92:0/2579883745 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fae740388c0 msgr2=0x7fae7403ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:04.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.783+0000 7fae91fad700 1 --2- 172.21.15.92:0/2579883745 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fae740388c0 0x7fae7403ad80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fae80006fd0 tx=0x7fae80006e40 comp rx=0 tx=0).stop 2023-10-16T13:06:04.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.783+0000 7fae91fad700 1 -- 172.21.15.92:0/2579883745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae8c105940 msgr2=0x7fae8c195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:04.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.783+0000 7fae91fad700 1 --2- 172.21.15.92:0/2579883745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae8c105940 0x7fae8c195f10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fae7c005850 tx=0x7fae7c004ff0 comp rx=0 tx=0).stop 2023-10-16T13:06:04.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.783+0000 7fae91fad700 1 -- 172.21.15.92:0/2579883745 shutdown_connections 2023-10-16T13:06:04.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.783+0000 7fae91fad700 1 --2- 172.21.15.92:0/2579883745 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fae740388c0 0x7fae7403ad80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:04.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.783+0000 7fae91fad700 1 --2- 172.21.15.92:0/2579883745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae8c105940 0x7fae8c195f10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:04.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.783+0000 7fae91fad700 1 -- 172.21.15.92:0/2579883745 >> 172.21.15.92:0/2579883745 conn(0x7fae8c075fa0 msgr2=0x7fae8c0fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:06:04.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.783+0000 7fae91fad700 1 -- 172.21.15.92:0/2579883745 shutdown_connections 2023-10-16T13:06:04.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:04.783+0000 7fae91fad700 1 -- 172.21.15.92:0/2579883745 wait complete. 2023-10-16T13:06:05.141 INFO:tasks.cephadm:Setting crush tunables to default 2023-10-16T13:06:05.142 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph osd crush tunables default 2023-10-16T13:06:05.701 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:06:05.913 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:05 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:05.914 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:05 smithi092 ceph-mon[99542]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:06:05.914 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:05 smithi092 ceph-mon[99542]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.873+0000 7ff24f65d700 1 -- 172.21.15.92:0/2549414538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff248106970 msgr2=0x7ff248106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.873+0000 7ff24f65d700 1 --2- 172.21.15.92:0/2549414538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff248106970 0x7ff248106d50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff238009910 tx=0x7ff238009c20 comp rx=0 tx=0).stop 2023-10-16T13:06:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.873+0000 7ff24f65d700 1 -- 172.21.15.92:0/2549414538 shutdown_connections 2023-10-16T13:06:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.873+0000 7ff24f65d700 1 --2- 172.21.15.92:0/2549414538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff248106970 0x7ff248106d50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.873+0000 7ff24f65d700 1 -- 172.21.15.92:0/2549414538 >> 172.21.15.92:0/2549414538 conn(0x7ff2480fc4a0 msgr2=0x7ff2480fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:06:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.873+0000 7ff24f65d700 1 -- 172.21.15.92:0/2549414538 shutdown_connections 2023-10-16T13:06:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.873+0000 7ff24f65d700 1 -- 172.21.15.92:0/2549414538 wait complete. 2023-10-16T13:06:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.874+0000 7ff24f65d700 1 Processor -- start 2023-10-16T13:06:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.874+0000 7ff24f65d700 1 -- start start 2023-10-16T13:06:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.875+0000 7ff24f65d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff248106970 0x7ff248195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.875+0000 7ff24f65d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff248196450 con 0x7ff248106970 2023-10-16T13:06:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.875+0000 7ff24d3f9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff248106970 0x7ff248195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.875+0000 7ff24d3f9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff248106970 0x7ff248195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34286/0 (socket says 172.21.15.92:34286) 2023-10-16T13:06:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.875+0000 7ff24d3f9700 1 -- 172.21.15.92:0/177238790 learned_addr learned my addr 172.21.15.92:0/177238790 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:06:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.875+0000 7ff24d3f9700 1 -- 172.21.15.92:0/177238790 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2380095f0 con 0x7ff248106970 2023-10-16T13:06:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.875+0000 7ff24d3f9700 1 --2- 172.21.15.92:0/177238790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff248106970 0x7ff248195f10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff238005f50 tx=0x7ff238004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:06:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.875+0000 7ff23e7fc700 1 -- 172.21.15.92:0/177238790 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff23801d070 con 0x7ff248106970 2023-10-16T13:06:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.875+0000 7ff23e7fc700 1 -- 172.21.15.92:0/177238790 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff23800bbd0 con 0x7ff248106970 2023-10-16T13:06:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.875+0000 7ff24f65d700 1 -- 172.21.15.92:0/177238790 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2481966b0 con 0x7ff248106970 2023-10-16T13:06:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.875+0000 7ff23e7fc700 1 -- 172.21.15.92:0/177238790 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff238003a40 con 0x7ff248106970 2023-10-16T13:06:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.875+0000 7ff24f65d700 1 -- 172.21.15.92:0/177238790 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff248196b30 con 0x7ff248106970 2023-10-16T13:06:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.876+0000 7ff23e7fc700 1 -- 172.21.15.92:0/177238790 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7ff238003ba0 con 0x7ff248106970 2023-10-16T13:06:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.876+0000 7ff23e7fc700 1 --2- 172.21.15.92:0/177238790 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff234038910 0x7ff23403add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.876+0000 7ff23e7fc700 1 -- 172.21.15.92:0/177238790 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff23804c550 con 0x7ff248106970 2023-10-16T13:06:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.876+0000 7ff24cbf8700 1 --2- 172.21.15.92:0/177238790 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff234038910 0x7ff23403add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.876+0000 7ff24f65d700 1 -- 172.21.15.92:0/177238790 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2480624e0 con 0x7ff248106970 2023-10-16T13:06:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.877+0000 7ff24cbf8700 1 --2- 172.21.15.92:0/177238790 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff234038910 0x7ff23403add0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff244006fd0 tx=0x7ff244006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:06:06.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:06.882+0000 7ff23e7fc700 1 -- 172.21.15.92:0/177238790 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff238026020 con 0x7ff248106970 2023-10-16T13:06:07.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:07.076+0000 7ff24f65d700 1 -- 172.21.15.92:0/177238790 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff24810ade0 con 0x7ff248106970 2023-10-16T13:06:07.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:07.127+0000 7ff23e7fc700 1 -- 172.21.15.92:0/177238790 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff23802b440 con 0x7ff248106970 2023-10-16T13:06:07.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:07.129+0000 7ff24f65d700 1 -- 172.21.15.92:0/177238790 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff234038910 msgr2=0x7ff23403add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:07.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:07.129+0000 7ff24f65d700 1 --2- 172.21.15.92:0/177238790 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff234038910 0x7ff23403add0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff244006fd0 tx=0x7ff244006e40 comp rx=0 tx=0).stop 2023-10-16T13:06:07.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:07.129+0000 7ff24f65d700 1 -- 172.21.15.92:0/177238790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff248106970 msgr2=0x7ff248195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:07.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:07.129+0000 7ff24f65d700 1 --2- 172.21.15.92:0/177238790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff248106970 0x7ff248195f10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff238005f50 tx=0x7ff238004ff0 comp rx=0 tx=0).stop 2023-10-16T13:06:07.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:07.129+0000 7ff24f65d700 1 -- 172.21.15.92:0/177238790 shutdown_connections 2023-10-16T13:06:07.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:07.129+0000 7ff24f65d700 1 --2- 172.21.15.92:0/177238790 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff234038910 0x7ff23403add0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:07.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:07.129+0000 7ff24f65d700 1 --2- 172.21.15.92:0/177238790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff248106970 0x7ff248195f10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:07.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:07.129+0000 7ff24f65d700 1 -- 172.21.15.92:0/177238790 >> 172.21.15.92:0/177238790 conn(0x7ff2480fc4a0 msgr2=0x7ff248108d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:06:07.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:07.129+0000 7ff24f65d700 1 -- 172.21.15.92:0/177238790 shutdown_connections 2023-10-16T13:06:07.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:07.129+0000 7ff24f65d700 1 -- 172.21.15.92:0/177238790 wait complete. 2023-10-16T13:06:07.135 INFO:teuthology.orchestra.run.smithi092.stderr:adjusted tunables profile to default 2023-10-16T13:06:07.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:07 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/177238790' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-16T13:06:07.645 INFO:tasks.cephadm:Adding mon.a on smithi092 2023-10-16T13:06:07.645 INFO:tasks.cephadm:Adding mon.b on smithi118 2023-10-16T13:06:07.646 INFO:tasks.cephadm:Adding mon.c on smithi152 2023-10-16T13:06:07.646 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch apply mon '3;smithi092:172.21.15.92=a;smithi118:172.21.15.118=b;smithi152:172.21.15.152=c' 2023-10-16T13:06:08.250 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-16T13:06:08.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:08 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/177238790' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-16T13:06:08.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:08 smithi092 ceph-mon[99542]: osdmap e4: 0 total, 0 up, 0 in 2023-10-16T13:06:08.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:08 smithi092 ceph-mon[99542]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:08.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:08 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:08.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:08 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:08.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:08 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:08.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:08 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:08.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:08 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi152", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:06:08.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:08 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:08.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:08 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:06:09.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.505+0000 7f5dc2ba6700 1 -- 172.21.15.152:0/3536162841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dbc105a60 msgr2=0x7f5dbc105e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:09.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.505+0000 7f5dc2ba6700 1 --2- 172.21.15.152:0/3536162841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dbc105a60 0x7f5dbc105e40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5db0009910 tx=0x7f5db0009c20 comp rx=0 tx=0).stop 2023-10-16T13:06:09.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.505+0000 7f5dc2ba6700 1 -- 172.21.15.152:0/3536162841 shutdown_connections 2023-10-16T13:06:09.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.505+0000 7f5dc2ba6700 1 --2- 172.21.15.152:0/3536162841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dbc105a60 0x7f5dbc105e40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:09.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.505+0000 7f5dc2ba6700 1 -- 172.21.15.152:0/3536162841 >> 172.21.15.152:0/3536162841 conn(0x7f5dbc075fa0 msgr2=0x7f5dbc0763b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:06:09.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.505+0000 7f5dc2ba6700 1 -- 172.21.15.152:0/3536162841 shutdown_connections 2023-10-16T13:06:09.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.505+0000 7f5dc2ba6700 1 -- 172.21.15.152:0/3536162841 wait complete. 2023-10-16T13:06:09.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.506+0000 7f5dc2ba6700 1 Processor -- start 2023-10-16T13:06:09.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.506+0000 7f5dc2ba6700 1 -- start start 2023-10-16T13:06:09.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.506+0000 7f5dc2ba6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dbc105a60 0x7f5dbc194fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:09.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.506+0000 7f5dc2ba6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc195510 con 0x7f5dbc105a60 2023-10-16T13:06:09.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.507+0000 7f5dc0942700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dbc105a60 0x7f5dbc194fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:09.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.507+0000 7f5dc0942700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dbc105a60 0x7f5dbc194fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.152:44762/0 (socket says 172.21.15.152:44762) 2023-10-16T13:06:09.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.507+0000 7f5dc0942700 1 -- 172.21.15.152:0/4249222008 learned_addr learned my addr 172.21.15.152:0/4249222008 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T13:06:09.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.507+0000 7f5dc0942700 1 -- 172.21.15.152:0/4249222008 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db00095f0 con 0x7f5dbc105a60 2023-10-16T13:06:09.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.507+0000 7f5dc0942700 1 --2- 172.21.15.152:0/4249222008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dbc105a60 0x7f5dbc194fd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5db0005f50 tx=0x7f5db0004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:06:09.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.507+0000 7f5db9ffb700 1 -- 172.21.15.152:0/4249222008 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5db001d070 con 0x7f5dbc105a60 2023-10-16T13:06:09.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.507+0000 7f5dc2ba6700 1 -- 172.21.15.152:0/4249222008 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dbc195770 con 0x7f5dbc105a60 2023-10-16T13:06:09.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.507+0000 7f5db9ffb700 1 -- 172.21.15.152:0/4249222008 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5db000bbd0 con 0x7f5dbc105a60 2023-10-16T13:06:09.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.507+0000 7f5db9ffb700 1 -- 172.21.15.152:0/4249222008 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5db0003a40 con 0x7f5dbc105a60 2023-10-16T13:06:09.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.507+0000 7f5dc2ba6700 1 -- 172.21.15.152:0/4249222008 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dbc195bf0 con 0x7f5dbc105a60 2023-10-16T13:06:09.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.508+0000 7f5dc2ba6700 1 -- 172.21.15.152:0/4249222008 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dbc0624e0 con 0x7f5dbc105a60 2023-10-16T13:06:09.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.508+0000 7f5db9ffb700 1 -- 172.21.15.152:0/4249222008 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f5db000bd40 con 0x7f5dbc105a60 2023-10-16T13:06:09.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.509+0000 7f5db9ffb700 1 --2- 172.21.15.152:0/4249222008 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5dac0388c0 0x7f5dac03ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:09.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.509+0000 7f5db9ffb700 1 -- 172.21.15.152:0/4249222008 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5db004c5b0 con 0x7f5dbc105a60 2023-10-16T13:06:09.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.509+0000 7f5dbbfff700 1 --2- 172.21.15.152:0/4249222008 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5dac0388c0 0x7f5dac03ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:09.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.509+0000 7f5dbbfff700 1 --2- 172.21.15.152:0/4249222008 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5dac0388c0 0x7f5dac03ad80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5da8006fd0 tx=0x7f5da8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:06:09.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.514+0000 7f5db9ffb700 1 -- 172.21.15.152:0/4249222008 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5db0029360 con 0x7f5dbc105a60 2023-10-16T13:06:09.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.711+0000 7f5dc2ba6700 1 -- 172.21.15.152:0/4249222008 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi092:172.21.15.92=a;smithi118:172.21.15.118=b;smithi152:172.21.15.152=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f5dbc109f60 con 0x7f5dac0388c0 2023-10-16T13:06:09.719 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.718+0000 7f5db9ffb700 1 -- 172.21.15.152:0/4249222008 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f5dbc109f60 con 0x7f5dac0388c0 2023-10-16T13:06:09.720 INFO:teuthology.orchestra.run.smithi152.stdout:Scheduled mon update... 2023-10-16T13:06:09.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.720+0000 7f5dc2ba6700 1 -- 172.21.15.152:0/4249222008 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5dac0388c0 msgr2=0x7f5dac03ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:09.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.720+0000 7f5dc2ba6700 1 --2- 172.21.15.152:0/4249222008 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5dac0388c0 0x7f5dac03ad80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5da8006fd0 tx=0x7f5da8006e40 comp rx=0 tx=0).stop 2023-10-16T13:06:09.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.720+0000 7f5dc2ba6700 1 -- 172.21.15.152:0/4249222008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dbc105a60 msgr2=0x7f5dbc194fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:09.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.720+0000 7f5dc2ba6700 1 --2- 172.21.15.152:0/4249222008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dbc105a60 0x7f5dbc194fd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5db0005f50 tx=0x7f5db0004ff0 comp rx=0 tx=0).stop 2023-10-16T13:06:09.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.720+0000 7f5dc2ba6700 1 -- 172.21.15.152:0/4249222008 shutdown_connections 2023-10-16T13:06:09.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.720+0000 7f5dc2ba6700 1 --2- 172.21.15.152:0/4249222008 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5dac0388c0 0x7f5dac03ad80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:09.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.720+0000 7f5dc2ba6700 1 --2- 172.21.15.152:0/4249222008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dbc105a60 0x7f5dbc194fd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:09.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.720+0000 7f5dc2ba6700 1 -- 172.21.15.152:0/4249222008 >> 172.21.15.152:0/4249222008 conn(0x7f5dbc075fa0 msgr2=0x7f5dbc0fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:06:09.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.720+0000 7f5dc2ba6700 1 -- 172.21.15.152:0/4249222008 shutdown_connections 2023-10-16T13:06:09.724 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:09.720+0000 7f5dc2ba6700 1 -- 172.21.15.152:0/4249222008 wait complete. 2023-10-16T13:06:09.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:09 smithi092 ceph-mon[99542]: Updating smithi152:/etc/ceph/ceph.conf 2023-10-16T13:06:09.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:09 smithi092 ceph-mon[99542]: Updating smithi152:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-16T13:06:09.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:09 smithi092 ceph-mon[99542]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-10-16T13:06:09.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:09 smithi092 ceph-mon[99542]: Updating smithi152:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-16T13:06:09.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:09 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:09.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:09 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:09.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:09 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:10.227 DEBUG:teuthology.orchestra.run.smithi118:mon.b> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mon.b.service 2023-10-16T13:06:10.230 DEBUG:teuthology.orchestra.run.smithi152:mon.c> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mon.c.service 2023-10-16T13:06:10.232 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-16T13:06:10.232 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-16T13:06:10.264 INFO:journalctl@ceph.mon.c.smithi152.stdout:-- Logs begin at Mon 2023-10-16 12:49:44 UTC. -- 2023-10-16T13:06:10.266 INFO:journalctl@ceph.mon.b.smithi118.stdout:-- Logs begin at Mon 2023-10-16 12:50:05 UTC. -- 2023-10-16T13:06:10.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:10 smithi092 ceph-mon[99542]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:10.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:10 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:10.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:10 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:10.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:10 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:10.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:10 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:06:10.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:10 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:10.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:10 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-16T13:06:10.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:10 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:11.291 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-16T13:06:11.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:11 smithi092 ceph-mon[99542]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi092:172.21.15.92=a;smithi118:172.21.15.118=b;smithi152:172.21.15.152=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:06:11.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:11 smithi092 ceph-mon[99542]: Saving service mon spec with placement smithi092:172.21.15.92=a;smithi118:172.21.15.118=b;smithi152:172.21.15.152=c;count:3 2023-10-16T13:06:11.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:11 smithi092 ceph-mon[99542]: Deploying daemon mon.c on smithi152 2023-10-16T13:06:12.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.957+0000 7fa43979b700 1 -- 172.21.15.152:0/4058140864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa434106970 msgr2=0x7fa434106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:12.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.957+0000 7fa43979b700 1 --2- 172.21.15.152:0/4058140864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa434106970 0x7fa434106d50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa424009910 tx=0x7fa424009c20 comp rx=0 tx=0).stop 2023-10-16T13:06:12.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.957+0000 7fa43979b700 1 -- 172.21.15.152:0/4058140864 shutdown_connections 2023-10-16T13:06:12.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.957+0000 7fa43979b700 1 --2- 172.21.15.152:0/4058140864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa434106970 0x7fa434106d50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:12.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.957+0000 7fa43979b700 1 -- 172.21.15.152:0/4058140864 >> 172.21.15.152:0/4058140864 conn(0x7fa434075370 msgr2=0x7fa434075780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:06:12.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.957+0000 7fa43979b700 1 -- 172.21.15.152:0/4058140864 shutdown_connections 2023-10-16T13:06:12.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.957+0000 7fa43979b700 1 -- 172.21.15.152:0/4058140864 wait complete. 2023-10-16T13:06:12.962 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.958+0000 7fa43979b700 1 Processor -- start 2023-10-16T13:06:12.962 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.958+0000 7fa43979b700 1 -- start start 2023-10-16T13:06:12.962 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.958+0000 7fa43979b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa434106970 0x7fa434195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:12.962 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.958+0000 7fa43979b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa434196450 con 0x7fa434106970 2023-10-16T13:06:12.962 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.958+0000 7fa432ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa434106970 0x7fa434195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:12.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.959+0000 7fa432ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa434106970 0x7fa434195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.152:44768/0 (socket says 172.21.15.152:44768) 2023-10-16T13:06:12.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.959+0000 7fa432ffd700 1 -- 172.21.15.152:0/2218628134 learned_addr learned my addr 172.21.15.152:0/2218628134 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T13:06:12.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.959+0000 7fa432ffd700 1 -- 172.21.15.152:0/2218628134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4240095f0 con 0x7fa434106970 2023-10-16T13:06:12.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.959+0000 7fa432ffd700 1 --2- 172.21.15.152:0/2218628134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa434106970 0x7fa434195f10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa424005850 tx=0x7fa424004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:06:12.965 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.959+0000 7fa41bfff700 1 -- 172.21.15.152:0/2218628134 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa42401d070 con 0x7fa434106970 2023-10-16T13:06:12.965 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.959+0000 7fa41bfff700 1 -- 172.21.15.152:0/2218628134 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa424004500 con 0x7fa434106970 2023-10-16T13:06:12.965 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.959+0000 7fa41bfff700 1 -- 172.21.15.152:0/2218628134 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4240039f0 con 0x7fa434106970 2023-10-16T13:06:12.965 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.959+0000 7fa43979b700 1 -- 172.21.15.152:0/2218628134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa434196650 con 0x7fa434106970 2023-10-16T13:06:12.965 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.959+0000 7fa43979b700 1 -- 172.21.15.152:0/2218628134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa434196ad0 con 0x7fa434106970 2023-10-16T13:06:12.966 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.960+0000 7fa41bfff700 1 -- 172.21.15.152:0/2218628134 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fa424003cb0 con 0x7fa434106970 2023-10-16T13:06:12.966 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.960+0000 7fa43979b700 1 -- 172.21.15.152:0/2218628134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4340624e0 con 0x7fa434106970 2023-10-16T13:06:12.966 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.961+0000 7fa41bfff700 1 --2- 172.21.15.152:0/2218628134 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa41c0388c0 0x7fa41c03ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:12.966 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.961+0000 7fa41bfff700 1 -- 172.21.15.152:0/2218628134 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa42404cad0 con 0x7fa434106970 2023-10-16T13:06:12.966 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.961+0000 7fa4327fc700 1 --2- 172.21.15.152:0/2218628134 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa41c0388c0 0x7fa41c03ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:12.967 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.961+0000 7fa4327fc700 1 --2- 172.21.15.152:0/2218628134 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa41c0388c0 0x7fa41c03ad80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa428006fd0 tx=0x7fa428006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:06:12.968 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:12.966+0000 7fa41bfff700 1 -- 172.21.15.152:0/2218628134 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa42402a770 con 0x7fa434106970 2023-10-16T13:06:12.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:12 smithi092 ceph-mon[99542]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:13.252 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:13.250+0000 7fa43979b700 1 -- 172.21.15.152:0/2218628134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa43410aed0 con 0x7fa434106970 2023-10-16T13:06:13.252 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:13.250+0000 7fa41bfff700 1 -- 172.21.15.152:0/2218628134 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7fa424020370 con 0x7fa434106970 2023-10-16T13:06:13.253 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T13:06:13.253 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","modified":"2023-10-16T13:04:37.627441Z","created":"2023-10-16T13:04:37.627441Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-16T13:06:13.254 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:13.252+0000 7fa43979b700 1 -- 172.21.15.152:0/2218628134 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa41c0388c0 msgr2=0x7fa41c03ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:13.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:13.252+0000 7fa43979b700 1 --2- 172.21.15.152:0/2218628134 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa41c0388c0 0x7fa41c03ad80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa428006fd0 tx=0x7fa428006e40 comp rx=0 tx=0).stop 2023-10-16T13:06:13.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:13.252+0000 7fa43979b700 1 -- 172.21.15.152:0/2218628134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa434106970 msgr2=0x7fa434195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:13.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:13.252+0000 7fa43979b700 1 --2- 172.21.15.152:0/2218628134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa434106970 0x7fa434195f10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa424005850 tx=0x7fa424004ff0 comp rx=0 tx=0).stop 2023-10-16T13:06:13.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:13.253+0000 7fa43979b700 1 -- 172.21.15.152:0/2218628134 shutdown_connections 2023-10-16T13:06:13.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:13.253+0000 7fa43979b700 1 --2- 172.21.15.152:0/2218628134 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa41c0388c0 0x7fa41c03ad80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:13.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:13.253+0000 7fa43979b700 1 --2- 172.21.15.152:0/2218628134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa434106970 0x7fa434195f10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:13.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:13.253+0000 7fa43979b700 1 -- 172.21.15.152:0/2218628134 >> 172.21.15.152:0/2218628134 conn(0x7fa434075370 msgr2=0x7fa4340fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:06:13.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:13.253+0000 7fa43979b700 1 -- 172.21.15.152:0/2218628134 shutdown_connections 2023-10-16T13:06:13.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:13.253+0000 7fa43979b700 1 -- 172.21.15.152:0/2218628134 wait complete. 2023-10-16T13:06:13.257 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2023-10-16T13:06:13.400 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: Updating smithi152:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-16T13:06:13.401 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-10-16T13:06:13.401 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: Updating smithi152:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-16T13:06:13.401 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:13.401 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:13.402 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:13.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:13.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:13.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:13.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:13.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:06:13.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:13.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-16T13:06:13.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:13.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi092:172.21.15.92=a;smithi118:172.21.15.118=b;smithi152:172.21.15.152=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:06:13.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: Saving service mon spec with placement smithi092:172.21.15.92=a;smithi118:172.21.15.118=b;smithi152:172.21.15.152=c;count:3 2023-10-16T13:06:13.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: Deploying daemon mon.c on smithi152 2023-10-16T13:06:13.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:13.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-16T13:06:13.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-10-16T13:06:13.696 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: expand_channel_meta expand map: {default=false} 2023-10-16T13:06:13.696 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: expand_channel_meta from 'false' to 'false' 2023-10-16T13:06:13.696 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: expand_channel_meta expanded map: {default=false} 2023-10-16T13:06:13.696 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: expand_channel_meta expand map: {default=info} 2023-10-16T13:06:13.696 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: expand_channel_meta from 'info' to 'info' 2023-10-16T13:06:13.696 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: expand_channel_meta expanded map: {default=info} 2023-10-16T13:06:13.697 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: expand_channel_meta expand map: {default=daemon} 2023-10-16T13:06:13.697 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: expand_channel_meta from 'daemon' to 'daemon' 2023-10-16T13:06:13.697 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: expand_channel_meta expanded map: {default=daemon} 2023-10-16T13:06:13.697 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: expand_channel_meta expand map: {default=debug} 2023-10-16T13:06:13.697 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: expand_channel_meta from 'debug' to 'debug' 2023-10-16T13:06:13.698 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 ceph-mon[104423]: expand_channel_meta expanded map: {default=debug} 2023-10-16T13:06:13.698 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:13 smithi152 systemd[1]: Started Ceph mon.c for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:06:14.887 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-16T13:06:14.887 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-16T13:06:15.456 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-16T13:06:18.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:18.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-16T13:06:18.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: mon.a calling monitor election 2023-10-16T13:06:18.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:18.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:18.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:18.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:18.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: mon.c calling monitor election 2023-10-16T13:06:18.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:18.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:18.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:18.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:18.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-16T13:06:18.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: monmap e2: 2 mons at {a=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],c=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} 2023-10-16T13:06:18.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: fsmap 2023-10-16T13:06:18.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: osdmap e4: 0 total, 0 up, 0 in 2023-10-16T13:06:18.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: mgrmap e13: x(active, since 43s) 2023-10-16T13:06:18.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: overall HEALTH_OK 2023-10-16T13:06:18.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:18.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:18.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:18.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-16T13:06:18.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: mon.a calling monitor election 2023-10-16T13:06:19.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:19.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:19.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:19.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:19.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: mon.c calling monitor election 2023-10-16T13:06:19.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:19.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:19.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:19.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:19.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-16T13:06:19.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: monmap e2: 2 mons at {a=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],c=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} 2023-10-16T13:06:19.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: fsmap 2023-10-16T13:06:19.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: osdmap e4: 0 total, 0 up, 0 in 2023-10-16T13:06:19.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: mgrmap e13: x(active, since 43s) 2023-10-16T13:06:19.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: overall HEALTH_OK 2023-10-16T13:06:19.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:19.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:19.636 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.633+0000 7f7d57a18700 1 -- 172.21.15.152:0/809560306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d3c0035c0 msgr2=0x7f7d3c005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:19.636 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.633+0000 7f7d57a18700 1 --2- 172.21.15.152:0/809560306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d3c0035c0 0x7f7d3c005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7d50077920 tx=0x7f7d4000feb0 comp rx=0 tx=0).stop 2023-10-16T13:06:19.636 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.634+0000 7f7d57a18700 1 -- 172.21.15.152:0/809560306 shutdown_connections 2023-10-16T13:06:19.637 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.634+0000 7f7d57a18700 1 --2- 172.21.15.152:0/809560306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d3c0035c0 0x7f7d3c005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:19.637 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.634+0000 7f7d57a18700 1 -- 172.21.15.152:0/809560306 >> 172.21.15.152:0/809560306 conn(0x7f7d50076520 msgr2=0x7f7d50076930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:06:19.637 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.634+0000 7f7d57a18700 1 -- 172.21.15.152:0/809560306 shutdown_connections 2023-10-16T13:06:19.637 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.634+0000 7f7d57a18700 1 -- 172.21.15.152:0/809560306 wait complete. 2023-10-16T13:06:19.639 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.635+0000 7f7d57a18700 1 Processor -- start 2023-10-16T13:06:19.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.635+0000 7f7d57a18700 1 -- start start 2023-10-16T13:06:19.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.635+0000 7f7d57a18700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d3c0035c0 0x7f7d50196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:19.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.635+0000 7f7d57a18700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d50197450 0x7f7d501978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:19.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.635+0000 7f7d57a18700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5019ff80 con 0x7f7d3c0035c0 2023-10-16T13:06:19.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.635+0000 7f7d57a18700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d501a00c0 con 0x7f7d50197450 2023-10-16T13:06:19.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.635+0000 7f7d54fb3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d50197450 0x7f7d501978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:19.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.635+0000 7f7d54fb3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d50197450 0x7f7d501978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45326/0 (socket says 172.21.15.152:45326) 2023-10-16T13:06:19.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.635+0000 7f7d54fb3700 1 -- 172.21.15.152:0/2733671916 learned_addr learned my addr 172.21.15.152:0/2733671916 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T13:06:19.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.635+0000 7f7d557b4700 1 --2- 172.21.15.152:0/2733671916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d3c0035c0 0x7f7d50196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:19.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.635+0000 7f7d54fb3700 1 -- 172.21.15.152:0/2733671916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d50197450 msgr2=0x7f7d501978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-10-16T13:06:19.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.635+0000 7f7d54fb3700 1 -- 172.21.15.152:0/2733671916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d50197450 msgr2=0x7f7d501978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-16T13:06:19.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.635+0000 7f7d54fb3700 1 --2- 172.21.15.152:0/2733671916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d50197450 0x7f7d501978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T13:06:19.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.635+0000 7f7d54fb3700 1 --2- 172.21.15.152:0/2733671916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d50197450 0x7f7d501978d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T13:06:19.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.636+0000 7f7d557b4700 1 -- 172.21.15.152:0/2733671916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d50197450 msgr2=0x7f7d501978d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T13:06:19.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.636+0000 7f7d557b4700 1 --2- 172.21.15.152:0/2733671916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d50197450 0x7f7d501978d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:19.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.636+0000 7f7d557b4700 1 -- 172.21.15.152:0/2733671916 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4000f900 con 0x7f7d3c0035c0 2023-10-16T13:06:19.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.636+0000 7f7d557b4700 1 --2- 172.21.15.152:0/2733671916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d3c0035c0 0x7f7d50196f10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7d40010010 tx=0x7f7d400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:06:19.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.636+0000 7f7d467fc700 1 -- 172.21.15.152:0/2733671916 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f7d40013960 con 0x7f7d3c0035c0 2023-10-16T13:06:19.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.636+0000 7f7d57a18700 1 -- 172.21.15.152:0/2733671916 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d501a0260 con 0x7f7d3c0035c0 2023-10-16T13:06:19.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.636+0000 7f7d467fc700 1 -- 172.21.15.152:0/2733671916 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7d40004030 con 0x7f7d3c0035c0 2023-10-16T13:06:19.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.636+0000 7f7d467fc700 1 -- 172.21.15.152:0/2733671916 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f7d40011be0 con 0x7f7d3c0035c0 2023-10-16T13:06:19.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.636+0000 7f7d57a18700 1 -- 172.21.15.152:0/2733671916 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d501a0780 con 0x7f7d3c0035c0 2023-10-16T13:06:19.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.637+0000 7f7d467fc700 1 -- 172.21.15.152:0/2733671916 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f7d40011d80 con 0x7f7d3c0035c0 2023-10-16T13:06:19.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.637+0000 7f7d467fc700 1 --2- 172.21.15.152:0/2733671916 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7d340386a0 0x7f7d3403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:19.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.638+0000 7f7d467fc700 1 -- 172.21.15.152:0/2733671916 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7d4004dea0 con 0x7f7d3c0035c0 2023-10-16T13:06:19.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.638+0000 7f7d57a18700 1 -- 172.21.15.152:0/2733671916 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d500624e0 con 0x7f7d3c0035c0 2023-10-16T13:06:19.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.638+0000 7f7d54fb3700 1 --2- 172.21.15.152:0/2733671916 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7d340386a0 0x7f7d3403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:19.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.638+0000 7f7d54fb3700 1 --2- 172.21.15.152:0/2733671916 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7d340386a0 0x7f7d3403ab60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7d50069720 tx=0x7f7d4c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:06:19.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.643+0000 7f7d467fc700 1 -- 172.21.15.152:0/2733671916 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7d400109c0 con 0x7f7d3c0035c0 2023-10-16T13:06:19.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.912+0000 7f7d57a18700 1 -- 172.21.15.152:0/2733671916 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7d50107990 con 0x7f7d3c0035c0 2023-10-16T13:06:19.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.913+0000 7f7d467fc700 1 -- 172.21.15.152:0/2733671916 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7f7d400103d0 con 0x7f7d3c0035c0 2023-10-16T13:06:19.915 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T13:06:19.916 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":2,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","modified":"2023-10-16T13:06:13.402805Z","created":"2023-10-16T13:04:37.627441Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-16T13:06:19.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.914+0000 7f7d57a18700 1 -- 172.21.15.152:0/2733671916 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7d340386a0 msgr2=0x7f7d3403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:19.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.914+0000 7f7d57a18700 1 --2- 172.21.15.152:0/2733671916 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7d340386a0 0x7f7d3403ab60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7d50069720 tx=0x7f7d4c008040 comp rx=0 tx=0).stop 2023-10-16T13:06:19.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.915+0000 7f7d57a18700 1 -- 172.21.15.152:0/2733671916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d3c0035c0 msgr2=0x7f7d50196f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:19.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.915+0000 7f7d57a18700 1 --2- 172.21.15.152:0/2733671916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d3c0035c0 0x7f7d50196f10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7d40010010 tx=0x7f7d400057f0 comp rx=0 tx=0).stop 2023-10-16T13:06:19.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.915+0000 7f7d57a18700 1 -- 172.21.15.152:0/2733671916 shutdown_connections 2023-10-16T13:06:19.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.915+0000 7f7d57a18700 1 --2- 172.21.15.152:0/2733671916 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7d340386a0 0x7f7d3403ab60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:19.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.915+0000 7f7d57a18700 1 --2- 172.21.15.152:0/2733671916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d3c0035c0 0x7f7d50196f10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:19.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.915+0000 7f7d57a18700 1 --2- 172.21.15.152:0/2733671916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d50197450 0x7f7d501978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:19.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.915+0000 7f7d57a18700 1 -- 172.21.15.152:0/2733671916 >> 172.21.15.152:0/2733671916 conn(0x7f7d50076520 msgr2=0x7f7d5018d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:06:19.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.915+0000 7f7d57a18700 1 -- 172.21.15.152:0/2733671916 shutdown_connections 2023-10-16T13:06:19.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:19.915+0000 7f7d57a18700 1 -- 172.21.15.152:0/2733671916 wait complete. 2023-10-16T13:06:19.920 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 2 2023-10-16T13:06:19.936 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:19 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:19.936 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:19 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-16T13:06:19.937 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:19 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:19.937 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:19 smithi152 ceph-mon[104423]: Deploying daemon mon.b on smithi118 2023-10-16T13:06:19.937 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:19 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:19.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:19 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:19.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:19 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-16T13:06:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:19 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:19 smithi092 ceph-mon[99542]: Deploying daemon mon.b on smithi118 2023-10-16T13:06:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:19 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:20.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:20 smithi152 ceph-mon[104423]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:20.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:20 smithi152 ceph-mon[104423]: from='client.? 172.21.15.152:0/2733671916' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-16T13:06:20.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:20 smithi092 ceph-mon[99542]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:20.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:20 smithi092 ceph-mon[99542]: from='client.? 172.21.15.152:0/2733671916' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-16T13:06:21.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 systemd[1]: Starting Ceph mon.b for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:06:21.320 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-16T13:06:21.321 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-16T13:06:21.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 podman[103929]: 2023-10-16T13:06:21.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 bash[103929]: 65f2a00cf2787e8a7e1c9cc8b4dae9948f70a89f3fc6f08a7a818a124e22da68 2023-10-16T13:06:21.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: set uid:gid to 167:167 (ceph:ceph) 2023-10-16T13:06:21.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev), process ceph-mon, pid 7 2023-10-16T13:06:21.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: pidfile_write: ignore empty --pid-file 2023-10-16T13:06:21.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: load: jerasure load: lrc 2023-10-16T13:06:21.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: RocksDB version: 7.9.2 2023-10-16T13:06:21.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Git sha 0 2023-10-16T13:06:21.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Compile date 2023-10-13 13:48:46 2023-10-16T13:06:21.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: DB SUMMARY 2023-10-16T13:06:21.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: DB Session ID: J0KQ6WF5LMHPTTNS90O6 2023-10-16T13:06:21.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: CURRENT file: CURRENT 2023-10-16T13:06:21.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: IDENTITY file: IDENTITY 2023-10-16T13:06:21.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-16T13:06:21.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-10-16T13:06:21.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-10-16T13:06:21.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.error_if_exists: 0 2023-10-16T13:06:21.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.create_if_missing: 0 2023-10-16T13:06:21.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.paranoid_checks: 1 2023-10-16T13:06:21.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-16T13:06:21.788 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-16T13:06:21.788 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-16T13:06:21.788 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.env: 0x55752db44da0 2023-10-16T13:06:21.788 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.fs: PosixFileSystem 2023-10-16T13:06:21.788 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.info_log: 0x55752e4bb5e0 2023-10-16T13:06:21.789 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_file_opening_threads: 16 2023-10-16T13:06:21.789 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.statistics: (nil) 2023-10-16T13:06:21.789 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.use_fsync: 0 2023-10-16T13:06:21.789 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_log_file_size: 0 2023-10-16T13:06:21.789 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-16T13:06:21.789 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-16T13:06:21.790 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.keep_log_file_num: 1000 2023-10-16T13:06:21.790 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.recycle_log_file_num: 0 2023-10-16T13:06:21.790 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.allow_fallocate: 1 2023-10-16T13:06:21.790 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.allow_mmap_reads: 0 2023-10-16T13:06:21.790 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.allow_mmap_writes: 0 2023-10-16T13:06:21.791 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.use_direct_reads: 0 2023-10-16T13:06:21.791 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-16T13:06:21.791 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.create_missing_column_families: 0 2023-10-16T13:06:21.791 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.db_log_dir: 2023-10-16T13:06:21.793 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.wal_dir: 2023-10-16T13:06:21.793 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-16T13:06:21.793 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-16T13:06:21.793 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-16T13:06:21.793 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-16T13:06:21.794 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-16T13:06:21.794 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-16T13:06:21.794 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.advise_random_on_open: 1 2023-10-16T13:06:21.794 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.db_write_buffer_size: 0 2023-10-16T13:06:21.794 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.write_buffer_manager: 0x55752e473360 2023-10-16T13:06:21.795 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-16T13:06:21.795 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-16T13:06:21.795 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-16T13:06:21.795 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.rate_limiter: (nil) 2023-10-16T13:06:21.795 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-16T13:06:21.795 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.wal_recovery_mode: 2 2023-10-16T13:06:21.796 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.enable_thread_tracking: 0 2023-10-16T13:06:21.796 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.enable_pipelined_write: 0 2023-10-16T13:06:21.796 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.unordered_write: 0 2023-10-16T13:06:21.796 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-16T13:06:21.796 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-16T13:06:21.797 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-16T13:06:21.797 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-16T13:06:21.797 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.row_cache: None 2023-10-16T13:06:21.797 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.wal_filter: None 2023-10-16T13:06:21.797 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-16T13:06:21.797 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.allow_ingest_behind: 0 2023-10-16T13:06:21.798 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.two_write_queues: 0 2023-10-16T13:06:21.798 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.manual_wal_flush: 0 2023-10-16T13:06:21.798 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.wal_compression: 0 2023-10-16T13:06:21.798 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.atomic_flush: 0 2023-10-16T13:06:21.798 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-16T13:06:21.799 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-16T13:06:21.799 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-16T13:06:21.799 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.log_readahead_size: 0 2023-10-16T13:06:21.799 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-16T13:06:21.799 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.best_efforts_recovery: 0 2023-10-16T13:06:21.800 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-16T13:06:21.800 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-16T13:06:21.800 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.allow_data_in_errors: 0 2023-10-16T13:06:21.800 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.db_host_id: __hostname__ 2023-10-16T13:06:21.800 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-16T13:06:21.801 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_background_jobs: 2 2023-10-16T13:06:21.801 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_background_compactions: -1 2023-10-16T13:06:21.801 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_subcompactions: 1 2023-10-16T13:06:21.801 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-16T13:06:21.801 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-16T13:06:21.802 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-16T13:06:21.802 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_total_wal_size: 0 2023-10-16T13:06:21.802 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-16T13:06:21.802 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-16T13:06:21.802 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-16T13:06:21.803 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-16T13:06:21.803 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_open_files: -1 2023-10-16T13:06:21.803 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.bytes_per_sync: 0 2023-10-16T13:06:21.803 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-16T13:06:21.803 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-16T13:06:21.803 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compaction_readahead_size: 0 2023-10-16T13:06:21.804 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_background_flushes: -1 2023-10-16T13:06:21.804 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Compression algorithms supported: 2023-10-16T13:06:21.804 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-16T13:06:21.804 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: kZSTD supported: 0 2023-10-16T13:06:21.804 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: kXpressCompression supported: 0 2023-10-16T13:06:21.804 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: kLZ4HCCompression supported: 1 2023-10-16T13:06:21.805 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: kZlibCompression supported: 1 2023-10-16T13:06:21.805 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: kSnappyCompression supported: 1 2023-10-16T13:06:21.805 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: kLZ4Compression supported: 1 2023-10-16T13:06:21.805 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: kBZip2Compression supported: 0 2023-10-16T13:06:21.805 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-16T13:06:21.806 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-16T13:06:21.806 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-10-16T13:06:21.806 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-16T13:06:21.806 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-16T13:06:21.806 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.merge_operator: 2023-10-16T13:06:21.807 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compaction_filter: None 2023-10-16T13:06:21.807 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compaction_filter_factory: None 2023-10-16T13:06:21.807 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.sst_partitioner_factory: None 2023-10-16T13:06:21.807 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-16T13:06:21.807 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-16T13:06:21.807 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55752e4bb6e0) 2023-10-16T13:06:21.808 INFO:journalctl@ceph.mon.b.smithi118.stdout: cache_index_and_filter_blocks: 1 2023-10-16T13:06:21.808 INFO:journalctl@ceph.mon.b.smithi118.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-16T13:06:21.808 INFO:journalctl@ceph.mon.b.smithi118.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-16T13:06:21.808 INFO:journalctl@ceph.mon.b.smithi118.stdout: pin_top_level_index_and_filter: 1 2023-10-16T13:06:21.808 INFO:journalctl@ceph.mon.b.smithi118.stdout: index_type: 0 2023-10-16T13:06:21.808 INFO:journalctl@ceph.mon.b.smithi118.stdout: data_block_index_type: 0 2023-10-16T13:06:21.809 INFO:journalctl@ceph.mon.b.smithi118.stdout: index_shortening: 1 2023-10-16T13:06:21.809 INFO:journalctl@ceph.mon.b.smithi118.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-16T13:06:21.809 INFO:journalctl@ceph.mon.b.smithi118.stdout: checksum: 4 2023-10-16T13:06:21.809 INFO:journalctl@ceph.mon.b.smithi118.stdout: no_block_cache: 0 2023-10-16T13:06:21.809 INFO:journalctl@ceph.mon.b.smithi118.stdout: block_cache: 0x55752e5111f0 2023-10-16T13:06:21.809 INFO:journalctl@ceph.mon.b.smithi118.stdout: block_cache_name: BinnedLRUCache 2023-10-16T13:06:21.810 INFO:journalctl@ceph.mon.b.smithi118.stdout: block_cache_options: 2023-10-16T13:06:21.810 INFO:journalctl@ceph.mon.b.smithi118.stdout: capacity : 536870912 2023-10-16T13:06:21.810 INFO:journalctl@ceph.mon.b.smithi118.stdout: num_shard_bits : 4 2023-10-16T13:06:21.810 INFO:journalctl@ceph.mon.b.smithi118.stdout: strict_capacity_limit : 0 2023-10-16T13:06:21.810 INFO:journalctl@ceph.mon.b.smithi118.stdout: high_pri_pool_ratio: 0.000 2023-10-16T13:06:21.811 INFO:journalctl@ceph.mon.b.smithi118.stdout: block_cache_compressed: (nil) 2023-10-16T13:06:21.811 INFO:journalctl@ceph.mon.b.smithi118.stdout: persistent_cache: (nil) 2023-10-16T13:06:21.811 INFO:journalctl@ceph.mon.b.smithi118.stdout: block_size: 4096 2023-10-16T13:06:21.811 INFO:journalctl@ceph.mon.b.smithi118.stdout: block_size_deviation: 10 2023-10-16T13:06:21.811 INFO:journalctl@ceph.mon.b.smithi118.stdout: block_restart_interval: 16 2023-10-16T13:06:21.812 INFO:journalctl@ceph.mon.b.smithi118.stdout: index_block_restart_interval: 1 2023-10-16T13:06:21.812 INFO:journalctl@ceph.mon.b.smithi118.stdout: metadata_block_size: 4096 2023-10-16T13:06:21.812 INFO:journalctl@ceph.mon.b.smithi118.stdout: partition_filters: 0 2023-10-16T13:06:21.812 INFO:journalctl@ceph.mon.b.smithi118.stdout: use_delta_encoding: 1 2023-10-16T13:06:21.812 INFO:journalctl@ceph.mon.b.smithi118.stdout: filter_policy: bloomfilter 2023-10-16T13:06:21.813 INFO:journalctl@ceph.mon.b.smithi118.stdout: whole_key_filtering: 1 2023-10-16T13:06:21.813 INFO:journalctl@ceph.mon.b.smithi118.stdout: verify_compression: 0 2023-10-16T13:06:21.813 INFO:journalctl@ceph.mon.b.smithi118.stdout: read_amp_bytes_per_bit: 0 2023-10-16T13:06:21.813 INFO:journalctl@ceph.mon.b.smithi118.stdout: format_version: 5 2023-10-16T13:06:21.813 INFO:journalctl@ceph.mon.b.smithi118.stdout: enable_index_compression: 1 2023-10-16T13:06:21.813 INFO:journalctl@ceph.mon.b.smithi118.stdout: block_align: 0 2023-10-16T13:06:21.814 INFO:journalctl@ceph.mon.b.smithi118.stdout: max_auto_readahead_size: 262144 2023-10-16T13:06:21.814 INFO:journalctl@ceph.mon.b.smithi118.stdout: prepopulate_block_cache: 0 2023-10-16T13:06:21.814 INFO:journalctl@ceph.mon.b.smithi118.stdout: initial_auto_readahead_size: 8192 2023-10-16T13:06:21.814 INFO:journalctl@ceph.mon.b.smithi118.stdout: num_file_reads_for_auto_readahead: 2 2023-10-16T13:06:21.814 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.write_buffer_size: 33554432 2023-10-16T13:06:21.815 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_write_buffer_number: 2 2023-10-16T13:06:21.815 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compression: NoCompression 2023-10-16T13:06:21.815 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.bottommost_compression: Disabled 2023-10-16T13:06:21.815 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.prefix_extractor: nullptr 2023-10-16T13:06:21.815 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-16T13:06:21.815 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.num_levels: 7 2023-10-16T13:06:21.816 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-16T13:06:21.816 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-16T13:06:21.816 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-16T13:06:21.816 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-16T13:06:21.816 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-16T13:06:21.816 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-16T13:06:21.817 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-16T13:06:21.817 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-16T13:06:21.817 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-16T13:06:21.817 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-16T13:06:21.817 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-16T13:06:21.817 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-16T13:06:21.818 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-16T13:06:21.818 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compression_opts.level: 32767 2023-10-16T13:06:21.818 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compression_opts.strategy: 0 2023-10-16T13:06:21.818 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-16T13:06:21.818 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-16T13:06:21.819 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-16T13:06:21.819 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-16T13:06:21.819 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compression_opts.enabled: false 2023-10-16T13:06:21.819 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-16T13:06:21.819 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-16T13:06:21.819 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-16T13:06:21.820 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-16T13:06:21.820 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.target_file_size_base: 67108864 2023-10-16T13:06:21.820 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-16T13:06:21.820 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-16T13:06:21.820 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-16T13:06:21.820 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-16T13:06:21.821 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-16T13:06:21.821 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-16T13:06:21.821 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-16T13:06:21.821 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-16T13:06:21.821 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-16T13:06:21.821 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-16T13:06:21.822 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-16T13:06:21.822 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-16T13:06:21.822 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-16T13:06:21.822 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-16T13:06:21.822 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.arena_block_size: 1048576 2023-10-16T13:06:21.823 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-16T13:06:21.823 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-16T13:06:21.823 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.disable_auto_compactions: 0 2023-10-16T13:06:21.823 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-16T13:06:21.823 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-16T13:06:21.823 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-16T13:06:21.824 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-16T13:06:21.824 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-16T13:06:21.824 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-16T13:06:21.824 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-16T13:06:21.824 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-16T13:06:21.824 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-16T13:06:21.825 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-16T13:06:21.825 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.table_properties_collectors: 2023-10-16T13:06:21.825 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.inplace_update_support: 0 2023-10-16T13:06:21.825 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-16T13:06:21.825 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-16T13:06:21.825 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-16T13:06:21.826 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-16T13:06:21.826 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.bloom_locality: 0 2023-10-16T13:06:21.826 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.max_successive_merges: 0 2023-10-16T13:06:21.826 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-16T13:06:21.826 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.paranoid_file_checks: 0 2023-10-16T13:06:21.827 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.force_consistency_checks: 1 2023-10-16T13:06:21.827 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.report_bg_io_stats: 0 2023-10-16T13:06:21.827 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.ttl: 2592000 2023-10-16T13:06:21.827 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-16T13:06:21.827 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-16T13:06:21.827 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-16T13:06:21.828 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.enable_blob_files: false 2023-10-16T13:06:21.828 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.min_blob_size: 0 2023-10-16T13:06:21.828 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.blob_file_size: 268435456 2023-10-16T13:06:21.828 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-16T13:06:21.828 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-16T13:06:21.829 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-16T13:06:21.829 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-16T13:06:21.829 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-16T13:06:21.829 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.blob_file_starting_level: 0 2023-10-16T13:06:21.829 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-16T13:06:21.829 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-16T13:06:21.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-16T13:06:21.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 26349a65-74c8-4a14-a62e-a2694a396cb6 2023-10-16T13:06:21.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697461581543825, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-16T13:06:21.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-16T13:06:21.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697461581544237, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1697461581, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "26349a65-74c8-4a14-a62e-a2694a396cb6", "db_session_id": "J0KQ6WF5LMHPTTNS90O6", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-16T13:06:21.831 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697461581544302, "job": 1, "event": "recovery_finished"} 2023-10-16T13:06:21.831 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-16T13:06:21.831 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-16T13:06:21.831 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55752e5ae000 2023-10-16T13:06:21.831 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: DB pointer 0x55752e59a000 2023-10-16T13:06:21.832 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-16T13:06:21.832 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-16T13:06:21.832 INFO:journalctl@ceph.mon.b.smithi118.stdout: ** DB Stats ** 2023-10-16T13:06:21.832 INFO:journalctl@ceph.mon.b.smithi118.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-16T13:06:21.832 INFO:journalctl@ceph.mon.b.smithi118.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-16T13:06:21.832 INFO:journalctl@ceph.mon.b.smithi118.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-16T13:06:21.833 INFO:journalctl@ceph.mon.b.smithi118.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-16T13:06:21.833 INFO:journalctl@ceph.mon.b.smithi118.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-16T13:06:21.833 INFO:journalctl@ceph.mon.b.smithi118.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-16T13:06:21.833 INFO:journalctl@ceph.mon.b.smithi118.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-16T13:06:21.833 INFO:journalctl@ceph.mon.b.smithi118.stdout: 2023-10-16T13:06:21.833 INFO:journalctl@ceph.mon.b.smithi118.stdout: ** Compaction Stats [default] ** 2023-10-16T13:06:21.834 INFO:journalctl@ceph.mon.b.smithi118.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-16T13:06:21.834 INFO:journalctl@ceph.mon.b.smithi118.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-16T13:06:21.834 INFO:journalctl@ceph.mon.b.smithi118.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-16T13:06:21.834 INFO:journalctl@ceph.mon.b.smithi118.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-16T13:06:21.834 INFO:journalctl@ceph.mon.b.smithi118.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-16T13:06:21.835 INFO:journalctl@ceph.mon.b.smithi118.stdout: 2023-10-16T13:06:21.835 INFO:journalctl@ceph.mon.b.smithi118.stdout: ** Compaction Stats [default] ** 2023-10-16T13:06:21.835 INFO:journalctl@ceph.mon.b.smithi118.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-16T13:06:21.835 INFO:journalctl@ceph.mon.b.smithi118.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-16T13:06:21.836 INFO:journalctl@ceph.mon.b.smithi118.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-16T13:06:21.836 INFO:journalctl@ceph.mon.b.smithi118.stdout: 2023-10-16T13:06:21.836 INFO:journalctl@ceph.mon.b.smithi118.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-16T13:06:21.836 INFO:journalctl@ceph.mon.b.smithi118.stdout: 2023-10-16T13:06:21.836 INFO:journalctl@ceph.mon.b.smithi118.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-16T13:06:21.837 INFO:journalctl@ceph.mon.b.smithi118.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-16T13:06:21.837 INFO:journalctl@ceph.mon.b.smithi118.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-16T13:06:21.837 INFO:journalctl@ceph.mon.b.smithi118.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-16T13:06:21.837 INFO:journalctl@ceph.mon.b.smithi118.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-16T13:06:21.837 INFO:journalctl@ceph.mon.b.smithi118.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-16T13:06:21.837 INFO:journalctl@ceph.mon.b.smithi118.stdout: Cumulative compaction: 0.00 GB write, 0.70 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-16T13:06:21.838 INFO:journalctl@ceph.mon.b.smithi118.stdout: Interval compaction: 0.00 GB write, 0.70 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-16T13:06:21.838 INFO:journalctl@ceph.mon.b.smithi118.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-16T13:06:21.838 INFO:journalctl@ceph.mon.b.smithi118.stdout: Block cache BinnedLRUCache@0x55752e5111f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2023-10-16T13:06:21.838 INFO:journalctl@ceph.mon.b.smithi118.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-16T13:06:21.838 INFO:journalctl@ceph.mon.b.smithi118.stdout: 2023-10-16T13:06:21.839 INFO:journalctl@ceph.mon.b.smithi118.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-16T13:06:21.839 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-10-16T13:06:21.839 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: using public_addr v2:172.21.15.118:0/0 -> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2023-10-16T13:06:21.839 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: starting mon.b rank -1 at public addrs [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] at bind addrs [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:06:21.839 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mon.b@-1(???) e0 preinit fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:06:21.840 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 systemd[1]: Started Ceph mon.b for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:06:21.840 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mon.b@-1(synchronizing).mds e1 new map 2023-10-16T13:06:21.840 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mon.b@-1(synchronizing).mds e1 print_map 2023-10-16T13:06:21.840 INFO:journalctl@ceph.mon.b.smithi118.stdout: e1 2023-10-16T13:06:21.840 INFO:journalctl@ceph.mon.b.smithi118.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-16T13:06:21.840 INFO:journalctl@ceph.mon.b.smithi118.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-16T13:06:21.841 INFO:journalctl@ceph.mon.b.smithi118.stdout: legacy client fscid: -1 2023-10-16T13:06:21.841 INFO:journalctl@ceph.mon.b.smithi118.stdout: 2023-10-16T13:06:21.841 INFO:journalctl@ceph.mon.b.smithi118.stdout: No filesystems configured 2023-10-16T13:06:21.841 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-16T13:06:21.841 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-16T13:06:21.842 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-16T13:06:21.842 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-16T13:06:21.842 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-16T13:06:21.842 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-16T13:06:21.842 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-16T13:06:21.843 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-16T13:06:21.843 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-16T13:06:21.843 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-16T13:06:21.843 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi152", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:06:21.843 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: Updating smithi118:/etc/ceph/ceph.conf 2023-10-16T13:06:21.844 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: Deploying cephadm binary to smithi152 2023-10-16T13:06:21.844 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: Updating smithi118:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-16T13:06:21.844 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: Updating smithi118:/etc/ceph/ceph.client.admin.keyring 2023-10-16T13:06:21.844 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:21.844 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:21.844 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:21.845 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:21.845 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:21.845 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:21.845 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: Updating smithi118:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-16T13:06:21.845 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: Added host smithi152 2023-10-16T13:06:21.846 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:21.846 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:21.846 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:21.846 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:21.846 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:06:21.847 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:21.847 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/177238790' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-16T13:06:21.847 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/177238790' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-16T13:06:21.847 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: osdmap e4: 0 total, 0 up, 0 in 2023-10-16T13:06:21.847 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:21.848 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:21.848 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:21.848 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:21.848 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:21.848 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi152", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:06:21.848 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:21.849 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:06:21.849 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: Updating smithi152:/etc/ceph/ceph.conf 2023-10-16T13:06:21.849 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: Updating smithi152:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-16T13:06:21.849 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-10-16T13:06:21.849 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: Updating smithi152:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-16T13:06:21.850 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:21.850 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:21.850 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:21.850 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:21.851 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:21.851 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:21.851 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:21.851 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:06:21.851 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:21.851 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-16T13:06:21.852 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:21.852 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi092:172.21.15.92=a;smithi118:172.21.15.118=b;smithi152:172.21.15.152=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:06:21.852 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: Saving service mon spec with placement smithi092:172.21.15.92=a;smithi118:172.21.15.118=b;smithi152:172.21.15.152=c;count:3 2023-10-16T13:06:21.852 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: Deploying daemon mon.c on smithi152 2023-10-16T13:06:21.852 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:21.853 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:21.853 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-16T13:06:21.853 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mon.a calling monitor election 2023-10-16T13:06:21.853 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:21.853 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:21.854 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:21.854 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:21.854 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mon.c calling monitor election 2023-10-16T13:06:21.854 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:21.854 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:21.855 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:21.855 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:21.855 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-16T13:06:21.855 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: monmap e2: 2 mons at {a=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],c=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} 2023-10-16T13:06:21.855 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: fsmap 2023-10-16T13:06:21.856 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: osdmap e4: 0 total, 0 up, 0 in 2023-10-16T13:06:21.856 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mgrmap e13: x(active, since 43s) 2023-10-16T13:06:21.856 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: overall HEALTH_OK 2023-10-16T13:06:21.856 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:21.856 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:21.856 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:21.857 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-16T13:06:21.857 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:21.857 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: Deploying daemon mon.b on smithi118 2023-10-16T13:06:21.857 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:21.857 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:21.858 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: from='client.? 172.21.15.152:0/2733671916' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-16T13:06:21.858 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-16T13:06:21.858 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-10-16T13:06:21.858 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: expand_channel_meta expand map: {default=false} 2023-10-16T13:06:21.858 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: expand_channel_meta from 'false' to 'false' 2023-10-16T13:06:21.859 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: expand_channel_meta expanded map: {default=false} 2023-10-16T13:06:21.859 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: expand_channel_meta expand map: {default=info} 2023-10-16T13:06:21.859 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: expand_channel_meta from 'info' to 'info' 2023-10-16T13:06:21.859 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: expand_channel_meta expanded map: {default=info} 2023-10-16T13:06:21.859 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: expand_channel_meta expand map: {default=daemon} 2023-10-16T13:06:21.859 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: expand_channel_meta from 'daemon' to 'daemon' 2023-10-16T13:06:21.860 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: expand_channel_meta expanded map: {default=daemon} 2023-10-16T13:06:21.860 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: expand_channel_meta expand map: {default=debug} 2023-10-16T13:06:21.860 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: expand_channel_meta from 'debug' to 'debug' 2023-10-16T13:06:21.860 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:21 smithi118 ceph-mon[103969]: expand_channel_meta expanded map: {default=debug} 2023-10-16T13:06:21.893 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-16T13:06:26.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.780+0000 7ff84153a700 1 -- 172.21.15.152:0/1661995122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8240057d0 msgr2=0x7ff824007c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:26.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.780+0000 7ff84153a700 1 --2- 172.21.15.152:0/1661995122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8240057d0 0x7ff824007c60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff83c077150 tx=0x7ff830014ec0 comp rx=0 tx=0).stop 2023-10-16T13:06:26.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.780+0000 7ff84153a700 1 -- 172.21.15.152:0/1661995122 shutdown_connections 2023-10-16T13:06:26.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.780+0000 7ff84153a700 1 --2- 172.21.15.152:0/1661995122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8240057d0 0x7ff824007c60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:26.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.780+0000 7ff84153a700 1 -- 172.21.15.152:0/1661995122 >> 172.21.15.152:0/1661995122 conn(0x7ff83c0fb050 msgr2=0x7ff83c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:06:26.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.780+0000 7ff84153a700 1 -- 172.21.15.152:0/1661995122 shutdown_connections 2023-10-16T13:06:26.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.780+0000 7ff84153a700 1 -- 172.21.15.152:0/1661995122 wait complete. 2023-10-16T13:06:26.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.781+0000 7ff84153a700 1 Processor -- start 2023-10-16T13:06:26.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.782+0000 7ff84153a700 1 -- start start 2023-10-16T13:06:26.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.782+0000 7ff84153a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8240057d0 0x7ff83c193fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:26.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.782+0000 7ff84153a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff83c1944f0 0x7ff83c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:26.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.782+0000 7ff84153a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff83c198ea0 0x7ff83c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:26.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.782+0000 7ff84153a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c194be0 con 0x7ff83c1944f0 2023-10-16T13:06:26.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.782+0000 7ff84153a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c1a0c10 con 0x7ff83c198ea0 2023-10-16T13:06:26.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.782+0000 7ff84153a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c1a0d50 con 0x7ff8240057d0 2023-10-16T13:06:26.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.782+0000 7ff83affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8240057d0 0x7ff83c193fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:26.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.782+0000 7ff83affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8240057d0 0x7ff83c193fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45348/0 (socket says 172.21.15.152:45348) 2023-10-16T13:06:26.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.782+0000 7ff83affd700 1 -- 172.21.15.152:0/812967722 learned_addr learned my addr 172.21.15.152:0/812967722 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T13:06:26.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.782+0000 7ff83affd700 1 -- 172.21.15.152:0/812967722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8240057d0 msgr2=0x7ff83c193fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-10-16T13:06:26.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.782+0000 7ff83affd700 1 -- 172.21.15.152:0/812967722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8240057d0 msgr2=0x7ff83c193fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-16T13:06:26.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.782+0000 7ff83affd700 1 --2- 172.21.15.152:0/812967722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8240057d0 0x7ff83c193fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T13:06:26.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.782+0000 7ff83a7fc700 1 --2- 172.21.15.152:0/812967722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff83c1944f0 0x7ff83c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:26.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.782+0000 7ff83affd700 1 --2- 172.21.15.152:0/812967722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8240057d0 0x7ff83c193fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T13:06:26.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.782+0000 7ff83b7fe700 1 --2- 172.21.15.152:0/812967722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff83c198ea0 0x7ff83c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:26.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.782+0000 7ff83b7fe700 1 -- 172.21.15.152:0/812967722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff83c198ea0 msgr2=0x7ff83c199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-10-16T13:06:26.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.782+0000 7ff83b7fe700 1 -- 172.21.15.152:0/812967722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff83c198ea0 msgr2=0x7ff83c199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-16T13:06:26.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.782+0000 7ff83b7fe700 1 --2- 172.21.15.152:0/812967722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff83c198ea0 0x7ff83c199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T13:06:26.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.783+0000 7ff83b7fe700 1 --2- 172.21.15.152:0/812967722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff83c198ea0 0x7ff83c199350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T13:06:26.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.783+0000 7ff83a7fc700 1 -- 172.21.15.152:0/812967722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8240057d0 msgr2=0x7ff83c193fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T13:06:26.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.783+0000 7ff83a7fc700 1 --2- 172.21.15.152:0/812967722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8240057d0 0x7ff83c193fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:26.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.783+0000 7ff83a7fc700 1 -- 172.21.15.152:0/812967722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff83c198ea0 msgr2=0x7ff83c199350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T13:06:26.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.783+0000 7ff83a7fc700 1 --2- 172.21.15.152:0/812967722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff83c198ea0 0x7ff83c199350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:26.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.783+0000 7ff83a7fc700 1 -- 172.21.15.152:0/812967722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff830014910 con 0x7ff83c1944f0 2023-10-16T13:06:26.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.783+0000 7ff83a7fc700 1 --2- 172.21.15.152:0/812967722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff83c1944f0 0x7ff83c198960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00b550 tx=0x7ff82c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:06:26.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.783+0000 7ff823fff700 1 -- 172.21.15.152:0/812967722 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c004230 con 0x7ff83c1944f0 2023-10-16T13:06:26.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.783+0000 7ff823fff700 1 -- 172.21.15.152:0/812967722 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff82c004390 con 0x7ff83c1944f0 2023-10-16T13:06:26.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.783+0000 7ff84153a700 1 -- 172.21.15.152:0/812967722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83c1a0fd0 con 0x7ff83c1944f0 2023-10-16T13:06:26.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.783+0000 7ff823fff700 1 -- 172.21.15.152:0/812967722 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c011b90 con 0x7ff83c1944f0 2023-10-16T13:06:26.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.783+0000 7ff84153a700 1 -- 172.21.15.152:0/812967722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83c1a1520 con 0x7ff83c1944f0 2023-10-16T13:06:26.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.784+0000 7ff823fff700 1 -- 172.21.15.152:0/812967722 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7ff82c011cf0 con 0x7ff83c1944f0 2023-10-16T13:06:26.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.785+0000 7ff84153a700 1 -- 172.21.15.152:0/812967722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83c0624e0 con 0x7ff83c1944f0 2023-10-16T13:06:26.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.785+0000 7ff823fff700 1 --2- 172.21.15.152:0/812967722 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff828038d90 0x7ff82803b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:26.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.785+0000 7ff823fff700 1 -- 172.21.15.152:0/812967722 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff82c04af40 con 0x7ff83c1944f0 2023-10-16T13:06:26.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.785+0000 7ff83affd700 1 --2- 172.21.15.152:0/812967722 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff828038d90 0x7ff82803b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:26.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.786+0000 7ff83affd700 1 --2- 172.21.15.152:0/812967722 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff828038d90 0x7ff82803b250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff83000f470 tx=0x7ff83000f400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:06:26.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:26.790+0000 7ff823fff700 1 -- 172.21.15.152:0/812967722 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff82c01a400 con 0x7ff83c1944f0 2023-10-16T13:06:26.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: mon.c calling monitor election 2023-10-16T13:06:26.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-16T13:06:26.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: mon.a calling monitor election 2023-10-16T13:06:26.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:26.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:26.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:26.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:26.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:26.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:26.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:26.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:26.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:26.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-16T13:06:26.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: monmap e3: 3 mons at {a=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],b=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0],c=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} 2023-10-16T13:06:26.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: fsmap 2023-10-16T13:06:26.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: osdmap e4: 0 total, 0 up, 0 in 2023-10-16T13:06:26.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: mgrmap e13: x(active, since 51s) 2023-10-16T13:06:26.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-16T13:06:26.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-16T13:06:26.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-16T13:06:26.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: mon.b (rank 2) addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] is down (out of quorum) 2023-10-16T13:06:26.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:26.948 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: mon.c calling monitor election 2023-10-16T13:06:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-16T13:06:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: mon.a calling monitor election 2023-10-16T13:06:26.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:26.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:26.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:27.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:27.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:27.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-16T13:06:27.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: monmap e3: 3 mons at {a=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],b=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0],c=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} 2023-10-16T13:06:27.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: fsmap 2023-10-16T13:06:27.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: osdmap e4: 0 total, 0 up, 0 in 2023-10-16T13:06:27.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: mgrmap e13: x(active, since 51s) 2023-10-16T13:06:27.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-16T13:06:27.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-16T13:06:27.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-16T13:06:27.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: mon.b (rank 2) addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] is down (out of quorum) 2023-10-16T13:06:27.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:27.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:27.086 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:27.084+0000 7ff84153a700 1 -- 172.21.15.152:0/812967722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff83c106910 con 0x7ff83c1944f0 2023-10-16T13:06:27.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:27.084+0000 7ff823fff700 1 -- 172.21.15.152:0/812967722 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1274 (secure 0 0 0) 0x7ff82c004570 con 0x7ff83c1944f0 2023-10-16T13:06:27.087 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T13:06:27.087 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":3,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","modified":"2023-10-16T13:06:21.566165Z","created":"2023-10-16T13:04:37.627441Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-16T13:06:27.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:27.087+0000 7ff84153a700 1 -- 172.21.15.152:0/812967722 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff828038d90 msgr2=0x7ff82803b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:27.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:27.087+0000 7ff84153a700 1 --2- 172.21.15.152:0/812967722 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff828038d90 0x7ff82803b250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff83000f470 tx=0x7ff83000f400 comp rx=0 tx=0).stop 2023-10-16T13:06:27.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:27.087+0000 7ff84153a700 1 -- 172.21.15.152:0/812967722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff83c1944f0 msgr2=0x7ff83c198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:27.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:27.087+0000 7ff84153a700 1 --2- 172.21.15.152:0/812967722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff83c1944f0 0x7ff83c198960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00b550 tx=0x7ff82c00b910 comp rx=0 tx=0).stop 2023-10-16T13:06:27.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:27.087+0000 7ff84153a700 1 -- 172.21.15.152:0/812967722 shutdown_connections 2023-10-16T13:06:27.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:27.087+0000 7ff84153a700 1 --2- 172.21.15.152:0/812967722 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff828038d90 0x7ff82803b250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:27.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:27.087+0000 7ff84153a700 1 --2- 172.21.15.152:0/812967722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff83c198ea0 0x7ff83c199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:27.091 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:27.087+0000 7ff84153a700 1 --2- 172.21.15.152:0/812967722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8240057d0 0x7ff83c193fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:27.091 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:27.087+0000 7ff84153a700 1 --2- 172.21.15.152:0/812967722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff83c1944f0 0x7ff83c198960 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:27.091 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:27.087+0000 7ff84153a700 1 -- 172.21.15.152:0/812967722 >> 172.21.15.152:0/812967722 conn(0x7ff83c0fb050 msgr2=0x7ff83c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:06:27.091 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:27.087+0000 7ff84153a700 1 -- 172.21.15.152:0/812967722 shutdown_connections 2023-10-16T13:06:27.091 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:27.087+0000 7ff84153a700 1 -- 172.21.15.152:0/812967722 wait complete. 2023-10-16T13:06:27.092 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 3 2023-10-16T13:06:27.456 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-10-16T13:06:27.457 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph config generate-minimal-conf 2023-10-16T13:06:27.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:27 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:27.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:27 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:27.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:27 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:27.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:27 smithi092 ceph-mon[99542]: from='client.? 172.21.15.152:0/812967722' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-16T13:06:27.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:27 smithi092 ceph-mon[99542]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:27.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:27 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:27.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:27 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:27.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:27 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:27.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:27 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:27.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:27 smithi152 ceph-mon[104423]: from='client.? 172.21.15.152:0/812967722' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-16T13:06:27.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:27 smithi152 ceph-mon[104423]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:27.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:27 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:28.029 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:06:29.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: mon.c calling monitor election 2023-10-16T13:06:29.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-16T13:06:29.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: mon.a calling monitor election 2023-10-16T13:06:29.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:29.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:06:29.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:29.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:29.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:29.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:29.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:29.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:29.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:29.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-16T13:06:29.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: monmap e3: 3 mons at {a=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],b=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0],c=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} 2023-10-16T13:06:29.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: fsmap 2023-10-16T13:06:29.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: osdmap e4: 0 total, 0 up, 0 in 2023-10-16T13:06:29.038 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: mgrmap e13: x(active, since 51s) 2023-10-16T13:06:29.038 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-16T13:06:29.038 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-16T13:06:29.038 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-16T13:06:29.039 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: mon.b (rank 2) addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] is down (out of quorum) 2023-10-16T13:06:29.039 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.039 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.039 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.040 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.040 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:29.040 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: from='client.? 172.21.15.152:0/812967722' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-16T13:06:29.040 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:29.040 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:29.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.339+0000 7fc9ef422700 1 -- 172.21.15.92:0/2460377755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e8105860 msgr2=0x7fc9e8105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:29.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.339+0000 7fc9ef422700 1 --2- 172.21.15.92:0/2460377755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e8105860 0x7fc9e8105c40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8009910 tx=0x7fc9d8009c20 comp rx=0 tx=0).stop 2023-10-16T13:06:29.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.339+0000 7fc9ef422700 1 -- 172.21.15.92:0/2460377755 shutdown_connections 2023-10-16T13:06:29.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.339+0000 7fc9ef422700 1 --2- 172.21.15.92:0/2460377755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e8105860 0x7fc9e8105c40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:29.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.339+0000 7fc9ef422700 1 -- 172.21.15.92:0/2460377755 >> 172.21.15.92:0/2460377755 conn(0x7fc9e8075370 msgr2=0x7fc9e8075780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:06:29.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.339+0000 7fc9ef422700 1 -- 172.21.15.92:0/2460377755 shutdown_connections 2023-10-16T13:06:29.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.339+0000 7fc9ef422700 1 -- 172.21.15.92:0/2460377755 wait complete. 2023-10-16T13:06:29.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.340+0000 7fc9ef422700 1 Processor -- start 2023-10-16T13:06:29.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.340+0000 7fc9ef422700 1 -- start start 2023-10-16T13:06:29.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.340+0000 7fc9ef422700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e8105860 0x7fc9e8194fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:29.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.340+0000 7fc9ef422700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9e81954f0 0x7fc9e8199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:29.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.340+0000 7fc9ef422700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9e8199ea0 0x7fc9e819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:29.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.340+0000 7fc9ef422700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e8195be0 con 0x7fc9e8105860 2023-10-16T13:06:29.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.340+0000 7fc9ef422700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e81a1c10 con 0x7fc9e81954f0 2023-10-16T13:06:29.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.340+0000 7fc9ef422700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e81a1d50 con 0x7fc9e8199ea0 2023-10-16T13:06:29.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.340+0000 7fc9ed1be700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e8105860 0x7fc9e8194fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:29.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.340+0000 7fc9ed1be700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e8105860 0x7fc9e8194fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34292/0 (socket says 172.21.15.92:34292) 2023-10-16T13:06:29.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.340+0000 7fc9ed1be700 1 -- 172.21.15.92:0/2282696936 learned_addr learned my addr 172.21.15.92:0/2282696936 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:06:29.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.340+0000 7fc9ed1be700 1 -- 172.21.15.92:0/2282696936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9e8199ea0 msgr2=0x7fc9e819a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:29.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.340+0000 7fc9ed1be700 1 --2- 172.21.15.92:0/2282696936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9e8199ea0 0x7fc9e819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:29.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.340+0000 7fc9ed1be700 1 -- 172.21.15.92:0/2282696936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9e81954f0 msgr2=0x7fc9e8199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:29.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.340+0000 7fc9ed1be700 1 --2- 172.21.15.92:0/2282696936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9e81954f0 0x7fc9e8199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:29.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.340+0000 7fc9ed1be700 1 -- 172.21.15.92:0/2282696936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d80095f0 con 0x7fc9e8105860 2023-10-16T13:06:29.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.341+0000 7fc9ed1be700 1 --2- 172.21.15.92:0/2282696936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e8105860 0x7fc9e8194fb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8004cb0 tx=0x7fc9d8004d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:06:29.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.341+0000 7fc9de7fc700 1 -- 172.21.15.92:0/2282696936 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d801d070 con 0x7fc9e8105860 2023-10-16T13:06:29.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.341+0000 7fc9de7fc700 1 -- 172.21.15.92:0/2282696936 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc9d800bec0 con 0x7fc9e8105860 2023-10-16T13:06:29.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.341+0000 7fc9de7fc700 1 -- 172.21.15.92:0/2282696936 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d800f6c0 con 0x7fc9e8105860 2023-10-16T13:06:29.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.341+0000 7fc9ef422700 1 -- 172.21.15.92:0/2282696936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e8068280 con 0x7fc9e8105860 2023-10-16T13:06:29.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.341+0000 7fc9ef422700 1 -- 172.21.15.92:0/2282696936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e8068780 con 0x7fc9e8105860 2023-10-16T13:06:29.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.342+0000 7fc9de7fc700 1 -- 172.21.15.92:0/2282696936 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fc9d800b9e0 con 0x7fc9e8105860 2023-10-16T13:06:29.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.342+0000 7fc9ef422700 1 -- 172.21.15.92:0/2282696936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e80624e0 con 0x7fc9e8105860 2023-10-16T13:06:29.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.342+0000 7fc9de7fc700 1 --2- 172.21.15.92:0/2282696936 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc9d4038d40 0x7fc9d403b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:29.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.342+0000 7fc9de7fc700 1 -- 172.21.15.92:0/2282696936 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc9d804c9b0 con 0x7fc9e8105860 2023-10-16T13:06:29.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.342+0000 7fc9ec9bd700 1 --2- 172.21.15.92:0/2282696936 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc9d4038d40 0x7fc9d403b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:29.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.342+0000 7fc9ec9bd700 1 --2- 172.21.15.92:0/2282696936 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc9d4038d40 0x7fc9d403b200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40098e0 tx=0x7fc9e4006dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:06:29.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.347+0000 7fc9de7fc700 1 -- 172.21.15.92:0/2282696936 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc9d800f820 con 0x7fc9e8105860 2023-10-16T13:06:29.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.542+0000 7fc9ef422700 1 -- 172.21.15.92:0/2282696936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fc9e8196310 con 0x7fc9e8105860 2023-10-16T13:06:29.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.543+0000 7fc9de7fc700 1 -- 172.21.15.92:0/2282696936 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+275 (secure 0 0 0) 0x7fc9d8027030 con 0x7fc9e8105860 2023-10-16T13:06:29.545 INFO:teuthology.orchestra.run.smithi092.stdout:# minimal ceph.conf for 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:06:29.545 INFO:teuthology.orchestra.run.smithi092.stdout:[global] 2023-10-16T13:06:29.545 INFO:teuthology.orchestra.run.smithi092.stdout: fsid = 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:06:29.546 INFO:teuthology.orchestra.run.smithi092.stdout: mon_host = [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2023-10-16T13:06:29.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.545+0000 7fc9ef422700 1 -- 172.21.15.92:0/2282696936 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc9d4038d40 msgr2=0x7fc9d403b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:29.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.545+0000 7fc9ef422700 1 --2- 172.21.15.92:0/2282696936 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc9d4038d40 0x7fc9d403b200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40098e0 tx=0x7fc9e4006dd0 comp rx=0 tx=0).stop 2023-10-16T13:06:29.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.545+0000 7fc9ef422700 1 -- 172.21.15.92:0/2282696936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e8105860 msgr2=0x7fc9e8194fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:29.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.545+0000 7fc9ef422700 1 --2- 172.21.15.92:0/2282696936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e8105860 0x7fc9e8194fb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8004cb0 tx=0x7fc9d8004d90 comp rx=0 tx=0).stop 2023-10-16T13:06:29.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.545+0000 7fc9ef422700 1 -- 172.21.15.92:0/2282696936 shutdown_connections 2023-10-16T13:06:29.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.545+0000 7fc9ef422700 1 --2- 172.21.15.92:0/2282696936 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc9d4038d40 0x7fc9d403b200 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:29.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.545+0000 7fc9ef422700 1 --2- 172.21.15.92:0/2282696936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e8105860 0x7fc9e8194fb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:29.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.545+0000 7fc9ef422700 1 --2- 172.21.15.92:0/2282696936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9e8199ea0 0x7fc9e819a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:29.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.545+0000 7fc9ef422700 1 --2- 172.21.15.92:0/2282696936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9e81954f0 0x7fc9e8199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:29.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.545+0000 7fc9ef422700 1 -- 172.21.15.92:0/2282696936 >> 172.21.15.92:0/2282696936 conn(0x7fc9e8075370 msgr2=0x7fc9e80fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:06:29.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.545+0000 7fc9ef422700 1 -- 172.21.15.92:0/2282696936 shutdown_connections 2023-10-16T13:06:29.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:29.545+0000 7fc9ef422700 1 -- 172.21.15.92:0/2282696936 wait complete. 2023-10-16T13:06:29.634 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: mon.b calling monitor election 2023-10-16T13:06:29.634 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: mon.b calling monitor election 2023-10-16T13:06:29.634 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: mon.c calling monitor election 2023-10-16T13:06:29.634 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: mon.a calling monitor election 2023-10-16T13:06:29.635 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-16T13:06:29.635 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: monmap e3: 3 mons at {a=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],b=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0],c=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} 2023-10-16T13:06:29.635 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: fsmap 2023-10-16T13:06:29.635 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: osdmap e4: 0 total, 0 up, 0 in 2023-10-16T13:06:29.636 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: mgrmap e13: x(active, since 53s) 2023-10-16T13:06:29.636 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-16T13:06:29.636 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: Cluster is now healthy 2023-10-16T13:06:29.636 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: overall HEALTH_OK 2023-10-16T13:06:29.636 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.636 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.637 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.637 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.637 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.637 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.637 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.638 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.638 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.638 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.638 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.638 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-16T13:06:29.639 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-16T13:06:29.639 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:29.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: mon.b calling monitor election 2023-10-16T13:06:29.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: mon.b calling monitor election 2023-10-16T13:06:29.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: mon.c calling monitor election 2023-10-16T13:06:29.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: mon.a calling monitor election 2023-10-16T13:06:29.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-16T13:06:29.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: monmap e3: 3 mons at {a=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],b=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0],c=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} 2023-10-16T13:06:29.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: fsmap 2023-10-16T13:06:29.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: osdmap e4: 0 total, 0 up, 0 in 2023-10-16T13:06:29.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: mgrmap e13: x(active, since 53s) 2023-10-16T13:06:29.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-16T13:06:29.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: Cluster is now healthy 2023-10-16T13:06:29.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: overall HEALTH_OK 2023-10-16T13:06:29.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.696 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.696 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.696 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.696 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.696 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.697 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.697 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.697 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.697 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-16T13:06:29.698 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-16T13:06:29.698 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:29.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: mon.b calling monitor election 2023-10-16T13:06:29.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: mon.b calling monitor election 2023-10-16T13:06:29.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: mon.c calling monitor election 2023-10-16T13:06:29.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: mon.a calling monitor election 2023-10-16T13:06:29.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-16T13:06:29.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: monmap e3: 3 mons at {a=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],b=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0],c=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} 2023-10-16T13:06:29.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: fsmap 2023-10-16T13:06:29.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: osdmap e4: 0 total, 0 up, 0 in 2023-10-16T13:06:29.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: mgrmap e13: x(active, since 53s) 2023-10-16T13:06:29.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-16T13:06:29.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: Cluster is now healthy 2023-10-16T13:06:29.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: overall HEALTH_OK 2023-10-16T13:06:29.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.788 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.788 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.788 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.788 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:29.789 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-16T13:06:29.789 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-16T13:06:29.789 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:30.395 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-10-16T13:06:30.395 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T13:06:30.395 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.conf 2023-10-16T13:06:30.425 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T13:06:30.425 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-16T13:06:30.491 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-16T13:06:30.491 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.conf 2023-10-16T13:06:30.527 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-16T13:06:30.527 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-16T13:06:30.596 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T13:06:30.596 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.conf 2023-10-16T13:06:30.633 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T13:06:30.633 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-16T13:06:30.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:30 smithi152 ceph-mon[104423]: Updating smithi118:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-16T13:06:30.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:30 smithi152 ceph-mon[104423]: Updating smithi152:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-16T13:06:30.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:30 smithi152 ceph-mon[104423]: Updating smithi092:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-16T13:06:30.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:30 smithi152 ceph-mon[104423]: Reconfiguring mon.a (unknown last config time)... 2023-10-16T13:06:30.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:30 smithi152 ceph-mon[104423]: Reconfiguring daemon mon.a on smithi092 2023-10-16T13:06:30.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:30 smithi152 ceph-mon[104423]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:30.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:30 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2282696936' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:30.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:30 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:30.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:30 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:30.703 INFO:tasks.cephadm:Adding mgr.x on smithi092 2023-10-16T13:06:30.704 INFO:tasks.cephadm:Adding mgr.y on smithi118 2023-10-16T13:06:30.704 INFO:tasks.cephadm:Adding mgr.z on smithi152 2023-10-16T13:06:30.704 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch apply mgr '3;smithi092=x;smithi118=y;smithi152=z' 2023-10-16T13:06:30.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:30 smithi092 ceph-mon[99542]: Updating smithi118:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-16T13:06:30.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:30 smithi092 ceph-mon[99542]: Updating smithi152:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-16T13:06:30.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:30 smithi092 ceph-mon[99542]: Updating smithi092:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-16T13:06:30.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:30 smithi092 ceph-mon[99542]: Reconfiguring mon.a (unknown last config time)... 2023-10-16T13:06:30.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:30 smithi092 ceph-mon[99542]: Reconfiguring daemon mon.a on smithi092 2023-10-16T13:06:30.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:30 smithi092 ceph-mon[99542]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:30.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:30 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2282696936' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:30.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:30 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:30.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:30 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:30.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:30 smithi118 ceph-mon[103969]: Updating smithi118:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-16T13:06:30.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:30 smithi118 ceph-mon[103969]: Updating smithi152:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-16T13:06:30.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:30 smithi118 ceph-mon[103969]: Updating smithi092:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-16T13:06:30.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:30 smithi118 ceph-mon[103969]: Reconfiguring mon.a (unknown last config time)... 2023-10-16T13:06:30.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:30 smithi118 ceph-mon[103969]: Reconfiguring daemon mon.a on smithi092 2023-10-16T13:06:30.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:30 smithi118 ceph-mon[103969]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:30.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:30 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2282696936' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:30.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:30 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:06:30.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:30 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:31.302 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-16T13:06:31.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:31 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:31.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:31 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:31.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:31 smithi152 ceph-mon[104423]: Reconfiguring mon.b (monmap changed)... 2023-10-16T13:06:31.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:31 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-16T13:06:31.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:31 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-16T13:06:31.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:31 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:31.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:31 smithi152 ceph-mon[104423]: Reconfiguring daemon mon.b on smithi118 2023-10-16T13:06:31.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:31 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:31.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:31 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:31.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:31 smithi092 ceph-mon[99542]: Reconfiguring mon.b (monmap changed)... 2023-10-16T13:06:31.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:31 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-16T13:06:31.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:31 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-16T13:06:31.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:31 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:31.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:31 smithi092 ceph-mon[99542]: Reconfiguring daemon mon.b on smithi118 2023-10-16T13:06:31.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:31 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:31.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:31 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:31.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:31 smithi118 ceph-mon[103969]: Reconfiguring mon.b (monmap changed)... 2023-10-16T13:06:31.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:31 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-16T13:06:31.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:31 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-16T13:06:31.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:31 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:31.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:31 smithi118 ceph-mon[103969]: Reconfiguring daemon mon.b on smithi118 2023-10-16T13:06:32.414 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:32 smithi152 ceph-mon[104423]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:32.414 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:32 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:32.415 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:32 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:32.415 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:32 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-16T13:06:32.415 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:32 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-16T13:06:32.415 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:32 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.622+0000 7f5d8d182700 1 -- 172.21.15.152:0/1967436506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d880ffa00 msgr2=0x7f5d880ffe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:32.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.622+0000 7f5d8d182700 1 --2- 172.21.15.152:0/1967436506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d880ffa00 0x7f5d880ffe20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c009910 tx=0x7f5d7c009c20 comp rx=0 tx=0).stop 2023-10-16T13:06:32.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.622+0000 7f5d8d182700 1 -- 172.21.15.152:0/1967436506 shutdown_connections 2023-10-16T13:06:32.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.622+0000 7f5d8d182700 1 --2- 172.21.15.152:0/1967436506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d880ffa00 0x7f5d880ffe20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:32.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.622+0000 7f5d8d182700 1 -- 172.21.15.152:0/1967436506 >> 172.21.15.152:0/1967436506 conn(0x7f5d880fafc0 msgr2=0x7f5d880fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:06:32.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.623+0000 7f5d8d182700 1 -- 172.21.15.152:0/1967436506 shutdown_connections 2023-10-16T13:06:32.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.623+0000 7f5d8d182700 1 -- 172.21.15.152:0/1967436506 wait complete. 2023-10-16T13:06:32.628 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.623+0000 7f5d8d182700 1 Processor -- start 2023-10-16T13:06:32.629 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.623+0000 7f5d8d182700 1 -- start start 2023-10-16T13:06:32.629 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.624+0000 7f5d8d182700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d880ffa00 0x7f5d880691c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:32.629 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.624+0000 7f5d8d182700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d88198b50 0x7f5d8819af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:32.629 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.624+0000 7f5d8d182700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d8819b4d0 0x7f5d8819d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:32.629 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.624+0000 7f5d8d182700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8819e110 con 0x7f5d88198b50 2023-10-16T13:06:32.630 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.624+0000 7f5d8d182700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8819e280 con 0x7f5d8819b4d0 2023-10-16T13:06:32.630 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.624+0000 7f5d8d182700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8819e440 con 0x7f5d880ffa00 2023-10-16T13:06:32.630 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.624+0000 7f5d86d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d880ffa00 0x7f5d880691c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:32.630 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.624+0000 7f5d86d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d880ffa00 0x7f5d880691c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45358/0 (socket says 172.21.15.152:45358) 2023-10-16T13:06:32.631 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.624+0000 7f5d86d9d700 1 -- 172.21.15.152:0/3704759699 learned_addr learned my addr 172.21.15.152:0/3704759699 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T13:06:32.631 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.624+0000 7f5d8659c700 1 --2- 172.21.15.152:0/3704759699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d88198b50 0x7f5d8819af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:32.631 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.624+0000 7f5d86d9d700 1 -- 172.21.15.152:0/3704759699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d8819b4d0 msgr2=0x7f5d8819d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:32.631 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.624+0000 7f5d8759e700 1 --2- 172.21.15.152:0/3704759699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d8819b4d0 0x7f5d8819d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:32.631 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.624+0000 7f5d86d9d700 1 --2- 172.21.15.152:0/3704759699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d8819b4d0 0x7f5d8819d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.624+0000 7f5d86d9d700 1 -- 172.21.15.152:0/3704759699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d88198b50 msgr2=0x7f5d8819af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.624+0000 7f5d86d9d700 1 --2- 172.21.15.152:0/3704759699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d88198b50 0x7f5d8819af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.624+0000 7f5d86d9d700 1 -- 172.21.15.152:0/3704759699 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c0095f0 con 0x7f5d880ffa00 2023-10-16T13:06:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.624+0000 7f5d86d9d700 1 --2- 172.21.15.152:0/3704759699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d880ffa00 0x7f5d880691c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c004cb0 tx=0x7f5d7c004d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:06:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.624+0000 7f5d6ffff700 1 -- 172.21.15.152:0/3704759699 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c01d070 con 0x7f5d880ffa00 2023-10-16T13:06:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.625+0000 7f5d8d182700 1 -- 172.21.15.152:0/3704759699 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8819e6c0 con 0x7f5d880ffa00 2023-10-16T13:06:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.625+0000 7f5d6ffff700 1 -- 172.21.15.152:0/3704759699 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5d7c00f460 con 0x7f5d880ffa00 2023-10-16T13:06:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.625+0000 7f5d6ffff700 1 -- 172.21.15.152:0/3704759699 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c017680 con 0x7f5d880ffa00 2023-10-16T13:06:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.625+0000 7f5d8d182700 1 -- 172.21.15.152:0/3704759699 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d8819ebb0 con 0x7f5d880ffa00 2023-10-16T13:06:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.626+0000 7f5d6ffff700 1 -- 172.21.15.152:0/3704759699 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f5d7c0177e0 con 0x7f5d880ffa00 2023-10-16T13:06:32.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.626+0000 7f5d8d182700 1 -- 172.21.15.152:0/3704759699 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8818e600 con 0x7f5d880ffa00 2023-10-16T13:06:32.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.626+0000 7f5d6ffff700 1 --2- 172.21.15.152:0/3704759699 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5d70038d40 0x7f5d7003b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:32.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.626+0000 7f5d6ffff700 1 -- 172.21.15.152:0/3704759699 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5d7c04c790 con 0x7f5d880ffa00 2023-10-16T13:06:32.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.626+0000 7f5d8659c700 1 --2- 172.21.15.152:0/3704759699 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5d70038d40 0x7f5d7003b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:32.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.626+0000 7f5d8659c700 1 --2- 172.21.15.152:0/3704759699 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5d70038d40 0x7f5d7003b200 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5d88069720 tx=0x7f5d78008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:06:32.635 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.631+0000 7f5d6ffff700 1 -- 172.21.15.152:0/3704759699 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5d7c015350 con 0x7f5d880ffa00 2023-10-16T13:06:32.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:32 smithi092 ceph-mon[99542]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:32.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:32 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:32.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:32 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:32.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:32 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-16T13:06:32.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:32 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-16T13:06:32.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:32 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:32.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:32 smithi118 ceph-mon[103969]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:32.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:32 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:32.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:32 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:32.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:32 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-16T13:06:32.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:32 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-16T13:06:32.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:32 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:32.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.836+0000 7f5d8d182700 1 -- 172.21.15.152:0/3704759699 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi092=x;smithi118=y;smithi152=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d8802d2a0 con 0x7f5d70038d40 2023-10-16T13:06:32.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.843+0000 7f5d6ffff700 1 -- 172.21.15.152:0/3704759699 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f5d8802d2a0 con 0x7f5d70038d40 2023-10-16T13:06:32.845 INFO:teuthology.orchestra.run.smithi152.stdout:Scheduled mgr update... 2023-10-16T13:06:32.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.845+0000 7f5d8d182700 1 -- 172.21.15.152:0/3704759699 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5d70038d40 msgr2=0x7f5d7003b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:32.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.845+0000 7f5d8d182700 1 --2- 172.21.15.152:0/3704759699 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5d70038d40 0x7f5d7003b200 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5d88069720 tx=0x7f5d78008040 comp rx=0 tx=0).stop 2023-10-16T13:06:32.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.845+0000 7f5d8d182700 1 -- 172.21.15.152:0/3704759699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d880ffa00 msgr2=0x7f5d880691c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:32.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.845+0000 7f5d8d182700 1 --2- 172.21.15.152:0/3704759699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d880ffa00 0x7f5d880691c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c004cb0 tx=0x7f5d7c004d90 comp rx=0 tx=0).stop 2023-10-16T13:06:32.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.845+0000 7f5d8d182700 1 -- 172.21.15.152:0/3704759699 shutdown_connections 2023-10-16T13:06:32.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.845+0000 7f5d8d182700 1 --2- 172.21.15.152:0/3704759699 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5d70038d40 0x7f5d7003b200 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:32.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.845+0000 7f5d8d182700 1 --2- 172.21.15.152:0/3704759699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d8819b4d0 0x7f5d8819d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:32.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.845+0000 7f5d8d182700 1 --2- 172.21.15.152:0/3704759699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d880ffa00 0x7f5d880691c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:32.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.845+0000 7f5d8d182700 1 --2- 172.21.15.152:0/3704759699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d88198b50 0x7f5d8819af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:32.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.845+0000 7f5d8d182700 1 -- 172.21.15.152:0/3704759699 >> 172.21.15.152:0/3704759699 conn(0x7f5d880fafc0 msgr2=0x7f5d880fbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:06:32.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.846+0000 7f5d8d182700 1 -- 172.21.15.152:0/3704759699 shutdown_connections 2023-10-16T13:06:32.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:06:32.846+0000 7f5d8d182700 1 -- 172.21.15.152:0/3704759699 wait complete. 2023-10-16T13:06:33.288 DEBUG:teuthology.orchestra.run.smithi118:mgr.y> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mgr.y.service 2023-10-16T13:06:33.291 DEBUG:teuthology.orchestra.run.smithi152:mgr.z> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mgr.z.service 2023-10-16T13:06:33.294 INFO:tasks.cephadm:Deploying OSDs... 2023-10-16T13:06:33.294 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T13:06:33.295 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T13:06:33.315 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T13:06:33.316 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2023-10-16T13:06:33.325 INFO:journalctl@ceph.mgr.z.smithi152.stdout:-- Logs begin at Mon 2023-10-16 12:49:44 UTC. -- 2023-10-16T13:06:33.326 INFO:journalctl@ceph.mgr.y.smithi118.stdout:-- Logs begin at Mon 2023-10-16 12:50:05 UTC. -- 2023-10-16T13:06:33.378 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T13:06:33.378 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:06:33.378 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 385922 Links: 1 2023-10-16T13:06:33.379 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:06:33.379 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:06:33.379 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-16 13:05:46.449503333 +0000 2023-10-16T13:06:33.379 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-16 12:59:14.136953496 +0000 2023-10-16T13:06:33.379 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-16 12:59:14.136953496 +0000 2023-10-16T13:06:33.380 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-10-16T13:06:33.380 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T13:06:33.450 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-16T13:06:33.451 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-16T13:06:33.451 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000283921 s, 1.8 MB/s 2023-10-16T13:06:33.452 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T13:06:33.514 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2023-10-16T13:06:33.575 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T13:06:33.575 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:06:33.575 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 388047 Links: 1 2023-10-16T13:06:33.576 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:06:33.576 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:06:33.576 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-16 13:05:46.487502221 +0000 2023-10-16T13:06:33.576 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-16 12:59:14.687937452 +0000 2023-10-16T13:06:33.577 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-16 12:59:14.687937452 +0000 2023-10-16T13:06:33.577 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-10-16T13:06:33.577 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T13:06:33.646 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-16T13:06:33.646 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-16T13:06:33.647 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000288985 s, 1.8 MB/s 2023-10-16T13:06:33.648 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T13:06:33.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:33 smithi152 ceph-mon[104423]: Reconfiguring mon.c (monmap changed)... 2023-10-16T13:06:33.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:33 smithi152 ceph-mon[104423]: Reconfiguring daemon mon.c on smithi152 2023-10-16T13:06:33.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:33 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:33.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:33 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:33.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:33 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:33.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:33 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:33.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:33 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:33.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:33 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:06:33.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:33 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:33.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:33 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-16T13:06:33.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:33 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-16T13:06:33.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:33 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-16T13:06:33.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:33 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:33.709 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2023-10-16T13:06:33.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:33 smithi092 ceph-mon[99542]: Reconfiguring mon.c (monmap changed)... 2023-10-16T13:06:33.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:33 smithi092 ceph-mon[99542]: Reconfiguring daemon mon.c on smithi152 2023-10-16T13:06:33.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:33 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:33.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:33 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:33.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:33 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:33.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:33 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:33.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:33 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:33.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:33 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:06:33.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:33 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:33.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:33 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-16T13:06:33.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:33 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-16T13:06:33.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:33 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-16T13:06:33.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:33 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:33.769 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T13:06:33.769 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:06:33.769 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 396402 Links: 1 2023-10-16T13:06:33.770 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:06:33.770 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:06:33.770 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-16 13:05:46.527501050 +0000 2023-10-16T13:06:33.770 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-16 12:59:15.188922865 +0000 2023-10-16T13:06:33.770 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-16 12:59:15.188922865 +0000 2023-10-16T13:06:33.771 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-10-16T13:06:33.771 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T13:06:33.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:33 smithi118 ceph-mon[103969]: Reconfiguring mon.c (monmap changed)... 2023-10-16T13:06:33.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:33 smithi118 ceph-mon[103969]: Reconfiguring daemon mon.c on smithi152 2023-10-16T13:06:33.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:33 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:33.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:33 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:33.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:33 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:33.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:33 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:33.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:33 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:33.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:33 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:06:33.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:33 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:33.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:33 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-16T13:06:33.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:33 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-16T13:06:33.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:33 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-16T13:06:33.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:33 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:33.840 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-16T13:06:33.840 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-16T13:06:33.840 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.00027498 s, 1.9 MB/s 2023-10-16T13:06:33.841 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T13:06:33.902 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2023-10-16T13:06:33.963 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T13:06:33.963 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:06:33.963 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 386008 Links: 1 2023-10-16T13:06:33.963 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:06:33.964 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:06:33.964 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-16 13:05:46.566499908 +0000 2023-10-16T13:06:33.964 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-16 12:59:15.706907782 +0000 2023-10-16T13:06:33.964 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-16 12:59:15.706907782 +0000 2023-10-16T13:06:33.964 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-10-16T13:06:33.965 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T13:06:34.033 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-16T13:06:34.034 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-16T13:06:34.034 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000214298 s, 2.4 MB/s 2023-10-16T13:06:34.035 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T13:06:34.097 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-16T13:06:34.097 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T13:06:34.119 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T13:06:34.119 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_1 2023-10-16T13:06:34.180 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T13:06:34.180 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:06:34.180 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 387592 Links: 1 2023-10-16T13:06:34.181 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:06:34.181 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:06:34.181 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-10-16 13:06:21.017740297 +0000 2023-10-16T13:06:34.181 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-10-16 12:59:32.239169785 +0000 2023-10-16T13:06:34.181 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-10-16 12:59:32.239169785 +0000 2023-10-16T13:06:34.181 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-10-16T13:06:34.182 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T13:06:34.251 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-10-16T13:06:34.251 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-10-16T13:06:34.251 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000142447 s, 3.6 MB/s 2023-10-16T13:06:34.252 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T13:06:34.314 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_2 2023-10-16T13:06:34.375 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T13:06:34.375 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:06:34.375 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 387690 Links: 1 2023-10-16T13:06:34.375 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:06:34.376 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:06:34.376 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-10-16 13:06:21.017740297 +0000 2023-10-16T13:06:34.376 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-10-16 12:59:32.736158946 +0000 2023-10-16T13:06:34.376 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-10-16 12:59:32.736158946 +0000 2023-10-16T13:06:34.376 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-10-16T13:06:34.377 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T13:06:34.447 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-10-16T13:06:34.447 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-10-16T13:06:34.447 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000135193 s, 3.8 MB/s 2023-10-16T13:06:34.448 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T13:06:34.510 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_3 2023-10-16T13:06:34.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:34 smithi118 ceph-mon[103969]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi092=x;smithi118=y;smithi152=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:06:34.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:34 smithi118 ceph-mon[103969]: Saving service mgr spec with placement smithi092=x;smithi118=y;smithi152=z;count:3 2023-10-16T13:06:34.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:34 smithi118 ceph-mon[103969]: Deploying daemon mgr.z on smithi152 2023-10-16T13:06:34.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:34 smithi118 ceph-mon[103969]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:34.554 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T13:06:34.554 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:06:34.555 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 395322 Links: 1 2023-10-16T13:06:34.555 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:06:34.555 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:06:34.555 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-10-16 13:06:21.018740275 +0000 2023-10-16T13:06:34.556 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-10-16 12:59:33.242147912 +0000 2023-10-16T13:06:34.556 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-10-16 12:59:33.242147912 +0000 2023-10-16T13:06:34.556 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-10-16T13:06:34.556 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T13:06:34.624 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-10-16T13:06:34.625 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-10-16T13:06:34.625 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000134493 s, 3.8 MB/s 2023-10-16T13:06:34.626 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T13:06:34.687 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_4 2023-10-16T13:06:34.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:34 smithi152 ceph-mon[104423]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi092=x;smithi118=y;smithi152=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:06:34.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:34 smithi152 ceph-mon[104423]: Saving service mgr spec with placement smithi092=x;smithi118=y;smithi152=z;count:3 2023-10-16T13:06:34.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:34 smithi152 ceph-mon[104423]: Deploying daemon mgr.z on smithi152 2023-10-16T13:06:34.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:34 smithi152 ceph-mon[104423]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:34.694 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:34 smithi152 systemd[1]: Starting Ceph mgr.z for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:06:34.747 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T13:06:34.747 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:06:34.747 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 392623 Links: 1 2023-10-16T13:06:34.747 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:06:34.748 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:06:34.748 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-10-16 13:06:21.018740275 +0000 2023-10-16T13:06:34.748 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-10-16 12:59:33.764136527 +0000 2023-10-16T13:06:34.748 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-10-16 12:59:33.764136527 +0000 2023-10-16T13:06:34.748 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-10-16T13:06:34.749 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T13:06:34.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:34 smithi092 ceph-mon[99542]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi092=x;smithi118=y;smithi152=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:06:34.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:34 smithi092 ceph-mon[99542]: Saving service mgr spec with placement smithi092=x;smithi118=y;smithi152=z;count:3 2023-10-16T13:06:34.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:34 smithi092 ceph-mon[99542]: Deploying daemon mgr.z on smithi152 2023-10-16T13:06:34.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:34 smithi092 ceph-mon[99542]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:34.815 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-10-16T13:06:34.815 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-10-16T13:06:34.816 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000138908 s, 3.7 MB/s 2023-10-16T13:06:34.816 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T13:06:34.876 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T13:06:34.877 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T13:06:34.895 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T13:06:34.896 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2023-10-16T13:06:34.954 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T13:06:34.954 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:06:34.954 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 386448 Links: 1 2023-10-16T13:06:34.955 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:06:34.955 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:06:34.955 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-10-16 13:06:34.549090031 +0000 2023-10-16T13:06:34.955 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-10-16 12:59:32.062611283 +0000 2023-10-16T13:06:34.956 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-10-16 12:59:32.062611283 +0000 2023-10-16T13:06:34.956 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-10-16T13:06:34.958 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T13:06:35.022 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-10-16T13:06:35.022 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-10-16T13:06:35.022 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000284398 s, 1.8 MB/s 2023-10-16T13:06:35.023 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T13:06:35.081 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2023-10-16T13:06:35.138 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T13:06:35.138 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:06:35.139 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 391141 Links: 1 2023-10-16T13:06:35.139 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:06:35.139 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:06:35.139 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-10-16 13:06:34.549090031 +0000 2023-10-16T13:06:35.139 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-10-16 12:59:32.567604975 +0000 2023-10-16T13:06:35.140 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-10-16 12:59:32.567604975 +0000 2023-10-16T13:06:35.140 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-10-16T13:06:35.140 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T13:06:35.156 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:34 smithi152 podman[106260]: 2023-10-16T13:06:35.182 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-10-16T13:06:35.182 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-10-16T13:06:35.182 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000269101 s, 1.9 MB/s 2023-10-16T13:06:35.183 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T13:06:35.243 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2023-10-16T13:06:35.300 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T13:06:35.300 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:06:35.300 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 393478 Links: 1 2023-10-16T13:06:35.300 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:06:35.301 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:06:35.301 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-10-16 13:06:34.549090031 +0000 2023-10-16T13:06:35.301 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-10-16 12:59:33.070598693 +0000 2023-10-16T13:06:35.301 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-10-16 12:59:33.070598693 +0000 2023-10-16T13:06:35.301 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-10-16T13:06:35.302 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T13:06:35.366 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-10-16T13:06:35.366 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-10-16T13:06:35.366 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000243359 s, 2.1 MB/s 2023-10-16T13:06:35.367 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T13:06:35.426 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2023-10-16T13:06:35.442 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:35 smithi152 ceph-mgr[106393]: -- 172.21.15.152:0/1549634340 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d457ac91e0 con 0x55d457a9e800 2023-10-16T13:06:35.443 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:35 smithi152 bash[106260]: 2cafabd79f92c7862ba65252f6b9c2437b3d1421933db667fea7868d17bd5964 2023-10-16T13:06:35.443 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:35 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:35.278+0000 7fafaecd0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T13:06:35.443 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:35 smithi152 systemd[1]: Started Ceph mgr.z for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:06:35.443 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:35 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:35.377+0000 7fafaecd0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T13:06:35.459 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T13:06:35.459 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:06:35.460 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 393639 Links: 1 2023-10-16T13:06:35.460 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:06:35.460 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:06:35.460 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-10-16 13:06:34.549090031 +0000 2023-10-16T13:06:35.460 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-10-16 12:59:33.579592335 +0000 2023-10-16T13:06:35.461 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-10-16 12:59:33.579592335 +0000 2023-10-16T13:06:35.461 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-10-16T13:06:35.461 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T13:06:35.525 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-10-16T13:06:35.525 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-10-16T13:06:35.525 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000199358 s, 2.6 MB/s 2023-10-16T13:06:35.526 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T13:06:35.584 INFO:tasks.cephadm:Deploying osd.0 on smithi092 with /dev/vg_nvme/lv_4... 2023-10-16T13:06:35.584 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-16T13:06:35.744 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:35 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:35.472+0000 7fafaecd0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T13:06:35.744 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:35 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:35.570+0000 7fafaecd0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T13:06:36.156 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:06:36.423 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:35 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:35.742+0000 7fafaecd0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T13:06:36.423 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:36 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:36.106+0000 7fafaecd0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T13:06:36.423 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:36 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:36.237+0000 7fafaecd0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T13:06:36.424 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:36 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:36.325+0000 7fafaecd0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T13:06:36.424 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:36 smithi152 ceph-mon[104423]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:36.424 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:36.424 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:36.425 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:36.425 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-16T13:06:36.425 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-16T13:06:36.425 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-16T13:06:36.426 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:36.426 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:36 smithi152 ceph-mon[104423]: Deploying daemon mgr.y on smithi118 2023-10-16T13:06:36.692 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:36 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:36.421+0000 7fafaecd0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T13:06:36.709 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:36 smithi118 ceph-mon[103969]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:36.709 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:36.709 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:36.710 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:36.710 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-16T13:06:36.710 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-16T13:06:36.710 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-16T13:06:36.711 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:36.711 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:36 smithi118 ceph-mon[103969]: Deploying daemon mgr.y on smithi118 2023-10-16T13:06:36.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:36 smithi092 ceph-mon[99542]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:36.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:36.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:36.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:36.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-16T13:06:36.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-16T13:06:36.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-16T13:06:36.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:36.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:36 smithi092 ceph-mon[99542]: Deploying daemon mgr.y on smithi118 2023-10-16T13:06:37.034 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:36 smithi118 systemd[1]: Starting Ceph mgr.y for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:06:37.192 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:36 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:36.841+0000 7fafaecd0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T13:06:37.512 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:37 smithi118 podman[105411]: 2023-10-16T13:06:37.512 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:37 smithi118 bash[105411]: bbebe676509325d4bacb2aba09fafee4d29554ddc9ed00a7b6529b85c1838575 2023-10-16T13:06:37.512 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:37 smithi118 ceph-mgr[105452]: -- 172.21.15.118:0/2415244609 <== mon.2 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d9cd8931e0 con 0x55d9cd869000 2023-10-16T13:06:37.747 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-16T13:06:37.748 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-16T13:06:37.748 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2023-10-16T13:06:37.748 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2023-10-16T13:06:37.748 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110469 s, 949 MB/s 2023-10-16T13:06:37.748 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2023-10-16T13:06:37.783 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:37 smithi118 systemd[1]: Started Ceph mgr.y for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:06:37.783 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:37 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:37.546+0000 7fa895dc4200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T13:06:37.783 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:37 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:37.632+0000 7fa895dc4200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T13:06:37.784 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:37 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:37.723+0000 7fa895dc4200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T13:06:37.942 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:37 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:37.508+0000 7fafaecd0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T13:06:37.942 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:37 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:37.590+0000 7fafaecd0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T13:06:38.200 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi092:vg_nvme/lv_4 2023-10-16T13:06:38.283 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:37 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:37.823+0000 7fa895dc4200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T13:06:38.284 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:38 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:38.012+0000 7fa895dc4200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T13:06:38.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:38 smithi092 ceph-mon[99542]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:38.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:38 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:38.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:38 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:38.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:38 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:38.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:38 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:38.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:38 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:38.629 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:38 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:38.397+0000 7fa895dc4200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T13:06:38.629 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:38 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:38.533+0000 7fa895dc4200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T13:06:38.630 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:38 smithi118 ceph-mon[103969]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:38.630 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:38 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:38.630 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:38 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:38.630 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:38 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:38.630 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:38 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:38.631 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:38 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:38.690 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:38 smithi152 ceph-mon[104423]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:38.690 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:38 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:38.690 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:38 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:38.691 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:38 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:38.691 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:38 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:38.691 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:38 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:38.691 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:38 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:38.409+0000 7fafaecd0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T13:06:38.692 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:38 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:38.503+0000 7fafaecd0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T13:06:38.766 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:06:38.942 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:38 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:38.685+0000 7fafaecd0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T13:06:39.033 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:38 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:38.626+0000 7fa895dc4200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T13:06:39.034 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:38 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:38.729+0000 7fa895dc4200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T13:06:39.392 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:38 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:38.987+0000 7fafaecd0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T13:06:39.392 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:39 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:39.229+0000 7fafaecd0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T13:06:39.393 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:39 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:39.390+0000 7fafaecd0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T13:06:39.533 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:39 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:39.175+0000 7fa895dc4200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T13:06:39.942 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:39 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:39.656+0000 7fafaecd0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T13:06:40.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.153+0000 7fb098ae6700 1 -- 172.21.15.92:0/954498536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb094101990 msgr2=0x7fb0941082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:40.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.153+0000 7fb098ae6700 1 --2- 172.21.15.92:0/954498536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb094101990 0x7fb0941082b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb08c00b0a0 tx=0x7fb08c00b3b0 comp rx=0 tx=0).stop 2023-10-16T13:06:40.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.153+0000 7fb098ae6700 1 -- 172.21.15.92:0/954498536 shutdown_connections 2023-10-16T13:06:40.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.153+0000 7fb098ae6700 1 --2- 172.21.15.92:0/954498536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb094101990 0x7fb0941082b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:40.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.153+0000 7fb098ae6700 1 --2- 172.21.15.92:0/954498536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0940ffe70 0x7fb094100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:40.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.153+0000 7fb098ae6700 1 --2- 172.21.15.92:0/954498536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb094100fd0 0x7fb094101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:40.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.153+0000 7fb098ae6700 1 -- 172.21.15.92:0/954498536 >> 172.21.15.92:0/954498536 conn(0x7fb0940fb3f0 msgr2=0x7fb0940fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:06:40.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.153+0000 7fb098ae6700 1 -- 172.21.15.92:0/954498536 shutdown_connections 2023-10-16T13:06:40.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.153+0000 7fb098ae6700 1 -- 172.21.15.92:0/954498536 wait complete. 2023-10-16T13:06:40.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb098ae6700 1 Processor -- start 2023-10-16T13:06:40.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb098ae6700 1 -- start start 2023-10-16T13:06:40.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb098ae6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0940ffe70 0x7fb094196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:40.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb098ae6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb094100fd0 0x7fb094197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:40.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb098ae6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb094101990 0x7fb09419e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:40.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb098ae6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09419e9d0 con 0x7fb0940ffe70 2023-10-16T13:06:40.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb098ae6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09419eb10 con 0x7fb094101990 2023-10-16T13:06:40.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb098ae6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09419eca0 con 0x7fb094100fd0 2023-10-16T13:06:40.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb09259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0940ffe70 0x7fb094196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:40.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb09259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0940ffe70 0x7fb094196e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34302/0 (socket says 172.21.15.92:34302) 2023-10-16T13:06:40.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb09259c700 1 -- 172.21.15.92:0/2305027778 learned_addr learned my addr 172.21.15.92:0/2305027778 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:06:40.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb092d9d700 1 --2- 172.21.15.92:0/2305027778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb094101990 0x7fb09419e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:40.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb091d9b700 1 --2- 172.21.15.92:0/2305027778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb094100fd0 0x7fb094197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:40.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb09259c700 1 -- 172.21.15.92:0/2305027778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb094100fd0 msgr2=0x7fb094197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:40.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb09259c700 1 --2- 172.21.15.92:0/2305027778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb094100fd0 0x7fb094197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:40.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb09259c700 1 -- 172.21.15.92:0/2305027778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb094101990 msgr2=0x7fb09419e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:40.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb09259c700 1 --2- 172.21.15.92:0/2305027778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb094101990 0x7fb09419e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:40.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb09259c700 1 -- 172.21.15.92:0/2305027778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c009d00 con 0x7fb0940ffe70 2023-10-16T13:06:40.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb09259c700 1 --2- 172.21.15.92:0/2305027778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0940ffe70 0x7fb094196e40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb08400d9b0 tx=0x7fb08400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:06:40.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.154+0000 7fb0837fe700 1 -- 172.21.15.92:0/2305027778 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb084004220 con 0x7fb0940ffe70 2023-10-16T13:06:40.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.155+0000 7fb0837fe700 1 -- 172.21.15.92:0/2305027778 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb084007640 con 0x7fb0940ffe70 2023-10-16T13:06:40.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.155+0000 7fb0837fe700 1 -- 172.21.15.92:0/2305027778 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb084005650 con 0x7fb0940ffe70 2023-10-16T13:06:40.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.155+0000 7fb098ae6700 1 -- 172.21.15.92:0/2305027778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09419ef80 con 0x7fb0940ffe70 2023-10-16T13:06:40.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.155+0000 7fb098ae6700 1 -- 172.21.15.92:0/2305027778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09419f390 con 0x7fb0940ffe70 2023-10-16T13:06:40.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.156+0000 7fb0837fe700 1 -- 172.21.15.92:0/2305027778 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fb08400b750 con 0x7fb0940ffe70 2023-10-16T13:06:40.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.156+0000 7fb098ae6700 1 -- 172.21.15.92:0/2305027778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb09410b890 con 0x7fb0940ffe70 2023-10-16T13:06:40.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.156+0000 7fb0837fe700 1 --2- 172.21.15.92:0/2305027778 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb07c038af0 0x7fb07c03afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:06:40.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.156+0000 7fb0837fe700 1 -- 172.21.15.92:0/2305027778 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb08404b2f0 con 0x7fb0940ffe70 2023-10-16T13:06:40.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.156+0000 7fb091d9b700 1 --2- 172.21.15.92:0/2305027778 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb07c038af0 0x7fb07c03afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:06:40.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.156+0000 7fb091d9b700 1 --2- 172.21.15.92:0/2305027778 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb07c038af0 0x7fb07c03afb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb088005950 tx=0x7fb08800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:06:40.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.161+0000 7fb0837fe700 1 -- 172.21.15.92:0/2305027778 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb084019820 con 0x7fb0940ffe70 2023-10-16T13:06:40.283 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:39 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:39.853+0000 7fa895dc4200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T13:06:40.283 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:39 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:39.934+0000 7fa895dc4200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T13:06:40.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:40.376+0000 7fb098ae6700 1 -- 172.21.15.92:0/2305027778 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb094069960 con 0x7fb07c038af0 2023-10-16T13:06:40.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:40 smithi092 ceph-mon[99542]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:40.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:06:40.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:40.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:40 smithi092 ceph-mon[99542]: Reconfiguring mgr.x (unknown last config time)... 2023-10-16T13:06:40.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-16T13:06:40.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-16T13:06:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:40 smithi092 ceph-mon[99542]: Reconfiguring daemon mgr.x on smithi092 2023-10-16T13:06:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:40.692 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:40 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:40.388+0000 7fafaecd0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T13:06:40.692 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:40 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:40.519+0000 7fafaecd0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T13:06:40.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:40 smithi152 ceph-mon[104423]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:40.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:40.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:40.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:40.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:40.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:40.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:06:40.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:40.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:40 smithi152 ceph-mon[104423]: Reconfiguring mgr.x (unknown last config time)... 2023-10-16T13:06:40.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-16T13:06:40.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-16T13:06:40.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:40.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:40 smithi152 ceph-mon[104423]: Reconfiguring daemon mgr.x on smithi092 2023-10-16T13:06:40.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:40.704 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:40 smithi118 ceph-mon[103969]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:40.704 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:40.704 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:40.705 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:40.705 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:40.705 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:40.705 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:06:40.705 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:40.705 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:40 smithi118 ceph-mon[103969]: Reconfiguring mgr.x (unknown last config time)... 2023-10-16T13:06:40.706 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-16T13:06:40.706 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-16T13:06:40.706 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:40.706 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:40 smithi118 ceph-mon[103969]: Reconfiguring daemon mgr.x on smithi092 2023-10-16T13:06:40.706 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:40.971 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:40 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:40.701+0000 7fa895dc4200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T13:06:40.971 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:40 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:40.792+0000 7fa895dc4200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T13:06:41.049 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:40 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:40.713+0000 7fafaecd0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T13:06:41.049 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:40 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:40.828+0000 7fafaecd0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T13:06:41.250 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:40 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:40.968+0000 7fa895dc4200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T13:06:41.330 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:41 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:41.047+0000 7fafaecd0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T13:06:41.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:41 smithi092 ceph-mon[99542]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:06:41.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:41 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:06:41.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:41 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:06:41.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:41 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:41.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:41 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:41.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:41 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:41.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:41 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:41.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:41 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:41.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:41 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:06:41.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:41 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:41.533 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:41 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:41.247+0000 7fa895dc4200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T13:06:41.533 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:41 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:41.472+0000 7fa895dc4200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T13:06:41.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:41 smithi118 ceph-mon[103969]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:06:41.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:41 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:06:41.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:41 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:06:41.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:41 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:41.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:41 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:41.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:41 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:41.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:41 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:41.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:41 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:41.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:41 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:06:41.536 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:41 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:41.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:41 smithi152 ceph-mon[104423]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:06:41.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:41 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:06:41.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:41 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:06:41.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:41 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:41.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:41 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:41.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:41 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:41.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:41 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:41.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:41 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:41.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:41 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:06:41.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:41 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:41.882 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:41 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:41.620+0000 7fa895dc4200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T13:06:42.192 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:06:41 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z[106314]: 2023-10-16T13:06:41.913+0000 7fafaecd0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T13:06:42.283 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:41 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:41.879+0000 7fa895dc4200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T13:06:42.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:42 smithi092 ceph-mon[99542]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:42.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:42 smithi092 ceph-mon[99542]: Standby manager daemon z started 2023-10-16T13:06:42.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:42 smithi092 ceph-mon[99542]: from='mgr.? 172.21.15.152:0/438375387' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-16T13:06:42.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:42 smithi092 ceph-mon[99542]: from='mgr.? 172.21.15.152:0/438375387' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-16T13:06:42.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:42 smithi092 ceph-mon[99542]: from='mgr.? 172.21.15.152:0/438375387' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-16T13:06:42.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:42 smithi092 ceph-mon[99542]: from='mgr.? 172.21.15.152:0/438375387' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-16T13:06:42.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:42 smithi152 ceph-mon[104423]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:42.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:42 smithi152 ceph-mon[104423]: Standby manager daemon z started 2023-10-16T13:06:42.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:42 smithi152 ceph-mon[104423]: from='mgr.? 172.21.15.152:0/438375387' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-16T13:06:42.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:42 smithi152 ceph-mon[104423]: from='mgr.? 172.21.15.152:0/438375387' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-16T13:06:42.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:42 smithi152 ceph-mon[104423]: from='mgr.? 172.21.15.152:0/438375387' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-16T13:06:42.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:42 smithi152 ceph-mon[104423]: from='mgr.? 172.21.15.152:0/438375387' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-16T13:06:42.709 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:42 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:42.575+0000 7fa895dc4200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T13:06:42.709 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:42 smithi118 ceph-mon[103969]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:42.710 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:42 smithi118 ceph-mon[103969]: Standby manager daemon z started 2023-10-16T13:06:42.710 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:42 smithi118 ceph-mon[103969]: from='mgr.? 172.21.15.152:0/438375387' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-16T13:06:42.710 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:42 smithi118 ceph-mon[103969]: from='mgr.? 172.21.15.152:0/438375387' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-16T13:06:42.710 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:42 smithi118 ceph-mon[103969]: from='mgr.? 172.21.15.152:0/438375387' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-16T13:06:42.710 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:42 smithi118 ceph-mon[103969]: from='mgr.? 172.21.15.152:0/438375387' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-16T13:06:42.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:42.819+0000 7fb0837fe700 1 -- 172.21.15.92:0/2305027778 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 14) v1 ==== 90791+0+0 (secure 0 0 0) 0x7fb084003a00 con 0x7fb0940ffe70 2023-10-16T13:06:43.012 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:42 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:42.706+0000 7fa895dc4200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T13:06:43.013 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:42 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:42.898+0000 7fa895dc4200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T13:06:43.013 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:43 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:43.010+0000 7fa895dc4200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T13:06:43.283 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:43 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:43.224+0000 7fa895dc4200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T13:06:44.192 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:43 smithi152 ceph-mon[104423]: mgrmap e14: x(active, since 67s), standbys: z 2023-10-16T13:06:44.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-16T13:06:44.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:43 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2534259615' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6aa1b3b6-7395-4c31-84e7-9a68dbed218e"}]: dispatch 2023-10-16T13:06:44.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:43 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2534259615' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6aa1b3b6-7395-4c31-84e7-9a68dbed218e"}]': finished 2023-10-16T13:06:44.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:43 smithi152 ceph-mon[104423]: osdmap e5: 1 total, 0 up, 1 in 2023-10-16T13:06:44.194 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-16T13:06:44.194 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:43 smithi152 ceph-mon[104423]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:44.194 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:43 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3269106893' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:06:44.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:43 smithi092 ceph-mon[99542]: mgrmap e14: x(active, since 67s), standbys: z 2023-10-16T13:06:44.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-16T13:06:44.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:43 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2534259615' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6aa1b3b6-7395-4c31-84e7-9a68dbed218e"}]: dispatch 2023-10-16T13:06:44.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:43 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2534259615' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6aa1b3b6-7395-4c31-84e7-9a68dbed218e"}]': finished 2023-10-16T13:06:44.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:43 smithi092 ceph-mon[99542]: osdmap e5: 1 total, 0 up, 1 in 2023-10-16T13:06:44.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-16T13:06:44.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:43 smithi092 ceph-mon[99542]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:44.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:43 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3269106893' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:06:44.283 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:06:44 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y[105427]: 2023-10-16T13:06:44.081+0000 7fa895dc4200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T13:06:44.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:43 smithi118 ceph-mon[103969]: mgrmap e14: x(active, since 67s), standbys: z 2023-10-16T13:06:44.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-16T13:06:44.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:43 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2534259615' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6aa1b3b6-7395-4c31-84e7-9a68dbed218e"}]: dispatch 2023-10-16T13:06:44.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:43 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2534259615' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6aa1b3b6-7395-4c31-84e7-9a68dbed218e"}]': finished 2023-10-16T13:06:44.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:43 smithi118 ceph-mon[103969]: osdmap e5: 1 total, 0 up, 1 in 2023-10-16T13:06:44.285 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-16T13:06:44.285 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:43 smithi118 ceph-mon[103969]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:44.285 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:43 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3269106893' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:06:44.924 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:44.921+0000 7fb0837fe700 1 -- 172.21.15.92:0/2305027778 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fb08405d6f0 con 0x7fb0940ffe70 2023-10-16T13:06:45.192 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:44 smithi152 ceph-mon[104423]: Standby manager daemon y started 2023-10-16T13:06:45.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:44 smithi152 ceph-mon[104423]: from='mgr.? 172.21.15.118:0/2973808599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-16T13:06:45.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:44 smithi152 ceph-mon[104423]: from='mgr.? 172.21.15.118:0/2973808599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-16T13:06:45.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:44 smithi152 ceph-mon[104423]: from='mgr.? 172.21.15.118:0/2973808599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-16T13:06:45.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:44 smithi152 ceph-mon[104423]: from='mgr.? 172.21.15.118:0/2973808599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-16T13:06:45.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:44 smithi092 ceph-mon[99542]: Standby manager daemon y started 2023-10-16T13:06:45.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:44 smithi092 ceph-mon[99542]: from='mgr.? 172.21.15.118:0/2973808599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-16T13:06:45.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:44 smithi092 ceph-mon[99542]: from='mgr.? 172.21.15.118:0/2973808599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-16T13:06:45.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:44 smithi092 ceph-mon[99542]: from='mgr.? 172.21.15.118:0/2973808599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-16T13:06:45.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:44 smithi092 ceph-mon[99542]: from='mgr.? 172.21.15.118:0/2973808599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-16T13:06:45.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:44 smithi118 ceph-mon[103969]: Standby manager daemon y started 2023-10-16T13:06:45.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:44 smithi118 ceph-mon[103969]: from='mgr.? 172.21.15.118:0/2973808599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-16T13:06:45.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:44 smithi118 ceph-mon[103969]: from='mgr.? 172.21.15.118:0/2973808599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-16T13:06:45.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:44 smithi118 ceph-mon[103969]: from='mgr.? 172.21.15.118:0/2973808599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-16T13:06:45.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:44 smithi118 ceph-mon[103969]: from='mgr.? 172.21.15.118:0/2973808599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-16T13:06:46.192 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:45 smithi152 ceph-mon[104423]: mgrmap e15: x(active, since 69s), standbys: z, y 2023-10-16T13:06:46.192 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:45 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-16T13:06:46.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:45 smithi152 ceph-mon[104423]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:46.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:45 smithi092 ceph-mon[99542]: mgrmap e15: x(active, since 69s), standbys: z, y 2023-10-16T13:06:46.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:45 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-16T13:06:46.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:45 smithi092 ceph-mon[99542]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:46.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:45 smithi118 ceph-mon[103969]: mgrmap e15: x(active, since 69s), standbys: z, y 2023-10-16T13:06:46.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:45 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-16T13:06:46.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:45 smithi118 ceph-mon[103969]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:48.422 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:48 smithi092 ceph-mon[99542]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:48.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:48 smithi118 ceph-mon[103969]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:48.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:48 smithi152 ceph-mon[104423]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:50.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:50 smithi118 ceph-mon[103969]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:50.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:50 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-16T13:06:50.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:50 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:50.573 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:50 smithi092 ceph-mon[99542]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:50.573 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-16T13:06:50.573 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:50.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:50 smithi152 ceph-mon[104423]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:50.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:50 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-16T13:06:50.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:50 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:51.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:51 smithi118 ceph-mon[103969]: Deploying daemon osd.0 on smithi092 2023-10-16T13:06:51.663 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:51 smithi092 ceph-mon[99542]: Deploying daemon osd.0 on smithi092 2023-10-16T13:06:51.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:51 smithi152 ceph-mon[104423]: Deploying daemon osd.0 on smithi092 2023-10-16T13:06:52.321 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:52 smithi092 ceph-mon[99542]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:52.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:52 smithi118 ceph-mon[103969]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:52.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:52 smithi152 ceph-mon[104423]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:54.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:54 smithi118 ceph-mon[103969]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:54.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:54 smithi152 ceph-mon[104423]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:54.710 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:54 smithi092 ceph-mon[99542]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:55 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:55 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:55 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:55.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:55 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:55.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:55 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:55.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:55 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:55.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:55 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:55.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:55 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:55.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:55 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:56.379 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:56 smithi092 ceph-mon[99542]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:56.380 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:56 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:56.380 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:56 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:56.380 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:56 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:56.380 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:56 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:06:56.381 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:56 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:56.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:56 smithi152 ceph-mon[104423]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:56.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:56 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:56.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:56 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:56.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:56 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:56.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:56 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:06:56.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:56 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:56.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:56 smithi118 ceph-mon[103969]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:56.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:56 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:56.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:56 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:56.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:56 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:06:56.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:56 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:06:56.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:56 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:57.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:57.128+0000 7fb0837fe700 1 -- 172.21.15.92:0/2305027778 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb094069960 con 0x7fb07c038af0 2023-10-16T13:06:57.132 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 0 on host 'smithi092' 2023-10-16T13:06:57.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:57.130+0000 7fb098ae6700 1 -- 172.21.15.92:0/2305027778 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb07c038af0 msgr2=0x7fb07c03afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:57.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:57.131+0000 7fb098ae6700 1 --2- 172.21.15.92:0/2305027778 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb07c038af0 0x7fb07c03afb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb088005950 tx=0x7fb08800b410 comp rx=0 tx=0).stop 2023-10-16T13:06:57.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:57.131+0000 7fb098ae6700 1 -- 172.21.15.92:0/2305027778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0940ffe70 msgr2=0x7fb094196e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:06:57.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:57.131+0000 7fb098ae6700 1 --2- 172.21.15.92:0/2305027778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0940ffe70 0x7fb094196e40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb08400d9b0 tx=0x7fb08400dcc0 comp rx=0 tx=0).stop 2023-10-16T13:06:57.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:57.131+0000 7fb098ae6700 1 -- 172.21.15.92:0/2305027778 shutdown_connections 2023-10-16T13:06:57.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:57.131+0000 7fb098ae6700 1 --2- 172.21.15.92:0/2305027778 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb07c038af0 0x7fb07c03afb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:57.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:57.131+0000 7fb098ae6700 1 --2- 172.21.15.92:0/2305027778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0940ffe70 0x7fb094196e40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:57.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:57.131+0000 7fb098ae6700 1 --2- 172.21.15.92:0/2305027778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb094101990 0x7fb09419e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:57.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:57.131+0000 7fb098ae6700 1 --2- 172.21.15.92:0/2305027778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb094100fd0 0x7fb094197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:06:57.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:57.131+0000 7fb098ae6700 1 -- 172.21.15.92:0/2305027778 >> 172.21.15.92:0/2305027778 conn(0x7fb0940fb3f0 msgr2=0x7fb094069250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:06:57.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:57.131+0000 7fb098ae6700 1 -- 172.21.15.92:0/2305027778 shutdown_connections 2023-10-16T13:06:57.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:06:57.131+0000 7fb098ae6700 1 -- 172.21.15.92:0/2305027778 wait complete. 2023-10-16T13:06:57.578 DEBUG:teuthology.orchestra.run.smithi092:osd.0> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.0.service 2023-10-16T13:06:57.580 INFO:tasks.cephadm:Deploying osd.1 on smithi118 with /dev/vg_nvme/lv_4... 2023-10-16T13:06:57.581 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-16T13:06:57.612 INFO:journalctl@ceph.osd.0.smithi092.stdout:-- Logs begin at Mon 2023-10-16 12:49:18 UTC. -- 2023-10-16T13:06:58.134 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-16T13:06:58.345 INFO:journalctl@ceph.osd.0.smithi092.stdout:Oct 16 13:06:58 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-0[117459]: 2023-10-16T13:06:58.273+0000 7f20d6ba8640 -1 osd.0 0 log_to_monitors true 2023-10-16T13:06:58.345 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:58 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:58.345 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:58 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:58.345 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:58 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:58.346 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:58 smithi092 ceph-mon[99542]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:58.373 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:58 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:58.373 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:58 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:58.374 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:58 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:58.374 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:58 smithi118 ceph-mon[103969]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:58.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:58 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:58.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:58 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:06:58.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:58 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:06:58.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:58 smithi152 ceph-mon[104423]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:06:59.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:06:59 smithi092 ceph-mon[99542]: from='osd.0 [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-16T13:06:59.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:06:59 smithi152 ceph-mon[104423]: from='osd.0 [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-16T13:06:59.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:06:59 smithi118 ceph-mon[103969]: from='osd.0 [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-16T13:06:59.768 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-16T13:06:59.768 INFO:teuthology.orchestra.run.smithi118.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-16T13:06:59.769 INFO:teuthology.orchestra.run.smithi118.stderr: stderr: 10+0 records in 2023-10-16T13:06:59.769 INFO:teuthology.orchestra.run.smithi118.stderr:10+0 records out 2023-10-16T13:06:59.769 INFO:teuthology.orchestra.run.smithi118.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00828648 s, 1.3 GB/s 2023-10-16T13:06:59.769 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping successful for: 2023-10-16T13:07:00.186 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi118:vg_nvme/lv_4 2023-10-16T13:07:00.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:00 smithi152 ceph-mon[104423]: from='osd.0 [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-16T13:07:00.445 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:00 smithi152 ceph-mon[104423]: osdmap e6: 1 total, 0 up, 1 in 2023-10-16T13:07:00.445 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:00 smithi152 ceph-mon[104423]: from='osd.0 [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-16T13:07:00.445 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:00 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-16T13:07:00.445 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:00 smithi152 ceph-mon[104423]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:07:00.497 INFO:journalctl@ceph.osd.0.smithi092.stdout:Oct 16 13:07:00 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-0[117459]: 2023-10-16T13:07:00.122+0000 7f20cba1e700 -1 osd.0 0 waiting for initial osdmap 2023-10-16T13:07:00.497 INFO:journalctl@ceph.osd.0.smithi092.stdout:Oct 16 13:07:00 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-0[117459]: 2023-10-16T13:07:00.128+0000 7f20c400c700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:07:00.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:00 smithi092 ceph-mon[99542]: from='osd.0 [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-16T13:07:00.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:00 smithi092 ceph-mon[99542]: osdmap e6: 1 total, 0 up, 1 in 2023-10-16T13:07:00.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:00 smithi092 ceph-mon[99542]: from='osd.0 [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-16T13:07:00.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:00 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-16T13:07:00.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:00 smithi092 ceph-mon[99542]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:07:00.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:00 smithi118 ceph-mon[103969]: from='osd.0 [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-16T13:07:00.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:00 smithi118 ceph-mon[103969]: osdmap e6: 1 total, 0 up, 1 in 2023-10-16T13:07:00.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:00 smithi118 ceph-mon[103969]: from='osd.0 [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-16T13:07:00.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:00 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-16T13:07:00.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:00 smithi118 ceph-mon[103969]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:07:00.746 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-16T13:07:01.234 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:01 smithi118 ceph-mon[103969]: from='osd.0 [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-16T13:07:01.234 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:01 smithi118 ceph-mon[103969]: osdmap e7: 1 total, 0 up, 1 in 2023-10-16T13:07:01.234 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:01 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-16T13:07:01.234 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:01 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-16T13:07:01.235 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:01 smithi118 ceph-mon[103969]: Detected new or changed devices on smithi092 2023-10-16T13:07:01.235 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:01 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:01.235 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:01 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:01.235 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:01 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:07:01.235 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:01 smithi118 ceph-mon[103969]: Adjusting osd_memory_target on smithi092 to 17168M 2023-10-16T13:07:01.236 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:01 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:01.236 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:01 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:01.236 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:01 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:07:01.236 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:01 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:01.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:01 smithi152 ceph-mon[104423]: from='osd.0 [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-16T13:07:01.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:01 smithi152 ceph-mon[104423]: osdmap e7: 1 total, 0 up, 1 in 2023-10-16T13:07:01.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:01 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-16T13:07:01.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:01 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-16T13:07:01.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:01 smithi152 ceph-mon[104423]: Detected new or changed devices on smithi092 2023-10-16T13:07:01.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:01 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:01.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:01 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:01.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:01 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:07:01.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:01 smithi152 ceph-mon[104423]: Adjusting osd_memory_target on smithi092 to 17168M 2023-10-16T13:07:01.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:01 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:01.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:01 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:01.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:01 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:07:01.445 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:01 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:01.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:01 smithi092 ceph-mon[99542]: from='osd.0 [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-16T13:07:01.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:01 smithi092 ceph-mon[99542]: osdmap e7: 1 total, 0 up, 1 in 2023-10-16T13:07:01.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:01 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-16T13:07:01.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:01 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-16T13:07:01.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:01 smithi092 ceph-mon[99542]: Detected new or changed devices on smithi092 2023-10-16T13:07:01.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:01 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:01.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:01 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:01.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:01 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:07:01.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:01 smithi092 ceph-mon[99542]: Adjusting osd_memory_target on smithi092 to 17168M 2023-10-16T13:07:01.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:01 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:01.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:01 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:01.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:01 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:07:01.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:01 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:01.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.938+0000 7f86e99b1700 1 -- 172.21.15.118:0/2823577861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86e40ff660 msgr2=0x7f86e40ffa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:07:01.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.938+0000 7f86e99b1700 1 --2- 172.21.15.118:0/2823577861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86e40ff660 0x7f86e40ffa80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f86d80099c0 tx=0x7f86d8009cd0 comp rx=0 tx=0).stop 2023-10-16T13:07:01.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.938+0000 7f86e99b1700 1 -- 172.21.15.118:0/2823577861 shutdown_connections 2023-10-16T13:07:01.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.938+0000 7f86e99b1700 1 --2- 172.21.15.118:0/2823577861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86e4101200 0x7f86e4107ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:01.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.938+0000 7f86e99b1700 1 --2- 172.21.15.118:0/2823577861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86e40ff660 0x7f86e40ffa80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:01.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.938+0000 7f86e99b1700 1 --2- 172.21.15.118:0/2823577861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86e4100860 0x7f86e4100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:01.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.938+0000 7f86e99b1700 1 -- 172.21.15.118:0/2823577861 >> 172.21.15.118:0/2823577861 conn(0x7f86e40fac00 msgr2=0x7f86e40fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:07:01.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.938+0000 7f86e99b1700 1 -- 172.21.15.118:0/2823577861 shutdown_connections 2023-10-16T13:07:01.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.938+0000 7f86e99b1700 1 -- 172.21.15.118:0/2823577861 wait complete. 2023-10-16T13:07:01.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.938+0000 7f86e99b1700 1 Processor -- start 2023-10-16T13:07:01.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.938+0000 7f86e99b1700 1 -- start start 2023-10-16T13:07:01.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e99b1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86e40ff660 0x7f86e4196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:07:01.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e99b1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86e4100860 0x7f86e4197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:07:01.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e99b1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86e4101200 0x7f86e419e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:07:01.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e99b1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e419e880 con 0x7f86e4100860 2023-10-16T13:07:01.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e99b1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e419e9c0 con 0x7f86e40ff660 2023-10-16T13:07:01.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e99b1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e419eb80 con 0x7f86e4101200 2023-10-16T13:07:01.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e2ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86e40ff660 0x7f86e4196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:07:01.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e2ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86e40ff660 0x7f86e4196d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49958/0 (socket says 172.21.15.118:49958) 2023-10-16T13:07:01.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e2ffd700 1 -- 172.21.15.118:0/197588267 learned_addr learned my addr 172.21.15.118:0/197588267 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-16T13:07:01.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e37fe700 1 --2- 172.21.15.118:0/197588267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86e4101200 0x7f86e419e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:07:01.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e27fc700 1 --2- 172.21.15.118:0/197588267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86e4100860 0x7f86e4197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:07:01.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e2ffd700 1 -- 172.21.15.118:0/197588267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86e4101200 msgr2=0x7f86e419e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:07:01.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e2ffd700 1 --2- 172.21.15.118:0/197588267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86e4101200 0x7f86e419e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:01.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e2ffd700 1 -- 172.21.15.118:0/197588267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86e4100860 msgr2=0x7f86e4197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:07:01.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e2ffd700 1 --2- 172.21.15.118:0/197588267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86e4100860 0x7f86e4197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:01.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e2ffd700 1 -- 172.21.15.118:0/197588267 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d80095f0 con 0x7f86e40ff660 2023-10-16T13:07:01.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e37fe700 1 --2- 172.21.15.118:0/197588267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86e4101200 0x7f86e419e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:07:01.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e27fc700 1 --2- 172.21.15.118:0/197588267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86e4100860 0x7f86e4197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:07:01.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e2ffd700 1 --2- 172.21.15.118:0/197588267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86e40ff660 0x7f86e4196d30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f86d8003800 tx=0x7f86d8005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:07:01.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e89af700 1 -- 172.21.15.118:0/197588267 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d801d070 con 0x7f86e40ff660 2023-10-16T13:07:01.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e89af700 1 -- 172.21.15.118:0/197588267 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f86d80041a0 con 0x7f86e40ff660 2023-10-16T13:07:01.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e99b1700 1 -- 172.21.15.118:0/197588267 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e419ee00 con 0x7f86e40ff660 2023-10-16T13:07:01.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e89af700 1 -- 172.21.15.118:0/197588267 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8022e90 con 0x7f86e40ff660 2023-10-16T13:07:01.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.939+0000 7f86e99b1700 1 -- 172.21.15.118:0/197588267 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e419f1e0 con 0x7f86e40ff660 2023-10-16T13:07:01.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.940+0000 7f86e99b1700 1 -- 172.21.15.118:0/197588267 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e410afb0 con 0x7f86e40ff660 2023-10-16T13:07:01.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.942+0000 7f86e89af700 1 -- 172.21.15.118:0/197588267 <== mon.2 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f86d8022570 con 0x7f86e40ff660 2023-10-16T13:07:01.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.942+0000 7f86e89af700 1 --2- 172.21.15.118:0/197588267 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f86cc0a13f0 0x7f86cc0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:07:01.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.942+0000 7f86e89af700 1 -- 172.21.15.118:0/197588267 <== mon.2 v2:172.21.15.118:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f86d80cce40 con 0x7f86e40ff660 2023-10-16T13:07:01.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.943+0000 7f86e27fc700 1 --2- 172.21.15.118:0/197588267 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f86cc0a13f0 0x7f86cc0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:07:01.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.943+0000 7f86e27fc700 1 --2- 172.21.15.118:0/197588267 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f86cc0a13f0 0x7f86cc0a38b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f86d4005fd0 tx=0x7f86d4005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:07:01.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:01.946+0000 7f86e89af700 1 -- 172.21.15.118:0/197588267 <== mon.2 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f86d8097f00 con 0x7f86e40ff660 2023-10-16T13:07:02.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:02.149+0000 7f86e99b1700 1 -- 172.21.15.118:0/197588267 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f86e4106cb0 con 0x7f86cc0a13f0 2023-10-16T13:07:02.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:02 smithi152 ceph-mon[104423]: purged_snaps scrub starts 2023-10-16T13:07:02.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:02 smithi152 ceph-mon[104423]: purged_snaps scrub ok 2023-10-16T13:07:02.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:02 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-16T13:07:02.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:02 smithi152 ceph-mon[104423]: osd.0 [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261] boot 2023-10-16T13:07:02.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:02 smithi152 ceph-mon[104423]: osdmap e8: 1 total, 1 up, 1 in 2023-10-16T13:07:02.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:02 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-16T13:07:02.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:02 smithi152 ceph-mon[104423]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:07:02.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:02 smithi092 ceph-mon[99542]: purged_snaps scrub starts 2023-10-16T13:07:02.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:02 smithi092 ceph-mon[99542]: purged_snaps scrub ok 2023-10-16T13:07:02.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:02 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-16T13:07:02.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:02 smithi092 ceph-mon[99542]: osd.0 [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261] boot 2023-10-16T13:07:02.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:02 smithi092 ceph-mon[99542]: osdmap e8: 1 total, 1 up, 1 in 2023-10-16T13:07:02.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:02 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-16T13:07:02.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:02 smithi092 ceph-mon[99542]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:07:02.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:02 smithi118 ceph-mon[103969]: purged_snaps scrub starts 2023-10-16T13:07:02.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:02 smithi118 ceph-mon[103969]: purged_snaps scrub ok 2023-10-16T13:07:02.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:02 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-16T13:07:02.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:02 smithi118 ceph-mon[103969]: osd.0 [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261] boot 2023-10-16T13:07:02.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:02 smithi118 ceph-mon[103969]: osdmap e8: 1 total, 1 up, 1 in 2023-10-16T13:07:02.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:02 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-16T13:07:02.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:02 smithi118 ceph-mon[103969]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-16T13:07:03.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:03 smithi118 ceph-mon[103969]: osdmap e9: 1 total, 1 up, 1 in 2023-10-16T13:07:03.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:03 smithi118 ceph-mon[103969]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:07:03.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:03 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:07:03.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:03 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:07:03.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:03 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:03.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:03 smithi152 ceph-mon[104423]: osdmap e9: 1 total, 1 up, 1 in 2023-10-16T13:07:03.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:03 smithi152 ceph-mon[104423]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:07:03.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:03 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:07:03.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:03 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:07:03.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:03 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:03.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:03 smithi092 ceph-mon[99542]: osdmap e9: 1 total, 1 up, 1 in 2023-10-16T13:07:03.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:03 smithi092 ceph-mon[99542]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:07:03.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:03 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:07:03.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:03 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:07:03.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:03 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:04.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:04 smithi152 ceph-mon[104423]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:04.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:04 smithi092 ceph-mon[99542]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:04.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:04 smithi118 ceph-mon[103969]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:05.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:05 smithi152 ceph-mon[104423]: from='client.? 172.21.15.118:0/2649467547' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee68f65f-99c2-4bb9-9a7d-a6239cf9660e"}]: dispatch 2023-10-16T13:07:05.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:05 smithi152 ceph-mon[104423]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee68f65f-99c2-4bb9-9a7d-a6239cf9660e"}]: dispatch 2023-10-16T13:07:05.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:05 smithi152 ceph-mon[104423]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee68f65f-99c2-4bb9-9a7d-a6239cf9660e"}]': finished 2023-10-16T13:07:05.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:05 smithi152 ceph-mon[104423]: osdmap e10: 2 total, 1 up, 2 in 2023-10-16T13:07:05.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:05 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-16T13:07:05.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:05 smithi152 ceph-mon[104423]: from='client.? 172.21.15.118:0/3322014905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:07:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:05 smithi092 ceph-mon[99542]: from='client.? 172.21.15.118:0/2649467547' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee68f65f-99c2-4bb9-9a7d-a6239cf9660e"}]: dispatch 2023-10-16T13:07:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:05 smithi092 ceph-mon[99542]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee68f65f-99c2-4bb9-9a7d-a6239cf9660e"}]: dispatch 2023-10-16T13:07:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:05 smithi092 ceph-mon[99542]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee68f65f-99c2-4bb9-9a7d-a6239cf9660e"}]': finished 2023-10-16T13:07:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:05 smithi092 ceph-mon[99542]: osdmap e10: 2 total, 1 up, 2 in 2023-10-16T13:07:05.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:05 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-16T13:07:05.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:05 smithi092 ceph-mon[99542]: from='client.? 172.21.15.118:0/3322014905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:07:05.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:05 smithi118 ceph-mon[103969]: from='client.? 172.21.15.118:0/2649467547' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee68f65f-99c2-4bb9-9a7d-a6239cf9660e"}]: dispatch 2023-10-16T13:07:05.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:05 smithi118 ceph-mon[103969]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee68f65f-99c2-4bb9-9a7d-a6239cf9660e"}]: dispatch 2023-10-16T13:07:05.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:05 smithi118 ceph-mon[103969]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee68f65f-99c2-4bb9-9a7d-a6239cf9660e"}]': finished 2023-10-16T13:07:05.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:05 smithi118 ceph-mon[103969]: osdmap e10: 2 total, 1 up, 2 in 2023-10-16T13:07:05.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:05 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-16T13:07:05.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:05 smithi118 ceph-mon[103969]: from='client.? 172.21.15.118:0/3322014905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:07:06.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:06 smithi092 ceph-mon[99542]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:06.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:06 smithi118 ceph-mon[103969]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:06.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:06 smithi152 ceph-mon[104423]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:08.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:08 smithi092 ceph-mon[99542]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:08.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:08 smithi118 ceph-mon[103969]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:08.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:08 smithi152 ceph-mon[104423]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:10 smithi092 ceph-mon[99542]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:10.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:10 smithi118 ceph-mon[103969]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:10.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:10 smithi152 ceph-mon[104423]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:11.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:11 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-16T13:07:11.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:11 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:11.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:11 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-16T13:07:11.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:11 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:11.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:11 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-16T13:07:11.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:11 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:12.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:12 smithi118 ceph-mon[103969]: Deploying daemon osd.1 on smithi118 2023-10-16T13:07:12.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:12 smithi118 ceph-mon[103969]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:12.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:12 smithi152 ceph-mon[104423]: Deploying daemon osd.1 on smithi118 2023-10-16T13:07:12.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:12 smithi152 ceph-mon[104423]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:12.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:12 smithi092 ceph-mon[99542]: Deploying daemon osd.1 on smithi118 2023-10-16T13:07:12.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:12 smithi092 ceph-mon[99542]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:14.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:14 smithi118 ceph-mon[103969]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:14.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:14 smithi152 ceph-mon[104423]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:14 smithi092 ceph-mon[99542]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:16.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:16 smithi152 ceph-mon[104423]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:16.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:16 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:16.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:16 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:16.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:16 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:07:16.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:16 smithi092 ceph-mon[99542]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:16.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:16 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:16.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:16 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:16.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:16 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:07:16.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:16 smithi118 ceph-mon[103969]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:16.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:16 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:16.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:16 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:16.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:16 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:07:18.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:18.357+0000 7f86e89af700 1 -- 172.21.15.118:0/197588267 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f86e4106cb0 con 0x7f86cc0a13f0 2023-10-16T13:07:18.361 INFO:teuthology.orchestra.run.smithi118.stdout:Created osd(s) 1 on host 'smithi118' 2023-10-16T13:07:18.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:18.359+0000 7f86e99b1700 1 -- 172.21.15.118:0/197588267 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f86cc0a13f0 msgr2=0x7f86cc0a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:07:18.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:18.359+0000 7f86e99b1700 1 --2- 172.21.15.118:0/197588267 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f86cc0a13f0 0x7f86cc0a38b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f86d4005fd0 tx=0x7f86d4005ee0 comp rx=0 tx=0).stop 2023-10-16T13:07:18.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:18.359+0000 7f86e99b1700 1 -- 172.21.15.118:0/197588267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86e40ff660 msgr2=0x7f86e4196d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:07:18.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:18.359+0000 7f86e99b1700 1 --2- 172.21.15.118:0/197588267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86e40ff660 0x7f86e4196d30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f86d8003800 tx=0x7f86d8005e80 comp rx=0 tx=0).stop 2023-10-16T13:07:18.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:18.359+0000 7f86e99b1700 1 -- 172.21.15.118:0/197588267 shutdown_connections 2023-10-16T13:07:18.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:18.359+0000 7f86e99b1700 1 --2- 172.21.15.118:0/197588267 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f86cc0a13f0 0x7f86cc0a38b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:18.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:18.359+0000 7f86e99b1700 1 --2- 172.21.15.118:0/197588267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86e4101200 0x7f86e419e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:18.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:18.359+0000 7f86e99b1700 1 --2- 172.21.15.118:0/197588267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86e40ff660 0x7f86e4196d30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:18.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:18.359+0000 7f86e99b1700 1 --2- 172.21.15.118:0/197588267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86e4100860 0x7f86e4197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:18.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:18.359+0000 7f86e99b1700 1 -- 172.21.15.118:0/197588267 >> 172.21.15.118:0/197588267 conn(0x7f86e40fac00 msgr2=0x7f86e40fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:07:18.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:18.360+0000 7f86e99b1700 1 -- 172.21.15.118:0/197588267 shutdown_connections 2023-10-16T13:07:18.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:07:18.360+0000 7f86e99b1700 1 -- 172.21.15.118:0/197588267 wait complete. 2023-10-16T13:07:18.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:18 smithi118 ceph-mon[103969]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:18.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:18 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:18.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:18 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:18.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:18 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:18.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:18 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:07:18.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:18 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:18.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:18 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:18.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:18 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:18.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:18 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:07:18.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:18 smithi092 ceph-mon[99542]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:18.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:18.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:18.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:18.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:07:18.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:18.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:18.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:18.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:07:18.823 DEBUG:teuthology.orchestra.run.smithi118:osd.1> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.1.service 2023-10-16T13:07:18.826 INFO:tasks.cephadm:Deploying osd.2 on smithi152 with /dev/vg_nvme/lv_4... 2023-10-16T13:07:18.826 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-16T13:07:18.857 INFO:journalctl@ceph.osd.1.smithi118.stdout:-- Logs begin at Mon 2023-10-16 12:50:05 UTC. -- 2023-10-16T13:07:18.858 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:18 smithi152 ceph-mon[104423]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:18.858 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:18.859 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:18.859 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:18.859 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:07:18.859 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:18.860 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:18.860 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:18.860 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:07:19.393 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-16T13:07:19.664 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:19 smithi118 ceph-mon[103969]: from='osd.1 [v2:172.21.15.118:6800/106427465,v1:172.21.15.118:6801/106427465]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-16T13:07:19.664 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:19 smithi118 ceph-mon[103969]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-16T13:07:19.664 INFO:journalctl@ceph.osd.1.smithi118.stdout:Oct 16 13:07:19 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-1[109050]: 2023-10-16T13:07:19.375+0000 7f1f8b4e8640 -1 osd.1 0 log_to_monitors true 2023-10-16T13:07:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:19 smithi092 ceph-mon[99542]: from='osd.1 [v2:172.21.15.118:6800/106427465,v1:172.21.15.118:6801/106427465]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-16T13:07:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:19 smithi092 ceph-mon[99542]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-16T13:07:19.773 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:19 smithi152 ceph-mon[104423]: from='osd.1 [v2:172.21.15.118:6800/106427465,v1:172.21.15.118:6801/106427465]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-16T13:07:19.773 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:19 smithi152 ceph-mon[104423]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-16T13:07:20.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:20 smithi152 ceph-mon[104423]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:20.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:20 smithi152 ceph-mon[104423]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-16T13:07:20.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:20 smithi152 ceph-mon[104423]: from='osd.1 [v2:172.21.15.118:6800/106427465,v1:172.21.15.118:6801/106427465]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:07:20.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:20 smithi152 ceph-mon[104423]: osdmap e11: 2 total, 1 up, 2 in 2023-10-16T13:07:20.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:20 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-16T13:07:20.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:20 smithi152 ceph-mon[104423]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:07:20.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:20 smithi092 ceph-mon[99542]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:20.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:20 smithi092 ceph-mon[99542]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-16T13:07:20.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:20 smithi092 ceph-mon[99542]: from='osd.1 [v2:172.21.15.118:6800/106427465,v1:172.21.15.118:6801/106427465]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:07:20.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:20 smithi092 ceph-mon[99542]: osdmap e11: 2 total, 1 up, 2 in 2023-10-16T13:07:20.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:20 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-16T13:07:20.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:20 smithi092 ceph-mon[99542]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:07:20.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:20 smithi118 ceph-mon[103969]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:20.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:20 smithi118 ceph-mon[103969]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-16T13:07:20.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:20 smithi118 ceph-mon[103969]: from='osd.1 [v2:172.21.15.118:6800/106427465,v1:172.21.15.118:6801/106427465]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:07:20.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:20 smithi118 ceph-mon[103969]: osdmap e11: 2 total, 1 up, 2 in 2023-10-16T13:07:20.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:20 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-16T13:07:20.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:20 smithi118 ceph-mon[103969]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:07:20.786 INFO:journalctl@ceph.osd.1.smithi118.stdout:Oct 16 13:07:20 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-1[109050]: 2023-10-16T13:07:20.462+0000 7f1f8035e700 -1 osd.1 0 waiting for initial osdmap 2023-10-16T13:07:20.786 INFO:journalctl@ceph.osd.1.smithi118.stdout:Oct 16 13:07:20 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-1[109050]: 2023-10-16T13:07:20.466+0000 7f1f7a14f700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:07:20.895 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-16T13:07:20.895 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-16T13:07:20.896 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2023-10-16T13:07:20.896 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2023-10-16T13:07:20.896 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114879 s, 913 MB/s 2023-10-16T13:07:20.896 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2023-10-16T13:07:21.338 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi152:vg_nvme/lv_4 2023-10-16T13:07:21.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:21 smithi152 ceph-mon[104423]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-16T13:07:21.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:21 smithi152 ceph-mon[104423]: osdmap e12: 2 total, 1 up, 2 in 2023-10-16T13:07:21.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:21 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-16T13:07:21.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:21 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-16T13:07:21.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:21 smithi092 ceph-mon[99542]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-16T13:07:21.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:21 smithi092 ceph-mon[99542]: osdmap e12: 2 total, 1 up, 2 in 2023-10-16T13:07:21.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:21 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-16T13:07:21.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:21 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-16T13:07:21.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:21 smithi118 ceph-mon[103969]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-16T13:07:21.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:21 smithi118 ceph-mon[103969]: osdmap e12: 2 total, 1 up, 2 in 2023-10-16T13:07:21.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-16T13:07:21.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:21 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-16T13:07:21.933 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-16T13:07:22.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:22 smithi092 ceph-mon[99542]: purged_snaps scrub starts 2023-10-16T13:07:22.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:22 smithi092 ceph-mon[99542]: purged_snaps scrub ok 2023-10-16T13:07:22.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:22 smithi092 ceph-mon[99542]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:22.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:22 smithi092 ceph-mon[99542]: osd.1 [v2:172.21.15.118:6800/106427465,v1:172.21.15.118:6801/106427465] boot 2023-10-16T13:07:22.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:22 smithi092 ceph-mon[99542]: osdmap e13: 2 total, 2 up, 2 in 2023-10-16T13:07:22.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:22 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-16T13:07:22.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:22 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:22.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:22 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:22.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:22 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:07:22.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:22 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:22.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:22 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:22.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:22 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:07:22.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:22 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:22.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:22 smithi118 ceph-mon[103969]: purged_snaps scrub starts 2023-10-16T13:07:22.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:22 smithi118 ceph-mon[103969]: purged_snaps scrub ok 2023-10-16T13:07:22.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:22 smithi118 ceph-mon[103969]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:22.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:22 smithi118 ceph-mon[103969]: osd.1 [v2:172.21.15.118:6800/106427465,v1:172.21.15.118:6801/106427465] boot 2023-10-16T13:07:22.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:22 smithi118 ceph-mon[103969]: osdmap e13: 2 total, 2 up, 2 in 2023-10-16T13:07:22.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:22 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-16T13:07:22.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:22 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:22.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:22 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:22.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:22 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:07:22.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:22 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:22.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:22 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:22.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:22 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:07:22.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:22 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:22.930 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:22 smithi152 ceph-mon[104423]: purged_snaps scrub starts 2023-10-16T13:07:22.930 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:22 smithi152 ceph-mon[104423]: purged_snaps scrub ok 2023-10-16T13:07:22.931 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:22 smithi152 ceph-mon[104423]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-16T13:07:22.931 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:22 smithi152 ceph-mon[104423]: osd.1 [v2:172.21.15.118:6800/106427465,v1:172.21.15.118:6801/106427465] boot 2023-10-16T13:07:22.931 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:22 smithi152 ceph-mon[104423]: osdmap e13: 2 total, 2 up, 2 in 2023-10-16T13:07:22.931 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:22 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-16T13:07:22.931 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:22 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:22.932 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:22 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:22.932 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:22 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:07:22.932 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:22 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:22.932 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:22 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:22.932 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:22 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:07:22.933 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:22 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:23.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.123+0000 7f5f2aa84700 1 -- 172.21.15.152:0/678118886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f240ff630 msgr2=0x7f5f240ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:07:23.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.123+0000 7f5f2aa84700 1 --2- 172.21.15.152:0/678118886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f240ff630 0x7f5f240ffa50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5f18009990 tx=0x7f5f18009ca0 comp rx=0 tx=0).stop 2023-10-16T13:07:23.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.124+0000 7f5f2aa84700 1 -- 172.21.15.152:0/678118886 shutdown_connections 2023-10-16T13:07:23.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.124+0000 7f5f2aa84700 1 --2- 172.21.15.152:0/678118886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f241011d0 0x7f5f24107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:23.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.124+0000 7f5f2aa84700 1 --2- 172.21.15.152:0/678118886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f240ff630 0x7f5f240ffa50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:23.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.124+0000 7f5f2aa84700 1 --2- 172.21.15.152:0/678118886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f24100830 0x7f5f24100c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:23.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.124+0000 7f5f2aa84700 1 -- 172.21.15.152:0/678118886 >> 172.21.15.152:0/678118886 conn(0x7f5f240fabd0 msgr2=0x7f5f240fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:07:23.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.124+0000 7f5f2aa84700 1 -- 172.21.15.152:0/678118886 shutdown_connections 2023-10-16T13:07:23.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.124+0000 7f5f2aa84700 1 -- 172.21.15.152:0/678118886 wait complete. 2023-10-16T13:07:23.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.124+0000 7f5f2aa84700 1 Processor -- start 2023-10-16T13:07:23.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.124+0000 7f5f2aa84700 1 -- start start 2023-10-16T13:07:23.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f2aa84700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f240ff630 0x7f5f241035c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:07:23.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f2aa84700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f24100830 0x7f5f24101c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:07:23.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f2aa84700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f241011d0 0x7f5f24102150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:07:23.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f2aa84700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f241028d0 con 0x7f5f240ff630 2023-10-16T13:07:23.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f2aa84700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f24102a40 con 0x7f5f24100830 2023-10-16T13:07:23.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f2aa84700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f241a0d30 con 0x7f5f241011d0 2023-10-16T13:07:23.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f29021700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f241011d0 0x7f5f24102150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:07:23.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f29021700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f241011d0 0x7f5f24102150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45392/0 (socket says 172.21.15.152:45392) 2023-10-16T13:07:23.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f29021700 1 -- 172.21.15.152:0/3359824926 learned_addr learned my addr 172.21.15.152:0/3359824926 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T13:07:23.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f28820700 1 --2- 172.21.15.152:0/3359824926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f240ff630 0x7f5f241035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:07:23.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f23fff700 1 --2- 172.21.15.152:0/3359824926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f24100830 0x7f5f24101c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:07:23.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f29021700 1 -- 172.21.15.152:0/3359824926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f24100830 msgr2=0x7f5f24101c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:07:23.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f29021700 1 --2- 172.21.15.152:0/3359824926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f24100830 0x7f5f24101c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:23.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f29021700 1 -- 172.21.15.152:0/3359824926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f240ff630 msgr2=0x7f5f241035c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:07:23.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f29021700 1 --2- 172.21.15.152:0/3359824926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f240ff630 0x7f5f241035c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:23.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f29021700 1 -- 172.21.15.152:0/3359824926 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f180095f0 con 0x7f5f241011d0 2023-10-16T13:07:23.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f29021700 1 --2- 172.21.15.152:0/3359824926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f241011d0 0x7f5f24102150 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c007ee0 tx=0x7f5f1c00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:07:23.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f21ffb700 1 -- 172.21.15.152:0/3359824926 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c017070 con 0x7f5f241011d0 2023-10-16T13:07:23.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f21ffb700 1 -- 172.21.15.152:0/3359824926 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5f1c00f040 con 0x7f5f241011d0 2023-10-16T13:07:23.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f2aa84700 1 -- 172.21.15.152:0/3359824926 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f241a0fb0 con 0x7f5f241011d0 2023-10-16T13:07:23.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.125+0000 7f5f21ffb700 1 -- 172.21.15.152:0/3359824926 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c005760 con 0x7f5f241011d0 2023-10-16T13:07:23.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.126+0000 7f5f2aa84700 1 -- 172.21.15.152:0/3359824926 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f241a1420 con 0x7f5f241011d0 2023-10-16T13:07:23.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.126+0000 7f5f2aa84700 1 -- 172.21.15.152:0/3359824926 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2410af70 con 0x7f5f241011d0 2023-10-16T13:07:23.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.127+0000 7f5f21ffb700 1 -- 172.21.15.152:0/3359824926 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f5f1c0058c0 con 0x7f5f241011d0 2023-10-16T13:07:23.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.128+0000 7f5f21ffb700 1 --2- 172.21.15.152:0/3359824926 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5f140a1470 0x7f5f140a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:07:23.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.128+0000 7f5f21ffb700 1 -- 172.21.15.152:0/3359824926 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7f5f1c0caca0 con 0x7f5f241011d0 2023-10-16T13:07:23.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.128+0000 7f5f28820700 1 --2- 172.21.15.152:0/3359824926 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5f140a1470 0x7f5f140a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:07:23.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.129+0000 7f5f28820700 1 --2- 172.21.15.152:0/3359824926 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5f140a1470 0x7f5f140a3930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5f18006010 tx=0x7f5f18005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:07:23.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.133+0000 7f5f21ffb700 1 -- 172.21.15.152:0/3359824926 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5f1c095ab0 con 0x7f5f241011d0 2023-10-16T13:07:23.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:23.331+0000 7f5f2aa84700 1 -- 172.21.15.152:0/3359824926 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f24106c80 con 0x7f5f140a1470 2023-10-16T13:07:23.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:23 smithi092 ceph-mon[99542]: Detected new or changed devices on smithi118 2023-10-16T13:07:23.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:23 smithi092 ceph-mon[99542]: Adjusting osd_memory_target on smithi118 to 17168M 2023-10-16T13:07:23.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:23 smithi092 ceph-mon[99542]: osdmap e14: 2 total, 2 up, 2 in 2023-10-16T13:07:23.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:23 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:07:23.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:23 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:07:23.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:23 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:23.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:23 smithi118 ceph-mon[103969]: Detected new or changed devices on smithi118 2023-10-16T13:07:23.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:23 smithi118 ceph-mon[103969]: Adjusting osd_memory_target on smithi118 to 17168M 2023-10-16T13:07:23.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:23 smithi118 ceph-mon[103969]: osdmap e14: 2 total, 2 up, 2 in 2023-10-16T13:07:23.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:23 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:07:23.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:23 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:07:23.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:23 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:23.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:23 smithi152 ceph-mon[104423]: Detected new or changed devices on smithi118 2023-10-16T13:07:23.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:23 smithi152 ceph-mon[104423]: Adjusting osd_memory_target on smithi118 to 17168M 2023-10-16T13:07:23.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:23 smithi152 ceph-mon[104423]: osdmap e14: 2 total, 2 up, 2 in 2023-10-16T13:07:23.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:23 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:07:23.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:23 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:07:23.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:23 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:24.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:24 smithi152 ceph-mon[104423]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:24.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:24 smithi152 ceph-mon[104423]: from='client.24148 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:07:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:24 smithi092 ceph-mon[99542]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:24 smithi092 ceph-mon[99542]: from='client.24148 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:07:24.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:24 smithi118 ceph-mon[103969]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:24.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:24 smithi118 ceph-mon[103969]: from='client.24148 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:07:26.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:26 smithi092 ceph-mon[99542]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:26.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:26 smithi092 ceph-mon[99542]: from='client.? 172.21.15.152:0/4105895549' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "094dbf98-7978-4174-a403-1df4105a77e5"}]: dispatch 2023-10-16T13:07:26.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:26 smithi092 ceph-mon[99542]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "094dbf98-7978-4174-a403-1df4105a77e5"}]: dispatch 2023-10-16T13:07:26.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:26 smithi092 ceph-mon[99542]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "094dbf98-7978-4174-a403-1df4105a77e5"}]': finished 2023-10-16T13:07:26.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:26 smithi092 ceph-mon[99542]: osdmap e15: 3 total, 2 up, 3 in 2023-10-16T13:07:26.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-16T13:07:26.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:26 smithi092 ceph-mon[99542]: from='client.? 172.21.15.152:0/4190815411' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:07:26.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:26 smithi118 ceph-mon[103969]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:26.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:26 smithi118 ceph-mon[103969]: from='client.? 172.21.15.152:0/4105895549' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "094dbf98-7978-4174-a403-1df4105a77e5"}]: dispatch 2023-10-16T13:07:26.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:26 smithi118 ceph-mon[103969]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "094dbf98-7978-4174-a403-1df4105a77e5"}]: dispatch 2023-10-16T13:07:26.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:26 smithi118 ceph-mon[103969]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "094dbf98-7978-4174-a403-1df4105a77e5"}]': finished 2023-10-16T13:07:26.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:26 smithi118 ceph-mon[103969]: osdmap e15: 3 total, 2 up, 3 in 2023-10-16T13:07:26.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:26 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-16T13:07:26.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:26 smithi118 ceph-mon[103969]: from='client.? 172.21.15.152:0/4190815411' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:07:26.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:26 smithi152 ceph-mon[104423]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:26.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:26 smithi152 ceph-mon[104423]: from='client.? 172.21.15.152:0/4105895549' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "094dbf98-7978-4174-a403-1df4105a77e5"}]: dispatch 2023-10-16T13:07:26.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:26 smithi152 ceph-mon[104423]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "094dbf98-7978-4174-a403-1df4105a77e5"}]: dispatch 2023-10-16T13:07:26.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:26 smithi152 ceph-mon[104423]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "094dbf98-7978-4174-a403-1df4105a77e5"}]': finished 2023-10-16T13:07:26.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:26 smithi152 ceph-mon[104423]: osdmap e15: 3 total, 2 up, 3 in 2023-10-16T13:07:26.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-16T13:07:26.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:26 smithi152 ceph-mon[104423]: from='client.? 172.21.15.152:0/4190815411' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:07:28.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:28 smithi118 ceph-mon[103969]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:28.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:28 smithi152 ceph-mon[104423]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:28.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:28 smithi092 ceph-mon[99542]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:30.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:30 smithi118 ceph-mon[103969]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:30.893 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:30 smithi152 ceph-mon[104423]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:30.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:30 smithi092 ceph-mon[99542]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:32.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:32 smithi118 ceph-mon[103969]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:32.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:32 smithi152 ceph-mon[104423]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:32.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:32 smithi092 ceph-mon[99542]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:33.759 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:33 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-16T13:07:33.760 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:33 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:33.760 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:33 smithi152 ceph-mon[104423]: Deploying daemon osd.2 on smithi152 2023-10-16T13:07:33.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:33 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-16T13:07:33.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:33 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:33.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:33 smithi118 ceph-mon[103969]: Deploying daemon osd.2 on smithi152 2023-10-16T13:07:33.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:33 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-16T13:07:33.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:33 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:33.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:33 smithi092 ceph-mon[99542]: Deploying daemon osd.2 on smithi152 2023-10-16T13:07:34.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:34 smithi152 ceph-mon[104423]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:34.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:34 smithi118 ceph-mon[103969]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:34.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:34 smithi092 ceph-mon[99542]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:36.775 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:36 smithi152 ceph-mon[104423]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:36.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:36 smithi118 ceph-mon[103969]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:36.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:36 smithi092 ceph-mon[99542]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:38.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:38 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:38.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:38 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:38.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:38 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:07:38.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:38 smithi152 ceph-mon[104423]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:38.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:38 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:38.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:38 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:38.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:38 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:07:38.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:38 smithi092 ceph-mon[99542]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:38.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:38 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:38.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:38 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:38.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:38 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:07:38.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:38 smithi118 ceph-mon[103969]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:39.792 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 2 on host 'smithi152' 2023-10-16T13:07:39.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:39.790+0000 7f5f21ffb700 1 -- 172.21.15.152:0/3359824926 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5f24106c80 con 0x7f5f140a1470 2023-10-16T13:07:39.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:39.792+0000 7f5f2aa84700 1 -- 172.21.15.152:0/3359824926 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5f140a1470 msgr2=0x7f5f140a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:07:39.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:39.792+0000 7f5f2aa84700 1 --2- 172.21.15.152:0/3359824926 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5f140a1470 0x7f5f140a3930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5f18006010 tx=0x7f5f18005960 comp rx=0 tx=0).stop 2023-10-16T13:07:39.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:39.792+0000 7f5f2aa84700 1 -- 172.21.15.152:0/3359824926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f241011d0 msgr2=0x7f5f24102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:07:39.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:39.792+0000 7f5f2aa84700 1 --2- 172.21.15.152:0/3359824926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f241011d0 0x7f5f24102150 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c007ee0 tx=0x7f5f1c00d3b0 comp rx=0 tx=0).stop 2023-10-16T13:07:39.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:39.792+0000 7f5f2aa84700 1 -- 172.21.15.152:0/3359824926 shutdown_connections 2023-10-16T13:07:39.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:39.792+0000 7f5f2aa84700 1 --2- 172.21.15.152:0/3359824926 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5f140a1470 0x7f5f140a3930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:39.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:39.792+0000 7f5f2aa84700 1 --2- 172.21.15.152:0/3359824926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f240ff630 0x7f5f241035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:39.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:39.792+0000 7f5f2aa84700 1 --2- 172.21.15.152:0/3359824926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f241011d0 0x7f5f24102150 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:39.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:39.792+0000 7f5f2aa84700 1 --2- 172.21.15.152:0/3359824926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f24100830 0x7f5f24101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:39.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:39.792+0000 7f5f2aa84700 1 -- 172.21.15.152:0/3359824926 >> 172.21.15.152:0/3359824926 conn(0x7f5f240fabd0 msgr2=0x7f5f240fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:07:39.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:39.792+0000 7f5f2aa84700 1 -- 172.21.15.152:0/3359824926 shutdown_connections 2023-10-16T13:07:39.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:07:39.792+0000 7f5f2aa84700 1 -- 172.21.15.152:0/3359824926 wait complete. 2023-10-16T13:07:40.214 DEBUG:teuthology.orchestra.run.smithi152:osd.2> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.2.service 2023-10-16T13:07:40.217 INFO:tasks.cephadm:Deploying osd.3 on smithi092 with /dev/vg_nvme/lv_3... 2023-10-16T13:07:40.218 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-16T13:07:40.247 INFO:journalctl@ceph.osd.2.smithi152.stdout:-- Logs begin at Mon 2023-10-16 12:49:44 UTC. -- 2023-10-16T13:07:40.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:40 smithi152 ceph-mon[104423]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:40.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:40.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:40.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:40.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:07:40.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:40.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:40.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:40.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:07:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:40 smithi092 ceph-mon[99542]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:40.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:40.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:40.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:40.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:07:40.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:40.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:40.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:40.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:07:40.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:40 smithi118 ceph-mon[103969]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:40.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:40.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:40.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:40.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:07:40.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:40.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:40.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:40.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:07:40.793 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:07:41.192 INFO:journalctl@ceph.osd.2.smithi152.stdout:Oct 16 13:07:41 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-2[110270]: 2023-10-16T13:07:41.049+0000 7fdc9ebee640 -1 osd.2 0 log_to_monitors true 2023-10-16T13:07:41.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:41 smithi152 ceph-mon[104423]: from='osd.2 [v2:172.21.15.152:6800/304464027,v1:172.21.15.152:6801/304464027]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-16T13:07:41.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:41 smithi152 ceph-mon[104423]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-16T13:07:41.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:41 smithi092 ceph-mon[99542]: from='osd.2 [v2:172.21.15.152:6800/304464027,v1:172.21.15.152:6801/304464027]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-16T13:07:41.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:41 smithi092 ceph-mon[99542]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-16T13:07:41.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:41 smithi118 ceph-mon[103969]: from='osd.2 [v2:172.21.15.152:6800/304464027,v1:172.21.15.152:6801/304464027]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-16T13:07:41.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:41 smithi118 ceph-mon[103969]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-16T13:07:42.445 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-16T13:07:42.445 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-16T13:07:42.445 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2023-10-16T13:07:42.445 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2023-10-16T13:07:42.446 INFO:teuthology.orchestra.run.smithi092.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110538 s, 949 MB/s 2023-10-16T13:07:42.446 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2023-10-16T13:07:42.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:42 smithi092 ceph-mon[99542]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:42.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:42 smithi092 ceph-mon[99542]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-16T13:07:42.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:42 smithi092 ceph-mon[99542]: osdmap e16: 3 total, 2 up, 3 in 2023-10-16T13:07:42.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:42 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-16T13:07:42.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:42 smithi092 ceph-mon[99542]: from='osd.2 [v2:172.21.15.152:6800/304464027,v1:172.21.15.152:6801/304464027]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:07:42.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:42 smithi092 ceph-mon[99542]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:07:42.658 INFO:journalctl@ceph.osd.2.smithi152.stdout:Oct 16 13:07:42 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-2[110270]: 2023-10-16T13:07:42.314+0000 7fdc93a64700 -1 osd.2 0 waiting for initial osdmap 2023-10-16T13:07:42.658 INFO:journalctl@ceph.osd.2.smithi152.stdout:Oct 16 13:07:42 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-2[110270]: 2023-10-16T13:07:42.318+0000 7fdc8e056700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:07:42.659 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:42 smithi152 ceph-mon[104423]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:42.659 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:42 smithi152 ceph-mon[104423]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-16T13:07:42.659 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:42 smithi152 ceph-mon[104423]: osdmap e16: 3 total, 2 up, 3 in 2023-10-16T13:07:42.659 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:42 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-16T13:07:42.659 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:42 smithi152 ceph-mon[104423]: from='osd.2 [v2:172.21.15.152:6800/304464027,v1:172.21.15.152:6801/304464027]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:07:42.660 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:42 smithi152 ceph-mon[104423]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:07:42.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:42 smithi118 ceph-mon[103969]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:42.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:42 smithi118 ceph-mon[103969]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-16T13:07:42.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:42 smithi118 ceph-mon[103969]: osdmap e16: 3 total, 2 up, 3 in 2023-10-16T13:07:42.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:42 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-16T13:07:42.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:42 smithi118 ceph-mon[103969]: from='osd.2 [v2:172.21.15.152:6800/304464027,v1:172.21.15.152:6801/304464027]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:07:42.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:42 smithi118 ceph-mon[103969]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:07:42.849 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi092:vg_nvme/lv_3 2023-10-16T13:07:43.405 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:07:43.658 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:43 smithi092 ceph-mon[99542]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-10-16T13:07:43.658 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:43 smithi092 ceph-mon[99542]: osdmap e17: 3 total, 2 up, 3 in 2023-10-16T13:07:43.659 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-16T13:07:43.659 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-16T13:07:43.659 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:43.659 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:43.659 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:07:43.660 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:43.660 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:43.660 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:07:43.660 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:43.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:43 smithi152 ceph-mon[104423]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-10-16T13:07:43.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:43 smithi152 ceph-mon[104423]: osdmap e17: 3 total, 2 up, 3 in 2023-10-16T13:07:43.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-16T13:07:43.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-16T13:07:43.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:43.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:43.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:07:43.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:43.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:43.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:07:43.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:43.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:43 smithi118 ceph-mon[103969]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-10-16T13:07:43.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:43 smithi118 ceph-mon[103969]: osdmap e17: 3 total, 2 up, 3 in 2023-10-16T13:07:43.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-16T13:07:43.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-16T13:07:43.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:43.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:43.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:07:43.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:43.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:43.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:07:43.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:44.556 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:44 smithi092 ceph-mon[99542]: purged_snaps scrub starts 2023-10-16T13:07:44.556 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:44 smithi092 ceph-mon[99542]: purged_snaps scrub ok 2023-10-16T13:07:44.556 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:44 smithi092 ceph-mon[99542]: Detected new or changed devices on smithi152 2023-10-16T13:07:44.556 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:44 smithi092 ceph-mon[99542]: Adjusting osd_memory_target on smithi152 to 17168M 2023-10-16T13:07:44.557 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:44 smithi092 ceph-mon[99542]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:44.557 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:44 smithi092 ceph-mon[99542]: osd.2 [v2:172.21.15.152:6800/304464027,v1:172.21.15.152:6801/304464027] boot 2023-10-16T13:07:44.557 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:44 smithi092 ceph-mon[99542]: osdmap e18: 3 total, 3 up, 3 in 2023-10-16T13:07:44.557 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:44 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-16T13:07:44.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:44 smithi152 ceph-mon[104423]: purged_snaps scrub starts 2023-10-16T13:07:44.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:44 smithi152 ceph-mon[104423]: purged_snaps scrub ok 2023-10-16T13:07:44.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:44 smithi152 ceph-mon[104423]: Detected new or changed devices on smithi152 2023-10-16T13:07:44.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:44 smithi152 ceph-mon[104423]: Adjusting osd_memory_target on smithi152 to 17168M 2023-10-16T13:07:44.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:44 smithi152 ceph-mon[104423]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:44.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:44 smithi152 ceph-mon[104423]: osd.2 [v2:172.21.15.152:6800/304464027,v1:172.21.15.152:6801/304464027] boot 2023-10-16T13:07:44.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:44 smithi152 ceph-mon[104423]: osdmap e18: 3 total, 3 up, 3 in 2023-10-16T13:07:44.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:44 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-16T13:07:44.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.733+0000 7f9a03e66700 1 -- 172.21.15.92:0/3193809922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99fc100fd0 msgr2=0x7f99fc101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:07:44.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.733+0000 7f9a03e66700 1 --2- 172.21.15.92:0/3193809922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99fc100fd0 0x7f99fc101450 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009990 tx=0x7f99f8009ca0 comp rx=0 tx=0).stop 2023-10-16T13:07:44.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.733+0000 7f9a03e66700 1 -- 172.21.15.92:0/3193809922 shutdown_connections 2023-10-16T13:07:44.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.733+0000 7f9a03e66700 1 --2- 172.21.15.92:0/3193809922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99fc101990 0x7f99fc1082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:44.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.733+0000 7f9a03e66700 1 --2- 172.21.15.92:0/3193809922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99fc0ffe70 0x7f99fc100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:44.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.733+0000 7f9a03e66700 1 --2- 172.21.15.92:0/3193809922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99fc100fd0 0x7f99fc101450 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:44.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.733+0000 7f9a03e66700 1 -- 172.21.15.92:0/3193809922 >> 172.21.15.92:0/3193809922 conn(0x7f99fc0fb3f0 msgr2=0x7f99fc0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:07:44.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.733+0000 7f9a03e66700 1 -- 172.21.15.92:0/3193809922 shutdown_connections 2023-10-16T13:07:44.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.733+0000 7f9a03e66700 1 -- 172.21.15.92:0/3193809922 wait complete. 2023-10-16T13:07:44.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.734+0000 7f9a03e66700 1 Processor -- start 2023-10-16T13:07:44.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.734+0000 7f9a03e66700 1 -- start start 2023-10-16T13:07:44.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.734+0000 7f9a03e66700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99fc0ffe70 0x7f99fc069d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:07:44.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.734+0000 7f9a03e66700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99fc100fd0 0x7f99fc19ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:07:44.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.734+0000 7f9a03e66700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99fc101990 0x7f99fc19e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:07:44.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.734+0000 7f9a03e66700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc19e850 con 0x7f99fc0ffe70 2023-10-16T13:07:44.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.734+0000 7f9a03e66700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc19e9c0 con 0x7f99fc101990 2023-10-16T13:07:44.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.734+0000 7f9a03e66700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc19eb80 con 0x7f99fc100fd0 2023-10-16T13:07:44.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.734+0000 7f9a01c02700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99fc0ffe70 0x7f99fc069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:07:44.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.734+0000 7f9a01c02700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99fc0ffe70 0x7f99fc069d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34368/0 (socket says 172.21.15.92:34368) 2023-10-16T13:07:44.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.734+0000 7f9a01c02700 1 -- 172.21.15.92:0/1355692040 learned_addr learned my addr 172.21.15.92:0/1355692040 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:07:44.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.734+0000 7f9a01401700 1 --2- 172.21.15.92:0/1355692040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99fc100fd0 0x7f99fc19ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:07:44.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.734+0000 7f9a02403700 1 --2- 172.21.15.92:0/1355692040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99fc101990 0x7f99fc19e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:07:44.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.734+0000 7f9a01c02700 1 -- 172.21.15.92:0/1355692040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99fc100fd0 msgr2=0x7f99fc19ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:07:44.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.734+0000 7f9a01c02700 1 --2- 172.21.15.92:0/1355692040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99fc100fd0 0x7f99fc19ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:44.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.734+0000 7f9a01c02700 1 -- 172.21.15.92:0/1355692040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99fc101990 msgr2=0x7f99fc19e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:07:44.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.734+0000 7f9a01c02700 1 --2- 172.21.15.92:0/1355692040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99fc101990 0x7f99fc19e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:07:44.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.734+0000 7f9a01c02700 1 -- 172.21.15.92:0/1355692040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec009520 con 0x7f99fc0ffe70 2023-10-16T13:07:44.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.734+0000 7f9a02403700 1 --2- 172.21.15.92:0/1355692040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99fc101990 0x7f99fc19e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:07:44.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.735+0000 7f9a01c02700 1 --2- 172.21.15.92:0/1355692040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99fc0ffe70 0x7f99fc069d90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00eb30 tx=0x7f99ec00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:07:44.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.735+0000 7f99f2ffd700 1 -- 172.21.15.92:0/1355692040 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec009880 con 0x7f99fc0ffe70 2023-10-16T13:07:44.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.735+0000 7f99f2ffd700 1 -- 172.21.15.92:0/1355692040 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f99ec004500 con 0x7f99fc0ffe70 2023-10-16T13:07:44.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.735+0000 7f9a03e66700 1 -- 172.21.15.92:0/1355692040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f80095f0 con 0x7f99fc0ffe70 2023-10-16T13:07:44.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.735+0000 7f99f2ffd700 1 -- 172.21.15.92:0/1355692040 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec010430 con 0x7f99fc0ffe70 2023-10-16T13:07:44.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.735+0000 7f9a03e66700 1 -- 172.21.15.92:0/1355692040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99fc19f1a0 con 0x7f99fc0ffe70 2023-10-16T13:07:44.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.736+0000 7f9a03e66700 1 -- 172.21.15.92:0/1355692040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99fc1073b0 con 0x7f99fc0ffe70 2023-10-16T13:07:44.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.737+0000 7f99f2ffd700 1 -- 172.21.15.92:0/1355692040 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f99ec00cc90 con 0x7f99fc0ffe70 2023-10-16T13:07:44.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.737+0000 7f99f2ffd700 1 --2- 172.21.15.92:0/1355692040 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f99e80a13f0 0x7f99e80a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:07:44.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.737+0000 7f9a01401700 1 --2- 172.21.15.92:0/1355692040 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f99e80a13f0 0x7f99e80a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:07:44.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.737+0000 7f99f2ffd700 1 -- 172.21.15.92:0/1355692040 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 2851+0+0 (secure 0 0 0) 0x7f99ec014070 con 0x7f99fc0ffe70 2023-10-16T13:07:44.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.738+0000 7f9a01401700 1 --2- 172.21.15.92:0/1355692040 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f99e80a13f0 0x7f99e80a38b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f99f800b2e0 tx=0x7f99f8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:07:44.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.741+0000 7f99f2ffd700 1 -- 172.21.15.92:0/1355692040 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f99ec096830 con 0x7f99fc0ffe70 2023-10-16T13:07:44.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:44 smithi118 ceph-mon[103969]: purged_snaps scrub starts 2023-10-16T13:07:44.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:44 smithi118 ceph-mon[103969]: purged_snaps scrub ok 2023-10-16T13:07:44.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:44 smithi118 ceph-mon[103969]: Detected new or changed devices on smithi152 2023-10-16T13:07:44.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:44 smithi118 ceph-mon[103969]: Adjusting osd_memory_target on smithi152 to 17168M 2023-10-16T13:07:44.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:44 smithi118 ceph-mon[103969]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-16T13:07:44.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:44 smithi118 ceph-mon[103969]: osd.2 [v2:172.21.15.152:6800/304464027,v1:172.21.15.152:6801/304464027] boot 2023-10-16T13:07:44.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:44 smithi118 ceph-mon[103969]: osdmap e18: 3 total, 3 up, 3 in 2023-10-16T13:07:44.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:44 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-16T13:07:44.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:44.936+0000 7f9a03e66700 1 -- 172.21.15.92:0/1355692040 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f99fc02d2b0 con 0x7f99e80a13f0 2023-10-16T13:07:45.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:45 smithi092 ceph-mon[99542]: osdmap e19: 3 total, 3 up, 3 in 2023-10-16T13:07:45.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:45 smithi092 ceph-mon[99542]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:07:45.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:45 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:07:45.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:45 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:07:45.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:45 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:45.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:45 smithi092 ceph-mon[99542]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-16T13:07:45.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:45 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-16T13:07:46.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:45 smithi118 ceph-mon[103969]: osdmap e19: 3 total, 3 up, 3 in 2023-10-16T13:07:46.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:45 smithi118 ceph-mon[103969]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:07:46.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:45 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:07:46.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:45 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:07:46.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:45 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:46.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:45 smithi118 ceph-mon[103969]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-16T13:07:46.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:45 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-16T13:07:46.192 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:45 smithi152 ceph-mon[104423]: osdmap e19: 3 total, 3 up, 3 in 2023-10-16T13:07:46.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:45 smithi152 ceph-mon[104423]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:07:46.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:45 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:07:46.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:45 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:07:46.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:45 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:46.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:45 smithi152 ceph-mon[104423]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-16T13:07:46.194 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:45 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-16T13:07:47.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-16T13:07:47.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:47 smithi092 ceph-mon[99542]: osdmap e20: 3 total, 3 up, 3 in 2023-10-16T13:07:47.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-16T13:07:47.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:47 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-16T13:07:47.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:47 smithi118 ceph-mon[103969]: osdmap e20: 3 total, 3 up, 3 in 2023-10-16T13:07:47.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:47 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-16T13:07:47.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:47 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-16T13:07:47.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:47 smithi152 ceph-mon[104423]: osdmap e20: 3 total, 3 up, 3 in 2023-10-16T13:07:47.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:47 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-16T13:07:47.858 INFO:journalctl@ceph.osd.0.smithi092.stdout:Oct 16 13:07:47 smithi092 sudo[123152]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-16T13:07:47.859 INFO:journalctl@ceph.osd.0.smithi092.stdout:Oct 16 13:07:47 smithi092 sudo[123152]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-16T13:07:47.859 INFO:journalctl@ceph.osd.0.smithi092.stdout:Oct 16 13:07:47 smithi092 sudo[123152]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-16T13:07:47.859 INFO:journalctl@ceph.osd.0.smithi092.stdout:Oct 16 13:07:47 smithi092 sudo[123152]: pam_unix(sudo:session): session closed for user root 2023-10-16T13:07:48.247 INFO:journalctl@ceph.osd.0.smithi092.stdout:Oct 16 13:07:47 smithi092 sudo[123166]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-16T13:07:48.247 INFO:journalctl@ceph.osd.0.smithi092.stdout:Oct 16 13:07:47 smithi092 sudo[123166]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-16T13:07:48.247 INFO:journalctl@ceph.osd.0.smithi092.stdout:Oct 16 13:07:47 smithi092 sudo[123166]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-16T13:07:48.247 INFO:journalctl@ceph.osd.0.smithi092.stdout:Oct 16 13:07:47 smithi092 sudo[123166]: pam_unix(sudo:session): session closed for user root 2023-10-16T13:07:48.381 INFO:journalctl@ceph.osd.1.smithi118.stdout:Oct 16 13:07:48 smithi118 sudo[114376]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-16T13:07:48.381 INFO:journalctl@ceph.osd.1.smithi118.stdout:Oct 16 13:07:48 smithi118 sudo[114376]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-16T13:07:48.381 INFO:journalctl@ceph.osd.1.smithi118.stdout:Oct 16 13:07:48 smithi118 sudo[114376]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-16T13:07:48.381 INFO:journalctl@ceph.osd.1.smithi118.stdout:Oct 16 13:07:48 smithi118 sudo[114376]: pam_unix(sudo:session): session closed for user root 2023-10-16T13:07:48.382 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:48 smithi118 ceph-mon[103969]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-16T13:07:48.382 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:48 smithi118 ceph-mon[103969]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-16T13:07:48.382 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:48 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-16T13:07:48.382 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:48 smithi118 ceph-mon[103969]: osdmap e21: 3 total, 3 up, 3 in 2023-10-16T13:07:48.383 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:48 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2886254906' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e6002e4-6baa-435a-90e2-34092f9548e8"}]: dispatch 2023-10-16T13:07:48.383 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:48 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2886254906' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e6002e4-6baa-435a-90e2-34092f9548e8"}]': finished 2023-10-16T13:07:48.383 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:48 smithi118 ceph-mon[103969]: osdmap e22: 4 total, 3 up, 4 in 2023-10-16T13:07:48.383 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:48 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-16T13:07:48.383 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:48 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:48.384 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:48 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2213276816' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:07:48.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:07:48.472+0000 7f99f2ffd700 1 -- 172.21.15.92:0/1355692040 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f99ec096c00 con 0x7f99fc0ffe70 2023-10-16T13:07:48.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:48 smithi152 ceph-mon[104423]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-16T13:07:48.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:48 smithi152 ceph-mon[104423]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-16T13:07:48.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:48 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-16T13:07:48.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:48 smithi152 ceph-mon[104423]: osdmap e21: 3 total, 3 up, 3 in 2023-10-16T13:07:48.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:48 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2886254906' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e6002e4-6baa-435a-90e2-34092f9548e8"}]: dispatch 2023-10-16T13:07:48.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:48 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2886254906' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e6002e4-6baa-435a-90e2-34092f9548e8"}]': finished 2023-10-16T13:07:48.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:48 smithi152 ceph-mon[104423]: osdmap e22: 4 total, 3 up, 4 in 2023-10-16T13:07:48.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:48 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-16T13:07:48.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:48 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:48.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:48 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2213276816' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:07:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:48 smithi092 ceph-mon[99542]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-16T13:07:48.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:48 smithi092 ceph-mon[99542]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-16T13:07:48.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:48 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-16T13:07:48.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:48 smithi092 ceph-mon[99542]: osdmap e21: 3 total, 3 up, 3 in 2023-10-16T13:07:48.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:48 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2886254906' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e6002e4-6baa-435a-90e2-34092f9548e8"}]: dispatch 2023-10-16T13:07:48.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:48 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2886254906' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e6002e4-6baa-435a-90e2-34092f9548e8"}]': finished 2023-10-16T13:07:48.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:48 smithi092 ceph-mon[99542]: osdmap e22: 4 total, 3 up, 4 in 2023-10-16T13:07:48.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:48 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-16T13:07:48.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:48 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:48.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:48 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2213276816' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:07:48.783 INFO:journalctl@ceph.osd.1.smithi118.stdout:Oct 16 13:07:48 smithi118 sudo[114379]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-16T13:07:48.783 INFO:journalctl@ceph.osd.1.smithi118.stdout:Oct 16 13:07:48 smithi118 sudo[114379]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-16T13:07:48.784 INFO:journalctl@ceph.osd.1.smithi118.stdout:Oct 16 13:07:48 smithi118 sudo[114379]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-16T13:07:48.784 INFO:journalctl@ceph.osd.1.smithi118.stdout:Oct 16 13:07:48 smithi118 sudo[114379]: pam_unix(sudo:session): session closed for user root 2023-10-16T13:07:49.043 INFO:journalctl@ceph.osd.2.smithi152.stdout:Oct 16 13:07:48 smithi152 sudo[114957]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-16T13:07:49.044 INFO:journalctl@ceph.osd.2.smithi152.stdout:Oct 16 13:07:48 smithi152 sudo[114957]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-16T13:07:49.044 INFO:journalctl@ceph.osd.2.smithi152.stdout:Oct 16 13:07:48 smithi152 sudo[114957]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-16T13:07:49.044 INFO:journalctl@ceph.osd.2.smithi152.stdout:Oct 16 13:07:48 smithi152 sudo[114957]: pam_unix(sudo:session): session closed for user root 2023-10-16T13:07:49.442 INFO:journalctl@ceph.osd.2.smithi152.stdout:Oct 16 13:07:49 smithi152 sudo[114960]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-16T13:07:49.443 INFO:journalctl@ceph.osd.2.smithi152.stdout:Oct 16 13:07:49 smithi152 sudo[114960]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-16T13:07:49.443 INFO:journalctl@ceph.osd.2.smithi152.stdout:Oct 16 13:07:49 smithi152 sudo[114960]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-16T13:07:49.443 INFO:journalctl@ceph.osd.2.smithi152.stdout:Oct 16 13:07:49 smithi152 sudo[114960]: pam_unix(sudo:session): session closed for user root 2023-10-16T13:07:49.584 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:49 smithi092 sudo[123615]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-16T13:07:49.584 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:49 smithi092 sudo[123615]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-16T13:07:49.585 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:49 smithi092 sudo[123615]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-16T13:07:49.585 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:49 smithi092 sudo[123615]: pam_unix(sudo:session): session closed for user root 2023-10-16T13:07:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:49 smithi092 sudo[123620]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-16T13:07:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:49 smithi092 sudo[123620]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-16T13:07:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:49 smithi092 sudo[123620]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-16T13:07:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:49 smithi092 sudo[123620]: pam_unix(sudo:session): session closed for user root 2023-10-16T13:07:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:49 smithi092 ceph-mon[99542]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-10-16T13:07:49.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:49 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:49.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:49 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:49.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:49 smithi092 ceph-mon[99542]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-16T13:07:50.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:49 smithi118 ceph-mon[103969]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-10-16T13:07:50.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:49 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:50.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:49 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:50.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:49 smithi118 ceph-mon[103969]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-16T13:07:50.079 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:49 smithi152 sudo[114963]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-16T13:07:50.079 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:49 smithi152 sudo[114963]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-16T13:07:50.079 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:49 smithi152 sudo[114963]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-16T13:07:50.080 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:49 smithi152 sudo[114963]: pam_unix(sudo:session): session closed for user root 2023-10-16T13:07:50.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 sudo[114966]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-16T13:07:50.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 sudo[114966]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-16T13:07:50.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 sudo[114966]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-16T13:07:50.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 sudo[114966]: pam_unix(sudo:session): session closed for user root 2023-10-16T13:07:50.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-10-16T13:07:50.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:50.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:50.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-16T13:07:50.573 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 sudo[114382]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-16T13:07:50.573 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 sudo[114382]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-16T13:07:50.573 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 sudo[114382]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-16T13:07:50.573 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 sudo[114382]: pam_unix(sudo:session): session closed for user root 2023-10-16T13:07:50.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: pgmap v79: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-16T13:07:50.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-16T13:07:50.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-16T13:07:50.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:07:50.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:07:50.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-16T13:07:50.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-16T13:07:50.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:07:50.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:07:50.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-16T13:07:50.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: Cluster is now healthy 2023-10-16T13:07:50.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-16T13:07:50.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-16T13:07:50.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-16T13:07:50.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:07:50.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:07:50.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:50 smithi152 ceph-mon[104423]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-16T13:07:50.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:50 smithi092 ceph-mon[99542]: pgmap v79: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-16T13:07:50.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:50 smithi092 ceph-mon[99542]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-16T13:07:50.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-16T13:07:50.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:07:50.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:07:50.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:50 smithi092 ceph-mon[99542]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-16T13:07:50.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-16T13:07:50.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:07:50.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:07:50.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:50 smithi092 ceph-mon[99542]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-16T13:07:50.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:50 smithi092 ceph-mon[99542]: Cluster is now healthy 2023-10-16T13:07:50.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:50 smithi092 ceph-mon[99542]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-16T13:07:50.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:50 smithi092 ceph-mon[99542]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-16T13:07:51.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-16T13:07:51.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:07:51.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:07:51.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:50 smithi092 ceph-mon[99542]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-16T13:07:51.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 sudo[114385]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-16T13:07:51.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 sudo[114385]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-16T13:07:51.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 sudo[114385]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-16T13:07:51.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 sudo[114385]: pam_unix(sudo:session): session closed for user root 2023-10-16T13:07:51.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 ceph-mon[103969]: pgmap v79: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-16T13:07:51.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 ceph-mon[103969]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-16T13:07:51.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-16T13:07:51.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:07:51.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:07:51.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 ceph-mon[103969]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-16T13:07:51.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-16T13:07:51.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:07:51.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:07:51.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 ceph-mon[103969]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-16T13:07:51.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 ceph-mon[103969]: Cluster is now healthy 2023-10-16T13:07:51.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 ceph-mon[103969]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-16T13:07:51.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 ceph-mon[103969]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-16T13:07:51.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-16T13:07:51.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-16T13:07:51.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-16T13:07:51.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:50 smithi118 ceph-mon[103969]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-16T13:07:51.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:51 smithi092 ceph-mon[99542]: pgmap v80: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-16T13:07:51.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:51 smithi152 ceph-mon[104423]: pgmap v80: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-16T13:07:52.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:51 smithi118 ceph-mon[103969]: pgmap v80: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-16T13:07:54.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:54 smithi118 ceph-mon[103969]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 9.0 KiB/s rd, 457 KiB/s wr, 30 op/s 2023-10-16T13:07:54.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:54 smithi152 ceph-mon[104423]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 9.0 KiB/s rd, 457 KiB/s wr, 30 op/s 2023-10-16T13:07:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:54 smithi092 ceph-mon[99542]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 9.0 KiB/s rd, 457 KiB/s wr, 30 op/s 2023-10-16T13:07:55.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:55 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-16T13:07:55.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:55 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:55.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:55 smithi118 ceph-mon[103969]: Deploying daemon osd.3 on smithi092 2023-10-16T13:07:55.593 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:55 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-16T13:07:55.594 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:55 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:55.594 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:55 smithi092 ceph-mon[99542]: Deploying daemon osd.3 on smithi092 2023-10-16T13:07:55.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:55 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-16T13:07:55.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:55 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:07:55.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:55 smithi152 ceph-mon[104423]: Deploying daemon osd.3 on smithi092 2023-10-16T13:07:56.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:56 smithi092 ceph-mon[99542]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 305 KiB/s wr, 20 op/s 2023-10-16T13:07:56.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:56 smithi118 ceph-mon[103969]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 305 KiB/s wr, 20 op/s 2023-10-16T13:07:56.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:56 smithi152 ceph-mon[104423]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 305 KiB/s wr, 20 op/s 2023-10-16T13:07:58.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:58 smithi118 ceph-mon[103969]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 228 KiB/s wr, 15 op/s 2023-10-16T13:07:58.566 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:58 smithi092 ceph-mon[99542]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 228 KiB/s wr, 15 op/s 2023-10-16T13:07:58.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:58 smithi152 ceph-mon[104423]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 228 KiB/s wr, 15 op/s 2023-10-16T13:07:59.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:59 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:59.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:59 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:07:59.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:59 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:07:59.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:07:59 smithi092 ceph-mon[99542]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-10-16T13:08:00.192 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:59 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:00.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:59 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:00.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:59 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:08:00.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:07:59 smithi152 ceph-mon[104423]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-10-16T13:08:00.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:59 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:00.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:59 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:00.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:59 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:08:00.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:07:59 smithi118 ceph-mon[103969]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-10-16T13:08:01.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:01.487+0000 7f99f2ffd700 1 -- 172.21.15.92:0/1355692040 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f99fc02d2b0 con 0x7f99e80a13f0 2023-10-16T13:08:01.490 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 3 on host 'smithi092' 2023-10-16T13:08:01.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:01.489+0000 7f9a03e66700 1 -- 172.21.15.92:0/1355692040 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f99e80a13f0 msgr2=0x7f99e80a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:08:01.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:01.489+0000 7f9a03e66700 1 --2- 172.21.15.92:0/1355692040 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f99e80a13f0 0x7f99e80a38b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f99f800b2e0 tx=0x7f99f8005960 comp rx=0 tx=0).stop 2023-10-16T13:08:01.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:01.489+0000 7f9a03e66700 1 -- 172.21.15.92:0/1355692040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99fc0ffe70 msgr2=0x7f99fc069d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:08:01.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:01.489+0000 7f9a03e66700 1 --2- 172.21.15.92:0/1355692040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99fc0ffe70 0x7f99fc069d90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00eb30 tx=0x7f99ec00ee40 comp rx=0 tx=0).stop 2023-10-16T13:08:01.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:01.489+0000 7f9a03e66700 1 -- 172.21.15.92:0/1355692040 shutdown_connections 2023-10-16T13:08:01.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:01.489+0000 7f9a03e66700 1 --2- 172.21.15.92:0/1355692040 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f99e80a13f0 0x7f99e80a38b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:01.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:01.489+0000 7f9a03e66700 1 --2- 172.21.15.92:0/1355692040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99fc0ffe70 0x7f99fc069d90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:01.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:01.489+0000 7f9a03e66700 1 --2- 172.21.15.92:0/1355692040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99fc101990 0x7f99fc19e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:01.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:01.489+0000 7f9a03e66700 1 --2- 172.21.15.92:0/1355692040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99fc100fd0 0x7f99fc19ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:01.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:01.489+0000 7f9a03e66700 1 -- 172.21.15.92:0/1355692040 >> 172.21.15.92:0/1355692040 conn(0x7f99fc0fb3f0 msgr2=0x7f99fc1044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:08:01.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:01.489+0000 7f9a03e66700 1 -- 172.21.15.92:0/1355692040 shutdown_connections 2023-10-16T13:08:01.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:01.489+0000 7f9a03e66700 1 -- 172.21.15.92:0/1355692040 wait complete. 2023-10-16T13:08:01.900 DEBUG:teuthology.orchestra.run.smithi092:osd.3> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.3.service 2023-10-16T13:08:01.902 INFO:tasks.cephadm:Deploying osd.4 on smithi118 with /dev/vg_nvme/lv_3... 2023-10-16T13:08:01.903 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-16T13:08:01.931 INFO:journalctl@ceph.osd.3.smithi092.stdout:-- Logs begin at Mon 2023-10-16 12:49:18 UTC. -- 2023-10-16T13:08:02.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:02 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:02.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:02 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:02.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:02 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:02.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:02 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:08:02.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:02 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:02.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:02 smithi092 ceph-mon[99542]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-10-16T13:08:02.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:02 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:02.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:02 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:02.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:02 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:08:02.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:02 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:02.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:02 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:02.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:02 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:02.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:02 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:08:02.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:02 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:02.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:02 smithi118 ceph-mon[103969]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-10-16T13:08:02.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:02 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:02.285 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:02 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:02.285 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:02 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:08:02.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:02 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:02.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:02 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:02.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:02 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:02.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:02 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:08:02.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:02 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:02.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:02 smithi152 ceph-mon[104423]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-10-16T13:08:02.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:02 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:02.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:02 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:02.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:02 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:08:02.477 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-16T13:08:03.026 INFO:journalctl@ceph.osd.3.smithi092.stdout:Oct 16 13:08:02 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-3[125409]: 2023-10-16T13:08:02.792+0000 7f7bd14a8640 -1 osd.3 0 log_to_monitors true 2023-10-16T13:08:03.290 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:03 smithi092 ceph-mon[99542]: from='osd.3 [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-16T13:08:03.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:03 smithi152 ceph-mon[104423]: from='osd.3 [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-16T13:08:03.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:03 smithi118 ceph-mon[103969]: from='osd.3 [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-16T13:08:04.082 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-16T13:08:04.083 INFO:teuthology.orchestra.run.smithi118.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-16T13:08:04.083 INFO:teuthology.orchestra.run.smithi118.stderr: stderr: 10+0 records in 2023-10-16T13:08:04.083 INFO:teuthology.orchestra.run.smithi118.stderr:10+0 records out 2023-10-16T13:08:04.083 INFO:teuthology.orchestra.run.smithi118.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00828272 s, 1.3 GB/s 2023-10-16T13:08:04.084 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping successful for: 2023-10-16T13:08:04.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:04 smithi152 ceph-mon[104423]: from='osd.3 [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-16T13:08:04.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:04 smithi152 ceph-mon[104423]: osdmap e23: 4 total, 3 up, 4 in 2023-10-16T13:08:04.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:04 smithi152 ceph-mon[104423]: from='osd.3 [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-16T13:08:04.445 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:04 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-16T13:08:04.445 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:04 smithi152 ceph-mon[104423]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-10-16T13:08:04.483 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:04 smithi118 ceph-mon[103969]: from='osd.3 [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-16T13:08:04.483 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:04 smithi118 ceph-mon[103969]: osdmap e23: 4 total, 3 up, 4 in 2023-10-16T13:08:04.483 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:04 smithi118 ceph-mon[103969]: from='osd.3 [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-16T13:08:04.483 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:04 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-16T13:08:04.483 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:04 smithi118 ceph-mon[103969]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-10-16T13:08:04.496 INFO:journalctl@ceph.osd.3.smithi092.stdout:Oct 16 13:08:04 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-3[125409]: 2023-10-16T13:08:04.151+0000 7f7bc631e700 -1 osd.3 0 waiting for initial osdmap 2023-10-16T13:08:04.497 INFO:journalctl@ceph.osd.3.smithi092.stdout:Oct 16 13:08:04 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-3[125409]: 2023-10-16T13:08:04.160+0000 7f7bbf10d700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:08:04.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:04 smithi092 ceph-mon[99542]: from='osd.3 [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-16T13:08:04.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:04 smithi092 ceph-mon[99542]: osdmap e23: 4 total, 3 up, 4 in 2023-10-16T13:08:04.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:04 smithi092 ceph-mon[99542]: from='osd.3 [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-16T13:08:04.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:04 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-16T13:08:04.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:04 smithi092 ceph-mon[99542]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-10-16T13:08:04.520 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi118:vg_nvme/lv_3 2023-10-16T13:08:05.082 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-16T13:08:05.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:05 smithi152 ceph-mon[104423]: from='osd.3 [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-16T13:08:05.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:05 smithi152 ceph-mon[104423]: osdmap e24: 4 total, 3 up, 4 in 2023-10-16T13:08:05.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:05 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-16T13:08:05.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:05 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-16T13:08:05.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:05 smithi152 ceph-mon[104423]: Detected new or changed devices on smithi092 2023-10-16T13:08:05.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:05 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:05.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:05 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:05.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:05 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:08:05.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:05 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:08:05.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:05 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:05.445 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:05 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:05.445 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:05 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:08:05.445 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:05 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:05 smithi092 ceph-mon[99542]: from='osd.3 [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-16T13:08:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:05 smithi092 ceph-mon[99542]: osdmap e24: 4 total, 3 up, 4 in 2023-10-16T13:08:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:05 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-16T13:08:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:05 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-16T13:08:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:05 smithi092 ceph-mon[99542]: Detected new or changed devices on smithi092 2023-10-16T13:08:05.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:05 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:05.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:05 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:05.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:05 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:08:05.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:05 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:08:05.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:05 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:05.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:05 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:05.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:05 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:08:05.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:05 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:05.509 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:05 smithi118 ceph-mon[103969]: from='osd.3 [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-16T13:08:05.509 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:05 smithi118 ceph-mon[103969]: osdmap e24: 4 total, 3 up, 4 in 2023-10-16T13:08:05.510 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:05 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-16T13:08:05.510 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:05 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-16T13:08:05.510 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:05 smithi118 ceph-mon[103969]: Detected new or changed devices on smithi092 2023-10-16T13:08:05.510 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:05 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:05.510 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:05 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:05.511 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:05 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:08:05.511 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:05 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:08:05.511 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:05 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:05.511 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:05 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:05.511 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:05 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:08:05.511 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:05 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:06.172 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:06 smithi118 ceph-mon[103969]: purged_snaps scrub starts 2023-10-16T13:08:06.172 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:06 smithi118 ceph-mon[103969]: purged_snaps scrub ok 2023-10-16T13:08:06.173 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:06 smithi118 ceph-mon[103969]: Adjusting osd_memory_target on smithi092 to 8584M 2023-10-16T13:08:06.173 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:06 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-16T13:08:06.173 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:06 smithi118 ceph-mon[103969]: osd.3 [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450] boot 2023-10-16T13:08:06.173 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:06 smithi118 ceph-mon[103969]: osdmap e25: 4 total, 4 up, 4 in 2023-10-16T13:08:06.174 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:06 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-16T13:08:06.174 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:06 smithi118 ceph-mon[103969]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-16T13:08:06.174 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:06 smithi118 ceph-mon[103969]: osdmap e26: 4 total, 4 up, 4 in 2023-10-16T13:08:06.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.358+0000 7fb72b6b9700 1 -- 172.21.15.118:0/3396579440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb724104390 msgr2=0x7fb724106780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:08:06.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.358+0000 7fb72b6b9700 1 --2- 172.21.15.118:0/3396579440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb724104390 0x7fb724106780 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb714009990 tx=0x7fb714009ca0 comp rx=0 tx=0).stop 2023-10-16T13:08:06.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.358+0000 7fb72b6b9700 1 -- 172.21.15.118:0/3396579440 shutdown_connections 2023-10-16T13:08:06.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.358+0000 7fb72b6b9700 1 --2- 172.21.15.118:0/3396579440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb724101a60 0x7fb724103e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:06.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.358+0000 7fb72b6b9700 1 --2- 172.21.15.118:0/3396579440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb724106cc0 0x7fb7241090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:06.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.358+0000 7fb72b6b9700 1 --2- 172.21.15.118:0/3396579440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb724104390 0x7fb724106780 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:06.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.358+0000 7fb72b6b9700 1 -- 172.21.15.118:0/3396579440 >> 172.21.15.118:0/3396579440 conn(0x7fb7240fb3f0 msgr2=0x7fb7240fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:08:06.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.358+0000 7fb72b6b9700 1 -- 172.21.15.118:0/3396579440 shutdown_connections 2023-10-16T13:08:06.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.358+0000 7fb72b6b9700 1 -- 172.21.15.118:0/3396579440 wait complete. 2023-10-16T13:08:06.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.359+0000 7fb72b6b9700 1 Processor -- start 2023-10-16T13:08:06.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.359+0000 7fb72b6b9700 1 -- start start 2023-10-16T13:08:06.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.359+0000 7fb72b6b9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb724101a60 0x7fb724196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:08:06.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.359+0000 7fb72b6b9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb724104390 0x7fb724197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:08:06.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.359+0000 7fb72b6b9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb724106cc0 0x7fb72419e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:08:06.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.359+0000 7fb72b6b9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72419e880 con 0x7fb724104390 2023-10-16T13:08:06.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.359+0000 7fb72b6b9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72419e9c0 con 0x7fb724106cc0 2023-10-16T13:08:06.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.359+0000 7fb72b6b9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72419eb80 con 0x7fb724101a60 2023-10-16T13:08:06.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.359+0000 7fb729c56700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb724106cc0 0x7fb72419e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:08:06.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.359+0000 7fb729c56700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb724106cc0 0x7fb72419e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50038/0 (socket says 172.21.15.118:50038) 2023-10-16T13:08:06.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.359+0000 7fb729c56700 1 -- 172.21.15.118:0/3984461698 learned_addr learned my addr 172.21.15.118:0/3984461698 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-16T13:08:06.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.359+0000 7fb728c54700 1 --2- 172.21.15.118:0/3984461698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb724104390 0x7fb724197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:08:06.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.359+0000 7fb729455700 1 --2- 172.21.15.118:0/3984461698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb724101a60 0x7fb724196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:08:06.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.359+0000 7fb729c56700 1 -- 172.21.15.118:0/3984461698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb724101a60 msgr2=0x7fb724196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:08:06.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.359+0000 7fb729c56700 1 --2- 172.21.15.118:0/3984461698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb724101a60 0x7fb724196d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:06.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.359+0000 7fb729c56700 1 -- 172.21.15.118:0/3984461698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb724104390 msgr2=0x7fb724197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:08:06.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.359+0000 7fb729c56700 1 --2- 172.21.15.118:0/3984461698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb724104390 0x7fb724197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:06.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.359+0000 7fb729c56700 1 -- 172.21.15.118:0/3984461698 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7140095f0 con 0x7fb724106cc0 2023-10-16T13:08:06.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.359+0000 7fb729c56700 1 --2- 172.21.15.118:0/3984461698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb724106cc0 0x7fb72419e2b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00ada0 tx=0x7fb71c00c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:08:06.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.360+0000 7fb71a7fc700 1 -- 172.21.15.118:0/3984461698 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c00f070 con 0x7fb724106cc0 2023-10-16T13:08:06.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.360+0000 7fb71a7fc700 1 -- 172.21.15.118:0/3984461698 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb71c007b00 con 0x7fb724106cc0 2023-10-16T13:08:06.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.360+0000 7fb72b6b9700 1 -- 172.21.15.118:0/3984461698 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb72419ee60 con 0x7fb724106cc0 2023-10-16T13:08:06.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.360+0000 7fb71a7fc700 1 -- 172.21.15.118:0/3984461698 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c005380 con 0x7fb724106cc0 2023-10-16T13:08:06.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.360+0000 7fb72b6b9700 1 -- 172.21.15.118:0/3984461698 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb72419f270 con 0x7fb724106cc0 2023-10-16T13:08:06.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.360+0000 7fb72b6b9700 1 -- 172.21.15.118:0/3984461698 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7240fcf70 con 0x7fb724106cc0 2023-10-16T13:08:06.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.362+0000 7fb71a7fc700 1 -- 172.21.15.118:0/3984461698 <== mon.2 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb71c00c980 con 0x7fb724106cc0 2023-10-16T13:08:06.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.362+0000 7fb71a7fc700 1 --2- 172.21.15.118:0/3984461698 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb7100a1500 0x7fb7100a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:08:06.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.362+0000 7fb71a7fc700 1 -- 172.21.15.118:0/3984461698 <== mon.2 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3698+0+0 (secure 0 0 0) 0x7fb71c0cb530 con 0x7fb724106cc0 2023-10-16T13:08:06.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.363+0000 7fb729455700 1 --2- 172.21.15.118:0/3984461698 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb7100a1500 0x7fb7100a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:08:06.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.363+0000 7fb729455700 1 --2- 172.21.15.118:0/3984461698 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb7100a1500 0x7fb7100a39c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb720005950 tx=0x7fb720005d10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:08:06.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.366+0000 7fb71a7fc700 1 -- 172.21.15.118:0/3984461698 <== mon.2 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb71c095e20 con 0x7fb724106cc0 2023-10-16T13:08:06.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:06 smithi152 ceph-mon[104423]: purged_snaps scrub starts 2023-10-16T13:08:06.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:06 smithi152 ceph-mon[104423]: purged_snaps scrub ok 2023-10-16T13:08:06.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:06 smithi152 ceph-mon[104423]: Adjusting osd_memory_target on smithi092 to 8584M 2023-10-16T13:08:06.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:06 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-16T13:08:06.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:06 smithi152 ceph-mon[104423]: osd.3 [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450] boot 2023-10-16T13:08:06.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:06 smithi152 ceph-mon[104423]: osdmap e25: 4 total, 4 up, 4 in 2023-10-16T13:08:06.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:06 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-16T13:08:06.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:06 smithi152 ceph-mon[104423]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-16T13:08:06.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:06 smithi152 ceph-mon[104423]: osdmap e26: 4 total, 4 up, 4 in 2023-10-16T13:08:06.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:06 smithi092 ceph-mon[99542]: purged_snaps scrub starts 2023-10-16T13:08:06.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:06 smithi092 ceph-mon[99542]: purged_snaps scrub ok 2023-10-16T13:08:06.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:06 smithi092 ceph-mon[99542]: Adjusting osd_memory_target on smithi092 to 8584M 2023-10-16T13:08:06.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:06 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-16T13:08:06.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:06 smithi092 ceph-mon[99542]: osd.3 [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450] boot 2023-10-16T13:08:06.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:06 smithi092 ceph-mon[99542]: osdmap e25: 4 total, 4 up, 4 in 2023-10-16T13:08:06.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:06 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-16T13:08:06.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:06 smithi092 ceph-mon[99542]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-16T13:08:06.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:06 smithi092 ceph-mon[99542]: osdmap e26: 4 total, 4 up, 4 in 2023-10-16T13:08:06.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:06.563+0000 7fb72b6b9700 1 -- 172.21.15.118:0/3984461698 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb72402d390 con 0x7fb7100a1500 2023-10-16T13:08:07.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:07 smithi118 ceph-mon[103969]: osdmap e27: 4 total, 4 up, 4 in 2023-10-16T13:08:07.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:07 smithi118 ceph-mon[103969]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:08:07.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:07 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:08:07.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:07 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:08:07.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:07 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:07.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:07 smithi152 ceph-mon[104423]: osdmap e27: 4 total, 4 up, 4 in 2023-10-16T13:08:07.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:07 smithi152 ceph-mon[104423]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:08:07.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:07 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:08:07.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:07 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:08:07.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:07 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:07 smithi092 ceph-mon[99542]: osdmap e27: 4 total, 4 up, 4 in 2023-10-16T13:08:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:07 smithi092 ceph-mon[99542]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:08:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:07 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:08:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:07 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:08:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:07 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:08.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:08 smithi118 ceph-mon[103969]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:08.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:08 smithi118 ceph-mon[103969]: osdmap e28: 4 total, 4 up, 4 in 2023-10-16T13:08:08.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:08 smithi152 ceph-mon[104423]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:08.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:08 smithi152 ceph-mon[104423]: osdmap e28: 4 total, 4 up, 4 in 2023-10-16T13:08:08.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:08 smithi092 ceph-mon[99542]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:08.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:08 smithi092 ceph-mon[99542]: osdmap e28: 4 total, 4 up, 4 in 2023-10-16T13:08:09.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:09 smithi118 ceph-mon[103969]: osdmap e29: 4 total, 4 up, 4 in 2023-10-16T13:08:09.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:09 smithi118 ceph-mon[103969]: from='client.? 172.21.15.118:0/2897242278' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea9862ef-7323-44e2-bed6-191f1a01b94a"}]: dispatch 2023-10-16T13:08:09.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:09 smithi118 ceph-mon[103969]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea9862ef-7323-44e2-bed6-191f1a01b94a"}]: dispatch 2023-10-16T13:08:09.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:09 smithi118 ceph-mon[103969]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea9862ef-7323-44e2-bed6-191f1a01b94a"}]': finished 2023-10-16T13:08:09.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:09 smithi118 ceph-mon[103969]: osdmap e30: 5 total, 4 up, 5 in 2023-10-16T13:08:09.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:09 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-16T13:08:09.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:09 smithi152 ceph-mon[104423]: osdmap e29: 4 total, 4 up, 4 in 2023-10-16T13:08:09.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:09 smithi152 ceph-mon[104423]: from='client.? 172.21.15.118:0/2897242278' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea9862ef-7323-44e2-bed6-191f1a01b94a"}]: dispatch 2023-10-16T13:08:09.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:09 smithi152 ceph-mon[104423]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea9862ef-7323-44e2-bed6-191f1a01b94a"}]: dispatch 2023-10-16T13:08:09.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:09 smithi152 ceph-mon[104423]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea9862ef-7323-44e2-bed6-191f1a01b94a"}]': finished 2023-10-16T13:08:09.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:09 smithi152 ceph-mon[104423]: osdmap e30: 5 total, 4 up, 5 in 2023-10-16T13:08:09.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:09 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-16T13:08:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:09 smithi092 ceph-mon[99542]: osdmap e29: 4 total, 4 up, 4 in 2023-10-16T13:08:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:09 smithi092 ceph-mon[99542]: from='client.? 172.21.15.118:0/2897242278' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea9862ef-7323-44e2-bed6-191f1a01b94a"}]: dispatch 2023-10-16T13:08:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:09 smithi092 ceph-mon[99542]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea9862ef-7323-44e2-bed6-191f1a01b94a"}]: dispatch 2023-10-16T13:08:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:09 smithi092 ceph-mon[99542]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea9862ef-7323-44e2-bed6-191f1a01b94a"}]': finished 2023-10-16T13:08:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:09 smithi092 ceph-mon[99542]: osdmap e30: 5 total, 4 up, 5 in 2023-10-16T13:08:09.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:09 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-16T13:08:10.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:10 smithi118 ceph-mon[103969]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 145 KiB/s, 0 objects/s recovering 2023-10-16T13:08:10.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:10 smithi118 ceph-mon[103969]: from='client.? 172.21.15.118:0/1638469164' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:08:10.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:10 smithi152 ceph-mon[104423]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 145 KiB/s, 0 objects/s recovering 2023-10-16T13:08:10.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:10 smithi152 ceph-mon[104423]: from='client.? 172.21.15.118:0/1638469164' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:08:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:10 smithi092 ceph-mon[99542]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 145 KiB/s, 0 objects/s recovering 2023-10-16T13:08:10.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:10 smithi092 ceph-mon[99542]: from='client.? 172.21.15.118:0/1638469164' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:08:12.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:12 smithi118 ceph-mon[103969]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-16T13:08:12.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:12 smithi152 ceph-mon[104423]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-16T13:08:12.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:12 smithi092 ceph-mon[99542]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-16T13:08:14.334 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:14 smithi118 ceph-mon[103969]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-16T13:08:14.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:14 smithi152 ceph-mon[104423]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-16T13:08:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:14 smithi092 ceph-mon[99542]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-16T13:08:16.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:16 smithi118 ceph-mon[103969]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-16T13:08:16.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:16 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-16T13:08:16.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:16 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:16.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:16 smithi118 ceph-mon[103969]: Deploying daemon osd.4 on smithi118 2023-10-16T13:08:16.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:16 smithi152 ceph-mon[104423]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-16T13:08:16.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:16 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-16T13:08:16.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:16 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:16.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:16 smithi152 ceph-mon[104423]: Deploying daemon osd.4 on smithi118 2023-10-16T13:08:16.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:16 smithi092 ceph-mon[99542]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-16T13:08:16.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:16 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-16T13:08:16.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:16 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:16.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:16 smithi092 ceph-mon[99542]: Deploying daemon osd.4 on smithi118 2023-10-16T13:08:18.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:18 smithi118 ceph-mon[103969]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:18.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:18 smithi152 ceph-mon[104423]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:18.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:18 smithi092 ceph-mon[99542]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:20.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:20 smithi118 ceph-mon[103969]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:20.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:20 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:20.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:20 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:20.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:20 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:08:20.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:20 smithi152 ceph-mon[104423]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:20.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:20 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:20.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:20 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:20.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:20 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:08:20.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:20 smithi092 ceph-mon[99542]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:20.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:20 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:20.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:20 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:20.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:20 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:08:22.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:22 smithi118 ceph-mon[103969]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:22.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:22 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:22.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:22 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:22.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:22 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:22.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:22 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:08:22.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:22 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:22.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:22 smithi152 ceph-mon[104423]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:22.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:22 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:22.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:22 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:22.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:22 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:22.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:22 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:08:22.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:22 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:22.725 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:22.723+0000 7fb71a7fc700 1 -- 172.21.15.118:0/3984461698 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb72402d390 con 0x7fb7100a1500 2023-10-16T13:08:22.725 INFO:teuthology.orchestra.run.smithi118.stdout:Created osd(s) 4 on host 'smithi118' 2023-10-16T13:08:22.727 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:22.725+0000 7fb72b6b9700 1 -- 172.21.15.118:0/3984461698 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb7100a1500 msgr2=0x7fb7100a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:08:22.727 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:22.725+0000 7fb72b6b9700 1 --2- 172.21.15.118:0/3984461698 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb7100a1500 0x7fb7100a39c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb720005950 tx=0x7fb720005d10 comp rx=0 tx=0).stop 2023-10-16T13:08:22.728 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:22.725+0000 7fb72b6b9700 1 -- 172.21.15.118:0/3984461698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb724106cc0 msgr2=0x7fb72419e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:08:22.728 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:22.725+0000 7fb72b6b9700 1 --2- 172.21.15.118:0/3984461698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb724106cc0 0x7fb72419e2b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00ada0 tx=0x7fb71c00c330 comp rx=0 tx=0).stop 2023-10-16T13:08:22.728 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:22.725+0000 7fb72b6b9700 1 -- 172.21.15.118:0/3984461698 shutdown_connections 2023-10-16T13:08:22.728 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:22.725+0000 7fb72b6b9700 1 --2- 172.21.15.118:0/3984461698 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb7100a1500 0x7fb7100a39c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:22.728 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:22.725+0000 7fb72b6b9700 1 --2- 172.21.15.118:0/3984461698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb724106cc0 0x7fb72419e2b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:22.729 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:22.725+0000 7fb72b6b9700 1 --2- 172.21.15.118:0/3984461698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb724101a60 0x7fb724196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:22.729 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:22.725+0000 7fb72b6b9700 1 --2- 172.21.15.118:0/3984461698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb724104390 0x7fb724197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:22.729 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:22.725+0000 7fb72b6b9700 1 -- 172.21.15.118:0/3984461698 >> 172.21.15.118:0/3984461698 conn(0x7fb7240fb3f0 msgr2=0x7fb7241026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:08:22.729 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:22.726+0000 7fb72b6b9700 1 -- 172.21.15.118:0/3984461698 shutdown_connections 2023-10-16T13:08:22.729 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:08:22.726+0000 7fb72b6b9700 1 -- 172.21.15.118:0/3984461698 wait complete. 2023-10-16T13:08:22.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:22 smithi092 ceph-mon[99542]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:22.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:22 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:22.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:22 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:22.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:22 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:22.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:22 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:08:22.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:22 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:23.266 DEBUG:teuthology.orchestra.run.smithi118:osd.4> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.4.service 2023-10-16T13:08:23.268 INFO:tasks.cephadm:Deploying osd.5 on smithi152 with /dev/vg_nvme/lv_3... 2023-10-16T13:08:23.268 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-16T13:08:23.298 INFO:journalctl@ceph.osd.4.smithi118.stdout:-- Logs begin at Mon 2023-10-16 12:50:05 UTC. -- 2023-10-16T13:08:23.839 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-16T13:08:23.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:23 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:23.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:23 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:23.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:23 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:08:23.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:23 smithi092 ceph-mon[99542]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:24.027 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:23 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:24.027 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:23 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:24.028 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:23 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:08:24.028 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:23 smithi152 ceph-mon[104423]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:24.033 INFO:journalctl@ceph.osd.4.smithi118.stdout:Oct 16 13:08:23 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-4[117604]: 2023-10-16T13:08:23.804+0000 7f7ce6c85640 -1 osd.4 0 log_to_monitors true 2023-10-16T13:08:24.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:23 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:24.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:23 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:24.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:23 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:08:24.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:23 smithi118 ceph-mon[103969]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:24.834 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:24 smithi152 ceph-mon[104423]: from='osd.4 [v2:172.21.15.118:6808/3903514094,v1:172.21.15.118:6809/3903514094]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-16T13:08:24.835 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:24 smithi152 ceph-mon[104423]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-16T13:08:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:24 smithi092 ceph-mon[99542]: from='osd.4 [v2:172.21.15.118:6808/3903514094,v1:172.21.15.118:6809/3903514094]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-16T13:08:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:24 smithi092 ceph-mon[99542]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-16T13:08:25.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:24 smithi118 ceph-mon[103969]: from='osd.4 [v2:172.21.15.118:6808/3903514094,v1:172.21.15.118:6809/3903514094]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-16T13:08:25.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:24 smithi118 ceph-mon[103969]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-16T13:08:25.341 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-16T13:08:25.341 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-16T13:08:25.342 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2023-10-16T13:08:25.342 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2023-10-16T13:08:25.342 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112447 s, 933 MB/s 2023-10-16T13:08:25.342 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2023-10-16T13:08:25.783 INFO:journalctl@ceph.osd.4.smithi118.stdout:Oct 16 13:08:25 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-4[117604]: 2023-10-16T13:08:25.722+0000 7f7cdbafb700 -1 osd.4 0 waiting for initial osdmap 2023-10-16T13:08:25.784 INFO:journalctl@ceph.osd.4.smithi118.stdout:Oct 16 13:08:25 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-4[117604]: 2023-10-16T13:08:25.730+0000 7f7cd58ec700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:08:25.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:25 smithi118 ceph-mon[103969]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-16T13:08:25.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:25 smithi118 ceph-mon[103969]: osdmap e31: 5 total, 4 up, 5 in 2023-10-16T13:08:25.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:25 smithi118 ceph-mon[103969]: from='osd.4 [v2:172.21.15.118:6808/3903514094,v1:172.21.15.118:6809/3903514094]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:08:25.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:25 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-16T13:08:25.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:25 smithi118 ceph-mon[103969]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:08:25.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:25 smithi118 ceph-mon[103969]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:25.795 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi152:vg_nvme/lv_3 2023-10-16T13:08:25.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:25 smithi092 ceph-mon[99542]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-16T13:08:25.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:25 smithi092 ceph-mon[99542]: osdmap e31: 5 total, 4 up, 5 in 2023-10-16T13:08:25.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:25 smithi092 ceph-mon[99542]: from='osd.4 [v2:172.21.15.118:6808/3903514094,v1:172.21.15.118:6809/3903514094]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:08:25.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:25 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-16T13:08:25.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:25 smithi092 ceph-mon[99542]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:08:25.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:25 smithi092 ceph-mon[99542]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:26.192 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:25 smithi152 ceph-mon[104423]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-16T13:08:26.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:25 smithi152 ceph-mon[104423]: osdmap e31: 5 total, 4 up, 5 in 2023-10-16T13:08:26.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:25 smithi152 ceph-mon[104423]: from='osd.4 [v2:172.21.15.118:6808/3903514094,v1:172.21.15.118:6809/3903514094]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:08:26.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:25 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-16T13:08:26.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:25 smithi152 ceph-mon[104423]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:08:26.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:25 smithi152 ceph-mon[104423]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:26.357 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-16T13:08:26.903 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:26 smithi152 ceph-mon[104423]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-16T13:08:26.904 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:26 smithi152 ceph-mon[104423]: osdmap e32: 5 total, 4 up, 5 in 2023-10-16T13:08:26.904 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-16T13:08:26.904 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-16T13:08:26.904 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:26 smithi152 ceph-mon[104423]: Detected new or changed devices on smithi118 2023-10-16T13:08:26.905 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:26.905 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:26.905 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:08:26.905 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:08:26.905 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:26 smithi152 ceph-mon[104423]: Adjusting osd_memory_target on smithi118 to 8584M 2023-10-16T13:08:26.905 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:26.906 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:26.906 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:08:26.906 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:26 smithi092 ceph-mon[99542]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-16T13:08:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:26 smithi092 ceph-mon[99542]: osdmap e32: 5 total, 4 up, 5 in 2023-10-16T13:08:26.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-16T13:08:26.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-16T13:08:26.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:26 smithi092 ceph-mon[99542]: Detected new or changed devices on smithi118 2023-10-16T13:08:26.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:26.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:26.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:08:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:08:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:26 smithi092 ceph-mon[99542]: Adjusting osd_memory_target on smithi118 to 8584M 2023-10-16T13:08:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:08:27.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:27.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:26 smithi118 ceph-mon[103969]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-16T13:08:27.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:26 smithi118 ceph-mon[103969]: osdmap e32: 5 total, 4 up, 5 in 2023-10-16T13:08:27.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:26 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-16T13:08:27.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:26 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-16T13:08:27.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:26 smithi118 ceph-mon[103969]: Detected new or changed devices on smithi118 2023-10-16T13:08:27.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:26 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:27.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:26 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:27.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:26 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:08:27.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:26 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:08:27.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:26 smithi118 ceph-mon[103969]: Adjusting osd_memory_target on smithi118 to 8584M 2023-10-16T13:08:27.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:26 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:27.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:26 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:27.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:26 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:08:27.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:26 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:27.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.564+0000 7f6023502700 1 -- 172.21.15.152:0/3888208206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f601c101990 msgr2=0x7f601c1082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:08:27.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.564+0000 7f6023502700 1 --2- 172.21.15.152:0/3888208206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f601c101990 0x7f601c1082b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f601400b0a0 tx=0x7f601400b3b0 comp rx=0 tx=0).stop 2023-10-16T13:08:27.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.564+0000 7f6023502700 1 -- 172.21.15.152:0/3888208206 shutdown_connections 2023-10-16T13:08:27.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.564+0000 7f6023502700 1 --2- 172.21.15.152:0/3888208206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f601c101990 0x7f601c1082b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:27.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.564+0000 7f6023502700 1 --2- 172.21.15.152:0/3888208206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f601c0ffe70 0x7f601c100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:27.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.564+0000 7f6023502700 1 --2- 172.21.15.152:0/3888208206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c100fd0 0x7f601c101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:27.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.564+0000 7f6023502700 1 -- 172.21.15.152:0/3888208206 >> 172.21.15.152:0/3888208206 conn(0x7f601c0fb3f0 msgr2=0x7f601c0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:08:27.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.564+0000 7f6023502700 1 -- 172.21.15.152:0/3888208206 shutdown_connections 2023-10-16T13:08:27.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.564+0000 7f6023502700 1 -- 172.21.15.152:0/3888208206 wait complete. 2023-10-16T13:08:27.569 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.565+0000 7f6023502700 1 Processor -- start 2023-10-16T13:08:27.569 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.565+0000 7f6023502700 1 -- start start 2023-10-16T13:08:27.571 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.565+0000 7f6023502700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f601c0ffe70 0x7f601c069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:08:27.571 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.565+0000 7f6023502700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f601c100fd0 0x7f601c19b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:08:27.572 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.565+0000 7f6023502700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c101990 0x7f601c19df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:08:27.572 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.565+0000 7f6023502700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c19e6c0 con 0x7f601c101990 2023-10-16T13:08:27.572 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.565+0000 7f6023502700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c19e830 con 0x7f601c0ffe70 2023-10-16T13:08:27.572 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.565+0000 7f6023502700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c19e9f0 con 0x7f601c100fd0 2023-10-16T13:08:27.572 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.565+0000 7f6020a9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f601c100fd0 0x7f601c19b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:08:27.573 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.565+0000 7f6020a9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f601c100fd0 0x7f601c19b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45472/0 (socket says 172.21.15.152:45472) 2023-10-16T13:08:27.573 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.565+0000 7f6020a9d700 1 -- 172.21.15.152:0/4175446054 learned_addr learned my addr 172.21.15.152:0/4175446054 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T13:08:27.573 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.565+0000 7f602129e700 1 --2- 172.21.15.152:0/4175446054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f601c0ffe70 0x7f601c069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:08:27.573 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.565+0000 7f6021a9f700 1 --2- 172.21.15.152:0/4175446054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c101990 0x7f601c19df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:08:27.573 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.566+0000 7f6020a9d700 1 -- 172.21.15.152:0/4175446054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f601c0ffe70 msgr2=0x7f601c069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:08:27.574 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.566+0000 7f6020a9d700 1 --2- 172.21.15.152:0/4175446054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f601c0ffe70 0x7f601c069520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:27.574 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.566+0000 7f6020a9d700 1 -- 172.21.15.152:0/4175446054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c101990 msgr2=0x7f601c19df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:08:27.574 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.566+0000 7f6020a9d700 1 --2- 172.21.15.152:0/4175446054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c101990 0x7f601c19df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:27.574 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.566+0000 7f6020a9d700 1 -- 172.21.15.152:0/4175446054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6014009d00 con 0x7f601c100fd0 2023-10-16T13:08:27.575 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.566+0000 7f6020a9d700 1 --2- 172.21.15.152:0/4175446054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f601c100fd0 0x7f601c19b8d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f601800c9b0 tx=0x7f601800cd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:08:27.575 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.566+0000 7f60127fc700 1 -- 172.21.15.152:0/4175446054 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018007b00 con 0x7f601c100fd0 2023-10-16T13:08:27.575 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.566+0000 7f60127fc700 1 -- 172.21.15.152:0/4175446054 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6018007c60 con 0x7f601c100fd0 2023-10-16T13:08:27.575 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.566+0000 7f6023502700 1 -- 172.21.15.152:0/4175446054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601c19ecd0 con 0x7f601c100fd0 2023-10-16T13:08:27.575 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.566+0000 7f60127fc700 1 -- 172.21.15.152:0/4175446054 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018018730 con 0x7f601c100fd0 2023-10-16T13:08:27.575 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.566+0000 7f6023502700 1 -- 172.21.15.152:0/4175446054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601c19f180 con 0x7f601c100fd0 2023-10-16T13:08:27.576 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.567+0000 7f6023502700 1 -- 172.21.15.152:0/4175446054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601c107320 con 0x7f601c100fd0 2023-10-16T13:08:27.576 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.568+0000 7f60127fc700 1 -- 172.21.15.152:0/4175446054 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6018018890 con 0x7f601c100fd0 2023-10-16T13:08:27.576 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.568+0000 7f60127fc700 1 --2- 172.21.15.152:0/4175446054 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f60080a1480 0x7f60080a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:08:27.576 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.569+0000 7f60127fc700 1 -- 172.21.15.152:0/4175446054 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f60180cbd60 con 0x7f601c100fd0 2023-10-16T13:08:27.576 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.569+0000 7f602129e700 1 --2- 172.21.15.152:0/4175446054 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f60080a1480 0x7f60080a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:08:27.577 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.569+0000 7f602129e700 1 --2- 172.21.15.152:0/4175446054 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f60080a1480 0x7f60080a3940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f600c005fd0 tx=0x7f600c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:08:27.577 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.573+0000 7f60127fc700 1 -- 172.21.15.152:0/4175446054 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6018096430 con 0x7f601c100fd0 2023-10-16T13:08:27.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:27.770+0000 7f6023502700 1 -- 172.21.15.152:0/4175446054 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f601c02d2b0 con 0x7f60080a1480 2023-10-16T13:08:27.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:27 smithi092 ceph-mon[99542]: purged_snaps scrub starts 2023-10-16T13:08:27.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:27 smithi092 ceph-mon[99542]: purged_snaps scrub ok 2023-10-16T13:08:27.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:27 smithi092 ceph-mon[99542]: osd.4 [v2:172.21.15.118:6808/3903514094,v1:172.21.15.118:6809/3903514094] boot 2023-10-16T13:08:27.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:27 smithi092 ceph-mon[99542]: osdmap e33: 5 total, 5 up, 5 in 2023-10-16T13:08:27.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:27 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-16T13:08:27.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:27 smithi092 ceph-mon[99542]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:28.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:27 smithi118 ceph-mon[103969]: purged_snaps scrub starts 2023-10-16T13:08:28.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:27 smithi118 ceph-mon[103969]: purged_snaps scrub ok 2023-10-16T13:08:28.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:27 smithi118 ceph-mon[103969]: osd.4 [v2:172.21.15.118:6808/3903514094,v1:172.21.15.118:6809/3903514094] boot 2023-10-16T13:08:28.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:27 smithi118 ceph-mon[103969]: osdmap e33: 5 total, 5 up, 5 in 2023-10-16T13:08:28.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:27 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-16T13:08:28.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:27 smithi118 ceph-mon[103969]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:28.192 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:27 smithi152 ceph-mon[104423]: purged_snaps scrub starts 2023-10-16T13:08:28.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:27 smithi152 ceph-mon[104423]: purged_snaps scrub ok 2023-10-16T13:08:28.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:27 smithi152 ceph-mon[104423]: osd.4 [v2:172.21.15.118:6808/3903514094,v1:172.21.15.118:6809/3903514094] boot 2023-10-16T13:08:28.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:27 smithi152 ceph-mon[104423]: osdmap e33: 5 total, 5 up, 5 in 2023-10-16T13:08:28.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:27 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-16T13:08:28.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:27 smithi152 ceph-mon[104423]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-16T13:08:28.886 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:28 smithi152 ceph-mon[104423]: osdmap e34: 5 total, 5 up, 5 in 2023-10-16T13:08:28.887 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:28 smithi152 ceph-mon[104423]: from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:08:28.887 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:28 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:08:28.887 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:28 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:08:28.887 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:28 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:28.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:28 smithi092 ceph-mon[99542]: osdmap e34: 5 total, 5 up, 5 in 2023-10-16T13:08:28.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:28 smithi092 ceph-mon[99542]: from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:08:28.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:28 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:08:28.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:28 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:08:28.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:28 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:29.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:28 smithi118 ceph-mon[103969]: osdmap e34: 5 total, 5 up, 5 in 2023-10-16T13:08:29.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:28 smithi118 ceph-mon[103969]: from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:08:29.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:08:29.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:08:29.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:29 smithi092 ceph-mon[99542]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:30.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:29 smithi118 ceph-mon[103969]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:30.192 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:29 smithi152 ceph-mon[104423]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:30.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:30 smithi092 ceph-mon[99542]: from='client.? 172.21.15.152:0/1464684860' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb550e84-333c-4c46-b1c8-5bc29237fd34"}]: dispatch 2023-10-16T13:08:30.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:30 smithi092 ceph-mon[99542]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb550e84-333c-4c46-b1c8-5bc29237fd34"}]: dispatch 2023-10-16T13:08:30.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:30 smithi092 ceph-mon[99542]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb550e84-333c-4c46-b1c8-5bc29237fd34"}]': finished 2023-10-16T13:08:30.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:30 smithi092 ceph-mon[99542]: osdmap e35: 6 total, 5 up, 6 in 2023-10-16T13:08:30.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:30 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-16T13:08:31.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:30 smithi118 ceph-mon[103969]: from='client.? 172.21.15.152:0/1464684860' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb550e84-333c-4c46-b1c8-5bc29237fd34"}]: dispatch 2023-10-16T13:08:31.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:30 smithi118 ceph-mon[103969]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb550e84-333c-4c46-b1c8-5bc29237fd34"}]: dispatch 2023-10-16T13:08:31.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:30 smithi118 ceph-mon[103969]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb550e84-333c-4c46-b1c8-5bc29237fd34"}]': finished 2023-10-16T13:08:31.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:30 smithi118 ceph-mon[103969]: osdmap e35: 6 total, 5 up, 6 in 2023-10-16T13:08:31.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:30 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-16T13:08:31.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:30 smithi152 ceph-mon[104423]: from='client.? 172.21.15.152:0/1464684860' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb550e84-333c-4c46-b1c8-5bc29237fd34"}]: dispatch 2023-10-16T13:08:31.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:30 smithi152 ceph-mon[104423]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb550e84-333c-4c46-b1c8-5bc29237fd34"}]: dispatch 2023-10-16T13:08:31.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:30 smithi152 ceph-mon[104423]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb550e84-333c-4c46-b1c8-5bc29237fd34"}]': finished 2023-10-16T13:08:31.194 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:30 smithi152 ceph-mon[104423]: osdmap e35: 6 total, 5 up, 6 in 2023-10-16T13:08:31.194 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:30 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-16T13:08:32.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:31 smithi118 ceph-mon[103969]: from='client.? 172.21.15.152:0/2457679482' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:08:32.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:31 smithi118 ceph-mon[103969]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:32.192 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:31 smithi152 ceph-mon[104423]: from='client.? 172.21.15.152:0/2457679482' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:08:32.192 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:31 smithi152 ceph-mon[104423]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:32.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:31 smithi092 ceph-mon[99542]: from='client.? 172.21.15.152:0/2457679482' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:08:32.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:31 smithi092 ceph-mon[99542]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:34.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:34 smithi152 ceph-mon[104423]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:34.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:34 smithi118 ceph-mon[103969]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:34.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:34 smithi092 ceph-mon[99542]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:36.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:36 smithi152 ceph-mon[104423]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:36.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:36 smithi118 ceph-mon[103969]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:36.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:36 smithi092 ceph-mon[99542]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:37.682 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:37 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-16T13:08:37.683 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:37 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:37.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:37 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-16T13:08:37.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:37 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:37.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:37 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-16T13:08:37.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:37 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:38.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:38 smithi152 ceph-mon[104423]: Deploying daemon osd.5 on smithi152 2023-10-16T13:08:38.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:38 smithi152 ceph-mon[104423]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:38.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:38 smithi092 ceph-mon[99542]: Deploying daemon osd.5 on smithi152 2023-10-16T13:08:38.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:38 smithi092 ceph-mon[99542]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:38.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:38 smithi118 ceph-mon[103969]: Deploying daemon osd.5 on smithi152 2023-10-16T13:08:38.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:38 smithi118 ceph-mon[103969]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:40.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:40 smithi152 ceph-mon[104423]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:40.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:40 smithi092 ceph-mon[99542]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:40.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:40 smithi118 ceph-mon[103969]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:42.315 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:42 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:42.315 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:42 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:42.316 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:42 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:08:42.316 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:42 smithi152 ceph-mon[104423]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:42.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:42 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:42.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:42 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:42.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:42 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:08:42.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:42 smithi092 ceph-mon[99542]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:42.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:42 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:42.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:42 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:42.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:42 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:08:42.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:42 smithi118 ceph-mon[103969]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:44.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:44.132+0000 7f60127fc700 1 -- 172.21.15.152:0/4175446054 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f601c02d2b0 con 0x7f60080a1480 2023-10-16T13:08:44.135 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 5 on host 'smithi152' 2023-10-16T13:08:44.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:44.134+0000 7f6023502700 1 -- 172.21.15.152:0/4175446054 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f60080a1480 msgr2=0x7f60080a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:08:44.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:44.134+0000 7f6023502700 1 --2- 172.21.15.152:0/4175446054 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f60080a1480 0x7f60080a3940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f600c005fd0 tx=0x7f600c00a560 comp rx=0 tx=0).stop 2023-10-16T13:08:44.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:44.134+0000 7f6023502700 1 -- 172.21.15.152:0/4175446054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f601c100fd0 msgr2=0x7f601c19b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:08:44.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:44.134+0000 7f6023502700 1 --2- 172.21.15.152:0/4175446054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f601c100fd0 0x7f601c19b8d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f601800c9b0 tx=0x7f601800cd70 comp rx=0 tx=0).stop 2023-10-16T13:08:44.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:44.134+0000 7f6023502700 1 -- 172.21.15.152:0/4175446054 shutdown_connections 2023-10-16T13:08:44.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:44.134+0000 7f6023502700 1 --2- 172.21.15.152:0/4175446054 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f60080a1480 0x7f60080a3940 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:44.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:44.134+0000 7f6023502700 1 --2- 172.21.15.152:0/4175446054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c101990 0x7f601c19df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:44.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:44.134+0000 7f6023502700 1 --2- 172.21.15.152:0/4175446054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f601c0ffe70 0x7f601c069520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:44.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:44.134+0000 7f6023502700 1 --2- 172.21.15.152:0/4175446054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f601c100fd0 0x7f601c19b8d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:44.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:44.134+0000 7f6023502700 1 -- 172.21.15.152:0/4175446054 >> 172.21.15.152:0/4175446054 conn(0x7f601c0fb3f0 msgr2=0x7f601c104460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:08:44.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:44.134+0000 7f6023502700 1 -- 172.21.15.152:0/4175446054 shutdown_connections 2023-10-16T13:08:44.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:08:44.134+0000 7f6023502700 1 -- 172.21.15.152:0/4175446054 wait complete. 2023-10-16T13:08:44.537 DEBUG:teuthology.orchestra.run.smithi152:osd.5> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.5.service 2023-10-16T13:08:44.542 INFO:tasks.cephadm:Deploying osd.6 on smithi092 with /dev/vg_nvme/lv_2... 2023-10-16T13:08:44.542 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-16T13:08:44.585 INFO:journalctl@ceph.osd.5.smithi152.stdout:-- Logs begin at Mon 2023-10-16 12:49:44 UTC. -- 2023-10-16T13:08:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:44 smithi092 ceph-mon[99542]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:44 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:44 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:44 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:44.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:44 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:08:44.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:44 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:44.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:44 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:08:44.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:44 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:44.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:44 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:44.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:44 smithi118 ceph-mon[103969]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:44.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:44 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:44.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:44 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:44.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:44 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:44.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:44 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:08:44.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:44 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:44.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:44 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:08:44.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:44 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:44.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:44 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:44.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:44 smithi152 ceph-mon[104423]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:44.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:44 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:44.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:44 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:44.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:44 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:44.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:44 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:08:44.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:44 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:44.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:44 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:08:44.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:44 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:44.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:44 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:45.124 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:08:45.367 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:08:45 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:08:45.131+0000 7f4c65fbb640 -1 osd.5 0 log_to_monitors true 2023-10-16T13:08:45.654 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:45 smithi092 ceph-mon[99542]: from='osd.5 [v2:172.21.15.152:6808/3958877515,v1:172.21.15.152:6809/3958877515]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-16T13:08:45.654 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:45 smithi092 ceph-mon[99542]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-16T13:08:45.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:45 smithi152 ceph-mon[104423]: from='osd.5 [v2:172.21.15.152:6808/3958877515,v1:172.21.15.152:6809/3958877515]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-16T13:08:45.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:45 smithi152 ceph-mon[104423]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-16T13:08:45.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:45 smithi118 ceph-mon[103969]: from='osd.5 [v2:172.21.15.152:6808/3958877515,v1:172.21.15.152:6809/3958877515]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-16T13:08:45.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:45 smithi118 ceph-mon[103969]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-16T13:08:46.648 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-16T13:08:46.648 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-16T13:08:46.648 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2023-10-16T13:08:46.649 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2023-10-16T13:08:46.649 INFO:teuthology.orchestra.run.smithi092.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0126751 s, 827 MB/s 2023-10-16T13:08:46.649 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2023-10-16T13:08:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:46 smithi092 ceph-mon[99542]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:46 smithi092 ceph-mon[99542]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-16T13:08:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:46 smithi092 ceph-mon[99542]: osdmap e36: 6 total, 5 up, 6 in 2023-10-16T13:08:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-16T13:08:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:46 smithi092 ceph-mon[99542]: from='osd.5 [v2:172.21.15.152:6808/3958877515,v1:172.21.15.152:6809/3958877515]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:08:46.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:46 smithi092 ceph-mon[99542]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:08:46.776 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:08:46 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:08:46.474+0000 7f4c5ae31700 -1 osd.5 0 waiting for initial osdmap 2023-10-16T13:08:46.777 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:08:46 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:08:46.481+0000 7f4c55c24700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:08:46.777 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:46 smithi152 ceph-mon[104423]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:46.777 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:46 smithi152 ceph-mon[104423]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-16T13:08:46.777 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:46 smithi152 ceph-mon[104423]: osdmap e36: 6 total, 5 up, 6 in 2023-10-16T13:08:46.778 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-16T13:08:46.778 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:46 smithi152 ceph-mon[104423]: from='osd.5 [v2:172.21.15.152:6808/3958877515,v1:172.21.15.152:6809/3958877515]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:08:46.778 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:46 smithi152 ceph-mon[104423]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:08:46.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:46 smithi118 ceph-mon[103969]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:46.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:46 smithi118 ceph-mon[103969]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-16T13:08:46.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:46 smithi118 ceph-mon[103969]: osdmap e36: 6 total, 5 up, 6 in 2023-10-16T13:08:46.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-16T13:08:46.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:46 smithi118 ceph-mon[103969]: from='osd.5 [v2:172.21.15.152:6808/3958877515,v1:172.21.15.152:6809/3958877515]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:08:46.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:46 smithi118 ceph-mon[103969]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:08:47.070 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi092:vg_nvme/lv_2 2023-10-16T13:08:47.633 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:08:47.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:47 smithi092 ceph-mon[99542]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-10-16T13:08:47.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:47 smithi092 ceph-mon[99542]: osdmap e37: 6 total, 5 up, 6 in 2023-10-16T13:08:47.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-16T13:08:47.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-16T13:08:47.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:47.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:47.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:08:47.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:08:47.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:47.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:47.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:08:47.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:47.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:47 smithi118 ceph-mon[103969]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-10-16T13:08:47.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:47 smithi118 ceph-mon[103969]: osdmap e37: 6 total, 5 up, 6 in 2023-10-16T13:08:47.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:47 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-16T13:08:47.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:47 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-16T13:08:47.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:47 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:47.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:47 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:47.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:47 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:08:47.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:47 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:08:47.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:47 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:47.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:47 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:47.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:47 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:08:47.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:47 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:47.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:47 smithi152 ceph-mon[104423]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-10-16T13:08:47.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:47 smithi152 ceph-mon[104423]: osdmap e37: 6 total, 5 up, 6 in 2023-10-16T13:08:47.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:47 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-16T13:08:47.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:47 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-16T13:08:47.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:47 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:47.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:47 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:47.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:47 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:08:47.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:47 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:08:47.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:47 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:47.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:47 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:47.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:47 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:08:47.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:47 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:08:48.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:48 smithi092 ceph-mon[99542]: purged_snaps scrub starts 2023-10-16T13:08:48.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:48 smithi092 ceph-mon[99542]: purged_snaps scrub ok 2023-10-16T13:08:48.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:48 smithi092 ceph-mon[99542]: Detected new or changed devices on smithi152 2023-10-16T13:08:48.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:48 smithi092 ceph-mon[99542]: Adjusting osd_memory_target on smithi152 to 8584M 2023-10-16T13:08:48.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:48 smithi092 ceph-mon[99542]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:48.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:48 smithi092 ceph-mon[99542]: osd.5 [v2:172.21.15.152:6808/3958877515,v1:172.21.15.152:6809/3958877515] boot 2023-10-16T13:08:48.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:48 smithi092 ceph-mon[99542]: osdmap e38: 6 total, 6 up, 6 in 2023-10-16T13:08:48.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:48 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-16T13:08:48.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:48 smithi118 ceph-mon[103969]: purged_snaps scrub starts 2023-10-16T13:08:48.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:48 smithi118 ceph-mon[103969]: purged_snaps scrub ok 2023-10-16T13:08:48.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:48 smithi118 ceph-mon[103969]: Detected new or changed devices on smithi152 2023-10-16T13:08:48.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:48 smithi118 ceph-mon[103969]: Adjusting osd_memory_target on smithi152 to 8584M 2023-10-16T13:08:48.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:48 smithi118 ceph-mon[103969]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:48.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:48 smithi118 ceph-mon[103969]: osd.5 [v2:172.21.15.152:6808/3958877515,v1:172.21.15.152:6809/3958877515] boot 2023-10-16T13:08:48.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:48 smithi118 ceph-mon[103969]: osdmap e38: 6 total, 6 up, 6 in 2023-10-16T13:08:48.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:48 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-16T13:08:48.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:48 smithi152 ceph-mon[104423]: purged_snaps scrub starts 2023-10-16T13:08:48.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:48 smithi152 ceph-mon[104423]: purged_snaps scrub ok 2023-10-16T13:08:48.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:48 smithi152 ceph-mon[104423]: Detected new or changed devices on smithi152 2023-10-16T13:08:48.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:48 smithi152 ceph-mon[104423]: Adjusting osd_memory_target on smithi152 to 8584M 2023-10-16T13:08:48.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:48 smithi152 ceph-mon[104423]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-16T13:08:48.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:48 smithi152 ceph-mon[104423]: osd.5 [v2:172.21.15.152:6808/3958877515,v1:172.21.15.152:6809/3958877515] boot 2023-10-16T13:08:48.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:48 smithi152 ceph-mon[104423]: osdmap e38: 6 total, 6 up, 6 in 2023-10-16T13:08:48.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:48 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-16T13:08:48.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.958+0000 7efc5a1db700 1 -- 172.21.15.92:0/1390825828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc54101a70 msgr2=0x7efc54108300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:08:48.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.958+0000 7efc5a1db700 1 --2- 172.21.15.92:0/1390825828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc54101a70 0x7efc54108300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00b0a0 tx=0x7efc4c00b3b0 comp rx=0 tx=0).stop 2023-10-16T13:08:48.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.958+0000 7efc5a1db700 1 -- 172.21.15.92:0/1390825828 shutdown_connections 2023-10-16T13:08:48.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.958+0000 7efc5a1db700 1 --2- 172.21.15.92:0/1390825828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc54101a70 0x7efc54108300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:48.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.958+0000 7efc5a1db700 1 --2- 172.21.15.92:0/1390825828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc54100390 0x7efc541007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:48.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.958+0000 7efc5a1db700 1 --2- 172.21.15.92:0/1390825828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc541010b0 0x7efc54101530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:48.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.958+0000 7efc5a1db700 1 -- 172.21.15.92:0/1390825828 >> 172.21.15.92:0/1390825828 conn(0x7efc540fab70 msgr2=0x7efc540fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:08:48.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.958+0000 7efc5a1db700 1 -- 172.21.15.92:0/1390825828 shutdown_connections 2023-10-16T13:08:48.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.958+0000 7efc5a1db700 1 -- 172.21.15.92:0/1390825828 wait complete. 2023-10-16T13:08:48.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.959+0000 7efc5a1db700 1 Processor -- start 2023-10-16T13:08:48.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.959+0000 7efc5a1db700 1 -- start start 2023-10-16T13:08:48.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.959+0000 7efc5a1db700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc54100390 0x7efc54196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:08:48.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.959+0000 7efc5a1db700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc541010b0 0x7efc54197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:08:48.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.959+0000 7efc5a1db700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc54101a70 0x7efc5419e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:08:48.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.959+0000 7efc5a1db700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5419e9c0 con 0x7efc54100390 2023-10-16T13:08:48.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.959+0000 7efc5a1db700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5419eb00 con 0x7efc541010b0 2023-10-16T13:08:48.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.959+0000 7efc5a1db700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5419ec90 con 0x7efc54101a70 2023-10-16T13:08:48.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.959+0000 7efc537fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc54100390 0x7efc54196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:08:48.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.959+0000 7efc537fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc54100390 0x7efc54196e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34500/0 (socket says 172.21.15.92:34500) 2023-10-16T13:08:48.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.959+0000 7efc537fe700 1 -- 172.21.15.92:0/2325007471 learned_addr learned my addr 172.21.15.92:0/2325007471 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:08:48.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.959+0000 7efc53fff700 1 --2- 172.21.15.92:0/2325007471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc54101a70 0x7efc5419e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:08:48.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.959+0000 7efc52ffd700 1 --2- 172.21.15.92:0/2325007471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc541010b0 0x7efc54197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:08:48.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.959+0000 7efc537fe700 1 -- 172.21.15.92:0/2325007471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc54101a70 msgr2=0x7efc5419e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:08:48.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.959+0000 7efc537fe700 1 --2- 172.21.15.92:0/2325007471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc54101a70 0x7efc5419e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:48.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.959+0000 7efc537fe700 1 -- 172.21.15.92:0/2325007471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc541010b0 msgr2=0x7efc54197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:08:48.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.959+0000 7efc537fe700 1 --2- 172.21.15.92:0/2325007471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc541010b0 0x7efc54197370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:08:48.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.959+0000 7efc537fe700 1 -- 172.21.15.92:0/2325007471 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c009d00 con 0x7efc54100390 2023-10-16T13:08:48.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.960+0000 7efc537fe700 1 --2- 172.21.15.92:0/2325007471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc54100390 0x7efc54196e30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efc3c00e9a0 tx=0x7efc3c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:08:48.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.960+0000 7efc50ff9700 1 -- 172.21.15.92:0/2325007471 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c009790 con 0x7efc54100390 2023-10-16T13:08:48.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.960+0000 7efc50ff9700 1 -- 172.21.15.92:0/2325007471 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efc3c004500 con 0x7efc54100390 2023-10-16T13:08:48.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.960+0000 7efc5a1db700 1 -- 172.21.15.92:0/2325007471 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5419ef70 con 0x7efc54100390 2023-10-16T13:08:48.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.960+0000 7efc50ff9700 1 -- 172.21.15.92:0/2325007471 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c003e30 con 0x7efc54100390 2023-10-16T13:08:48.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.960+0000 7efc5a1db700 1 -- 172.21.15.92:0/2325007471 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5419f380 con 0x7efc54100390 2023-10-16T13:08:48.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.961+0000 7efc5a1db700 1 -- 172.21.15.92:0/2325007471 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5410b830 con 0x7efc54100390 2023-10-16T13:08:48.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.962+0000 7efc50ff9700 1 -- 172.21.15.92:0/2325007471 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7efc3c003f90 con 0x7efc54100390 2023-10-16T13:08:48.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.963+0000 7efc50ff9700 1 --2- 172.21.15.92:0/2325007471 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7efc400a1480 0x7efc400a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:08:48.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.963+0000 7efc52ffd700 1 --2- 172.21.15.92:0/2325007471 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7efc400a1480 0x7efc400a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:08:48.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.963+0000 7efc50ff9700 1 -- 172.21.15.92:0/2325007471 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4562+0+0 (secure 0 0 0) 0x7efc3c014070 con 0x7efc54100390 2023-10-16T13:08:48.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.963+0000 7efc52ffd700 1 --2- 172.21.15.92:0/2325007471 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7efc400a1480 0x7efc400a3940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efc541000c0 tx=0x7efc44009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:08:48.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:48.966+0000 7efc50ff9700 1 -- 172.21.15.92:0/2325007471 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efc3c0966e0 con 0x7efc54100390 2023-10-16T13:08:49.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:08:49.164+0000 7efc5a1db700 1 -- 172.21.15.92:0/2325007471 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7efc540ff680 con 0x7efc400a1480 2023-10-16T13:08:49.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:49 smithi092 ceph-mon[99542]: osdmap e39: 6 total, 6 up, 6 in 2023-10-16T13:08:49.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:49 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:08:49.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:49 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:08:49.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:49 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:49.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:49 smithi118 ceph-mon[103969]: osdmap e39: 6 total, 6 up, 6 in 2023-10-16T13:08:49.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:49 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:08:49.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:49 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:08:49.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:49 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:49.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:49 smithi152 ceph-mon[104423]: osdmap e39: 6 total, 6 up, 6 in 2023-10-16T13:08:49.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:49 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:08:49.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:49 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:08:49.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:49 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:50.556 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:50 smithi092 ceph-mon[99542]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:08:50.557 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:50 smithi092 ceph-mon[99542]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-16T13:08:50.557 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:50 smithi092 ceph-mon[99542]: osdmap e40: 6 total, 6 up, 6 in 2023-10-16T13:08:50.557 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:50 smithi092 ceph-mon[99542]: osdmap e41: 6 total, 6 up, 6 in 2023-10-16T13:08:50.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:50 smithi118 ceph-mon[103969]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:08:50.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:50 smithi118 ceph-mon[103969]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-16T13:08:50.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:50 smithi118 ceph-mon[103969]: osdmap e40: 6 total, 6 up, 6 in 2023-10-16T13:08:50.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:50 smithi118 ceph-mon[103969]: osdmap e41: 6 total, 6 up, 6 in 2023-10-16T13:08:50.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:50 smithi152 ceph-mon[104423]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:08:50.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:50 smithi152 ceph-mon[104423]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-16T13:08:50.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:50 smithi152 ceph-mon[104423]: osdmap e40: 6 total, 6 up, 6 in 2023-10-16T13:08:50.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:50 smithi152 ceph-mon[104423]: osdmap e41: 6 total, 6 up, 6 in 2023-10-16T13:08:52.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:52 smithi118 ceph-mon[103969]: pgmap v129: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-16T13:08:52.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:52 smithi118 ceph-mon[103969]: osdmap e42: 6 total, 6 up, 6 in 2023-10-16T13:08:52.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:52 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3611439376' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f93ad94-3117-44cc-ab85-5fbee3f68f56"}]: dispatch 2023-10-16T13:08:52.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:52 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3611439376' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f93ad94-3117-44cc-ab85-5fbee3f68f56"}]': finished 2023-10-16T13:08:52.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:52 smithi118 ceph-mon[103969]: osdmap e43: 7 total, 6 up, 7 in 2023-10-16T13:08:52.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:52 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-16T13:08:52.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:52 smithi152 ceph-mon[104423]: pgmap v129: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-16T13:08:52.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:52 smithi152 ceph-mon[104423]: osdmap e42: 6 total, 6 up, 6 in 2023-10-16T13:08:52.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:52 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3611439376' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f93ad94-3117-44cc-ab85-5fbee3f68f56"}]: dispatch 2023-10-16T13:08:52.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:52 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3611439376' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f93ad94-3117-44cc-ab85-5fbee3f68f56"}]': finished 2023-10-16T13:08:52.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:52 smithi152 ceph-mon[104423]: osdmap e43: 7 total, 6 up, 7 in 2023-10-16T13:08:52.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:52 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-16T13:08:52.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:52 smithi092 ceph-mon[99542]: pgmap v129: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-16T13:08:52.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:52 smithi092 ceph-mon[99542]: osdmap e42: 6 total, 6 up, 6 in 2023-10-16T13:08:52.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:52 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3611439376' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f93ad94-3117-44cc-ab85-5fbee3f68f56"}]: dispatch 2023-10-16T13:08:52.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:52 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3611439376' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f93ad94-3117-44cc-ab85-5fbee3f68f56"}]': finished 2023-10-16T13:08:52.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:52 smithi092 ceph-mon[99542]: osdmap e43: 7 total, 6 up, 7 in 2023-10-16T13:08:52.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:52 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-16T13:08:53.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:53 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3783702491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:08:53.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:53 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3783702491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:08:53.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:53 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3783702491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:08:54.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:54 smithi118 ceph-mon[103969]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-16T13:08:54.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:54 smithi152 ceph-mon[104423]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-16T13:08:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:54 smithi092 ceph-mon[99542]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-16T13:08:56.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:56 smithi118 ceph-mon[103969]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 100 KiB/s, 0 objects/s recovering 2023-10-16T13:08:56.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:56 smithi152 ceph-mon[104423]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 100 KiB/s, 0 objects/s recovering 2023-10-16T13:08:56.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:56 smithi092 ceph-mon[99542]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 100 KiB/s, 0 objects/s recovering 2023-10-16T13:08:58.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:58 smithi092 ceph-mon[99542]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-10-16T13:08:58.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:58 smithi118 ceph-mon[103969]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-10-16T13:08:58.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:58 smithi152 ceph-mon[104423]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-10-16T13:08:59.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:59 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-16T13:08:59.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:59 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:59.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:08:59 smithi092 ceph-mon[99542]: Deploying daemon osd.6 on smithi092 2023-10-16T13:08:59.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:59 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-16T13:08:59.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:59 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:59.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:08:59 smithi118 ceph-mon[103969]: Deploying daemon osd.6 on smithi092 2023-10-16T13:08:59.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:59 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-16T13:08:59.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:59 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:08:59.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:08:59 smithi152 ceph-mon[104423]: Deploying daemon osd.6 on smithi092 2023-10-16T13:09:00.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:00 smithi092 ceph-mon[99542]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-16T13:09:00.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:00 smithi152 ceph-mon[104423]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-16T13:09:00.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:00 smithi118 ceph-mon[103969]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-16T13:09:02.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:02 smithi092 ceph-mon[99542]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-16T13:09:02.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:02 smithi152 ceph-mon[104423]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-16T13:09:02.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:02 smithi118 ceph-mon[103969]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-16T13:09:04.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:04 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:04.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:04 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:04.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:04 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:09:04.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:04 smithi092 ceph-mon[99542]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-10-16T13:09:04.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:04 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:04.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:04 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:04.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:04 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:09:04.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:04 smithi152 ceph-mon[104423]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-10-16T13:09:04.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:04 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:04.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:04 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:04.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:04 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:09:04.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:04 smithi118 ceph-mon[103969]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-10-16T13:09:06.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:06.063+0000 7efc50ff9700 1 -- 172.21.15.92:0/2325007471 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efc540ff680 con 0x7efc400a1480 2023-10-16T13:09:06.067 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 6 on host 'smithi092' 2023-10-16T13:09:06.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:06.066+0000 7efc5a1db700 1 -- 172.21.15.92:0/2325007471 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7efc400a1480 msgr2=0x7efc400a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:09:06.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:06.066+0000 7efc5a1db700 1 --2- 172.21.15.92:0/2325007471 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7efc400a1480 0x7efc400a3940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efc541000c0 tx=0x7efc44009260 comp rx=0 tx=0).stop 2023-10-16T13:09:06.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:06.066+0000 7efc5a1db700 1 -- 172.21.15.92:0/2325007471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc54100390 msgr2=0x7efc54196e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:09:06.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:06.066+0000 7efc5a1db700 1 --2- 172.21.15.92:0/2325007471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc54100390 0x7efc54196e30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efc3c00e9a0 tx=0x7efc3c00ecb0 comp rx=0 tx=0).stop 2023-10-16T13:09:06.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:06.066+0000 7efc5a1db700 1 -- 172.21.15.92:0/2325007471 shutdown_connections 2023-10-16T13:09:06.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:06.066+0000 7efc5a1db700 1 --2- 172.21.15.92:0/2325007471 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7efc400a1480 0x7efc400a3940 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:06.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:06.066+0000 7efc5a1db700 1 --2- 172.21.15.92:0/2325007471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc54100390 0x7efc54196e30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:06.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:06.066+0000 7efc5a1db700 1 --2- 172.21.15.92:0/2325007471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc54101a70 0x7efc5419e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:06.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:06.066+0000 7efc5a1db700 1 --2- 172.21.15.92:0/2325007471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc541010b0 0x7efc54197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:06.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:06.066+0000 7efc5a1db700 1 -- 172.21.15.92:0/2325007471 >> 172.21.15.92:0/2325007471 conn(0x7efc540fab70 msgr2=0x7efc540fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:09:06.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:06.066+0000 7efc5a1db700 1 -- 172.21.15.92:0/2325007471 shutdown_connections 2023-10-16T13:09:06.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:06.066+0000 7efc5a1db700 1 -- 172.21.15.92:0/2325007471 wait complete. 2023-10-16T13:09:06.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:06 smithi092 ceph-mon[99542]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-16T13:09:06.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:06 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:06.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:06 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:06.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:06 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:06.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:06 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:09:06.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:06 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:06.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:06 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:06.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:06 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:06.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:06 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:09:06.513 DEBUG:teuthology.orchestra.run.smithi092:osd.6> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.6.service 2023-10-16T13:09:06.516 INFO:tasks.cephadm:Deploying osd.7 on smithi118 with /dev/vg_nvme/lv_2... 2023-10-16T13:09:06.516 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-16T13:09:06.549 INFO:journalctl@ceph.osd.6.smithi092.stdout:-- Logs begin at Mon 2023-10-16 12:49:18 UTC. -- 2023-10-16T13:09:06.561 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:06 smithi118 ceph-mon[103969]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-16T13:09:06.619 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:06 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:06.619 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:06 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:06.620 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:06 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:06.620 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:06 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:09:06.620 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:06 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:06.620 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:06 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:06.620 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:06 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:06.621 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:06 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:09:06.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:06 smithi152 ceph-mon[104423]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-16T13:09:06.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:06 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:06.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:06 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:06.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:06 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:06.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:06 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:09:06.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:06 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:06.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:06 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:06.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:06 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:06.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:06 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:09:07.096 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-16T13:09:07.382 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:09:07 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:09:07.054+0000 7fa1a0389640 -1 osd.6 0 log_to_monitors true 2023-10-16T13:09:07.383 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:07 smithi092 ceph-mon[99542]: from='osd.6 [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-16T13:09:07.630 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:07 smithi118 ceph-mon[103969]: from='osd.6 [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-16T13:09:07.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:07 smithi152 ceph-mon[104423]: from='osd.6 [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-16T13:09:08.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:08 smithi118 ceph-mon[103969]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-16T13:09:08.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:08 smithi118 ceph-mon[103969]: from='osd.6 [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-16T13:09:08.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:08 smithi118 ceph-mon[103969]: osdmap e44: 7 total, 6 up, 7 in 2023-10-16T13:09:08.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:08 smithi118 ceph-mon[103969]: from='osd.6 [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-16T13:09:08.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:08 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-16T13:09:08.574 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-16T13:09:08.575 INFO:teuthology.orchestra.run.smithi118.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-16T13:09:08.575 INFO:teuthology.orchestra.run.smithi118.stderr: stderr: 10+0 records in 2023-10-16T13:09:08.575 INFO:teuthology.orchestra.run.smithi118.stderr:10+0 records out 2023-10-16T13:09:08.575 INFO:teuthology.orchestra.run.smithi118.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00804088 s, 1.3 GB/s 2023-10-16T13:09:08.575 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping successful for: 2023-10-16T13:09:08.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:08 smithi152 ceph-mon[104423]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-16T13:09:08.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:08 smithi152 ceph-mon[104423]: from='osd.6 [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-16T13:09:08.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:08 smithi152 ceph-mon[104423]: osdmap e44: 7 total, 6 up, 7 in 2023-10-16T13:09:08.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:08 smithi152 ceph-mon[104423]: from='osd.6 [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-16T13:09:08.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:08 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-16T13:09:08.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:08 smithi092 ceph-mon[99542]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-16T13:09:08.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:08 smithi092 ceph-mon[99542]: from='osd.6 [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-16T13:09:08.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:08 smithi092 ceph-mon[99542]: osdmap e44: 7 total, 6 up, 7 in 2023-10-16T13:09:08.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:08 smithi092 ceph-mon[99542]: from='osd.6 [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-16T13:09:08.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:08 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-16T13:09:08.749 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:09:08 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:09:08.293+0000 7fa1951ff700 -1 osd.6 0 waiting for initial osdmap 2023-10-16T13:09:08.749 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:09:08 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:09:08.308+0000 7fa1917f5700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:09:09.040 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi118:vg_nvme/lv_2 2023-10-16T13:09:09.598 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-16T13:09:09.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:09 smithi152 ceph-mon[104423]: from='osd.6 [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-16T13:09:09.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:09 smithi152 ceph-mon[104423]: osdmap e45: 7 total, 6 up, 7 in 2023-10-16T13:09:09.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:09 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-16T13:09:09.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:09 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-16T13:09:09.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:09 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:09.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:09 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:09.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:09 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:09.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:09 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:09.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:09 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:09.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:09 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:09.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:09 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:09.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:09 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:09:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:09 smithi092 ceph-mon[99542]: from='osd.6 [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-16T13:09:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:09 smithi092 ceph-mon[99542]: osdmap e45: 7 total, 6 up, 7 in 2023-10-16T13:09:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:09 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-16T13:09:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:09 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-16T13:09:09.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:09 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:09.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:09 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:09.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:09 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:09.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:09 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:09.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:09 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:09.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:09 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:09.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:09 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:09.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:09 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:09:09.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:09 smithi118 ceph-mon[103969]: from='osd.6 [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-16T13:09:09.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:09 smithi118 ceph-mon[103969]: osdmap e45: 7 total, 6 up, 7 in 2023-10-16T13:09:09.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:09 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-16T13:09:09.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:09 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-16T13:09:09.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:09 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:09.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:09 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:09.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:09 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:09.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:09 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:09.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:09 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:09.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:09 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:09.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:09 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:09.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:09 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:09:10.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:10 smithi118 ceph-mon[103969]: purged_snaps scrub starts 2023-10-16T13:09:10.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:10 smithi118 ceph-mon[103969]: purged_snaps scrub ok 2023-10-16T13:09:10.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:10 smithi118 ceph-mon[103969]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-16T13:09:10.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:10 smithi118 ceph-mon[103969]: Detected new or changed devices on smithi092 2023-10-16T13:09:10.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:10 smithi118 ceph-mon[103969]: Adjusting osd_memory_target on smithi092 to 5722M 2023-10-16T13:09:10.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:10 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-16T13:09:10.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:10 smithi118 ceph-mon[103969]: osd.6 [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740] boot 2023-10-16T13:09:10.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:10 smithi118 ceph-mon[103969]: osdmap e46: 7 total, 7 up, 7 in 2023-10-16T13:09:10.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:10 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-16T13:09:10.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:10 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:10.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:10 smithi152 ceph-mon[104423]: purged_snaps scrub starts 2023-10-16T13:09:10.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:10 smithi152 ceph-mon[104423]: purged_snaps scrub ok 2023-10-16T13:09:10.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:10 smithi152 ceph-mon[104423]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-16T13:09:10.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:10 smithi152 ceph-mon[104423]: Detected new or changed devices on smithi092 2023-10-16T13:09:10.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:10 smithi152 ceph-mon[104423]: Adjusting osd_memory_target on smithi092 to 5722M 2023-10-16T13:09:10.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:10 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-16T13:09:10.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:10 smithi152 ceph-mon[104423]: osd.6 [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740] boot 2023-10-16T13:09:10.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:10 smithi152 ceph-mon[104423]: osdmap e46: 7 total, 7 up, 7 in 2023-10-16T13:09:10.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:10 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-16T13:09:10.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:10 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:10.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:10 smithi092 ceph-mon[99542]: purged_snaps scrub starts 2023-10-16T13:09:10.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:10 smithi092 ceph-mon[99542]: purged_snaps scrub ok 2023-10-16T13:09:10.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:10 smithi092 ceph-mon[99542]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-16T13:09:10.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:10 smithi092 ceph-mon[99542]: Detected new or changed devices on smithi092 2023-10-16T13:09:10.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:10 smithi092 ceph-mon[99542]: Adjusting osd_memory_target on smithi092 to 5722M 2023-10-16T13:09:10.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:10 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-16T13:09:10.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:10 smithi092 ceph-mon[99542]: osd.6 [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740] boot 2023-10-16T13:09:10.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:10 smithi092 ceph-mon[99542]: osdmap e46: 7 total, 7 up, 7 in 2023-10-16T13:09:10.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:10 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-16T13:09:10.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:10 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:10.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.965+0000 7ffab5c53700 1 -- 172.21.15.118:0/4269920174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffab0106ce0 msgr2=0x7ffab01090d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:09:10.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.965+0000 7ffab5c53700 1 --2- 172.21.15.118:0/4269920174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffab0106ce0 0x7ffab01090d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800b0a0 tx=0x7ffaa800b3b0 comp rx=0 tx=0).stop 2023-10-16T13:09:10.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.965+0000 7ffab5c53700 1 -- 172.21.15.118:0/4269920174 shutdown_connections 2023-10-16T13:09:10.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.965+0000 7ffab5c53700 1 --2- 172.21.15.118:0/4269920174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffab0106ce0 0x7ffab01090d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:10.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.965+0000 7ffab5c53700 1 --2- 172.21.15.118:0/4269920174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffab0101a80 0x7ffab0103e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:10.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.965+0000 7ffab5c53700 1 --2- 172.21.15.118:0/4269920174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab01043b0 0x7ffab01067a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:10.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.965+0000 7ffab5c53700 1 -- 172.21.15.118:0/4269920174 >> 172.21.15.118:0/4269920174 conn(0x7ffab00fb3f0 msgr2=0x7ffab00fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:09:10.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.965+0000 7ffab5c53700 1 -- 172.21.15.118:0/4269920174 shutdown_connections 2023-10-16T13:09:10.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.965+0000 7ffab5c53700 1 -- 172.21.15.118:0/4269920174 wait complete. 2023-10-16T13:09:10.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.966+0000 7ffab5c53700 1 Processor -- start 2023-10-16T13:09:10.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.966+0000 7ffab5c53700 1 -- start start 2023-10-16T13:09:10.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.966+0000 7ffab5c53700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffab0101a80 0x7ffab01013e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:09:10.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.966+0000 7ffab5c53700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab01043b0 0x7ffab00ffa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:09:10.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.966+0000 7ffab5c53700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffab0106ce0 0x7ffab00fff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:09:10.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.966+0000 7ffab5c53700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab01006f0 con 0x7ffab01043b0 2023-10-16T13:09:10.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.966+0000 7ffab5c53700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab0100860 con 0x7ffab0106ce0 2023-10-16T13:09:10.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.966+0000 7ffab5c53700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab01a0e60 con 0x7ffab0101a80 2023-10-16T13:09:10.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.966+0000 7ffaaffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffab0106ce0 0x7ffab00fff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:09:10.974 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.966+0000 7ffaaf7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffab0101a80 0x7ffab01013e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:09:10.974 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.966+0000 7ffaaf7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffab0101a80 0x7ffab01013e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.118:58146/0 (socket says 172.21.15.118:58146) 2023-10-16T13:09:10.974 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.966+0000 7ffaaf7fe700 1 -- 172.21.15.118:0/3769002336 learned_addr learned my addr 172.21.15.118:0/3769002336 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-16T13:09:10.974 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.966+0000 7ffaaeffd700 1 --2- 172.21.15.118:0/3769002336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab01043b0 0x7ffab00ffa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:09:10.974 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.967+0000 7ffaaffff700 1 -- 172.21.15.118:0/3769002336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffab0101a80 msgr2=0x7ffab01013e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:09:10.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.967+0000 7ffaaffff700 1 --2- 172.21.15.118:0/3769002336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffab0101a80 0x7ffab01013e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:10.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.967+0000 7ffaaffff700 1 -- 172.21.15.118:0/3769002336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab01043b0 msgr2=0x7ffab00ffa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:09:10.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.967+0000 7ffaaffff700 1 --2- 172.21.15.118:0/3769002336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab01043b0 0x7ffab00ffa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:10.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.967+0000 7ffaaffff700 1 -- 172.21.15.118:0/3769002336 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa8009d00 con 0x7ffab0106ce0 2023-10-16T13:09:10.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.967+0000 7ffaaffff700 1 --2- 172.21.15.118:0/3769002336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffab0106ce0 0x7ffab00fff70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800b070 tx=0x7ffaa8009410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:09:10.976 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.967+0000 7ffaacff9700 1 -- 172.21.15.118:0/3769002336 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa800e040 con 0x7ffab0106ce0 2023-10-16T13:09:10.976 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.967+0000 7ffaacff9700 1 -- 172.21.15.118:0/3769002336 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ffaa8004e60 con 0x7ffab0106ce0 2023-10-16T13:09:10.976 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.967+0000 7ffab5c53700 1 -- 172.21.15.118:0/3769002336 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab01a10e0 con 0x7ffab0106ce0 2023-10-16T13:09:10.976 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.967+0000 7ffaacff9700 1 -- 172.21.15.118:0/3769002336 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa801b970 con 0x7ffab0106ce0 2023-10-16T13:09:10.976 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.967+0000 7ffab5c53700 1 -- 172.21.15.118:0/3769002336 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab01a1500 con 0x7ffab0106ce0 2023-10-16T13:09:10.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.968+0000 7ffab5c53700 1 -- 172.21.15.118:0/3769002336 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab00fcf70 con 0x7ffab0106ce0 2023-10-16T13:09:10.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.969+0000 7ffaacff9700 1 -- 172.21.15.118:0/3769002336 <== mon.2 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ffaa801dbf0 con 0x7ffab0106ce0 2023-10-16T13:09:10.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.970+0000 7ffaacff9700 1 --2- 172.21.15.118:0/3769002336 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ffa980a1480 0x7ffa980a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:09:10.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.970+0000 7ffaacff9700 1 -- 172.21.15.118:0/3769002336 <== mon.2 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4965+0+0 (secure 0 0 0) 0x7ffaa80ce170 con 0x7ffab0106ce0 2023-10-16T13:09:10.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.970+0000 7ffaaf7fe700 1 --2- 172.21.15.118:0/3769002336 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ffa980a1480 0x7ffa980a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:09:10.978 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.970+0000 7ffaaf7fe700 1 --2- 172.21.15.118:0/3769002336 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ffa980a1480 0x7ffa980a3940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4005950 tx=0x7ffaa400a400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:09:10.978 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:10.973+0000 7ffaacff9700 1 -- 172.21.15.118:0/3769002336 <== mon.2 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ffaa8098570 con 0x7ffab0106ce0 2023-10-16T13:09:11.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:11.170+0000 7ffab5c53700 1 -- 172.21.15.118:0/3769002336 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7ffab002d130 con 0x7ffa980a1480 2023-10-16T13:09:11.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:11 smithi152 ceph-mon[104423]: osdmap e47: 7 total, 7 up, 7 in 2023-10-16T13:09:11.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:11 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:09:11.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:11 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:09:11.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:11 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:11.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:11 smithi092 ceph-mon[99542]: osdmap e47: 7 total, 7 up, 7 in 2023-10-16T13:09:11.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:11 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:09:11.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:11 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:09:11.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:11 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:11.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:11 smithi118 ceph-mon[103969]: osdmap e47: 7 total, 7 up, 7 in 2023-10-16T13:09:11.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:11 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:09:11.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:11 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:09:11.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:11 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:12.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:12 smithi152 ceph-mon[104423]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:09:12.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:12 smithi152 ceph-mon[104423]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:12.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:12 smithi092 ceph-mon[99542]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:09:12.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:12 smithi092 ceph-mon[99542]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:12.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:12 smithi118 ceph-mon[103969]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:09:12.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:12 smithi118 ceph-mon[103969]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:14.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:14 smithi152 ceph-mon[104423]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:14.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:14 smithi152 ceph-mon[104423]: from='client.? 172.21.15.118:0/3306458827' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b32e20e-f395-41b8-aafe-7455c630490c"}]: dispatch 2023-10-16T13:09:14.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:14 smithi152 ceph-mon[104423]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b32e20e-f395-41b8-aafe-7455c630490c"}]: dispatch 2023-10-16T13:09:14.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:14 smithi152 ceph-mon[104423]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5b32e20e-f395-41b8-aafe-7455c630490c"}]': finished 2023-10-16T13:09:14.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:14 smithi152 ceph-mon[104423]: osdmap e48: 8 total, 7 up, 8 in 2023-10-16T13:09:14.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:14 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-16T13:09:14.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:14 smithi152 ceph-mon[104423]: from='client.? 172.21.15.118:0/1706243702' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:09:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:14 smithi092 ceph-mon[99542]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:14 smithi092 ceph-mon[99542]: from='client.? 172.21.15.118:0/3306458827' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b32e20e-f395-41b8-aafe-7455c630490c"}]: dispatch 2023-10-16T13:09:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:14 smithi092 ceph-mon[99542]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b32e20e-f395-41b8-aafe-7455c630490c"}]: dispatch 2023-10-16T13:09:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:14 smithi092 ceph-mon[99542]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5b32e20e-f395-41b8-aafe-7455c630490c"}]': finished 2023-10-16T13:09:14.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:14 smithi092 ceph-mon[99542]: osdmap e48: 8 total, 7 up, 8 in 2023-10-16T13:09:14.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:14 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-16T13:09:14.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:14 smithi092 ceph-mon[99542]: from='client.? 172.21.15.118:0/1706243702' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:09:14.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:14 smithi118 ceph-mon[103969]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:14.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:14 smithi118 ceph-mon[103969]: from='client.? 172.21.15.118:0/3306458827' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b32e20e-f395-41b8-aafe-7455c630490c"}]: dispatch 2023-10-16T13:09:14.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:14 smithi118 ceph-mon[103969]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b32e20e-f395-41b8-aafe-7455c630490c"}]: dispatch 2023-10-16T13:09:14.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:14 smithi118 ceph-mon[103969]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5b32e20e-f395-41b8-aafe-7455c630490c"}]': finished 2023-10-16T13:09:14.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:14 smithi118 ceph-mon[103969]: osdmap e48: 8 total, 7 up, 8 in 2023-10-16T13:09:14.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:14 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-16T13:09:14.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:14 smithi118 ceph-mon[103969]: from='client.? 172.21.15.118:0/1706243702' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:09:16.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:16 smithi152 ceph-mon[104423]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:16.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:16 smithi092 ceph-mon[99542]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:16.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:16 smithi118 ceph-mon[103969]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:18.593 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:18 smithi118 ceph-mon[103969]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:18.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:18 smithi152 ceph-mon[104423]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:18.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:18 smithi092 ceph-mon[99542]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:20.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:20 smithi118 ceph-mon[103969]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:20.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:20 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-16T13:09:20.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:20 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:20.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:20 smithi152 ceph-mon[104423]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:20.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:20 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-16T13:09:20.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:20 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:20.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:20 smithi092 ceph-mon[99542]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:20.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:20 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-16T13:09:20.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:20 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:21.490 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:21 smithi118 ceph-mon[103969]: Deploying daemon osd.7 on smithi118 2023-10-16T13:09:21.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:21 smithi152 ceph-mon[104423]: Deploying daemon osd.7 on smithi118 2023-10-16T13:09:21.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:21 smithi092 ceph-mon[99542]: Deploying daemon osd.7 on smithi118 2023-10-16T13:09:22.447 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:22 smithi118 ceph-mon[103969]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:22.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:22 smithi152 ceph-mon[104423]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:22.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:22 smithi092 ceph-mon[99542]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:24.664 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:24 smithi118 ceph-mon[103969]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:24.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:24 smithi152 ceph-mon[104423]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:24 smithi092 ceph-mon[99542]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:25.861 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:25 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:25.861 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:25 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:25.861 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:25 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:09:25.861 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:25 smithi118 ceph-mon[103969]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:25.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:25 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:25.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:25 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:25.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:25 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:09:25.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:25 smithi092 ceph-mon[99542]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:26.192 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:25 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:26.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:25 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:26.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:25 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:09:26.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:25 smithi152 ceph-mon[104423]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:27.485 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:27.481+0000 7ffaacff9700 1 -- 172.21.15.118:0/3769002336 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ffab002d130 con 0x7ffa980a1480 2023-10-16T13:09:27.485 INFO:teuthology.orchestra.run.smithi118.stdout:Created osd(s) 7 on host 'smithi118' 2023-10-16T13:09:27.486 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:27.483+0000 7ffab5c53700 1 -- 172.21.15.118:0/3769002336 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ffa980a1480 msgr2=0x7ffa980a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:09:27.487 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:27.483+0000 7ffab5c53700 1 --2- 172.21.15.118:0/3769002336 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ffa980a1480 0x7ffa980a3940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4005950 tx=0x7ffaa400a400 comp rx=0 tx=0).stop 2023-10-16T13:09:27.487 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:27.483+0000 7ffab5c53700 1 -- 172.21.15.118:0/3769002336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffab0106ce0 msgr2=0x7ffab00fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:09:27.487 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:27.483+0000 7ffab5c53700 1 --2- 172.21.15.118:0/3769002336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffab0106ce0 0x7ffab00fff70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800b070 tx=0x7ffaa8009410 comp rx=0 tx=0).stop 2023-10-16T13:09:27.487 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:27.483+0000 7ffab5c53700 1 -- 172.21.15.118:0/3769002336 shutdown_connections 2023-10-16T13:09:27.487 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:27.483+0000 7ffab5c53700 1 --2- 172.21.15.118:0/3769002336 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ffa980a1480 0x7ffa980a3940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:27.488 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:27.483+0000 7ffab5c53700 1 --2- 172.21.15.118:0/3769002336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffab0106ce0 0x7ffab00fff70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:27.488 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:27.483+0000 7ffab5c53700 1 --2- 172.21.15.118:0/3769002336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffab0101a80 0x7ffab01013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:27.488 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:27.483+0000 7ffab5c53700 1 --2- 172.21.15.118:0/3769002336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab01043b0 0x7ffab00ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:27.488 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:27.483+0000 7ffab5c53700 1 -- 172.21.15.118:0/3769002336 >> 172.21.15.118:0/3769002336 conn(0x7ffab00fb3f0 msgr2=0x7ffab01026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:09:27.488 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:27.483+0000 7ffab5c53700 1 -- 172.21.15.118:0/3769002336 shutdown_connections 2023-10-16T13:09:27.489 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:09:27.483+0000 7ffab5c53700 1 -- 172.21.15.118:0/3769002336 wait complete. 2023-10-16T13:09:27.989 DEBUG:teuthology.orchestra.run.smithi118:osd.7> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.7.service 2023-10-16T13:09:27.992 INFO:tasks.cephadm:Deploying osd.8 on smithi152 with /dev/vg_nvme/lv_2... 2023-10-16T13:09:27.993 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-16T13:09:28.021 INFO:journalctl@ceph.osd.7.smithi118.stdout:-- Logs begin at Mon 2023-10-16 12:50:05 UTC. -- 2023-10-16T13:09:28.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:28 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:28.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:28 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:28.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:28 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:28.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:28 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:09:28.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:28 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:28.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:28 smithi152 ceph-mon[104423]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:28.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:28 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:09:28.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:28 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:28.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:28 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:28.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:28 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:28.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:28 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:28.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:28 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:28.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:28 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:09:28.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:28 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:28.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:28 smithi092 ceph-mon[99542]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:28.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:28 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:09:28.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:28 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:28.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:28 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:28.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:28.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:28.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:28.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:09:28.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:28.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:28 smithi118 ceph-mon[103969]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:28.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:09:28.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:28.536 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:28 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:28.562 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-16T13:09:28.936 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:09:28 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:09:28.600+0000 7ff053c16640 -1 osd.7 0 log_to_monitors true 2023-10-16T13:09:29.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:29 smithi152 ceph-mon[104423]: from='osd.7 [v2:172.21.15.118:6816/3103702893,v1:172.21.15.118:6817/3103702893]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-16T13:09:29.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:29 smithi152 ceph-mon[104423]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-16T13:09:29.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:29 smithi092 ceph-mon[99542]: from='osd.7 [v2:172.21.15.118:6816/3103702893,v1:172.21.15.118:6817/3103702893]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-16T13:09:29.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:29 smithi092 ceph-mon[99542]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-16T13:09:29.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:29 smithi118 ceph-mon[103969]: from='osd.7 [v2:172.21.15.118:6816/3103702893,v1:172.21.15.118:6817/3103702893]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-16T13:09:29.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:29 smithi118 ceph-mon[103969]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-16T13:09:30.061 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-16T13:09:30.062 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-16T13:09:30.062 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2023-10-16T13:09:30.062 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2023-10-16T13:09:30.062 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111943 s, 937 MB/s 2023-10-16T13:09:30.063 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2023-10-16T13:09:30.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:30 smithi152 ceph-mon[104423]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-16T13:09:30.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:30 smithi152 ceph-mon[104423]: from='osd.7 [v2:172.21.15.118:6816/3103702893,v1:172.21.15.118:6817/3103702893]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:09:30.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:30 smithi152 ceph-mon[104423]: osdmap e49: 8 total, 7 up, 8 in 2023-10-16T13:09:30.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:30 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-16T13:09:30.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:30 smithi152 ceph-mon[104423]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:09:30.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:30 smithi152 ceph-mon[104423]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:30.483 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:09:30 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:09:30.224+0000 7ff048a8c700 -1 osd.7 0 waiting for initial osdmap 2023-10-16T13:09:30.484 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:09:30 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:09:30.236+0000 7ff04107a700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:09:30.484 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:30 smithi118 ceph-mon[103969]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-16T13:09:30.484 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:30 smithi118 ceph-mon[103969]: from='osd.7 [v2:172.21.15.118:6816/3103702893,v1:172.21.15.118:6817/3103702893]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:09:30.485 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:30 smithi118 ceph-mon[103969]: osdmap e49: 8 total, 7 up, 8 in 2023-10-16T13:09:30.485 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:30 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-16T13:09:30.485 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:30 smithi118 ceph-mon[103969]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:09:30.485 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:30 smithi118 ceph-mon[103969]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:30.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:30 smithi092 ceph-mon[99542]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-16T13:09:30.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:30 smithi092 ceph-mon[99542]: from='osd.7 [v2:172.21.15.118:6816/3103702893,v1:172.21.15.118:6817/3103702893]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:09:30.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:30 smithi092 ceph-mon[99542]: osdmap e49: 8 total, 7 up, 8 in 2023-10-16T13:09:30.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:30 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-16T13:09:30.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:30 smithi092 ceph-mon[99542]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:09:30.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:30 smithi092 ceph-mon[99542]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-16T13:09:30.507 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi152:vg_nvme/lv_2 2023-10-16T13:09:31.065 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-16T13:09:31.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:31 smithi092 ceph-mon[99542]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-16T13:09:31.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:31 smithi092 ceph-mon[99542]: osdmap e50: 8 total, 7 up, 8 in 2023-10-16T13:09:31.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:31 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-16T13:09:31.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:31 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-16T13:09:31.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:31 smithi092 ceph-mon[99542]: osd.7 [v2:172.21.15.118:6816/3103702893,v1:172.21.15.118:6817/3103702893] boot 2023-10-16T13:09:31.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:31 smithi092 ceph-mon[99542]: osdmap e51: 8 total, 8 up, 8 in 2023-10-16T13:09:31.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:31 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-16T13:09:31.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:31 smithi092 ceph-mon[99542]: Detected new or changed devices on smithi118 2023-10-16T13:09:31.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:31 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:31.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:31 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:31.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:31 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:31.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:31 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:31.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:31 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:31.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:31 smithi092 ceph-mon[99542]: Adjusting osd_memory_target on smithi118 to 5722M 2023-10-16T13:09:31.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:31 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:31.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:31 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:31.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:31 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:09:31.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:31 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:31.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:31 smithi118 ceph-mon[103969]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-16T13:09:31.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:31 smithi118 ceph-mon[103969]: osdmap e50: 8 total, 7 up, 8 in 2023-10-16T13:09:31.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:31 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-16T13:09:31.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:31 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-16T13:09:31.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:31 smithi118 ceph-mon[103969]: osd.7 [v2:172.21.15.118:6816/3103702893,v1:172.21.15.118:6817/3103702893] boot 2023-10-16T13:09:31.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:31 smithi118 ceph-mon[103969]: osdmap e51: 8 total, 8 up, 8 in 2023-10-16T13:09:31.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:31 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-16T13:09:31.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:31 smithi118 ceph-mon[103969]: Detected new or changed devices on smithi118 2023-10-16T13:09:31.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:31 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:31.536 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:31 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:31.536 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:31 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:31.536 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:31 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:31.536 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:31 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:31.537 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:31 smithi118 ceph-mon[103969]: Adjusting osd_memory_target on smithi118 to 5722M 2023-10-16T13:09:31.537 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:31 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:31.537 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:31 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:31.537 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:31 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:09:31.537 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:31 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:31.576 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:31 smithi152 ceph-mon[104423]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-16T13:09:31.576 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:31 smithi152 ceph-mon[104423]: osdmap e50: 8 total, 7 up, 8 in 2023-10-16T13:09:31.577 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:31 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-16T13:09:31.577 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:31 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-16T13:09:31.577 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:31 smithi152 ceph-mon[104423]: osd.7 [v2:172.21.15.118:6816/3103702893,v1:172.21.15.118:6817/3103702893] boot 2023-10-16T13:09:31.577 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:31 smithi152 ceph-mon[104423]: osdmap e51: 8 total, 8 up, 8 in 2023-10-16T13:09:31.577 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:31 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-16T13:09:31.578 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:31 smithi152 ceph-mon[104423]: Detected new or changed devices on smithi118 2023-10-16T13:09:31.578 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:31 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:31.578 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:31 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:31.578 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:31 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:31.579 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:31 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:31.579 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:31 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:31.579 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:31 smithi152 ceph-mon[104423]: Adjusting osd_memory_target on smithi118 to 5722M 2023-10-16T13:09:31.579 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:31 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:31.579 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:31 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:31.579 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:31 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:09:31.580 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:31 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:32.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.258+0000 7fc32944a700 1 -- 172.21.15.152:0/3153133883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc324101990 msgr2=0x7fc3241082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:09:32.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.258+0000 7fc32944a700 1 --2- 172.21.15.152:0/3153133883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc324101990 0x7fc3241082b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc31c009990 tx=0x7fc31c009ca0 comp rx=0 tx=0).stop 2023-10-16T13:09:32.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.258+0000 7fc32944a700 1 -- 172.21.15.152:0/3153133883 shutdown_connections 2023-10-16T13:09:32.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.258+0000 7fc32944a700 1 --2- 172.21.15.152:0/3153133883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc324101990 0x7fc3241082b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:32.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.258+0000 7fc32944a700 1 --2- 172.21.15.152:0/3153133883 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3240ffe70 0x7fc324100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:32.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.258+0000 7fc32944a700 1 --2- 172.21.15.152:0/3153133883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc324100fd0 0x7fc324101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:32.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.258+0000 7fc32944a700 1 -- 172.21.15.152:0/3153133883 >> 172.21.15.152:0/3153133883 conn(0x7fc3240fb3f0 msgr2=0x7fc3240fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:09:32.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.258+0000 7fc32944a700 1 -- 172.21.15.152:0/3153133883 shutdown_connections 2023-10-16T13:09:32.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.258+0000 7fc32944a700 1 -- 172.21.15.152:0/3153133883 wait complete. 2023-10-16T13:09:32.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.258+0000 7fc32944a700 1 Processor -- start 2023-10-16T13:09:32.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.259+0000 7fc32944a700 1 -- start start 2023-10-16T13:09:32.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.259+0000 7fc32944a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3240ffe70 0x7fc324198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:09:32.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.259+0000 7fc32944a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc324100fd0 0x7fc3241992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:09:32.265 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.259+0000 7fc32944a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc324101990 0x7fc3241a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:09:32.265 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.259+0000 7fc32944a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3241a08e0 con 0x7fc3240ffe70 2023-10-16T13:09:32.265 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.259+0000 7fc32944a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3241a0a20 con 0x7fc324101990 2023-10-16T13:09:32.265 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.259+0000 7fc32944a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3241a0be0 con 0x7fc324100fd0 2023-10-16T13:09:32.265 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.259+0000 7fc3227fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc324100fd0 0x7fc3241992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:09:32.266 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.259+0000 7fc3227fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc324100fd0 0x7fc3241992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45586/0 (socket says 172.21.15.152:45586) 2023-10-16T13:09:32.266 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.259+0000 7fc3227fc700 1 -- 172.21.15.152:0/69230543 learned_addr learned my addr 172.21.15.152:0/69230543 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T13:09:32.266 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.259+0000 7fc3237fe700 1 --2- 172.21.15.152:0/69230543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc324101990 0x7fc3241a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:09:32.266 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.259+0000 7fc322ffd700 1 --2- 172.21.15.152:0/69230543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3240ffe70 0x7fc324198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:09:32.266 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.259+0000 7fc3227fc700 1 -- 172.21.15.152:0/69230543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc324101990 msgr2=0x7fc3241a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:09:32.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.259+0000 7fc3227fc700 1 --2- 172.21.15.152:0/69230543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc324101990 0x7fc3241a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:32.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.259+0000 7fc3227fc700 1 -- 172.21.15.152:0/69230543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3240ffe70 msgr2=0x7fc324198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:09:32.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.259+0000 7fc3227fc700 1 --2- 172.21.15.152:0/69230543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3240ffe70 0x7fc324198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:32.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.259+0000 7fc3227fc700 1 -- 172.21.15.152:0/69230543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c0095f0 con 0x7fc324100fd0 2023-10-16T13:09:32.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.259+0000 7fc3227fc700 1 --2- 172.21.15.152:0/69230543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc324100fd0 0x7fc3241992d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00d950 tx=0x7fc30c00dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:09:32.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.259+0000 7fc31bfff700 1 -- 172.21.15.152:0/69230543 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c009940 con 0x7fc324100fd0 2023-10-16T13:09:32.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.260+0000 7fc32944a700 1 -- 172.21.15.152:0/69230543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3241a0ec0 con 0x7fc324100fd0 2023-10-16T13:09:32.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.260+0000 7fc31bfff700 1 -- 172.21.15.152:0/69230543 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc30c010460 con 0x7fc324100fd0 2023-10-16T13:09:32.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.260+0000 7fc31bfff700 1 -- 172.21.15.152:0/69230543 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c00f620 con 0x7fc324100fd0 2023-10-16T13:09:32.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.260+0000 7fc32944a700 1 -- 172.21.15.152:0/69230543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3241a1330 con 0x7fc324100fd0 2023-10-16T13:09:32.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.261+0000 7fc32944a700 1 -- 172.21.15.152:0/69230543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3241072c0 con 0x7fc324100fd0 2023-10-16T13:09:32.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.262+0000 7fc31bfff700 1 -- 172.21.15.152:0/69230543 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fc30c010960 con 0x7fc324100fd0 2023-10-16T13:09:32.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.262+0000 7fc31bfff700 1 --2- 172.21.15.152:0/69230543 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc3100a1480 0x7fc3100a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:09:32.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.262+0000 7fc31bfff700 1 -- 172.21.15.152:0/69230543 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5426+0+0 (secure 0 0 0) 0x7fc30c0cc100 con 0x7fc324100fd0 2023-10-16T13:09:32.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.263+0000 7fc322ffd700 1 --2- 172.21.15.152:0/69230543 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc3100a1480 0x7fc3100a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:09:32.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.263+0000 7fc322ffd700 1 --2- 172.21.15.152:0/69230543 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc3100a1480 0x7fc3100a3940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc32419a270 tx=0x7fc314009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:09:32.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.266+0000 7fc31bfff700 1 -- 172.21.15.152:0/69230543 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc30c096200 con 0x7fc324100fd0 2023-10-16T13:09:32.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:32.465+0000 7fc32944a700 1 -- 172.21.15.152:0/69230543 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc32402d2b0 con 0x7fc3100a1480 2023-10-16T13:09:32.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:32 smithi118 ceph-mon[103969]: purged_snaps scrub starts 2023-10-16T13:09:32.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:32 smithi118 ceph-mon[103969]: purged_snaps scrub ok 2023-10-16T13:09:32.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:32 smithi118 ceph-mon[103969]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:32.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:32 smithi118 ceph-mon[103969]: osdmap e52: 8 total, 8 up, 8 in 2023-10-16T13:09:32.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:32 smithi152 ceph-mon[104423]: purged_snaps scrub starts 2023-10-16T13:09:32.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:32 smithi152 ceph-mon[104423]: purged_snaps scrub ok 2023-10-16T13:09:32.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:32 smithi152 ceph-mon[104423]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:32.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:32 smithi152 ceph-mon[104423]: osdmap e52: 8 total, 8 up, 8 in 2023-10-16T13:09:32.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:32 smithi092 ceph-mon[99542]: purged_snaps scrub starts 2023-10-16T13:09:32.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:32 smithi092 ceph-mon[99542]: purged_snaps scrub ok 2023-10-16T13:09:32.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:32 smithi092 ceph-mon[99542]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:32.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:32 smithi092 ceph-mon[99542]: osdmap e52: 8 total, 8 up, 8 in 2023-10-16T13:09:33.534 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:33 smithi152 ceph-mon[104423]: osdmap e53: 8 total, 8 up, 8 in 2023-10-16T13:09:33.535 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:33 smithi152 ceph-mon[104423]: from='client.24274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:09:33.535 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:33 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:09:33.536 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:33 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:09:33.536 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:33 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:33.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:33 smithi092 ceph-mon[99542]: osdmap e53: 8 total, 8 up, 8 in 2023-10-16T13:09:33.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:33 smithi092 ceph-mon[99542]: from='client.24274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:09:33.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:33 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:09:33.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:33 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:09:33.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:33 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:33.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:33 smithi118 ceph-mon[103969]: osdmap e53: 8 total, 8 up, 8 in 2023-10-16T13:09:33.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:33 smithi118 ceph-mon[103969]: from='client.24274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:09:33.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:33 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:09:33.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:33 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:09:33.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:33 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:34.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:34 smithi152 ceph-mon[104423]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:34.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:34 smithi152 ceph-mon[104423]: osdmap e54: 8 total, 8 up, 8 in 2023-10-16T13:09:34.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:34 smithi092 ceph-mon[99542]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:34.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:34 smithi092 ceph-mon[99542]: osdmap e54: 8 total, 8 up, 8 in 2023-10-16T13:09:34.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:34 smithi118 ceph-mon[103969]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:34.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:34 smithi118 ceph-mon[103969]: osdmap e54: 8 total, 8 up, 8 in 2023-10-16T13:09:35.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:35 smithi152 ceph-mon[104423]: osdmap e55: 8 total, 8 up, 8 in 2023-10-16T13:09:35.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:35 smithi152 ceph-mon[104423]: from='client.? 172.21.15.152:0/3692078608' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ee11b20-7519-44ad-aa47-53df8dea3a75"}]: dispatch 2023-10-16T13:09:35.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:35 smithi152 ceph-mon[104423]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ee11b20-7519-44ad-aa47-53df8dea3a75"}]: dispatch 2023-10-16T13:09:35.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:35 smithi152 ceph-mon[104423]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ee11b20-7519-44ad-aa47-53df8dea3a75"}]': finished 2023-10-16T13:09:35.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:35 smithi152 ceph-mon[104423]: osdmap e56: 9 total, 8 up, 9 in 2023-10-16T13:09:35.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-16T13:09:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:35 smithi092 ceph-mon[99542]: osdmap e55: 8 total, 8 up, 8 in 2023-10-16T13:09:35.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:35 smithi092 ceph-mon[99542]: from='client.? 172.21.15.152:0/3692078608' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ee11b20-7519-44ad-aa47-53df8dea3a75"}]: dispatch 2023-10-16T13:09:35.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:35 smithi092 ceph-mon[99542]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ee11b20-7519-44ad-aa47-53df8dea3a75"}]: dispatch 2023-10-16T13:09:35.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:35 smithi092 ceph-mon[99542]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ee11b20-7519-44ad-aa47-53df8dea3a75"}]': finished 2023-10-16T13:09:35.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:35 smithi092 ceph-mon[99542]: osdmap e56: 9 total, 8 up, 9 in 2023-10-16T13:09:35.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-16T13:09:35.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:35 smithi118 ceph-mon[103969]: osdmap e55: 8 total, 8 up, 8 in 2023-10-16T13:09:35.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:35 smithi118 ceph-mon[103969]: from='client.? 172.21.15.152:0/3692078608' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ee11b20-7519-44ad-aa47-53df8dea3a75"}]: dispatch 2023-10-16T13:09:35.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:35 smithi118 ceph-mon[103969]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ee11b20-7519-44ad-aa47-53df8dea3a75"}]: dispatch 2023-10-16T13:09:35.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:35 smithi118 ceph-mon[103969]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ee11b20-7519-44ad-aa47-53df8dea3a75"}]': finished 2023-10-16T13:09:35.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:35 smithi118 ceph-mon[103969]: osdmap e56: 9 total, 8 up, 9 in 2023-10-16T13:09:35.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-16T13:09:36.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:36 smithi152 ceph-mon[104423]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:36.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:36 smithi152 ceph-mon[104423]: from='client.? 172.21.15.152:0/2803831920' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:09:36.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:36 smithi092 ceph-mon[99542]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:36.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:36 smithi092 ceph-mon[99542]: from='client.? 172.21.15.152:0/2803831920' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:09:36.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:36 smithi118 ceph-mon[103969]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:36.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:36 smithi118 ceph-mon[103969]: from='client.? 172.21.15.152:0/2803831920' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:09:38.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:38 smithi152 ceph-mon[104423]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:38.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:38 smithi092 ceph-mon[99542]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:38.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:38 smithi118 ceph-mon[103969]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:40.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:40 smithi152 ceph-mon[104423]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:40.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:40 smithi092 ceph-mon[99542]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:40.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:40 smithi118 ceph-mon[103969]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:42.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:42 smithi152 ceph-mon[104423]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:42.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:42 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-16T13:09:42.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:42 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:42.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:42 smithi152 ceph-mon[104423]: Deploying daemon osd.8 on smithi152 2023-10-16T13:09:42.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:42 smithi092 ceph-mon[99542]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:42.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:42 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-16T13:09:42.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:42 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:42.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:42 smithi092 ceph-mon[99542]: Deploying daemon osd.8 on smithi152 2023-10-16T13:09:42.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:42 smithi118 ceph-mon[103969]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:42.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:42 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-16T13:09:42.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:42 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:42.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:42 smithi118 ceph-mon[103969]: Deploying daemon osd.8 on smithi152 2023-10-16T13:09:44.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:44 smithi152 ceph-mon[104423]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:44 smithi092 ceph-mon[99542]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:44.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:44 smithi118 ceph-mon[103969]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:46.638 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:46 smithi152 ceph-mon[104423]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:46.639 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:46.639 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:46.639 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:09:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:46 smithi092 ceph-mon[99542]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:09:46.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:46 smithi118 ceph-mon[103969]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:46.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:46.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:46.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:09:48.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:48.423+0000 7fc31bfff700 1 -- 172.21.15.152:0/69230543 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc32402d2b0 con 0x7fc3100a1480 2023-10-16T13:09:48.425 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 8 on host 'smithi152' 2023-10-16T13:09:48.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:48.425+0000 7fc32944a700 1 -- 172.21.15.152:0/69230543 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc3100a1480 msgr2=0x7fc3100a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:09:48.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:48.425+0000 7fc32944a700 1 --2- 172.21.15.152:0/69230543 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc3100a1480 0x7fc3100a3940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc32419a270 tx=0x7fc314009210 comp rx=0 tx=0).stop 2023-10-16T13:09:48.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:48.425+0000 7fc32944a700 1 -- 172.21.15.152:0/69230543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc324100fd0 msgr2=0x7fc3241992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:09:48.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:48.425+0000 7fc32944a700 1 --2- 172.21.15.152:0/69230543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc324100fd0 0x7fc3241992d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00d950 tx=0x7fc30c00dc60 comp rx=0 tx=0).stop 2023-10-16T13:09:48.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:48.425+0000 7fc32944a700 1 -- 172.21.15.152:0/69230543 shutdown_connections 2023-10-16T13:09:48.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:48.425+0000 7fc32944a700 1 --2- 172.21.15.152:0/69230543 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc3100a1480 0x7fc3100a3940 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:48.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:48.425+0000 7fc32944a700 1 --2- 172.21.15.152:0/69230543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3240ffe70 0x7fc324198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:48.429 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:48.425+0000 7fc32944a700 1 --2- 172.21.15.152:0/69230543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc324101990 0x7fc3241a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:48.429 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:48.425+0000 7fc32944a700 1 --2- 172.21.15.152:0/69230543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc324100fd0 0x7fc3241992d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:48.429 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:48.425+0000 7fc32944a700 1 -- 172.21.15.152:0/69230543 >> 172.21.15.152:0/69230543 conn(0x7fc3240fb3f0 msgr2=0x7fc324104400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:09:48.429 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:48.425+0000 7fc32944a700 1 -- 172.21.15.152:0/69230543 shutdown_connections 2023-10-16T13:09:48.429 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:09:48.425+0000 7fc32944a700 1 -- 172.21.15.152:0/69230543 wait complete. 2023-10-16T13:09:48.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:48 smithi152 ceph-mon[104423]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:48.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:48 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:48.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:48 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:48.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:48 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:48.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:48 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:09:48.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:48 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:48.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:48 smithi092 ceph-mon[99542]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:48.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:48 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:48.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:48 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:48.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:48 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:48.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:48 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:09:48.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:48 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:48.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:48 smithi118 ceph-mon[103969]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:48.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:48 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:48.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:48 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:48.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:48 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:48.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:48 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:09:48.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:48 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:48.841 DEBUG:teuthology.orchestra.run.smithi152:osd.8> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.8.service 2023-10-16T13:09:48.843 INFO:tasks.cephadm:Deploying osd.9 on smithi092 with /dev/vg_nvme/lv_1... 2023-10-16T13:09:48.844 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-16T13:09:48.874 INFO:journalctl@ceph.osd.8.smithi152.stdout:-- Logs begin at Mon 2023-10-16 12:49:44 UTC. -- 2023-10-16T13:09:49.419 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:09:49.584 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:49 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:49.585 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:49 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:49.585 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:49 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:09:49.679 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:49 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:49.680 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:49 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:49.680 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:49 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:09:49.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:49 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:49.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:49 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:49.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:49 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:09:49.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:09:49 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:09:49.761+0000 7f4486498640 -1 osd.8 0 log_to_monitors true 2023-10-16T13:09:50.524 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:50 smithi092 ceph-mon[99542]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:50.524 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:50 smithi092 ceph-mon[99542]: from='osd.8 [v2:172.21.15.152:6816/3968044260,v1:172.21.15.152:6817/3968044260]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-16T13:09:50.524 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:50 smithi092 ceph-mon[99542]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-16T13:09:50.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:50 smithi152 ceph-mon[104423]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:50.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:50 smithi152 ceph-mon[104423]: from='osd.8 [v2:172.21.15.152:6816/3968044260,v1:172.21.15.152:6817/3968044260]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-16T13:09:50.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:50 smithi152 ceph-mon[104423]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-16T13:09:50.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:50 smithi118 ceph-mon[103969]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:50.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:50 smithi118 ceph-mon[103969]: from='osd.8 [v2:172.21.15.152:6816/3968044260,v1:172.21.15.152:6817/3968044260]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-16T13:09:50.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:50 smithi118 ceph-mon[103969]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-16T13:09:51.052 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-16T13:09:51.052 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-16T13:09:51.053 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2023-10-16T13:09:51.053 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2023-10-16T13:09:51.053 INFO:teuthology.orchestra.run.smithi092.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0154508 s, 679 MB/s 2023-10-16T13:09:51.053 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 2023-10-16T13:09:51.053 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2023-10-16T13:09:51.463 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi092:vg_nvme/lv_1 2023-10-16T13:09:51.692 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:09:51 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:09:51.399+0000 7f447b30e700 -1 osd.8 0 waiting for initial osdmap 2023-10-16T13:09:51.693 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:09:51 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:09:51.413+0000 7f44740fd700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:09:51.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:51 smithi152 ceph-mon[104423]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-16T13:09:51.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:51 smithi152 ceph-mon[104423]: osdmap e57: 9 total, 8 up, 9 in 2023-10-16T13:09:51.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:51 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-16T13:09:51.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:51 smithi152 ceph-mon[104423]: from='osd.8 [v2:172.21.15.152:6816/3968044260,v1:172.21.15.152:6817/3968044260]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:09:51.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:51 smithi152 ceph-mon[104423]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:09:51.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:51 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:51.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:51 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:51.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:51 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:51.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:51 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:51.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:51 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:51.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:51 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:51.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:51 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:51.696 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:51 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:09:51.696 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:51 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:51.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:51 smithi092 ceph-mon[99542]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-16T13:09:51.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:51 smithi092 ceph-mon[99542]: osdmap e57: 9 total, 8 up, 9 in 2023-10-16T13:09:51.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:51 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-16T13:09:51.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:51 smithi092 ceph-mon[99542]: from='osd.8 [v2:172.21.15.152:6816/3968044260,v1:172.21.15.152:6817/3968044260]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:09:51.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:51 smithi092 ceph-mon[99542]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:09:51.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:51 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:51.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:51 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:51.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:51 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:51.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:51 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:51.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:51 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:51.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:51 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:51.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:51 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:51.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:51 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:09:51.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:51 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:51.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:51 smithi118 ceph-mon[103969]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-16T13:09:51.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:51 smithi118 ceph-mon[103969]: osdmap e57: 9 total, 8 up, 9 in 2023-10-16T13:09:51.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:51 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-16T13:09:51.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:51 smithi118 ceph-mon[103969]: from='osd.8 [v2:172.21.15.152:6816/3968044260,v1:172.21.15.152:6817/3968044260]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:09:51.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:51 smithi118 ceph-mon[103969]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:09:51.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:51 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:51.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:51 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:51.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:51 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:51.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:51 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:51.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:51 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:09:51.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:51 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:51.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:51 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:51.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:51 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:09:51.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:51 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:09:52.017 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:09:52.581 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:52 smithi092 ceph-mon[99542]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:52.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:52 smithi092 ceph-mon[99542]: Detected new or changed devices on smithi152 2023-10-16T13:09:52.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:52 smithi092 ceph-mon[99542]: Adjusting osd_memory_target on smithi152 to 5722M 2023-10-16T13:09:52.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:52 smithi092 ceph-mon[99542]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-10-16T13:09:52.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:52 smithi092 ceph-mon[99542]: osdmap e58: 9 total, 8 up, 9 in 2023-10-16T13:09:52.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:52 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-16T13:09:52.583 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:52 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-16T13:09:52.583 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:52 smithi092 ceph-mon[99542]: osd.8 [v2:172.21.15.152:6816/3968044260,v1:172.21.15.152:6817/3968044260] boot 2023-10-16T13:09:52.583 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:52 smithi092 ceph-mon[99542]: osdmap e59: 9 total, 9 up, 9 in 2023-10-16T13:09:52.583 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:52 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-16T13:09:52.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:52 smithi152 ceph-mon[104423]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:52.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:52 smithi152 ceph-mon[104423]: Detected new or changed devices on smithi152 2023-10-16T13:09:52.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:52 smithi152 ceph-mon[104423]: Adjusting osd_memory_target on smithi152 to 5722M 2023-10-16T13:09:52.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:52 smithi152 ceph-mon[104423]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-10-16T13:09:52.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:52 smithi152 ceph-mon[104423]: osdmap e58: 9 total, 8 up, 9 in 2023-10-16T13:09:52.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:52 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-16T13:09:52.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:52 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-16T13:09:52.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:52 smithi152 ceph-mon[104423]: osd.8 [v2:172.21.15.152:6816/3968044260,v1:172.21.15.152:6817/3968044260] boot 2023-10-16T13:09:52.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:52 smithi152 ceph-mon[104423]: osdmap e59: 9 total, 9 up, 9 in 2023-10-16T13:09:52.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:52 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-16T13:09:52.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:52 smithi118 ceph-mon[103969]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-16T13:09:52.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:52 smithi118 ceph-mon[103969]: Detected new or changed devices on smithi152 2023-10-16T13:09:52.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:52 smithi118 ceph-mon[103969]: Adjusting osd_memory_target on smithi152 to 5722M 2023-10-16T13:09:52.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:52 smithi118 ceph-mon[103969]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-10-16T13:09:52.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:52 smithi118 ceph-mon[103969]: osdmap e58: 9 total, 8 up, 9 in 2023-10-16T13:09:52.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:52 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-16T13:09:52.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:52 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-16T13:09:52.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:52 smithi118 ceph-mon[103969]: osd.8 [v2:172.21.15.152:6816/3968044260,v1:172.21.15.152:6817/3968044260] boot 2023-10-16T13:09:52.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:52 smithi118 ceph-mon[103969]: osdmap e59: 9 total, 9 up, 9 in 2023-10-16T13:09:52.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:52 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-16T13:09:53.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.360+0000 7f64b1f70700 1 -- 172.21.15.92:0/2644643643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64ac102210 msgr2=0x7f64ac102670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:09:53.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.360+0000 7f64b1f70700 1 --2- 172.21.15.92:0/2644643643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64ac102210 0x7f64ac102670 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009990 tx=0x7f64a0009ca0 comp rx=0 tx=0).stop 2023-10-16T13:09:53.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.360+0000 7f64b1f70700 1 -- 172.21.15.92:0/2644643643 shutdown_connections 2023-10-16T13:09:53.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.360+0000 7f64b1f70700 1 --2- 172.21.15.92:0/2644643643 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64ac102bb0 0x7f64ac109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:53.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.360+0000 7f64b1f70700 1 --2- 172.21.15.92:0/2644643643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64ac0ff230 0x7f64ac0ff650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:53.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.360+0000 7f64b1f70700 1 --2- 172.21.15.92:0/2644643643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64ac102210 0x7f64ac102670 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:53.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.360+0000 7f64b1f70700 1 -- 172.21.15.92:0/2644643643 >> 172.21.15.92:0/2644643643 conn(0x7f64ac0fab70 msgr2=0x7f64ac0fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:09:53.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.360+0000 7f64b1f70700 1 -- 172.21.15.92:0/2644643643 shutdown_connections 2023-10-16T13:09:53.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.360+0000 7f64b1f70700 1 -- 172.21.15.92:0/2644643643 wait complete. 2023-10-16T13:09:53.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.360+0000 7f64b1f70700 1 Processor -- start 2023-10-16T13:09:53.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64b1f70700 1 -- start start 2023-10-16T13:09:53.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64b1f70700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64ac0ff230 0x7f64ac101b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:09:53.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64b1f70700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64ac102210 0x7f64ac1001c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:09:53.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64b1f70700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64ac102bb0 0x7f64ac100700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:09:53.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64b1f70700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac100e80 con 0x7f64ac102bb0 2023-10-16T13:09:53.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64b1f70700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac100ff0 con 0x7f64ac102210 2023-10-16T13:09:53.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64b1f70700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac1a0d40 con 0x7f64ac0ff230 2023-10-16T13:09:53.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64abfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64ac102bb0 0x7f64ac100700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:09:53.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64abfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64ac102bb0 0x7f64ac100700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34650/0 (socket says 172.21.15.92:34650) 2023-10-16T13:09:53.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64abfff700 1 -- 172.21.15.92:0/3636216951 learned_addr learned my addr 172.21.15.92:0/3636216951 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:09:53.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64aaffd700 1 --2- 172.21.15.92:0/3636216951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64ac102210 0x7f64ac1001c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:09:53.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64ab7fe700 1 --2- 172.21.15.92:0/3636216951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64ac0ff230 0x7f64ac101b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:09:53.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64abfff700 1 -- 172.21.15.92:0/3636216951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64ac0ff230 msgr2=0x7f64ac101b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:09:53.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64abfff700 1 --2- 172.21.15.92:0/3636216951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64ac0ff230 0x7f64ac101b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:53.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64abfff700 1 -- 172.21.15.92:0/3636216951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64ac102210 msgr2=0x7f64ac1001c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:09:53.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64abfff700 1 --2- 172.21.15.92:0/3636216951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64ac102210 0x7f64ac1001c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:09:53.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64abfff700 1 -- 172.21.15.92:0/3636216951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a00095f0 con 0x7f64ac102bb0 2023-10-16T13:09:53.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64abfff700 1 --2- 172.21.15.92:0/3636216951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64ac102bb0 0x7f64ac100700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f64a400ef30 tx=0x7f64a400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:09:53.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64a8ff9700 1 -- 172.21.15.92:0/3636216951 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a4018070 con 0x7f64ac102bb0 2023-10-16T13:09:53.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64a8ff9700 1 -- 172.21.15.92:0/3636216951 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f64a400f040 con 0x7f64ac102bb0 2023-10-16T13:09:53.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64b1f70700 1 -- 172.21.15.92:0/3636216951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ac1a0fc0 con 0x7f64ac102bb0 2023-10-16T13:09:53.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64a8ff9700 1 -- 172.21.15.92:0/3636216951 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a400ce00 con 0x7f64ac102bb0 2023-10-16T13:09:53.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.361+0000 7f64b1f70700 1 -- 172.21.15.92:0/3636216951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ac1a13e0 con 0x7f64ac102bb0 2023-10-16T13:09:53.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.362+0000 7f64b1f70700 1 -- 172.21.15.92:0/3636216951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ac10c8b0 con 0x7f64ac102bb0 2023-10-16T13:09:53.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.364+0000 7f64a8ff9700 1 -- 172.21.15.92:0/3636216951 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f64a4003a00 con 0x7f64ac102bb0 2023-10-16T13:09:53.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.364+0000 7f64a8ff9700 1 --2- 172.21.15.92:0/3636216951 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f64940a1480 0x7f64940a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:09:53.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.364+0000 7f64ab7fe700 1 --2- 172.21.15.92:0/3636216951 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f64940a1480 0x7f64940a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:09:53.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.364+0000 7f64a8ff9700 1 -- 172.21.15.92:0/3636216951 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5862+0+0 (secure 0 0 0) 0x7f64a40cc8f0 con 0x7f64ac102bb0 2023-10-16T13:09:53.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.365+0000 7f64ab7fe700 1 --2- 172.21.15.92:0/3636216951 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f64940a1480 0x7f64940a3940 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0687a0 tx=0x7f649c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:09:53.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.368+0000 7f64a8ff9700 1 -- 172.21.15.92:0/3636216951 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f64a4096970 con 0x7f64ac102bb0 2023-10-16T13:09:53.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:09:53.569+0000 7f64b1f70700 1 -- 172.21.15.92:0/3636216951 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f64ac0612f0 con 0x7f64940a1480 2023-10-16T13:09:53.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:53 smithi152 ceph-mon[104423]: purged_snaps scrub starts 2023-10-16T13:09:53.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:53 smithi152 ceph-mon[104423]: purged_snaps scrub ok 2023-10-16T13:09:53.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:53 smithi152 ceph-mon[104423]: osdmap e60: 9 total, 9 up, 9 in 2023-10-16T13:09:53.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:53 smithi092 ceph-mon[99542]: purged_snaps scrub starts 2023-10-16T13:09:53.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:53 smithi092 ceph-mon[99542]: purged_snaps scrub ok 2023-10-16T13:09:53.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:53 smithi092 ceph-mon[99542]: osdmap e60: 9 total, 9 up, 9 in 2023-10-16T13:09:53.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:53 smithi118 ceph-mon[103969]: purged_snaps scrub starts 2023-10-16T13:09:53.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:53 smithi118 ceph-mon[103969]: purged_snaps scrub ok 2023-10-16T13:09:53.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:53 smithi118 ceph-mon[103969]: osdmap e60: 9 total, 9 up, 9 in 2023-10-16T13:09:54.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:54 smithi152 ceph-mon[104423]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-16T13:09:54.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:54 smithi152 ceph-mon[104423]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:09:54.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:54 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:09:54.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:54 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:09:54.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:54 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:54.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:54 smithi152 ceph-mon[104423]: osdmap e61: 9 total, 9 up, 9 in 2023-10-16T13:09:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:54 smithi092 ceph-mon[99542]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-16T13:09:54.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:54 smithi092 ceph-mon[99542]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:09:54.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:54 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:09:54.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:54 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:09:54.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:54 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:54.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:54 smithi092 ceph-mon[99542]: osdmap e61: 9 total, 9 up, 9 in 2023-10-16T13:09:54.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:54 smithi118 ceph-mon[103969]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-16T13:09:54.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:54 smithi118 ceph-mon[103969]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:09:54.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:54 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:09:54.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:54 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:09:54.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:54 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:09:54.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:54 smithi118 ceph-mon[103969]: osdmap e61: 9 total, 9 up, 9 in 2023-10-16T13:09:56.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:56 smithi118 ceph-mon[103969]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-16T13:09:56.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:56 smithi118 ceph-mon[103969]: osdmap e62: 9 total, 9 up, 9 in 2023-10-16T13:09:56.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:56 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3293748082' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf985086-cb42-4def-9d17-317345e66f85"}]: dispatch 2023-10-16T13:09:56.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:56 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3293748082' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf985086-cb42-4def-9d17-317345e66f85"}]': finished 2023-10-16T13:09:56.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:56 smithi118 ceph-mon[103969]: osdmap e63: 10 total, 9 up, 10 in 2023-10-16T13:09:56.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:56 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-16T13:09:56.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:56 smithi152 ceph-mon[104423]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-16T13:09:56.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:56 smithi152 ceph-mon[104423]: osdmap e62: 9 total, 9 up, 9 in 2023-10-16T13:09:56.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:56 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3293748082' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf985086-cb42-4def-9d17-317345e66f85"}]: dispatch 2023-10-16T13:09:56.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:56 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3293748082' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf985086-cb42-4def-9d17-317345e66f85"}]': finished 2023-10-16T13:09:56.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:56 smithi152 ceph-mon[104423]: osdmap e63: 10 total, 9 up, 10 in 2023-10-16T13:09:56.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:56 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-16T13:09:56.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:56 smithi092 ceph-mon[99542]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-16T13:09:56.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:56 smithi092 ceph-mon[99542]: osdmap e62: 9 total, 9 up, 9 in 2023-10-16T13:09:56.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:56 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3293748082' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf985086-cb42-4def-9d17-317345e66f85"}]: dispatch 2023-10-16T13:09:56.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:56 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3293748082' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf985086-cb42-4def-9d17-317345e66f85"}]': finished 2023-10-16T13:09:56.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:56 smithi092 ceph-mon[99542]: osdmap e63: 10 total, 9 up, 10 in 2023-10-16T13:09:56.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:56 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-16T13:09:57.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:57 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/996286759' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:09:57.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:57 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/996286759' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:09:57.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:57 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/996286759' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:09:58.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:09:58 smithi118 ceph-mon[103969]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-16T13:09:58.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:09:58 smithi152 ceph-mon[104423]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-16T13:09:58.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:09:58 smithi092 ceph-mon[99542]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-16T13:10:00.426 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:00 smithi092 ceph-mon[99542]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2023-10-16T13:10:00.426 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:00 smithi092 ceph-mon[99542]: overall HEALTH_OK 2023-10-16T13:10:00.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:00 smithi118 ceph-mon[103969]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2023-10-16T13:10:00.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:00 smithi118 ceph-mon[103969]: overall HEALTH_OK 2023-10-16T13:10:00.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:00 smithi152 ceph-mon[104423]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2023-10-16T13:10:00.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:00 smithi152 ceph-mon[104423]: overall HEALTH_OK 2023-10-16T13:10:02.570 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:02 smithi092 ceph-mon[99542]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2023-10-16T13:10:02.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:02 smithi152 ceph-mon[104423]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2023-10-16T13:10:02.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:02 smithi118 ceph-mon[103969]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2023-10-16T13:10:03.593 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:03 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-16T13:10:03.594 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:03 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:03.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:03 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-16T13:10:03.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:03 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:03.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:03 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-16T13:10:03.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:03 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:04.418 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:04 smithi092 ceph-mon[99542]: Deploying daemon osd.9 on smithi092 2023-10-16T13:10:04.418 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:04 smithi092 ceph-mon[99542]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-16T13:10:04.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:04 smithi152 ceph-mon[104423]: Deploying daemon osd.9 on smithi092 2023-10-16T13:10:04.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:04 smithi152 ceph-mon[104423]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-16T13:10:04.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:04 smithi118 ceph-mon[103969]: Deploying daemon osd.9 on smithi092 2023-10-16T13:10:04.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:04 smithi118 ceph-mon[103969]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-16T13:10:06.579 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:06 smithi092 ceph-mon[99542]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-16T13:10:06.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:06 smithi152 ceph-mon[104423]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-16T13:10:06.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:06 smithi118 ceph-mon[103969]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-16T13:10:08.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:08 smithi092 ceph-mon[99542]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2023-10-16T13:10:08.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:08 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:08.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:08 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:08.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:08 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:10:08.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:08 smithi118 ceph-mon[103969]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2023-10-16T13:10:08.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:08 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:08.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:08 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:08.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:08 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:10:08.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:08 smithi152 ceph-mon[104423]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2023-10-16T13:10:08.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:08 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:08.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:08 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:08.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:08 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:10:10.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:10.470+0000 7f64a8ff9700 1 -- 172.21.15.92:0/3636216951 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f64ac0612f0 con 0x7f64940a1480 2023-10-16T13:10:10.473 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 9 on host 'smithi092' 2023-10-16T13:10:10.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:10.472+0000 7f64b1f70700 1 -- 172.21.15.92:0/3636216951 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f64940a1480 msgr2=0x7f64940a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:10.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:10.472+0000 7f64b1f70700 1 --2- 172.21.15.92:0/3636216951 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f64940a1480 0x7f64940a3940 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0687a0 tx=0x7f649c009260 comp rx=0 tx=0).stop 2023-10-16T13:10:10.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:10.472+0000 7f64b1f70700 1 -- 172.21.15.92:0/3636216951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64ac102bb0 msgr2=0x7f64ac100700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:10.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:10.472+0000 7f64b1f70700 1 --2- 172.21.15.92:0/3636216951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64ac102bb0 0x7f64ac100700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f64a400ef30 tx=0x7f64a400c3a0 comp rx=0 tx=0).stop 2023-10-16T13:10:10.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:10.472+0000 7f64b1f70700 1 -- 172.21.15.92:0/3636216951 shutdown_connections 2023-10-16T13:10:10.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:10.472+0000 7f64b1f70700 1 --2- 172.21.15.92:0/3636216951 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f64940a1480 0x7f64940a3940 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:10.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:10.472+0000 7f64b1f70700 1 --2- 172.21.15.92:0/3636216951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64ac102bb0 0x7f64ac100700 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:10.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:10.472+0000 7f64b1f70700 1 --2- 172.21.15.92:0/3636216951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64ac0ff230 0x7f64ac101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:10.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:10.472+0000 7f64b1f70700 1 --2- 172.21.15.92:0/3636216951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64ac102210 0x7f64ac1001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:10.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:10.472+0000 7f64b1f70700 1 -- 172.21.15.92:0/3636216951 >> 172.21.15.92:0/3636216951 conn(0x7f64ac0fab70 msgr2=0x7f64ac0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:10:10.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:10.472+0000 7f64b1f70700 1 -- 172.21.15.92:0/3636216951 shutdown_connections 2023-10-16T13:10:10.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:10.473+0000 7f64b1f70700 1 -- 172.21.15.92:0/3636216951 wait complete. 2023-10-16T13:10:10.627 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:10 smithi092 ceph-mon[99542]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-16T13:10:10.628 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:10 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:10.628 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:10 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:10.628 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:10 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:10.628 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:10 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:10:10.629 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:10 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:10.629 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:10 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:10.629 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:10 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:10.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:10 smithi118 ceph-mon[103969]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-16T13:10:10.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:10 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:10.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:10 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:10.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:10 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:10.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:10 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:10:10.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:10 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:10.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:10 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:10.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:10 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:10.909 DEBUG:teuthology.orchestra.run.smithi092:osd.9> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.9.service 2023-10-16T13:10:10.912 INFO:tasks.cephadm:Deploying osd.10 on smithi118 with /dev/vg_nvme/lv_1... 2023-10-16T13:10:10.912 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-16T13:10:10.943 INFO:journalctl@ceph.osd.9.smithi092.stdout:-- Logs begin at Mon 2023-10-16 12:49:18 UTC. -- 2023-10-16T13:10:10.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:10 smithi152 ceph-mon[104423]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-16T13:10:10.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:10 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:10.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:10 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:10.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:10 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:10.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:10 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:10:10.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:10 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:10.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:10 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:10.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:10 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:11.483 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-16T13:10:11.635 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:11 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:10:11.635 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:11 smithi092 ceph-mon[99542]: from='osd.9 [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-16T13:10:11.636 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:10:11 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:10:11.337+0000 7f6949b96640 -1 osd.9 0 log_to_monitors true 2023-10-16T13:10:11.744 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:11 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:10:11.744 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:11 smithi118 ceph-mon[103969]: from='osd.9 [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-16T13:10:11.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:11 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:10:11.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:11 smithi152 ceph-mon[104423]: from='osd.9 [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-16T13:10:12.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:12 smithi092 ceph-mon[99542]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-16T13:10:12.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:12 smithi092 ceph-mon[99542]: from='osd.9 [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-16T13:10:12.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:12 smithi092 ceph-mon[99542]: osdmap e64: 10 total, 9 up, 10 in 2023-10-16T13:10:12.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:12 smithi092 ceph-mon[99542]: from='osd.9 [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-16T13:10:12.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:12 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-16T13:10:12.499 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:10:12 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:10:12.477+0000 7f694020f700 -1 osd.9 0 waiting for initial osdmap 2023-10-16T13:10:12.585 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:12 smithi118 ceph-mon[103969]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-16T13:10:12.585 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:12 smithi118 ceph-mon[103969]: from='osd.9 [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-16T13:10:12.585 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:12 smithi118 ceph-mon[103969]: osdmap e64: 10 total, 9 up, 10 in 2023-10-16T13:10:12.586 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:12 smithi118 ceph-mon[103969]: from='osd.9 [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-16T13:10:12.586 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:12 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-16T13:10:12.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:12 smithi152 ceph-mon[104423]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-16T13:10:12.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:12 smithi152 ceph-mon[104423]: from='osd.9 [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-16T13:10:12.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:12 smithi152 ceph-mon[104423]: osdmap e64: 10 total, 9 up, 10 in 2023-10-16T13:10:12.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:12 smithi152 ceph-mon[104423]: from='osd.9 [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-16T13:10:12.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:12 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-16T13:10:12.996 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:10:12 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:10:12.496+0000 7f69387fd700 -1 osd.9 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:10:13.089 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-16T13:10:13.090 INFO:teuthology.orchestra.run.smithi118.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-16T13:10:13.090 INFO:teuthology.orchestra.run.smithi118.stderr: stderr: 10+0 records in 2023-10-16T13:10:13.090 INFO:teuthology.orchestra.run.smithi118.stderr:10+0 records out 2023-10-16T13:10:13.090 INFO:teuthology.orchestra.run.smithi118.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124532 s, 842 MB/s 2023-10-16T13:10:13.090 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping successful for: 2023-10-16T13:10:13.537 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi118:vg_nvme/lv_1 2023-10-16T13:10:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:13 smithi092 ceph-mon[99542]: from='osd.9 [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-16T13:10:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:13 smithi092 ceph-mon[99542]: osdmap e65: 10 total, 9 up, 10 in 2023-10-16T13:10:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:13 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-16T13:10:13.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:13 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-16T13:10:13.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:13 smithi118 ceph-mon[103969]: from='osd.9 [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-16T13:10:13.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:13 smithi118 ceph-mon[103969]: osdmap e65: 10 total, 9 up, 10 in 2023-10-16T13:10:13.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:13 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-16T13:10:13.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:13 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-16T13:10:13.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:13 smithi152 ceph-mon[104423]: from='osd.9 [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-16T13:10:13.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:13 smithi152 ceph-mon[104423]: osdmap e65: 10 total, 9 up, 10 in 2023-10-16T13:10:13.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:13 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-16T13:10:13.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:13 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-16T13:10:14.095 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-16T13:10:14.636 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:14 smithi118 ceph-mon[103969]: purged_snaps scrub starts 2023-10-16T13:10:14.636 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:14 smithi118 ceph-mon[103969]: purged_snaps scrub ok 2023-10-16T13:10:14.637 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:14 smithi118 ceph-mon[103969]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-16T13:10:14.637 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:14 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-16T13:10:14.637 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:14 smithi118 ceph-mon[103969]: osd.9 [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271] boot 2023-10-16T13:10:14.637 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:14 smithi118 ceph-mon[103969]: osdmap e66: 10 total, 10 up, 10 in 2023-10-16T13:10:14.637 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:14 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-16T13:10:14.638 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:14 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:14.638 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:14 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:14.638 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:14 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:14.638 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:14 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:14.638 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:14 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:14.639 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:14 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:14.639 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:14 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:14.639 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:14 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:14.639 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:14 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:10:14.639 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:14 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:14 smithi092 ceph-mon[99542]: purged_snaps scrub starts 2023-10-16T13:10:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:14 smithi092 ceph-mon[99542]: purged_snaps scrub ok 2023-10-16T13:10:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:14 smithi092 ceph-mon[99542]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-16T13:10:14.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:14 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-16T13:10:14.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:14 smithi092 ceph-mon[99542]: osd.9 [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271] boot 2023-10-16T13:10:14.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:14 smithi092 ceph-mon[99542]: osdmap e66: 10 total, 10 up, 10 in 2023-10-16T13:10:14.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:14 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-16T13:10:14.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:14 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:14.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:14 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:14.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:14 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:14.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:14 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:14.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:14 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:14.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:14 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:14.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:14 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:14.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:14 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:14.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:14 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:10:14.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:14 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:14.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:14 smithi152 ceph-mon[104423]: purged_snaps scrub starts 2023-10-16T13:10:14.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:14 smithi152 ceph-mon[104423]: purged_snaps scrub ok 2023-10-16T13:10:14.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:14 smithi152 ceph-mon[104423]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-16T13:10:14.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:14 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-16T13:10:14.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:14 smithi152 ceph-mon[104423]: osd.9 [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271] boot 2023-10-16T13:10:14.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:14 smithi152 ceph-mon[104423]: osdmap e66: 10 total, 10 up, 10 in 2023-10-16T13:10:14.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:14 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-16T13:10:14.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:14 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:14.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:14 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:14.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:14 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:14.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:14 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:14.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:14 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:14.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:14 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:14.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:14 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:14.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:14 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:14.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:14 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:10:14.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:14 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:15.443 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.441+0000 7f514b8cc700 1 -- 172.21.15.118:0/3008922479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5144101050 msgr2=0x7f51441014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:15.444 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.441+0000 7f514b8cc700 1 --2- 172.21.15.118:0/3008922479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5144101050 0x7f51441014d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5140009990 tx=0x7f5140009ca0 comp rx=0 tx=0).stop 2023-10-16T13:10:15.444 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.441+0000 7f514b8cc700 1 -- 172.21.15.118:0/3008922479 shutdown_connections 2023-10-16T13:10:15.444 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.441+0000 7f514b8cc700 1 --2- 172.21.15.118:0/3008922479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5144101a10 0x7f5144108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:15.444 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.441+0000 7f514b8cc700 1 --2- 172.21.15.118:0/3008922479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51440ffe60 0x7f5144100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:15.444 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.441+0000 7f514b8cc700 1 --2- 172.21.15.118:0/3008922479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5144101050 0x7f51441014d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:15.445 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.441+0000 7f514b8cc700 1 -- 172.21.15.118:0/3008922479 >> 172.21.15.118:0/3008922479 conn(0x7f51440fb450 msgr2=0x7f51440fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:10:15.445 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.441+0000 7f514b8cc700 1 -- 172.21.15.118:0/3008922479 shutdown_connections 2023-10-16T13:10:15.445 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.441+0000 7f514b8cc700 1 -- 172.21.15.118:0/3008922479 wait complete. 2023-10-16T13:10:15.448 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.441+0000 7f514b8cc700 1 Processor -- start 2023-10-16T13:10:15.448 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.441+0000 7f514b8cc700 1 -- start start 2023-10-16T13:10:15.448 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f514b8cc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51440ffe60 0x7f5144069e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:10:15.448 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f514b8cc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5144101050 0x7f514419baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:10:15.448 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f514b8cc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5144101a10 0x7f514419e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:10:15.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f514b8cc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514419e890 con 0x7f51440ffe60 2023-10-16T13:10:15.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f514b8cc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514419ea00 con 0x7f5144101050 2023-10-16T13:10:15.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f514b8cc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514419ebc0 con 0x7f5144101a10 2023-10-16T13:10:15.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f5148e67700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5144101050 0x7f514419baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:10:15.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f5148e67700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5144101050 0x7f514419baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50286/0 (socket says 172.21.15.118:50286) 2023-10-16T13:10:15.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f5148e67700 1 -- 172.21.15.118:0/4017068465 learned_addr learned my addr 172.21.15.118:0/4017068465 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-16T13:10:15.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f5149e69700 1 --2- 172.21.15.118:0/4017068465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5144101a10 0x7f514419e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:10:15.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f5149668700 1 --2- 172.21.15.118:0/4017068465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51440ffe60 0x7f5144069e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:10:15.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f5148e67700 1 -- 172.21.15.118:0/4017068465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5144101a10 msgr2=0x7f514419e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:15.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f5148e67700 1 --2- 172.21.15.118:0/4017068465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5144101a10 0x7f514419e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:15.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f5148e67700 1 -- 172.21.15.118:0/4017068465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51440ffe60 msgr2=0x7f5144069e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:15.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f5148e67700 1 --2- 172.21.15.118:0/4017068465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51440ffe60 0x7f5144069e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:15.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f5148e67700 1 -- 172.21.15.118:0/4017068465 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51400095f0 con 0x7f5144101050 2023-10-16T13:10:15.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f5149668700 1 --2- 172.21.15.118:0/4017068465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51440ffe60 0x7f5144069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:10:15.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f5148e67700 1 --2- 172.21.15.118:0/4017068465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5144101050 0x7f514419baa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5140000c00 tx=0x7f5140004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:10:15.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f513a7fc700 1 -- 172.21.15.118:0/4017068465 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514001d070 con 0x7f5144101050 2023-10-16T13:10:15.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f513a7fc700 1 -- 172.21.15.118:0/4017068465 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f51400040c0 con 0x7f5144101050 2023-10-16T13:10:15.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f514b8cc700 1 -- 172.21.15.118:0/4017068465 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514419ee40 con 0x7f5144101050 2023-10-16T13:10:15.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f513a7fc700 1 -- 172.21.15.118:0/4017068465 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140022e40 con 0x7f5144101050 2023-10-16T13:10:15.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.442+0000 7f514b8cc700 1 -- 172.21.15.118:0/4017068465 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514419f1f0 con 0x7f5144101050 2023-10-16T13:10:15.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.443+0000 7f514b8cc700 1 -- 172.21.15.118:0/4017068465 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5144106e20 con 0x7f5144101050 2023-10-16T13:10:15.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.445+0000 7f513a7fc700 1 -- 172.21.15.118:0/4017068465 <== mon.2 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5140022470 con 0x7f5144101050 2023-10-16T13:10:15.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.445+0000 7f513a7fc700 1 --2- 172.21.15.118:0/4017068465 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f51300a1500 0x7f51300a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:10:15.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.445+0000 7f513a7fc700 1 -- 172.21.15.118:0/4017068465 <== mon.2 v2:172.21.15.118:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f51400cdc60 con 0x7f5144101050 2023-10-16T13:10:15.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.445+0000 7f5149668700 1 --2- 172.21.15.118:0/4017068465 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f51300a1500 0x7f51300a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:10:15.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.446+0000 7f5149668700 1 --2- 172.21.15.118:0/4017068465 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f51300a1500 0x7f51300a39c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5134005fd0 tx=0x7f5134005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:10:15.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.448+0000 7f513a7fc700 1 -- 172.21.15.118:0/4017068465 <== mon.2 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5140097b50 con 0x7f5144101050 2023-10-16T13:10:15.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:15.648+0000 7f514b8cc700 1 -- 172.21.15.118:0/4017068465 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f514402d230 con 0x7f51300a1500 2023-10-16T13:10:15.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:15 smithi092 ceph-mon[99542]: Detected new or changed devices on smithi092 2023-10-16T13:10:15.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:15 smithi092 ceph-mon[99542]: Adjusting osd_memory_target on smithi092 to 4292M 2023-10-16T13:10:15.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:15 smithi092 ceph-mon[99542]: osdmap e67: 10 total, 10 up, 10 in 2023-10-16T13:10:15.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:15 smithi118 ceph-mon[103969]: Detected new or changed devices on smithi092 2023-10-16T13:10:15.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:15 smithi118 ceph-mon[103969]: Adjusting osd_memory_target on smithi092 to 4292M 2023-10-16T13:10:15.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:15 smithi118 ceph-mon[103969]: osdmap e67: 10 total, 10 up, 10 in 2023-10-16T13:10:15.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:15 smithi152 ceph-mon[104423]: Detected new or changed devices on smithi092 2023-10-16T13:10:15.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:15 smithi152 ceph-mon[104423]: Adjusting osd_memory_target on smithi092 to 4292M 2023-10-16T13:10:15.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:15 smithi152 ceph-mon[104423]: osdmap e67: 10 total, 10 up, 10 in 2023-10-16T13:10:16.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:16 smithi092 ceph-mon[99542]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:16.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:16 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:10:16.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:16 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:10:16.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:16 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:16.760 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:16 smithi118 ceph-mon[103969]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:16.760 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:16 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:10:16.761 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:16 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:10:16.761 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:16 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:16.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:16 smithi152 ceph-mon[104423]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:16.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:16 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:10:16.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:16 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:10:16.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:16 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:17.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:17 smithi118 ceph-mon[103969]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:10:17.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:17 smithi092 ceph-mon[99542]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:10:17.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:17 smithi152 ceph-mon[104423]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:10:18.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:18 smithi092 ceph-mon[99542]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:18.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:18 smithi092 ceph-mon[99542]: from='client.? 172.21.15.118:0/3954379915' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "835ac2f9-3615-42f3-bb6d-037f3c1fc192"}]: dispatch 2023-10-16T13:10:18.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:18 smithi092 ceph-mon[99542]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "835ac2f9-3615-42f3-bb6d-037f3c1fc192"}]: dispatch 2023-10-16T13:10:18.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:18 smithi092 ceph-mon[99542]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "835ac2f9-3615-42f3-bb6d-037f3c1fc192"}]': finished 2023-10-16T13:10:18.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:18 smithi092 ceph-mon[99542]: osdmap e68: 11 total, 10 up, 11 in 2023-10-16T13:10:18.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-16T13:10:18.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:18 smithi118 ceph-mon[103969]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:18.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:18 smithi118 ceph-mon[103969]: from='client.? 172.21.15.118:0/3954379915' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "835ac2f9-3615-42f3-bb6d-037f3c1fc192"}]: dispatch 2023-10-16T13:10:18.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:18 smithi118 ceph-mon[103969]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "835ac2f9-3615-42f3-bb6d-037f3c1fc192"}]: dispatch 2023-10-16T13:10:18.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:18 smithi118 ceph-mon[103969]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "835ac2f9-3615-42f3-bb6d-037f3c1fc192"}]': finished 2023-10-16T13:10:18.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:18 smithi118 ceph-mon[103969]: osdmap e68: 11 total, 10 up, 11 in 2023-10-16T13:10:18.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:18 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-16T13:10:18.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:18 smithi152 ceph-mon[104423]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:18.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:18 smithi152 ceph-mon[104423]: from='client.? 172.21.15.118:0/3954379915' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "835ac2f9-3615-42f3-bb6d-037f3c1fc192"}]: dispatch 2023-10-16T13:10:18.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:18 smithi152 ceph-mon[104423]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "835ac2f9-3615-42f3-bb6d-037f3c1fc192"}]: dispatch 2023-10-16T13:10:18.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:18 smithi152 ceph-mon[104423]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "835ac2f9-3615-42f3-bb6d-037f3c1fc192"}]': finished 2023-10-16T13:10:18.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:18 smithi152 ceph-mon[104423]: osdmap e68: 11 total, 10 up, 11 in 2023-10-16T13:10:18.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-16T13:10:19.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:19 smithi118 ceph-mon[103969]: from='client.? 172.21.15.118:0/996245694' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:10:19.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:19 smithi152 ceph-mon[104423]: from='client.? 172.21.15.118:0/996245694' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:10:19.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:19 smithi092 ceph-mon[99542]: from='client.? 172.21.15.118:0/996245694' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:10:20.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:20 smithi118 ceph-mon[103969]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:20.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:20 smithi152 ceph-mon[104423]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:20.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:20 smithi092 ceph-mon[99542]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:22.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:22 smithi118 ceph-mon[103969]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:22.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:22 smithi152 ceph-mon[104423]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:22.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:22 smithi092 ceph-mon[99542]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:24.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:24 smithi118 ceph-mon[103969]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:24.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:24 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-16T13:10:24.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:24 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:24.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:24 smithi152 ceph-mon[104423]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:24.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:24 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-16T13:10:24.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:24 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:24 smithi092 ceph-mon[99542]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:24 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-16T13:10:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:24 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:25.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:25 smithi118 ceph-mon[103969]: Deploying daemon osd.10 on smithi118 2023-10-16T13:10:25.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:25 smithi152 ceph-mon[104423]: Deploying daemon osd.10 on smithi118 2023-10-16T13:10:25.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:25 smithi092 ceph-mon[99542]: Deploying daemon osd.10 on smithi118 2023-10-16T13:10:26.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:26 smithi118 ceph-mon[103969]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:26.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:26 smithi152 ceph-mon[104423]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:26 smithi092 ceph-mon[99542]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:28.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:28 smithi118 ceph-mon[103969]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:28.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:28 smithi152 ceph-mon[104423]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:28.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:28 smithi092 ceph-mon[99542]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:30.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:30.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:30.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:10:30.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:29 smithi118 ceph-mon[103969]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:30.192 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:30.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:30.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:10:30.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:29 smithi152 ceph-mon[104423]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:30.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:30.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:30.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:10:30.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:29 smithi092 ceph-mon[99542]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:31.614 INFO:teuthology.orchestra.run.smithi118.stdout:Created osd(s) 10 on host 'smithi118' 2023-10-16T13:10:31.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:31.611+0000 7f513a7fc700 1 -- 172.21.15.118:0/4017068465 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f514402d230 con 0x7f51300a1500 2023-10-16T13:10:31.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:31.614+0000 7f514b8cc700 1 -- 172.21.15.118:0/4017068465 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f51300a1500 msgr2=0x7f51300a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:31.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:31.614+0000 7f514b8cc700 1 --2- 172.21.15.118:0/4017068465 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f51300a1500 0x7f51300a39c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5134005fd0 tx=0x7f5134005f00 comp rx=0 tx=0).stop 2023-10-16T13:10:31.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:31.614+0000 7f514b8cc700 1 -- 172.21.15.118:0/4017068465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5144101050 msgr2=0x7f514419baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:31.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:31.614+0000 7f514b8cc700 1 --2- 172.21.15.118:0/4017068465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5144101050 0x7f514419baa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5140000c00 tx=0x7f5140004730 comp rx=0 tx=0).stop 2023-10-16T13:10:31.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:31.614+0000 7f514b8cc700 1 -- 172.21.15.118:0/4017068465 shutdown_connections 2023-10-16T13:10:31.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:31.614+0000 7f514b8cc700 1 --2- 172.21.15.118:0/4017068465 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f51300a1500 0x7f51300a39c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:31.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:31.614+0000 7f514b8cc700 1 --2- 172.21.15.118:0/4017068465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51440ffe60 0x7f5144069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:31.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:31.614+0000 7f514b8cc700 1 --2- 172.21.15.118:0/4017068465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5144101a10 0x7f514419e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:31.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:31.614+0000 7f514b8cc700 1 --2- 172.21.15.118:0/4017068465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5144101050 0x7f514419baa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:31.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:31.614+0000 7f514b8cc700 1 -- 172.21.15.118:0/4017068465 >> 172.21.15.118:0/4017068465 conn(0x7f51440fb450 msgr2=0x7f51440fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:10:31.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:31.614+0000 7f514b8cc700 1 -- 172.21.15.118:0/4017068465 shutdown_connections 2023-10-16T13:10:31.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-16T13:10:31.614+0000 7f514b8cc700 1 -- 172.21.15.118:0/4017068465 wait complete. 2023-10-16T13:10:32.073 DEBUG:teuthology.orchestra.run.smithi118:osd.10> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.10.service 2023-10-16T13:10:32.076 INFO:tasks.cephadm:Deploying osd.11 on smithi152 with /dev/vg_nvme/lv_1... 2023-10-16T13:10:32.076 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-16T13:10:32.106 INFO:journalctl@ceph.osd.10.smithi118.stdout:-- Logs begin at Mon 2023-10-16 12:50:05 UTC. -- 2023-10-16T13:10:32.644 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-16T13:10:32.863 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:32 smithi152 ceph-mon[104423]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:32.864 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:32 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:32.864 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:32 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:32.864 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:32 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:32.864 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:32 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:32.891 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:10:32 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:10:32.614+0000 7f2e11be3640 -1 osd.10 0 log_to_monitors true 2023-10-16T13:10:32.891 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:32 smithi118 ceph-mon[103969]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:32.892 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:32 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:32.892 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:32 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:32.892 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:32 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:32.892 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:32 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:32.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:32 smithi092 ceph-mon[99542]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:32.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:32 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:32.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:32 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:32.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:32 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:32.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:32 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:33.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:33 smithi118 ceph-mon[103969]: from='osd.10 [v2:172.21.15.118:6824/3622143535,v1:172.21.15.118:6825/3622143535]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-16T13:10:33.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:33 smithi118 ceph-mon[103969]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-16T13:10:33.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:33 smithi152 ceph-mon[104423]: from='osd.10 [v2:172.21.15.118:6824/3622143535,v1:172.21.15.118:6825/3622143535]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-16T13:10:33.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:33 smithi152 ceph-mon[104423]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-16T13:10:33.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:33 smithi092 ceph-mon[99542]: from='osd.10 [v2:172.21.15.118:6824/3622143535,v1:172.21.15.118:6825/3622143535]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-16T13:10:33.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:33 smithi092 ceph-mon[99542]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-16T13:10:34.181 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-16T13:10:34.181 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-16T13:10:34.181 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2023-10-16T13:10:34.181 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2023-10-16T13:10:34.182 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111829 s, 938 MB/s 2023-10-16T13:10:34.182 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2023-10-16T13:10:34.601 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi152:vg_nvme/lv_1 2023-10-16T13:10:34.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:34 smithi152 ceph-mon[104423]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:34.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:34 smithi152 ceph-mon[104423]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-16T13:10:34.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:34 smithi152 ceph-mon[104423]: from='osd.10 [v2:172.21.15.118:6824/3622143535,v1:172.21.15.118:6825/3622143535]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:10:34.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:34 smithi152 ceph-mon[104423]: osdmap e69: 11 total, 10 up, 11 in 2023-10-16T13:10:34.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:34 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-16T13:10:34.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:34 smithi152 ceph-mon[104423]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:10:34.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:34 smithi092 ceph-mon[99542]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:34.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:34 smithi092 ceph-mon[99542]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-16T13:10:34.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:34 smithi092 ceph-mon[99542]: from='osd.10 [v2:172.21.15.118:6824/3622143535,v1:172.21.15.118:6825/3622143535]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:10:34.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:34 smithi092 ceph-mon[99542]: osdmap e69: 11 total, 10 up, 11 in 2023-10-16T13:10:34.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:34 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-16T13:10:34.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:34 smithi092 ceph-mon[99542]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:10:35.033 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:10:34 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:10:34.612+0000 7f2e06a59700 -1 osd.10 0 waiting for initial osdmap 2023-10-16T13:10:35.033 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:10:34 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:10:34.631+0000 7f2e0084a700 -1 osd.10 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:10:35.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:34 smithi118 ceph-mon[103969]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:35.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:34 smithi118 ceph-mon[103969]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-16T13:10:35.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:34 smithi118 ceph-mon[103969]: from='osd.10 [v2:172.21.15.118:6824/3622143535,v1:172.21.15.118:6825/3622143535]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:10:35.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:34 smithi118 ceph-mon[103969]: osdmap e69: 11 total, 10 up, 11 in 2023-10-16T13:10:35.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:34 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-16T13:10:35.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:34 smithi118 ceph-mon[103969]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-16T13:10:35.162 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-16T13:10:35.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-16T13:10:35.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: osdmap e70: 11 total, 10 up, 11 in 2023-10-16T13:10:35.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-16T13:10:35.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-16T13:10:35.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: Detected new or changed devices on smithi118 2023-10-16T13:10:35.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:35.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:35.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:35.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:35.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:35.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:35.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: Adjusting osd_memory_target on smithi118 to 4292M 2023-10-16T13:10:35.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:35.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:35.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:10:35.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:35.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:10:35.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:35.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:10:35.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:35.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:35.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: osd.10 [v2:172.21.15.118:6824/3622143535,v1:172.21.15.118:6825/3622143535] boot 2023-10-16T13:10:35.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: osdmap e71: 11 total, 11 up, 11 in 2023-10-16T13:10:35.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-16T13:10:35.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-16T13:10:35.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: osdmap e70: 11 total, 10 up, 11 in 2023-10-16T13:10:35.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-16T13:10:35.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-16T13:10:35.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: Detected new or changed devices on smithi118 2023-10-16T13:10:35.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:35.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:35.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:35.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:35.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:35.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:35.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: Adjusting osd_memory_target on smithi118 to 4292M 2023-10-16T13:10:35.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:35.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:36.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:10:36.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:36.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:10:36.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:36.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:10:36.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:36.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:36.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: osd.10 [v2:172.21.15.118:6824/3622143535,v1:172.21.15.118:6825/3622143535] boot 2023-10-16T13:10:36.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: osdmap e71: 11 total, 11 up, 11 in 2023-10-16T13:10:36.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-16T13:10:36.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-16T13:10:36.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: osdmap e70: 11 total, 10 up, 11 in 2023-10-16T13:10:36.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-16T13:10:36.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-16T13:10:36.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: Detected new or changed devices on smithi118 2023-10-16T13:10:36.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:36.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:36.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:36.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:36.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:36.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:36.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: Adjusting osd_memory_target on smithi118 to 4292M 2023-10-16T13:10:36.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:36.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:36.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:10:36.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:36.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:10:36.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:36.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:10:36.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:36.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-16T13:10:36.038 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: osd.10 [v2:172.21.15.118:6824/3622143535,v1:172.21.15.118:6825/3622143535] boot 2023-10-16T13:10:36.038 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: osdmap e71: 11 total, 11 up, 11 in 2023-10-16T13:10:36.038 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-16T13:10:36.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.242+0000 7f220ddec700 1 -- 172.21.15.152:0/3358020799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2208100a40 msgr2=0x7f22081082e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:36.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.242+0000 7f220ddec700 1 --2- 172.21.15.152:0/3358020799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2208100a40 0x7f22081082e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f220000b0a0 tx=0x7f220000b3b0 comp rx=0 tx=0).stop 2023-10-16T13:10:36.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.242+0000 7f220ddec700 1 -- 172.21.15.152:0/3358020799 shutdown_connections 2023-10-16T13:10:36.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.242+0000 7f220ddec700 1 --2- 172.21.15.152:0/3358020799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2208100a40 0x7f22081082e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:36.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.242+0000 7f220ddec700 1 --2- 172.21.15.152:0/3358020799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2208101420 0x7f2208101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:36.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.242+0000 7f220ddec700 1 --2- 172.21.15.152:0/3358020799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2208100080 0x7f2208100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:36.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.242+0000 7f220ddec700 1 -- 172.21.15.152:0/3358020799 >> 172.21.15.152:0/3358020799 conn(0x7f22080fab70 msgr2=0x7f22080fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:10:36.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.242+0000 7f220ddec700 1 -- 172.21.15.152:0/3358020799 shutdown_connections 2023-10-16T13:10:36.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.243+0000 7f220ddec700 1 -- 172.21.15.152:0/3358020799 wait complete. 2023-10-16T13:10:36.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.243+0000 7f220ddec700 1 Processor -- start 2023-10-16T13:10:36.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.243+0000 7f220ddec700 1 -- start start 2023-10-16T13:10:36.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.243+0000 7f220ddec700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2208100080 0x7f22080ffad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:10:36.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.243+0000 7f220ddec700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2208100a40 0x7f220819ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:10:36.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.243+0000 7f220ddec700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2208101420 0x7f220819e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:10:36.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.243+0000 7f220ddec700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220819e850 con 0x7f2208101420 2023-10-16T13:10:36.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.243+0000 7f220ddec700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220819e9c0 con 0x7f2208100080 2023-10-16T13:10:36.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.243+0000 7f220ddec700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220819eb80 con 0x7f2208100a40 2023-10-16T13:10:36.252 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.244+0000 7f2206ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2208100a40 0x7f220819ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:10:36.252 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.244+0000 7f2206ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2208100a40 0x7f220819ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45740/0 (socket says 172.21.15.152:45740) 2023-10-16T13:10:36.252 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.244+0000 7f2206ffd700 1 -- 172.21.15.152:0/3123212968 learned_addr learned my addr 172.21.15.152:0/3123212968 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T13:10:36.252 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.244+0000 7f2207fff700 1 --2- 172.21.15.152:0/3123212968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2208101420 0x7f220819e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:10:36.252 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.244+0000 7f22077fe700 1 --2- 172.21.15.152:0/3123212968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2208100080 0x7f22080ffad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:10:36.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.244+0000 7f2206ffd700 1 -- 172.21.15.152:0/3123212968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2208100080 msgr2=0x7f22080ffad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:36.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.244+0000 7f2206ffd700 1 --2- 172.21.15.152:0/3123212968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2208100080 0x7f22080ffad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:36.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.244+0000 7f2206ffd700 1 -- 172.21.15.152:0/3123212968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2208101420 msgr2=0x7f220819e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:36.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.244+0000 7f2206ffd700 1 --2- 172.21.15.152:0/3123212968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2208101420 0x7f220819e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:36.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.244+0000 7f2206ffd700 1 -- 172.21.15.152:0/3123212968 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2200009d00 con 0x7f2208100a40 2023-10-16T13:10:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.244+0000 7f22077fe700 1 --2- 172.21.15.152:0/3123212968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2208100080 0x7f22080ffad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:10:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.244+0000 7f2206ffd700 1 --2- 172.21.15.152:0/3123212968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2208100a40 0x7f220819ba70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00d950 tx=0x7f21fc00dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:10:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.244+0000 7f2204ff9700 1 -- 172.21.15.152:0/3123212968 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc009940 con 0x7f2208100a40 2023-10-16T13:10:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.244+0000 7f2204ff9700 1 -- 172.21.15.152:0/3123212968 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f21fc010460 con 0x7f2208100a40 2023-10-16T13:10:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.244+0000 7f2204ff9700 1 -- 172.21.15.152:0/3123212968 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc00f620 con 0x7f2208100a40 2023-10-16T13:10:36.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.244+0000 7f220ddec700 1 -- 172.21.15.152:0/3123212968 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220819ee60 con 0x7f2208100a40 2023-10-16T13:10:36.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.244+0000 7f220ddec700 1 -- 172.21.15.152:0/3123212968 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220819f280 con 0x7f2208100a40 2023-10-16T13:10:36.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.245+0000 7f220ddec700 1 -- 172.21.15.152:0/3123212968 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2208107350 con 0x7f2208100a40 2023-10-16T13:10:36.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.246+0000 7f2204ff9700 1 -- 172.21.15.152:0/3123212968 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f21fc010960 con 0x7f2208100a40 2023-10-16T13:10:36.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.247+0000 7f2204ff9700 1 --2- 172.21.15.152:0/3123212968 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f21f00a1480 0x7f21f00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:10:36.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.247+0000 7f2204ff9700 1 -- 172.21.15.152:0/3123212968 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6727+0+0 (secure 0 0 0) 0x7f21fc0cc5a0 con 0x7f2208100a40 2023-10-16T13:10:36.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.247+0000 7f22077fe700 1 --2- 172.21.15.152:0/3123212968 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f21f00a1480 0x7f21f00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:10:36.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.247+0000 7f22077fe700 1 --2- 172.21.15.152:0/3123212968 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f21f00a1480 0x7f21f00a3940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f21f8005fd0 tx=0x7f21f8005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:10:36.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.250+0000 7f2204ff9700 1 -- 172.21.15.152:0/3123212968 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f21fc096230 con 0x7f2208100a40 2023-10-16T13:10:36.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:36.452+0000 7f220ddec700 1 -- 172.21.15.152:0/3123212968 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f220802d350 con 0x7f21f00a1480 2023-10-16T13:10:36.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:36 smithi152 ceph-mon[104423]: purged_snaps scrub starts 2023-10-16T13:10:36.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:36 smithi152 ceph-mon[104423]: purged_snaps scrub ok 2023-10-16T13:10:36.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:36 smithi152 ceph-mon[104423]: osdmap e72: 11 total, 11 up, 11 in 2023-10-16T13:10:36.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:36 smithi152 ceph-mon[104423]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:10:36.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:10:36.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:10:36.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:36.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:36 smithi092 ceph-mon[99542]: purged_snaps scrub starts 2023-10-16T13:10:36.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:36 smithi092 ceph-mon[99542]: purged_snaps scrub ok 2023-10-16T13:10:36.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:36 smithi092 ceph-mon[99542]: osdmap e72: 11 total, 11 up, 11 in 2023-10-16T13:10:36.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:36 smithi092 ceph-mon[99542]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:10:36.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:10:36.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:10:36.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:37.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:36 smithi118 ceph-mon[103969]: purged_snaps scrub starts 2023-10-16T13:10:37.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:36 smithi118 ceph-mon[103969]: purged_snaps scrub ok 2023-10-16T13:10:37.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:36 smithi118 ceph-mon[103969]: osdmap e72: 11 total, 11 up, 11 in 2023-10-16T13:10:37.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:36 smithi118 ceph-mon[103969]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:10:37.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-16T13:10:37.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-16T13:10:37.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:38.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:38 smithi152 ceph-mon[104423]: pgmap v213: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-16T13:10:38.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:38 smithi152 ceph-mon[104423]: osdmap e73: 11 total, 11 up, 11 in 2023-10-16T13:10:38.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:38 smithi092 ceph-mon[99542]: pgmap v213: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-16T13:10:38.759 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:38 smithi092 ceph-mon[99542]: osdmap e73: 11 total, 11 up, 11 in 2023-10-16T13:10:38.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:38 smithi118 ceph-mon[103969]: pgmap v213: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-16T13:10:38.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:38 smithi118 ceph-mon[103969]: osdmap e73: 11 total, 11 up, 11 in 2023-10-16T13:10:39.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:39 smithi152 ceph-mon[104423]: osdmap e74: 11 total, 11 up, 11 in 2023-10-16T13:10:39.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:39 smithi152 ceph-mon[104423]: from='client.? 172.21.15.152:0/139325997' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30d2e40e-290f-48a0-bf74-f6f7b5ff659c"}]: dispatch 2023-10-16T13:10:39.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:39 smithi152 ceph-mon[104423]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30d2e40e-290f-48a0-bf74-f6f7b5ff659c"}]: dispatch 2023-10-16T13:10:39.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:39 smithi152 ceph-mon[104423]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30d2e40e-290f-48a0-bf74-f6f7b5ff659c"}]': finished 2023-10-16T13:10:39.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:39 smithi152 ceph-mon[104423]: osdmap e75: 12 total, 11 up, 12 in 2023-10-16T13:10:39.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:39 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-16T13:10:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:39 smithi092 ceph-mon[99542]: osdmap e74: 11 total, 11 up, 11 in 2023-10-16T13:10:39.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:39 smithi092 ceph-mon[99542]: from='client.? 172.21.15.152:0/139325997' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30d2e40e-290f-48a0-bf74-f6f7b5ff659c"}]: dispatch 2023-10-16T13:10:39.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:39 smithi092 ceph-mon[99542]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30d2e40e-290f-48a0-bf74-f6f7b5ff659c"}]: dispatch 2023-10-16T13:10:39.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:39 smithi092 ceph-mon[99542]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30d2e40e-290f-48a0-bf74-f6f7b5ff659c"}]': finished 2023-10-16T13:10:39.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:39 smithi092 ceph-mon[99542]: osdmap e75: 12 total, 11 up, 12 in 2023-10-16T13:10:39.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:39 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-16T13:10:39.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:39 smithi118 ceph-mon[103969]: osdmap e74: 11 total, 11 up, 11 in 2023-10-16T13:10:39.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:39 smithi118 ceph-mon[103969]: from='client.? 172.21.15.152:0/139325997' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30d2e40e-290f-48a0-bf74-f6f7b5ff659c"}]: dispatch 2023-10-16T13:10:39.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:39 smithi118 ceph-mon[103969]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30d2e40e-290f-48a0-bf74-f6f7b5ff659c"}]: dispatch 2023-10-16T13:10:39.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:39 smithi118 ceph-mon[103969]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30d2e40e-290f-48a0-bf74-f6f7b5ff659c"}]': finished 2023-10-16T13:10:39.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:39 smithi118 ceph-mon[103969]: osdmap e75: 12 total, 11 up, 12 in 2023-10-16T13:10:39.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:39 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-16T13:10:40.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:40 smithi152 ceph-mon[104423]: pgmap v217: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-16T13:10:40.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:40 smithi152 ceph-mon[104423]: from='client.? 172.21.15.152:0/1925112913' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:10:40.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:40 smithi092 ceph-mon[99542]: pgmap v217: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-16T13:10:40.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:40 smithi092 ceph-mon[99542]: from='client.? 172.21.15.152:0/1925112913' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:10:40.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:40 smithi118 ceph-mon[103969]: pgmap v217: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-16T13:10:40.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:40 smithi118 ceph-mon[103969]: from='client.? 172.21.15.152:0/1925112913' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-16T13:10:42.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:42 smithi152 ceph-mon[104423]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-16T13:10:42.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:42 smithi092 ceph-mon[99542]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-16T13:10:42.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:42 smithi118 ceph-mon[103969]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-16T13:10:44.581 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:44 smithi152 ceph-mon[104423]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-16T13:10:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:44 smithi092 ceph-mon[99542]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-16T13:10:44.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:44 smithi118 ceph-mon[103969]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-16T13:10:46.606 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:46 smithi152 ceph-mon[104423]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-16T13:10:46.606 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-16T13:10:46.606 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:46 smithi092 ceph-mon[99542]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-16T13:10:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-16T13:10:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:46.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:46 smithi118 ceph-mon[103969]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-16T13:10:46.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-16T13:10:46.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:47.424 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:47 smithi152 ceph-mon[104423]: Deploying daemon osd.11 on smithi152 2023-10-16T13:10:47.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:47 smithi092 ceph-mon[99542]: Deploying daemon osd.11 on smithi152 2023-10-16T13:10:47.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:47 smithi118 ceph-mon[103969]: Deploying daemon osd.11 on smithi152 2023-10-16T13:10:48.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:48 smithi152 ceph-mon[104423]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-16T13:10:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:48 smithi092 ceph-mon[99542]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-16T13:10:48.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:48 smithi118 ceph-mon[103969]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-16T13:10:50.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:50 smithi152 ceph-mon[104423]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-10-16T13:10:50.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:50 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:50.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:50 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:50.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:50 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:10:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:50 smithi092 ceph-mon[99542]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-10-16T13:10:50.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:50.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:50.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:50 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:10:50.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:50 smithi118 ceph-mon[103969]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-10-16T13:10:50.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:50 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:50.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:50 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:50.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:50 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:10:52.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:52 smithi152 ceph-mon[104423]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-16T13:10:52.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:52 smithi092 ceph-mon[99542]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-16T13:10:52.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:52 smithi118 ceph-mon[103969]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-16T13:10:52.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:52.812+0000 7f2204ff9700 1 -- 172.21.15.152:0/3123212968 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f220802d350 con 0x7f21f00a1480 2023-10-16T13:10:52.815 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 11 on host 'smithi152' 2023-10-16T13:10:52.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:52.814+0000 7f220ddec700 1 -- 172.21.15.152:0/3123212968 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f21f00a1480 msgr2=0x7f21f00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:52.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:52.814+0000 7f220ddec700 1 --2- 172.21.15.152:0/3123212968 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f21f00a1480 0x7f21f00a3940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f21f8005fd0 tx=0x7f21f8005e30 comp rx=0 tx=0).stop 2023-10-16T13:10:52.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:52.814+0000 7f220ddec700 1 -- 172.21.15.152:0/3123212968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2208100a40 msgr2=0x7f220819ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:52.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:52.814+0000 7f220ddec700 1 --2- 172.21.15.152:0/3123212968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2208100a40 0x7f220819ba70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00d950 tx=0x7f21fc00dc60 comp rx=0 tx=0).stop 2023-10-16T13:10:52.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:52.814+0000 7f220ddec700 1 -- 172.21.15.152:0/3123212968 shutdown_connections 2023-10-16T13:10:52.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:52.814+0000 7f220ddec700 1 --2- 172.21.15.152:0/3123212968 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f21f00a1480 0x7f21f00a3940 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:52.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:52.814+0000 7f220ddec700 1 --2- 172.21.15.152:0/3123212968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2208101420 0x7f220819e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:52.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:52.814+0000 7f220ddec700 1 --2- 172.21.15.152:0/3123212968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2208100080 0x7f22080ffad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:52.814+0000 7f220ddec700 1 --2- 172.21.15.152:0/3123212968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2208100a40 0x7f220819ba70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:52.814+0000 7f220ddec700 1 -- 172.21.15.152:0/3123212968 >> 172.21.15.152:0/3123212968 conn(0x7f22080fab70 msgr2=0x7f2208104490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:10:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:52.814+0000 7f220ddec700 1 -- 172.21.15.152:0/3123212968 shutdown_connections 2023-10-16T13:10:52.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:10:52.814+0000 7f220ddec700 1 -- 172.21.15.152:0/3123212968 wait complete. 2023-10-16T13:10:53.275 DEBUG:teuthology.orchestra.run.smithi152:osd.11> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.11.service 2023-10-16T13:10:53.279 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-10-16T13:10:53.280 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph osd stat -f json 2023-10-16T13:10:53.310 INFO:journalctl@ceph.osd.11.smithi152.stdout:-- Logs begin at Mon 2023-10-16 12:49:44 UTC. -- 2023-10-16T13:10:53.853 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:10:53.935 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:53 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:53.936 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:53 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:53.936 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:53 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:53.936 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:53 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:10:53.936 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:53 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:53.936 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:53 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:53.937 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:53 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:53.937 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:53 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:10:53.937 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:53 smithi152 ceph-mon[104423]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-16T13:10:53.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:53 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:53.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:53 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:53.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:53 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:53.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:53 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:10:53.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:53 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:53.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:53 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:53.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:53 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:53.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:53 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:10:53.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:53 smithi092 ceph-mon[99542]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-16T13:10:54.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:53 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:54.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:53 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:54.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:53 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:54.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:53 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:10:54.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:53 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:54.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:53 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:54.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:53 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:54.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:53 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:10:54.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:53 smithi118 ceph-mon[103969]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-16T13:10:54.193 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:10:53 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:10:53.980+0000 7fca0a508640 -1 osd.11 0 log_to_monitors true 2023-10-16T13:10:54.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:54 smithi092 ceph-mon[99542]: from='osd.11 [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-16T13:10:55.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.058+0000 7fa9ffd2c700 1 -- 172.21.15.92:0/1589222570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9f8101050 msgr2=0x7fa9f81014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:55.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.058+0000 7fa9ffd2c700 1 --2- 172.21.15.92:0/1589222570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9f8101050 0x7fa9f81014d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009990 tx=0x7fa9f4009ca0 comp rx=0 tx=0).stop 2023-10-16T13:10:55.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.058+0000 7fa9ffd2c700 1 -- 172.21.15.92:0/1589222570 shutdown_connections 2023-10-16T13:10:55.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.058+0000 7fa9ffd2c700 1 --2- 172.21.15.92:0/1589222570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9f8101a10 0x7fa9f8108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:55.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.058+0000 7fa9ffd2c700 1 --2- 172.21.15.92:0/1589222570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9f80ffe60 0x7fa9f8100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:55.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.058+0000 7fa9ffd2c700 1 --2- 172.21.15.92:0/1589222570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9f8101050 0x7fa9f81014d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:55.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.058+0000 7fa9ffd2c700 1 -- 172.21.15.92:0/1589222570 >> 172.21.15.92:0/1589222570 conn(0x7fa9f80fb450 msgr2=0x7fa9f80fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:10:55.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.059+0000 7fa9ffd2c700 1 -- 172.21.15.92:0/1589222570 shutdown_connections 2023-10-16T13:10:55.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.059+0000 7fa9ffd2c700 1 -- 172.21.15.92:0/1589222570 wait complete. 2023-10-16T13:10:55.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.059+0000 7fa9ffd2c700 1 Processor -- start 2023-10-16T13:10:55.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.059+0000 7fa9ffd2c700 1 -- start start 2023-10-16T13:10:55.066 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.059+0000 7fa9ffd2c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9f80ffe60 0x7fa9f8069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:10:55.066 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.059+0000 7fa9ffd2c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9f8101050 0x7fa9f819ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:10:55.066 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.059+0000 7fa9ffd2c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9f8101a10 0x7fa9f819e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:10:55.066 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.059+0000 7fa9ffd2c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f819e8b0 con 0x7fa9f8101a10 2023-10-16T13:10:55.066 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.059+0000 7fa9ffd2c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f819ea20 con 0x7fa9f8101050 2023-10-16T13:10:55.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.059+0000 7fa9ffd2c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f819ebe0 con 0x7fa9f80ffe60 2023-10-16T13:10:55.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.060+0000 7fa9fe2c9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9f8101a10 0x7fa9f819e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:10:55.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.060+0000 7fa9fdac8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9f80ffe60 0x7fa9f8069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:10:55.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.060+0000 7fa9fe2c9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9f8101a10 0x7fa9f819e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34808/0 (socket says 172.21.15.92:34808) 2023-10-16T13:10:55.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.060+0000 7fa9fdac8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9f80ffe60 0x7fa9f8069e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.92:41636/0 (socket says 172.21.15.92:41636) 2023-10-16T13:10:55.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.060+0000 7fa9fe2c9700 1 -- 172.21.15.92:0/1621847280 learned_addr learned my addr 172.21.15.92:0/1621847280 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:10:55.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.060+0000 7fa9fd2c7700 1 --2- 172.21.15.92:0/1621847280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9f8101050 0x7fa9f819ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:10:55.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.060+0000 7fa9fe2c9700 1 -- 172.21.15.92:0/1621847280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9f80ffe60 msgr2=0x7fa9f8069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:55.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.060+0000 7fa9fe2c9700 1 --2- 172.21.15.92:0/1621847280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9f80ffe60 0x7fa9f8069e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:55.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.060+0000 7fa9fe2c9700 1 -- 172.21.15.92:0/1621847280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9f8101050 msgr2=0x7fa9f819ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:55.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.060+0000 7fa9fe2c9700 1 --2- 172.21.15.92:0/1621847280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9f8101050 0x7fa9f819ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:55.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.060+0000 7fa9fe2c9700 1 -- 172.21.15.92:0/1621847280 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f40095f0 con 0x7fa9f8101a10 2023-10-16T13:10:55.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.060+0000 7fa9fdac8700 1 --2- 172.21.15.92:0/1621847280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9f80ffe60 0x7fa9f8069e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:10:55.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.060+0000 7fa9fe2c9700 1 --2- 172.21.15.92:0/1621847280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9f8101a10 0x7fa9f819e110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa9f000ef30 tx=0x7fa9f000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:10:55.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.060+0000 7fa9eeffd700 1 -- 172.21.15.92:0/1621847280 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0018070 con 0x7fa9f8101a10 2023-10-16T13:10:55.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.060+0000 7fa9ffd2c700 1 -- 172.21.15.92:0/1621847280 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f819ee60 con 0x7fa9f8101a10 2023-10-16T13:10:55.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.060+0000 7fa9eeffd700 1 -- 172.21.15.92:0/1621847280 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa9f000f040 con 0x7fa9f8101a10 2023-10-16T13:10:55.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.060+0000 7fa9eeffd700 1 -- 172.21.15.92:0/1621847280 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f000ce00 con 0x7fa9f8101a10 2023-10-16T13:10:55.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.060+0000 7fa9ffd2c700 1 -- 172.21.15.92:0/1621847280 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f819f280 con 0x7fa9f8101a10 2023-10-16T13:10:55.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.061+0000 7fa9ffd2c700 1 -- 172.21.15.92:0/1621847280 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f8106e70 con 0x7fa9f8101a10 2023-10-16T13:10:55.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.062+0000 7fa9eeffd700 1 -- 172.21.15.92:0/1621847280 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa9f0003a00 con 0x7fa9f8101a10 2023-10-16T13:10:55.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.063+0000 7fa9eeffd700 1 --2- 172.21.15.92:0/1621847280 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa9e40a1480 0x7fa9e40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:10:55.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.063+0000 7fa9fdac8700 1 --2- 172.21.15.92:0/1621847280 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa9e40a1480 0x7fa9e40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:10:55.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.063+0000 7fa9eeffd700 1 -- 172.21.15.92:0/1621847280 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6831+0+0 (secure 0 0 0) 0x7fa9f00cc3e0 con 0x7fa9f8101a10 2023-10-16T13:10:55.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.063+0000 7fa9fdac8700 1 --2- 172.21.15.92:0/1621847280 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa9e40a1480 0x7fa9e40a3940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8100bc0 tx=0x7fa9e800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:10:55.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.067+0000 7fa9eeffd700 1 -- 172.21.15.92:0/1621847280 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa9f0096000 con 0x7fa9f8101a10 2023-10-16T13:10:55.192 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:54 smithi152 ceph-mon[104423]: from='osd.11 [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-16T13:10:55.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.257+0000 7fa9ffd2c700 1 -- 172.21.15.92:0/1621847280 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fa9f810b820 con 0x7fa9f8101a10 2023-10-16T13:10:55.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.257+0000 7fa9eeffd700 1 -- 172.21.15.92:0/1621847280 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) v1 ==== 74+0+133 (secure 0 0 0) 0x7fa9f0099620 con 0x7fa9f8101a10 2023-10-16T13:10:55.260 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:10:55.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.259+0000 7fa9ffd2c700 1 -- 172.21.15.92:0/1621847280 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa9e40a1480 msgr2=0x7fa9e40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:55.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.259+0000 7fa9ffd2c700 1 --2- 172.21.15.92:0/1621847280 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa9e40a1480 0x7fa9e40a3940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8100bc0 tx=0x7fa9e800a380 comp rx=0 tx=0).stop 2023-10-16T13:10:55.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.259+0000 7fa9ffd2c700 1 -- 172.21.15.92:0/1621847280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9f8101a10 msgr2=0x7fa9f819e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:55.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.259+0000 7fa9ffd2c700 1 --2- 172.21.15.92:0/1621847280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9f8101a10 0x7fa9f819e110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa9f000ef30 tx=0x7fa9f000c3a0 comp rx=0 tx=0).stop 2023-10-16T13:10:55.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.259+0000 7fa9ffd2c700 1 -- 172.21.15.92:0/1621847280 shutdown_connections 2023-10-16T13:10:55.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.259+0000 7fa9ffd2c700 1 --2- 172.21.15.92:0/1621847280 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa9e40a1480 0x7fa9e40a3940 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:55.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.259+0000 7fa9ffd2c700 1 --2- 172.21.15.92:0/1621847280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9f8101a10 0x7fa9f819e110 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:55.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.259+0000 7fa9ffd2c700 1 --2- 172.21.15.92:0/1621847280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9f80ffe60 0x7fa9f8069e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:55.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.259+0000 7fa9ffd2c700 1 --2- 172.21.15.92:0/1621847280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9f8101050 0x7fa9f819ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:55.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.259+0000 7fa9ffd2c700 1 -- 172.21.15.92:0/1621847280 >> 172.21.15.92:0/1621847280 conn(0x7fa9f80fb450 msgr2=0x7fa9f80fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:10:55.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.259+0000 7fa9ffd2c700 1 -- 172.21.15.92:0/1621847280 shutdown_connections 2023-10-16T13:10:55.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:55.259+0000 7fa9ffd2c700 1 -- 172.21.15.92:0/1621847280 wait complete. 2023-10-16T13:10:55.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:54 smithi118 ceph-mon[103969]: from='osd.11 [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-16T13:10:55.606 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":76,"num_osds":12,"num_up_osds":11,"osd_up_since":1697461835,"num_in_osds":12,"osd_in_since":1697461838,"num_remapped_pgs":0} 2023-10-16T13:10:55.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:55 smithi092 ceph-mon[99542]: from='osd.11 [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-16T13:10:55.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:55 smithi092 ceph-mon[99542]: osdmap e76: 12 total, 11 up, 12 in 2023-10-16T13:10:55.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:55 smithi092 ceph-mon[99542]: from='osd.11 [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:10:55.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:55 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-16T13:10:55.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:55 smithi092 ceph-mon[99542]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-16T13:10:55.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:55 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1621847280' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-16T13:10:55.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:55 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:56.192 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:10:55 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:10:55.811+0000 7fc9ff37e700 -1 osd.11 0 waiting for initial osdmap 2023-10-16T13:10:56.193 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:10:55 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:10:55.829+0000 7fc9fb974700 -1 osd.11 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:10:56.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:55 smithi152 ceph-mon[104423]: from='osd.11 [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-16T13:10:56.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:55 smithi152 ceph-mon[104423]: osdmap e76: 12 total, 11 up, 12 in 2023-10-16T13:10:56.194 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:55 smithi152 ceph-mon[104423]: from='osd.11 [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:10:56.194 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:55 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-16T13:10:56.194 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:55 smithi152 ceph-mon[104423]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-16T13:10:56.194 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:55 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1621847280' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-16T13:10:56.194 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:55 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:56.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:55 smithi118 ceph-mon[103969]: from='osd.11 [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-16T13:10:56.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:55 smithi118 ceph-mon[103969]: osdmap e76: 12 total, 11 up, 12 in 2023-10-16T13:10:56.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:55 smithi118 ceph-mon[103969]: from='osd.11 [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-10-16T13:10:56.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:55 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-16T13:10:56.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:55 smithi118 ceph-mon[103969]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-16T13:10:56.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:55 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1621847280' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-16T13:10:56.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:55 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:56.607 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph osd stat -f json 2023-10-16T13:10:56.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:56 smithi092 ceph-mon[99542]: Detected new or changed devices on smithi152 2023-10-16T13:10:56.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:56 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:56.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:56 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:56.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:56 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:56.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:56 smithi092 ceph-mon[99542]: from='osd.11 [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-10-16T13:10:56.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:56 smithi092 ceph-mon[99542]: osdmap e77: 12 total, 11 up, 12 in 2023-10-16T13:10:56.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:56 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-16T13:10:56.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:56 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:56.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:56 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-16T13:10:56.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:56 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:56.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:56 smithi092 ceph-mon[99542]: Adjusting osd_memory_target on smithi152 to 4292M 2023-10-16T13:10:56.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:56 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:56.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:56 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:56.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:56 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:10:56.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:56 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:57.171 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:10:57.192 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:56 smithi152 ceph-mon[104423]: Detected new or changed devices on smithi152 2023-10-16T13:10:57.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:56 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:57.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:56 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:57.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:56 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:57.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:56 smithi152 ceph-mon[104423]: from='osd.11 [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-10-16T13:10:57.194 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:56 smithi152 ceph-mon[104423]: osdmap e77: 12 total, 11 up, 12 in 2023-10-16T13:10:57.194 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:56 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-16T13:10:57.194 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:56 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:57.194 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:56 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-16T13:10:57.194 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:56 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:57.195 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:56 smithi152 ceph-mon[104423]: Adjusting osd_memory_target on smithi152 to 4292M 2023-10-16T13:10:57.195 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:56 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:57.195 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:56 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:57.195 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:56 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:10:57.195 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:56 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:57.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:56 smithi118 ceph-mon[103969]: Detected new or changed devices on smithi152 2023-10-16T13:10:57.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:56 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:57.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:56 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:57.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:56 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:57.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:56 smithi118 ceph-mon[103969]: from='osd.11 [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-10-16T13:10:57.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:56 smithi118 ceph-mon[103969]: osdmap e77: 12 total, 11 up, 12 in 2023-10-16T13:10:57.285 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:56 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-16T13:10:57.285 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:56 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:57.285 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:56 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-16T13:10:57.285 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:56 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-16T13:10:57.285 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:56 smithi118 ceph-mon[103969]: Adjusting osd_memory_target on smithi152 to 4292M 2023-10-16T13:10:57.286 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:56 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:57.286 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:56 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:10:57.286 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:56 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:10:57.286 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:56 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:10:57.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:57 smithi092 ceph-mon[99542]: purged_snaps scrub starts 2023-10-16T13:10:57.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:57 smithi092 ceph-mon[99542]: purged_snaps scrub ok 2023-10-16T13:10:57.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:57 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-16T13:10:57.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:57 smithi092 ceph-mon[99542]: osd.11 [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763] boot 2023-10-16T13:10:57.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:57 smithi092 ceph-mon[99542]: osdmap e78: 12 total, 12 up, 12 in 2023-10-16T13:10:57.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:57 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-16T13:10:57.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:57 smithi092 ceph-mon[99542]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-16T13:10:58.192 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:57 smithi152 ceph-mon[104423]: purged_snaps scrub starts 2023-10-16T13:10:58.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:57 smithi152 ceph-mon[104423]: purged_snaps scrub ok 2023-10-16T13:10:58.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:57 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-16T13:10:58.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:57 smithi152 ceph-mon[104423]: osd.11 [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763] boot 2023-10-16T13:10:58.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:57 smithi152 ceph-mon[104423]: osdmap e78: 12 total, 12 up, 12 in 2023-10-16T13:10:58.194 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:57 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-16T13:10:58.194 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:57 smithi152 ceph-mon[104423]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-16T13:10:58.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:57 smithi118 ceph-mon[103969]: purged_snaps scrub starts 2023-10-16T13:10:58.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:57 smithi118 ceph-mon[103969]: purged_snaps scrub ok 2023-10-16T13:10:58.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:57 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-16T13:10:58.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:57 smithi118 ceph-mon[103969]: osd.11 [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763] boot 2023-10-16T13:10:58.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:57 smithi118 ceph-mon[103969]: osdmap e78: 12 total, 12 up, 12 in 2023-10-16T13:10:58.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:57 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-16T13:10:58.285 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:57 smithi118 ceph-mon[103969]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-16T13:10:58.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.536+0000 7f7eaa459700 1 -- 172.21.15.92:0/3638376451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ea4101990 msgr2=0x7f7ea41082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:58.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.536+0000 7f7eaa459700 1 --2- 172.21.15.92:0/3638376451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ea4101990 0x7f7ea41082b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00b0a0 tx=0x7f7e9c00b3b0 comp rx=0 tx=0).stop 2023-10-16T13:10:58.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.536+0000 7f7eaa459700 1 -- 172.21.15.92:0/3638376451 shutdown_connections 2023-10-16T13:10:58.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.536+0000 7f7eaa459700 1 --2- 172.21.15.92:0/3638376451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ea4101990 0x7f7ea41082b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:58.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.536+0000 7f7eaa459700 1 --2- 172.21.15.92:0/3638376451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ea40ffe70 0x7f7ea4100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:58.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.536+0000 7f7eaa459700 1 --2- 172.21.15.92:0/3638376451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea4100fd0 0x7f7ea4101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:58.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.536+0000 7f7eaa459700 1 -- 172.21.15.92:0/3638376451 >> 172.21.15.92:0/3638376451 conn(0x7f7ea40fb3f0 msgr2=0x7f7ea40fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:10:58.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.536+0000 7f7eaa459700 1 -- 172.21.15.92:0/3638376451 shutdown_connections 2023-10-16T13:10:58.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.536+0000 7f7eaa459700 1 -- 172.21.15.92:0/3638376451 wait complete. 2023-10-16T13:10:58.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.537+0000 7f7eaa459700 1 Processor -- start 2023-10-16T13:10:58.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.537+0000 7f7eaa459700 1 -- start start 2023-10-16T13:10:58.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.537+0000 7f7eaa459700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ea40ffe70 0x7f7ea4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:10:58.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.537+0000 7f7eaa459700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea4100fd0 0x7f7ea419bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:10:58.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.537+0000 7f7eaa459700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ea4101990 0x7f7ea419e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:10:58.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.537+0000 7f7eaa459700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea419e970 con 0x7f7ea4101990 2023-10-16T13:10:58.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.537+0000 7f7eaa459700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea419eae0 con 0x7f7ea4100fd0 2023-10-16T13:10:58.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.537+0000 7f7eaa459700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea419eca0 con 0x7f7ea40ffe70 2023-10-16T13:10:58.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.537+0000 7f7ea89f6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ea4101990 0x7f7ea419e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:10:58.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.537+0000 7f7ea89f6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ea4101990 0x7f7ea419e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34826/0 (socket says 172.21.15.92:34826) 2023-10-16T13:10:58.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.537+0000 7f7ea89f6700 1 -- 172.21.15.92:0/28917768 learned_addr learned my addr 172.21.15.92:0/28917768 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:10:58.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.538+0000 7f7ea37fe700 1 --2- 172.21.15.92:0/28917768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea4100fd0 0x7f7ea419bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:10:58.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.538+0000 7f7ea3fff700 1 --2- 172.21.15.92:0/28917768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ea40ffe70 0x7f7ea4069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:10:58.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.538+0000 7f7ea89f6700 1 -- 172.21.15.92:0/28917768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ea40ffe70 msgr2=0x7f7ea4069500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:58.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.538+0000 7f7ea89f6700 1 --2- 172.21.15.92:0/28917768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ea40ffe70 0x7f7ea4069500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:58.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.538+0000 7f7ea89f6700 1 -- 172.21.15.92:0/28917768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea4100fd0 msgr2=0x7f7ea419bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:58.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.538+0000 7f7ea89f6700 1 --2- 172.21.15.92:0/28917768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea4100fd0 0x7f7ea419bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:58.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.538+0000 7f7ea89f6700 1 -- 172.21.15.92:0/28917768 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c009d00 con 0x7f7ea4101990 2023-10-16T13:10:58.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.538+0000 7f7ea89f6700 1 --2- 172.21.15.92:0/28917768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ea4101990 0x7f7ea419e1d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00bd00 tx=0x7f7e9c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:10:58.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.538+0000 7f7ea17fa700 1 -- 172.21.15.92:0/28917768 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c00e040 con 0x7f7ea4101990 2023-10-16T13:10:58.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.538+0000 7f7eaa459700 1 -- 172.21.15.92:0/28917768 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea419ef20 con 0x7f7ea4101990 2023-10-16T13:10:58.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.538+0000 7f7ea17fa700 1 -- 172.21.15.92:0/28917768 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7e9c004e40 con 0x7f7ea4101990 2023-10-16T13:10:58.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.538+0000 7f7ea17fa700 1 -- 172.21.15.92:0/28917768 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0053b0 con 0x7f7ea4101990 2023-10-16T13:10:58.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.538+0000 7f7eaa459700 1 -- 172.21.15.92:0/28917768 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea419f3e0 con 0x7f7ea4101990 2023-10-16T13:10:58.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.539+0000 7f7eaa459700 1 -- 172.21.15.92:0/28917768 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea410b820 con 0x7f7ea4101990 2023-10-16T13:10:58.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.540+0000 7f7ea17fa700 1 -- 172.21.15.92:0/28917768 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7e9c01d9e0 con 0x7f7ea4101990 2023-10-16T13:10:58.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.541+0000 7f7ea17fa700 1 --2- 172.21.15.92:0/28917768 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7e8c0a1500 0x7f7e8c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:10:58.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.541+0000 7f7ea3fff700 1 --2- 172.21.15.92:0/28917768 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7e8c0a1500 0x7f7e8c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:10:58.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.541+0000 7f7ea17fa700 1 -- 172.21.15.92:0/28917768 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7e9c0ce140 con 0x7f7ea4101990 2023-10-16T13:10:58.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.541+0000 7f7ea3fff700 1 --2- 172.21.15.92:0/28917768 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7e8c0a1500 0x7f7e8c0a39c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7e94009c60 tx=0x7f7e94009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:10:58.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.544+0000 7f7ea17fa700 1 -- 172.21.15.92:0/28917768 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7e9c097c30 con 0x7f7ea4101990 2023-10-16T13:10:58.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.734+0000 7f7eaa459700 1 -- 172.21.15.92:0/28917768 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f7ea4106d00 con 0x7f7ea4101990 2023-10-16T13:10:58.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.734+0000 7f7ea17fa700 1 -- 172.21.15.92:0/28917768 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) v1 ==== 74+0+133 (secure 0 0 0) 0x7f7e9c09b250 con 0x7f7ea4101990 2023-10-16T13:10:58.737 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:10:58.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.736+0000 7f7eaa459700 1 -- 172.21.15.92:0/28917768 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7e8c0a1500 msgr2=0x7f7e8c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:58.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.736+0000 7f7eaa459700 1 --2- 172.21.15.92:0/28917768 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7e8c0a1500 0x7f7e8c0a39c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7e94009c60 tx=0x7f7e94009260 comp rx=0 tx=0).stop 2023-10-16T13:10:58.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.736+0000 7f7eaa459700 1 -- 172.21.15.92:0/28917768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ea4101990 msgr2=0x7f7ea419e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:10:58.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.736+0000 7f7eaa459700 1 --2- 172.21.15.92:0/28917768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ea4101990 0x7f7ea419e1d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00bd00 tx=0x7f7e9c00bd30 comp rx=0 tx=0).stop 2023-10-16T13:10:58.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.736+0000 7f7eaa459700 1 -- 172.21.15.92:0/28917768 shutdown_connections 2023-10-16T13:10:58.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.736+0000 7f7eaa459700 1 --2- 172.21.15.92:0/28917768 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7e8c0a1500 0x7f7e8c0a39c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:58.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.736+0000 7f7eaa459700 1 --2- 172.21.15.92:0/28917768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ea4101990 0x7f7ea419e1d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:58.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.736+0000 7f7eaa459700 1 --2- 172.21.15.92:0/28917768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ea40ffe70 0x7f7ea4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:58.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.736+0000 7f7eaa459700 1 --2- 172.21.15.92:0/28917768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea4100fd0 0x7f7ea419bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:10:58.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.736+0000 7f7eaa459700 1 -- 172.21.15.92:0/28917768 >> 172.21.15.92:0/28917768 conn(0x7f7ea40fb3f0 msgr2=0x7f7ea40fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:10:58.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.736+0000 7f7eaa459700 1 -- 172.21.15.92:0/28917768 shutdown_connections 2023-10-16T13:10:58.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:10:58.736+0000 7f7eaa459700 1 -- 172.21.15.92:0/28917768 wait complete. 2023-10-16T13:10:59.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:58 smithi092 ceph-mon[99542]: osdmap e79: 12 total, 12 up, 12 in 2023-10-16T13:10:59.127 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:58 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/28917768' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-16T13:10:59.128 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":79,"num_osds":12,"num_up_osds":12,"osd_up_since":1697461856,"num_in_osds":12,"osd_in_since":1697461838,"num_remapped_pgs":0} 2023-10-16T13:10:59.128 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph osd dump --format=json 2023-10-16T13:10:59.192 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:58 smithi152 ceph-mon[104423]: osdmap e79: 12 total, 12 up, 12 in 2023-10-16T13:10:59.193 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:58 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/28917768' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-16T13:10:59.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:58 smithi118 ceph-mon[103969]: osdmap e79: 12 total, 12 up, 12 in 2023-10-16T13:10:59.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:58 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/28917768' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-16T13:10:59.687 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:11:00.109 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:10:59 smithi092 ceph-mon[99542]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:00.192 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:10:59 smithi152 ceph-mon[104423]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:00.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:10:59 smithi118 ceph-mon[103969]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:00.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.875+0000 7efc70276700 1 -- 172.21.15.92:0/3658091018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc68104e30 msgr2=0x7efc68105210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:00.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.875+0000 7efc70276700 1 --2- 172.21.15.92:0/3658091018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc68104e30 0x7efc68105210 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efc640099c0 tx=0x7efc64009cd0 comp rx=0 tx=0).stop 2023-10-16T13:11:00.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.875+0000 7efc70276700 1 -- 172.21.15.92:0/3658091018 shutdown_connections 2023-10-16T13:11:00.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.875+0000 7efc70276700 1 --2- 172.21.15.92:0/3658091018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc68104e30 0x7efc68105210 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:00.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.875+0000 7efc70276700 1 --2- 172.21.15.92:0/3658091018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc68100f20 0x7efc6810ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:00.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.875+0000 7efc70276700 1 --2- 172.21.15.92:0/3658091018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc68100560 0x7efc681009e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:00.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.875+0000 7efc70276700 1 -- 172.21.15.92:0/3658091018 >> 172.21.15.92:0/3658091018 conn(0x7efc68076360 msgr2=0x7efc680fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:00.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.875+0000 7efc70276700 1 -- 172.21.15.92:0/3658091018 shutdown_connections 2023-10-16T13:11:00.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.875+0000 7efc70276700 1 -- 172.21.15.92:0/3658091018 wait complete. 2023-10-16T13:11:00.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.875+0000 7efc70276700 1 Processor -- start 2023-10-16T13:11:00.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.875+0000 7efc70276700 1 -- start start 2023-10-16T13:11:00.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc70276700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc68100560 0x7efc68197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:00.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc70276700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc68100f20 0x7efc68198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:00.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc70276700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc68104e30 0x7efc681a2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:00.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc70276700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc68198cb0 con 0x7efc68100f20 2023-10-16T13:11:00.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc70276700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc681a33f0 con 0x7efc68100560 2023-10-16T13:11:00.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc70276700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc681a35b0 con 0x7efc68104e30 2023-10-16T13:11:00.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc6d811700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc68100f20 0x7efc68198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:00.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc6d811700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc68100f20 0x7efc68198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34844/0 (socket says 172.21.15.92:34844) 2023-10-16T13:11:00.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc6d811700 1 -- 172.21.15.92:0/3738801591 learned_addr learned my addr 172.21.15.92:0/3738801591 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:00.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc6e012700 1 --2- 172.21.15.92:0/3738801591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc68100560 0x7efc68197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:00.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc6e813700 1 --2- 172.21.15.92:0/3738801591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc68104e30 0x7efc681a2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:00.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc6d811700 1 -- 172.21.15.92:0/3738801591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc68104e30 msgr2=0x7efc681a2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:00.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc6d811700 1 --2- 172.21.15.92:0/3738801591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc68104e30 0x7efc681a2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:00.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc6d811700 1 -- 172.21.15.92:0/3738801591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc68100560 msgr2=0x7efc68197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:00.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc6d811700 1 --2- 172.21.15.92:0/3738801591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc68100560 0x7efc68197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:00.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc6d811700 1 -- 172.21.15.92:0/3738801591 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc640095f0 con 0x7efc68100f20 2023-10-16T13:11:00.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc6d811700 1 --2- 172.21.15.92:0/3738801591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc68100f20 0x7efc68198370 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efc5800d950 tx=0x7efc5800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:00.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc5f7fe700 1 -- 172.21.15.92:0/3738801591 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58009b40 con 0x7efc68100f20 2023-10-16T13:11:00.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc5f7fe700 1 -- 172.21.15.92:0/3738801591 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efc58009ca0 con 0x7efc68100f20 2023-10-16T13:11:00.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc70276700 1 -- 172.21.15.92:0/3738801591 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc681a3890 con 0x7efc68100f20 2023-10-16T13:11:00.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.876+0000 7efc5f7fe700 1 -- 172.21.15.92:0/3738801591 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5800f6b0 con 0x7efc68100f20 2023-10-16T13:11:00.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.877+0000 7efc70276700 1 -- 172.21.15.92:0/3738801591 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc681a3de0 con 0x7efc68100f20 2023-10-16T13:11:00.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.877+0000 7efc70276700 1 -- 172.21.15.92:0/3738801591 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6804ebb0 con 0x7efc68100f20 2023-10-16T13:11:00.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.878+0000 7efc5f7fe700 1 -- 172.21.15.92:0/3738801591 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7efc58010460 con 0x7efc68100f20 2023-10-16T13:11:00.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.879+0000 7efc5f7fe700 1 --2- 172.21.15.92:0/3738801591 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7efc540a1500 0x7efc540a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:00.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.879+0000 7efc5f7fe700 1 -- 172.21.15.92:0/3738801591 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7efc580ccb60 con 0x7efc68100f20 2023-10-16T13:11:00.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.879+0000 7efc6e012700 1 --2- 172.21.15.92:0/3738801591 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7efc540a1500 0x7efc540a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:00.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.879+0000 7efc6e012700 1 --2- 172.21.15.92:0/3738801591 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7efc540a1500 0x7efc540a39c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efc64009fd0 tx=0x7efc64005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:00.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:00.883+0000 7efc5f7fe700 1 -- 172.21.15.92:0/3738801591 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efc58096660 con 0x7efc68100f20 2023-10-16T13:11:01.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:01.074+0000 7efc70276700 1 -- 172.21.15.92:0/3738801591 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc680008d0 con 0x7efc68100f20 2023-10-16T13:11:01.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:01.075+0000 7efc5f7fe700 1 -- 172.21.15.92:0/3738801591 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18422 (secure 0 0 0) 0x7efc58099c80 con 0x7efc68100f20 2023-10-16T13:11:01.077 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:01.078 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":79,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:10:57.822846+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:11:01.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:01.077+0000 7efc70276700 1 -- 172.21.15.92:0/3738801591 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7efc540a1500 msgr2=0x7efc540a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:01.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:01.077+0000 7efc70276700 1 --2- 172.21.15.92:0/3738801591 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7efc540a1500 0x7efc540a39c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efc64009fd0 tx=0x7efc64005fd0 comp rx=0 tx=0).stop 2023-10-16T13:11:01.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:01.077+0000 7efc70276700 1 -- 172.21.15.92:0/3738801591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc68100f20 msgr2=0x7efc68198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:01.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:01.077+0000 7efc70276700 1 --2- 172.21.15.92:0/3738801591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc68100f20 0x7efc68198370 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efc5800d950 tx=0x7efc5800dd10 comp rx=0 tx=0).stop 2023-10-16T13:11:01.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:01.077+0000 7efc70276700 1 -- 172.21.15.92:0/3738801591 shutdown_connections 2023-10-16T13:11:01.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:01.077+0000 7efc70276700 1 --2- 172.21.15.92:0/3738801591 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7efc540a1500 0x7efc540a39c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:01.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:01.077+0000 7efc70276700 1 --2- 172.21.15.92:0/3738801591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc68104e30 0x7efc681a2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:01.077+0000 7efc70276700 1 --2- 172.21.15.92:0/3738801591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc68100560 0x7efc68197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:01.077+0000 7efc70276700 1 --2- 172.21.15.92:0/3738801591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc68100f20 0x7efc68198370 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:01.077+0000 7efc70276700 1 -- 172.21.15.92:0/3738801591 >> 172.21.15.92:0/3738801591 conn(0x7efc68076360 msgr2=0x7efc68102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:01.077+0000 7efc70276700 1 -- 172.21.15.92:0/3738801591 shutdown_connections 2023-10-16T13:11:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:01.077+0000 7efc70276700 1 -- 172.21.15.92:0/3738801591 wait complete. 2023-10-16T13:11:01.431 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:01 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3738801591' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:01.443 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:07:45.516334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:11:01.444 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph osd pool get .mgr pg_num 2023-10-16T13:11:01.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:01 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3738801591' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:01.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:01 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3738801591' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:02.001 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:11:02.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:02 smithi092 ceph-mon[99542]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:02.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:02 smithi152 ceph-mon[104423]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:02.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:02 smithi118 ceph-mon[103969]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:03.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.309+0000 7f646551c700 1 -- 172.21.15.92:0/2813556015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64601051a0 msgr2=0x7f646010cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:03.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.309+0000 7f646551c700 1 --2- 172.21.15.92:0/2813556015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64601051a0 0x7f646010cd70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f645800b0a0 tx=0x7f645800b3b0 comp rx=0 tx=0).stop 2023-10-16T13:11:03.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.309+0000 7f646551c700 1 -- 172.21.15.92:0/2813556015 shutdown_connections 2023-10-16T13:11:03.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.309+0000 7f646551c700 1 --2- 172.21.15.92:0/2813556015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64601051a0 0x7f646010cd70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:03.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.309+0000 7f646551c700 1 --2- 172.21.15.92:0/2813556015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6460100370 0x7f6460100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:03.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.309+0000 7f646551c700 1 --2- 172.21.15.92:0/2813556015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6460100d20 0x7f6460104ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:03.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.309+0000 7f646551c700 1 -- 172.21.15.92:0/2813556015 >> 172.21.15.92:0/2813556015 conn(0x7f6460076c30 msgr2=0x7f6460077040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:03.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.309+0000 7f646551c700 1 -- 172.21.15.92:0/2813556015 shutdown_connections 2023-10-16T13:11:03.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.309+0000 7f646551c700 1 -- 172.21.15.92:0/2813556015 wait complete. 2023-10-16T13:11:03.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.310+0000 7f646551c700 1 Processor -- start 2023-10-16T13:11:03.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.310+0000 7f646551c700 1 -- start start 2023-10-16T13:11:03.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.310+0000 7f646551c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6460100370 0x7f6460197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:03.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.310+0000 7f646551c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6460100d20 0x7f6460197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:03.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.310+0000 7f646551c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64601051a0 0x7f646019bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:03.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.310+0000 7f646551c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646019c1d0 con 0x7f6460100d20 2023-10-16T13:11:03.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.310+0000 7f646551c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646019c340 con 0x7f64601051a0 2023-10-16T13:11:03.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.310+0000 7f646551c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646019c500 con 0x7f6460100370 2023-10-16T13:11:03.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.310+0000 7f645e7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6460100d20 0x7f6460197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:03.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.310+0000 7f645e7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6460100d20 0x7f6460197750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34856/0 (socket says 172.21.15.92:34856) 2023-10-16T13:11:03.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.310+0000 7f645e7fc700 1 -- 172.21.15.92:0/4211285815 learned_addr learned my addr 172.21.15.92:0/4211285815 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:03.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.310+0000 7f645f7fe700 1 --2- 172.21.15.92:0/4211285815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64601051a0 0x7f646019bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:03.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.311+0000 7f645effd700 1 --2- 172.21.15.92:0/4211285815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6460100370 0x7f6460197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:03.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.311+0000 7f645e7fc700 1 -- 172.21.15.92:0/4211285815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6460100370 msgr2=0x7f6460197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:03.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.311+0000 7f645e7fc700 1 --2- 172.21.15.92:0/4211285815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6460100370 0x7f6460197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:03.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.311+0000 7f645e7fc700 1 -- 172.21.15.92:0/4211285815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64601051a0 msgr2=0x7f646019bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:03.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.311+0000 7f645e7fc700 1 --2- 172.21.15.92:0/4211285815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64601051a0 0x7f646019bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:03.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.311+0000 7f645e7fc700 1 -- 172.21.15.92:0/4211285815 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6458009d00 con 0x7f6460100d20 2023-10-16T13:11:03.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.311+0000 7f645e7fc700 1 --2- 172.21.15.92:0/4211285815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6460100d20 0x7f6460197750 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f645000c9e0 tx=0x7f645000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:03.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.311+0000 7f6447fff700 1 -- 172.21.15.92:0/4211285815 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6450007aa0 con 0x7f6460100d20 2023-10-16T13:11:03.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.311+0000 7f646551c700 1 -- 172.21.15.92:0/4211285815 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646019c7e0 con 0x7f6460100d20 2023-10-16T13:11:03.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.311+0000 7f6447fff700 1 -- 172.21.15.92:0/4211285815 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6450007c00 con 0x7f6460100d20 2023-10-16T13:11:03.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.311+0000 7f6447fff700 1 -- 172.21.15.92:0/4211285815 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6450018660 con 0x7f6460100d20 2023-10-16T13:11:03.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.311+0000 7f646551c700 1 -- 172.21.15.92:0/4211285815 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64601a4040 con 0x7f6460100d20 2023-10-16T13:11:03.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.312+0000 7f646551c700 1 -- 172.21.15.92:0/4211285815 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646004ebb0 con 0x7f6460100d20 2023-10-16T13:11:03.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.313+0000 7f6447fff700 1 -- 172.21.15.92:0/4211285815 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f645000f450 con 0x7f6460100d20 2023-10-16T13:11:03.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.314+0000 7f6447fff700 1 --2- 172.21.15.92:0/4211285815 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f64480a1500 0x7f64480a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:03.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.314+0000 7f645effd700 1 --2- 172.21.15.92:0/4211285815 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f64480a1500 0x7f64480a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:03.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.314+0000 7f6447fff700 1 -- 172.21.15.92:0/4211285815 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f64500ccb20 con 0x7f6460100d20 2023-10-16T13:11:03.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.314+0000 7f645effd700 1 --2- 172.21.15.92:0/4211285815 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f64480a1500 0x7f64480a39c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6454006fd0 tx=0x7f6454008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:03.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.317+0000 7f6447fff700 1 -- 172.21.15.92:0/4211285815 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6450096610 con 0x7f6460100d20 2023-10-16T13:11:03.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.504+0000 7f646551c700 1 -- 172.21.15.92:0/4211285815 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6460198570 con 0x7f6460100d20 2023-10-16T13:11:03.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.504+0000 7f6447fff700 1 -- 172.21.15.92:0/4211285815 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6450099c30 con 0x7f6460100d20 2023-10-16T13:11:03.507 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-10-16T13:11:03.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.507+0000 7f646551c700 1 -- 172.21.15.92:0/4211285815 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f64480a1500 msgr2=0x7f64480a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:03.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.507+0000 7f646551c700 1 --2- 172.21.15.92:0/4211285815 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f64480a1500 0x7f64480a39c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6454006fd0 tx=0x7f6454008040 comp rx=0 tx=0).stop 2023-10-16T13:11:03.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.507+0000 7f646551c700 1 -- 172.21.15.92:0/4211285815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6460100d20 msgr2=0x7f6460197750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:03.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.507+0000 7f646551c700 1 --2- 172.21.15.92:0/4211285815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6460100d20 0x7f6460197750 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f645000c9e0 tx=0x7f645000ccf0 comp rx=0 tx=0).stop 2023-10-16T13:11:03.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.507+0000 7f646551c700 1 -- 172.21.15.92:0/4211285815 shutdown_connections 2023-10-16T13:11:03.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.507+0000 7f646551c700 1 --2- 172.21.15.92:0/4211285815 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f64480a1500 0x7f64480a39c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:03.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.507+0000 7f646551c700 1 --2- 172.21.15.92:0/4211285815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64601051a0 0x7f646019bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:03.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.507+0000 7f646551c700 1 --2- 172.21.15.92:0/4211285815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6460100370 0x7f6460197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:03.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.507+0000 7f646551c700 1 --2- 172.21.15.92:0/4211285815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6460100d20 0x7f6460197750 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:03.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.507+0000 7f646551c700 1 -- 172.21.15.92:0/4211285815 >> 172.21.15.92:0/4211285815 conn(0x7f6460076c30 msgr2=0x7f6460069300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:03.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.507+0000 7f646551c700 1 -- 172.21.15.92:0/4211285815 shutdown_connections 2023-10-16T13:11:03.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:03.507+0000 7f646551c700 1 -- 172.21.15.92:0/4211285815 wait complete. 2023-10-16T13:11:03.945 INFO:tasks.cephadm:Adding mds.a on smithi092 2023-10-16T13:11:03.946 INFO:tasks.cephadm:Adding mds.d on smithi092 2023-10-16T13:11:03.946 INFO:tasks.cephadm:Adding mds.g on smithi092 2023-10-16T13:11:03.946 INFO:tasks.cephadm:Adding mds.j on smithi092 2023-10-16T13:11:03.947 INFO:tasks.cephadm:Adding mds.b on smithi118 2023-10-16T13:11:03.947 INFO:tasks.cephadm:Adding mds.e on smithi118 2023-10-16T13:11:03.947 INFO:tasks.cephadm:Adding mds.h on smithi118 2023-10-16T13:11:03.947 INFO:tasks.cephadm:Adding mds.k on smithi118 2023-10-16T13:11:03.948 INFO:tasks.cephadm:Adding mds.c on smithi152 2023-10-16T13:11:03.948 INFO:tasks.cephadm:Adding mds.f on smithi152 2023-10-16T13:11:03.948 INFO:tasks.cephadm:Adding mds.i on smithi152 2023-10-16T13:11:03.948 INFO:tasks.cephadm:Adding mds.l on smithi152 2023-10-16T13:11:03.949 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph orch apply mds all '12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi118=b;smithi118=e;smithi118=h;smithi118=k;smithi152=c;smithi152=f;smithi152=i;smithi152=l' 2023-10-16T13:11:04.525 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-16T13:11:04.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:04 smithi152 ceph-mon[104423]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:04.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:04 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/4211285815' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:11:04.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:04 smithi092 ceph-mon[99542]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:04.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:04 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/4211285815' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:11:04.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:04 smithi118 ceph-mon[103969]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:04.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:04 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/4211285815' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:11:05.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.847+0000 7f3b75574700 1 -- 172.21.15.152:0/784138302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b701014a0 msgr2=0x7f3b701018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:05.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.847+0000 7f3b75574700 1 --2- 172.21.15.152:0/784138302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b701014a0 0x7f3b701018c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3b64009990 tx=0x7f3b64009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:05.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.847+0000 7f3b75574700 1 -- 172.21.15.152:0/784138302 shutdown_connections 2023-10-16T13:11:05.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.847+0000 7f3b75574700 1 --2- 172.21.15.152:0/784138302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b70100af0 0x7f3b701083b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:05.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.847+0000 7f3b75574700 1 --2- 172.21.15.152:0/784138302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b701014a0 0x7f3b701018c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:05.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.847+0000 7f3b75574700 1 --2- 172.21.15.152:0/784138302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b70100150 0x7f3b701005b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:05.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.847+0000 7f3b75574700 1 -- 172.21.15.152:0/784138302 >> 172.21.15.152:0/784138302 conn(0x7f3b700fabe0 msgr2=0x7f3b700fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:05.853 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.847+0000 7f3b75574700 1 -- 172.21.15.152:0/784138302 shutdown_connections 2023-10-16T13:11:05.853 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.847+0000 7f3b75574700 1 -- 172.21.15.152:0/784138302 wait complete. 2023-10-16T13:11:05.853 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.847+0000 7f3b75574700 1 Processor -- start 2023-10-16T13:11:05.853 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.847+0000 7f3b75574700 1 -- start start 2023-10-16T13:11:05.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b75574700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b70100150 0x7f3b70195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:05.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b75574700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b70100af0 0x7f3b70196170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:05.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b75574700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b701014a0 0x7f3b7019d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:05.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b75574700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7019d780 con 0x7f3b70100af0 2023-10-16T13:11:05.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b75574700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7019d8c0 con 0x7f3b70100150 2023-10-16T13:11:05.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b75574700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7019da80 con 0x7f3b701014a0 2023-10-16T13:11:05.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b6f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b701014a0 0x7f3b7019d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:05.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b6f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b701014a0 0x7f3b7019d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45852/0 (socket says 172.21.15.152:45852) 2023-10-16T13:11:05.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b6f7fe700 1 -- 172.21.15.152:0/720555874 learned_addr learned my addr 172.21.15.152:0/720555874 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T13:11:05.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b6effd700 1 --2- 172.21.15.152:0/720555874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b70100150 0x7f3b70195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:05.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b6e7fc700 1 --2- 172.21.15.152:0/720555874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b70100af0 0x7f3b70196170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:05.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b6f7fe700 1 -- 172.21.15.152:0/720555874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b70100150 msgr2=0x7f3b70195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:05.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b6f7fe700 1 --2- 172.21.15.152:0/720555874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b70100150 0x7f3b70195c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:05.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b6f7fe700 1 -- 172.21.15.152:0/720555874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b70100af0 msgr2=0x7f3b70196170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:05.858 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b6f7fe700 1 --2- 172.21.15.152:0/720555874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b70100af0 0x7f3b70196170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:05.858 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b6f7fe700 1 -- 172.21.15.152:0/720555874 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b640095f0 con 0x7f3b701014a0 2023-10-16T13:11:05.858 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b6f7fe700 1 --2- 172.21.15.152:0/720555874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b701014a0 0x7f3b7019d1b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3b68007ee0 tx=0x7f3b6800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:05.858 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b57fff700 1 -- 172.21.15.152:0/720555874 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68017070 con 0x7f3b701014a0 2023-10-16T13:11:05.859 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b75574700 1 -- 172.21.15.152:0/720555874 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7019dd60 con 0x7f3b701014a0 2023-10-16T13:11:05.859 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b57fff700 1 -- 172.21.15.152:0/720555874 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3b6800f040 con 0x7f3b701014a0 2023-10-16T13:11:05.859 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b57fff700 1 -- 172.21.15.152:0/720555874 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68005760 con 0x7f3b701014a0 2023-10-16T13:11:05.859 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.848+0000 7f3b75574700 1 -- 172.21.15.152:0/720555874 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7019e1b0 con 0x7f3b701014a0 2023-10-16T13:11:05.860 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.849+0000 7f3b75574700 1 -- 172.21.15.152:0/720555874 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b70107500 con 0x7f3b701014a0 2023-10-16T13:11:05.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.850+0000 7f3b57fff700 1 -- 172.21.15.152:0/720555874 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3b680058c0 con 0x7f3b701014a0 2023-10-16T13:11:05.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.851+0000 7f3b57fff700 1 --2- 172.21.15.152:0/720555874 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3b580a1480 0x7f3b580a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:05.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.851+0000 7f3b57fff700 1 -- 172.21.15.152:0/720555874 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3b680cbfc0 con 0x7f3b701014a0 2023-10-16T13:11:05.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.851+0000 7f3b6effd700 1 --2- 172.21.15.152:0/720555874 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3b580a1480 0x7f3b580a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:05.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.852+0000 7f3b6effd700 1 --2- 172.21.15.152:0/720555874 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3b580a1480 0x7f3b580a3940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b70197110 tx=0x7f3b64005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:05.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:05.855+0000 7f3b57fff700 1 -- 172.21.15.152:0/720555874 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3b680ff100 con 0x7f3b701014a0 2023-10-16T13:11:06.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:06.054+0000 7f3b75574700 1 -- 172.21.15.152:0/720555874 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi118=b;smithi118=e;smithi118=h;smithi118=k;smithi152=c;smithi152=f;smithi152=i;smithi152=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b700612f0 con 0x7f3b580a1480 2023-10-16T13:11:06.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:06.062+0000 7f3b57fff700 1 -- 172.21.15.152:0/720555874 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f3b700612f0 con 0x7f3b580a1480 2023-10-16T13:11:06.064 INFO:teuthology.orchestra.run.smithi152.stdout:Scheduled mds.all update... 2023-10-16T13:11:06.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:06.064+0000 7f3b75574700 1 -- 172.21.15.152:0/720555874 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3b580a1480 msgr2=0x7f3b580a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:06.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:06.064+0000 7f3b75574700 1 --2- 172.21.15.152:0/720555874 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3b580a1480 0x7f3b580a3940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b70197110 tx=0x7f3b64005fb0 comp rx=0 tx=0).stop 2023-10-16T13:11:06.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:06.064+0000 7f3b75574700 1 -- 172.21.15.152:0/720555874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b701014a0 msgr2=0x7f3b7019d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:06.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:06.064+0000 7f3b75574700 1 --2- 172.21.15.152:0/720555874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b701014a0 0x7f3b7019d1b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3b68007ee0 tx=0x7f3b6800d3b0 comp rx=0 tx=0).stop 2023-10-16T13:11:06.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:06.064+0000 7f3b75574700 1 -- 172.21.15.152:0/720555874 shutdown_connections 2023-10-16T13:11:06.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:06.064+0000 7f3b75574700 1 --2- 172.21.15.152:0/720555874 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3b580a1480 0x7f3b580a3940 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:06.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:06.064+0000 7f3b75574700 1 --2- 172.21.15.152:0/720555874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b701014a0 0x7f3b7019d1b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:06.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:06.064+0000 7f3b75574700 1 --2- 172.21.15.152:0/720555874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b70100150 0x7f3b70195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:06.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:06.064+0000 7f3b75574700 1 --2- 172.21.15.152:0/720555874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b70100af0 0x7f3b70196170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:06.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:06.064+0000 7f3b75574700 1 -- 172.21.15.152:0/720555874 >> 172.21.15.152:0/720555874 conn(0x7f3b700fabe0 msgr2=0x7f3b70104640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:06.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:06.064+0000 7f3b75574700 1 -- 172.21.15.152:0/720555874 shutdown_connections 2023-10-16T13:11:06.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T13:11:06.064+0000 7f3b75574700 1 -- 172.21.15.152:0/720555874 wait complete. 2023-10-16T13:11:06.439 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:06 smithi152 ceph-mon[104423]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:06.440 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:06 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:06.440 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:06 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:11:06.440 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:06 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:06.440 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:06 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:11:06.440 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:06 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:06.441 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:06 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:06.441 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:06 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:06.441 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:06 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:06.470 DEBUG:teuthology.orchestra.run.smithi092:mds.a> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.a.service 2023-10-16T13:11:06.473 DEBUG:teuthology.orchestra.run.smithi092:mds.d> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.d.service 2023-10-16T13:11:06.511 INFO:journalctl@ceph.mds.a.smithi092.stdout:-- Logs begin at Mon 2023-10-16 12:49:18 UTC. -- 2023-10-16T13:11:06.512 DEBUG:teuthology.orchestra.run.smithi092:mds.g> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.g.service 2023-10-16T13:11:06.543 INFO:journalctl@ceph.mds.d.smithi092.stdout:-- Logs begin at Mon 2023-10-16 12:49:18 UTC. -- 2023-10-16T13:11:06.545 DEBUG:teuthology.orchestra.run.smithi092:mds.j> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.j.service 2023-10-16T13:11:06.570 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:06 smithi092 ceph-mon[99542]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:06.571 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:06 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:06.571 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:06 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:11:06.571 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:06 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:06.571 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:06 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:11:06.571 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:06 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:06.572 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:06 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:06.572 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:06 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:06.572 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:06 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:06.573 DEBUG:teuthology.orchestra.run.smithi118:mds.b> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.b.service 2023-10-16T13:11:06.575 DEBUG:teuthology.orchestra.run.smithi118:mds.e> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.e.service 2023-10-16T13:11:06.577 INFO:journalctl@ceph.mds.g.smithi092.stdout:-- Logs begin at Mon 2023-10-16 12:49:18 UTC. -- 2023-10-16T13:11:06.603 INFO:journalctl@ceph.mds.j.smithi092.stdout:-- Logs begin at Mon 2023-10-16 12:49:18 UTC. -- 2023-10-16T13:11:06.606 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:06 smithi118 ceph-mon[103969]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:06.606 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:06 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:06.606 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:06 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:11:06.607 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:06 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:06.607 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:06 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:11:06.607 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:06 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:06.607 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:06 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:06.607 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:06 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:06.608 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:06 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:06.608 DEBUG:teuthology.orchestra.run.smithi118:mds.h> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.h.service 2023-10-16T13:11:06.613 INFO:journalctl@ceph.mds.b.smithi118.stdout:-- Logs begin at Mon 2023-10-16 12:50:05 UTC. -- 2023-10-16T13:11:06.614 DEBUG:teuthology.orchestra.run.smithi118:mds.k> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.k.service 2023-10-16T13:11:06.636 INFO:journalctl@ceph.mds.e.smithi118.stdout:-- Logs begin at Mon 2023-10-16 12:50:05 UTC. -- 2023-10-16T13:11:06.637 DEBUG:teuthology.orchestra.run.smithi152:mds.c> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.c.service 2023-10-16T13:11:06.640 DEBUG:teuthology.orchestra.run.smithi152:mds.f> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.f.service 2023-10-16T13:11:06.642 INFO:journalctl@ceph.mds.h.smithi118.stdout:-- Logs begin at Mon 2023-10-16 12:50:05 UTC. -- 2023-10-16T13:11:06.665 INFO:journalctl@ceph.mds.k.smithi118.stdout:-- Logs begin at Mon 2023-10-16 12:50:05 UTC. -- 2023-10-16T13:11:06.668 INFO:journalctl@ceph.mds.c.smithi152.stdout:-- Logs begin at Mon 2023-10-16 12:49:44 UTC. -- 2023-10-16T13:11:06.669 DEBUG:teuthology.orchestra.run.smithi152:mds.i> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.i.service 2023-10-16T13:11:06.694 INFO:journalctl@ceph.mds.f.smithi152.stdout:-- Logs begin at Mon 2023-10-16 12:49:44 UTC. -- 2023-10-16T13:11:06.696 DEBUG:teuthology.orchestra.run.smithi152:mds.l> sudo journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.l.service 2023-10-16T13:11:06.722 INFO:journalctl@ceph.mds.i.smithi152.stdout:-- Logs begin at Mon 2023-10-16 12:49:44 UTC. -- 2023-10-16T13:11:06.723 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-10-16T13:11:06.724 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:11:06.748 INFO:journalctl@ceph.mds.l.smithi152.stdout:-- Logs begin at Mon 2023-10-16 12:49:44 UTC. -- 2023-10-16T13:11:06.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.866+0000 7f2467786700 1 -- 172.21.15.92:0/1254800542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24600ff790 msgr2=0x7f2460101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:06.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.866+0000 7f2467786700 1 --2- 172.21.15.92:0/1254800542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24600ff790 0x7f2460101bc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f245c009990 tx=0x7f245c009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:06.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.866+0000 7f2467786700 1 -- 172.21.15.92:0/1254800542 shutdown_connections 2023-10-16T13:11:06.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.866+0000 7f2467786700 1 --2- 172.21.15.92:0/1254800542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24600ff790 0x7f2460101bc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:06.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.866+0000 7f2467786700 1 --2- 172.21.15.92:0/1254800542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2460104ad0 0x7f2460104f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:06.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.866+0000 7f2467786700 1 --2- 172.21.15.92:0/1254800542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2460102100 0x7f2460104590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:06.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.866+0000 7f2467786700 1 -- 172.21.15.92:0/1254800542 >> 172.21.15.92:0/1254800542 conn(0x7f24600fb3b0 msgr2=0x7f24600fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:06.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.866+0000 7f2467786700 1 -- 172.21.15.92:0/1254800542 shutdown_connections 2023-10-16T13:11:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.866+0000 7f2467786700 1 -- 172.21.15.92:0/1254800542 wait complete. 2023-10-16T13:11:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f2467786700 1 Processor -- start 2023-10-16T13:11:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f2467786700 1 -- start start 2023-10-16T13:11:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f2467786700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24600ff790 0x7f246019d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f2467786700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2460102100 0x7f246019d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f2467786700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2460104ad0 0x7f24601a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f2467786700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24601a4d90 con 0x7f2460104ad0 2023-10-16T13:11:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f2467786700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24601a4ed0 con 0x7f2460102100 2023-10-16T13:11:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f2467786700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24601a5060 con 0x7f24600ff790 2023-10-16T13:11:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f2465d23700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2460104ad0 0x7f24601a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f2465d23700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2460104ad0 0x7f24601a47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34872/0 (socket says 172.21.15.92:34872) 2023-10-16T13:11:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f2465d23700 1 -- 172.21.15.92:0/2780519721 learned_addr learned my addr 172.21.15.92:0/2780519721 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f2464d21700 1 --2- 172.21.15.92:0/2780519721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2460102100 0x7f246019d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f2465522700 1 --2- 172.21.15.92:0/2780519721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24600ff790 0x7f246019d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f2465d23700 1 -- 172.21.15.92:0/2780519721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24600ff790 msgr2=0x7f246019d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f2465d23700 1 --2- 172.21.15.92:0/2780519721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24600ff790 0x7f246019d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f2465d23700 1 -- 172.21.15.92:0/2780519721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2460102100 msgr2=0x7f246019d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f2465d23700 1 --2- 172.21.15.92:0/2780519721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2460102100 0x7f246019d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f2465d23700 1 -- 172.21.15.92:0/2780519721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c0095f0 con 0x7f2460104ad0 2023-10-16T13:11:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f2465d23700 1 --2- 172.21.15.92:0/2780519721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2460104ad0 0x7f24601a47c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2458007ee0 tx=0x7f245800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.867+0000 7f24567fc700 1 -- 172.21.15.92:0/2780519721 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2458017070 con 0x7f2460104ad0 2023-10-16T13:11:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.868+0000 7f24567fc700 1 -- 172.21.15.92:0/2780519721 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f245800f040 con 0x7f2460104ad0 2023-10-16T13:11:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.868+0000 7f24567fc700 1 -- 172.21.15.92:0/2780519721 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2458005610 con 0x7f2460104ad0 2023-10-16T13:11:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.868+0000 7f2467786700 1 -- 172.21.15.92:0/2780519721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24601a5340 con 0x7f2460104ad0 2023-10-16T13:11:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.868+0000 7f2467786700 1 -- 172.21.15.92:0/2780519721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24601a5850 con 0x7f2460104ad0 2023-10-16T13:11:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.868+0000 7f2467786700 1 -- 172.21.15.92:0/2780519721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24600fcf30 con 0x7f2460104ad0 2023-10-16T13:11:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.870+0000 7f24567fc700 1 -- 172.21.15.92:0/2780519721 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2458005770 con 0x7f2460104ad0 2023-10-16T13:11:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.870+0000 7f24567fc700 1 --2- 172.21.15.92:0/2780519721 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f244c0a15a0 0x7f244c0a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.870+0000 7f2465522700 1 --2- 172.21.15.92:0/2780519721 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f244c0a15a0 0x7f244c0a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.870+0000 7f24567fc700 1 -- 172.21.15.92:0/2780519721 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f24580cc580 con 0x7f2460104ad0 2023-10-16T13:11:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.871+0000 7f2465522700 1 --2- 172.21.15.92:0/2780519721 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f244c0a15a0 0x7f244c0a3a60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f245c000c00 tx=0x7f245c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:06.874+0000 7f24567fc700 1 -- 172.21.15.92:0/2780519721 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2458096080 con 0x7f2460104ad0 2023-10-16T13:11:07.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.067+0000 7f2467786700 1 -- 172.21.15.92:0/2780519721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2460112ee0 con 0x7f2460104ad0 2023-10-16T13:11:07.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.068+0000 7f24567fc700 1 -- 172.21.15.92:0/2780519721 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18422 (secure 0 0 0) 0x7f2458009390 con 0x7f2460104ad0 2023-10-16T13:11:07.070 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:07.071 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":79,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:10:57.822846+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:11:07.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.070+0000 7f2467786700 1 -- 172.21.15.92:0/2780519721 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f244c0a15a0 msgr2=0x7f244c0a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:07.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.070+0000 7f2467786700 1 --2- 172.21.15.92:0/2780519721 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f244c0a15a0 0x7f244c0a3a60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f245c000c00 tx=0x7f245c005fb0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.070+0000 7f2467786700 1 -- 172.21.15.92:0/2780519721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2460104ad0 msgr2=0x7f24601a47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:07.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.070+0000 7f2467786700 1 --2- 172.21.15.92:0/2780519721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2460104ad0 0x7f24601a47c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2458007ee0 tx=0x7f245800d3b0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.070+0000 7f2467786700 1 -- 172.21.15.92:0/2780519721 shutdown_connections 2023-10-16T13:11:07.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.070+0000 7f2467786700 1 --2- 172.21.15.92:0/2780519721 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f244c0a15a0 0x7f244c0a3a60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.070+0000 7f2467786700 1 --2- 172.21.15.92:0/2780519721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2460104ad0 0x7f24601a47c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.070+0000 7f2467786700 1 --2- 172.21.15.92:0/2780519721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24600ff790 0x7f246019d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.070+0000 7f2467786700 1 --2- 172.21.15.92:0/2780519721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2460102100 0x7f246019d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.070+0000 7f2467786700 1 -- 172.21.15.92:0/2780519721 >> 172.21.15.92:0/2780519721 conn(0x7f24600fb3b0 msgr2=0x7f2460102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:07.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.070+0000 7f2467786700 1 -- 172.21.15.92:0/2780519721 shutdown_connections 2023-10-16T13:11:07.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.070+0000 7f2467786700 1 -- 172.21.15.92:0/2780519721 wait complete. 2023-10-16T13:11:07.085 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:07:45.516334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:11:07.085 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:11:07.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.207+0000 7f922ba3a700 1 -- 172.21.15.92:0/2794416168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92240ffdb0 msgr2=0x7f92241001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:07.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.207+0000 7f922ba3a700 1 --2- 172.21.15.92:0/2794416168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92240ffdb0 0x7f92241001d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f92200099c0 tx=0x7f9220009cd0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.207+0000 7f922ba3a700 1 -- 172.21.15.92:0/2794416168 shutdown_connections 2023-10-16T13:11:07.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.207+0000 7f922ba3a700 1 --2- 172.21.15.92:0/2794416168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92240ffdb0 0x7f92241001d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.207+0000 7f922ba3a700 1 --2- 172.21.15.92:0/2794416168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9224101940 0x7f92241081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.207+0000 7f922ba3a700 1 --2- 172.21.15.92:0/2794416168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9224100fa0 0x7f9224101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.207+0000 7f922ba3a700 1 -- 172.21.15.92:0/2794416168 >> 172.21.15.92:0/2794416168 conn(0x7f92240fb320 msgr2=0x7f92240fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:07.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.208+0000 7f922ba3a700 1 -- 172.21.15.92:0/2794416168 shutdown_connections 2023-10-16T13:11:07.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.208+0000 7f922ba3a700 1 -- 172.21.15.92:0/2794416168 wait complete. 2023-10-16T13:11:07.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.208+0000 7f922ba3a700 1 Processor -- start 2023-10-16T13:11:07.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.208+0000 7f922ba3a700 1 -- start start 2023-10-16T13:11:07.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.208+0000 7f922ba3a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92240ffdb0 0x7f9224195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:07.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.208+0000 7f922ba3a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9224100fa0 0x7f9224196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:07.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.208+0000 7f922ba3a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9224101940 0x7f922419d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:07.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.208+0000 7f922ba3a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922419d660 con 0x7f9224100fa0 2023-10-16T13:11:07.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.208+0000 7f922ba3a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922419d7a0 con 0x7f92240ffdb0 2023-10-16T13:11:07.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.208+0000 7f922ba3a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922419d930 con 0x7f9224101940 2023-10-16T13:11:07.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.208+0000 7f9228fd5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9224100fa0 0x7f9224196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:07.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.208+0000 7f9228fd5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9224100fa0 0x7f9224196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34884/0 (socket says 172.21.15.92:34884) 2023-10-16T13:11:07.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.208+0000 7f9228fd5700 1 -- 172.21.15.92:0/4035046503 learned_addr learned my addr 172.21.15.92:0/4035046503 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:07.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.208+0000 7f92297d6700 1 --2- 172.21.15.92:0/4035046503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92240ffdb0 0x7f9224195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:07.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.209+0000 7f9228fd5700 1 -- 172.21.15.92:0/4035046503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9224101940 msgr2=0x7f922419d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:07.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.209+0000 7f9229fd7700 1 --2- 172.21.15.92:0/4035046503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9224101940 0x7f922419d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:07.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.209+0000 7f9228fd5700 1 --2- 172.21.15.92:0/4035046503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9224101940 0x7f922419d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.209+0000 7f9228fd5700 1 -- 172.21.15.92:0/4035046503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92240ffdb0 msgr2=0x7f9224195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:07.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.209+0000 7f9228fd5700 1 --2- 172.21.15.92:0/4035046503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92240ffdb0 0x7f9224195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.209+0000 7f9228fd5700 1 -- 172.21.15.92:0/4035046503 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92200095f0 con 0x7f9224100fa0 2023-10-16T13:11:07.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.209+0000 7f9228fd5700 1 --2- 172.21.15.92:0/4035046503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9224100fa0 0x7f9224196020 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f921400c920 tx=0x7f921400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:07.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.209+0000 7f921a7fc700 1 -- 172.21.15.92:0/4035046503 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9214007b00 con 0x7f9224100fa0 2023-10-16T13:11:07.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.209+0000 7f921a7fc700 1 -- 172.21.15.92:0/4035046503 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f921400ce70 con 0x7f9224100fa0 2023-10-16T13:11:07.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.209+0000 7f922ba3a700 1 -- 172.21.15.92:0/4035046503 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922419dc10 con 0x7f9224100fa0 2023-10-16T13:11:07.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.209+0000 7f921a7fc700 1 -- 172.21.15.92:0/4035046503 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9214005610 con 0x7f9224100fa0 2023-10-16T13:11:07.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.209+0000 7f922ba3a700 1 -- 172.21.15.92:0/4035046503 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922419e170 con 0x7f9224100fa0 2023-10-16T13:11:07.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.210+0000 7f922ba3a700 1 -- 172.21.15.92:0/4035046503 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922410b720 con 0x7f9224100fa0 2023-10-16T13:11:07.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.211+0000 7f921a7fc700 1 -- 172.21.15.92:0/4035046503 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f9214004750 con 0x7f9224100fa0 2023-10-16T13:11:07.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.212+0000 7f921a7fc700 1 --2- 172.21.15.92:0/4035046503 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f92100a1500 0x7f92100a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:07.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.212+0000 7f92297d6700 1 --2- 172.21.15.92:0/4035046503 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f92100a1500 0x7f92100a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:07.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.212+0000 7f921a7fc700 1 -- 172.21.15.92:0/4035046503 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f92140cc770 con 0x7f9224100fa0 2023-10-16T13:11:07.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.212+0000 7f92297d6700 1 --2- 172.21.15.92:0/4035046503 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f92100a1500 0x7f92100a39c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9220009990 tx=0x7f9220003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:07.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.215+0000 7f921a7fc700 1 -- 172.21.15.92:0/4035046503 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9214096250 con 0x7f9224100fa0 2023-10-16T13:11:07.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.405+0000 7f922ba3a700 1 -- 172.21.15.92:0/4035046503 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9224106c80 con 0x7f9224100fa0 2023-10-16T13:11:07.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.406+0000 7f921a7fc700 1 -- 172.21.15.92:0/4035046503 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f921401d0a0 con 0x7f9224100fa0 2023-10-16T13:11:07.408 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-10-16T13:11:07.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.408+0000 7f922ba3a700 1 -- 172.21.15.92:0/4035046503 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f92100a1500 msgr2=0x7f92100a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:07.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.408+0000 7f922ba3a700 1 --2- 172.21.15.92:0/4035046503 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f92100a1500 0x7f92100a39c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9220009990 tx=0x7f9220003680 comp rx=0 tx=0).stop 2023-10-16T13:11:07.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.408+0000 7f922ba3a700 1 -- 172.21.15.92:0/4035046503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9224100fa0 msgr2=0x7f9224196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:07.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.408+0000 7f922ba3a700 1 --2- 172.21.15.92:0/4035046503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9224100fa0 0x7f9224196020 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f921400c920 tx=0x7f921400cc30 comp rx=0 tx=0).stop 2023-10-16T13:11:07.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.408+0000 7f922ba3a700 1 -- 172.21.15.92:0/4035046503 shutdown_connections 2023-10-16T13:11:07.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.408+0000 7f922ba3a700 1 --2- 172.21.15.92:0/4035046503 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f92100a1500 0x7f92100a39c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.408+0000 7f922ba3a700 1 --2- 172.21.15.92:0/4035046503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9224101940 0x7f922419d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.408+0000 7f922ba3a700 1 --2- 172.21.15.92:0/4035046503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92240ffdb0 0x7f9224195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.408+0000 7f922ba3a700 1 --2- 172.21.15.92:0/4035046503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9224100fa0 0x7f9224196020 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.408+0000 7f922ba3a700 1 -- 172.21.15.92:0/4035046503 >> 172.21.15.92:0/4035046503 conn(0x7f92240fb320 msgr2=0x7f92240fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:07.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.408+0000 7f922ba3a700 1 -- 172.21.15.92:0/4035046503 shutdown_connections 2023-10-16T13:11:07.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.408+0000 7f922ba3a700 1 -- 172.21.15.92:0/4035046503 wait complete. 2023-10-16T13:11:07.421 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:07 smithi092 ceph-mon[99542]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi118=b;smithi118=e;smithi118=h;smithi118=k;smithi152=c;smithi152=f;smithi152=i;smithi152=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:11:07.421 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:07 smithi092 ceph-mon[99542]: Saving service mds.all spec with placement smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi118=b;smithi118=e;smithi118=h;smithi118=k;smithi152=c;smithi152=f;smithi152=i;smithi152=l;count:12 2023-10-16T13:11:07.421 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:07 smithi092 ceph-mon[99542]: Deploying daemon mds.l on smithi152 2023-10-16T13:11:07.421 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:07 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2780519721' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:07.422 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:11:07.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.542+0000 7f6c0a525700 1 -- 172.21.15.92:0/3263372929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c040ff560 msgr2=0x7f6c040ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:07.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.542+0000 7f6c0a525700 1 --2- 172.21.15.92:0/3263372929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c040ff560 0x7f6c040ff980 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4009990 tx=0x7f6bf4009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.542+0000 7f6c0a525700 1 -- 172.21.15.92:0/3263372929 shutdown_connections 2023-10-16T13:11:07.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.542+0000 7f6c0a525700 1 --2- 172.21.15.92:0/3263372929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c040ff560 0x7f6c040ff980 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.542+0000 7f6c0a525700 1 --2- 172.21.15.92:0/3263372929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c041010f0 0x7f6c041079a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.542+0000 7f6c0a525700 1 --2- 172.21.15.92:0/3263372929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c04100750 0x7f6c04100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.542+0000 7f6c0a525700 1 -- 172.21.15.92:0/3263372929 >> 172.21.15.92:0/3263372929 conn(0x7f6c040faab0 msgr2=0x7f6c040fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:07.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.542+0000 7f6c0a525700 1 -- 172.21.15.92:0/3263372929 shutdown_connections 2023-10-16T13:11:07.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.542+0000 7f6c0a525700 1 -- 172.21.15.92:0/3263372929 wait complete. 2023-10-16T13:11:07.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.542+0000 7f6c0a525700 1 Processor -- start 2023-10-16T13:11:07.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.542+0000 7f6c0a525700 1 -- start start 2023-10-16T13:11:07.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.543+0000 7f6c0a525700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c040ff560 0x7f6c04195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:07.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.543+0000 7f6c0a525700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c04100750 0x7f6c04196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:07.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.543+0000 7f6c0a525700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c041010f0 0x7f6c0419d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:07.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.543+0000 7f6c0a525700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0419d6d0 con 0x7f6c040ff560 2023-10-16T13:11:07.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.543+0000 7f6c0a525700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0419d810 con 0x7f6c04100750 2023-10-16T13:11:07.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.543+0000 7f6c0a525700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0419d9a0 con 0x7f6c041010f0 2023-10-16T13:11:07.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.543+0000 7f6c03fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c040ff560 0x7f6c04195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:07.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.543+0000 7f6c03fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c040ff560 0x7f6c04195b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34896/0 (socket says 172.21.15.92:34896) 2023-10-16T13:11:07.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.543+0000 7f6c03fff700 1 -- 172.21.15.92:0/269540249 learned_addr learned my addr 172.21.15.92:0/269540249 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:07.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.543+0000 7f6c08ac2700 1 --2- 172.21.15.92:0/269540249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c041010f0 0x7f6c0419d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:07.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.543+0000 7f6c037fe700 1 --2- 172.21.15.92:0/269540249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c04100750 0x7f6c04196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:07.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.543+0000 7f6c03fff700 1 -- 172.21.15.92:0/269540249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c041010f0 msgr2=0x7f6c0419d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:07.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.543+0000 7f6c03fff700 1 --2- 172.21.15.92:0/269540249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c041010f0 0x7f6c0419d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.543+0000 7f6c03fff700 1 -- 172.21.15.92:0/269540249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c04100750 msgr2=0x7f6c04196090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:07.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.543+0000 7f6c03fff700 1 --2- 172.21.15.92:0/269540249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c04100750 0x7f6c04196090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.543+0000 7f6c03fff700 1 -- 172.21.15.92:0/269540249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf40095f0 con 0x7f6c040ff560 2023-10-16T13:11:07.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.543+0000 7f6c03fff700 1 --2- 172.21.15.92:0/269540249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c040ff560 0x7f6c04195b50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4004800 tx=0x7f6bf4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:07.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.543+0000 7f6c017fa700 1 -- 172.21.15.92:0/269540249 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf401d070 con 0x7f6c040ff560 2023-10-16T13:11:07.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.544+0000 7f6c017fa700 1 -- 172.21.15.92:0/269540249 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6bf400bed0 con 0x7f6c040ff560 2023-10-16T13:11:07.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.544+0000 7f6c0a525700 1 -- 172.21.15.92:0/269540249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0419dc20 con 0x7f6c040ff560 2023-10-16T13:11:07.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.544+0000 7f6c017fa700 1 -- 172.21.15.92:0/269540249 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4017650 con 0x7f6c040ff560 2023-10-16T13:11:07.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.544+0000 7f6c0a525700 1 -- 172.21.15.92:0/269540249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0419e040 con 0x7f6c040ff560 2023-10-16T13:11:07.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.545+0000 7f6c0a525700 1 -- 172.21.15.92:0/269540249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c04106a50 con 0x7f6c040ff560 2023-10-16T13:11:07.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.546+0000 7f6c017fa700 1 -- 172.21.15.92:0/269540249 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6bf4021410 con 0x7f6c040ff560 2023-10-16T13:11:07.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.546+0000 7f6c017fa700 1 --2- 172.21.15.92:0/269540249 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6bf00a1520 0x7f6bf00a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.547+0000 7f6c037fe700 1 --2- 172.21.15.92:0/269540249 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6bf00a1520 0x7f6bf00a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.547+0000 7f6c017fa700 1 -- 172.21.15.92:0/269540249 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6bf40cdee0 con 0x7f6c040ff560 2023-10-16T13:11:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.547+0000 7f6c037fe700 1 --2- 172.21.15.92:0/269540249 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6bf00a1520 0x7f6bf00a39e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6bec009c60 tx=0x7f6bec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.550+0000 7f6c017fa700 1 -- 172.21.15.92:0/269540249 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6bf4097a70 con 0x7f6c040ff560 2023-10-16T13:11:07.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:07 smithi152 ceph-mon[104423]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi118=b;smithi118=e;smithi118=h;smithi118=k;smithi152=c;smithi152=f;smithi152=i;smithi152=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:11:07.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:07 smithi152 ceph-mon[104423]: Saving service mds.all spec with placement smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi118=b;smithi118=e;smithi118=h;smithi118=k;smithi152=c;smithi152=f;smithi152=i;smithi152=l;count:12 2023-10-16T13:11:07.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:07 smithi152 ceph-mon[104423]: Deploying daemon mds.l on smithi152 2023-10-16T13:11:07.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:07 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2780519721' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:07.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:07 smithi118 ceph-mon[103969]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi118=b;smithi118=e;smithi118=h;smithi118=k;smithi152=c;smithi152=f;smithi152=i;smithi152=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:11:07.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:07 smithi118 ceph-mon[103969]: Saving service mds.all spec with placement smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi118=b;smithi118=e;smithi118=h;smithi118=k;smithi152=c;smithi152=f;smithi152=i;smithi152=l;count:12 2023-10-16T13:11:07.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:07 smithi118 ceph-mon[103969]: Deploying daemon mds.l on smithi152 2023-10-16T13:11:07.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:07 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2780519721' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:07.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.786+0000 7f6c0a525700 1 -- 172.21.15.92:0/269540249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c0410b9f0 con 0x7f6c040ff560 2023-10-16T13:11:07.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.786+0000 7f6c017fa700 1 -- 172.21.15.92:0/269540249 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f6bf409b090 con 0x7f6c040ff560 2023-10-16T13:11:07.788 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:07.788 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-10-16T13:11:07.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.788+0000 7f6c0a525700 1 -- 172.21.15.92:0/269540249 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6bf00a1520 msgr2=0x7f6bf00a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:07.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.788+0000 7f6c0a525700 1 --2- 172.21.15.92:0/269540249 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6bf00a1520 0x7f6bf00a39e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6bec009c60 tx=0x7f6bec009260 comp rx=0 tx=0).stop 2023-10-16T13:11:07.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.788+0000 7f6c0a525700 1 -- 172.21.15.92:0/269540249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c040ff560 msgr2=0x7f6c04195b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:07.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.788+0000 7f6c0a525700 1 --2- 172.21.15.92:0/269540249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c040ff560 0x7f6c04195b50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4004800 tx=0x7f6bf4009580 comp rx=0 tx=0).stop 2023-10-16T13:11:07.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.788+0000 7f6c0a525700 1 -- 172.21.15.92:0/269540249 shutdown_connections 2023-10-16T13:11:07.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.788+0000 7f6c0a525700 1 --2- 172.21.15.92:0/269540249 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6bf00a1520 0x7f6bf00a39e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.788+0000 7f6c0a525700 1 --2- 172.21.15.92:0/269540249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c040ff560 0x7f6c04195b50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.788+0000 7f6c0a525700 1 --2- 172.21.15.92:0/269540249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c041010f0 0x7f6c0419d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.788+0000 7f6c0a525700 1 --2- 172.21.15.92:0/269540249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c04100750 0x7f6c04196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:07.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.788+0000 7f6c0a525700 1 -- 172.21.15.92:0/269540249 >> 172.21.15.92:0/269540249 conn(0x7f6c040faab0 msgr2=0x7f6c04103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:07.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.788+0000 7f6c0a525700 1 -- 172.21.15.92:0/269540249 shutdown_connections 2023-10-16T13:11:07.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:07.788+0000 7f6c0a525700 1 -- 172.21.15.92:0/269540249 wait complete. 2023-10-16T13:11:07.793 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 1 2023-10-16T13:11:07.942 INFO:journalctl@ceph.mds.l.smithi152.stdout:Oct 16 13:11:07 smithi152 systemd[1]: Starting Ceph mds.l for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:11:08.242 INFO:journalctl@ceph.mds.l.smithi152.stdout:Oct 16 13:11:07 smithi152 podman[141312]: 2023-10-16T13:11:08.693 INFO:journalctl@ceph.mds.l.smithi152.stdout:Oct 16 13:11:08 smithi152 ceph-mds[141352]: -- 172.21.15.152:0/2101614767 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fca2fa31e0 con 0x55fca2f78800 2023-10-16T13:11:08.693 INFO:journalctl@ceph.mds.l.smithi152.stdout:Oct 16 13:11:08 smithi152 bash[141312]: a7c483e826efee7be44bad8638458b5d69be44fbfecef2561d08ec763f08b39a 2023-10-16T13:11:08.693 INFO:journalctl@ceph.mds.l.smithi152.stdout:Oct 16 13:11:08 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-l[141328]: starting mds.l at 2023-10-16T13:11:08.693 INFO:journalctl@ceph.mds.l.smithi152.stdout:Oct 16 13:11:08 smithi152 systemd[1]: Started Ceph mds.l for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:11:08.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:08 smithi152 ceph-mon[104423]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:08.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:08 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/4035046503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:11:08.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:08 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/269540249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:08.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:08 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] up:boot 2023-10-16T13:11:08.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:08 smithi152 ceph-mon[104423]: fsmap 1 up:standby 2023-10-16T13:11:08.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:08 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-16T13:11:08.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:08 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:08.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:08 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:08.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:08 smithi092 ceph-mon[99542]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:08.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:08 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/4035046503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:11:08.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:08 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/269540249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:08.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:08 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] up:boot 2023-10-16T13:11:08.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:08 smithi092 ceph-mon[99542]: fsmap 1 up:standby 2023-10-16T13:11:08.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:08 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-16T13:11:08.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:08 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:08.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:08 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:08.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:08 smithi118 ceph-mon[103969]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:08.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:08 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/4035046503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:11:08.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:08 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/269540249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:08.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:08 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] up:boot 2023-10-16T13:11:08.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:08 smithi118 ceph-mon[103969]: fsmap 1 up:standby 2023-10-16T13:11:08.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:08 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-16T13:11:08.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:08 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:08.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:08 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:09.651 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:09 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:09.652 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:09 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:09.652 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:09 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:09.652 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:09 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:09.652 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:09 smithi118 ceph-mon[103969]: Deploying daemon mds.k on smithi118 2023-10-16T13:11:09.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:09 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:09.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:09 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:09.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:09 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:09.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:09 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:09.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:09 smithi152 ceph-mon[104423]: Deploying daemon mds.k on smithi118 2023-10-16T13:11:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:09 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:09 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:09 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:09 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:09.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:09 smithi092 ceph-mon[99542]: Deploying daemon mds.k on smithi118 2023-10-16T13:11:09.803 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:11:09.939 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.937+0000 7f5819774700 1 -- 172.21.15.92:0/996721385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58141007b0 msgr2=0x7f5814100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:09.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.937+0000 7f5819774700 1 --2- 172.21.15.92:0/996721385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58141007b0 0x7f5814100c10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00aad0 tx=0x7f57fc00ade0 comp rx=0 tx=0).stop 2023-10-16T13:11:09.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.937+0000 7f5819774700 1 -- 172.21.15.92:0/996721385 shutdown_connections 2023-10-16T13:11:09.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.937+0000 7f5819774700 1 --2- 172.21.15.92:0/996721385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5814101150 0x7f5814107a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:09.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.937+0000 7f5819774700 1 --2- 172.21.15.92:0/996721385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58140ff5c0 0x7f58140ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:09.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.937+0000 7f5819774700 1 --2- 172.21.15.92:0/996721385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58141007b0 0x7f5814100c10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:09.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.937+0000 7f5819774700 1 -- 172.21.15.92:0/996721385 >> 172.21.15.92:0/996721385 conn(0x7f58140fab30 msgr2=0x7f58140fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:09.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.937+0000 7f5819774700 1 -- 172.21.15.92:0/996721385 shutdown_connections 2023-10-16T13:11:09.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.937+0000 7f5819774700 1 -- 172.21.15.92:0/996721385 wait complete. 2023-10-16T13:11:09.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.938+0000 7f5819774700 1 Processor -- start 2023-10-16T13:11:09.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.938+0000 7f5819774700 1 -- start start 2023-10-16T13:11:09.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.939+0000 7f5819774700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58140ff5c0 0x7f5814196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:09.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.939+0000 7f5819774700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58141007b0 0x7f5814197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:09.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.939+0000 7f5819774700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5814101150 0x7f581419e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:09.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.939+0000 7f5819774700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581419e760 con 0x7f58140ff5c0 2023-10-16T13:11:09.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.939+0000 7f5819774700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581419e8a0 con 0x7f5814101150 2023-10-16T13:11:09.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.939+0000 7f5819774700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581419ea30 con 0x7f58141007b0 2023-10-16T13:11:09.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.939+0000 7f5812ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58140ff5c0 0x7f5814196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:09.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.939+0000 7f5812ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58140ff5c0 0x7f5814196be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34910/0 (socket says 172.21.15.92:34910) 2023-10-16T13:11:09.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.939+0000 7f5812ffd700 1 -- 172.21.15.92:0/3737467909 learned_addr learned my addr 172.21.15.92:0/3737467909 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:09.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.939+0000 7f58127fc700 1 --2- 172.21.15.92:0/3737467909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58141007b0 0x7f5814197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:09.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.939+0000 7f58137fe700 1 --2- 172.21.15.92:0/3737467909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5814101150 0x7f581419e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:09.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.939+0000 7f5812ffd700 1 -- 172.21.15.92:0/3737467909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58141007b0 msgr2=0x7f5814197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:09.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.939+0000 7f5812ffd700 1 --2- 172.21.15.92:0/3737467909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58141007b0 0x7f5814197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:09.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.939+0000 7f5812ffd700 1 -- 172.21.15.92:0/3737467909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5814101150 msgr2=0x7f581419e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:09.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.939+0000 7f5812ffd700 1 --2- 172.21.15.92:0/3737467909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5814101150 0x7f581419e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:09.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.939+0000 7f5812ffd700 1 -- 172.21.15.92:0/3737467909 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57fc00a700 con 0x7f58140ff5c0 2023-10-16T13:11:09.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.939+0000 7f5812ffd700 1 --2- 172.21.15.92:0/3737467909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58140ff5c0 0x7f5814196be0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f580400d980 tx=0x7f580400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:09.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.939+0000 7f580bfff700 1 -- 172.21.15.92:0/3737467909 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580400f890 con 0x7f58140ff5c0 2023-10-16T13:11:09.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.940+0000 7f5819774700 1 -- 172.21.15.92:0/3737467909 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581419ed10 con 0x7f58140ff5c0 2023-10-16T13:11:09.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.940+0000 7f580bfff700 1 -- 172.21.15.92:0/3737467909 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5804010460 con 0x7f58140ff5c0 2023-10-16T13:11:09.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.940+0000 7f580bfff700 1 -- 172.21.15.92:0/3737467909 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58040195c0 con 0x7f58140ff5c0 2023-10-16T13:11:09.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.940+0000 7f5819774700 1 -- 172.21.15.92:0/3737467909 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581419f1d0 con 0x7f58140ff5c0 2023-10-16T13:11:09.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.941+0000 7f5819774700 1 -- 172.21.15.92:0/3737467909 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f581410a6f0 con 0x7f58140ff5c0 2023-10-16T13:11:09.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.942+0000 7f580bfff700 1 -- 172.21.15.92:0/3737467909 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5804010940 con 0x7f58140ff5c0 2023-10-16T13:11:09.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.942+0000 7f580bfff700 1 --2- 172.21.15.92:0/3737467909 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f58000a15a0 0x7f58000a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:09.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.943+0000 7f58127fc700 1 --2- 172.21.15.92:0/3737467909 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f58000a15a0 0x7f58000a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:09.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.943+0000 7f580bfff700 1 -- 172.21.15.92:0/3737467909 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f58040ccbc0 con 0x7f58140ff5c0 2023-10-16T13:11:09.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.943+0000 7f58127fc700 1 --2- 172.21.15.92:0/3737467909 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f58000a15a0 0x7f58000a3a60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f57fc000c00 tx=0x7f57fc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:09.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:09.946+0000 7f580bfff700 1 -- 172.21.15.92:0/3737467909 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5804096620 con 0x7f58140ff5c0 2023-10-16T13:11:10.034 INFO:journalctl@ceph.mds.k.smithi118.stdout:Oct 16 13:11:09 smithi118 systemd[1]: Starting Ceph mds.k for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:11:10.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:10.180+0000 7f5819774700 1 -- 172.21.15.92:0/3737467909 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5814106320 con 0x7f58140ff5c0 2023-10-16T13:11:10.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:10.181+0000 7f580bfff700 1 -- 172.21.15.92:0/3737467909 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7f58040105d0 con 0x7f58140ff5c0 2023-10-16T13:11:10.183 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:10.183 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-16T13:11:10.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:10.183+0000 7f5819774700 1 -- 172.21.15.92:0/3737467909 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f58000a15a0 msgr2=0x7f58000a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:10.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:10.183+0000 7f5819774700 1 --2- 172.21.15.92:0/3737467909 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f58000a15a0 0x7f58000a3a60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f57fc000c00 tx=0x7f57fc005fb0 comp rx=0 tx=0).stop 2023-10-16T13:11:10.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:10.183+0000 7f5819774700 1 -- 172.21.15.92:0/3737467909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58140ff5c0 msgr2=0x7f5814196be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:10.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:10.183+0000 7f5819774700 1 --2- 172.21.15.92:0/3737467909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58140ff5c0 0x7f5814196be0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f580400d980 tx=0x7f580400dc90 comp rx=0 tx=0).stop 2023-10-16T13:11:10.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:10.183+0000 7f5819774700 1 -- 172.21.15.92:0/3737467909 shutdown_connections 2023-10-16T13:11:10.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:10.183+0000 7f5819774700 1 --2- 172.21.15.92:0/3737467909 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f58000a15a0 0x7f58000a3a60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:10.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:10.183+0000 7f5819774700 1 --2- 172.21.15.92:0/3737467909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58140ff5c0 0x7f5814196be0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:10.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:10.183+0000 7f5819774700 1 --2- 172.21.15.92:0/3737467909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5814101150 0x7f581419e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:10.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:10.183+0000 7f5819774700 1 --2- 172.21.15.92:0/3737467909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58141007b0 0x7f5814197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:10.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:10.183+0000 7f5819774700 1 -- 172.21.15.92:0/3737467909 >> 172.21.15.92:0/3737467909 conn(0x7f58140fab30 msgr2=0x7f58140fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:10.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:10.183+0000 7f5819774700 1 -- 172.21.15.92:0/3737467909 shutdown_connections 2023-10-16T13:11:10.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:10.183+0000 7f5819774700 1 -- 172.21.15.92:0/3737467909 wait complete. 2023-10-16T13:11:10.187 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 2 2023-10-16T13:11:10.332 INFO:journalctl@ceph.mds.k.smithi118.stdout:Oct 16 13:11:10 smithi118 podman[140364]: 2023-10-16T13:11:10.332 INFO:journalctl@ceph.mds.k.smithi118.stdout:Oct 16 13:11:10 smithi118 bash[140364]: 1c555bd4281f7a6c3bda11d5b8c664fe8bcadf8ef392ab499c1d62579c1f1d5e 2023-10-16T13:11:10.333 INFO:journalctl@ceph.mds.k.smithi118.stdout:Oct 16 13:11:10 smithi118 ceph-mds[140404]: -- 172.21.15.118:0/2798319498 <== mon.2 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557fbefed1e0 con 0x557fbefc2c00 2023-10-16T13:11:10.333 INFO:journalctl@ceph.mds.k.smithi118.stdout:Oct 16 13:11:10 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-k[140380]: starting mds.k at 2023-10-16T13:11:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:10 smithi092 ceph-mon[99542]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:10 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3737467909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:10.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:10 smithi152 ceph-mon[104423]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:10.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:10 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3737467909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:10.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:10 smithi118 ceph-mon[103969]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:10.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:10 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3737467909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:10.784 INFO:journalctl@ceph.mds.k.smithi118.stdout:Oct 16 13:11:10 smithi118 systemd[1]: Started Ceph mds.k for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:11:11.690 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:11 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:11.691 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:11 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:11.691 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:11 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:11.691 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:11 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:11.691 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:11 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:11.692 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:11 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:11.692 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:11 smithi092 ceph-mon[99542]: Deploying daemon mds.j on smithi092 2023-10-16T13:11:11.692 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:11 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.118:6832/1243983806,v1:172.21.15.118:6833/1243983806] up:boot 2023-10-16T13:11:11.692 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:11 smithi092 ceph-mon[99542]: fsmap 2 up:standby 2023-10-16T13:11:11.692 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:11 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-16T13:11:11.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:11 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:11.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:11 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:11.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:11 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:11.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:11 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:11.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:11 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:11.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:11 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:11.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:11 smithi152 ceph-mon[104423]: Deploying daemon mds.j on smithi092 2023-10-16T13:11:11.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:11 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.118:6832/1243983806,v1:172.21.15.118:6833/1243983806] up:boot 2023-10-16T13:11:11.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:11 smithi152 ceph-mon[104423]: fsmap 2 up:standby 2023-10-16T13:11:11.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:11 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-16T13:11:11.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:11 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:11.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:11 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:11.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:11 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:11.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:11 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:11.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:11 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:11.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:11 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:11.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:11 smithi118 ceph-mon[103969]: Deploying daemon mds.j on smithi092 2023-10-16T13:11:11.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:11 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.118:6832/1243983806,v1:172.21.15.118:6833/1243983806] up:boot 2023-10-16T13:11:11.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:11 smithi118 ceph-mon[103969]: fsmap 2 up:standby 2023-10-16T13:11:11.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:11 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-16T13:11:12.197 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:11:12.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.322+0000 7f8fc1129700 1 -- 172.21.15.92:0/1213774816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fbc102b10 msgr2=0x7f8fbc1093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:12.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.322+0000 7f8fc1129700 1 --2- 172.21.15.92:0/1213774816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fbc102b10 0x7f8fbc1093c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400b0a0 tx=0x7f8fb400b3b0 comp rx=0 tx=0).stop 2023-10-16T13:11:12.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.322+0000 7f8fc1129700 1 -- 172.21.15.92:0/1213774816 shutdown_connections 2023-10-16T13:11:12.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.322+0000 7f8fc1129700 1 --2- 172.21.15.92:0/1213774816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fbc102b10 0x7f8fbc1093c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:12.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.322+0000 7f8fc1129700 1 --2- 172.21.15.92:0/1213774816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fbc0ff1a0 0x7f8fbc0ff5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:12.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.322+0000 7f8fc1129700 1 --2- 172.21.15.92:0/1213774816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fbc102170 0x7f8fbc1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.322+0000 7f8fc1129700 1 -- 172.21.15.92:0/1213774816 >> 172.21.15.92:0/1213774816 conn(0x7f8fbc0faab0 msgr2=0x7f8fbc0fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.322+0000 7f8fc1129700 1 -- 172.21.15.92:0/1213774816 shutdown_connections 2023-10-16T13:11:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.322+0000 7f8fc1129700 1 -- 172.21.15.92:0/1213774816 wait complete. 2023-10-16T13:11:12.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.323+0000 7f8fc1129700 1 Processor -- start 2023-10-16T13:11:12.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.323+0000 7f8fc1129700 1 -- start start 2023-10-16T13:11:12.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fc1129700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fbc0ff1a0 0x7f8fbc101ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:12.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fc1129700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fbc102170 0x7f8fbc100120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:12.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fc1129700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fbc102b10 0x7f8fbc100660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:12.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fc1129700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc100e00 con 0x7f8fbc102b10 2023-10-16T13:11:12.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fc1129700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc100f70 con 0x7f8fbc102170 2023-10-16T13:11:12.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fc1129700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc1a0ea0 con 0x7f8fbc0ff1a0 2023-10-16T13:11:12.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fbb59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fbc102b10 0x7f8fbc100660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:12.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fbb59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fbc102b10 0x7f8fbc100660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34926/0 (socket says 172.21.15.92:34926) 2023-10-16T13:11:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fbb59e700 1 -- 172.21.15.92:0/2366618661 learned_addr learned my addr 172.21.15.92:0/2366618661 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fba59c700 1 --2- 172.21.15.92:0/2366618661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fbc102170 0x7f8fbc100120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fbad9d700 1 --2- 172.21.15.92:0/2366618661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fbc0ff1a0 0x7f8fbc101ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fbb59e700 1 -- 172.21.15.92:0/2366618661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fbc0ff1a0 msgr2=0x7f8fbc101ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fbb59e700 1 --2- 172.21.15.92:0/2366618661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fbc0ff1a0 0x7f8fbc101ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fbb59e700 1 -- 172.21.15.92:0/2366618661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fbc102170 msgr2=0x7f8fbc100120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fbb59e700 1 --2- 172.21.15.92:0/2366618661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fbc102170 0x7f8fbc100120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fbb59e700 1 -- 172.21.15.92:0/2366618661 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb4009d00 con 0x7f8fbc102b10 2023-10-16T13:11:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fbad9d700 1 --2- 172.21.15.92:0/2366618661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fbc0ff1a0 0x7f8fbc101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:11:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fbb59e700 1 --2- 172.21.15.92:0/2366618661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fbc102b10 0x7f8fbc100660 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400b070 tx=0x7f8fb4004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fa3fff700 1 -- 172.21.15.92:0/2366618661 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb400e040 con 0x7f8fbc102b10 2023-10-16T13:11:12.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fa3fff700 1 -- 172.21.15.92:0/2366618661 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8fb401bb30 con 0x7f8fbc102b10 2023-10-16T13:11:12.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fc1129700 1 -- 172.21.15.92:0/2366618661 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fbc1a1120 con 0x7f8fbc102b10 2023-10-16T13:11:12.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.324+0000 7f8fa3fff700 1 -- 172.21.15.92:0/2366618661 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4005930 con 0x7f8fbc102b10 2023-10-16T13:11:12.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.325+0000 7f8fc1129700 1 -- 172.21.15.92:0/2366618661 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fbc1a1620 con 0x7f8fbc102b10 2023-10-16T13:11:12.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.325+0000 7f8fc1129700 1 -- 172.21.15.92:0/2366618661 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fbc108420 con 0x7f8fbc102b10 2023-10-16T13:11:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.326+0000 7f8fa3fff700 1 -- 172.21.15.92:0/2366618661 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8fb4005040 con 0x7f8fbc102b10 2023-10-16T13:11:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.327+0000 7f8fa3fff700 1 --2- 172.21.15.92:0/2366618661 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f8fa40a1520 0x7f8fa40a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.327+0000 7f8fbad9d700 1 --2- 172.21.15.92:0/2366618661 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f8fa40a1520 0x7f8fa40a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.327+0000 7f8fa3fff700 1 -- 172.21.15.92:0/2366618661 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8fb40cef50 con 0x7f8fbc102b10 2023-10-16T13:11:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.327+0000 7f8fbad9d700 1 --2- 172.21.15.92:0/2366618661 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f8fa40a1520 0x7f8fa40a39e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc067e40 tx=0x7f8fb0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.331+0000 7f8fa3fff700 1 -- 172.21.15.92:0/2366618661 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8fb4098ae0 con 0x7f8fbc102b10 2023-10-16T13:11:12.347 INFO:journalctl@ceph.mds.j.smithi092.stdout:Oct 16 13:11:12 smithi092 systemd[1]: Starting Ceph mds.j for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:11:12.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.583+0000 7f8fc1129700 1 -- 172.21.15.92:0/2366618661 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fbc02d1c0 con 0x7f8fbc102b10 2023-10-16T13:11:12.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.583+0000 7f8fa3fff700 1 -- 172.21.15.92:0/2366618661 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2122 (secure 0 0 0) 0x7f8fb409c100 con 0x7f8fbc102b10 2023-10-16T13:11:12.587 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:12.587 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-16T13:11:12.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.585+0000 7f8fc1129700 1 -- 172.21.15.92:0/2366618661 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f8fa40a1520 msgr2=0x7f8fa40a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:12.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.585+0000 7f8fc1129700 1 --2- 172.21.15.92:0/2366618661 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f8fa40a1520 0x7f8fa40a39e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc067e40 tx=0x7f8fb0008040 comp rx=0 tx=0).stop 2023-10-16T13:11:12.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.585+0000 7f8fc1129700 1 -- 172.21.15.92:0/2366618661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fbc102b10 msgr2=0x7f8fbc100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:12.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.585+0000 7f8fc1129700 1 --2- 172.21.15.92:0/2366618661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fbc102b10 0x7f8fbc100660 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400b070 tx=0x7f8fb4004a50 comp rx=0 tx=0).stop 2023-10-16T13:11:12.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.585+0000 7f8fc1129700 1 -- 172.21.15.92:0/2366618661 shutdown_connections 2023-10-16T13:11:12.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.585+0000 7f8fc1129700 1 --2- 172.21.15.92:0/2366618661 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f8fa40a1520 0x7f8fa40a39e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:12.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.585+0000 7f8fc1129700 1 --2- 172.21.15.92:0/2366618661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fbc102b10 0x7f8fbc100660 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:12.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.585+0000 7f8fc1129700 1 --2- 172.21.15.92:0/2366618661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fbc0ff1a0 0x7f8fbc101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:12.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.585+0000 7f8fc1129700 1 --2- 172.21.15.92:0/2366618661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fbc102170 0x7f8fbc100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:12.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.585+0000 7f8fc1129700 1 -- 172.21.15.92:0/2366618661 >> 172.21.15.92:0/2366618661 conn(0x7f8fbc0faab0 msgr2=0x7f8fbc105560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:12.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.586+0000 7f8fc1129700 1 -- 172.21.15.92:0/2366618661 shutdown_connections 2023-10-16T13:11:12.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:12.586+0000 7f8fc1129700 1 -- 172.21.15.92:0/2366618661 wait complete. 2023-10-16T13:11:12.591 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 3 2023-10-16T13:11:12.600 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:12 smithi092 ceph-mon[99542]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:12.600 INFO:journalctl@ceph.mds.j.smithi092.stdout:Oct 16 13:11:12 smithi092 podman[149366]: 2023-10-16T13:11:12.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:12 smithi152 ceph-mon[104423]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:12.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:12 smithi118 ceph-mon[103969]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:12.997 INFO:journalctl@ceph.mds.j.smithi092.stdout:Oct 16 13:11:12 smithi092 ceph-mds[149449]: -- 172.21.15.92:0/4169535754 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b19ac7f1e0 con 0x55b19ac55000 2023-10-16T13:11:12.997 INFO:journalctl@ceph.mds.j.smithi092.stdout:Oct 16 13:11:12 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-j[149425]: starting mds.j at 2023-10-16T13:11:12.997 INFO:journalctl@ceph.mds.j.smithi092.stdout:Oct 16 13:11:12 smithi092 bash[149366]: ccf9ecd8ad63f80fa315ebc9cb949213c6a4f70c630897c0dd15cda7d3f011d0 2023-10-16T13:11:12.997 INFO:journalctl@ceph.mds.j.smithi092.stdout:Oct 16 13:11:12 smithi092 systemd[1]: Started Ceph mds.j for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:11:13.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:13 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2366618661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:13.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:13 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:13.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:13 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:13.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:13 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:13.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:13 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:13.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:13 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:13.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:13 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:13 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2366618661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:13 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:13 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:13 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:13 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:13.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:13 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:13.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:13 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:13.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:13 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2366618661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:13.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:13 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:13.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:13 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:13.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:13 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:13.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:13 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:13.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:13 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:13.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:13 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:14.415 INFO:journalctl@ceph.mds.d.smithi092.stdout:Oct 16 13:11:14 smithi092 systemd[1]: Starting Ceph mds.d for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:11:14.602 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:11:14.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:14 smithi152 ceph-mon[104423]: Deploying daemon mds.d on smithi092 2023-10-16T13:11:14.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:14 smithi152 ceph-mon[104423]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:14.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:14 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.92:6834/1011037392,v1:172.21.15.92:6835/1011037392] up:boot 2023-10-16T13:11:14.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:14 smithi152 ceph-mon[104423]: fsmap 3 up:standby 2023-10-16T13:11:14.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:14 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-16T13:11:14.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.730+0000 7f79f9a7b700 1 -- 172.21.15.92:0/3154352902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79f4100fc0 msgr2=0x7f79f4101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:14.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.730+0000 7f79f9a7b700 1 --2- 172.21.15.92:0/3154352902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79f4100fc0 0x7f79f4101420 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f79e40099c0 tx=0x7f79e4009cd0 comp rx=0 tx=0).stop 2023-10-16T13:11:14.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.730+0000 7f79f9a7b700 1 -- 172.21.15.92:0/3154352902 shutdown_connections 2023-10-16T13:11:14.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.730+0000 7f79f9a7b700 1 --2- 172.21.15.92:0/3154352902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79f4101960 0x7f79f4108210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:14.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.730+0000 7f79f9a7b700 1 --2- 172.21.15.92:0/3154352902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79f40ffdd0 0x7f79f41001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:14.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.730+0000 7f79f9a7b700 1 --2- 172.21.15.92:0/3154352902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79f4100fc0 0x7f79f4101420 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:14.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.730+0000 7f79f9a7b700 1 -- 172.21.15.92:0/3154352902 >> 172.21.15.92:0/3154352902 conn(0x7f79f40fb320 msgr2=0x7f79f40fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:14.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.730+0000 7f79f9a7b700 1 -- 172.21.15.92:0/3154352902 shutdown_connections 2023-10-16T13:11:14.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.730+0000 7f79f9a7b700 1 -- 172.21.15.92:0/3154352902 wait complete. 2023-10-16T13:11:14.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.731+0000 7f79f9a7b700 1 Processor -- start 2023-10-16T13:11:14.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.731+0000 7f79f9a7b700 1 -- start start 2023-10-16T13:11:14.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.731+0000 7f79f9a7b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79f40ffdd0 0x7f79f4103d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.731+0000 7f79f9a7b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79f4100fc0 0x7f79f41023a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.731+0000 7f79f9a7b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79f4101960 0x7f79f41028e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.731+0000 7f79f9a7b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f4103080 con 0x7f79f4100fc0 2023-10-16T13:11:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.731+0000 7f79f9a7b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f41031f0 con 0x7f79f40ffdd0 2023-10-16T13:11:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.731+0000 7f79f9a7b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f41a0bd0 con 0x7f79f4101960 2023-10-16T13:11:14.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.731+0000 7f79f2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79f4100fc0 0x7f79f41023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:14.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.731+0000 7f79f2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79f4100fc0 0x7f79f41023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34950/0 (socket says 172.21.15.92:34950) 2023-10-16T13:11:14.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.731+0000 7f79f2ffd700 1 -- 172.21.15.92:0/483174227 learned_addr learned my addr 172.21.15.92:0/483174227 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:14.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.731+0000 7f79f37fe700 1 --2- 172.21.15.92:0/483174227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79f40ffdd0 0x7f79f4103d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:14.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.731+0000 7f79f3fff700 1 --2- 172.21.15.92:0/483174227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79f4101960 0x7f79f41028e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:14.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.732+0000 7f79f2ffd700 1 -- 172.21.15.92:0/483174227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79f4101960 msgr2=0x7f79f41028e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:14.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.732+0000 7f79f2ffd700 1 --2- 172.21.15.92:0/483174227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79f4101960 0x7f79f41028e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:14.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.732+0000 7f79f2ffd700 1 -- 172.21.15.92:0/483174227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79f40ffdd0 msgr2=0x7f79f4103d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:14.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.732+0000 7f79f2ffd700 1 --2- 172.21.15.92:0/483174227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79f40ffdd0 0x7f79f4103d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:14.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.732+0000 7f79f2ffd700 1 -- 172.21.15.92:0/483174227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e40095f0 con 0x7f79f4100fc0 2023-10-16T13:11:14.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.732+0000 7f79f3fff700 1 --2- 172.21.15.92:0/483174227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79f4101960 0x7f79f41028e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:11:14.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.732+0000 7f79f2ffd700 1 --2- 172.21.15.92:0/483174227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79f4100fc0 0x7f79f41023a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f79e4003800 tx=0x7f79e4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:14.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.732+0000 7f79f0ff9700 1 -- 172.21.15.92:0/483174227 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e401d070 con 0x7f79f4100fc0 2023-10-16T13:11:14.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.732+0000 7f79f9a7b700 1 -- 172.21.15.92:0/483174227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f41a0e50 con 0x7f79f4100fc0 2023-10-16T13:11:14.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.732+0000 7f79f0ff9700 1 -- 172.21.15.92:0/483174227 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f79e40040a0 con 0x7f79f4100fc0 2023-10-16T13:11:14.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.732+0000 7f79f0ff9700 1 -- 172.21.15.92:0/483174227 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e400f460 con 0x7f79f4100fc0 2023-10-16T13:11:14.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.732+0000 7f79f9a7b700 1 -- 172.21.15.92:0/483174227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f41a1270 con 0x7f79f4100fc0 2023-10-16T13:11:14.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.733+0000 7f79f9a7b700 1 -- 172.21.15.92:0/483174227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f410b720 con 0x7f79f4100fc0 2023-10-16T13:11:14.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.734+0000 7f79f0ff9700 1 -- 172.21.15.92:0/483174227 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f79e4022600 con 0x7f79f4100fc0 2023-10-16T13:11:14.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.735+0000 7f79f0ff9700 1 --2- 172.21.15.92:0/483174227 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f79dc0a1520 0x7f79dc0a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:14.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.735+0000 7f79f37fe700 1 --2- 172.21.15.92:0/483174227 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f79dc0a1520 0x7f79dc0a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:14.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.735+0000 7f79f0ff9700 1 -- 172.21.15.92:0/483174227 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f79e40ce440 con 0x7f79f4100fc0 2023-10-16T13:11:14.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.736+0000 7f79f37fe700 1 --2- 172.21.15.92:0/483174227 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f79dc0a1520 0x7f79dc0a39e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f79f4100e20 tx=0x7f79e800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:14.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.739+0000 7f79f0ff9700 1 -- 172.21.15.92:0/483174227 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f79e4097fd0 con 0x7f79f4100fc0 2023-10-16T13:11:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:14 smithi092 ceph-mon[99542]: Deploying daemon mds.d on smithi092 2023-10-16T13:11:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:14 smithi092 ceph-mon[99542]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:14 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.92:6834/1011037392,v1:172.21.15.92:6835/1011037392] up:boot 2023-10-16T13:11:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:14 smithi092 ceph-mon[99542]: fsmap 3 up:standby 2023-10-16T13:11:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:14 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-16T13:11:14.748 INFO:journalctl@ceph.mds.d.smithi092.stdout:Oct 16 13:11:14 smithi092 podman[149750]: 2023-10-16T13:11:14.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:14 smithi118 ceph-mon[103969]: Deploying daemon mds.d on smithi092 2023-10-16T13:11:14.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:14 smithi118 ceph-mon[103969]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:14.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:14 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.92:6834/1011037392,v1:172.21.15.92:6835/1011037392] up:boot 2023-10-16T13:11:14.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:14 smithi118 ceph-mon[103969]: fsmap 3 up:standby 2023-10-16T13:11:14.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:14 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-16T13:11:14.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.983+0000 7f79f9a7b700 1 -- 172.21.15.92:0/483174227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79f410b8b0 con 0x7f79f4100fc0 2023-10-16T13:11:14.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.984+0000 7f79f0ff9700 1 -- 172.21.15.92:0/483174227 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2913 (secure 0 0 0) 0x7f79e409b5f0 con 0x7f79f4100fc0 2023-10-16T13:11:14.987 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:14.987 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-16T13:11:14.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.986+0000 7f79f9a7b700 1 -- 172.21.15.92:0/483174227 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f79dc0a1520 msgr2=0x7f79dc0a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:14.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.986+0000 7f79f9a7b700 1 --2- 172.21.15.92:0/483174227 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f79dc0a1520 0x7f79dc0a39e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f79f4100e20 tx=0x7f79e800b410 comp rx=0 tx=0).stop 2023-10-16T13:11:14.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.986+0000 7f79f9a7b700 1 -- 172.21.15.92:0/483174227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79f4100fc0 msgr2=0x7f79f41023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:14.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.986+0000 7f79f9a7b700 1 --2- 172.21.15.92:0/483174227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79f4100fc0 0x7f79f41023a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f79e4003800 tx=0x7f79e4009580 comp rx=0 tx=0).stop 2023-10-16T13:11:14.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.986+0000 7f79f9a7b700 1 -- 172.21.15.92:0/483174227 shutdown_connections 2023-10-16T13:11:14.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.986+0000 7f79f9a7b700 1 --2- 172.21.15.92:0/483174227 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f79dc0a1520 0x7f79dc0a39e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:14.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.986+0000 7f79f9a7b700 1 --2- 172.21.15.92:0/483174227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79f4101960 0x7f79f41028e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:14.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.986+0000 7f79f9a7b700 1 --2- 172.21.15.92:0/483174227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79f40ffdd0 0x7f79f4103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:14.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.986+0000 7f79f9a7b700 1 --2- 172.21.15.92:0/483174227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79f4100fc0 0x7f79f41023a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:14.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.986+0000 7f79f9a7b700 1 -- 172.21.15.92:0/483174227 >> 172.21.15.92:0/483174227 conn(0x7f79f40fb320 msgr2=0x7f79f4068040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:14.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.986+0000 7f79f9a7b700 1 -- 172.21.15.92:0/483174227 shutdown_connections 2023-10-16T13:11:14.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:14.986+0000 7f79f9a7b700 1 -- 172.21.15.92:0/483174227 wait complete. 2023-10-16T13:11:14.991 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 4 2023-10-16T13:11:15.247 INFO:journalctl@ceph.mds.d.smithi092.stdout:Oct 16 13:11:14 smithi092 ceph-mds[149832]: -- 172.21.15.92:0/2726936289 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556ac66691e0 con 0x556ac663e800 2023-10-16T13:11:15.247 INFO:journalctl@ceph.mds.d.smithi092.stdout:Oct 16 13:11:14 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-d[149808]: starting mds.d at 2023-10-16T13:11:15.247 INFO:journalctl@ceph.mds.d.smithi092.stdout:Oct 16 13:11:14 smithi092 bash[149750]: 7bff708a2014e14016b27d8b77638843299692f369942eadf8017acd8d45a537 2023-10-16T13:11:15.247 INFO:journalctl@ceph.mds.d.smithi092.stdout:Oct 16 13:11:15 smithi092 systemd[1]: Started Ceph mds.d for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:11:15.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:15 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/483174227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:15.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:15 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:15.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:15 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:15.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:15 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:15.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:15 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:15.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:15 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:15.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:15 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:15.724 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:15 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/483174227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:15.724 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:15 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:15.724 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:15 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:15.724 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:15 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:15.725 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:15 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:15.725 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:15 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:15.725 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:15 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:15.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:15 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/483174227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:15.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:15 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:15.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:15 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:15.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:15 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:15.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:15 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:15.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:15 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:15.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:15 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:16.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:16 smithi152 ceph-mon[104423]: Deploying daemon mds.e on smithi118 2023-10-16T13:11:16.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:16 smithi152 ceph-mon[104423]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:16.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:16 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.92:6836/4269964747,v1:172.21.15.92:6837/4269964747] up:boot 2023-10-16T13:11:16.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:16 smithi152 ceph-mon[104423]: fsmap 4 up:standby 2023-10-16T13:11:16.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:16 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-16T13:11:16.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:16 smithi092 ceph-mon[99542]: Deploying daemon mds.e on smithi118 2023-10-16T13:11:16.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:16 smithi092 ceph-mon[99542]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:16.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:16 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.92:6836/4269964747,v1:172.21.15.92:6837/4269964747] up:boot 2023-10-16T13:11:16.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:16 smithi092 ceph-mon[99542]: fsmap 4 up:standby 2023-10-16T13:11:16.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:16 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-16T13:11:16.784 INFO:journalctl@ceph.mds.e.smithi118.stdout:Oct 16 13:11:16 smithi118 systemd[1]: Starting Ceph mds.e for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:11:16.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:16 smithi118 ceph-mon[103969]: Deploying daemon mds.e on smithi118 2023-10-16T13:11:16.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:16 smithi118 ceph-mon[103969]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:16.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:16 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.92:6836/4269964747,v1:172.21.15.92:6837/4269964747] up:boot 2023-10-16T13:11:16.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:16 smithi118 ceph-mon[103969]: fsmap 4 up:standby 2023-10-16T13:11:16.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:16 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-16T13:11:17.002 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:11:17.137 INFO:journalctl@ceph.mds.e.smithi118.stdout:Oct 16 13:11:16 smithi118 podman[140714]: 2023-10-16T13:11:17.137 INFO:journalctl@ceph.mds.e.smithi118.stdout:Oct 16 13:11:17 smithi118 bash[140714]: 7c60537431fe11d49d0c4ed7b72075b6b1b2b9beca25b5704e460b6dfdf97846 2023-10-16T13:11:17.137 INFO:journalctl@ceph.mds.e.smithi118.stdout:Oct 16 13:11:17 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-e[140730]: starting mds.e at 2023-10-16T13:11:17.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.139+0000 7fc13baaa700 1 -- 172.21.15.92:0/3003233875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1341009e0 msgr2=0x7fc134108280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:17.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.139+0000 7fc13baaa700 1 --2- 172.21.15.92:0/3003233875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1341009e0 0x7fc134108280 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009f90 tx=0x7fc12c00b330 comp rx=0 tx=0).stop 2023-10-16T13:11:17.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.139+0000 7fc13baaa700 1 -- 172.21.15.92:0/3003233875 shutdown_connections 2023-10-16T13:11:17.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.139+0000 7fc13baaa700 1 --2- 172.21.15.92:0/3003233875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1341009e0 0x7fc134108280 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:17.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.139+0000 7fc13baaa700 1 --2- 172.21.15.92:0/3003233875 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc134101460 0x7fc134101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:17.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.139+0000 7fc13baaa700 1 --2- 172.21.15.92:0/3003233875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc134100020 0x7fc1341004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:17.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.139+0000 7fc13baaa700 1 -- 172.21.15.92:0/3003233875 >> 172.21.15.92:0/3003233875 conn(0x7fc1340faab0 msgr2=0x7fc1340fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:17.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.139+0000 7fc13baaa700 1 -- 172.21.15.92:0/3003233875 shutdown_connections 2023-10-16T13:11:17.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.139+0000 7fc13baaa700 1 -- 172.21.15.92:0/3003233875 wait complete. 2023-10-16T13:11:17.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.139+0000 7fc13baaa700 1 Processor -- start 2023-10-16T13:11:17.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc13baaa700 1 -- start start 2023-10-16T13:11:17.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc13baaa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc134100020 0x7fc1340ffa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:17.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc13baaa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1341009e0 0x7fc13419ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:17.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc13baaa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc134101460 0x7fc13419e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:17.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc13baaa700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13419e800 con 0x7fc1341009e0 2023-10-16T13:11:17.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc13baaa700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13419e970 con 0x7fc134101460 2023-10-16T13:11:17.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc13baaa700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13419eb30 con 0x7fc134100020 2023-10-16T13:11:17.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc139045700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1341009e0 0x7fc13419ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:17.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc139045700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1341009e0 0x7fc13419ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34978/0 (socket says 172.21.15.92:34978) 2023-10-16T13:11:17.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc139045700 1 -- 172.21.15.92:0/2556278475 learned_addr learned my addr 172.21.15.92:0/2556278475 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:17.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc13a047700 1 --2- 172.21.15.92:0/2556278475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc134101460 0x7fc13419e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:17.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc139846700 1 --2- 172.21.15.92:0/2556278475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc134100020 0x7fc1340ffa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:17.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc139045700 1 -- 172.21.15.92:0/2556278475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc134100020 msgr2=0x7fc1340ffa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:17.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc139045700 1 --2- 172.21.15.92:0/2556278475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc134100020 0x7fc1340ffa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:17.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc139045700 1 -- 172.21.15.92:0/2556278475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc134101460 msgr2=0x7fc13419e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:17.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc139045700 1 --2- 172.21.15.92:0/2556278475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc134101460 0x7fc13419e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:17.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc139045700 1 -- 172.21.15.92:0/2556278475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c009c40 con 0x7fc1341009e0 2023-10-16T13:11:17.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc13a047700 1 --2- 172.21.15.92:0/2556278475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc134101460 0x7fc13419e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:11:17.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc139045700 1 --2- 172.21.15.92:0/2556278475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1341009e0 0x7fc13419ba20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc13000e9c0 tx=0x7fc13000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:17.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc12affd700 1 -- 172.21.15.92:0/2556278475 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13000cbd0 con 0x7fc1341009e0 2023-10-16T13:11:17.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc12affd700 1 -- 172.21.15.92:0/2556278475 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc13000eeb0 con 0x7fc1341009e0 2023-10-16T13:11:17.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc13baaa700 1 -- 172.21.15.92:0/2556278475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc13419ee10 con 0x7fc1341009e0 2023-10-16T13:11:17.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.140+0000 7fc12affd700 1 -- 172.21.15.92:0/2556278475 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc130005680 con 0x7fc1341009e0 2023-10-16T13:11:17.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.141+0000 7fc13baaa700 1 -- 172.21.15.92:0/2556278475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc13419f290 con 0x7fc1341009e0 2023-10-16T13:11:17.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.142+0000 7fc13baaa700 1 -- 172.21.15.92:0/2556278475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13410b7c0 con 0x7fc1341009e0 2023-10-16T13:11:17.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.142+0000 7fc12affd700 1 -- 172.21.15.92:0/2556278475 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fc130004750 con 0x7fc1341009e0 2023-10-16T13:11:17.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.143+0000 7fc12affd700 1 --2- 172.21.15.92:0/2556278475 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc1200a1520 0x7fc1200a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:17.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.143+0000 7fc139846700 1 --2- 172.21.15.92:0/2556278475 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc1200a1520 0x7fc1200a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:17.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.143+0000 7fc12affd700 1 -- 172.21.15.92:0/2556278475 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc130014070 con 0x7fc1341009e0 2023-10-16T13:11:17.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.143+0000 7fc139846700 1 --2- 172.21.15.92:0/2556278475 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc1200a1520 0x7fc1200a39e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc124005950 tx=0x7fc1240058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:17.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.147+0000 7fc12affd700 1 -- 172.21.15.92:0/2556278475 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc1300964c0 con 0x7fc1341009e0 2023-10-16T13:11:17.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.386+0000 7fc13baaa700 1 -- 172.21.15.92:0/2556278475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc13410b9a0 con 0x7fc1341009e0 2023-10-16T13:11:17.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.386+0000 7fc12affd700 1 -- 172.21.15.92:0/2556278475 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3704 (secure 0 0 0) 0x7fc13000cd30 con 0x7fc1341009e0 2023-10-16T13:11:17.390 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:17.390 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-16T13:11:17.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.388+0000 7fc13baaa700 1 -- 172.21.15.92:0/2556278475 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc1200a1520 msgr2=0x7fc1200a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:17.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.388+0000 7fc13baaa700 1 --2- 172.21.15.92:0/2556278475 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc1200a1520 0x7fc1200a39e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc124005950 tx=0x7fc1240058e0 comp rx=0 tx=0).stop 2023-10-16T13:11:17.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.388+0000 7fc13baaa700 1 -- 172.21.15.92:0/2556278475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1341009e0 msgr2=0x7fc13419ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:17.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.388+0000 7fc13baaa700 1 --2- 172.21.15.92:0/2556278475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1341009e0 0x7fc13419ba20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc13000e9c0 tx=0x7fc13000ecd0 comp rx=0 tx=0).stop 2023-10-16T13:11:17.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.388+0000 7fc13baaa700 1 -- 172.21.15.92:0/2556278475 shutdown_connections 2023-10-16T13:11:17.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.388+0000 7fc13baaa700 1 --2- 172.21.15.92:0/2556278475 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc1200a1520 0x7fc1200a39e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:17.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.388+0000 7fc13baaa700 1 --2- 172.21.15.92:0/2556278475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc134101460 0x7fc13419e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:17.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.388+0000 7fc13baaa700 1 --2- 172.21.15.92:0/2556278475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc134100020 0x7fc1340ffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:17.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.388+0000 7fc13baaa700 1 --2- 172.21.15.92:0/2556278475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1341009e0 0x7fc13419ba20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:17.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.388+0000 7fc13baaa700 1 -- 172.21.15.92:0/2556278475 >> 172.21.15.92:0/2556278475 conn(0x7fc1340faab0 msgr2=0x7fc1340fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:17.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.388+0000 7fc13baaa700 1 -- 172.21.15.92:0/2556278475 shutdown_connections 2023-10-16T13:11:17.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:17.388+0000 7fc13baaa700 1 -- 172.21.15.92:0/2556278475 wait complete. 2023-10-16T13:11:17.394 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 5 2023-10-16T13:11:17.533 INFO:journalctl@ceph.mds.e.smithi118.stdout:Oct 16 13:11:17 smithi118 systemd[1]: Started Ceph mds.e for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:11:18.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:18.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:18.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:18.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:18.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:18.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:18.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:18 smithi152 ceph-mon[104423]: Deploying daemon mds.f on smithi152 2023-10-16T13:11:18.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:18 smithi152 ceph-mon[104423]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:18.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:18 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2556278475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:18.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:18 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] up:boot 2023-10-16T13:11:18.445 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:18 smithi152 ceph-mon[104423]: fsmap 5 up:standby 2023-10-16T13:11:18.445 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:18 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-16T13:11:18.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:18.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:18.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:18.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:18.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:18.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:18.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:18 smithi092 ceph-mon[99542]: Deploying daemon mds.f on smithi152 2023-10-16T13:11:18.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:18 smithi092 ceph-mon[99542]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:18.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:18 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2556278475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:18.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:18 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] up:boot 2023-10-16T13:11:18.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:18 smithi092 ceph-mon[99542]: fsmap 5 up:standby 2023-10-16T13:11:18.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:18 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-16T13:11:18.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:18 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:18.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:18 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:18.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:18 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:18.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:18 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:18.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:18 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:18.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:18 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:18.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:18 smithi118 ceph-mon[103969]: Deploying daemon mds.f on smithi152 2023-10-16T13:11:18.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:18 smithi118 ceph-mon[103969]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:18.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:18 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2556278475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:18.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:18 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] up:boot 2023-10-16T13:11:18.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:18 smithi118 ceph-mon[103969]: fsmap 5 up:standby 2023-10-16T13:11:18.536 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:18 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-16T13:11:19.146 INFO:journalctl@ceph.mds.f.smithi152.stdout:Oct 16 13:11:18 smithi152 systemd[1]: Starting Ceph mds.f for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:11:19.404 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:11:19.408 INFO:journalctl@ceph.mds.f.smithi152.stdout:Oct 16 13:11:19 smithi152 podman[141653]: 2023-10-16T13:11:19.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.544+0000 7f921e3ca700 1 -- 172.21.15.92:0/3558174716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92180ff740 msgr2=0x7f92180ffb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:19.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.544+0000 7f921e3ca700 1 --2- 172.21.15.92:0/3558174716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92180ff740 0x7f92180ffb60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9208009990 tx=0x7f9208009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:19.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.544+0000 7f921e3ca700 1 -- 172.21.15.92:0/3558174716 shutdown_connections 2023-10-16T13:11:19.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.544+0000 7f921e3ca700 1 --2- 172.21.15.92:0/3558174716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92180ff740 0x7f92180ffb60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:19.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.544+0000 7f921e3ca700 1 --2- 172.21.15.92:0/3558174716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9218100a60 0x7f9218100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:19.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.544+0000 7f921e3ca700 1 --2- 172.21.15.92:0/3558174716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92181000a0 0x7f9218100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:19.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.544+0000 7f921e3ca700 1 -- 172.21.15.92:0/3558174716 >> 172.21.15.92:0/3558174716 conn(0x7f92180fb320 msgr2=0x7f92180fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:19.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.544+0000 7f921e3ca700 1 -- 172.21.15.92:0/3558174716 shutdown_connections 2023-10-16T13:11:19.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.544+0000 7f921e3ca700 1 -- 172.21.15.92:0/3558174716 wait complete. 2023-10-16T13:11:19.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.545+0000 7f921e3ca700 1 Processor -- start 2023-10-16T13:11:19.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.545+0000 7f921e3ca700 1 -- start start 2023-10-16T13:11:19.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.545+0000 7f921e3ca700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92180ff740 0x7f9218198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:19.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.545+0000 7f921e3ca700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92181000a0 0x7f9218199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:19.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.545+0000 7f921e3ca700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9218100a60 0x7f92181a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:19.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.545+0000 7f921e3ca700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92181a0970 con 0x7f92181000a0 2023-10-16T13:11:19.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.545+0000 7f921e3ca700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92181a0ab0 con 0x7f9218100a60 2023-10-16T13:11:19.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.545+0000 7f921e3ca700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92181a0c40 con 0x7f92180ff740 2023-10-16T13:11:19.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.545+0000 7f92177fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92181000a0 0x7f9218199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:19.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.545+0000 7f9217fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92180ff740 0x7f9218198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:19.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.545+0000 7f92177fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92181000a0 0x7f9218199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34992/0 (socket says 172.21.15.92:34992) 2023-10-16T13:11:19.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.545+0000 7f92177fe700 1 -- 172.21.15.92:0/2573093875 learned_addr learned my addr 172.21.15.92:0/2573093875 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:19.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.545+0000 7f9217fff700 1 --2- 172.21.15.92:0/2573093875 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92180ff740 0x7f9218198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.92:41820/0 (socket says 172.21.15.92:41820) 2023-10-16T13:11:19.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.545+0000 7f921c967700 1 --2- 172.21.15.92:0/2573093875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9218100a60 0x7f92181a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:19.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.546+0000 7f9217fff700 1 -- 172.21.15.92:0/2573093875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9218100a60 msgr2=0x7f92181a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:19.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.546+0000 7f9217fff700 1 --2- 172.21.15.92:0/2573093875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9218100a60 0x7f92181a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:19.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.546+0000 7f9217fff700 1 -- 172.21.15.92:0/2573093875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92181000a0 msgr2=0x7f9218199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:19.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.546+0000 7f9217fff700 1 --2- 172.21.15.92:0/2573093875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92181000a0 0x7f9218199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:19.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.546+0000 7f9217fff700 1 -- 172.21.15.92:0/2573093875 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92080095f0 con 0x7f92180ff740 2023-10-16T13:11:19.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.546+0000 7f92177fe700 1 --2- 172.21.15.92:0/2573093875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92181000a0 0x7f9218199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:11:19.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.546+0000 7f9217fff700 1 --2- 172.21.15.92:0/2573093875 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92180ff740 0x7f9218198df0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f92080098e0 tx=0x7f9208004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:19.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.546+0000 7f92157fa700 1 -- 172.21.15.92:0/2573093875 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920801d070 con 0x7f92180ff740 2023-10-16T13:11:19.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.546+0000 7f921e3ca700 1 -- 172.21.15.92:0/2573093875 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92181a0ec0 con 0x7f92180ff740 2023-10-16T13:11:19.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.546+0000 7f92157fa700 1 -- 172.21.15.92:0/2573093875 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f920800fbd0 con 0x7f92180ff740 2023-10-16T13:11:19.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.546+0000 7f92157fa700 1 -- 172.21.15.92:0/2573093875 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9208017410 con 0x7f92180ff740 2023-10-16T13:11:19.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.546+0000 7f921e3ca700 1 -- 172.21.15.92:0/2573093875 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92181a1230 con 0x7f92180ff740 2023-10-16T13:11:19.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.547+0000 7f921e3ca700 1 -- 172.21.15.92:0/2573093875 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921810a520 con 0x7f92180ff740 2023-10-16T13:11:19.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.552+0000 7f92157fa700 1 -- 172.21.15.92:0/2573093875 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f9208021410 con 0x7f92180ff740 2023-10-16T13:11:19.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.552+0000 7f92157fa700 1 --2- 172.21.15.92:0/2573093875 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f92000a1520 0x7f92000a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:19.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.553+0000 7f92177fe700 1 --2- 172.21.15.92:0/2573093875 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f92000a1520 0x7f92000a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:19.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.553+0000 7f92157fa700 1 -- 172.21.15.92:0/2573093875 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f92080cded0 con 0x7f92180ff740 2023-10-16T13:11:19.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.553+0000 7f92177fe700 1 --2- 172.21.15.92:0/2573093875 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f92000a1520 0x7f92000a39e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f920c011550 tx=0x7f920c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:19.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.555+0000 7f92157fa700 1 -- 172.21.15.92:0/2573093875 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9208097a40 con 0x7f92180ff740 2023-10-16T13:11:19.692 INFO:journalctl@ceph.mds.f.smithi152.stdout:Oct 16 13:11:19 smithi152 ceph-mds[141693]: -- 172.21.15.152:0/2097125164 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561d635311e0 con 0x561d63507000 2023-10-16T13:11:19.693 INFO:journalctl@ceph.mds.f.smithi152.stdout:Oct 16 13:11:19 smithi152 bash[141653]: 58680dcc1be8a002f014aba6cd1c3162031d1f7327e3accaa5ca74ddbbecae43 2023-10-16T13:11:19.693 INFO:journalctl@ceph.mds.f.smithi152.stdout:Oct 16 13:11:19 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-f[141669]: starting mds.f at 2023-10-16T13:11:19.693 INFO:journalctl@ceph.mds.f.smithi152.stdout:Oct 16 13:11:19 smithi152 systemd[1]: Started Ceph mds.f for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:11:19.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.794+0000 7f921e3ca700 1 -- 172.21.15.92:0/2573093875 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f921802d200 con 0x7f92180ff740 2023-10-16T13:11:19.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.795+0000 7f92157fa700 1 -- 172.21.15.92:0/2573093875 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4498 (secure 0 0 0) 0x7f920809b060 con 0x7f92180ff740 2023-10-16T13:11:19.798 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:19.798 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-10-16T13:11:19.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.797+0000 7f921e3ca700 1 -- 172.21.15.92:0/2573093875 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f92000a1520 msgr2=0x7f92000a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:19.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.797+0000 7f921e3ca700 1 --2- 172.21.15.92:0/2573093875 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f92000a1520 0x7f92000a39e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f920c011550 tx=0x7f920c009260 comp rx=0 tx=0).stop 2023-10-16T13:11:19.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.797+0000 7f921e3ca700 1 -- 172.21.15.92:0/2573093875 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92180ff740 msgr2=0x7f9218198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:19.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.797+0000 7f921e3ca700 1 --2- 172.21.15.92:0/2573093875 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92180ff740 0x7f9218198df0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f92080098e0 tx=0x7f9208004730 comp rx=0 tx=0).stop 2023-10-16T13:11:19.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.797+0000 7f921e3ca700 1 -- 172.21.15.92:0/2573093875 shutdown_connections 2023-10-16T13:11:19.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.797+0000 7f921e3ca700 1 --2- 172.21.15.92:0/2573093875 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f92000a1520 0x7f92000a39e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:19.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.797+0000 7f921e3ca700 1 --2- 172.21.15.92:0/2573093875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9218100a60 0x7f92181a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:19.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.797+0000 7f921e3ca700 1 --2- 172.21.15.92:0/2573093875 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92180ff740 0x7f9218198df0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:19.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.797+0000 7f921e3ca700 1 --2- 172.21.15.92:0/2573093875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92181000a0 0x7f9218199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:19.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.797+0000 7f921e3ca700 1 -- 172.21.15.92:0/2573093875 >> 172.21.15.92:0/2573093875 conn(0x7f92180fb320 msgr2=0x7f92180fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:19.802 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.797+0000 7f921e3ca700 1 -- 172.21.15.92:0/2573093875 shutdown_connections 2023-10-16T13:11:19.802 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:19.797+0000 7f921e3ca700 1 -- 172.21.15.92:0/2573093875 wait complete. 2023-10-16T13:11:19.802 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 6 2023-10-16T13:11:20.855 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:20 smithi152 ceph-mon[104423]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:20.855 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:20 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:20.856 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:20 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:20.856 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:20 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:20.856 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:20 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:20.856 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:20 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:20.856 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:20 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:20.857 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:20 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2573093875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:20.857 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:20 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] up:boot 2023-10-16T13:11:20.857 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:20 smithi152 ceph-mon[104423]: fsmap 6 up:standby 2023-10-16T13:11:20.858 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:20 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-16T13:11:20.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:20 smithi092 ceph-mon[99542]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:20.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:20 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:20.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:20 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:20.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:20 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:20.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:20 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:20.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:20 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:20.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:20 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:20.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:20 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2573093875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:20.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:20 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] up:boot 2023-10-16T13:11:20.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:20 smithi092 ceph-mon[99542]: fsmap 6 up:standby 2023-10-16T13:11:20.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:20 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-16T13:11:21.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:20 smithi118 ceph-mon[103969]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:21.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:20 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:21.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:20 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:21.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:20 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:21.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:20 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:21.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:20 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:21.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:20 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:21.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:20 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2573093875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:21.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:20 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] up:boot 2023-10-16T13:11:21.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:20 smithi118 ceph-mon[103969]: fsmap 6 up:standby 2023-10-16T13:11:21.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:20 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-16T13:11:21.443 INFO:journalctl@ceph.mds.c.smithi152.stdout:Oct 16 13:11:21 smithi152 systemd[1]: Starting Ceph mds.c for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:11:21.804 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:21 smithi152 ceph-mon[104423]: Deploying daemon mds.c on smithi152 2023-10-16T13:11:21.805 INFO:journalctl@ceph.mds.c.smithi152.stdout:Oct 16 13:11:21 smithi152 podman[141995]: 2023-10-16T13:11:21.805 INFO:journalctl@ceph.mds.c.smithi152.stdout:Oct 16 13:11:21 smithi152 ceph-mds[142035]: -- 172.21.15.152:0/1109459587 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56311a9fd1e0 con 0x56311a9d2c00 2023-10-16T13:11:21.805 INFO:journalctl@ceph.mds.c.smithi152.stdout:Oct 16 13:11:21 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-c[142011]: starting mds.c at 2023-10-16T13:11:21.806 INFO:journalctl@ceph.mds.c.smithi152.stdout:Oct 16 13:11:21 smithi152 bash[141995]: 958dcc9b6c4e88acd7e5f753857d91a71b02090568ce6da25f03f1e69e3cbb7d 2023-10-16T13:11:21.812 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:11:21.842 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:21 smithi092 ceph-mon[99542]: Deploying daemon mds.c on smithi152 2023-10-16T13:11:21.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.958+0000 7f109b8c1700 1 -- 172.21.15.92:0/854494864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1094100a60 msgr2=0x7f1094100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:21.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.958+0000 7f109b8c1700 1 --2- 172.21.15.92:0/854494864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1094100a60 0x7f1094100ee0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f108c00b0a0 tx=0x7f108c00b3b0 comp rx=0 tx=0).stop 2023-10-16T13:11:21.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.958+0000 7f109b8c1700 1 -- 172.21.15.92:0/854494864 shutdown_connections 2023-10-16T13:11:21.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.958+0000 7f109b8c1700 1 --2- 172.21.15.92:0/854494864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1094100a60 0x7f1094100ee0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:21.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.958+0000 7f109b8c1700 1 --2- 172.21.15.92:0/854494864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10940ff740 0x7f10940ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:21.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.958+0000 7f109b8c1700 1 --2- 172.21.15.92:0/854494864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10941000a0 0x7f1094100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:21.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.958+0000 7f109b8c1700 1 -- 172.21.15.92:0/854494864 >> 172.21.15.92:0/854494864 conn(0x7f10940fb320 msgr2=0x7f10940fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:21.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.958+0000 7f109b8c1700 1 -- 172.21.15.92:0/854494864 shutdown_connections 2023-10-16T13:11:21.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.958+0000 7f109b8c1700 1 -- 172.21.15.92:0/854494864 wait complete. 2023-10-16T13:11:21.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.958+0000 7f109b8c1700 1 Processor -- start 2023-10-16T13:11:21.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f109b8c1700 1 -- start start 2023-10-16T13:11:21.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f109b8c1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10940ff740 0x7f1094198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:21.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f109b8c1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10941000a0 0x7f10941993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:21.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f109b8c1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1094100a60 0x7f10941a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:21.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f109b8c1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10941a09f0 con 0x7f10940ff740 2023-10-16T13:11:21.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f109b8c1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10941a0b30 con 0x7f1094100a60 2023-10-16T13:11:21.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f109b8c1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10941a0cc0 con 0x7f10941000a0 2023-10-16T13:11:21.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f109965d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10940ff740 0x7f1094198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:21.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f109965d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10940ff740 0x7f1094198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35004/0 (socket says 172.21.15.92:35004) 2023-10-16T13:11:21.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f109965d700 1 -- 172.21.15.92:0/3731218145 learned_addr learned my addr 172.21.15.92:0/3731218145 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:21.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f1098e5c700 1 --2- 172.21.15.92:0/3731218145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10941000a0 0x7f10941993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:21.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f1099e5e700 1 --2- 172.21.15.92:0/3731218145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1094100a60 0x7f10941a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:21.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f109965d700 1 -- 172.21.15.92:0/3731218145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10941000a0 msgr2=0x7f10941993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:21.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f109965d700 1 --2- 172.21.15.92:0/3731218145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10941000a0 0x7f10941993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:21.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f109965d700 1 -- 172.21.15.92:0/3731218145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1094100a60 msgr2=0x7f10941a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:21.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f109965d700 1 --2- 172.21.15.92:0/3731218145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1094100a60 0x7f10941a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:21.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f109965d700 1 -- 172.21.15.92:0/3731218145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c009d00 con 0x7f10940ff740 2023-10-16T13:11:21.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f1099e5e700 1 --2- 172.21.15.92:0/3731218145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1094100a60 0x7f10941a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:11:21.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f109965d700 1 --2- 172.21.15.92:0/3731218145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10940ff740 0x7f1094198e70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f109000e9a0 tx=0x7f109000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:21.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.959+0000 7f108a7fc700 1 -- 172.21.15.92:0/3731218145 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1090009790 con 0x7f10940ff740 2023-10-16T13:11:21.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.960+0000 7f108a7fc700 1 -- 172.21.15.92:0/3731218145 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1090010430 con 0x7f10940ff740 2023-10-16T13:11:21.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.960+0000 7f109b8c1700 1 -- 172.21.15.92:0/3731218145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10941a0fa0 con 0x7f10940ff740 2023-10-16T13:11:21.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.960+0000 7f108a7fc700 1 -- 172.21.15.92:0/3731218145 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1090018680 con 0x7f10940ff740 2023-10-16T13:11:21.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.960+0000 7f109b8c1700 1 -- 172.21.15.92:0/3731218145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10941a13c0 con 0x7f10940ff740 2023-10-16T13:11:21.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.961+0000 7f109b8c1700 1 -- 172.21.15.92:0/3731218145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109410a520 con 0x7f10940ff740 2023-10-16T13:11:21.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.962+0000 7f108a7fc700 1 -- 172.21.15.92:0/3731218145 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f1090010910 con 0x7f10940ff740 2023-10-16T13:11:21.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.962+0000 7f108a7fc700 1 --2- 172.21.15.92:0/3731218145 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f10800a1520 0x7f10800a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:21.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.962+0000 7f1098e5c700 1 --2- 172.21.15.92:0/3731218145 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f10800a1520 0x7f10800a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:21.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.962+0000 7f108a7fc700 1 -- 172.21.15.92:0/3731218145 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1090014070 con 0x7f10940ff740 2023-10-16T13:11:21.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.963+0000 7f1098e5c700 1 --2- 172.21.15.92:0/3731218145 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f10800a1520 0x7f10800a39e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1084005950 tx=0x7f108400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:21.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:21.966+0000 7f108a7fc700 1 -- 172.21.15.92:0/3731218145 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f10900969c0 con 0x7f10940ff740 2023-10-16T13:11:22.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:21 smithi118 ceph-mon[103969]: Deploying daemon mds.c on smithi152 2023-10-16T13:11:22.193 INFO:journalctl@ceph.mds.c.smithi152.stdout:Oct 16 13:11:21 smithi152 systemd[1]: Started Ceph mds.c for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:11:22.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:22.203+0000 7f109b8c1700 1 -- 172.21.15.92:0/3731218145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f109410ed00 con 0x7f10940ff740 2023-10-16T13:11:22.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:22.204+0000 7f108a7fc700 1 -- 172.21.15.92:0/3731218145 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5292 (secure 0 0 0) 0x7f10900105a0 con 0x7f10940ff740 2023-10-16T13:11:22.207 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:22.207 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2023-10-16T13:11:22.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:22.206+0000 7f109b8c1700 1 -- 172.21.15.92:0/3731218145 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f10800a1520 msgr2=0x7f10800a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:22.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:22.206+0000 7f109b8c1700 1 --2- 172.21.15.92:0/3731218145 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f10800a1520 0x7f10800a39e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1084005950 tx=0x7f108400b410 comp rx=0 tx=0).stop 2023-10-16T13:11:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:22.206+0000 7f109b8c1700 1 -- 172.21.15.92:0/3731218145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10940ff740 msgr2=0x7f1094198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:22.206+0000 7f109b8c1700 1 --2- 172.21.15.92:0/3731218145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10940ff740 0x7f1094198e70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f109000e9a0 tx=0x7f109000ecb0 comp rx=0 tx=0).stop 2023-10-16T13:11:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:22.206+0000 7f109b8c1700 1 -- 172.21.15.92:0/3731218145 shutdown_connections 2023-10-16T13:11:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:22.206+0000 7f109b8c1700 1 --2- 172.21.15.92:0/3731218145 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f10800a1520 0x7f10800a39e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:22.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:22.206+0000 7f109b8c1700 1 --2- 172.21.15.92:0/3731218145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10940ff740 0x7f1094198e70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:22.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:22.206+0000 7f109b8c1700 1 --2- 172.21.15.92:0/3731218145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1094100a60 0x7f10941a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:22.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:22.206+0000 7f109b8c1700 1 --2- 172.21.15.92:0/3731218145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10941000a0 0x7f10941993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:22.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:22.206+0000 7f109b8c1700 1 -- 172.21.15.92:0/3731218145 >> 172.21.15.92:0/3731218145 conn(0x7f10940fb320 msgr2=0x7f10940fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:22.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:22.206+0000 7f109b8c1700 1 -- 172.21.15.92:0/3731218145 shutdown_connections 2023-10-16T13:11:22.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:22.206+0000 7f109b8c1700 1 -- 172.21.15.92:0/3731218145 wait complete. 2023-10-16T13:11:22.212 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 7 2023-10-16T13:11:22.883 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:22 smithi118 ceph-mon[103969]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:22.884 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:22 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:22.884 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:22 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:22.884 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:22 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:22.884 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:22 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:22.884 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:22 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:22.885 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:22 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:22.885 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:22 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3731218145' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:22.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:22 smithi152 ceph-mon[104423]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:22.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:22 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:22.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:22 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:22.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:22 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:22.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:22 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:22.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:22 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:22.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:22 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:22.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:22 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3731218145' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:22.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:22 smithi092 ceph-mon[99542]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:22.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:22 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:22.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:22 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:22.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:22 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:22.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:22 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:22.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:22 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:22.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:22 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:22.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:22 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3731218145' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:23.503 INFO:journalctl@ceph.mds.h.smithi118.stdout:Oct 16 13:11:23 smithi118 systemd[1]: Starting Ceph mds.h for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:11:23.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:23 smithi152 ceph-mon[104423]: Deploying daemon mds.h on smithi118 2023-10-16T13:11:23.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:23 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.152:6836/2403096460,v1:172.21.15.152:6837/2403096460] up:boot 2023-10-16T13:11:23.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:23 smithi152 ceph-mon[104423]: fsmap 7 up:standby 2023-10-16T13:11:23.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:23 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-16T13:11:23.961 INFO:journalctl@ceph.mds.h.smithi118.stdout:Oct 16 13:11:23 smithi118 podman[141055]: 2023-10-16T13:11:23.962 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:23 smithi118 ceph-mon[103969]: Deploying daemon mds.h on smithi118 2023-10-16T13:11:23.962 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:23 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.152:6836/2403096460,v1:172.21.15.152:6837/2403096460] up:boot 2023-10-16T13:11:23.962 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:23 smithi118 ceph-mon[103969]: fsmap 7 up:standby 2023-10-16T13:11:23.962 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:23 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-16T13:11:23.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:23 smithi092 ceph-mon[99542]: Deploying daemon mds.h on smithi118 2023-10-16T13:11:23.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:23 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.152:6836/2403096460,v1:172.21.15.152:6837/2403096460] up:boot 2023-10-16T13:11:23.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:23 smithi092 ceph-mon[99542]: fsmap 7 up:standby 2023-10-16T13:11:23.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:23 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-16T13:11:24.221 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:11:24.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.360+0000 7f856c331700 1 -- 172.21.15.92:0/345926324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8564101a10 msgr2=0x7f8564103e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:24.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.360+0000 7f856c331700 1 --2- 172.21.15.92:0/345926324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8564101a10 0x7f8564103e00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8554009990 tx=0x7f8554009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:24.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.360+0000 7f856c331700 1 -- 172.21.15.92:0/345926324 shutdown_connections 2023-10-16T13:11:24.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.360+0000 7f856c331700 1 --2- 172.21.15.92:0/345926324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8564101a10 0x7f8564103e00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:24.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.360+0000 7f856c331700 1 --2- 172.21.15.92:0/345926324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8564106c70 0x7f8564109060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:24.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.360+0000 7f856c331700 1 --2- 172.21.15.92:0/345926324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8564104340 0x7f8564106730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:24.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.360+0000 7f856c331700 1 -- 172.21.15.92:0/345926324 >> 172.21.15.92:0/345926324 conn(0x7f85640fb320 msgr2=0x7f85640fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:24.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.360+0000 7f856c331700 1 -- 172.21.15.92:0/345926324 shutdown_connections 2023-10-16T13:11:24.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.360+0000 7f856c331700 1 -- 172.21.15.92:0/345926324 wait complete. 2023-10-16T13:11:24.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.361+0000 7f856c331700 1 Processor -- start 2023-10-16T13:11:24.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.361+0000 7f856c331700 1 -- start start 2023-10-16T13:11:24.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.361+0000 7f856c331700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8564101a10 0x7f8564196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:24.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.361+0000 7f856c331700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8564104340 0x7f8564197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:24.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.361+0000 7f856c331700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8564106c70 0x7f856419e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:24.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.361+0000 7f856c331700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856419e770 con 0x7f8564106c70 2023-10-16T13:11:24.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.361+0000 7f856c331700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856419e8e0 con 0x7f8564104340 2023-10-16T13:11:24.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.361+0000 7f856c331700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856419eaa0 con 0x7f8564101a10 2023-10-16T13:11:24.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.361+0000 7f856a8ce700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8564106c70 0x7f856419e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:24.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.361+0000 7f856a8ce700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8564106c70 0x7f856419e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35022/0 (socket says 172.21.15.92:35022) 2023-10-16T13:11:24.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.361+0000 7f856a8ce700 1 -- 172.21.15.92:0/4226530266 learned_addr learned my addr 172.21.15.92:0/4226530266 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:24.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.361+0000 7f856a0cd700 1 --2- 172.21.15.92:0/4226530266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8564101a10 0x7f8564196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:24.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.361+0000 7f85698cc700 1 --2- 172.21.15.92:0/4226530266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8564104340 0x7f8564197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:24.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.362+0000 7f856a8ce700 1 -- 172.21.15.92:0/4226530266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8564101a10 msgr2=0x7f8564196c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:24.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.362+0000 7f856a8ce700 1 --2- 172.21.15.92:0/4226530266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8564101a10 0x7f8564196c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:24.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.362+0000 7f856a8ce700 1 -- 172.21.15.92:0/4226530266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8564104340 msgr2=0x7f8564197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:24.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.362+0000 7f856a8ce700 1 --2- 172.21.15.92:0/4226530266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8564104340 0x7f8564197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:24.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.362+0000 7f856a8ce700 1 -- 172.21.15.92:0/4226530266 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85540095f0 con 0x7f8564106c70 2023-10-16T13:11:24.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.362+0000 7f856a8ce700 1 --2- 172.21.15.92:0/4226530266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8564106c70 0x7f856419e1a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f855c007ee0 tx=0x7f855c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:24.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.362+0000 7f855b7fe700 1 -- 172.21.15.92:0/4226530266 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c017070 con 0x7f8564106c70 2023-10-16T13:11:24.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.362+0000 7f855b7fe700 1 -- 172.21.15.92:0/4226530266 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f855c00f040 con 0x7f8564106c70 2023-10-16T13:11:24.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.362+0000 7f856c331700 1 -- 172.21.15.92:0/4226530266 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856419ed80 con 0x7f8564106c70 2023-10-16T13:11:24.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.362+0000 7f855b7fe700 1 -- 172.21.15.92:0/4226530266 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c005610 con 0x7f8564106c70 2023-10-16T13:11:24.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.362+0000 7f856c331700 1 -- 172.21.15.92:0/4226530266 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856419f180 con 0x7f8564106c70 2023-10-16T13:11:24.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.363+0000 7f856c331700 1 -- 172.21.15.92:0/4226530266 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85640fcea0 con 0x7f8564106c70 2023-10-16T13:11:24.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.365+0000 7f855b7fe700 1 -- 172.21.15.92:0/4226530266 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f855c005770 con 0x7f8564106c70 2023-10-16T13:11:24.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.365+0000 7f855b7fe700 1 --2- 172.21.15.92:0/4226530266 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f85500a1520 0x7f85500a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:24.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.365+0000 7f856a0cd700 1 --2- 172.21.15.92:0/4226530266 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f85500a1520 0x7f85500a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:24.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.365+0000 7f855b7fe700 1 -- 172.21.15.92:0/4226530266 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f855c0cc5c0 con 0x7f8564106c70 2023-10-16T13:11:24.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.366+0000 7f856a0cd700 1 --2- 172.21.15.92:0/4226530266 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f85500a1520 0x7f85500a39e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f855400b2e0 tx=0x7f8554005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:24.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.369+0000 7f855b7fe700 1 -- 172.21.15.92:0/4226530266 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f855c0960c0 con 0x7f8564106c70 2023-10-16T13:11:24.533 INFO:journalctl@ceph.mds.h.smithi118.stdout:Oct 16 13:11:24 smithi118 ceph-mds[141095]: -- 172.21.15.118:0/2700803768 <== mon.2 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b8413a91e0 con 0x55b84137e800 2023-10-16T13:11:24.534 INFO:journalctl@ceph.mds.h.smithi118.stdout:Oct 16 13:11:24 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-h[141071]: starting mds.h at 2023-10-16T13:11:24.534 INFO:journalctl@ceph.mds.h.smithi118.stdout:Oct 16 13:11:24 smithi118 bash[141055]: b87e50408d90797c7fc04963a328fd5cedeff0ba2e5463a9ab140e1c078954a3 2023-10-16T13:11:24.534 INFO:journalctl@ceph.mds.h.smithi118.stdout:Oct 16 13:11:24 smithi118 systemd[1]: Started Ceph mds.h for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:11:24.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.603+0000 7f856c331700 1 -- 172.21.15.92:0/4226530266 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85640008d0 con 0x7f8564106c70 2023-10-16T13:11:24.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.603+0000 7f855b7fe700 1 -- 172.21.15.92:0/4226530266 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6880 (secure 0 0 0) 0x7f855c009390 con 0x7f8564106c70 2023-10-16T13:11:24.607 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:24.607 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/2133613540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":2133613540},{"type":"v1","addr":"172.21.15.118:6837","nonce":2133613540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/2403096460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":2403096460},{"type":"v1","addr":"172.21.15.152:6837","nonce":2403096460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-10-16T13:11:24.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.605+0000 7f856c331700 1 -- 172.21.15.92:0/4226530266 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f85500a1520 msgr2=0x7f85500a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:24.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.605+0000 7f856c331700 1 --2- 172.21.15.92:0/4226530266 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f85500a1520 0x7f85500a39e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f855400b2e0 tx=0x7f8554005fb0 comp rx=0 tx=0).stop 2023-10-16T13:11:24.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.605+0000 7f856c331700 1 -- 172.21.15.92:0/4226530266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8564106c70 msgr2=0x7f856419e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:24.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.605+0000 7f856c331700 1 --2- 172.21.15.92:0/4226530266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8564106c70 0x7f856419e1a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f855c007ee0 tx=0x7f855c00d3b0 comp rx=0 tx=0).stop 2023-10-16T13:11:24.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.605+0000 7f856c331700 1 -- 172.21.15.92:0/4226530266 shutdown_connections 2023-10-16T13:11:24.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.605+0000 7f856c331700 1 --2- 172.21.15.92:0/4226530266 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f85500a1520 0x7f85500a39e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:24.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.605+0000 7f856c331700 1 --2- 172.21.15.92:0/4226530266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8564106c70 0x7f856419e1a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:24.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.605+0000 7f856c331700 1 --2- 172.21.15.92:0/4226530266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8564101a10 0x7f8564196c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:24.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.605+0000 7f856c331700 1 --2- 172.21.15.92:0/4226530266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8564104340 0x7f8564197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:24.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.605+0000 7f856c331700 1 -- 172.21.15.92:0/4226530266 >> 172.21.15.92:0/4226530266 conn(0x7f85640fb320 msgr2=0x7f8564102680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:24.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.605+0000 7f856c331700 1 -- 172.21.15.92:0/4226530266 shutdown_connections 2023-10-16T13:11:24.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:24.606+0000 7f856c331700 1 -- 172.21.15.92:0/4226530266 wait complete. 2023-10-16T13:11:24.611 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 9 2023-10-16T13:11:24.923 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:24 smithi152 ceph-mon[104423]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:24.923 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:24 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:24.923 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:24 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:24.924 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:24 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:24.924 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:24 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:24.924 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:24 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:24.924 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:24 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:24.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:24 smithi092 ceph-mon[99542]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:24 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:24 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:24 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:24 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:24.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:24 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:24.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:24 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:25.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:24 smithi118 ceph-mon[103969]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:25.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:24 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:25.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:24 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:25.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:24 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:25.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:24 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:25.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:24 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:25.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:24 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:25.786 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:25 smithi152 ceph-mon[104423]: Deploying daemon mds.i on smithi152 2023-10-16T13:11:25.787 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:25 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.118:6836/2133613540,v1:172.21.15.118:6837/2133613540] up:boot 2023-10-16T13:11:25.787 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:25 smithi152 ceph-mon[104423]: fsmap 8 up:standby 2023-10-16T13:11:25.787 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:25 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-16T13:11:25.787 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:25 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/4226530266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:25.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:25 smithi092 ceph-mon[99542]: Deploying daemon mds.i on smithi152 2023-10-16T13:11:25.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:25 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.118:6836/2133613540,v1:172.21.15.118:6837/2133613540] up:boot 2023-10-16T13:11:25.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:25 smithi092 ceph-mon[99542]: fsmap 8 up:standby 2023-10-16T13:11:25.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:25 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-16T13:11:25.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:25 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/4226530266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:26.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:25 smithi118 ceph-mon[103969]: Deploying daemon mds.i on smithi152 2023-10-16T13:11:26.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:25 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.118:6836/2133613540,v1:172.21.15.118:6837/2133613540] up:boot 2023-10-16T13:11:26.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:25 smithi118 ceph-mon[103969]: fsmap 8 up:standby 2023-10-16T13:11:26.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:25 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-16T13:11:26.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:25 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/4226530266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:26.192 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:11:25 smithi152 systemd[1]: Starting Ceph mds.i for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:11:26.442 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:11:26 smithi152 podman[142333]: 2023-10-16T13:11:26.621 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:11:26.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.754+0000 7fa458f8f700 1 -- 172.21.15.92:0/3311966468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa454100120 msgr2=0x7fa4541005a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:26.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.754+0000 7fa458f8f700 1 --2- 172.21.15.92:0/3311966468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa454100120 0x7fa4541005a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa448009990 tx=0x7fa448009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:26.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.755+0000 7fa458f8f700 1 -- 172.21.15.92:0/3311966468 shutdown_connections 2023-10-16T13:11:26.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.755+0000 7fa458f8f700 1 --2- 172.21.15.92:0/3311966468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa454100ae0 0x7fa454100f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:26.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.755+0000 7fa458f8f700 1 --2- 172.21.15.92:0/3311966468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4540ff7c0 0x7fa4540ffbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:26.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.755+0000 7fa458f8f700 1 --2- 172.21.15.92:0/3311966468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa454100120 0x7fa4541005a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:26.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.755+0000 7fa458f8f700 1 -- 172.21.15.92:0/3311966468 >> 172.21.15.92:0/3311966468 conn(0x7fa4540fb320 msgr2=0x7fa4540fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:26.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.755+0000 7fa458f8f700 1 -- 172.21.15.92:0/3311966468 shutdown_connections 2023-10-16T13:11:26.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.755+0000 7fa458f8f700 1 -- 172.21.15.92:0/3311966468 wait complete. 2023-10-16T13:11:26.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.755+0000 7fa458f8f700 1 Processor -- start 2023-10-16T13:11:26.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.755+0000 7fa458f8f700 1 -- start start 2023-10-16T13:11:26.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.755+0000 7fa458f8f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4540ff7c0 0x7fa454198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:26.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.755+0000 7fa458f8f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa454100120 0x7fa454199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:26.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.755+0000 7fa458f8f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa454100ae0 0x7fa4541a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:26.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.755+0000 7fa458f8f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4541a08c0 con 0x7fa454100ae0 2023-10-16T13:11:26.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.755+0000 7fa458f8f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4541a0a00 con 0x7fa454100120 2023-10-16T13:11:26.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.755+0000 7fa458f8f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4541a0b90 con 0x7fa4540ff7c0 2023-10-16T13:11:26.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.756+0000 7fa452d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa454100ae0 0x7fa4541a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:26.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.756+0000 7fa452d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa454100ae0 0x7fa4541a02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35036/0 (socket says 172.21.15.92:35036) 2023-10-16T13:11:26.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.756+0000 7fa452d9d700 1 -- 172.21.15.92:0/3904568457 learned_addr learned my addr 172.21.15.92:0/3904568457 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:26.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.756+0000 7fa45259c700 1 --2- 172.21.15.92:0/3904568457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4540ff7c0 0x7fa454198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:26.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.756+0000 7fa451d9b700 1 --2- 172.21.15.92:0/3904568457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa454100120 0x7fa454199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:26.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.756+0000 7fa452d9d700 1 -- 172.21.15.92:0/3904568457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4540ff7c0 msgr2=0x7fa454198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:26.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.756+0000 7fa452d9d700 1 --2- 172.21.15.92:0/3904568457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4540ff7c0 0x7fa454198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:26.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.756+0000 7fa452d9d700 1 -- 172.21.15.92:0/3904568457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa454100120 msgr2=0x7fa454199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:26.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.756+0000 7fa452d9d700 1 --2- 172.21.15.92:0/3904568457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa454100120 0x7fa454199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:26.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.756+0000 7fa452d9d700 1 -- 172.21.15.92:0/3904568457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4480095f0 con 0x7fa454100ae0 2023-10-16T13:11:26.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.756+0000 7fa452d9d700 1 --2- 172.21.15.92:0/3904568457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa454100ae0 0x7fa4541a02f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa44c007d70 tx=0x7fa44c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:26.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.756+0000 7fa4437fe700 1 -- 172.21.15.92:0/3904568457 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c00ac90 con 0x7fa454100ae0 2023-10-16T13:11:26.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.756+0000 7fa4437fe700 1 -- 172.21.15.92:0/3904568457 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa44c00adf0 con 0x7fa454100ae0 2023-10-16T13:11:26.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.756+0000 7fa458f8f700 1 -- 172.21.15.92:0/3904568457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4541a0e70 con 0x7fa454100ae0 2023-10-16T13:11:26.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.756+0000 7fa4437fe700 1 -- 172.21.15.92:0/3904568457 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c0116b0 con 0x7fa454100ae0 2023-10-16T13:11:26.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.756+0000 7fa458f8f700 1 -- 172.21.15.92:0/3904568457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4541a12a0 con 0x7fa454100ae0 2023-10-16T13:11:26.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.758+0000 7fa458f8f700 1 -- 172.21.15.92:0/3904568457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45410a5a0 con 0x7fa454100ae0 2023-10-16T13:11:26.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.758+0000 7fa4437fe700 1 -- 172.21.15.92:0/3904568457 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa44c012420 con 0x7fa454100ae0 2023-10-16T13:11:26.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.759+0000 7fa4437fe700 1 --2- 172.21.15.92:0/3904568457 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa43c0a1520 0x7fa43c0a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:26.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.759+0000 7fa45259c700 1 --2- 172.21.15.92:0/3904568457 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa43c0a1520 0x7fa43c0a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:26.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.759+0000 7fa4437fe700 1 -- 172.21.15.92:0/3904568457 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa44c0cca70 con 0x7fa454100ae0 2023-10-16T13:11:26.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.759+0000 7fa45259c700 1 --2- 172.21.15.92:0/3904568457 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa43c0a1520 0x7fa43c0a39e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa444005950 tx=0x7fa44400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:26.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:26.763+0000 7fa4437fe700 1 -- 172.21.15.92:0/3904568457 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa44c096570 con 0x7fa454100ae0 2023-10-16T13:11:26.942 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:11:26 smithi152 ceph-mds[142373]: -- 172.21.15.152:0/936222964 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560118fe11e0 con 0x560118fb6800 2023-10-16T13:11:26.943 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:11:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: starting mds.i at 2023-10-16T13:11:26.943 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:11:26 smithi152 bash[142333]: 01b28e3a5fce0ebe5744fae1ec60bd5637941014935a765fbdea4264499fc426 2023-10-16T13:11:26.943 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:11:26 smithi152 systemd[1]: Started Ceph mds.i for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:11:26.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:26 smithi152 ceph-mon[104423]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:26.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:26.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:26.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:26.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:26.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:26.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:26 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:26 smithi092 ceph-mon[99542]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:26.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:26.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:26 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:27.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:26 smithi118 ceph-mon[103969]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:27.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:26 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:27.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:26 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:27.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:26 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:27.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:26 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:27.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:26 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:27.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:26 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:27.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:27.050+0000 7fa458f8f700 1 -- 172.21.15.92:0/3904568457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa45410ec80 con 0x7fa454100ae0 2023-10-16T13:11:27.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:27.051+0000 7fa4437fe700 1 -- 172.21.15.92:0/3904568457 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7676 (secure 0 0 0) 0x7fa44c099b90 con 0x7fa454100ae0 2023-10-16T13:11:27.054 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:27.054 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/2133613540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":2133613540},{"type":"v1","addr":"172.21.15.118:6837","nonce":2133613540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/2403096460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":2403096460},{"type":"v1","addr":"172.21.15.152:6837","nonce":2403096460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/1821921588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1821921588},{"type":"v1","addr":"172.21.15.152:6839","nonce":1821921588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-16T13:11:27.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:27.054+0000 7fa458f8f700 1 -- 172.21.15.92:0/3904568457 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa43c0a1520 msgr2=0x7fa43c0a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:27.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:27.054+0000 7fa458f8f700 1 --2- 172.21.15.92:0/3904568457 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa43c0a1520 0x7fa43c0a39e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa444005950 tx=0x7fa44400a300 comp rx=0 tx=0).stop 2023-10-16T13:11:27.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:27.054+0000 7fa458f8f700 1 -- 172.21.15.92:0/3904568457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa454100ae0 msgr2=0x7fa4541a02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:27.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:27.054+0000 7fa458f8f700 1 --2- 172.21.15.92:0/3904568457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa454100ae0 0x7fa4541a02f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa44c007d70 tx=0x7fa44c00a340 comp rx=0 tx=0).stop 2023-10-16T13:11:27.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:27.054+0000 7fa458f8f700 1 -- 172.21.15.92:0/3904568457 shutdown_connections 2023-10-16T13:11:27.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:27.054+0000 7fa458f8f700 1 --2- 172.21.15.92:0/3904568457 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa43c0a1520 0x7fa43c0a39e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:27.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:27.054+0000 7fa458f8f700 1 --2- 172.21.15.92:0/3904568457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa454100ae0 0x7fa4541a02f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:27.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:27.054+0000 7fa458f8f700 1 --2- 172.21.15.92:0/3904568457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4540ff7c0 0x7fa454198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:27.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:27.054+0000 7fa458f8f700 1 --2- 172.21.15.92:0/3904568457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa454100120 0x7fa454199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:27.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:27.054+0000 7fa458f8f700 1 -- 172.21.15.92:0/3904568457 >> 172.21.15.92:0/3904568457 conn(0x7fa4540fb320 msgr2=0x7fa4540fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:27.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:27.055+0000 7fa458f8f700 1 -- 172.21.15.92:0/3904568457 shutdown_connections 2023-10-16T13:11:27.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:27.055+0000 7fa458f8f700 1 -- 172.21.15.92:0/3904568457 wait complete. 2023-10-16T13:11:27.060 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 10 2023-10-16T13:11:27.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:27 smithi092 ceph-mon[99542]: Deploying daemon mds.g on smithi092 2023-10-16T13:11:27.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:27 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] up:boot 2023-10-16T13:11:27.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:27 smithi092 ceph-mon[99542]: fsmap 9 up:standby 2023-10-16T13:11:27.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:27 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-16T13:11:27.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:27 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3904568457' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:27.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:27 smithi152 ceph-mon[104423]: Deploying daemon mds.g on smithi092 2023-10-16T13:11:27.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:27 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] up:boot 2023-10-16T13:11:27.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:27 smithi152 ceph-mon[104423]: fsmap 9 up:standby 2023-10-16T13:11:27.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:27 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-16T13:11:27.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:27 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3904568457' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:28.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:27 smithi118 ceph-mon[103969]: Deploying daemon mds.g on smithi092 2023-10-16T13:11:28.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:27 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] up:boot 2023-10-16T13:11:28.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:27 smithi118 ceph-mon[103969]: fsmap 9 up:standby 2023-10-16T13:11:28.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:27 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-16T13:11:28.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:27 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3904568457' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:28.497 INFO:journalctl@ceph.mds.g.smithi092.stdout:Oct 16 13:11:28 smithi092 systemd[1]: Starting Ceph mds.g for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:11:28.899 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:28 smithi092 ceph-mon[99542]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:28.900 INFO:journalctl@ceph.mds.g.smithi092.stdout:Oct 16 13:11:28 smithi092 podman[150367]: 2023-10-16T13:11:28.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:28 smithi152 ceph-mon[104423]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:29.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:28 smithi118 ceph-mon[103969]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:29.072 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:11:29.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.199+0000 7fcd75587700 1 -- 172.21.15.92:0/3330063821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd70101930 msgr2=0x7fcd70108250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:29.203 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.199+0000 7fcd75587700 1 --2- 172.21.15.92:0/3330063821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd70101930 0x7fcd70108250 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcd6800b0a0 tx=0x7fcd6800b3b0 comp rx=0 tx=0).stop 2023-10-16T13:11:29.203 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.199+0000 7fcd75587700 1 -- 172.21.15.92:0/3330063821 shutdown_connections 2023-10-16T13:11:29.203 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.199+0000 7fcd75587700 1 --2- 172.21.15.92:0/3330063821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd70101930 0x7fcd70108250 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:29.203 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.199+0000 7fcd75587700 1 --2- 172.21.15.92:0/3330063821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd700ffe20 0x7fcd70100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:29.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.199+0000 7fcd75587700 1 --2- 172.21.15.92:0/3330063821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd70100f70 0x7fcd701013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:29.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.199+0000 7fcd75587700 1 -- 172.21.15.92:0/3330063821 >> 172.21.15.92:0/3330063821 conn(0x7fcd700fb3b0 msgr2=0x7fcd700fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:29.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.200+0000 7fcd75587700 1 -- 172.21.15.92:0/3330063821 shutdown_connections 2023-10-16T13:11:29.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.200+0000 7fcd75587700 1 -- 172.21.15.92:0/3330063821 wait complete. 2023-10-16T13:11:29.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.200+0000 7fcd75587700 1 Processor -- start 2023-10-16T13:11:29.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.200+0000 7fcd75587700 1 -- start start 2023-10-16T13:11:29.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.200+0000 7fcd75587700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd700ffe20 0x7fcd70103da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:29.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.200+0000 7fcd75587700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd70100f70 0x7fcd701023e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:29.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.200+0000 7fcd75587700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd70101930 0x7fcd70102920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:29.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.200+0000 7fcd75587700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd701030c0 con 0x7fcd700ffe20 2023-10-16T13:11:29.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.200+0000 7fcd75587700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd70103230 con 0x7fcd70101930 2023-10-16T13:11:29.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.200+0000 7fcd75587700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd701a0d50 con 0x7fcd70100f70 2023-10-16T13:11:29.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.201+0000 7fcd6effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd700ffe20 0x7fcd70103da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:29.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.201+0000 7fcd6effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd700ffe20 0x7fcd70103da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35058/0 (socket says 172.21.15.92:35058) 2023-10-16T13:11:29.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.201+0000 7fcd6effd700 1 -- 172.21.15.92:0/213412452 learned_addr learned my addr 172.21.15.92:0/213412452 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:29.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.201+0000 7fcd6f7fe700 1 --2- 172.21.15.92:0/213412452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd70101930 0x7fcd70102920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:29.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.201+0000 7fcd6e7fc700 1 --2- 172.21.15.92:0/213412452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd70100f70 0x7fcd701023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:29.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.201+0000 7fcd6effd700 1 -- 172.21.15.92:0/213412452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd70100f70 msgr2=0x7fcd701023e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:29.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.201+0000 7fcd6effd700 1 --2- 172.21.15.92:0/213412452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd70100f70 0x7fcd701023e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:29.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.201+0000 7fcd6effd700 1 -- 172.21.15.92:0/213412452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd70101930 msgr2=0x7fcd70102920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:29.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.201+0000 7fcd6effd700 1 --2- 172.21.15.92:0/213412452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd70101930 0x7fcd70102920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:29.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.201+0000 7fcd6effd700 1 -- 172.21.15.92:0/213412452 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd68009d00 con 0x7fcd700ffe20 2023-10-16T13:11:29.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.201+0000 7fcd6effd700 1 --2- 172.21.15.92:0/213412452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd700ffe20 0x7fcd70103da0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000b530 tx=0x7fcd6000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:29.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.201+0000 7fcd57fff700 1 -- 172.21.15.92:0/213412452 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd60011830 con 0x7fcd700ffe20 2023-10-16T13:11:29.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.201+0000 7fcd75587700 1 -- 172.21.15.92:0/213412452 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd701a0fd0 con 0x7fcd700ffe20 2023-10-16T13:11:29.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.201+0000 7fcd57fff700 1 -- 172.21.15.92:0/213412452 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcd60011e70 con 0x7fcd700ffe20 2023-10-16T13:11:29.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.201+0000 7fcd57fff700 1 -- 172.21.15.92:0/213412452 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6000f300 con 0x7fcd700ffe20 2023-10-16T13:11:29.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.201+0000 7fcd75587700 1 -- 172.21.15.92:0/213412452 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd701a1520 con 0x7fcd700ffe20 2023-10-16T13:11:29.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.203+0000 7fcd75587700 1 -- 172.21.15.92:0/213412452 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7010b7e0 con 0x7fcd700ffe20 2023-10-16T13:11:29.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.203+0000 7fcd57fff700 1 -- 172.21.15.92:0/213412452 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fcd600106d0 con 0x7fcd700ffe20 2023-10-16T13:11:29.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.204+0000 7fcd57fff700 1 --2- 172.21.15.92:0/213412452 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fcd580a1520 0x7fcd580a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:29.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.204+0000 7fcd57fff700 1 -- 172.21.15.92:0/213412452 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcd600cc3f0 con 0x7fcd700ffe20 2023-10-16T13:11:29.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.204+0000 7fcd6e7fc700 1 --2- 172.21.15.92:0/213412452 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fcd580a1520 0x7fcd580a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:29.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.204+0000 7fcd6e7fc700 1 --2- 172.21.15.92:0/213412452 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fcd580a1520 0x7fcd580a39e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcd64005950 tx=0x7fcd640058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.208+0000 7fcd57fff700 1 -- 172.21.15.92:0/213412452 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcd60095ef0 con 0x7fcd700ffe20 2023-10-16T13:11:29.246 INFO:journalctl@ceph.mds.g.smithi092.stdout:Oct 16 13:11:28 smithi092 ceph-mds[150408]: -- 172.21.15.92:0/1320866786 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55aeb9d931e0 con 0x55aeb9d69000 2023-10-16T13:11:29.247 INFO:journalctl@ceph.mds.g.smithi092.stdout:Oct 16 13:11:28 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-g[150383]: starting mds.g at 2023-10-16T13:11:29.247 INFO:journalctl@ceph.mds.g.smithi092.stdout:Oct 16 13:11:28 smithi092 bash[150367]: 20201c7fe07ef0b7ffdee7849e633b84f0cf05ba9b43f92ffb04c4671d607302 2023-10-16T13:11:29.247 INFO:journalctl@ceph.mds.g.smithi092.stdout:Oct 16 13:11:28 smithi092 systemd[1]: Started Ceph mds.g for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:11:29.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.461+0000 7fcd75587700 1 -- 172.21.15.92:0/213412452 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd701a17a0 con 0x7fcd700ffe20 2023-10-16T13:11:29.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.462+0000 7fcd57fff700 1 -- 172.21.15.92:0/213412452 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7676 (secure 0 0 0) 0x7fcd60099510 con 0x7fcd700ffe20 2023-10-16T13:11:29.465 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:29.465 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/2133613540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":2133613540},{"type":"v1","addr":"172.21.15.118:6837","nonce":2133613540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/2403096460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":2403096460},{"type":"v1","addr":"172.21.15.152:6837","nonce":2403096460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/1821921588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1821921588},{"type":"v1","addr":"172.21.15.152:6839","nonce":1821921588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-16T13:11:29.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.464+0000 7fcd75587700 1 -- 172.21.15.92:0/213412452 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fcd580a1520 msgr2=0x7fcd580a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:29.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.464+0000 7fcd75587700 1 --2- 172.21.15.92:0/213412452 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fcd580a1520 0x7fcd580a39e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcd64005950 tx=0x7fcd640058e0 comp rx=0 tx=0).stop 2023-10-16T13:11:29.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.464+0000 7fcd75587700 1 -- 172.21.15.92:0/213412452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd700ffe20 msgr2=0x7fcd70103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:29.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.464+0000 7fcd75587700 1 --2- 172.21.15.92:0/213412452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd700ffe20 0x7fcd70103da0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000b530 tx=0x7fcd6000b840 comp rx=0 tx=0).stop 2023-10-16T13:11:29.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.464+0000 7fcd75587700 1 -- 172.21.15.92:0/213412452 shutdown_connections 2023-10-16T13:11:29.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.464+0000 7fcd75587700 1 --2- 172.21.15.92:0/213412452 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fcd580a1520 0x7fcd580a39e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:29.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.464+0000 7fcd75587700 1 --2- 172.21.15.92:0/213412452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd700ffe20 0x7fcd70103da0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:29.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.464+0000 7fcd75587700 1 --2- 172.21.15.92:0/213412452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd70101930 0x7fcd70102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:29.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.464+0000 7fcd75587700 1 --2- 172.21.15.92:0/213412452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd70100f70 0x7fcd701023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:29.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.464+0000 7fcd75587700 1 -- 172.21.15.92:0/213412452 >> 172.21.15.92:0/213412452 conn(0x7fcd700fb3b0 msgr2=0x7fcd70069070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:29.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.464+0000 7fcd75587700 1 -- 172.21.15.92:0/213412452 shutdown_connections 2023-10-16T13:11:29.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:29.464+0000 7fcd75587700 1 -- 172.21.15.92:0/213412452 wait complete. 2023-10-16T13:11:29.469 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 10 2023-10-16T13:11:30.190 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:30.190 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:30.191 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:30.191 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:30.191 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:30.191 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:30.191 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:29 smithi092 ceph-mon[99542]: Deploying daemon mds.a on smithi092 2023-10-16T13:11:30.192 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:29 smithi092 ceph-mon[99542]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:30.192 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:29 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/213412452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:30.192 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:29 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.92:6838/1790514945,v1:172.21.15.92:6839/1790514945] up:boot 2023-10-16T13:11:30.192 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:29 smithi092 ceph-mon[99542]: fsmap 10 up:standby 2023-10-16T13:11:30.192 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:29 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-16T13:11:30.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:30.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:30.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:30.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:30.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:30.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:30.285 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:29 smithi118 ceph-mon[103969]: Deploying daemon mds.a on smithi092 2023-10-16T13:11:30.285 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:29 smithi118 ceph-mon[103969]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:30.285 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:29 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/213412452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:30.285 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:29 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.92:6838/1790514945,v1:172.21.15.92:6839/1790514945] up:boot 2023-10-16T13:11:30.285 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:29 smithi118 ceph-mon[103969]: fsmap 10 up:standby 2023-10-16T13:11:30.285 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:29 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-16T13:11:30.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:30.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:30.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:30.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:30.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:30.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:30.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:29 smithi152 ceph-mon[104423]: Deploying daemon mds.a on smithi092 2023-10-16T13:11:30.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:29 smithi152 ceph-mon[104423]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:30.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:29 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/213412452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:30.445 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:29 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.92:6838/1790514945,v1:172.21.15.92:6839/1790514945] up:boot 2023-10-16T13:11:30.445 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:29 smithi152 ceph-mon[104423]: fsmap 10 up:standby 2023-10-16T13:11:30.445 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:29 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-16T13:11:30.747 INFO:journalctl@ceph.mds.a.smithi092.stdout:Oct 16 13:11:30 smithi092 systemd[1]: Starting Ceph mds.a for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:11:31.116 INFO:journalctl@ceph.mds.a.smithi092.stdout:Oct 16 13:11:30 smithi092 podman[150755]: 2023-10-16T13:11:31.480 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:11:31.496 INFO:journalctl@ceph.mds.a.smithi092.stdout:Oct 16 13:11:31 smithi092 ceph-mds[150795]: -- 172.21.15.92:0/146341812 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d478ee51e0 con 0x55d478eba800 2023-10-16T13:11:31.497 INFO:journalctl@ceph.mds.a.smithi092.stdout:Oct 16 13:11:31 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-a[150771]: starting mds.a at 2023-10-16T13:11:31.497 INFO:journalctl@ceph.mds.a.smithi092.stdout:Oct 16 13:11:31 smithi092 bash[150755]: a06763ee02450735d8f70a6b8ae4fd4a3db4fd7e7e1d26bf14510f6ea136c697 2023-10-16T13:11:31.497 INFO:journalctl@ceph.mds.a.smithi092.stdout:Oct 16 13:11:31 smithi092 systemd[1]: Started Ceph mds.a for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:11:31.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.606+0000 7fdf9ca03700 1 -- 172.21.15.92:0/3205656183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf980ff5c0 msgr2=0x7fdf980ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:31.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.606+0000 7fdf9ca03700 1 --2- 172.21.15.92:0/3205656183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf980ff5c0 0x7fdf980ff9e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdf880099c0 tx=0x7fdf88009cd0 comp rx=0 tx=0).stop 2023-10-16T13:11:31.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.606+0000 7fdf9ca03700 1 -- 172.21.15.92:0/3205656183 shutdown_connections 2023-10-16T13:11:31.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.606+0000 7fdf9ca03700 1 --2- 172.21.15.92:0/3205656183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf980ff5c0 0x7fdf980ff9e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:31.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.606+0000 7fdf9ca03700 1 --2- 172.21.15.92:0/3205656183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf98101150 0x7fdf98107a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:31.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.606+0000 7fdf9ca03700 1 --2- 172.21.15.92:0/3205656183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf981007b0 0x7fdf98100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:31.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.606+0000 7fdf9ca03700 1 -- 172.21.15.92:0/3205656183 >> 172.21.15.92:0/3205656183 conn(0x7fdf980fab30 msgr2=0x7fdf980fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:31.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.606+0000 7fdf9ca03700 1 -- 172.21.15.92:0/3205656183 shutdown_connections 2023-10-16T13:11:31.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.606+0000 7fdf9ca03700 1 -- 172.21.15.92:0/3205656183 wait complete. 2023-10-16T13:11:31.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf9ca03700 1 Processor -- start 2023-10-16T13:11:31.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf9ca03700 1 -- start start 2023-10-16T13:11:31.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf9ca03700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf980ff5c0 0x7fdf981961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:31.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf9ca03700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf981007b0 0x7fdf981947e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:31.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf9ca03700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf98101150 0x7fdf98194d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:31.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf9ca03700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf981954c0 con 0x7fdf980ff5c0 2023-10-16T13:11:31.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf9ca03700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf98195630 con 0x7fdf981007b0 2023-10-16T13:11:31.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf9ca03700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf981a0c70 con 0x7fdf98101150 2023-10-16T13:11:31.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf9659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf980ff5c0 0x7fdf981961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:31.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf9659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf980ff5c0 0x7fdf981961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35086/0 (socket says 172.21.15.92:35086) 2023-10-16T13:11:31.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf9659c700 1 -- 172.21.15.92:0/1054424678 learned_addr learned my addr 172.21.15.92:0/1054424678 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:31.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf95d9b700 1 --2- 172.21.15.92:0/1054424678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf981007b0 0x7fdf981947e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:31.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf96d9d700 1 --2- 172.21.15.92:0/1054424678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf98101150 0x7fdf98194d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:31.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf9659c700 1 -- 172.21.15.92:0/1054424678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf98101150 msgr2=0x7fdf98194d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:31.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf9659c700 1 --2- 172.21.15.92:0/1054424678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf98101150 0x7fdf98194d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:31.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf9659c700 1 -- 172.21.15.92:0/1054424678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf981007b0 msgr2=0x7fdf981947e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:31.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf9659c700 1 --2- 172.21.15.92:0/1054424678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf981007b0 0x7fdf981947e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:31.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf9659c700 1 -- 172.21.15.92:0/1054424678 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf880095f0 con 0x7fdf980ff5c0 2023-10-16T13:11:31.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf96d9d700 1 --2- 172.21.15.92:0/1054424678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf98101150 0x7fdf98194d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:11:31.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf9659c700 1 --2- 172.21.15.92:0/1054424678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf980ff5c0 0x7fdf981961a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdf880098e0 tx=0x7fdf88009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:31.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.607+0000 7fdf877fe700 1 -- 172.21.15.92:0/1054424678 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8801d070 con 0x7fdf980ff5c0 2023-10-16T13:11:31.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.608+0000 7fdf9ca03700 1 -- 172.21.15.92:0/1054424678 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf981a0ef0 con 0x7fdf980ff5c0 2023-10-16T13:11:31.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.608+0000 7fdf877fe700 1 -- 172.21.15.92:0/1054424678 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdf88022470 con 0x7fdf980ff5c0 2023-10-16T13:11:31.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.608+0000 7fdf877fe700 1 -- 172.21.15.92:0/1054424678 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88017650 con 0x7fdf980ff5c0 2023-10-16T13:11:31.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.608+0000 7fdf9ca03700 1 -- 172.21.15.92:0/1054424678 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf981a1260 con 0x7fdf980ff5c0 2023-10-16T13:11:31.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.608+0000 7fdf9ca03700 1 -- 172.21.15.92:0/1054424678 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9810a700 con 0x7fdf980ff5c0 2023-10-16T13:11:31.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.610+0000 7fdf877fe700 1 -- 172.21.15.92:0/1054424678 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fdf880225e0 con 0x7fdf980ff5c0 2023-10-16T13:11:31.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.610+0000 7fdf877fe700 1 --2- 172.21.15.92:0/1054424678 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdf800a1520 0x7fdf800a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:31.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.610+0000 7fdf877fe700 1 -- 172.21.15.92:0/1054424678 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fdf880cdee0 con 0x7fdf980ff5c0 2023-10-16T13:11:31.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.610+0000 7fdf95d9b700 1 --2- 172.21.15.92:0/1054424678 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdf800a1520 0x7fdf800a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:31.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.611+0000 7fdf95d9b700 1 --2- 172.21.15.92:0/1054424678 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdf800a1520 0x7fdf800a39e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c00acd0 tx=0x7fdf8c010040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:31.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.614+0000 7fdf877fe700 1 -- 172.21.15.92:0/1054424678 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdf88097a70 con 0x7fdf980ff5c0 2023-10-16T13:11:31.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.847+0000 7fdf9ca03700 1 -- 172.21.15.92:0/1054424678 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf9810a9d0 con 0x7fdf980ff5c0 2023-10-16T13:11:31.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.848+0000 7fdf877fe700 1 -- 172.21.15.92:0/1054424678 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9260 (secure 0 0 0) 0x7fdf8809b090 con 0x7fdf980ff5c0 2023-10-16T13:11:31.851 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:31.851 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/1790514945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1790514945},{"type":"v1","addr":"172.21.15.92:6839","nonce":1790514945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1016260236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1016260236},{"type":"v1","addr":"172.21.15.92:6841","nonce":1016260236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/2133613540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":2133613540},{"type":"v1","addr":"172.21.15.118:6837","nonce":2133613540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/2403096460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":2403096460},{"type":"v1","addr":"172.21.15.152:6837","nonce":2403096460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/1821921588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1821921588},{"type":"v1","addr":"172.21.15.152:6839","nonce":1821921588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-16T13:11:31.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.850+0000 7fdf9ca03700 1 -- 172.21.15.92:0/1054424678 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdf800a1520 msgr2=0x7fdf800a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:31.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.850+0000 7fdf9ca03700 1 --2- 172.21.15.92:0/1054424678 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdf800a1520 0x7fdf800a39e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c00acd0 tx=0x7fdf8c010040 comp rx=0 tx=0).stop 2023-10-16T13:11:31.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.850+0000 7fdf9ca03700 1 -- 172.21.15.92:0/1054424678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf980ff5c0 msgr2=0x7fdf981961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:31.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.850+0000 7fdf9ca03700 1 --2- 172.21.15.92:0/1054424678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf980ff5c0 0x7fdf981961a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdf880098e0 tx=0x7fdf88009580 comp rx=0 tx=0).stop 2023-10-16T13:11:31.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.850+0000 7fdf9ca03700 1 -- 172.21.15.92:0/1054424678 shutdown_connections 2023-10-16T13:11:31.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.850+0000 7fdf9ca03700 1 --2- 172.21.15.92:0/1054424678 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdf800a1520 0x7fdf800a39e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:31.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.850+0000 7fdf9ca03700 1 --2- 172.21.15.92:0/1054424678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf980ff5c0 0x7fdf981961a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:31.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.850+0000 7fdf9ca03700 1 --2- 172.21.15.92:0/1054424678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf98101150 0x7fdf98194d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:31.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.850+0000 7fdf9ca03700 1 --2- 172.21.15.92:0/1054424678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf981007b0 0x7fdf981947e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:31.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.850+0000 7fdf9ca03700 1 -- 172.21.15.92:0/1054424678 >> 172.21.15.92:0/1054424678 conn(0x7fdf980fab30 msgr2=0x7fdf980fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:31.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.850+0000 7fdf9ca03700 1 -- 172.21.15.92:0/1054424678 shutdown_connections 2023-10-16T13:11:31.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:31.850+0000 7fdf9ca03700 1 -- 172.21.15.92:0/1054424678 wait complete. 2023-10-16T13:11:31.858 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 12 2023-10-16T13:11:32.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:32 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:32.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:32 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:32.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:32 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:32.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:32 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:32.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:32 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:32.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:32 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:32.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:32 smithi092 ceph-mon[99542]: Deploying daemon mds.b on smithi118 2023-10-16T13:11:32.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:32 smithi092 ceph-mon[99542]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:32.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:32 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.92:6840/1016260236,v1:172.21.15.92:6841/1016260236] up:boot 2023-10-16T13:11:32.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:32 smithi092 ceph-mon[99542]: fsmap 11 up:standby 2023-10-16T13:11:32.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:32 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-16T13:11:32.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:32 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1054424678' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:32.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:32 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:32.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:32 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:32.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:32 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:32.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:32 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:32.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:32 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:32.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:32 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:32.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:32 smithi118 ceph-mon[103969]: Deploying daemon mds.b on smithi118 2023-10-16T13:11:32.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:32 smithi118 ceph-mon[103969]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:32.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:32 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.92:6840/1016260236,v1:172.21.15.92:6841/1016260236] up:boot 2023-10-16T13:11:32.535 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:32 smithi118 ceph-mon[103969]: fsmap 11 up:standby 2023-10-16T13:11:32.536 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:32 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-16T13:11:32.536 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:32 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1054424678' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:32.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:32 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:32.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:32 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:32.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:32 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:32.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:32 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-16T13:11:32.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:32 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-16T13:11:32.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:32 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:32.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:32 smithi152 ceph-mon[104423]: Deploying daemon mds.b on smithi118 2023-10-16T13:11:32.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:32 smithi152 ceph-mon[104423]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:32.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:32 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.92:6840/1016260236,v1:172.21.15.92:6841/1016260236] up:boot 2023-10-16T13:11:32.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:32 smithi152 ceph-mon[104423]: fsmap 11 up:standby 2023-10-16T13:11:32.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:32 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-16T13:11:32.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:32 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1054424678' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:33.464 INFO:journalctl@ceph.mds.b.smithi118.stdout:Oct 16 13:11:32 smithi118 systemd[1]: Starting Ceph mds.b for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:11:33.464 INFO:journalctl@ceph.mds.b.smithi118.stdout:Oct 16 13:11:33 smithi118 podman[141398]: 2023-10-16T13:11:33.465 INFO:journalctl@ceph.mds.b.smithi118.stdout:Oct 16 13:11:33 smithi118 bash[141398]: e8dde3f8820870f23fa77cf14ac9bd03e44854e90eb80866f59ff0288d6dc486 2023-10-16T13:11:33.783 INFO:journalctl@ceph.mds.b.smithi118.stdout:Oct 16 13:11:33 smithi118 ceph-mds[141438]: -- 172.21.15.118:0/3119362761 <== mon.2 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561d5dd9f1e0 con 0x561d5dd75000 2023-10-16T13:11:33.784 INFO:journalctl@ceph.mds.b.smithi118.stdout:Oct 16 13:11:33 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-b[141414]: starting mds.b at 2023-10-16T13:11:33.784 INFO:journalctl@ceph.mds.b.smithi118.stdout:Oct 16 13:11:33 smithi118 systemd[1]: Started Ceph mds.b for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:11:33.866 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:11:34.009 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.007+0000 7f76b26fe700 1 -- 172.21.15.92:0/3712348792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76ac101950 msgr2=0x7f76ac103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:34.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.007+0000 7f76b26fe700 1 --2- 172.21.15.92:0/3712348792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76ac101950 0x7f76ac103d40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f769c009990 tx=0x7f769c009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:34.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.007+0000 7f76b26fe700 1 -- 172.21.15.92:0/3712348792 shutdown_connections 2023-10-16T13:11:34.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.007+0000 7f76b26fe700 1 --2- 172.21.15.92:0/3712348792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76ac101950 0x7f76ac103d40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:34.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.007+0000 7f76b26fe700 1 --2- 172.21.15.92:0/3712348792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76ac106bb0 0x7f76ac109020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:34.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.007+0000 7f76b26fe700 1 --2- 172.21.15.92:0/3712348792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76ac104280 0x7f76ac106670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:34.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.007+0000 7f76b26fe700 1 -- 172.21.15.92:0/3712348792 >> 172.21.15.92:0/3712348792 conn(0x7f76ac0fb320 msgr2=0x7f76ac0fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:34.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.007+0000 7f76b26fe700 1 -- 172.21.15.92:0/3712348792 shutdown_connections 2023-10-16T13:11:34.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.007+0000 7f76b26fe700 1 -- 172.21.15.92:0/3712348792 wait complete. 2023-10-16T13:11:34.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.008+0000 7f76b26fe700 1 Processor -- start 2023-10-16T13:11:34.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.008+0000 7f76b26fe700 1 -- start start 2023-10-16T13:11:34.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.008+0000 7f76b26fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76ac101950 0x7f76ac1012c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:34.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.008+0000 7f76b26fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76ac104280 0x7f76ac0ff900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:34.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.008+0000 7f76b26fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76ac106bb0 0x7f76ac0ffe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:34.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.008+0000 7f76b26fe700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac1005e0 con 0x7f76ac101950 2023-10-16T13:11:34.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.008+0000 7f76b26fe700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac100750 con 0x7f76ac106bb0 2023-10-16T13:11:34.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.008+0000 7f76b26fe700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac1a0c00 con 0x7f76ac104280 2023-10-16T13:11:34.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.008+0000 7f76abfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76ac101950 0x7f76ac1012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:34.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.008+0000 7f76abfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76ac101950 0x7f76ac1012c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35100/0 (socket says 172.21.15.92:35100) 2023-10-16T13:11:34.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.008+0000 7f76abfff700 1 -- 172.21.15.92:0/3796415755 learned_addr learned my addr 172.21.15.92:0/3796415755 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:34.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.008+0000 7f76ab7fe700 1 --2- 172.21.15.92:0/3796415755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76ac104280 0x7f76ac0ff900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:34.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.008+0000 7f76b0c9b700 1 --2- 172.21.15.92:0/3796415755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76ac106bb0 0x7f76ac0ffe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:34.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.009+0000 7f76abfff700 1 -- 172.21.15.92:0/3796415755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76ac104280 msgr2=0x7f76ac0ff900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:34.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.009+0000 7f76abfff700 1 --2- 172.21.15.92:0/3796415755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76ac104280 0x7f76ac0ff900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:34.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.009+0000 7f76abfff700 1 -- 172.21.15.92:0/3796415755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76ac106bb0 msgr2=0x7f76ac0ffe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:34.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.009+0000 7f76abfff700 1 --2- 172.21.15.92:0/3796415755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76ac106bb0 0x7f76ac0ffe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:34.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.009+0000 7f76abfff700 1 -- 172.21.15.92:0/3796415755 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a0009520 con 0x7f76ac101950 2023-10-16T13:11:34.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.009+0000 7f76abfff700 1 --2- 172.21.15.92:0/3796415755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76ac101950 0x7f76ac1012c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f769c0059d0 tx=0x7f769c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:34.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.009+0000 7f76a97fa700 1 -- 172.21.15.92:0/3796415755 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c01d070 con 0x7f76ac101950 2023-10-16T13:11:34.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.009+0000 7f76b26fe700 1 -- 172.21.15.92:0/3796415755 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769c0095f0 con 0x7f76ac101950 2023-10-16T13:11:34.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.009+0000 7f76a97fa700 1 -- 172.21.15.92:0/3796415755 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f769c00fd70 con 0x7f76ac101950 2023-10-16T13:11:34.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.009+0000 7f76a97fa700 1 -- 172.21.15.92:0/3796415755 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c017650 con 0x7f76ac101950 2023-10-16T13:11:34.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.009+0000 7f76b26fe700 1 -- 172.21.15.92:0/3796415755 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ac1a1110 con 0x7f76ac101950 2023-10-16T13:11:34.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.010+0000 7f76b26fe700 1 -- 172.21.15.92:0/3796415755 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ac0fcea0 con 0x7f76ac101950 2023-10-16T13:11:34.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.012+0000 7f76a97fa700 1 -- 172.21.15.92:0/3796415755 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f769c022470 con 0x7f76ac101950 2023-10-16T13:11:34.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.012+0000 7f76a97fa700 1 --2- 172.21.15.92:0/3796415755 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f76940a1520 0x7f76940a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:34.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.012+0000 7f76ab7fe700 1 --2- 172.21.15.92:0/3796415755 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f76940a1520 0x7f76940a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:34.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.012+0000 7f76a97fa700 1 -- 172.21.15.92:0/3796415755 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f769c0ce350 con 0x7f76ac101950 2023-10-16T13:11:34.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.013+0000 7f76ab7fe700 1 --2- 172.21.15.92:0/3796415755 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f76940a1520 0x7f76940a39e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f76a0009df0 tx=0x7f76a0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:34.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.016+0000 7f76a97fa700 1 -- 172.21.15.92:0/3796415755 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f769c097ee0 con 0x7f76ac101950 2023-10-16T13:11:34.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.266+0000 7f76b26fe700 1 -- 172.21.15.92:0/3796415755 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76ac02d2b0 con 0x7f76ac101950 2023-10-16T13:11:34.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.267+0000 7f76a97fa700 1 -- 172.21.15.92:0/3796415755 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9260 (secure 0 0 0) 0x7f769c09b500 con 0x7f76ac101950 2023-10-16T13:11:34.269 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:34.269 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/1790514945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1790514945},{"type":"v1","addr":"172.21.15.92:6839","nonce":1790514945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1016260236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1016260236},{"type":"v1","addr":"172.21.15.92:6841","nonce":1016260236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/2133613540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":2133613540},{"type":"v1","addr":"172.21.15.118:6837","nonce":2133613540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/2403096460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":2403096460},{"type":"v1","addr":"172.21.15.152:6837","nonce":2403096460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/1821921588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1821921588},{"type":"v1","addr":"172.21.15.152:6839","nonce":1821921588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-16T13:11:34.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.269+0000 7f76b26fe700 1 -- 172.21.15.92:0/3796415755 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f76940a1520 msgr2=0x7f76940a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:34.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.269+0000 7f76b26fe700 1 --2- 172.21.15.92:0/3796415755 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f76940a1520 0x7f76940a39e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f76a0009df0 tx=0x7f76a0009260 comp rx=0 tx=0).stop 2023-10-16T13:11:34.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.269+0000 7f76b26fe700 1 -- 172.21.15.92:0/3796415755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76ac101950 msgr2=0x7f76ac1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:34.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.269+0000 7f76b26fe700 1 --2- 172.21.15.92:0/3796415755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76ac101950 0x7f76ac1012c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f769c0059d0 tx=0x7f769c00f690 comp rx=0 tx=0).stop 2023-10-16T13:11:34.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.270+0000 7f76b26fe700 1 -- 172.21.15.92:0/3796415755 shutdown_connections 2023-10-16T13:11:34.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.270+0000 7f76b26fe700 1 --2- 172.21.15.92:0/3796415755 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f76940a1520 0x7f76940a39e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:34.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.270+0000 7f76b26fe700 1 --2- 172.21.15.92:0/3796415755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76ac101950 0x7f76ac1012c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:34.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.270+0000 7f76b26fe700 1 --2- 172.21.15.92:0/3796415755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76ac106bb0 0x7f76ac0ffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:34.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.270+0000 7f76b26fe700 1 --2- 172.21.15.92:0/3796415755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76ac104280 0x7f76ac0ff900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:34.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.270+0000 7f76b26fe700 1 -- 172.21.15.92:0/3796415755 >> 172.21.15.92:0/3796415755 conn(0x7f76ac0fb320 msgr2=0x7f76ac1025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:34.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.270+0000 7f76b26fe700 1 -- 172.21.15.92:0/3796415755 shutdown_connections 2023-10-16T13:11:34.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:34.270+0000 7f76b26fe700 1 -- 172.21.15.92:0/3796415755 wait complete. 2023-10-16T13:11:34.274 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 12 2023-10-16T13:11:34.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:34 smithi152 ceph-mon[104423]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:34.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:34 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:34.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:34 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:34.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:34 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:34.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:34 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:34.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:34 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:34.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:34 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:11:34.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:34 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3796415755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:34.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:34 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] up:boot 2023-10-16T13:11:34.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:34 smithi152 ceph-mon[104423]: fsmap 12 up:standby 2023-10-16T13:11:34.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:34 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-16T13:11:34.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:34 smithi092 ceph-mon[99542]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:34.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:34 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:34.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:34 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:34.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:34 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:34.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:34 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:34.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:34 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:34.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:34 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:11:34.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:34 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3796415755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:34 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] up:boot 2023-10-16T13:11:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:34 smithi092 ceph-mon[99542]: fsmap 12 up:standby 2023-10-16T13:11:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:34 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-16T13:11:35.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:34 smithi118 ceph-mon[103969]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:35.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:34 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:35.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:34 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:35.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:34 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:35.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:34 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:35.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:34 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:35.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:34 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:11:35.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:34 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3796415755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:35.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:34 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] up:boot 2023-10-16T13:11:35.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:34 smithi118 ceph-mon[103969]: fsmap 12 up:standby 2023-10-16T13:11:35.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:34 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-16T13:11:36.284 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:11:36.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.417+0000 7f18e63fc700 1 -- 172.21.15.92:0/1229872971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e00ff1a0 msgr2=0x7f18e00ff5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:36.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.417+0000 7f18e63fc700 1 --2- 172.21.15.92:0/1229872971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e00ff1a0 0x7f18e00ff5c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009990 tx=0x7f18d0009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:36.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.417+0000 7f18e63fc700 1 -- 172.21.15.92:0/1229872971 shutdown_connections 2023-10-16T13:11:36.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.417+0000 7f18e63fc700 1 --2- 172.21.15.92:0/1229872971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e00ff1a0 0x7f18e00ff5c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:36.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.417+0000 7f18e63fc700 1 --2- 172.21.15.92:0/1229872971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18e0102b10 0x7f18e01093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:36.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.417+0000 7f18e63fc700 1 --2- 172.21.15.92:0/1229872971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18e0102170 0x7f18e01025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:36.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.417+0000 7f18e63fc700 1 -- 172.21.15.92:0/1229872971 >> 172.21.15.92:0/1229872971 conn(0x7f18e00faab0 msgr2=0x7f18e00fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:36.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.417+0000 7f18e63fc700 1 -- 172.21.15.92:0/1229872971 shutdown_connections 2023-10-16T13:11:36.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.417+0000 7f18e63fc700 1 -- 172.21.15.92:0/1229872971 wait complete. 2023-10-16T13:11:36.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.418+0000 7f18e63fc700 1 Processor -- start 2023-10-16T13:11:36.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.418+0000 7f18e63fc700 1 -- start start 2023-10-16T13:11:36.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.418+0000 7f18e63fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18e00ff1a0 0x7f18e0196bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:36.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.418+0000 7f18e63fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e0102170 0x7f18e0197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:36.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.418+0000 7f18e63fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18e0102b10 0x7f18e019e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:36.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.418+0000 7f18e63fc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e019e750 con 0x7f18e0102170 2023-10-16T13:11:36.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.418+0000 7f18e63fc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e019e890 con 0x7f18e0102b10 2023-10-16T13:11:36.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.418+0000 7f18e63fc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e019ea20 con 0x7f18e00ff1a0 2023-10-16T13:11:36.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.419+0000 7f18df7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e0102170 0x7f18e0197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:36.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.419+0000 7f18df7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e0102170 0x7f18e0197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35116/0 (socket says 172.21.15.92:35116) 2023-10-16T13:11:36.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.419+0000 7f18df7fe700 1 -- 172.21.15.92:0/2624612647 learned_addr learned my addr 172.21.15.92:0/2624612647 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:36.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.419+0000 7f18e4999700 1 --2- 172.21.15.92:0/2624612647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18e0102b10 0x7f18e019e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:36.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.419+0000 7f18dffff700 1 --2- 172.21.15.92:0/2624612647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18e00ff1a0 0x7f18e0196bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:36.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.419+0000 7f18df7fe700 1 -- 172.21.15.92:0/2624612647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18e00ff1a0 msgr2=0x7f18e0196bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:36.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.419+0000 7f18df7fe700 1 --2- 172.21.15.92:0/2624612647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18e00ff1a0 0x7f18e0196bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:36.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.419+0000 7f18df7fe700 1 -- 172.21.15.92:0/2624612647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18e0102b10 msgr2=0x7f18e019e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:36.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.419+0000 7f18df7fe700 1 --2- 172.21.15.92:0/2624612647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18e0102b10 0x7f18e019e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:36.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.419+0000 7f18df7fe700 1 -- 172.21.15.92:0/2624612647 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d00095f0 con 0x7f18e0102170 2023-10-16T13:11:36.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.419+0000 7f18df7fe700 1 --2- 172.21.15.92:0/2624612647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e0102170 0x7f18e0197110 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f18c800d950 tx=0x7f18c800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:36.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.419+0000 7f18dd7fa700 1 -- 172.21.15.92:0/2624612647 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c800f890 con 0x7f18e0102170 2023-10-16T13:11:36.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.419+0000 7f18dd7fa700 1 -- 172.21.15.92:0/2624612647 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f18c8010460 con 0x7f18e0102170 2023-10-16T13:11:36.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.419+0000 7f18e63fc700 1 -- 172.21.15.92:0/2624612647 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e019ed00 con 0x7f18e0102170 2023-10-16T13:11:36.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.419+0000 7f18dd7fa700 1 -- 172.21.15.92:0/2624612647 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c800e610 con 0x7f18e0102170 2023-10-16T13:11:36.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.419+0000 7f18e63fc700 1 -- 172.21.15.92:0/2624612647 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e019f1c0 con 0x7f18e0102170 2023-10-16T13:11:36.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.420+0000 7f18e63fc700 1 -- 172.21.15.92:0/2624612647 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e0107dc0 con 0x7f18e0102170 2023-10-16T13:11:36.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.421+0000 7f18dd7fa700 1 -- 172.21.15.92:0/2624612647 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f18c8010960 con 0x7f18e0102170 2023-10-16T13:11:36.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.422+0000 7f18dd7fa700 1 --2- 172.21.15.92:0/2624612647 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f18cc0a15a0 0x7f18cc0a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:36.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.422+0000 7f18dffff700 1 --2- 172.21.15.92:0/2624612647 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f18cc0a15a0 0x7f18cc0a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:36.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.422+0000 7f18dd7fa700 1 -- 172.21.15.92:0/2624612647 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f18c80cc670 con 0x7f18e0102170 2023-10-16T13:11:36.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.422+0000 7f18dffff700 1 --2- 172.21.15.92:0/2624612647 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f18cc0a15a0 0x7f18cc0a3a60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f18d0000c00 tx=0x7f18d0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:36.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.426+0000 7f18dd7fa700 1 -- 172.21.15.92:0/2624612647 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f18c80960d0 con 0x7f18e0102170 2023-10-16T13:11:36.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:36 smithi118 ceph-mon[103969]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:36.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:36.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.683+0000 7f18e63fc700 1 -- 172.21.15.92:0/2624612647 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18e002d1e0 con 0x7f18e0102170 2023-10-16T13:11:36.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.684+0000 7f18dd7fa700 1 -- 172.21.15.92:0/2624612647 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10055 (secure 0 0 0) 0x7f18c80996f0 con 0x7f18e0102170 2023-10-16T13:11:36.686 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:36.686 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/1790514945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1790514945},{"type":"v1","addr":"172.21.15.92:6839","nonce":1790514945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1016260236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1016260236},{"type":"v1","addr":"172.21.15.92:6841","nonce":1016260236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/2133613540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":2133613540},{"type":"v1","addr":"172.21.15.118:6837","nonce":2133613540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/2403096460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":2403096460},{"type":"v1","addr":"172.21.15.152:6837","nonce":2403096460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/1821921588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1821921588},{"type":"v1","addr":"172.21.15.152:6839","nonce":1821921588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24491,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6839/1577355936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":1577355936},{"type":"v1","addr":"172.21.15.118:6839","nonce":1577355936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2023-10-16T13:11:36.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.686+0000 7f18e63fc700 1 -- 172.21.15.92:0/2624612647 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f18cc0a15a0 msgr2=0x7f18cc0a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:36.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.686+0000 7f18e63fc700 1 --2- 172.21.15.92:0/2624612647 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f18cc0a15a0 0x7f18cc0a3a60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f18d0000c00 tx=0x7f18d0005fb0 comp rx=0 tx=0).stop 2023-10-16T13:11:36.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.686+0000 7f18e63fc700 1 -- 172.21.15.92:0/2624612647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e0102170 msgr2=0x7f18e0197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:36.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.686+0000 7f18e63fc700 1 --2- 172.21.15.92:0/2624612647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e0102170 0x7f18e0197110 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f18c800d950 tx=0x7f18c800dc60 comp rx=0 tx=0).stop 2023-10-16T13:11:36.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.686+0000 7f18e63fc700 1 -- 172.21.15.92:0/2624612647 shutdown_connections 2023-10-16T13:11:36.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.686+0000 7f18e63fc700 1 --2- 172.21.15.92:0/2624612647 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f18cc0a15a0 0x7f18cc0a3a60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:36.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.686+0000 7f18e63fc700 1 --2- 172.21.15.92:0/2624612647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18e0102b10 0x7f18e019e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:36.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.686+0000 7f18e63fc700 1 --2- 172.21.15.92:0/2624612647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18e00ff1a0 0x7f18e0196bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:36.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.686+0000 7f18e63fc700 1 --2- 172.21.15.92:0/2624612647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e0102170 0x7f18e0197110 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:36.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.686+0000 7f18e63fc700 1 -- 172.21.15.92:0/2624612647 >> 172.21.15.92:0/2624612647 conn(0x7f18e00faab0 msgr2=0x7f18e00fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:36.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.686+0000 7f18e63fc700 1 -- 172.21.15.92:0/2624612647 shutdown_connections 2023-10-16T13:11:36.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.686+0000 7f18e63fc700 1 -- 172.21.15.92:0/2624612647 wait complete. 2023-10-16T13:11:36.691 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 13 2023-10-16T13:11:36.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:36 smithi152 ceph-mon[104423]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:36.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:36.699 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:36 smithi092 ceph-mon[99542]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:36.699 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:36.701 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:11:36.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.820+0000 7f3c78975700 1 -- 172.21.15.92:0/1890296632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c74100f10 msgr2=0x7f3c74101330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:36.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.820+0000 7f3c78975700 1 --2- 172.21.15.92:0/1890296632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c74100f10 0x7f3c74101330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400b0a0 tx=0x7f3c6400b3b0 comp rx=0 tx=0).stop 2023-10-16T13:11:36.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.820+0000 7f3c78975700 1 -- 172.21.15.92:0/1890296632 shutdown_connections 2023-10-16T13:11:36.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.820+0000 7f3c78975700 1 --2- 172.21.15.92:0/1890296632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c74100f10 0x7f3c74101330 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:36.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.820+0000 7f3c78975700 1 --2- 172.21.15.92:0/1890296632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c74102a20 0x7f3c74109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:36.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.820+0000 7f3c78975700 1 --2- 172.21.15.92:0/1890296632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c74102060 0x7f3c741024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:36.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.820+0000 7f3c78975700 1 -- 172.21.15.92:0/1890296632 >> 172.21.15.92:0/1890296632 conn(0x7f3c740fc460 msgr2=0x7f3c740fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:36.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.820+0000 7f3c78975700 1 -- 172.21.15.92:0/1890296632 shutdown_connections 2023-10-16T13:11:36.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.820+0000 7f3c78975700 1 -- 172.21.15.92:0/1890296632 wait complete. 2023-10-16T13:11:36.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.821+0000 7f3c78975700 1 Processor -- start 2023-10-16T13:11:36.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.821+0000 7f3c78975700 1 -- start start 2023-10-16T13:11:36.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.821+0000 7f3c78975700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c74100f10 0x7f3c74196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:36.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c78975700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c74102060 0x7f3c74197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:36.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c78975700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c74102a20 0x7f3c7419e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:36.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c78975700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7419e8d0 con 0x7f3c74100f10 2023-10-16T13:11:36.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c78975700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7419ea10 con 0x7f3c74102060 2023-10-16T13:11:36.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c78975700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7419eba0 con 0x7f3c74102a20 2023-10-16T13:11:36.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c7259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c74100f10 0x7f3c74196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:36.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c7259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c74100f10 0x7f3c74196d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35128/0 (socket says 172.21.15.92:35128) 2023-10-16T13:11:36.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c7259c700 1 -- 172.21.15.92:0/858414061 learned_addr learned my addr 172.21.15.92:0/858414061 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:36.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c72d9d700 1 --2- 172.21.15.92:0/858414061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c74102a20 0x7f3c7419e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:36.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c71d9b700 1 --2- 172.21.15.92:0/858414061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c74102060 0x7f3c74197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:36.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c7259c700 1 -- 172.21.15.92:0/858414061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c74102a20 msgr2=0x7f3c7419e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:36.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c7259c700 1 --2- 172.21.15.92:0/858414061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c74102a20 0x7f3c7419e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:36.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c7259c700 1 -- 172.21.15.92:0/858414061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c74102060 msgr2=0x7f3c74197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:36.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c7259c700 1 --2- 172.21.15.92:0/858414061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c74102060 0x7f3c74197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:36.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c7259c700 1 -- 172.21.15.92:0/858414061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c64009d00 con 0x7f3c74100f10 2023-10-16T13:11:36.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c7259c700 1 --2- 172.21.15.92:0/858414061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c74100f10 0x7f3c74196d50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3c64006070 tx=0x7f3c64004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:36.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c6b7fe700 1 -- 172.21.15.92:0/858414061 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6400e040 con 0x7f3c74100f10 2023-10-16T13:11:36.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c78975700 1 -- 172.21.15.92:0/858414061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c7419ee20 con 0x7f3c74100f10 2023-10-16T13:11:36.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c6b7fe700 1 -- 172.21.15.92:0/858414061 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3c6400cec0 con 0x7f3c74100f10 2023-10-16T13:11:36.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c6b7fe700 1 -- 172.21.15.92:0/858414061 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6401db90 con 0x7f3c74100f10 2023-10-16T13:11:36.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.822+0000 7f3c78975700 1 -- 172.21.15.92:0/858414061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c7419f190 con 0x7f3c74100f10 2023-10-16T13:11:36.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.823+0000 7f3c78975700 1 -- 172.21.15.92:0/858414061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c74107d10 con 0x7f3c74100f10 2023-10-16T13:11:36.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.824+0000 7f3c6b7fe700 1 -- 172.21.15.92:0/858414061 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3c64005250 con 0x7f3c74100f10 2023-10-16T13:11:36.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.825+0000 7f3c6b7fe700 1 --2- 172.21.15.92:0/858414061 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3c600a15a0 0x7f3c600a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:36.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.825+0000 7f3c71d9b700 1 --2- 172.21.15.92:0/858414061 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3c600a15a0 0x7f3c600a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:36.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.825+0000 7f3c6b7fe700 1 -- 172.21.15.92:0/858414061 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3c640ce190 con 0x7f3c74100f10 2023-10-16T13:11:36.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.825+0000 7f3c71d9b700 1 --2- 172.21.15.92:0/858414061 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3c600a15a0 0x7f3c600a3a60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c007c60 tx=0x7f3c5c0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:36.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:36.829+0000 7f3c6b7fe700 1 -- 172.21.15.92:0/858414061 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3c64097c80 con 0x7f3c74100f10 2023-10-16T13:11:37.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.033+0000 7f3c78975700 1 -- 172.21.15.92:0/858414061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c7410c8d0 con 0x7f3c74100f10 2023-10-16T13:11:37.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.034+0000 7f3c6b7fe700 1 -- 172.21.15.92:0/858414061 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18422 (secure 0 0 0) 0x7f3c6409b2a0 con 0x7f3c74100f10 2023-10-16T13:11:37.036 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:37.036 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":79,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:10:57.822846+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:11:37.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.036+0000 7f3c78975700 1 -- 172.21.15.92:0/858414061 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3c600a15a0 msgr2=0x7f3c600a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:37.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.036+0000 7f3c78975700 1 --2- 172.21.15.92:0/858414061 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3c600a15a0 0x7f3c600a3a60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c007c60 tx=0x7f3c5c0073d0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.036+0000 7f3c78975700 1 -- 172.21.15.92:0/858414061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c74100f10 msgr2=0x7f3c74196d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:37.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.036+0000 7f3c78975700 1 --2- 172.21.15.92:0/858414061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c74100f10 0x7f3c74196d50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3c64006070 tx=0x7f3c64004d00 comp rx=0 tx=0).stop 2023-10-16T13:11:37.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.036+0000 7f3c78975700 1 -- 172.21.15.92:0/858414061 shutdown_connections 2023-10-16T13:11:37.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.036+0000 7f3c78975700 1 --2- 172.21.15.92:0/858414061 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3c600a15a0 0x7f3c600a3a60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.036+0000 7f3c78975700 1 --2- 172.21.15.92:0/858414061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c74100f10 0x7f3c74196d50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.036+0000 7f3c78975700 1 --2- 172.21.15.92:0/858414061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c74102a20 0x7f3c7419e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.036+0000 7f3c78975700 1 --2- 172.21.15.92:0/858414061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c74102060 0x7f3c74197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.036+0000 7f3c78975700 1 -- 172.21.15.92:0/858414061 >> 172.21.15.92:0/858414061 conn(0x7f3c740fc460 msgr2=0x7f3c740fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:37.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.036+0000 7f3c78975700 1 -- 172.21.15.92:0/858414061 shutdown_connections 2023-10-16T13:11:37.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.036+0000 7f3c78975700 1 -- 172.21.15.92:0/858414061 wait complete. 2023-10-16T13:11:37.051 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:07:45.516334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:11:37.051 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:11:37.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.178+0000 7f7227d88700 1 -- 172.21.15.92:0/2142329562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7220101940 msgr2=0x7f7220103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:37.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.178+0000 7f7227d88700 1 --2- 172.21.15.92:0/2142329562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7220101940 0x7f7220103d30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f721c009990 tx=0x7f721c009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.178+0000 7f7227d88700 1 -- 172.21.15.92:0/2142329562 shutdown_connections 2023-10-16T13:11:37.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.178+0000 7f7227d88700 1 --2- 172.21.15.92:0/2142329562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7220101940 0x7f7220103d30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.178+0000 7f7227d88700 1 --2- 172.21.15.92:0/2142329562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7220106ba0 0x7f7220109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.178+0000 7f7227d88700 1 --2- 172.21.15.92:0/2142329562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7220104270 0x7f7220106660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.178+0000 7f7227d88700 1 -- 172.21.15.92:0/2142329562 >> 172.21.15.92:0/2142329562 conn(0x7f72200fb2f0 msgr2=0x7f72200fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:37.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.178+0000 7f7227d88700 1 -- 172.21.15.92:0/2142329562 shutdown_connections 2023-10-16T13:11:37.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.178+0000 7f7227d88700 1 -- 172.21.15.92:0/2142329562 wait complete. 2023-10-16T13:11:37.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.179+0000 7f7227d88700 1 Processor -- start 2023-10-16T13:11:37.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.179+0000 7f7227d88700 1 -- start start 2023-10-16T13:11:37.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.179+0000 7f7227d88700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7220101940 0x7f7220196c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:37.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.179+0000 7f7227d88700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7220104270 0x7f72201971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:37.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.179+0000 7f7227d88700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7220106ba0 0x7f722019e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:37.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.179+0000 7f7227d88700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722019e7a0 con 0x7f7220101940 2023-10-16T13:11:37.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.179+0000 7f7227d88700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722019e910 con 0x7f7220104270 2023-10-16T13:11:37.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.179+0000 7f7227d88700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722019ead0 con 0x7f7220106ba0 2023-10-16T13:11:37.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.179+0000 7f7225b24700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7220101940 0x7f7220196c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:37.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.179+0000 7f7225b24700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7220101940 0x7f7220196c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35142/0 (socket says 172.21.15.92:35142) 2023-10-16T13:11:37.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.179+0000 7f7225b24700 1 -- 172.21.15.92:0/2930198290 learned_addr learned my addr 172.21.15.92:0/2930198290 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:37.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.179+0000 7f7225323700 1 --2- 172.21.15.92:0/2930198290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7220104270 0x7f72201971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:37.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.179+0000 7f7226325700 1 --2- 172.21.15.92:0/2930198290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7220106ba0 0x7f722019e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:37.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.179+0000 7f7225b24700 1 -- 172.21.15.92:0/2930198290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7220106ba0 msgr2=0x7f722019e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:37.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.179+0000 7f7225b24700 1 --2- 172.21.15.92:0/2930198290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7220106ba0 0x7f722019e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.179+0000 7f7225b24700 1 -- 172.21.15.92:0/2930198290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7220104270 msgr2=0x7f72201971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:37.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.179+0000 7f7225b24700 1 --2- 172.21.15.92:0/2930198290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7220104270 0x7f72201971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.179+0000 7f7225b24700 1 -- 172.21.15.92:0/2930198290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c0095f0 con 0x7f7220101940 2023-10-16T13:11:37.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.180+0000 7f7225b24700 1 --2- 172.21.15.92:0/2930198290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7220101940 0x7f7220196c60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f721c0036f0 tx=0x7f721c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:37.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.180+0000 7f7216ffd700 1 -- 172.21.15.92:0/2930198290 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c01d070 con 0x7f7220101940 2023-10-16T13:11:37.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.180+0000 7f7216ffd700 1 -- 172.21.15.92:0/2930198290 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f721c005030 con 0x7f7220101940 2023-10-16T13:11:37.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.180+0000 7f7227d88700 1 -- 172.21.15.92:0/2930198290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72200ff730 con 0x7f7220101940 2023-10-16T13:11:37.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.180+0000 7f7216ffd700 1 -- 172.21.15.92:0/2930198290 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c004ba0 con 0x7f7220101940 2023-10-16T13:11:37.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.180+0000 7f7227d88700 1 -- 172.21.15.92:0/2930198290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72200ffbb0 con 0x7f7220101940 2023-10-16T13:11:37.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.181+0000 7f7227d88700 1 -- 172.21.15.92:0/2930198290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72200fce70 con 0x7f7220101940 2023-10-16T13:11:37.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.182+0000 7f7216ffd700 1 -- 172.21.15.92:0/2930198290 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f721c004d00 con 0x7f7220101940 2023-10-16T13:11:37.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.182+0000 7f7216ffd700 1 --2- 172.21.15.92:0/2930198290 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f720c0a1480 0x7f720c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:37.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.183+0000 7f7225323700 1 --2- 172.21.15.92:0/2930198290 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f720c0a1480 0x7f720c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:37.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.183+0000 7f7216ffd700 1 -- 172.21.15.92:0/2930198290 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f721c0cdc00 con 0x7f7220101940 2023-10-16T13:11:37.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.183+0000 7f7225323700 1 --2- 172.21.15.92:0/2930198290 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f720c0a1480 0x7f720c0a3940 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7210007c60 tx=0x7f72100073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:37.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.186+0000 7f7216ffd700 1 -- 172.21.15.92:0/2930198290 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f721c097790 con 0x7f7220101940 2023-10-16T13:11:37.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.383+0000 7f7227d88700 1 -- 172.21.15.92:0/2930198290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f722010c990 con 0x7f7220101940 2023-10-16T13:11:37.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.383+0000 7f7216ffd700 1 -- 172.21.15.92:0/2930198290 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f721c09adb0 con 0x7f7220101940 2023-10-16T13:11:37.385 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-10-16T13:11:37.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.385+0000 7f7227d88700 1 -- 172.21.15.92:0/2930198290 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f720c0a1480 msgr2=0x7f720c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:37.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.385+0000 7f7227d88700 1 --2- 172.21.15.92:0/2930198290 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f720c0a1480 0x7f720c0a3940 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7210007c60 tx=0x7f72100073d0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.385+0000 7f7227d88700 1 -- 172.21.15.92:0/2930198290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7220101940 msgr2=0x7f7220196c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:37.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.385+0000 7f7227d88700 1 --2- 172.21.15.92:0/2930198290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7220101940 0x7f7220196c60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f721c0036f0 tx=0x7f721c00f690 comp rx=0 tx=0).stop 2023-10-16T13:11:37.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.386+0000 7f7227d88700 1 -- 172.21.15.92:0/2930198290 shutdown_connections 2023-10-16T13:11:37.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.386+0000 7f7227d88700 1 --2- 172.21.15.92:0/2930198290 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f720c0a1480 0x7f720c0a3940 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.386+0000 7f7227d88700 1 --2- 172.21.15.92:0/2930198290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7220101940 0x7f7220196c60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.386+0000 7f7227d88700 1 --2- 172.21.15.92:0/2930198290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7220106ba0 0x7f722019e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.386+0000 7f7227d88700 1 --2- 172.21.15.92:0/2930198290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7220104270 0x7f72201971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.386+0000 7f7227d88700 1 -- 172.21.15.92:0/2930198290 >> 172.21.15.92:0/2930198290 conn(0x7f72200fb2f0 msgr2=0x7f72201025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:37.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.386+0000 7f7227d88700 1 -- 172.21.15.92:0/2930198290 shutdown_connections 2023-10-16T13:11:37.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.386+0000 7f7227d88700 1 -- 172.21.15.92:0/2930198290 wait complete. 2023-10-16T13:11:37.401 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T13:11:37.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.523+0000 7fe92bbe2700 1 -- 172.21.15.92:0/3984868566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9240ff1a0 msgr2=0x7fe9240ff5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:37.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.523+0000 7fe92bbe2700 1 --2- 172.21.15.92:0/3984868566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9240ff1a0 0x7fe9240ff5c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe920009990 tx=0x7fe920009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.523+0000 7fe92bbe2700 1 -- 172.21.15.92:0/3984868566 shutdown_connections 2023-10-16T13:11:37.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.523+0000 7fe92bbe2700 1 --2- 172.21.15.92:0/3984868566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9240ff1a0 0x7fe9240ff5c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.523+0000 7fe92bbe2700 1 --2- 172.21.15.92:0/3984868566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe924102b10 0x7fe9241093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.523+0000 7fe92bbe2700 1 --2- 172.21.15.92:0/3984868566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe924102170 0x7fe9241025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.523+0000 7fe92bbe2700 1 -- 172.21.15.92:0/3984868566 >> 172.21.15.92:0/3984868566 conn(0x7fe9240faab0 msgr2=0x7fe9240fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:37.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.523+0000 7fe92bbe2700 1 -- 172.21.15.92:0/3984868566 shutdown_connections 2023-10-16T13:11:37.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.523+0000 7fe92bbe2700 1 -- 172.21.15.92:0/3984868566 wait complete. 2023-10-16T13:11:37.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.523+0000 7fe92bbe2700 1 Processor -- start 2023-10-16T13:11:37.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.523+0000 7fe92bbe2700 1 -- start start 2023-10-16T13:11:37.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.523+0000 7fe92bbe2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9240ff1a0 0x7fe924196bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:37.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.523+0000 7fe92bbe2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe924102170 0x7fe924197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:37.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.523+0000 7fe92bbe2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe924102b10 0x7fe92419e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:37.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.523+0000 7fe92bbe2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92419e750 con 0x7fe9240ff1a0 2023-10-16T13:11:37.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.523+0000 7fe92bbe2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92419e890 con 0x7fe924102170 2023-10-16T13:11:37.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.523+0000 7fe92bbe2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92419ea20 con 0x7fe924102b10 2023-10-16T13:11:37.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.524+0000 7fe92997e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9240ff1a0 0x7fe924196bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:37.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.524+0000 7fe92997e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9240ff1a0 0x7fe924196bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35156/0 (socket says 172.21.15.92:35156) 2023-10-16T13:11:37.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.524+0000 7fe92997e700 1 -- 172.21.15.92:0/871086980 learned_addr learned my addr 172.21.15.92:0/871086980 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:37.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.524+0000 7fe92917d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe924102170 0x7fe924197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:37.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.524+0000 7fe92a17f700 1 --2- 172.21.15.92:0/871086980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe924102b10 0x7fe92419e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:37.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.524+0000 7fe92997e700 1 -- 172.21.15.92:0/871086980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe924102b10 msgr2=0x7fe92419e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:37.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.524+0000 7fe92997e700 1 --2- 172.21.15.92:0/871086980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe924102b10 0x7fe92419e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.524+0000 7fe92997e700 1 -- 172.21.15.92:0/871086980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe924102170 msgr2=0x7fe924197110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:37.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.524+0000 7fe92997e700 1 --2- 172.21.15.92:0/871086980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe924102170 0x7fe924197110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.524+0000 7fe92997e700 1 -- 172.21.15.92:0/871086980 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9200095f0 con 0x7fe9240ff1a0 2023-10-16T13:11:37.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.524+0000 7fe92997e700 1 --2- 172.21.15.92:0/871086980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9240ff1a0 0x7fe924196bd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe9200095c0 tx=0x7fe920004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:37.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.524+0000 7fe91affd700 1 -- 172.21.15.92:0/871086980 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92001d070 con 0x7fe9240ff1a0 2023-10-16T13:11:37.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.524+0000 7fe91affd700 1 -- 172.21.15.92:0/871086980 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe92000fb40 con 0x7fe9240ff1a0 2023-10-16T13:11:37.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.524+0000 7fe92bbe2700 1 -- 172.21.15.92:0/871086980 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92419eca0 con 0x7fe9240ff1a0 2023-10-16T13:11:37.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.524+0000 7fe91affd700 1 -- 172.21.15.92:0/871086980 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9200173f0 con 0x7fe9240ff1a0 2023-10-16T13:11:37.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.524+0000 7fe92bbe2700 1 -- 172.21.15.92:0/871086980 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92419f0c0 con 0x7fe9240ff1a0 2023-10-16T13:11:37.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.526+0000 7fe92bbe2700 1 -- 172.21.15.92:0/871086980 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe924107dc0 con 0x7fe9240ff1a0 2023-10-16T13:11:37.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.526+0000 7fe91affd700 1 -- 172.21.15.92:0/871086980 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe92000fcb0 con 0x7fe9240ff1a0 2023-10-16T13:11:37.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.527+0000 7fe91affd700 1 --2- 172.21.15.92:0/871086980 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe9100a1520 0x7fe9100a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:37.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.527+0000 7fe92917d700 1 --2- 172.21.15.92:0/871086980 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe9100a1520 0x7fe9100a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:37.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.527+0000 7fe91affd700 1 -- 172.21.15.92:0/871086980 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe9200cdbd0 con 0x7fe9240ff1a0 2023-10-16T13:11:37.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.527+0000 7fe92917d700 1 --2- 172.21.15.92:0/871086980 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe9100a1520 0x7fe9100a39e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe914009c60 tx=0x7fe914009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:37.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.532+0000 7fe91affd700 1 -- 172.21.15.92:0/871086980 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe920097760 con 0x7fe9240ff1a0 2023-10-16T13:11:37.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:37 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:37 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:37 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:37 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:37 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:37 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:37 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2624612647' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:37.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:37 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:37.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:37 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:11:37.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:37 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:37 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/858414061' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:37.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:37 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:11:37.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:37 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2930198290' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:11:37.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.733+0000 7fe92bbe2700 1 -- 172.21.15.92:0/871086980 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe92402d2d0 con 0x7fe9240ff1a0 2023-10-16T13:11:37.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.734+0000 7fe91affd700 1 -- 172.21.15.92:0/871086980 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe92009ad80 con 0x7fe9240ff1a0 2023-10-16T13:11:37.736 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:37.736 INFO:teuthology.orchestra.run.smithi092.stdout:[ 2023-10-16T13:11:37.736 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:11:37.737 INFO:teuthology.orchestra.run.smithi092.stdout: "poolnum": 1, 2023-10-16T13:11:37.737 INFO:teuthology.orchestra.run.smithi092.stdout: "poolname": ".mgr" 2023-10-16T13:11:37.737 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:11:37.737 INFO:teuthology.orchestra.run.smithi092.stdout:] 2023-10-16T13:11:37.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.736+0000 7fe92bbe2700 1 -- 172.21.15.92:0/871086980 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe9100a1520 msgr2=0x7fe9100a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:37.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.736+0000 7fe92bbe2700 1 --2- 172.21.15.92:0/871086980 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe9100a1520 0x7fe9100a39e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe914009c60 tx=0x7fe914009260 comp rx=0 tx=0).stop 2023-10-16T13:11:37.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.736+0000 7fe92bbe2700 1 -- 172.21.15.92:0/871086980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9240ff1a0 msgr2=0x7fe924196bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:37.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.736+0000 7fe92bbe2700 1 --2- 172.21.15.92:0/871086980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9240ff1a0 0x7fe924196bd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe9200095c0 tx=0x7fe920004730 comp rx=0 tx=0).stop 2023-10-16T13:11:37.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.736+0000 7fe92bbe2700 1 -- 172.21.15.92:0/871086980 shutdown_connections 2023-10-16T13:11:37.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.736+0000 7fe92bbe2700 1 --2- 172.21.15.92:0/871086980 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe9100a1520 0x7fe9100a39e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.736+0000 7fe92bbe2700 1 --2- 172.21.15.92:0/871086980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9240ff1a0 0x7fe924196bd0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.736+0000 7fe92bbe2700 1 --2- 172.21.15.92:0/871086980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe924102b10 0x7fe92419e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.736+0000 7fe92bbe2700 1 --2- 172.21.15.92:0/871086980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe924102170 0x7fe924197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.736+0000 7fe92bbe2700 1 -- 172.21.15.92:0/871086980 >> 172.21.15.92:0/871086980 conn(0x7fe9240faab0 msgr2=0x7fe9240fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:37.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.736+0000 7fe92bbe2700 1 -- 172.21.15.92:0/871086980 shutdown_connections 2023-10-16T13:11:37.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.736+0000 7fe92bbe2700 1 -- 172.21.15.92:0/871086980 wait complete. 2023-10-16T13:11:37.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:37 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:37 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:37 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:37 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:37 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:37 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:37 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2624612647' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:37.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:37 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:37.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:37 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:11:37.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:37 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:37 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/858414061' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:37.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:37 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:11:37.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:37 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2930198290' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:11:37.750 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T13:11:37.751 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T13:11:37.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:37 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:37 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:37 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:37 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:37 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:37 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:37 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2624612647' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:37.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:37 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:37.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:37 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:11:37.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:37 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:37.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:37 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/858414061' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:37.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:37 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:11:37.788 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:37 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2930198290' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:11:37.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.879+0000 7f1631bc1700 1 -- 172.21.15.92:0/885772033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f162c101940 msgr2=0x7f162c1081f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:37.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.879+0000 7f1631bc1700 1 --2- 172.21.15.92:0/885772033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f162c101940 0x7f162c1081f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f162400b0d0 tx=0x7f162400b3e0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.879+0000 7f1631bc1700 1 -- 172.21.15.92:0/885772033 shutdown_connections 2023-10-16T13:11:37.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.879+0000 7f1631bc1700 1 --2- 172.21.15.92:0/885772033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f162c101940 0x7f162c1081f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.879+0000 7f1631bc1700 1 --2- 172.21.15.92:0/885772033 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f162c0ffdb0 0x7f162c1001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.879+0000 7f1631bc1700 1 --2- 172.21.15.92:0/885772033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f162c100fa0 0x7f162c101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.879+0000 7f1631bc1700 1 -- 172.21.15.92:0/885772033 >> 172.21.15.92:0/885772033 conn(0x7f162c0fb320 msgr2=0x7f162c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:37.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.879+0000 7f1631bc1700 1 -- 172.21.15.92:0/885772033 shutdown_connections 2023-10-16T13:11:37.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.879+0000 7f1631bc1700 1 -- 172.21.15.92:0/885772033 wait complete. 2023-10-16T13:11:37.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.880+0000 7f1631bc1700 1 Processor -- start 2023-10-16T13:11:37.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.880+0000 7f1631bc1700 1 -- start start 2023-10-16T13:11:37.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.880+0000 7f1631bc1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f162c0ffdb0 0x7f162c196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:37.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.880+0000 7f1631bc1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f162c100fa0 0x7f162c197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:37.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.880+0000 7f1631bc1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f162c101940 0x7f162c19e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:37.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.880+0000 7f1631bc1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c19e8d0 con 0x7f162c101940 2023-10-16T13:11:37.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.880+0000 7f1631bc1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c19ea10 con 0x7f162c0ffdb0 2023-10-16T13:11:37.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.880+0000 7f1631bc1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c19eba0 con 0x7f162c100fa0 2023-10-16T13:11:37.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.880+0000 7f162bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f162c101940 0x7f162c19e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:37.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.880+0000 7f162bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f162c101940 0x7f162c19e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35174/0 (socket says 172.21.15.92:35174) 2023-10-16T13:11:37.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.880+0000 7f162bfff700 1 -- 172.21.15.92:0/1354437882 learned_addr learned my addr 172.21.15.92:0/1354437882 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:37.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.880+0000 7f162b7fe700 1 --2- 172.21.15.92:0/1354437882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f162c0ffdb0 0x7f162c196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:37.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.880+0000 7f162affd700 1 --2- 172.21.15.92:0/1354437882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f162c100fa0 0x7f162c197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:37.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.880+0000 7f162bfff700 1 -- 172.21.15.92:0/1354437882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f162c100fa0 msgr2=0x7f162c197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:37.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.880+0000 7f162bfff700 1 --2- 172.21.15.92:0/1354437882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f162c100fa0 0x7f162c197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.880+0000 7f162bfff700 1 -- 172.21.15.92:0/1354437882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f162c0ffdb0 msgr2=0x7f162c196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:37.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.880+0000 7f162bfff700 1 --2- 172.21.15.92:0/1354437882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f162c0ffdb0 0x7f162c196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:37.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.880+0000 7f162bfff700 1 -- 172.21.15.92:0/1354437882 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1624009d00 con 0x7f162c101940 2023-10-16T13:11:37.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.880+0000 7f162bfff700 1 --2- 172.21.15.92:0/1354437882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f162c101940 0x7f162c19e300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f162400d010 tx=0x7f162400bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:37.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.881+0000 7f1628ff9700 1 -- 172.21.15.92:0/1354437882 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162400e040 con 0x7f162c101940 2023-10-16T13:11:37.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.881+0000 7f1631bc1700 1 -- 172.21.15.92:0/1354437882 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162c19ee20 con 0x7f162c101940 2023-10-16T13:11:37.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.881+0000 7f1628ff9700 1 -- 172.21.15.92:0/1354437882 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1624012de0 con 0x7f162c101940 2023-10-16T13:11:37.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.881+0000 7f1628ff9700 1 -- 172.21.15.92:0/1354437882 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162401b450 con 0x7f162c101940 2023-10-16T13:11:37.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.881+0000 7f1631bc1700 1 -- 172.21.15.92:0/1354437882 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162c19f250 con 0x7f162c101940 2023-10-16T13:11:37.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.882+0000 7f1631bc1700 1 -- 172.21.15.92:0/1354437882 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162c10b710 con 0x7f162c101940 2023-10-16T13:11:37.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.882+0000 7f1628ff9700 1 -- 172.21.15.92:0/1354437882 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f162401d480 con 0x7f162c101940 2023-10-16T13:11:37.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.883+0000 7f1628ff9700 1 --2- 172.21.15.92:0/1354437882 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f16180a1500 0x7f16180a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:37.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.883+0000 7f162b7fe700 1 --2- 172.21.15.92:0/1354437882 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f16180a1500 0x7f16180a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:37.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.883+0000 7f1628ff9700 1 -- 172.21.15.92:0/1354437882 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f16240ce370 con 0x7f162c101940 2023-10-16T13:11:37.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.883+0000 7f162b7fe700 1 --2- 172.21.15.92:0/1354437882 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f16180a1500 0x7f16180a39c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f162c100e00 tx=0x7f161c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:37.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:37.887+0000 7f1628ff9700 1 -- 172.21.15.92:0/1354437882 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1624097e60 con 0x7f162c101940 2023-10-16T13:11:38.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:38.099+0000 7f1631bc1700 1 -- 172.21.15.92:0/1354437882 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f162c10b8d0 con 0x7f162c101940 2023-10-16T13:11:38.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:38 smithi152 ceph-mon[104423]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:38.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:38 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/871086980' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-16T13:11:38.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:38 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1354437882' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-16T13:11:38.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:38 smithi092 ceph-mon[99542]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:38.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:38 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/871086980' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-16T13:11:38.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:38 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1354437882' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-16T13:11:38.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:38 smithi118 ceph-mon[103969]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:38.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:38 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/871086980' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-16T13:11:38.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:38 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1354437882' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-16T13:11:38.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:38.938+0000 7f1628ff9700 1 -- 172.21.15.92:0/1354437882 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) v1 ==== 138+0+0 (secure 0 0 0) 0x7f162c10b8d0 con 0x7f162c101940 2023-10-16T13:11:38.942 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:38.940+0000 7f1631bc1700 1 -- 172.21.15.92:0/1354437882 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f16180a1500 msgr2=0x7f16180a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:38.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:38.940+0000 7f1631bc1700 1 --2- 172.21.15.92:0/1354437882 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f16180a1500 0x7f16180a39c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f162c100e00 tx=0x7f161c00b410 comp rx=0 tx=0).stop 2023-10-16T13:11:38.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:38.940+0000 7f1631bc1700 1 -- 172.21.15.92:0/1354437882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f162c101940 msgr2=0x7f162c19e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:38.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:38.940+0000 7f1631bc1700 1 --2- 172.21.15.92:0/1354437882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f162c101940 0x7f162c19e300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f162400d010 tx=0x7f162400bdc0 comp rx=0 tx=0).stop 2023-10-16T13:11:38.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:38.941+0000 7f1631bc1700 1 -- 172.21.15.92:0/1354437882 shutdown_connections 2023-10-16T13:11:38.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:38.941+0000 7f1631bc1700 1 --2- 172.21.15.92:0/1354437882 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f16180a1500 0x7f16180a39c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:38.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:38.941+0000 7f1631bc1700 1 --2- 172.21.15.92:0/1354437882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f162c101940 0x7f162c19e300 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:38.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:38.941+0000 7f1631bc1700 1 --2- 172.21.15.92:0/1354437882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f162c0ffdb0 0x7f162c196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:38.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:38.941+0000 7f1631bc1700 1 --2- 172.21.15.92:0/1354437882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f162c100fa0 0x7f162c197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:38.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:38.941+0000 7f1631bc1700 1 -- 172.21.15.92:0/1354437882 >> 172.21.15.92:0/1354437882 conn(0x7f162c0fb320 msgr2=0x7f162c0680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:38.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:38.941+0000 7f1631bc1700 1 -- 172.21.15.92:0/1354437882 shutdown_connections 2023-10-16T13:11:38.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:38.941+0000 7f1631bc1700 1 -- 172.21.15.92:0/1354437882 wait complete. 2023-10-16T13:11:38.945 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_metadata' created 2023-10-16T13:11:38.958 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T13:11:39.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.099+0000 7f0dd8445700 1 -- 172.21.15.92:0/2395494204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd01024f0 msgr2=0x7f0dd0102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:39.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.099+0000 7f0dd8445700 1 --2- 172.21.15.92:0/2395494204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd01024f0 0x7f0dd0102910 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009990 tx=0x7f0dc0009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:39.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.100+0000 7f0dd8445700 1 -- 172.21.15.92:0/2395494204 shutdown_connections 2023-10-16T13:11:39.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.100+0000 7f0dd8445700 1 --2- 172.21.15.92:0/2395494204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd01024f0 0x7f0dd0102910 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:39.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.100+0000 7f0dd8445700 1 --2- 172.21.15.92:0/2395494204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dd00ff920 0x7f0dd01094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:39.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.100+0000 7f0dd8445700 1 --2- 172.21.15.92:0/2395494204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd00fef60 0x7f0dd00ff3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:39.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.100+0000 7f0dd8445700 1 -- 172.21.15.92:0/2395494204 >> 172.21.15.92:0/2395494204 conn(0x7f0dd00faac0 msgr2=0x7f0dd00fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:39.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.100+0000 7f0dd8445700 1 -- 172.21.15.92:0/2395494204 shutdown_connections 2023-10-16T13:11:39.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.100+0000 7f0dd8445700 1 -- 172.21.15.92:0/2395494204 wait complete. 2023-10-16T13:11:39.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.100+0000 7f0dd8445700 1 Processor -- start 2023-10-16T13:11:39.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.100+0000 7f0dd8445700 1 -- start start 2023-10-16T13:11:39.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dd8445700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd00fef60 0x7f0dd0196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:39.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dd8445700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd00ff920 0x7f0dd0197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:39.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dd8445700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dd01024f0 0x7f0dd019e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:39.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dd8445700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd019e780 con 0x7f0dd00fef60 2023-10-16T13:11:39.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dd8445700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd019e8f0 con 0x7f0dd00ff920 2023-10-16T13:11:39.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dd8445700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd019eab0 con 0x7f0dd01024f0 2023-10-16T13:11:39.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dd61e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd00fef60 0x7f0dd0196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:39.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dd61e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd00fef60 0x7f0dd0196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35182/0 (socket says 172.21.15.92:35182) 2023-10-16T13:11:39.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dd61e1700 1 -- 172.21.15.92:0/2735252998 learned_addr learned my addr 172.21.15.92:0/2735252998 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:39.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dd59e0700 1 --2- 172.21.15.92:0/2735252998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd00ff920 0x7f0dd0197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:39.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dd69e2700 1 --2- 172.21.15.92:0/2735252998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dd01024f0 0x7f0dd019e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:39.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dd61e1700 1 -- 172.21.15.92:0/2735252998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dd01024f0 msgr2=0x7f0dd019e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:39.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dd61e1700 1 --2- 172.21.15.92:0/2735252998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dd01024f0 0x7f0dd019e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:39.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dd61e1700 1 -- 172.21.15.92:0/2735252998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd00ff920 msgr2=0x7f0dd0197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:39.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dd61e1700 1 --2- 172.21.15.92:0/2735252998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd00ff920 0x7f0dd0197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:39.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dd61e1700 1 -- 172.21.15.92:0/2735252998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc00095f0 con 0x7f0dd00fef60 2023-10-16T13:11:39.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dd61e1700 1 --2- 172.21.15.92:0/2735252998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd00fef60 0x7f0dd0196c40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0000c00 tx=0x7f0dc000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:39.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dc77fe700 1 -- 172.21.15.92:0/2735252998 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc001d070 con 0x7f0dd00fef60 2023-10-16T13:11:39.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dc77fe700 1 -- 172.21.15.92:0/2735252998 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0dc000bed0 con 0x7f0dd00fef60 2023-10-16T13:11:39.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dd8445700 1 -- 172.21.15.92:0/2735252998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd019ed30 con 0x7f0dd00fef60 2023-10-16T13:11:39.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dc77fe700 1 -- 172.21.15.92:0/2735252998 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0017650 con 0x7f0dd00fef60 2023-10-16T13:11:39.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.101+0000 7f0dd8445700 1 -- 172.21.15.92:0/2735252998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd019f150 con 0x7f0dd00fef60 2023-10-16T13:11:39.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.102+0000 7f0dd8445700 1 -- 172.21.15.92:0/2735252998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd0108580 con 0x7f0dd00fef60 2023-10-16T13:11:39.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.104+0000 7f0dc77fe700 1 -- 172.21.15.92:0/2735252998 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0dc0022470 con 0x7f0dd00fef60 2023-10-16T13:11:39.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.105+0000 7f0dc77fe700 1 --2- 172.21.15.92:0/2735252998 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0dbc0a1480 0x7f0dbc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:39.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.105+0000 7f0dc77fe700 1 -- 172.21.15.92:0/2735252998 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f0dc00ce7b0 con 0x7f0dd00fef60 2023-10-16T13:11:39.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.105+0000 7f0dd59e0700 1 --2- 172.21.15.92:0/2735252998 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0dbc0a1480 0x7f0dbc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:39.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.105+0000 7f0dd59e0700 1 --2- 172.21.15.92:0/2735252998 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0dbc0a1480 0x7f0dbc0a3940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0069180 tx=0x7f0dcc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:39.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.109+0000 7f0dc77fe700 1 -- 172.21.15.92:0/2735252998 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0dc00981d0 con 0x7f0dd00fef60 2023-10-16T13:11:39.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.307+0000 7f0dd8445700 1 -- 172.21.15.92:0/2735252998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0dd010c840 con 0x7f0dd00fef60 2023-10-16T13:11:39.942 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.941+0000 7f0dc77fe700 1 -- 172.21.15.92:0/2735252998 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0dc009b7f0 con 0x7f0dd00fef60 2023-10-16T13:11:39.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.943+0000 7f0dd8445700 1 -- 172.21.15.92:0/2735252998 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0dbc0a1480 msgr2=0x7f0dbc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:39.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.943+0000 7f0dd8445700 1 --2- 172.21.15.92:0/2735252998 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0dbc0a1480 0x7f0dbc0a3940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0069180 tx=0x7f0dcc009260 comp rx=0 tx=0).stop 2023-10-16T13:11:39.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.943+0000 7f0dd8445700 1 -- 172.21.15.92:0/2735252998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd00fef60 msgr2=0x7f0dd0196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:39.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.943+0000 7f0dd8445700 1 --2- 172.21.15.92:0/2735252998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd00fef60 0x7f0dd0196c40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0000c00 tx=0x7f0dc000f690 comp rx=0 tx=0).stop 2023-10-16T13:11:39.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.944+0000 7f0dd8445700 1 -- 172.21.15.92:0/2735252998 shutdown_connections 2023-10-16T13:11:39.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.944+0000 7f0dd8445700 1 --2- 172.21.15.92:0/2735252998 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0dbc0a1480 0x7f0dbc0a3940 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:39.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.944+0000 7f0dd8445700 1 --2- 172.21.15.92:0/2735252998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dd00fef60 0x7f0dd0196c40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:39.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.944+0000 7f0dd8445700 1 --2- 172.21.15.92:0/2735252998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dd01024f0 0x7f0dd019e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:39.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.944+0000 7f0dd8445700 1 --2- 172.21.15.92:0/2735252998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd00ff920 0x7f0dd0197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:39.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.944+0000 7f0dd8445700 1 -- 172.21.15.92:0/2735252998 >> 172.21.15.92:0/2735252998 conn(0x7f0dd00faac0 msgr2=0x7f0dd01056c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:39.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.945+0000 7f0dd8445700 1 -- 172.21.15.92:0/2735252998 shutdown_connections 2023-10-16T13:11:39.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:39.946+0000 7f0dd8445700 1 -- 172.21.15.92:0/2735252998 wait complete. 2023-10-16T13:11:39.963 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data' created 2023-10-16T13:11:39.974 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T13:11:40.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.097+0000 7f725515c700 1 -- 172.21.15.92:0/2979938747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72500ffe20 msgr2=0x7f7250100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:40.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.097+0000 7f725515c700 1 --2- 172.21.15.92:0/2979938747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72500ffe20 0x7f7250100240 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7244009990 tx=0x7f7244009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:40.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.097+0000 7f725515c700 1 -- 172.21.15.92:0/2979938747 shutdown_connections 2023-10-16T13:11:40.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.097+0000 7f725515c700 1 --2- 172.21.15.92:0/2979938747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72500ffe20 0x7f7250100240 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:40.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.097+0000 7f725515c700 1 --2- 172.21.15.92:0/2979938747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7250101930 0x7f7250108250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:40.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.097+0000 7f725515c700 1 --2- 172.21.15.92:0/2979938747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7250100f70 0x7f72501013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:40.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.097+0000 7f725515c700 1 -- 172.21.15.92:0/2979938747 >> 172.21.15.92:0/2979938747 conn(0x7f72500fb370 msgr2=0x7f72500fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:40.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.097+0000 7f725515c700 1 -- 172.21.15.92:0/2979938747 shutdown_connections 2023-10-16T13:11:40.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.097+0000 7f725515c700 1 -- 172.21.15.92:0/2979938747 wait complete. 2023-10-16T13:11:40.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.098+0000 7f725515c700 1 Processor -- start 2023-10-16T13:11:40.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.098+0000 7f725515c700 1 -- start start 2023-10-16T13:11:40.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.098+0000 7f725515c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72500ffe20 0x7f7250196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:40.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.098+0000 7f725515c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7250100f70 0x7f72501971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:40.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.098+0000 7f725515c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7250101930 0x7f725019e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:40.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.098+0000 7f725515c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725019e800 con 0x7f7250101930 2023-10-16T13:11:40.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.098+0000 7f725515c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725019e970 con 0x7f7250100f70 2023-10-16T13:11:40.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.098+0000 7f725515c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725019eb30 con 0x7f72500ffe20 2023-10-16T13:11:40.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.099+0000 7f724f59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7250101930 0x7f725019e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:40.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.099+0000 7f724e59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7250100f70 0x7f72501971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:40.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.099+0000 7f724f59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7250101930 0x7f725019e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35208/0 (socket says 172.21.15.92:35208) 2023-10-16T13:11:40.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.099+0000 7f724f59e700 1 -- 172.21.15.92:0/1582137234 learned_addr learned my addr 172.21.15.92:0/1582137234 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:40.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.099+0000 7f724ed9d700 1 --2- 172.21.15.92:0/1582137234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72500ffe20 0x7f7250196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:40.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.099+0000 7f724f59e700 1 -- 172.21.15.92:0/1582137234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72500ffe20 msgr2=0x7f7250196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:40.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.099+0000 7f724f59e700 1 --2- 172.21.15.92:0/1582137234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72500ffe20 0x7f7250196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:40.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.099+0000 7f724f59e700 1 -- 172.21.15.92:0/1582137234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7250100f70 msgr2=0x7f72501971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:40.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.099+0000 7f724f59e700 1 --2- 172.21.15.92:0/1582137234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7250100f70 0x7f72501971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:40.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.099+0000 7f724f59e700 1 -- 172.21.15.92:0/1582137234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72440095f0 con 0x7f7250101930 2023-10-16T13:11:40.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.099+0000 7f724e59c700 1 --2- 172.21.15.92:0/1582137234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7250100f70 0x7f72501971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:11:40.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.099+0000 7f724f59e700 1 --2- 172.21.15.92:0/1582137234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7250101930 0x7f725019e230 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f724800ada0 tx=0x7f724800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:40.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.099+0000 7f7237fff700 1 -- 172.21.15.92:0/1582137234 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800f070 con 0x7f7250101930 2023-10-16T13:11:40.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.099+0000 7f7237fff700 1 -- 172.21.15.92:0/1582137234 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7248007b30 con 0x7f7250101930 2023-10-16T13:11:40.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.099+0000 7f725515c700 1 -- 172.21.15.92:0/1582137234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f725019ee10 con 0x7f7250101930 2023-10-16T13:11:40.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.099+0000 7f7237fff700 1 -- 172.21.15.92:0/1582137234 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248013ba0 con 0x7f7250101930 2023-10-16T13:11:40.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.099+0000 7f725515c700 1 -- 172.21.15.92:0/1582137234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f725019f240 con 0x7f7250101930 2023-10-16T13:11:40.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.100+0000 7f725515c700 1 -- 172.21.15.92:0/1582137234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7250107ea0 con 0x7f7250101930 2023-10-16T13:11:40.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.101+0000 7f7237fff700 1 -- 172.21.15.92:0/1582137234 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f724800c8d0 con 0x7f7250101930 2023-10-16T13:11:40.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.102+0000 7f7237fff700 1 --2- 172.21.15.92:0/1582137234 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f72380a1480 0x7f72380a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:40.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.102+0000 7f724ed9d700 1 --2- 172.21.15.92:0/1582137234 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f72380a1480 0x7f72380a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:40.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.102+0000 7f7237fff700 1 -- 172.21.15.92:0/1582137234 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f72480ccca0 con 0x7f7250101930 2023-10-16T13:11:40.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.103+0000 7f724ed9d700 1 --2- 172.21.15.92:0/1582137234 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f72380a1480 0x7f72380a3940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f724400b5c0 tx=0x7f7244005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:40.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.106+0000 7f7237fff700 1 -- 172.21.15.92:0/1582137234 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7248096540 con 0x7f7250101930 2023-10-16T13:11:40.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:39 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1354437882' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-16T13:11:40.453 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:39 smithi092 ceph-mon[99542]: osdmap e80: 12 total, 12 up, 12 in 2023-10-16T13:11:40.453 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:39 smithi092 ceph-mon[99542]: pgmap v252: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:40.454 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:39 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2735252998' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-16T13:11:40.454 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:39 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.454 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:39 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.454 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:39 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.455 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:39 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.455 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:39 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.455 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:39 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.455 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:39 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:40.455 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:39 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:11:40.456 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:39 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.457 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:39 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1354437882' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-16T13:11:40.457 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:39 smithi152 ceph-mon[104423]: osdmap e80: 12 total, 12 up, 12 in 2023-10-16T13:11:40.458 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:39 smithi152 ceph-mon[104423]: pgmap v252: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:40.458 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:39 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2735252998' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-16T13:11:40.458 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:39 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.459 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:39 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.459 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:39 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.459 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:39 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.459 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:39 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.460 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:39 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.460 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:39 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:40.460 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:39 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:11:40.460 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:39 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.461 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:39 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1354437882' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-16T13:11:40.461 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:39 smithi118 ceph-mon[103969]: osdmap e80: 12 total, 12 up, 12 in 2023-10-16T13:11:40.461 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:39 smithi118 ceph-mon[103969]: pgmap v252: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:40.461 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:39 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2735252998' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-16T13:11:40.462 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:39 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.462 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:39 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.463 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:39 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.463 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:39 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.464 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:39 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.464 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:39 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.464 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:39 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:11:40.465 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:39 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:11:40.465 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:39 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:11:40.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:40.342+0000 7f725515c700 1 -- 172.21.15.92:0/1582137234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f725002d230 con 0x7f7250101930 2023-10-16T13:11:41.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:40 smithi092 ceph-mon[99542]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-16T13:11:41.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:40 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2735252998' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-16T13:11:41.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:40 smithi092 ceph-mon[99542]: osdmap e81: 12 total, 12 up, 12 in 2023-10-16T13:11:41.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:40 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1582137234' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-16T13:11:41.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:40 smithi092 ceph-mon[99542]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-16T13:11:41.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:40 smithi118 ceph-mon[103969]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-16T13:11:41.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:40 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2735252998' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-16T13:11:41.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:40 smithi118 ceph-mon[103969]: osdmap e81: 12 total, 12 up, 12 in 2023-10-16T13:11:41.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:40 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1582137234' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-16T13:11:41.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:40 smithi118 ceph-mon[103969]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-16T13:11:41.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.295+0000 7f7237fff700 1 -- 172.21.15.92:0/1582137234 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7248099b60 con 0x7f7250101930 2023-10-16T13:11:41.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.298+0000 7f725515c700 1 -- 172.21.15.92:0/1582137234 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f72380a1480 msgr2=0x7f72380a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:41.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.298+0000 7f725515c700 1 --2- 172.21.15.92:0/1582137234 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f72380a1480 0x7f72380a3940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f724400b5c0 tx=0x7f7244005960 comp rx=0 tx=0).stop 2023-10-16T13:11:41.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.299+0000 7f725515c700 1 -- 172.21.15.92:0/1582137234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7250101930 msgr2=0x7f725019e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:41.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.299+0000 7f725515c700 1 --2- 172.21.15.92:0/1582137234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7250101930 0x7f725019e230 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f724800ada0 tx=0x7f724800c330 comp rx=0 tx=0).stop 2023-10-16T13:11:41.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.299+0000 7f725515c700 1 -- 172.21.15.92:0/1582137234 shutdown_connections 2023-10-16T13:11:41.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.299+0000 7f725515c700 1 --2- 172.21.15.92:0/1582137234 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f72380a1480 0x7f72380a3940 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.299+0000 7f725515c700 1 --2- 172.21.15.92:0/1582137234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7250101930 0x7f725019e230 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.299+0000 7f725515c700 1 --2- 172.21.15.92:0/1582137234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72500ffe20 0x7f7250196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.299+0000 7f725515c700 1 --2- 172.21.15.92:0/1582137234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7250100f70 0x7f72501971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.299+0000 7f725515c700 1 -- 172.21.15.92:0/1582137234 >> 172.21.15.92:0/1582137234 conn(0x7f72500fb370 msgr2=0x7f72500fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:41.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.299+0000 7f725515c700 1 -- 172.21.15.92:0/1582137234 shutdown_connections 2023-10-16T13:11:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.299+0000 7f725515c700 1 -- 172.21.15.92:0/1582137234 wait complete. 2023-10-16T13:11:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:new fs with metadata pool 2 and data pool 3 2023-10-16T13:11:41.319 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:11:41.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:40 smithi152 ceph-mon[104423]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-16T13:11:41.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:40 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2735252998' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-16T13:11:41.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:40 smithi152 ceph-mon[104423]: osdmap e81: 12 total, 12 up, 12 in 2023-10-16T13:11:41.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:40 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1582137234' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-16T13:11:41.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:40 smithi152 ceph-mon[104423]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-16T13:11:41.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.444+0000 7f55279a4700 1 -- 172.21.15.92:0/1588351519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55201019b0 msgr2=0x7f5520103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:41.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.444+0000 7f55279a4700 1 --2- 172.21.15.92:0/1588351519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55201019b0 0x7f5520103da0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5510009990 tx=0x7f5510009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.444+0000 7f55279a4700 1 -- 172.21.15.92:0/1588351519 shutdown_connections 2023-10-16T13:11:41.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.444+0000 7f55279a4700 1 --2- 172.21.15.92:0/1588351519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55201019b0 0x7f5520103da0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.444+0000 7f55279a4700 1 --2- 172.21.15.92:0/1588351519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5520106c10 0x7f5520109080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.444+0000 7f55279a4700 1 --2- 172.21.15.92:0/1588351519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55201042e0 0x7f55201066d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.444+0000 7f55279a4700 1 -- 172.21.15.92:0/1588351519 >> 172.21.15.92:0/1588351519 conn(0x7f55200fb380 msgr2=0x7f55200fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:41.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.444+0000 7f55279a4700 1 -- 172.21.15.92:0/1588351519 shutdown_connections 2023-10-16T13:11:41.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.444+0000 7f55279a4700 1 -- 172.21.15.92:0/1588351519 wait complete. 2023-10-16T13:11:41.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f55279a4700 1 Processor -- start 2023-10-16T13:11:41.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f55279a4700 1 -- start start 2023-10-16T13:11:41.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f55279a4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55201019b0 0x7f5520101320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:41.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f55279a4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55201042e0 0x7f55200ff960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:41.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f55279a4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5520106c10 0x7f55200ffea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:41.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f55279a4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5520100640 con 0x7f5520106c10 2023-10-16T13:11:41.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f55279a4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55201007b0 con 0x7f55201019b0 2023-10-16T13:11:41.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f55279a4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55201a0c30 con 0x7f55201042e0 2023-10-16T13:11:41.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f5525f41700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5520106c10 0x7f55200ffea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:41.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f5525f41700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5520106c10 0x7f55200ffea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35222/0 (socket says 172.21.15.92:35222) 2023-10-16T13:11:41.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f5525f41700 1 -- 172.21.15.92:0/3783339626 learned_addr learned my addr 172.21.15.92:0/3783339626 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:41.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f5525740700 1 --2- 172.21.15.92:0/3783339626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55201019b0 0x7f5520101320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:41.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f5524f3f700 1 --2- 172.21.15.92:0/3783339626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55201042e0 0x7f55200ff960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:41.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f5525f41700 1 -- 172.21.15.92:0/3783339626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55201042e0 msgr2=0x7f55200ff960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:41.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f5525f41700 1 --2- 172.21.15.92:0/3783339626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55201042e0 0x7f55200ff960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f5525f41700 1 -- 172.21.15.92:0/3783339626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55201019b0 msgr2=0x7f5520101320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:41.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f5525f41700 1 --2- 172.21.15.92:0/3783339626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55201019b0 0x7f5520101320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f5525f41700 1 -- 172.21.15.92:0/3783339626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55100095f0 con 0x7f5520106c10 2023-10-16T13:11:41.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f5524f3f700 1 --2- 172.21.15.92:0/3783339626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55201042e0 0x7f55200ff960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:11:41.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f5525740700 1 --2- 172.21.15.92:0/3783339626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55201019b0 0x7f5520101320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:11:41.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.445+0000 7f5525f41700 1 --2- 172.21.15.92:0/3783339626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5520106c10 0x7f55200ffea0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5518007ee0 tx=0x7f551800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:41.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.446+0000 7f55167fc700 1 -- 172.21.15.92:0/3783339626 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518017070 con 0x7f5520106c10 2023-10-16T13:11:41.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.446+0000 7f55167fc700 1 -- 172.21.15.92:0/3783339626 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f551800f040 con 0x7f5520106c10 2023-10-16T13:11:41.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.446+0000 7f55279a4700 1 -- 172.21.15.92:0/3783339626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55201a0f10 con 0x7f5520106c10 2023-10-16T13:11:41.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.446+0000 7f55167fc700 1 -- 172.21.15.92:0/3783339626 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518005740 con 0x7f5520106c10 2023-10-16T13:11:41.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.446+0000 7f55279a4700 1 -- 172.21.15.92:0/3783339626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55201a1340 con 0x7f5520106c10 2023-10-16T13:11:41.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.447+0000 7f55279a4700 1 -- 172.21.15.92:0/3783339626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55200fcf00 con 0x7f5520106c10 2023-10-16T13:11:41.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.448+0000 7f55167fc700 1 -- 172.21.15.92:0/3783339626 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f55180058e0 con 0x7f5520106c10 2023-10-16T13:11:41.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.448+0000 7f55167fc700 1 --2- 172.21.15.92:0/3783339626 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f550c0a1520 0x7f550c0a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:41.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.448+0000 7f5525740700 1 --2- 172.21.15.92:0/3783339626 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f550c0a1520 0x7f550c0a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:41.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.448+0000 7f55167fc700 1 -- 172.21.15.92:0/3783339626 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f55180cc3f0 con 0x7f5520106c10 2023-10-16T13:11:41.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.449+0000 7f5525740700 1 --2- 172.21.15.92:0/3783339626 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f550c0a1520 0x7f550c0a39e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5510006010 tx=0x7f5510003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:41.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.453+0000 7f55167fc700 1 -- 172.21.15.92:0/3783339626 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5518095ba0 con 0x7f5520106c10 2023-10-16T13:11:41.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.647+0000 7f55279a4700 1 -- 172.21.15.92:0/3783339626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f552010c870 con 0x7f5520106c10 2023-10-16T13:11:41.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.648+0000 7f55167fc700 1 -- 172.21.15.92:0/3783339626 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22132 (secure 0 0 0) 0x7f55180991c0 con 0x7f5520106c10 2023-10-16T13:11:41.650 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:41.651 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":82,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:11:40.342933+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:11:38.345035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:11:39.549912+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:11:41.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.651+0000 7f55279a4700 1 -- 172.21.15.92:0/3783339626 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f550c0a1520 msgr2=0x7f550c0a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:41.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.651+0000 7f55279a4700 1 --2- 172.21.15.92:0/3783339626 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f550c0a1520 0x7f550c0a39e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5510006010 tx=0x7f5510003680 comp rx=0 tx=0).stop 2023-10-16T13:11:41.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.651+0000 7f55279a4700 1 -- 172.21.15.92:0/3783339626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5520106c10 msgr2=0x7f55200ffea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:41.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.651+0000 7f55279a4700 1 --2- 172.21.15.92:0/3783339626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5520106c10 0x7f55200ffea0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5518007ee0 tx=0x7f551800d3b0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.651+0000 7f55279a4700 1 -- 172.21.15.92:0/3783339626 shutdown_connections 2023-10-16T13:11:41.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.651+0000 7f55279a4700 1 --2- 172.21.15.92:0/3783339626 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f550c0a1520 0x7f550c0a39e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.651+0000 7f55279a4700 1 --2- 172.21.15.92:0/3783339626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5520106c10 0x7f55200ffea0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.651+0000 7f55279a4700 1 --2- 172.21.15.92:0/3783339626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55201019b0 0x7f5520101320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.651+0000 7f55279a4700 1 --2- 172.21.15.92:0/3783339626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55201042e0 0x7f55200ff960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.651+0000 7f55279a4700 1 -- 172.21.15.92:0/3783339626 >> 172.21.15.92:0/3783339626 conn(0x7f55200fb380 msgr2=0x7f5520102620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:41.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.651+0000 7f55279a4700 1 -- 172.21.15.92:0/3783339626 shutdown_connections 2023-10-16T13:11:41.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.651+0000 7f55279a4700 1 -- 172.21.15.92:0/3783339626 wait complete. 2023-10-16T13:11:41.665 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:11:41.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.784+0000 7fae0edb3700 1 -- 172.21.15.92:0/3205728070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae08100920 msgr2=0x7fae08108250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:41.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.784+0000 7fae0edb3700 1 --2- 172.21.15.92:0/3205728070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae08100920 0x7fae08108250 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fae0000b0a0 tx=0x7fae0000b3b0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.784+0000 7fae0edb3700 1 -- 172.21.15.92:0/3205728070 shutdown_connections 2023-10-16T13:11:41.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.784+0000 7fae0edb3700 1 --2- 172.21.15.92:0/3205728070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae08100920 0x7fae08108250 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.784+0000 7fae0edb3700 1 --2- 172.21.15.92:0/3205728070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae08101310 0x7fae08101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.784+0000 7fae0edb3700 1 --2- 172.21.15.92:0/3205728070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae080fff60 0x7fae081003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.784+0000 7fae0edb3700 1 -- 172.21.15.92:0/3205728070 >> 172.21.15.92:0/3205728070 conn(0x7fae080faab0 msgr2=0x7fae080fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:41.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.784+0000 7fae0edb3700 1 -- 172.21.15.92:0/3205728070 shutdown_connections 2023-10-16T13:11:41.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.784+0000 7fae0edb3700 1 -- 172.21.15.92:0/3205728070 wait complete. 2023-10-16T13:11:41.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.784+0000 7fae0edb3700 1 Processor -- start 2023-10-16T13:11:41.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae0edb3700 1 -- start start 2023-10-16T13:11:41.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae0edb3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae080fff60 0x7fae080ff9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:41.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae0edb3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae08100920 0x7fae0819ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:41.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae0edb3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae08101310 0x7fae0819e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:41.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae0edb3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0819e820 con 0x7fae080fff60 2023-10-16T13:11:41.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae0edb3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0819e990 con 0x7fae08101310 2023-10-16T13:11:41.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae0edb3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0819eb50 con 0x7fae08100920 2023-10-16T13:11:41.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae0cb4f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae080fff60 0x7fae080ff9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:41.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae0cb4f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae080fff60 0x7fae080ff9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35232/0 (socket says 172.21.15.92:35232) 2023-10-16T13:11:41.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae0cb4f700 1 -- 172.21.15.92:0/4107652563 learned_addr learned my addr 172.21.15.92:0/4107652563 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:41.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae07fff700 1 --2- 172.21.15.92:0/4107652563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae08100920 0x7fae0819ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:41.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae0d350700 1 --2- 172.21.15.92:0/4107652563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae08101310 0x7fae0819e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:41.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae0cb4f700 1 -- 172.21.15.92:0/4107652563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae08100920 msgr2=0x7fae0819ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:41.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae0cb4f700 1 --2- 172.21.15.92:0/4107652563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae08100920 0x7fae0819ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae0cb4f700 1 -- 172.21.15.92:0/4107652563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae08101310 msgr2=0x7fae0819e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:41.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae0cb4f700 1 --2- 172.21.15.92:0/4107652563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae08101310 0x7fae0819e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae0cb4f700 1 -- 172.21.15.92:0/4107652563 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae00009d00 con 0x7fae080fff60 2023-10-16T13:11:41.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae0cb4f700 1 --2- 172.21.15.92:0/4107652563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae080fff60 0x7fae080ff9e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00d980 tx=0x7fadfc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:41.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae05ffb700 1 -- 172.21.15.92:0/4107652563 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc004020 con 0x7fae080fff60 2023-10-16T13:11:41.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae05ffb700 1 -- 172.21.15.92:0/4107652563 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fadfc009730 con 0x7fae080fff60 2023-10-16T13:11:41.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae0edb3700 1 -- 172.21.15.92:0/4107652563 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0819ee30 con 0x7fae080fff60 2023-10-16T13:11:41.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.785+0000 7fae05ffb700 1 -- 172.21.15.92:0/4107652563 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc003be0 con 0x7fae080fff60 2023-10-16T13:11:41.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.786+0000 7fae0edb3700 1 -- 172.21.15.92:0/4107652563 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0819f2b0 con 0x7fae080fff60 2023-10-16T13:11:41.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.787+0000 7fae0edb3700 1 -- 172.21.15.92:0/4107652563 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae08107230 con 0x7fae080fff60 2023-10-16T13:11:41.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.787+0000 7fae05ffb700 1 -- 172.21.15.92:0/4107652563 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fadfc009ba0 con 0x7fae080fff60 2023-10-16T13:11:41.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.788+0000 7fae05ffb700 1 --2- 172.21.15.92:0/4107652563 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fadf80a15a0 0x7fadf80a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:41.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.788+0000 7fae05ffb700 1 -- 172.21.15.92:0/4107652563 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fadfc0cc820 con 0x7fae080fff60 2023-10-16T13:11:41.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.788+0000 7fae07fff700 1 --2- 172.21.15.92:0/4107652563 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fadf80a15a0 0x7fadf80a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:41.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.788+0000 7fae07fff700 1 --2- 172.21.15.92:0/4107652563 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fadf80a15a0 0x7fadf80a3a60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fae080ff750 tx=0x7fadf400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:41.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.792+0000 7fae05ffb700 1 -- 172.21.15.92:0/4107652563 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fadfc095f30 con 0x7fae080fff60 2023-10-16T13:11:41.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.990+0000 7fae0edb3700 1 -- 172.21.15.92:0/4107652563 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae0802d1a0 con 0x7fae080fff60 2023-10-16T13:11:41.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.991+0000 7fae05ffb700 1 -- 172.21.15.92:0/4107652563 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22119 (secure 0 0 0) 0x7fadfc099550 con 0x7fae080fff60 2023-10-16T13:11:41.993 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:41.994 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":83,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:11:41.954264+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:11:38.345035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:11:39.549912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:11:41.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.993+0000 7fae0edb3700 1 -- 172.21.15.92:0/4107652563 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fadf80a15a0 msgr2=0x7fadf80a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:41.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.993+0000 7fae0edb3700 1 --2- 172.21.15.92:0/4107652563 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fadf80a15a0 0x7fadf80a3a60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fae080ff750 tx=0x7fadf400b410 comp rx=0 tx=0).stop 2023-10-16T13:11:41.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.993+0000 7fae0edb3700 1 -- 172.21.15.92:0/4107652563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae080fff60 msgr2=0x7fae080ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:41.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.993+0000 7fae0edb3700 1 --2- 172.21.15.92:0/4107652563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae080fff60 0x7fae080ff9e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00d980 tx=0x7fadfc00dc90 comp rx=0 tx=0).stop 2023-10-16T13:11:41.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.993+0000 7fae0edb3700 1 -- 172.21.15.92:0/4107652563 shutdown_connections 2023-10-16T13:11:41.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.993+0000 7fae0edb3700 1 --2- 172.21.15.92:0/4107652563 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fadf80a15a0 0x7fadf80a3a60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.993+0000 7fae0edb3700 1 --2- 172.21.15.92:0/4107652563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae080fff60 0x7fae080ff9e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.993+0000 7fae0edb3700 1 --2- 172.21.15.92:0/4107652563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae08101310 0x7fae0819e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.993+0000 7fae0edb3700 1 --2- 172.21.15.92:0/4107652563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae08100920 0x7fae0819ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:41.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.993+0000 7fae0edb3700 1 -- 172.21.15.92:0/4107652563 >> 172.21.15.92:0/4107652563 conn(0x7fae080faab0 msgr2=0x7fae08104370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:41.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.993+0000 7fae0edb3700 1 -- 172.21.15.92:0/4107652563 shutdown_connections 2023-10-16T13:11:41.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:41.993+0000 7fae0edb3700 1 -- 172.21.15.92:0/4107652563 wait complete. 2023-10-16T13:11:42.008 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T13:11:42.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.130+0000 7fec88d5d700 1 -- 172.21.15.92:0/271159345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec84106c00 msgr2=0x7fec84109010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:42.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.130+0000 7fec88d5d700 1 --2- 172.21.15.92:0/271159345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec84106c00 0x7fec84109010 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00b0a0 tx=0x7fec7c00b3b0 comp rx=0 tx=0).stop 2023-10-16T13:11:42.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.130+0000 7fec88d5d700 1 -- 172.21.15.92:0/271159345 shutdown_connections 2023-10-16T13:11:42.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.130+0000 7fec88d5d700 1 --2- 172.21.15.92:0/271159345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec84106c00 0x7fec84109010 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:42.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.130+0000 7fec88d5d700 1 --2- 172.21.15.92:0/271159345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec841019a0 0x7fec84103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:42.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.130+0000 7fec88d5d700 1 --2- 172.21.15.92:0/271159345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec841042d0 0x7fec841066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:42.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.130+0000 7fec88d5d700 1 -- 172.21.15.92:0/271159345 >> 172.21.15.92:0/271159345 conn(0x7fec840fb2f0 msgr2=0x7fec840fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:42.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.130+0000 7fec88d5d700 1 -- 172.21.15.92:0/271159345 shutdown_connections 2023-10-16T13:11:42.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.130+0000 7fec88d5d700 1 -- 172.21.15.92:0/271159345 wait complete. 2023-10-16T13:11:42.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec88d5d700 1 Processor -- start 2023-10-16T13:11:42.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec88d5d700 1 -- start start 2023-10-16T13:11:42.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec88d5d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec841019a0 0x7fec84196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:42.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec88d5d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec841042d0 0x7fec841973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:42.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec88d5d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec84106c00 0x7fec8419e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:42.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec88d5d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8419ea20 con 0x7fec841042d0 2023-10-16T13:11:42.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec88d5d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8419eb60 con 0x7fec84106c00 2023-10-16T13:11:42.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec88d5d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8419ecf0 con 0x7fec841019a0 2023-10-16T13:11:42.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec81d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec841042d0 0x7fec841973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:42.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec81d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec841042d0 0x7fec841973e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35246/0 (socket says 172.21.15.92:35246) 2023-10-16T13:11:42.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec81d9b700 1 -- 172.21.15.92:0/906345443 learned_addr learned my addr 172.21.15.92:0/906345443 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:42.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec82d9d700 1 --2- 172.21.15.92:0/906345443 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec84106c00 0x7fec8419e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:42.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec81d9b700 1 -- 172.21.15.92:0/906345443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec841019a0 msgr2=0x7fec84196ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:42.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec8259c700 1 --2- 172.21.15.92:0/906345443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec841019a0 0x7fec84196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:42.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec81d9b700 1 --2- 172.21.15.92:0/906345443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec841019a0 0x7fec84196ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:42.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec81d9b700 1 -- 172.21.15.92:0/906345443 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec84106c00 msgr2=0x7fec8419e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:42.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec81d9b700 1 --2- 172.21.15.92:0/906345443 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec84106c00 0x7fec8419e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:42.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec81d9b700 1 -- 172.21.15.92:0/906345443 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c009d00 con 0x7fec841042d0 2023-10-16T13:11:42.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec82d9d700 1 --2- 172.21.15.92:0/906345443 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec84106c00 0x7fec8419e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:11:42.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec8259c700 1 --2- 172.21.15.92:0/906345443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec841019a0 0x7fec84196ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:11:42.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec81d9b700 1 --2- 172.21.15.92:0/906345443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec841042d0 0x7fec841973e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fec7400b530 tx=0x7fec7400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:42.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec737fe700 1 -- 172.21.15.92:0/906345443 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec74011830 con 0x7fec841042d0 2023-10-16T13:11:42.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec737fe700 1 -- 172.21.15.92:0/906345443 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fec74011e70 con 0x7fec841042d0 2023-10-16T13:11:42.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec88d5d700 1 -- 172.21.15.92:0/906345443 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8419efd0 con 0x7fec841042d0 2023-10-16T13:11:42.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.131+0000 7fec737fe700 1 -- 172.21.15.92:0/906345443 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7400f2e0 con 0x7fec841042d0 2023-10-16T13:11:42.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.132+0000 7fec88d5d700 1 -- 172.21.15.92:0/906345443 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec8419f4d0 con 0x7fec841042d0 2023-10-16T13:11:42.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.132+0000 7fec88d5d700 1 -- 172.21.15.92:0/906345443 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec840fce70 con 0x7fec841042d0 2023-10-16T13:11:42.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.133+0000 7fec737fe700 1 -- 172.21.15.92:0/906345443 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fec740105f0 con 0x7fec841042d0 2023-10-16T13:11:42.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.134+0000 7fec737fe700 1 --2- 172.21.15.92:0/906345443 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fec6c0a1480 0x7fec6c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:42.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.134+0000 7fec737fe700 1 -- 172.21.15.92:0/906345443 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fec740ccb70 con 0x7fec841042d0 2023-10-16T13:11:42.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.134+0000 7fec8259c700 1 --2- 172.21.15.92:0/906345443 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fec6c0a1480 0x7fec6c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:42.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.134+0000 7fec8259c700 1 --2- 172.21.15.92:0/906345443 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fec6c0a1480 0x7fec6c0a3940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fec78007900 tx=0x7fec78008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:42.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.137+0000 7fec737fe700 1 -- 172.21.15.92:0/906345443 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fec74096320 con 0x7fec841042d0 2023-10-16T13:11:42.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:41 smithi092 ceph-mon[99542]: osdmap e82: 12 total, 12 up, 12 in 2023-10-16T13:11:42.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:41 smithi092 ceph-mon[99542]: pgmap v255: 97 pgs: 16 creating+peering, 28 active+clean, 53 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:42.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:41 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1582137234' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-16T13:11:42.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:41 smithi092 ceph-mon[99542]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-16T13:11:42.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:41 smithi092 ceph-mon[99542]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-16T13:11:42.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:41 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3783339626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:42.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:41 smithi118 ceph-mon[103969]: osdmap e82: 12 total, 12 up, 12 in 2023-10-16T13:11:42.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:41 smithi118 ceph-mon[103969]: pgmap v255: 97 pgs: 16 creating+peering, 28 active+clean, 53 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:42.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:41 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1582137234' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-16T13:11:42.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:41 smithi118 ceph-mon[103969]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-16T13:11:42.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:41 smithi118 ceph-mon[103969]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-16T13:11:42.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:41 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3783339626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:42.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:42.375+0000 7fec88d5d700 1 -- 172.21.15.92:0/906345443 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fec8410cbe0 con 0x7fec841042d0 2023-10-16T13:11:42.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:41 smithi152 ceph-mon[104423]: osdmap e82: 12 total, 12 up, 12 in 2023-10-16T13:11:42.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:41 smithi152 ceph-mon[104423]: pgmap v255: 97 pgs: 16 creating+peering, 28 active+clean, 53 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:11:42.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:41 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1582137234' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-16T13:11:42.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:41 smithi152 ceph-mon[104423]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-16T13:11:42.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:41 smithi152 ceph-mon[104423]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-16T13:11:42.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:41 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3783339626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:43.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:42 smithi092 ceph-mon[99542]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-16T13:11:43.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:42 smithi092 ceph-mon[99542]: Cluster is now healthy 2023-10-16T13:11:43.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:42 smithi092 ceph-mon[99542]: osdmap e83: 12 total, 12 up, 12 in 2023-10-16T13:11:43.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:42 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/4107652563' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:43.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:42 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] up:active 2023-10-16T13:11:43.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:42 smithi092 ceph-mon[99542]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-16T13:11:43.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:42 smithi092 ceph-mon[99542]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-16T13:11:43.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:42 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/906345443' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-16T13:11:43.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:42 smithi118 ceph-mon[103969]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-16T13:11:43.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:42 smithi118 ceph-mon[103969]: Cluster is now healthy 2023-10-16T13:11:43.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:42 smithi118 ceph-mon[103969]: osdmap e83: 12 total, 12 up, 12 in 2023-10-16T13:11:43.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:42 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/4107652563' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:43.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:42 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] up:active 2023-10-16T13:11:43.284 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:42 smithi118 ceph-mon[103969]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-16T13:11:43.285 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:42 smithi118 ceph-mon[103969]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-16T13:11:43.285 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:42 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/906345443' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-16T13:11:43.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.303+0000 7fec737fe700 1 -- 172.21.15.92:0/906345443 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7fec8410cbe0 con 0x7fec841042d0 2023-10-16T13:11:43.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.306+0000 7fec88d5d700 1 -- 172.21.15.92:0/906345443 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fec6c0a1480 msgr2=0x7fec6c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:43.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.306+0000 7fec88d5d700 1 --2- 172.21.15.92:0/906345443 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fec6c0a1480 0x7fec6c0a3940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fec78007900 tx=0x7fec78008040 comp rx=0 tx=0).stop 2023-10-16T13:11:43.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.306+0000 7fec88d5d700 1 -- 172.21.15.92:0/906345443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec841042d0 msgr2=0x7fec841973e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:43.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.306+0000 7fec88d5d700 1 --2- 172.21.15.92:0/906345443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec841042d0 0x7fec841973e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fec7400b530 tx=0x7fec7400b8f0 comp rx=0 tx=0).stop 2023-10-16T13:11:43.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.306+0000 7fec88d5d700 1 -- 172.21.15.92:0/906345443 shutdown_connections 2023-10-16T13:11:43.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.306+0000 7fec88d5d700 1 --2- 172.21.15.92:0/906345443 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fec6c0a1480 0x7fec6c0a3940 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:43.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.306+0000 7fec88d5d700 1 --2- 172.21.15.92:0/906345443 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec84106c00 0x7fec8419e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:43.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.306+0000 7fec88d5d700 1 --2- 172.21.15.92:0/906345443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec841019a0 0x7fec84196ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:43.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.306+0000 7fec88d5d700 1 --2- 172.21.15.92:0/906345443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec841042d0 0x7fec841973e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:43.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.306+0000 7fec88d5d700 1 -- 172.21.15.92:0/906345443 >> 172.21.15.92:0/906345443 conn(0x7fec840fb2f0 msgr2=0x7fec84102610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:43.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.306+0000 7fec88d5d700 1 -- 172.21.15.92:0/906345443 shutdown_connections 2023-10-16T13:11:43.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.306+0000 7fec88d5d700 1 -- 172.21.15.92:0/906345443 wait complete. 2023-10-16T13:11:43.322 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-10-16T13:11:43.323 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-10-16T13:11:43.442 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:42 smithi152 ceph-mon[104423]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-16T13:11:43.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:42 smithi152 ceph-mon[104423]: Cluster is now healthy 2023-10-16T13:11:43.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:42 smithi152 ceph-mon[104423]: osdmap e83: 12 total, 12 up, 12 in 2023-10-16T13:11:43.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:42 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/4107652563' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:43.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:42 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] up:active 2023-10-16T13:11:43.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:42 smithi152 ceph-mon[104423]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-16T13:11:43.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:42 smithi152 ceph-mon[104423]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-16T13:11:43.444 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:42 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/906345443' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-16T13:11:43.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.451+0000 7faae7787700 1 -- 172.21.15.92:0/4281677937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faae01013c0 msgr2=0x7faae01017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:43.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.451+0000 7faae7787700 1 --2- 172.21.15.92:0/4281677937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faae01013c0 0x7faae01017e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faad0009990 tx=0x7faad0009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:43.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.451+0000 7faae7787700 1 -- 172.21.15.92:0/4281677937 shutdown_connections 2023-10-16T13:11:43.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.451+0000 7faae7787700 1 --2- 172.21.15.92:0/4281677937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faae01013c0 0x7faae01017e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:43.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.451+0000 7faae7787700 1 --2- 172.21.15.92:0/4281677937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faae0100a20 0x7faae01082c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:43.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.451+0000 7faae7787700 1 --2- 172.21.15.92:0/4281677937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faae0100060 0x7faae01004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:43.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.451+0000 7faae7787700 1 -- 172.21.15.92:0/4281677937 >> 172.21.15.92:0/4281677937 conn(0x7faae00faa90 msgr2=0x7faae00fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:43.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.451+0000 7faae7787700 1 -- 172.21.15.92:0/4281677937 shutdown_connections 2023-10-16T13:11:43.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.451+0000 7faae7787700 1 -- 172.21.15.92:0/4281677937 wait complete. 2023-10-16T13:11:43.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.452+0000 7faae7787700 1 Processor -- start 2023-10-16T13:11:43.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.452+0000 7faae7787700 1 -- start start 2023-10-16T13:11:43.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.452+0000 7faae7787700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faae0100060 0x7faae0195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:43.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.452+0000 7faae7787700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faae0100a20 0x7faae01961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:43.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.452+0000 7faae7787700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faae01013c0 0x7faae019d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:43.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.452+0000 7faae7787700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae019d820 con 0x7faae0100a20 2023-10-16T13:11:43.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.452+0000 7faae7787700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae019d990 con 0x7faae01013c0 2023-10-16T13:11:43.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.452+0000 7faae7787700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae019db50 con 0x7faae0100060 2023-10-16T13:11:43.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.452+0000 7faae4d22700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faae0100a20 0x7faae01961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:43.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.452+0000 7faae4d22700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faae0100a20 0x7faae01961f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35260/0 (socket says 172.21.15.92:35260) 2023-10-16T13:11:43.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.452+0000 7faae4d22700 1 -- 172.21.15.92:0/828551199 learned_addr learned my addr 172.21.15.92:0/828551199 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:43.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.452+0000 7faae5523700 1 --2- 172.21.15.92:0/828551199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faae0100060 0x7faae0195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:43.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.452+0000 7faae4d22700 1 -- 172.21.15.92:0/828551199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faae0100060 msgr2=0x7faae0195cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:43.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.452+0000 7faae4d22700 1 --2- 172.21.15.92:0/828551199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faae0100060 0x7faae0195cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:43.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.452+0000 7faae5d24700 1 --2- 172.21.15.92:0/828551199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faae01013c0 0x7faae019d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:43.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.452+0000 7faae4d22700 1 -- 172.21.15.92:0/828551199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faae01013c0 msgr2=0x7faae019d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:43.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.453+0000 7faae4d22700 1 --2- 172.21.15.92:0/828551199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faae01013c0 0x7faae019d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:43.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.453+0000 7faae4d22700 1 -- 172.21.15.92:0/828551199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad00095f0 con 0x7faae0100a20 2023-10-16T13:11:43.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.453+0000 7faae4d22700 1 --2- 172.21.15.92:0/828551199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faae0100a20 0x7faae01961f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faadc00b500 tx=0x7faadc00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:43.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.453+0000 7faad67fc700 1 -- 172.21.15.92:0/828551199 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc011830 con 0x7faae0100a20 2023-10-16T13:11:43.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.453+0000 7faad67fc700 1 -- 172.21.15.92:0/828551199 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faadc011e70 con 0x7faae0100a20 2023-10-16T13:11:43.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.453+0000 7faae7787700 1 -- 172.21.15.92:0/828551199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae019de30 con 0x7faae0100a20 2023-10-16T13:11:43.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.453+0000 7faad67fc700 1 -- 172.21.15.92:0/828551199 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc00f2e0 con 0x7faae0100a20 2023-10-16T13:11:43.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.453+0000 7faae7787700 1 -- 172.21.15.92:0/828551199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae019e260 con 0x7faae0100a20 2023-10-16T13:11:43.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.454+0000 7faae7787700 1 -- 172.21.15.92:0/828551199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae0107410 con 0x7faae0100a20 2023-10-16T13:11:43.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.455+0000 7faad67fc700 1 -- 172.21.15.92:0/828551199 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7faadc0105f0 con 0x7faae0100a20 2023-10-16T13:11:43.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.455+0000 7faad67fc700 1 --2- 172.21.15.92:0/828551199 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faacc0a1580 0x7faacc0a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:43.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.455+0000 7faae5523700 1 --2- 172.21.15.92:0/828551199 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faacc0a1580 0x7faacc0a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:43.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.456+0000 7faad67fc700 1 -- 172.21.15.92:0/828551199 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7faadc0ccba0 con 0x7faae0100a20 2023-10-16T13:11:43.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.456+0000 7faae5523700 1 --2- 172.21.15.92:0/828551199 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faacc0a1580 0x7faacc0a3a40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faad0000c00 tx=0x7faad0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:43.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.459+0000 7faad67fc700 1 -- 172.21.15.92:0/828551199 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faadc0962b0 con 0x7faae0100a20 2023-10-16T13:11:43.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:43.692+0000 7faae7787700 1 -- 172.21.15.92:0/828551199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7faae010ba10 con 0x7faae0100a20 2023-10-16T13:11:44.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.306+0000 7faad67fc700 1 -- 172.21.15.92:0/828551199 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7faadc015020 con 0x7faae0100a20 2023-10-16T13:11:44.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.309+0000 7faae7787700 1 -- 172.21.15.92:0/828551199 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faacc0a1580 msgr2=0x7faacc0a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:44.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.309+0000 7faae7787700 1 --2- 172.21.15.92:0/828551199 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faacc0a1580 0x7faacc0a3a40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faad0000c00 tx=0x7faad0005fd0 comp rx=0 tx=0).stop 2023-10-16T13:11:44.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.309+0000 7faae7787700 1 -- 172.21.15.92:0/828551199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faae0100a20 msgr2=0x7faae01961f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:44.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.309+0000 7faae7787700 1 --2- 172.21.15.92:0/828551199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faae0100a20 0x7faae01961f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faadc00b500 tx=0x7faadc00b8c0 comp rx=0 tx=0).stop 2023-10-16T13:11:44.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.309+0000 7faae7787700 1 -- 172.21.15.92:0/828551199 shutdown_connections 2023-10-16T13:11:44.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.309+0000 7faae7787700 1 --2- 172.21.15.92:0/828551199 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faacc0a1580 0x7faacc0a3a40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:44.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.309+0000 7faae7787700 1 --2- 172.21.15.92:0/828551199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faae01013c0 0x7faae019d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:44.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.309+0000 7faae7787700 1 --2- 172.21.15.92:0/828551199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faae0100060 0x7faae0195cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:44.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.309+0000 7faae7787700 1 --2- 172.21.15.92:0/828551199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faae0100a20 0x7faae01961f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:44.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.309+0000 7faae7787700 1 -- 172.21.15.92:0/828551199 >> 172.21.15.92:0/828551199 conn(0x7faae00faa90 msgr2=0x7faae0104550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:44.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.309+0000 7faae7787700 1 -- 172.21.15.92:0/828551199 shutdown_connections 2023-10-16T13:11:44.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.309+0000 7faae7787700 1 -- 172.21.15.92:0/828551199 wait complete. 2023-10-16T13:11:44.326 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-10-16T13:11:44.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.454+0000 7fef6ce87700 1 -- 172.21.15.92:0/3407340956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef681014e0 msgr2=0x7fef68101900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:44.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.455+0000 7fef6ce87700 1 --2- 172.21.15.92:0/3407340956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef681014e0 0x7fef68101900 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fef5c009990 tx=0x7fef5c009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:44.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.455+0000 7fef6ce87700 1 -- 172.21.15.92:0/3407340956 shutdown_connections 2023-10-16T13:11:44.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.455+0000 7fef6ce87700 1 --2- 172.21.15.92:0/3407340956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef681014e0 0x7fef68101900 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:44.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.455+0000 7fef6ce87700 1 --2- 172.21.15.92:0/3407340956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef681003b0 0x7fef68108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:44.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.455+0000 7fef6ce87700 1 --2- 172.21.15.92:0/3407340956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef680ffa10 0x7fef680ffe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:44.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.455+0000 7fef6ce87700 1 -- 172.21.15.92:0/3407340956 >> 172.21.15.92:0/3407340956 conn(0x7fef680fb330 msgr2=0x7fef680fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:44.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.455+0000 7fef6ce87700 1 -- 172.21.15.92:0/3407340956 shutdown_connections 2023-10-16T13:11:44.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.455+0000 7fef6ce87700 1 -- 172.21.15.92:0/3407340956 wait complete. 2023-10-16T13:11:44.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef6ce87700 1 Processor -- start 2023-10-16T13:11:44.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef6ce87700 1 -- start start 2023-10-16T13:11:44.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef6ce87700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef680ffa10 0x7fef68069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:44.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef6ce87700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef681003b0 0x7fef6819bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:44.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef6ce87700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef681014e0 0x7fef6819e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:44.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef6ce87700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6819e980 con 0x7fef681014e0 2023-10-16T13:11:44.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef6ce87700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6819eaf0 con 0x7fef681003b0 2023-10-16T13:11:44.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef6ce87700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6819ecb0 con 0x7fef680ffa10 2023-10-16T13:11:44.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef66d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef681014e0 0x7fef6819e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:44.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef66d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef681014e0 0x7fef6819e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35276/0 (socket says 172.21.15.92:35276) 2023-10-16T13:11:44.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef66d9d700 1 -- 172.21.15.92:0/3416041578 learned_addr learned my addr 172.21.15.92:0/3416041578 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:44.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef65d9b700 1 --2- 172.21.15.92:0/3416041578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef681003b0 0x7fef6819bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:44.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef6659c700 1 --2- 172.21.15.92:0/3416041578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef680ffa10 0x7fef68069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:44.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef66d9d700 1 -- 172.21.15.92:0/3416041578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef680ffa10 msgr2=0x7fef68069b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:44.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef66d9d700 1 --2- 172.21.15.92:0/3416041578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef680ffa10 0x7fef68069b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:44.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef66d9d700 1 -- 172.21.15.92:0/3416041578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef681003b0 msgr2=0x7fef6819bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:44.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef66d9d700 1 --2- 172.21.15.92:0/3416041578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef681003b0 0x7fef6819bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:44.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef66d9d700 1 -- 172.21.15.92:0/3416041578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c0095f0 con 0x7fef681014e0 2023-10-16T13:11:44.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef65d9b700 1 --2- 172.21.15.92:0/3416041578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef681003b0 0x7fef6819bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:11:44.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.456+0000 7fef66d9d700 1 --2- 172.21.15.92:0/3416041578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef681014e0 0x7fef6819e1b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fef6000ada0 tx=0x7fef6000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:44.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.457+0000 7fef577fe700 1 -- 172.21.15.92:0/3416041578 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6000f070 con 0x7fef681014e0 2023-10-16T13:11:44.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.457+0000 7fef577fe700 1 -- 172.21.15.92:0/3416041578 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fef60007b30 con 0x7fef681014e0 2023-10-16T13:11:44.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.457+0000 7fef6ce87700 1 -- 172.21.15.92:0/3416041578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6819ef90 con 0x7fef681014e0 2023-10-16T13:11:44.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.457+0000 7fef577fe700 1 -- 172.21.15.92:0/3416041578 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef600053c0 con 0x7fef681014e0 2023-10-16T13:11:44.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.457+0000 7fef6ce87700 1 -- 172.21.15.92:0/3416041578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6819f410 con 0x7fef681014e0 2023-10-16T13:11:44.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.458+0000 7fef6ce87700 1 -- 172.21.15.92:0/3416041578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6810b880 con 0x7fef681014e0 2023-10-16T13:11:44.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.459+0000 7fef577fe700 1 -- 172.21.15.92:0/3416041578 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fef6000c980 con 0x7fef681014e0 2023-10-16T13:11:44.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.459+0000 7fef577fe700 1 --2- 172.21.15.92:0/3416041578 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fef500a1480 0x7fef500a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:44.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.459+0000 7fef6659c700 1 --2- 172.21.15.92:0/3416041578 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fef500a1480 0x7fef500a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:44.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.459+0000 7fef577fe700 1 -- 172.21.15.92:0/3416041578 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fef600cc6f0 con 0x7fef681014e0 2023-10-16T13:11:44.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.460+0000 7fef6659c700 1 --2- 172.21.15.92:0/3416041578 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fef500a1480 0x7fef500a3940 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fef5c000c00 tx=0x7fef5c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:44.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.463+0000 7fef577fe700 1 -- 172.21.15.92:0/3416041578 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fef60095f10 con 0x7fef681014e0 2023-10-16T13:11:44.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:44 smithi152 ceph-mon[104423]: pgmap v257: 97 pgs: 16 creating+peering, 65 active+clean, 16 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 237 B/s wr, 5 op/s 2023-10-16T13:11:44.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:44 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/906345443' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-16T13:11:44.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:44 smithi152 ceph-mon[104423]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-16T13:11:44.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:44 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/828551199' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-16T13:11:44.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:44.699+0000 7fef6ce87700 1 -- 172.21.15.92:0/3416041578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fef68106d00 con 0x7fef681014e0 2023-10-16T13:11:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:44 smithi092 ceph-mon[99542]: pgmap v257: 97 pgs: 16 creating+peering, 65 active+clean, 16 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 237 B/s wr, 5 op/s 2023-10-16T13:11:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:44 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/906345443' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-16T13:11:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:44 smithi092 ceph-mon[99542]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-16T13:11:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:44 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/828551199' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-16T13:11:44.783 INFO:journalctl@ceph.mds.b.smithi118.stdout:Oct 16 13:11:44 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-b[141414]: 2023-10-16T13:11:44.316+0000 7fe3e1f89700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:11:44.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:44 smithi118 ceph-mon[103969]: pgmap v257: 97 pgs: 16 creating+peering, 65 active+clean, 16 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 237 B/s wr, 5 op/s 2023-10-16T13:11:44.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:44 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/906345443' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-16T13:11:44.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:44 smithi118 ceph-mon[103969]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-16T13:11:44.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:44 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/828551199' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-16T13:11:45.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.294+0000 7fef577fe700 1 -- 172.21.15.92:0/3416041578 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7fef60099530 con 0x7fef681014e0 2023-10-16T13:11:45.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.297+0000 7fef6ce87700 1 -- 172.21.15.92:0/3416041578 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fef500a1480 msgr2=0x7fef500a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:45.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.297+0000 7fef6ce87700 1 --2- 172.21.15.92:0/3416041578 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fef500a1480 0x7fef500a3940 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fef5c000c00 tx=0x7fef5c005fb0 comp rx=0 tx=0).stop 2023-10-16T13:11:45.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.297+0000 7fef6ce87700 1 -- 172.21.15.92:0/3416041578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef681014e0 msgr2=0x7fef6819e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:45.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.297+0000 7fef6ce87700 1 --2- 172.21.15.92:0/3416041578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef681014e0 0x7fef6819e1b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fef6000ada0 tx=0x7fef6000c330 comp rx=0 tx=0).stop 2023-10-16T13:11:45.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.298+0000 7fef6ce87700 1 -- 172.21.15.92:0/3416041578 shutdown_connections 2023-10-16T13:11:45.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.298+0000 7fef6ce87700 1 --2- 172.21.15.92:0/3416041578 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fef500a1480 0x7fef500a3940 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:45.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.298+0000 7fef6ce87700 1 --2- 172.21.15.92:0/3416041578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef681014e0 0x7fef6819e1b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:45.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.298+0000 7fef6ce87700 1 --2- 172.21.15.92:0/3416041578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef680ffa10 0x7fef68069b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:45.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.298+0000 7fef6ce87700 1 --2- 172.21.15.92:0/3416041578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef681003b0 0x7fef6819bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:45.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.298+0000 7fef6ce87700 1 -- 172.21.15.92:0/3416041578 >> 172.21.15.92:0/3416041578 conn(0x7fef680fb330 msgr2=0x7fef680fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:45.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.298+0000 7fef6ce87700 1 -- 172.21.15.92:0/3416041578 shutdown_connections 2023-10-16T13:11:45.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.298+0000 7fef6ce87700 1 -- 172.21.15.92:0/3416041578 wait complete. 2023-10-16T13:11:45.318 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-10-16T13:11:45.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.445+0000 7f77fd08c700 1 -- 172.21.15.92:0/1010622484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f8102090 msgr2=0x7f77f8102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:45.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.445+0000 7f77fd08c700 1 --2- 172.21.15.92:0/1010622484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f8102090 0x7f77f8102510 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009990 tx=0x7f77e8009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:45.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.445+0000 7f77fd08c700 1 -- 172.21.15.92:0/1010622484 shutdown_connections 2023-10-16T13:11:45.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.445+0000 7f77fd08c700 1 --2- 172.21.15.92:0/1010622484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77f8102a50 0x7f77f8109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:45.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.445+0000 7f77fd08c700 1 --2- 172.21.15.92:0/1010622484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f8100eb0 0x7f77f81012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:45.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.445+0000 7f77fd08c700 1 --2- 172.21.15.92:0/1010622484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f8102090 0x7f77f8102510 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:45.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.445+0000 7f77fd08c700 1 -- 172.21.15.92:0/1010622484 >> 172.21.15.92:0/1010622484 conn(0x7f77f80fc430 msgr2=0x7f77f80fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:45.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.445+0000 7f77fd08c700 1 -- 172.21.15.92:0/1010622484 shutdown_connections 2023-10-16T13:11:45.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.445+0000 7f77fd08c700 1 -- 172.21.15.92:0/1010622484 wait complete. 2023-10-16T13:11:45.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.446+0000 7f77fd08c700 1 Processor -- start 2023-10-16T13:11:45.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.446+0000 7f77fd08c700 1 -- start start 2023-10-16T13:11:45.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.446+0000 7f77fd08c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77f8100eb0 0x7f77f8196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:45.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.446+0000 7f77fd08c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f8102090 0x7f77f8197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:45.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.446+0000 7f77fd08c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f8102a50 0x7f77f819e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:45.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.446+0000 7f77fd08c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f819e870 con 0x7f77f8102090 2023-10-16T13:11:45.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.446+0000 7f77fd08c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f819e9e0 con 0x7f77f8100eb0 2023-10-16T13:11:45.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.446+0000 7f77fd08c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f819eba0 con 0x7f77f8102a50 2023-10-16T13:11:45.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.446+0000 7f77f659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f8102090 0x7f77f8197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:45.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.446+0000 7f77f659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f8102090 0x7f77f8197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35288/0 (socket says 172.21.15.92:35288) 2023-10-16T13:11:45.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.446+0000 7f77f659c700 1 -- 172.21.15.92:0/229207127 learned_addr learned my addr 172.21.15.92:0/229207127 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:45.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.447+0000 7f77f6d9d700 1 --2- 172.21.15.92:0/229207127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77f8100eb0 0x7f77f8196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:45.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.447+0000 7f77f759e700 1 --2- 172.21.15.92:0/229207127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f8102a50 0x7f77f819e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:45.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.447+0000 7f77f659c700 1 -- 172.21.15.92:0/229207127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f8102a50 msgr2=0x7f77f819e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:45.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.447+0000 7f77f659c700 1 --2- 172.21.15.92:0/229207127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f8102a50 0x7f77f819e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:45.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.447+0000 7f77f659c700 1 -- 172.21.15.92:0/229207127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77f8100eb0 msgr2=0x7f77f8196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:45.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.447+0000 7f77f659c700 1 --2- 172.21.15.92:0/229207127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77f8100eb0 0x7f77f8196d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:45.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.447+0000 7f77f659c700 1 -- 172.21.15.92:0/229207127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e80095f0 con 0x7f77f8102090 2023-10-16T13:11:45.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.447+0000 7f77f659c700 1 --2- 172.21.15.92:0/229207127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f8102090 0x7f77f8197270 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f77e8004800 tx=0x7f77e8009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:45.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.447+0000 7f77dffff700 1 -- 172.21.15.92:0/229207127 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e801d070 con 0x7f77f8102090 2023-10-16T13:11:45.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.447+0000 7f77fd08c700 1 -- 172.21.15.92:0/229207127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f819ee20 con 0x7f77f8102090 2023-10-16T13:11:45.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.447+0000 7f77fd08c700 1 -- 172.21.15.92:0/229207127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f819f190 con 0x7f77f8102090 2023-10-16T13:11:45.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.447+0000 7f77dffff700 1 -- 172.21.15.92:0/229207127 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f77e800bed0 con 0x7f77f8102090 2023-10-16T13:11:45.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.447+0000 7f77dffff700 1 -- 172.21.15.92:0/229207127 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e8017770 con 0x7f77f8102090 2023-10-16T13:11:45.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.448+0000 7f77fd08c700 1 -- 172.21.15.92:0/229207127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e4005310 con 0x7f77f8102090 2023-10-16T13:11:45.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.449+0000 7f77dffff700 1 -- 172.21.15.92:0/229207127 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f77e8021a80 con 0x7f77f8102090 2023-10-16T13:11:45.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.449+0000 7f77dffff700 1 --2- 172.21.15.92:0/229207127 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77e00a1480 0x7f77e00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:45.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.450+0000 7f77dffff700 1 -- 172.21.15.92:0/229207127 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f77e80ce6e0 con 0x7f77f8102090 2023-10-16T13:11:45.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.450+0000 7f77f6d9d700 1 --2- 172.21.15.92:0/229207127 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77e00a1480 0x7f77e00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:45.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.450+0000 7f77f6d9d700 1 --2- 172.21.15.92:0/229207127 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77e00a1480 0x7f77e00a3940 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f77f8198200 tx=0x7f77ec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:45.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.453+0000 7f77dffff700 1 -- 172.21.15.92:0/229207127 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f77e8097e80 con 0x7f77f8102090 2023-10-16T13:11:45.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:45 smithi152 ceph-mon[104423]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-16T13:11:45.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:45 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/828551199' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-16T13:11:45.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:45 smithi152 ceph-mon[104423]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-16T13:11:45.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:45 smithi152 ceph-mon[104423]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-16T13:11:45.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:45 smithi152 ceph-mon[104423]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-10-16T13:11:45.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:45 smithi152 ceph-mon[104423]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-10-16T13:11:45.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:45 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3416041578' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-16T13:11:45.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:45 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3416041578' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-16T13:11:45.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:45 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] up:active 2023-10-16T13:11:45.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:45 smithi152 ceph-mon[104423]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-16T13:11:45.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:45 smithi152 ceph-mon[104423]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2023-10-16T13:11:45.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:45 smithi152 ceph-mon[104423]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2023-10-16T13:11:45.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:45.694+0000 7f77fd08c700 1 -- 172.21.15.92:0/229207127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f77e4005930 con 0x7f77f8102090 2023-10-16T13:11:45.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:45 smithi092 ceph-mon[99542]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-16T13:11:45.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:45 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/828551199' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-16T13:11:45.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:45 smithi092 ceph-mon[99542]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-16T13:11:45.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:45 smithi092 ceph-mon[99542]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-16T13:11:45.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:45 smithi092 ceph-mon[99542]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-10-16T13:11:45.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:45 smithi092 ceph-mon[99542]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-10-16T13:11:45.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:45 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3416041578' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-16T13:11:45.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:45 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3416041578' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-16T13:11:45.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:45 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] up:active 2023-10-16T13:11:45.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:45 smithi092 ceph-mon[99542]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-16T13:11:45.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:45 smithi092 ceph-mon[99542]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2023-10-16T13:11:45.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:45 smithi092 ceph-mon[99542]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2023-10-16T13:11:45.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:45 smithi118 ceph-mon[103969]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-16T13:11:45.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:45 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/828551199' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-16T13:11:45.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:45 smithi118 ceph-mon[103969]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-16T13:11:45.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:45 smithi118 ceph-mon[103969]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-16T13:11:45.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:45 smithi118 ceph-mon[103969]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-10-16T13:11:45.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:45 smithi118 ceph-mon[103969]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-10-16T13:11:45.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:45 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3416041578' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-16T13:11:45.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:45 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3416041578' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-16T13:11:45.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:45 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] up:active 2023-10-16T13:11:45.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:45 smithi118 ceph-mon[103969]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-16T13:11:45.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:45 smithi118 ceph-mon[103969]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2023-10-16T13:11:45.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:45 smithi118 ceph-mon[103969]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2023-10-16T13:11:46.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.319+0000 7f77dffff700 1 -- 172.21.15.92:0/229207127 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7f77e809b4a0 con 0x7f77f8102090 2023-10-16T13:11:46.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.323+0000 7f77fd08c700 1 -- 172.21.15.92:0/229207127 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77e00a1480 msgr2=0x7f77e00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:46.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.323+0000 7f77fd08c700 1 --2- 172.21.15.92:0/229207127 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77e00a1480 0x7f77e00a3940 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f77f8198200 tx=0x7f77ec009260 comp rx=0 tx=0).stop 2023-10-16T13:11:46.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.323+0000 7f77fd08c700 1 -- 172.21.15.92:0/229207127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f8102090 msgr2=0x7f77f8197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:46.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.323+0000 7f77fd08c700 1 --2- 172.21.15.92:0/229207127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f8102090 0x7f77f8197270 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f77e8004800 tx=0x7f77e8009580 comp rx=0 tx=0).stop 2023-10-16T13:11:46.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.323+0000 7f77fd08c700 1 -- 172.21.15.92:0/229207127 shutdown_connections 2023-10-16T13:11:46.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.323+0000 7f77fd08c700 1 --2- 172.21.15.92:0/229207127 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77e00a1480 0x7f77e00a3940 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.323+0000 7f77fd08c700 1 --2- 172.21.15.92:0/229207127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f8102a50 0x7f77f819e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.323+0000 7f77fd08c700 1 --2- 172.21.15.92:0/229207127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77f8100eb0 0x7f77f8196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.323+0000 7f77fd08c700 1 --2- 172.21.15.92:0/229207127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f8102090 0x7f77f8197270 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.323+0000 7f77fd08c700 1 -- 172.21.15.92:0/229207127 >> 172.21.15.92:0/229207127 conn(0x7f77f80fc430 msgr2=0x7f77f80fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:46.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.324+0000 7f77fd08c700 1 -- 172.21.15.92:0/229207127 shutdown_connections 2023-10-16T13:11:46.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.324+0000 7f77fd08c700 1 -- 172.21.15.92:0/229207127 wait complete. 2023-10-16T13:11:46.343 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2023-10-16T13:11:46.343 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-10-16T13:11:46.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.468+0000 7f4bec864700 1 -- 172.21.15.92:0/3965648494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be8101990 msgr2=0x7f4be8108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:46.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.468+0000 7f4bec864700 1 --2- 172.21.15.92:0/3965648494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be8101990 0x7f4be8108240 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4be000b0d0 tx=0x7f4be000b3e0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.468+0000 7f4bec864700 1 -- 172.21.15.92:0/3965648494 shutdown_connections 2023-10-16T13:11:46.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.468+0000 7f4bec864700 1 --2- 172.21.15.92:0/3965648494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be8101990 0x7f4be8108240 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.468+0000 7f4bec864700 1 --2- 172.21.15.92:0/3965648494 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4be80ffe00 0x7f4be8100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.468+0000 7f4bec864700 1 --2- 172.21.15.92:0/3965648494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4be8100ff0 0x7f4be8101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.468+0000 7f4bec864700 1 -- 172.21.15.92:0/3965648494 >> 172.21.15.92:0/3965648494 conn(0x7f4be80fb370 msgr2=0x7f4be80fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:46.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.468+0000 7f4bec864700 1 -- 172.21.15.92:0/3965648494 shutdown_connections 2023-10-16T13:11:46.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.468+0000 7f4bec864700 1 -- 172.21.15.92:0/3965648494 wait complete. 2023-10-16T13:11:46.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.469+0000 7f4bec864700 1 Processor -- start 2023-10-16T13:11:46.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.469+0000 7f4bec864700 1 -- start start 2023-10-16T13:11:46.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.469+0000 7f4bec864700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4be80ffe00 0x7f4be8103d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:46.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.469+0000 7f4bec864700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4be8100ff0 0x7f4be81023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:46.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.469+0000 7f4bec864700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be8101990 0x7f4be8102910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:46.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.469+0000 7f4bec864700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be81030b0 con 0x7f4be8101990 2023-10-16T13:11:46.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.469+0000 7f4bec864700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be8103220 con 0x7f4be80ffe00 2023-10-16T13:11:46.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.469+0000 7f4bec864700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be81a1040 con 0x7f4be8100ff0 2023-10-16T13:11:46.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.469+0000 7f4be6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be8101990 0x7f4be8102910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:46.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.469+0000 7f4be6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be8101990 0x7f4be8102910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35304/0 (socket says 172.21.15.92:35304) 2023-10-16T13:11:46.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.469+0000 7f4be6d9d700 1 -- 172.21.15.92:0/2096536146 learned_addr learned my addr 172.21.15.92:0/2096536146 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:46.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.469+0000 7f4be659c700 1 --2- 172.21.15.92:0/2096536146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4be80ffe00 0x7f4be8103d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:46.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.469+0000 7f4be5d9b700 1 --2- 172.21.15.92:0/2096536146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4be8100ff0 0x7f4be81023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:46.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.469+0000 7f4be6d9d700 1 -- 172.21.15.92:0/2096536146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4be8100ff0 msgr2=0x7f4be81023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:46.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.469+0000 7f4be6d9d700 1 --2- 172.21.15.92:0/2096536146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4be8100ff0 0x7f4be81023d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.469+0000 7f4be6d9d700 1 -- 172.21.15.92:0/2096536146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4be80ffe00 msgr2=0x7f4be8103d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:46.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.469+0000 7f4be6d9d700 1 --2- 172.21.15.92:0/2096536146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4be80ffe00 0x7f4be8103d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.469+0000 7f4be6d9d700 1 -- 172.21.15.92:0/2096536146 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be0009d00 con 0x7f4be8101990 2023-10-16T13:11:46.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.470+0000 7f4be6d9d700 1 --2- 172.21.15.92:0/2096536146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be8101990 0x7f4be8102910 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4be0006070 tx=0x7f4be00079e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:46.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.470+0000 7f4bd77fe700 1 -- 172.21.15.92:0/2096536146 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be000e040 con 0x7f4be8101990 2023-10-16T13:11:46.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.470+0000 7f4bd77fe700 1 -- 172.21.15.92:0/2096536146 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4be00092d0 con 0x7f4be8101990 2023-10-16T13:11:46.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.470+0000 7f4bec864700 1 -- 172.21.15.92:0/2096536146 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be81a12c0 con 0x7f4be8101990 2023-10-16T13:11:46.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.470+0000 7f4bd77fe700 1 -- 172.21.15.92:0/2096536146 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be001b690 con 0x7f4be8101990 2023-10-16T13:11:46.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.470+0000 7f4bec864700 1 -- 172.21.15.92:0/2096536146 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be81a1810 con 0x7f4be8101990 2023-10-16T13:11:46.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.471+0000 7f4bec864700 1 -- 172.21.15.92:0/2096536146 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be810b8c0 con 0x7f4be8101990 2023-10-16T13:11:46.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.472+0000 7f4bd77fe700 1 -- 172.21.15.92:0/2096536146 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4be001b7f0 con 0x7f4be8101990 2023-10-16T13:11:46.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.473+0000 7f4bd77fe700 1 --2- 172.21.15.92:0/2096536146 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4bd00a1500 0x7f4bd00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:46.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.473+0000 7f4be659c700 1 --2- 172.21.15.92:0/2096536146 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4bd00a1500 0x7f4bd00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:46.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.473+0000 7f4bd77fe700 1 -- 172.21.15.92:0/2096536146 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4be00ce770 con 0x7f4be8101990 2023-10-16T13:11:46.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.473+0000 7f4be659c700 1 --2- 172.21.15.92:0/2096536146 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4bd00a1500 0x7f4bd00a39c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc006fd0 tx=0x7f4bdc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:46.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.476+0000 7f4bd77fe700 1 -- 172.21.15.92:0/2096536146 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4be0097f10 con 0x7f4be8101990 2023-10-16T13:11:46.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:46 smithi152 ceph-mon[104423]: pgmap v258: 97 pgs: 10 creating+peering, 87 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2023-10-16T13:11:46.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:46 smithi152 ceph-mon[104423]: daemon mds.f is now active in filesystem cephfs as rank 2 2023-10-16T13:11:46.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:46 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/229207127' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-16T13:11:46.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.698+0000 7f4bec864700 1 -- 172.21.15.92:0/2096536146 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f4be8069980 con 0x7f4bd00a1500 2023-10-16T13:11:46.707 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:46 smithi092 ceph-mon[99542]: pgmap v258: 97 pgs: 10 creating+peering, 87 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2023-10-16T13:11:46.707 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:46 smithi092 ceph-mon[99542]: daemon mds.f is now active in filesystem cephfs as rank 2 2023-10-16T13:11:46.707 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:46 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/229207127' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-16T13:11:46.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.745+0000 7f4bd77fe700 1 -- 172.21.15.92:0/2096536146 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4be8069980 con 0x7f4bd00a1500 2023-10-16T13:11:46.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.748+0000 7f4bec864700 1 -- 172.21.15.92:0/2096536146 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4bd00a1500 msgr2=0x7f4bd00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:46.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.748+0000 7f4bec864700 1 --2- 172.21.15.92:0/2096536146 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4bd00a1500 0x7f4bd00a39c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc006fd0 tx=0x7f4bdc008040 comp rx=0 tx=0).stop 2023-10-16T13:11:46.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.748+0000 7f4bec864700 1 -- 172.21.15.92:0/2096536146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be8101990 msgr2=0x7f4be8102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:46.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.748+0000 7f4bec864700 1 --2- 172.21.15.92:0/2096536146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be8101990 0x7f4be8102910 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4be0006070 tx=0x7f4be00079e0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.748+0000 7f4bec864700 1 -- 172.21.15.92:0/2096536146 shutdown_connections 2023-10-16T13:11:46.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.748+0000 7f4bec864700 1 --2- 172.21.15.92:0/2096536146 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4bd00a1500 0x7f4bd00a39c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.748+0000 7f4bec864700 1 --2- 172.21.15.92:0/2096536146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be8101990 0x7f4be8102910 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.748+0000 7f4bec864700 1 --2- 172.21.15.92:0/2096536146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4be80ffe00 0x7f4be8103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.748+0000 7f4bec864700 1 --2- 172.21.15.92:0/2096536146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4be8100ff0 0x7f4be81023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.748+0000 7f4bec864700 1 -- 172.21.15.92:0/2096536146 >> 172.21.15.92:0/2096536146 conn(0x7f4be80fb370 msgr2=0x7f4be8069270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:46.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.748+0000 7f4bec864700 1 -- 172.21.15.92:0/2096536146 shutdown_connections 2023-10-16T13:11:46.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.748+0000 7f4bec864700 1 -- 172.21.15.92:0/2096536146 wait complete. 2023-10-16T13:11:46.762 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-10-16T13:11:46.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:46 smithi118 ceph-mon[103969]: pgmap v258: 97 pgs: 10 creating+peering, 87 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2023-10-16T13:11:46.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:46 smithi118 ceph-mon[103969]: daemon mds.f is now active in filesystem cephfs as rank 2 2023-10-16T13:11:46.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:46 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/229207127' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-16T13:11:46.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.885+0000 7ff355f16700 1 -- 172.21.15.92:0/4238524572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff350100980 msgr2=0x7ff350108220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:46.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.885+0000 7ff355f16700 1 --2- 172.21.15.92:0/4238524572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff350100980 0x7ff350108220 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff34800b0a0 tx=0x7ff34800b3b0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.885+0000 7ff355f16700 1 -- 172.21.15.92:0/4238524572 shutdown_connections 2023-10-16T13:11:46.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.885+0000 7ff355f16700 1 --2- 172.21.15.92:0/4238524572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff350100980 0x7ff350108220 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.885+0000 7ff355f16700 1 --2- 172.21.15.92:0/4238524572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff350101370 0x7ff350101790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.885+0000 7ff355f16700 1 --2- 172.21.15.92:0/4238524572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3500fffc0 0x7ff350100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.885+0000 7ff355f16700 1 -- 172.21.15.92:0/4238524572 >> 172.21.15.92:0/4238524572 conn(0x7ff3500faa90 msgr2=0x7ff3500fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:46.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.885+0000 7ff355f16700 1 -- 172.21.15.92:0/4238524572 shutdown_connections 2023-10-16T13:11:46.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.885+0000 7ff355f16700 1 -- 172.21.15.92:0/4238524572 wait complete. 2023-10-16T13:11:46.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.886+0000 7ff355f16700 1 Processor -- start 2023-10-16T13:11:46.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.886+0000 7ff355f16700 1 -- start start 2023-10-16T13:11:46.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.886+0000 7ff355f16700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3500fffc0 0x7ff3500ffa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:46.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.886+0000 7ff355f16700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff350100980 0x7ff35019ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:46.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.886+0000 7ff355f16700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff350101370 0x7ff35019e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:46.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.886+0000 7ff355f16700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35019e870 con 0x7ff350101370 2023-10-16T13:11:46.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.886+0000 7ff355f16700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35019e9e0 con 0x7ff350100980 2023-10-16T13:11:46.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.886+0000 7ff355f16700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35019eba0 con 0x7ff3500fffc0 2023-10-16T13:11:46.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.886+0000 7ff34ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff350101370 0x7ff35019e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:46.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.886+0000 7ff34ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff350101370 0x7ff35019e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35338/0 (socket says 172.21.15.92:35338) 2023-10-16T13:11:46.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.886+0000 7ff34ffff700 1 -- 172.21.15.92:0/1220604059 learned_addr learned my addr 172.21.15.92:0/1220604059 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:46.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.886+0000 7ff34f7fe700 1 --2- 172.21.15.92:0/1220604059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3500fffc0 0x7ff3500ffa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:46.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.886+0000 7ff34ffff700 1 -- 172.21.15.92:0/1220604059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3500fffc0 msgr2=0x7ff3500ffa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:46.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.886+0000 7ff34ffff700 1 --2- 172.21.15.92:0/1220604059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3500fffc0 0x7ff3500ffa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.886+0000 7ff34ffff700 1 -- 172.21.15.92:0/1220604059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff350100980 msgr2=0x7ff35019ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:46.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.886+0000 7ff34ffff700 1 --2- 172.21.15.92:0/1220604059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff350100980 0x7ff35019ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:46.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.886+0000 7ff34ffff700 1 -- 172.21.15.92:0/1220604059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff348009d00 con 0x7ff350101370 2023-10-16T13:11:46.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.887+0000 7ff34ffff700 1 --2- 172.21.15.92:0/1220604059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff350101370 0x7ff35019e0d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff348004ce0 tx=0x7ff348004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:46.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.887+0000 7ff34cff9700 1 -- 172.21.15.92:0/1220604059 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34800e040 con 0x7ff350101370 2023-10-16T13:11:46.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.887+0000 7ff34cff9700 1 -- 172.21.15.92:0/1220604059 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff348009440 con 0x7ff350101370 2023-10-16T13:11:46.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.887+0000 7ff34cff9700 1 -- 172.21.15.92:0/1220604059 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34801ba50 con 0x7ff350101370 2023-10-16T13:11:46.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.887+0000 7ff355f16700 1 -- 172.21.15.92:0/1220604059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35019ee20 con 0x7ff350101370 2023-10-16T13:11:46.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.887+0000 7ff355f16700 1 -- 172.21.15.92:0/1220604059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35019f240 con 0x7ff350101370 2023-10-16T13:11:46.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.888+0000 7ff355f16700 1 -- 172.21.15.92:0/1220604059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff350106c70 con 0x7ff350101370 2023-10-16T13:11:46.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.889+0000 7ff34cff9700 1 -- 172.21.15.92:0/1220604059 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff34801bbb0 con 0x7ff350101370 2023-10-16T13:11:46.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.890+0000 7ff34cff9700 1 --2- 172.21.15.92:0/1220604059 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff3380a1500 0x7ff3380a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:46.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.890+0000 7ff34f7fe700 1 --2- 172.21.15.92:0/1220604059 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff3380a1500 0x7ff3380a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:46.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.890+0000 7ff34cff9700 1 -- 172.21.15.92:0/1220604059 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff3480cee60 con 0x7ff350101370 2023-10-16T13:11:46.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.890+0000 7ff34f7fe700 1 --2- 172.21.15.92:0/1220604059 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff3380a1500 0x7ff3380a39c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff344005950 tx=0x7ff34400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:46.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:46.894+0000 7ff34cff9700 1 -- 172.21.15.92:0/1220604059 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff348098720 con 0x7ff350101370 2023-10-16T13:11:46.997 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:11:46 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:11:46.703+0000 7f299f0e5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:11:46.997 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:11:46 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:11:46.703+0000 7f299f0e5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:11:46.997 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:11:46 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:11:46.703+0000 7f299f0e5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:11:46.998 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:11:46 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:11:46.703+0000 7f299f0e5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:11:46.998 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:11:46 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:11:46.703+0000 7f299f0e5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:11:47.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.119+0000 7ff355f16700 1 -- 172.21.15.92:0/1220604059 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7ff35010b6f0 con 0x7ff3380a1500 2023-10-16T13:11:47.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.124+0000 7ff34cff9700 1 -- 172.21.15.92:0/1220604059 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7ff35010b6f0 con 0x7ff3380a1500 2023-10-16T13:11:47.127 INFO:teuthology.orchestra.run.smithi092.stdout:/volumes/_nogroup/sv_0/a556245e-a885-46b6-85ec-030e655ce428 2023-10-16T13:11:47.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.126+0000 7ff355f16700 1 -- 172.21.15.92:0/1220604059 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff3380a1500 msgr2=0x7ff3380a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:47.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.126+0000 7ff355f16700 1 --2- 172.21.15.92:0/1220604059 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff3380a1500 0x7ff3380a39c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff344005950 tx=0x7ff34400a300 comp rx=0 tx=0).stop 2023-10-16T13:11:47.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.126+0000 7ff355f16700 1 -- 172.21.15.92:0/1220604059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff350101370 msgr2=0x7ff35019e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:47.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.126+0000 7ff355f16700 1 --2- 172.21.15.92:0/1220604059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff350101370 0x7ff35019e0d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff348004ce0 tx=0x7ff348004d10 comp rx=0 tx=0).stop 2023-10-16T13:11:47.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.126+0000 7ff355f16700 1 -- 172.21.15.92:0/1220604059 shutdown_connections 2023-10-16T13:11:47.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.126+0000 7ff355f16700 1 --2- 172.21.15.92:0/1220604059 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff3380a1500 0x7ff3380a39c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.126+0000 7ff355f16700 1 --2- 172.21.15.92:0/1220604059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff350101370 0x7ff35019e0d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.126+0000 7ff355f16700 1 --2- 172.21.15.92:0/1220604059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3500fffc0 0x7ff3500ffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.126+0000 7ff355f16700 1 --2- 172.21.15.92:0/1220604059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff350100980 0x7ff35019ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.126+0000 7ff355f16700 1 -- 172.21.15.92:0/1220604059 >> 172.21.15.92:0/1220604059 conn(0x7ff3500faa90 msgr2=0x7ff3500fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:47.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.126+0000 7ff355f16700 1 -- 172.21.15.92:0/1220604059 shutdown_connections 2023-10-16T13:11:47.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.126+0000 7ff355f16700 1 -- 172.21.15.92:0/1220604059 wait complete. 2023-10-16T13:11:47.141 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-10-16T13:11:47.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.264+0000 7f1a3bb3a700 1 -- 172.21.15.92:0/3917458396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a34101990 msgr2=0x7f1a34103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:47.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.264+0000 7f1a3bb3a700 1 --2- 172.21.15.92:0/3917458396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a34101990 0x7f1a34103d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1a24009990 tx=0x7f1a24009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.264+0000 7f1a3bb3a700 1 -- 172.21.15.92:0/3917458396 shutdown_connections 2023-10-16T13:11:47.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.264+0000 7f1a3bb3a700 1 --2- 172.21.15.92:0/3917458396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a34101990 0x7f1a34103d80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.264+0000 7f1a3bb3a700 1 --2- 172.21.15.92:0/3917458396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a34106bf0 0x7f1a34109000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.264+0000 7f1a3bb3a700 1 --2- 172.21.15.92:0/3917458396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a341042c0 0x7f1a341066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.264+0000 7f1a3bb3a700 1 -- 172.21.15.92:0/3917458396 >> 172.21.15.92:0/3917458396 conn(0x7f1a340fb320 msgr2=0x7f1a340fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:47.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.264+0000 7f1a3bb3a700 1 -- 172.21.15.92:0/3917458396 shutdown_connections 2023-10-16T13:11:47.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.264+0000 7f1a3bb3a700 1 -- 172.21.15.92:0/3917458396 wait complete. 2023-10-16T13:11:47.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.264+0000 7f1a3bb3a700 1 Processor -- start 2023-10-16T13:11:47.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.265+0000 7f1a3bb3a700 1 -- start start 2023-10-16T13:11:47.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.265+0000 7f1a3bb3a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a34101990 0x7f1a34196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:47.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.265+0000 7f1a3bb3a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a341042c0 0x7f1a341971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:47.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.265+0000 7f1a3bb3a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a34106bf0 0x7f1a3419e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:47.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.265+0000 7f1a3bb3a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3419e7f0 con 0x7f1a34106bf0 2023-10-16T13:11:47.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.265+0000 7f1a3bb3a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3419e960 con 0x7f1a34101990 2023-10-16T13:11:47.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.265+0000 7f1a3bb3a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3419eb20 con 0x7f1a341042c0 2023-10-16T13:11:47.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.265+0000 7f1a3a0d7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a34106bf0 0x7f1a3419e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:47.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.265+0000 7f1a3a0d7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a34106bf0 0x7f1a3419e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35352/0 (socket says 172.21.15.92:35352) 2023-10-16T13:11:47.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.265+0000 7f1a3a0d7700 1 -- 172.21.15.92:0/3162806995 learned_addr learned my addr 172.21.15.92:0/3162806995 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:47.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.265+0000 7f1a398d6700 1 --2- 172.21.15.92:0/3162806995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a34101990 0x7f1a34196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:47.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.265+0000 7f1a390d5700 1 --2- 172.21.15.92:0/3162806995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a341042c0 0x7f1a341971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:47.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.265+0000 7f1a3a0d7700 1 -- 172.21.15.92:0/3162806995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a341042c0 msgr2=0x7f1a341971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:47.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.265+0000 7f1a3a0d7700 1 --2- 172.21.15.92:0/3162806995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a341042c0 0x7f1a341971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.265+0000 7f1a3a0d7700 1 -- 172.21.15.92:0/3162806995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a34101990 msgr2=0x7f1a34196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:47.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.265+0000 7f1a3a0d7700 1 --2- 172.21.15.92:0/3162806995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a34101990 0x7f1a34196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.265+0000 7f1a3a0d7700 1 -- 172.21.15.92:0/3162806995 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a240095f0 con 0x7f1a34106bf0 2023-10-16T13:11:47.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.265+0000 7f1a3a0d7700 1 --2- 172.21.15.92:0/3162806995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a34106bf0 0x7f1a3419e220 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00ada0 tx=0x7f1a2c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:47.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.266+0000 7f1a2affd700 1 -- 172.21.15.92:0/3162806995 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c00f070 con 0x7f1a34106bf0 2023-10-16T13:11:47.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.266+0000 7f1a3bb3a700 1 -- 172.21.15.92:0/3162806995 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a3419ee00 con 0x7f1a34106bf0 2023-10-16T13:11:47.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.266+0000 7f1a2affd700 1 -- 172.21.15.92:0/3162806995 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1a2c007b30 con 0x7f1a34106bf0 2023-10-16T13:11:47.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.266+0000 7f1a2affd700 1 -- 172.21.15.92:0/3162806995 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c0053e0 con 0x7f1a34106bf0 2023-10-16T13:11:47.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.266+0000 7f1a3bb3a700 1 -- 172.21.15.92:0/3162806995 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a3419f230 con 0x7f1a34106bf0 2023-10-16T13:11:47.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.267+0000 7f1a3bb3a700 1 -- 172.21.15.92:0/3162806995 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a340fcea0 con 0x7f1a34106bf0 2023-10-16T13:11:47.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.267+0000 7f1a2affd700 1 -- 172.21.15.92:0/3162806995 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f1a2c005540 con 0x7f1a34106bf0 2023-10-16T13:11:47.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.268+0000 7f1a2affd700 1 --2- 172.21.15.92:0/3162806995 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1a200a1480 0x7f1a200a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:47.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.268+0000 7f1a398d6700 1 --2- 172.21.15.92:0/3162806995 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1a200a1480 0x7f1a200a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:47.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.268+0000 7f1a2affd700 1 -- 172.21.15.92:0/3162806995 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1a2c0cc0f0 con 0x7f1a34106bf0 2023-10-16T13:11:47.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.268+0000 7f1a398d6700 1 --2- 172.21.15.92:0/3162806995 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1a200a1480 0x7f1a200a3940 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1a24000c00 tx=0x7f1a24005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:47.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.272+0000 7f1a2affd700 1 -- 172.21.15.92:0/3162806995 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1a2c095930 con 0x7f1a34106bf0 2023-10-16T13:11:47.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.340+0000 7f1a2affd700 1 -- 172.21.15.92:0/3162806995 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f1a2c095d00 con 0x7f1a34106bf0 2023-10-16T13:11:47.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:47 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/229207127' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-16T13:11:47.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:47 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] up:active 2023-10-16T13:11:47.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:47 smithi092 ceph-mon[99542]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-16T13:11:47.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:47 smithi092 ceph-mon[99542]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2023-10-16T13:11:47.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:47 smithi092 ceph-mon[99542]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2023-10-16T13:11:47.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:47 smithi092 ceph-mon[99542]: daemon mds.e is now active in filesystem cephfs as rank 3 2023-10-16T13:11:47.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.505+0000 7f1a3bb3a700 1 -- 172.21.15.92:0/3162806995 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a3402d2c0 con 0x7f1a200a1480 2023-10-16T13:11:47.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.529+0000 7f1a2affd700 1 -- 172.21.15.92:0/3162806995 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1a3402d2c0 con 0x7f1a200a1480 2023-10-16T13:11:47.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.531+0000 7f1a3bb3a700 1 -- 172.21.15.92:0/3162806995 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1a200a1480 msgr2=0x7f1a200a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:47.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.531+0000 7f1a3bb3a700 1 --2- 172.21.15.92:0/3162806995 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1a200a1480 0x7f1a200a3940 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1a24000c00 tx=0x7f1a24005fb0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.531+0000 7f1a3bb3a700 1 -- 172.21.15.92:0/3162806995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a34106bf0 msgr2=0x7f1a3419e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:47.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.531+0000 7f1a3bb3a700 1 --2- 172.21.15.92:0/3162806995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a34106bf0 0x7f1a3419e220 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00ada0 tx=0x7f1a2c00c330 comp rx=0 tx=0).stop 2023-10-16T13:11:47.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.532+0000 7f1a3bb3a700 1 -- 172.21.15.92:0/3162806995 shutdown_connections 2023-10-16T13:11:47.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.532+0000 7f1a3bb3a700 1 --2- 172.21.15.92:0/3162806995 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1a200a1480 0x7f1a200a3940 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.532+0000 7f1a3bb3a700 1 --2- 172.21.15.92:0/3162806995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a34106bf0 0x7f1a3419e220 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.532+0000 7f1a3bb3a700 1 --2- 172.21.15.92:0/3162806995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a34101990 0x7f1a34196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.532+0000 7f1a3bb3a700 1 --2- 172.21.15.92:0/3162806995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a341042c0 0x7f1a341971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.532+0000 7f1a3bb3a700 1 -- 172.21.15.92:0/3162806995 >> 172.21.15.92:0/3162806995 conn(0x7f1a340fb320 msgr2=0x7f1a341026a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:47.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.532+0000 7f1a3bb3a700 1 -- 172.21.15.92:0/3162806995 shutdown_connections 2023-10-16T13:11:47.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.532+0000 7f1a3bb3a700 1 -- 172.21.15.92:0/3162806995 wait complete. 2023-10-16T13:11:47.546 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-10-16T13:11:47.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.668+0000 7f1f41e61700 1 -- 172.21.15.92:0/1666791822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f3c101920 msgr2=0x7f1f3c108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:47.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.668+0000 7f1f41e61700 1 --2- 172.21.15.92:0/1666791822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f3c101920 0x7f1f3c108240 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400b0a0 tx=0x7f1f3400b3b0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.668+0000 7f1f41e61700 1 -- 172.21.15.92:0/1666791822 shutdown_connections 2023-10-16T13:11:47.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.668+0000 7f1f41e61700 1 --2- 172.21.15.92:0/1666791822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f3c101920 0x7f1f3c108240 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.668+0000 7f1f41e61700 1 --2- 172.21.15.92:0/1666791822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f3c0ffe10 0x7f1f3c100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.668+0000 7f1f41e61700 1 --2- 172.21.15.92:0/1666791822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f3c100f60 0x7f1f3c1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.668+0000 7f1f41e61700 1 -- 172.21.15.92:0/1666791822 >> 172.21.15.92:0/1666791822 conn(0x7f1f3c0fb380 msgr2=0x7f1f3c0fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:47.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.669+0000 7f1f41e61700 1 -- 172.21.15.92:0/1666791822 shutdown_connections 2023-10-16T13:11:47.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.669+0000 7f1f41e61700 1 -- 172.21.15.92:0/1666791822 wait complete. 2023-10-16T13:11:47.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.669+0000 7f1f41e61700 1 Processor -- start 2023-10-16T13:11:47.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.669+0000 7f1f41e61700 1 -- start start 2023-10-16T13:11:47.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.669+0000 7f1f41e61700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f3c0ffe10 0x7f1f3c196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:47.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.669+0000 7f1f41e61700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f3c100f60 0x7f1f3c1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:47.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.669+0000 7f1f41e61700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f3c101920 0x7f1f3c19e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:47.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.669+0000 7f1f41e61700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c19e7f0 con 0x7f1f3c0ffe10 2023-10-16T13:11:47.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.669+0000 7f1f41e61700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c19e960 con 0x7f1f3c100f60 2023-10-16T13:11:47.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.669+0000 7f1f41e61700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c19eb20 con 0x7f1f3c101920 2023-10-16T13:11:47.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.669+0000 7f1f3b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f3c0ffe10 0x7f1f3c196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:47.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.670+0000 7f1f3b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f3c0ffe10 0x7f1f3c196c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35364/0 (socket says 172.21.15.92:35364) 2023-10-16T13:11:47.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.670+0000 7f1f3b7fe700 1 -- 172.21.15.92:0/869986899 learned_addr learned my addr 172.21.15.92:0/869986899 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:47.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.670+0000 7f1f3affd700 1 --2- 172.21.15.92:0/869986899 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f3c100f60 0x7f1f3c1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:47.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.670+0000 7f1f3bfff700 1 --2- 172.21.15.92:0/869986899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f3c101920 0x7f1f3c19e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:47.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.670+0000 7f1f3b7fe700 1 -- 172.21.15.92:0/869986899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f3c101920 msgr2=0x7f1f3c19e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:47.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.670+0000 7f1f3b7fe700 1 --2- 172.21.15.92:0/869986899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f3c101920 0x7f1f3c19e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.670+0000 7f1f3b7fe700 1 -- 172.21.15.92:0/869986899 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f3c100f60 msgr2=0x7f1f3c1971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:47.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.670+0000 7f1f3b7fe700 1 --2- 172.21.15.92:0/869986899 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f3c100f60 0x7f1f3c1971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.670+0000 7f1f3b7fe700 1 -- 172.21.15.92:0/869986899 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f34009d00 con 0x7f1f3c0ffe10 2023-10-16T13:11:47.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.670+0000 7f1f3bfff700 1 --2- 172.21.15.92:0/869986899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f3c101920 0x7f1f3c19e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:11:47.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.670+0000 7f1f3b7fe700 1 --2- 172.21.15.92:0/869986899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f3c0ffe10 0x7f1f3c196c80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000c9b0 tx=0x7f1f3000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:47.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.670+0000 7f1f38ff9700 1 -- 172.21.15.92:0/869986899 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f30007b00 con 0x7f1f3c0ffe10 2023-10-16T13:11:47.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.670+0000 7f1f38ff9700 1 -- 172.21.15.92:0/869986899 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1f30007c60 con 0x7f1f3c0ffe10 2023-10-16T13:11:47.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.670+0000 7f1f41e61700 1 -- 172.21.15.92:0/869986899 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3c19ee00 con 0x7f1f3c0ffe10 2023-10-16T13:11:47.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.670+0000 7f1f38ff9700 1 -- 172.21.15.92:0/869986899 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f30018660 con 0x7f1f3c0ffe10 2023-10-16T13:11:47.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.670+0000 7f1f41e61700 1 -- 172.21.15.92:0/869986899 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3c19f280 con 0x7f1f3c0ffe10 2023-10-16T13:11:47.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.671+0000 7f1f41e61700 1 -- 172.21.15.92:0/869986899 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3c106b40 con 0x7f1f3c0ffe10 2023-10-16T13:11:47.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.672+0000 7f1f38ff9700 1 -- 172.21.15.92:0/869986899 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f1f3000f450 con 0x7f1f3c0ffe10 2023-10-16T13:11:47.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.673+0000 7f1f38ff9700 1 --2- 172.21.15.92:0/869986899 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1f240a1590 0x7f1f240a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:47.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.673+0000 7f1f3affd700 1 --2- 172.21.15.92:0/869986899 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1f240a1590 0x7f1f240a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:47.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.673+0000 7f1f38ff9700 1 -- 172.21.15.92:0/869986899 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1f300ccd50 con 0x7f1f3c0ffe10 2023-10-16T13:11:47.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.673+0000 7f1f3affd700 1 --2- 172.21.15.92:0/869986899 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1f240a1590 0x7f1f240a3a50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c198180 tx=0x7f1f2c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:47.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.677+0000 7f1f38ff9700 1 -- 172.21.15.92:0/869986899 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1f30096300 con 0x7f1f3c0ffe10 2023-10-16T13:11:47.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:47 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/229207127' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-16T13:11:47.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:47 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] up:active 2023-10-16T13:11:47.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:47 smithi152 ceph-mon[104423]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-16T13:11:47.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:47 smithi152 ceph-mon[104423]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2023-10-16T13:11:47.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:47 smithi152 ceph-mon[104423]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2023-10-16T13:11:47.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:47 smithi152 ceph-mon[104423]: daemon mds.e is now active in filesystem cephfs as rank 3 2023-10-16T13:11:47.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:47 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/229207127' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-16T13:11:47.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:47 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] up:active 2023-10-16T13:11:47.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:47 smithi118 ceph-mon[103969]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-16T13:11:47.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:47 smithi118 ceph-mon[103969]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2023-10-16T13:11:47.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:47 smithi118 ceph-mon[103969]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2023-10-16T13:11:47.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:47 smithi118 ceph-mon[103969]: daemon mds.e is now active in filesystem cephfs as rank 3 2023-10-16T13:11:47.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.900+0000 7f1f41e61700 1 -- 172.21.15.92:0/869986899 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f3c02d220 con 0x7f1f240a1590 2023-10-16T13:11:47.906 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.904+0000 7f1f38ff9700 1 -- 172.21.15.92:0/869986899 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f1f3c02d220 con 0x7f1f240a1590 2023-10-16T13:11:47.907 INFO:teuthology.orchestra.run.smithi092.stdout:/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927 2023-10-16T13:11:47.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.906+0000 7f1f41e61700 1 -- 172.21.15.92:0/869986899 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1f240a1590 msgr2=0x7f1f240a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:47.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.906+0000 7f1f41e61700 1 --2- 172.21.15.92:0/869986899 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1f240a1590 0x7f1f240a3a50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c198180 tx=0x7f1f2c00a380 comp rx=0 tx=0).stop 2023-10-16T13:11:47.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.906+0000 7f1f41e61700 1 -- 172.21.15.92:0/869986899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f3c0ffe10 msgr2=0x7f1f3c196c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:47.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.906+0000 7f1f41e61700 1 --2- 172.21.15.92:0/869986899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f3c0ffe10 0x7f1f3c196c80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000c9b0 tx=0x7f1f3000ccc0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.906+0000 7f1f41e61700 1 -- 172.21.15.92:0/869986899 shutdown_connections 2023-10-16T13:11:47.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.906+0000 7f1f41e61700 1 --2- 172.21.15.92:0/869986899 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1f240a1590 0x7f1f240a3a50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.906+0000 7f1f41e61700 1 --2- 172.21.15.92:0/869986899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f3c0ffe10 0x7f1f3c196c80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.906+0000 7f1f41e61700 1 --2- 172.21.15.92:0/869986899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f3c101920 0x7f1f3c19e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.906+0000 7f1f41e61700 1 --2- 172.21.15.92:0/869986899 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f3c100f60 0x7f1f3c1971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:47.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.906+0000 7f1f41e61700 1 -- 172.21.15.92:0/869986899 >> 172.21.15.92:0/869986899 conn(0x7f1f3c0fb380 msgr2=0x7f1f3c0fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:47.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.907+0000 7f1f41e61700 1 -- 172.21.15.92:0/869986899 shutdown_connections 2023-10-16T13:11:47.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:47.907+0000 7f1f41e61700 1 -- 172.21.15.92:0/869986899 wait complete. 2023-10-16T13:11:47.921 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:11:48.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.041+0000 7fa3eb917700 1 -- 172.21.15.92:0/875103666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3e4102090 msgr2=0x7fa3e4102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:48.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.041+0000 7fa3eb917700 1 --2- 172.21.15.92:0/875103666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3e4102090 0x7fa3e4102510 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009990 tx=0x7fa3e0009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.041+0000 7fa3eb917700 1 -- 172.21.15.92:0/875103666 shutdown_connections 2023-10-16T13:11:48.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.041+0000 7fa3eb917700 1 --2- 172.21.15.92:0/875103666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3e4102a50 0x7fa3e4109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.041+0000 7fa3eb917700 1 --2- 172.21.15.92:0/875103666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3e4100eb0 0x7fa3e41012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.041+0000 7fa3eb917700 1 --2- 172.21.15.92:0/875103666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3e4102090 0x7fa3e4102510 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.041+0000 7fa3eb917700 1 -- 172.21.15.92:0/875103666 >> 172.21.15.92:0/875103666 conn(0x7fa3e40fc430 msgr2=0x7fa3e40fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:48.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.041+0000 7fa3eb917700 1 -- 172.21.15.92:0/875103666 shutdown_connections 2023-10-16T13:11:48.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.041+0000 7fa3eb917700 1 -- 172.21.15.92:0/875103666 wait complete. 2023-10-16T13:11:48.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.041+0000 7fa3eb917700 1 Processor -- start 2023-10-16T13:11:48.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3eb917700 1 -- start start 2023-10-16T13:11:48.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3eb917700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3e4100eb0 0x7fa3e4196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:48.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3eb917700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3e4102090 0x7fa3e41970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:48.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3eb917700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3e4102a50 0x7fa3e419e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:48.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3eb917700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e419e730 con 0x7fa3e4102a50 2023-10-16T13:11:48.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3eb917700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e419e870 con 0x7fa3e4100eb0 2023-10-16T13:11:48.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3eb917700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e419ea00 con 0x7fa3e4102090 2023-10-16T13:11:48.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3e9eb4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3e4102a50 0x7fa3e419e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:48.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3e9eb4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3e4102a50 0x7fa3e419e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35382/0 (socket says 172.21.15.92:35382) 2023-10-16T13:11:48.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3e9eb4700 1 -- 172.21.15.92:0/2604355411 learned_addr learned my addr 172.21.15.92:0/2604355411 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:48.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3e96b3700 1 --2- 172.21.15.92:0/2604355411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3e4100eb0 0x7fa3e4196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:48.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3e8eb2700 1 --2- 172.21.15.92:0/2604355411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3e4102090 0x7fa3e41970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:48.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3e9eb4700 1 -- 172.21.15.92:0/2604355411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3e4102090 msgr2=0x7fa3e41970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:48.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3e9eb4700 1 --2- 172.21.15.92:0/2604355411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3e4102090 0x7fa3e41970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3e9eb4700 1 -- 172.21.15.92:0/2604355411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3e4100eb0 msgr2=0x7fa3e4196bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:48.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3e9eb4700 1 --2- 172.21.15.92:0/2604355411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3e4100eb0 0x7fa3e4196bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3e9eb4700 1 -- 172.21.15.92:0/2604355411 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e00095f0 con 0x7fa3e4102a50 2023-10-16T13:11:48.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3e96b3700 1 --2- 172.21.15.92:0/2604355411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3e4100eb0 0x7fa3e4196bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:11:48.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3e9eb4700 1 --2- 172.21.15.92:0/2604355411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3e4102a50 0x7fa3e419e160 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc007d70 tx=0x7fa3dc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:48.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3da7fc700 1 -- 172.21.15.92:0/2604355411 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc00ad40 con 0x7fa3e4102a50 2023-10-16T13:11:48.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3da7fc700 1 -- 172.21.15.92:0/2604355411 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa3dc012900 con 0x7fa3e4102a50 2023-10-16T13:11:48.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3eb917700 1 -- 172.21.15.92:0/2604355411 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e419ece0 con 0x7fa3e4102a50 2023-10-16T13:11:48.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3da7fc700 1 -- 172.21.15.92:0/2604355411 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc011880 con 0x7fa3e4102a50 2023-10-16T13:11:48.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.042+0000 7fa3eb917700 1 -- 172.21.15.92:0/2604355411 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e419f1e0 con 0x7fa3e4102a50 2023-10-16T13:11:48.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.043+0000 7fa3eb917700 1 -- 172.21.15.92:0/2604355411 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e410c870 con 0x7fa3e4102a50 2023-10-16T13:11:48.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.044+0000 7fa3da7fc700 1 -- 172.21.15.92:0/2604355411 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fa3dc012a70 con 0x7fa3e4102a50 2023-10-16T13:11:48.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.045+0000 7fa3da7fc700 1 --2- 172.21.15.92:0/2604355411 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa3d00a1640 0x7fa3d00a3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:48.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.045+0000 7fa3e96b3700 1 --2- 172.21.15.92:0/2604355411 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa3d00a1640 0x7fa3d00a3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:48.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.045+0000 7fa3da7fc700 1 -- 172.21.15.92:0/2604355411 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa3dc0cce70 con 0x7fa3e4102a50 2023-10-16T13:11:48.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.045+0000 7fa3e96b3700 1 --2- 172.21.15.92:0/2604355411 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa3d00a1640 0x7fa3d00a3b00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4005950 tx=0x7fa3d40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:48.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.049+0000 7fa3da7fc700 1 -- 172.21.15.92:0/2604355411 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa3dc096630 con 0x7fa3e4102a50 2023-10-16T13:11:48.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.287+0000 7fa3eb917700 1 -- 172.21.15.92:0/2604355411 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3e4107d10 con 0x7fa3e4102a50 2023-10-16T13:11:48.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.287+0000 7fa3da7fc700 1 -- 172.21.15.92:0/2604355411 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+11358 (secure 0 0 0) 0x7fa3dc099c50 con 0x7fa3e4102a50 2023-10-16T13:11:48.290 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:48.291 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/1790514945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1790514945},{"type":"v1","addr":"172.21.15.92:6839","nonce":1790514945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1016260236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1016260236},{"type":"v1","addr":"172.21.15.92:6841","nonce":1016260236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-16T13:11:40.343309+0000","modified":"2023-10-16T13:11:47.341213+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24460,"mds_3":24428,"mds_4":24412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":4,"incarnation":25,"state":"up:creating","state_seq":1,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/2133613540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":2133613540},{"type":"v1","addr":"172.21.15.118:6837","nonce":2133613540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6837/2403096460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":2403096460},{"type":"v1","addr":"172.21.15.152:6837","nonce":2403096460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1821921588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1821921588},{"type":"v1","addr":"172.21.15.152:6839","nonce":1821921588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6839/1577355936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":1577355936},{"type":"v1","addr":"172.21.15.118:6839","nonce":1577355936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:11:48.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.289+0000 7fa3eb917700 1 -- 172.21.15.92:0/2604355411 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa3d00a1640 msgr2=0x7fa3d00a3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:48.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.289+0000 7fa3eb917700 1 --2- 172.21.15.92:0/2604355411 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa3d00a1640 0x7fa3d00a3b00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4005950 tx=0x7fa3d40058e0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.289+0000 7fa3eb917700 1 -- 172.21.15.92:0/2604355411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3e4102a50 msgr2=0x7fa3e419e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:48.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.289+0000 7fa3eb917700 1 --2- 172.21.15.92:0/2604355411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3e4102a50 0x7fa3e419e160 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc007d70 tx=0x7fa3dc00a340 comp rx=0 tx=0).stop 2023-10-16T13:11:48.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.289+0000 7fa3eb917700 1 -- 172.21.15.92:0/2604355411 shutdown_connections 2023-10-16T13:11:48.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.289+0000 7fa3eb917700 1 --2- 172.21.15.92:0/2604355411 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa3d00a1640 0x7fa3d00a3b00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.289+0000 7fa3eb917700 1 --2- 172.21.15.92:0/2604355411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3e4102a50 0x7fa3e419e160 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.289+0000 7fa3eb917700 1 --2- 172.21.15.92:0/2604355411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3e4100eb0 0x7fa3e4196bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.289+0000 7fa3eb917700 1 --2- 172.21.15.92:0/2604355411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3e4102090 0x7fa3e41970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.289+0000 7fa3eb917700 1 -- 172.21.15.92:0/2604355411 >> 172.21.15.92:0/2604355411 conn(0x7fa3e40fc430 msgr2=0x7fa3e40fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:48.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.290+0000 7fa3eb917700 1 -- 172.21.15.92:0/2604355411 shutdown_connections 2023-10-16T13:11:48.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.290+0000 7fa3eb917700 1 -- 172.21.15.92:0/2604355411 wait complete. 2023-10-16T13:11:48.295 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 25 2023-10-16T13:11:48.305 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:11:48.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.426+0000 7f1391058700 1 -- 172.21.15.92:0/3323986732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f138c100e80 msgr2=0x7f138c1012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:48.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.426+0000 7f1391058700 1 --2- 172.21.15.92:0/3323986732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f138c100e80 0x7f138c1012a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f138400b0a0 tx=0x7f138400b3b0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.426+0000 7f1391058700 1 -- 172.21.15.92:0/3323986732 shutdown_connections 2023-10-16T13:11:48.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.426+0000 7f1391058700 1 --2- 172.21.15.92:0/3323986732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f138c100e80 0x7f138c1012a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.426+0000 7f1391058700 1 --2- 172.21.15.92:0/3323986732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f138c102a20 0x7f138c109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.426+0000 7f1391058700 1 --2- 172.21.15.92:0/3323986732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f138c102060 0x7f138c1024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.426+0000 7f1391058700 1 -- 172.21.15.92:0/3323986732 >> 172.21.15.92:0/3323986732 conn(0x7f138c0fc400 msgr2=0x7f138c0fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:48.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.426+0000 7f1391058700 1 -- 172.21.15.92:0/3323986732 shutdown_connections 2023-10-16T13:11:48.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.426+0000 7f1391058700 1 -- 172.21.15.92:0/3323986732 wait complete. 2023-10-16T13:11:48.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.427+0000 7f1391058700 1 Processor -- start 2023-10-16T13:11:48.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.427+0000 7f1391058700 1 -- start start 2023-10-16T13:11:48.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.427+0000 7f1391058700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f138c100e80 0x7f138c196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:48.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.427+0000 7f1391058700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f138c102060 0x7f138c197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:48.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.427+0000 7f1391058700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f138c102a20 0x7f138c19e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:48.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.427+0000 7f1391058700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c19e870 con 0x7f138c102060 2023-10-16T13:11:48.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.427+0000 7f1391058700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c19e9e0 con 0x7f138c102a20 2023-10-16T13:11:48.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.427+0000 7f1391058700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c19eba0 con 0x7f138c100e80 2023-10-16T13:11:48.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.427+0000 7f138a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f138c102060 0x7f138c197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:48.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.427+0000 7f138a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f138c102060 0x7f138c197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35416/0 (socket says 172.21.15.92:35416) 2023-10-16T13:11:48.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.427+0000 7f138a59c700 1 -- 172.21.15.92:0/3821815738 learned_addr learned my addr 172.21.15.92:0/3821815738 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:48.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.427+0000 7f138b59e700 1 --2- 172.21.15.92:0/3821815738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f138c102a20 0x7f138c19e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:48.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.428+0000 7f138ad9d700 1 --2- 172.21.15.92:0/3821815738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f138c100e80 0x7f138c196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:48.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.428+0000 7f138a59c700 1 -- 172.21.15.92:0/3821815738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f138c100e80 msgr2=0x7f138c196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:48.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.428+0000 7f138a59c700 1 --2- 172.21.15.92:0/3821815738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f138c100e80 0x7f138c196d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.428+0000 7f138a59c700 1 -- 172.21.15.92:0/3821815738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f138c102a20 msgr2=0x7f138c19e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:48.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.428+0000 7f138a59c700 1 --2- 172.21.15.92:0/3821815738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f138c102a20 0x7f138c19e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.428+0000 7f138a59c700 1 -- 172.21.15.92:0/3821815738 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1384009d00 con 0x7f138c102060 2023-10-16T13:11:48.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.428+0000 7f138a59c700 1 --2- 172.21.15.92:0/3821815738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f138c102060 0x7f138c197270 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f137400d980 tx=0x7f137400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:48.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.428+0000 7f1383fff700 1 -- 172.21.15.92:0/3821815738 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374004020 con 0x7f138c102060 2023-10-16T13:11:48.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.428+0000 7f1391058700 1 -- 172.21.15.92:0/3821815738 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138c19ee80 con 0x7f138c102060 2023-10-16T13:11:48.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.428+0000 7f1383fff700 1 -- 172.21.15.92:0/3821815738 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1374009730 con 0x7f138c102060 2023-10-16T13:11:48.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.428+0000 7f1383fff700 1 -- 172.21.15.92:0/3821815738 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374003be0 con 0x7f138c102060 2023-10-16T13:11:48.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.428+0000 7f1391058700 1 -- 172.21.15.92:0/3821815738 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138c19f2a0 con 0x7f138c102060 2023-10-16T13:11:48.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.429+0000 7f1391058700 1 -- 172.21.15.92:0/3821815738 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138c107d60 con 0x7f138c102060 2023-10-16T13:11:48.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.431+0000 7f1383fff700 1 -- 172.21.15.92:0/3821815738 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f1374009ba0 con 0x7f138c102060 2023-10-16T13:11:48.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.431+0000 7f1383fff700 1 --2- 172.21.15.92:0/3821815738 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f13780a15c0 0x7f13780a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:48.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.431+0000 7f138ad9d700 1 --2- 172.21.15.92:0/3821815738 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f13780a15c0 0x7f13780a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:48.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.431+0000 7f1383fff700 1 -- 172.21.15.92:0/3821815738 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f13740ccc90 con 0x7f138c102060 2023-10-16T13:11:48.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.432+0000 7f138ad9d700 1 --2- 172.21.15.92:0/3821815738 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f13780a15c0 0x7f13780a3a80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f138400b830 tx=0x7f1384009be0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:48.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.435+0000 7f1383fff700 1 -- 172.21.15.92:0/3821815738 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1374096340 con 0x7f138c102060 2023-10-16T13:11:48.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.626+0000 7f1391058700 1 -- 172.21.15.92:0/3821815738 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f138c10ca00 con 0x7f138c102060 2023-10-16T13:11:48.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.627+0000 7f1383fff700 1 -- 172.21.15.92:0/3821815738 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22119 (secure 0 0 0) 0x7f1374099960 con 0x7f138c102060 2023-10-16T13:11:48.630 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:48.631 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":83,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:11:41.954264+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:11:38.345035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:11:39.549912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:11:48.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.629+0000 7f1391058700 1 -- 172.21.15.92:0/3821815738 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f13780a15c0 msgr2=0x7f13780a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:48.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.629+0000 7f1391058700 1 --2- 172.21.15.92:0/3821815738 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f13780a15c0 0x7f13780a3a80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f138400b830 tx=0x7f1384009be0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.629+0000 7f1391058700 1 -- 172.21.15.92:0/3821815738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f138c102060 msgr2=0x7f138c197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:48.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.629+0000 7f1391058700 1 --2- 172.21.15.92:0/3821815738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f138c102060 0x7f138c197270 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f137400d980 tx=0x7f137400dc90 comp rx=0 tx=0).stop 2023-10-16T13:11:48.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.629+0000 7f1391058700 1 -- 172.21.15.92:0/3821815738 shutdown_connections 2023-10-16T13:11:48.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.629+0000 7f1391058700 1 --2- 172.21.15.92:0/3821815738 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f13780a15c0 0x7f13780a3a80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.629+0000 7f1391058700 1 --2- 172.21.15.92:0/3821815738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f138c102a20 0x7f138c19e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.629+0000 7f1391058700 1 --2- 172.21.15.92:0/3821815738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f138c100e80 0x7f138c196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.629+0000 7f1391058700 1 --2- 172.21.15.92:0/3821815738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f138c102060 0x7f138c197270 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.629+0000 7f1391058700 1 -- 172.21.15.92:0/3821815738 >> 172.21.15.92:0/3821815738 conn(0x7f138c0fc400 msgr2=0x7f138c0fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:48.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.629+0000 7f1391058700 1 -- 172.21.15.92:0/3821815738 shutdown_connections 2023-10-16T13:11:48.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.629+0000 7f1391058700 1 -- 172.21.15.92:0/3821815738 wait complete. 2023-10-16T13:11:48.643 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:48 smithi092 ceph-mon[99542]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:11:48.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:48 smithi092 ceph-mon[99542]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:11:48.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:48 smithi092 ceph-mon[99542]: pgmap v259: 97 pgs: 97 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 559 B/s rd, 2.2 KiB/s wr, 10 op/s 2023-10-16T13:11:48.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:48 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] up:active 2023-10-16T13:11:48.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:48 smithi092 ceph-mon[99542]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-16T13:11:48.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:48 smithi092 ceph-mon[99542]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-16T13:11:48.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:48 smithi092 ceph-mon[99542]: Cluster is now healthy 2023-10-16T13:11:48.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:48 smithi092 ceph-mon[99542]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2023-10-16T13:11:48.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:48 smithi092 ceph-mon[99542]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-10-16T13:11:48.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:48 smithi092 ceph-mon[99542]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2023-10-16T13:11:48.646 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:48 smithi092 ceph-mon[99542]: daemon mds.l is now active in filesystem cephfs as rank 4 2023-10-16T13:11:48.646 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:48 smithi092 ceph-mon[99542]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:11:48.646 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:48 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2604355411' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:48.648 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T13:11:48.648 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:11:48.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:48 smithi152 ceph-mon[104423]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:11:48.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:48 smithi152 ceph-mon[104423]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:11:48.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:48 smithi152 ceph-mon[104423]: pgmap v259: 97 pgs: 97 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 559 B/s rd, 2.2 KiB/s wr, 10 op/s 2023-10-16T13:11:48.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:48 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] up:active 2023-10-16T13:11:48.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:48 smithi152 ceph-mon[104423]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-16T13:11:48.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:48 smithi152 ceph-mon[104423]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-16T13:11:48.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:48 smithi152 ceph-mon[104423]: Cluster is now healthy 2023-10-16T13:11:48.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:48 smithi152 ceph-mon[104423]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2023-10-16T13:11:48.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:48 smithi152 ceph-mon[104423]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-10-16T13:11:48.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:48 smithi152 ceph-mon[104423]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2023-10-16T13:11:48.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:48 smithi152 ceph-mon[104423]: daemon mds.l is now active in filesystem cephfs as rank 4 2023-10-16T13:11:48.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:48 smithi152 ceph-mon[104423]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:11:48.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:48 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2604355411' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:48.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.765+0000 7f7775eff700 1 -- 172.21.15.92:0/4063344895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77700ff1e0 msgr2=0x7f77700ff600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:48.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.765+0000 7f7775eff700 1 --2- 172.21.15.92:0/4063344895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77700ff1e0 0x7f77700ff600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7760009990 tx=0x7f7760009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.765+0000 7f7775eff700 1 -- 172.21.15.92:0/4063344895 shutdown_connections 2023-10-16T13:11:48.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.765+0000 7f7775eff700 1 --2- 172.21.15.92:0/4063344895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77700ff1e0 0x7f77700ff600 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.765+0000 7f7775eff700 1 --2- 172.21.15.92:0/4063344895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7770102b50 0x7f7770109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.765+0000 7f7775eff700 1 --2- 172.21.15.92:0/4063344895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77701021b0 0x7f7770102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.765+0000 7f7775eff700 1 -- 172.21.15.92:0/4063344895 >> 172.21.15.92:0/4063344895 conn(0x7f77700fab10 msgr2=0x7f77700fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:48.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.766+0000 7f7775eff700 1 -- 172.21.15.92:0/4063344895 shutdown_connections 2023-10-16T13:11:48.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.766+0000 7f7775eff700 1 -- 172.21.15.92:0/4063344895 wait complete. 2023-10-16T13:11:48.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.766+0000 7f7775eff700 1 Processor -- start 2023-10-16T13:11:48.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.766+0000 7f7775eff700 1 -- start start 2023-10-16T13:11:48.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f7775eff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77700ff1e0 0x7f7770196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:48.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f7775eff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77701021b0 0x7f77701970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:48.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f7775eff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7770102b50 0x7f777019e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:48.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f7775eff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777019e730 con 0x7f77700ff1e0 2023-10-16T13:11:48.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f7775eff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777019e870 con 0x7f7770102b50 2023-10-16T13:11:48.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f7775eff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777019ea00 con 0x7f77701021b0 2023-10-16T13:11:48.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f776f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77700ff1e0 0x7f7770196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:48.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f776f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77700ff1e0 0x7f7770196bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35428/0 (socket says 172.21.15.92:35428) 2023-10-16T13:11:48.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f776f7fe700 1 -- 172.21.15.92:0/2811490957 learned_addr learned my addr 172.21.15.92:0/2811490957 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:48.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f776ffff700 1 --2- 172.21.15.92:0/2811490957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7770102b50 0x7f777019e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:48.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f776f7fe700 1 -- 172.21.15.92:0/2811490957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77701021b0 msgr2=0x7f77701970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:48.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f776f7fe700 1 --2- 172.21.15.92:0/2811490957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77701021b0 0x7f77701970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f776f7fe700 1 -- 172.21.15.92:0/2811490957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7770102b50 msgr2=0x7f777019e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:48.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f776f7fe700 1 --2- 172.21.15.92:0/2811490957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7770102b50 0x7f777019e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f776f7fe700 1 -- 172.21.15.92:0/2811490957 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77600095f0 con 0x7f77700ff1e0 2023-10-16T13:11:48.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f776ffff700 1 --2- 172.21.15.92:0/2811490957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7770102b50 0x7f777019e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:11:48.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f776f7fe700 1 --2- 172.21.15.92:0/2811490957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77700ff1e0 0x7f7770196bb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f77600095c0 tx=0x7f776000f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:48.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f776cff9700 1 -- 172.21.15.92:0/2811490957 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776001d070 con 0x7f77700ff1e0 2023-10-16T13:11:48.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f7775eff700 1 -- 172.21.15.92:0/2811490957 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777019ec80 con 0x7f77700ff1e0 2023-10-16T13:11:48.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f776cff9700 1 -- 172.21.15.92:0/2811490957 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7760005530 con 0x7f77700ff1e0 2023-10-16T13:11:48.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f776cff9700 1 -- 172.21.15.92:0/2811490957 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760004c50 con 0x7f77700ff1e0 2023-10-16T13:11:48.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.767+0000 7f7775eff700 1 -- 172.21.15.92:0/2811490957 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777019f100 con 0x7f77700ff1e0 2023-10-16T13:11:48.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.768+0000 7f7775eff700 1 -- 172.21.15.92:0/2811490957 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7770107e00 con 0x7f77700ff1e0 2023-10-16T13:11:48.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.770+0000 7f776cff9700 1 -- 172.21.15.92:0/2811490957 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f776000fc30 con 0x7f77700ff1e0 2023-10-16T13:11:48.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.770+0000 7f776cff9700 1 --2- 172.21.15.92:0/2811490957 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77580a15c0 0x7f77580a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:48.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.770+0000 7f776cff9700 1 -- 172.21.15.92:0/2811490957 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f77600ce200 con 0x7f77700ff1e0 2023-10-16T13:11:48.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.770+0000 7f776effd700 1 --2- 172.21.15.92:0/2811490957 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77580a15c0 0x7f77580a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:48.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.771+0000 7f776effd700 1 --2- 172.21.15.92:0/2811490957 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77580a15c0 0x7f77580a3a80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7764005d90 tx=0x7f7764005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:48.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.774+0000 7f776cff9700 1 -- 172.21.15.92:0/2811490957 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7760097940 con 0x7f77700ff1e0 2023-10-16T13:11:48.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:48 smithi118 ceph-mon[103969]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:11:48.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:48 smithi118 ceph-mon[103969]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:11:48.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:48 smithi118 ceph-mon[103969]: pgmap v259: 97 pgs: 97 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 559 B/s rd, 2.2 KiB/s wr, 10 op/s 2023-10-16T13:11:48.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:48 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] up:active 2023-10-16T13:11:48.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:48 smithi118 ceph-mon[103969]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-16T13:11:48.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:48 smithi118 ceph-mon[103969]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-16T13:11:48.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:48 smithi118 ceph-mon[103969]: Cluster is now healthy 2023-10-16T13:11:48.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:48 smithi118 ceph-mon[103969]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2023-10-16T13:11:48.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:48 smithi118 ceph-mon[103969]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-10-16T13:11:48.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:48 smithi118 ceph-mon[103969]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2023-10-16T13:11:48.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:48 smithi118 ceph-mon[103969]: daemon mds.l is now active in filesystem cephfs as rank 4 2023-10-16T13:11:48.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:48 smithi118 ceph-mon[103969]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:11:48.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:48 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2604355411' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:11:48.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.963+0000 7f7775eff700 1 -- 172.21.15.92:0/2811490957 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f777002d320 con 0x7f77580a15c0 2023-10-16T13:11:48.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.975+0000 7f776cff9700 1 -- 172.21.15.92:0/2811490957 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335871 (secure 0 0 0) 0x7f777002d320 con 0x7f77580a15c0 2023-10-16T13:11:48.982 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:48.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.979+0000 7f7775eff700 1 -- 172.21.15.92:0/2811490957 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77580a15c0 msgr2=0x7f77580a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:48.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.979+0000 7f7775eff700 1 --2- 172.21.15.92:0/2811490957 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77580a15c0 0x7f77580a3a80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7764005d90 tx=0x7f7764005d00 comp rx=0 tx=0).stop 2023-10-16T13:11:48.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.979+0000 7f7775eff700 1 -- 172.21.15.92:0/2811490957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77700ff1e0 msgr2=0x7f7770196bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:48.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.979+0000 7f7775eff700 1 --2- 172.21.15.92:0/2811490957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77700ff1e0 0x7f7770196bb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f77600095c0 tx=0x7f776000f740 comp rx=0 tx=0).stop 2023-10-16T13:11:48.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.979+0000 7f7775eff700 1 -- 172.21.15.92:0/2811490957 shutdown_connections 2023-10-16T13:11:48.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.979+0000 7f7775eff700 1 --2- 172.21.15.92:0/2811490957 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77580a15c0 0x7f77580a3a80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.979+0000 7f7775eff700 1 --2- 172.21.15.92:0/2811490957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77700ff1e0 0x7f7770196bb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.979+0000 7f7775eff700 1 --2- 172.21.15.92:0/2811490957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7770102b50 0x7f777019e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.979+0000 7f7775eff700 1 --2- 172.21.15.92:0/2811490957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77701021b0 0x7f77701970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:48.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.979+0000 7f7775eff700 1 -- 172.21.15.92:0/2811490957 >> 172.21.15.92:0/2811490957 conn(0x7f77700fab10 msgr2=0x7f77700fccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:48.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.979+0000 7f7775eff700 1 -- 172.21.15.92:0/2811490957 shutdown_connections 2023-10-16T13:11:48.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:48.979+0000 7f7775eff700 1 -- 172.21.15.92:0/2811490957 wait complete. 2023-10-16T13:11:48.990 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-10-16T13:11:48.994 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2023-10-16T13:11:47.261053+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592958,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":131,"num_read_kb":113,"num_write":252,"num_write_kb":2954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336492,"kb_used_data":12256,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605332,"statfs":{"total":1151940427776,"available":1151595859968,"internally_reserved":0,"allocated":12550144,"data_stored":6847570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19128,"internal_metadata":331855176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2590,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":71,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.319173"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.981336+0000","last_change":"2023-10-16T13:11:40.980978+0000","last_active":"2023-10-16T13:11:40.981336+0000","last_peered":"2023-10-16T13:11:40.981336+0000","last_clean":"2023-10-16T13:11:40.981336+0000","last_became_active":"2023-10-16T13:11:40.980468+0000","last_became_peered":"2023-10-16T13:11:40.980468+0000","last_unstale":"2023-10-16T13:11:40.981336+0000","last_undegraded":"2023-10-16T13:11:40.981336+0000","last_fullsized":"2023-10-16T13:11:40.981336+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:37:37.329877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717598+0000","last_change":"2023-10-16T13:11:40.971625+0000","last_active":"2023-10-16T13:11:42.717598+0000","last_peered":"2023-10-16T13:11:42.717598+0000","last_clean":"2023-10-16T13:11:42.717598+0000","last_became_active":"2023-10-16T13:11:40.971028+0000","last_became_peered":"2023-10-16T13:11:40.971028+0000","last_unstale":"2023-10-16T13:11:42.717598+0000","last_undegraded":"2023-10-16T13:11:42.717598+0000","last_fullsized":"2023-10-16T13:11:42.717598+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:08.974553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717498+0000","last_change":"2023-10-16T13:11:40.973705+0000","last_active":"2023-10-16T13:11:42.717498+0000","last_peered":"2023-10-16T13:11:42.717498+0000","last_clean":"2023-10-16T13:11:42.717498+0000","last_became_active":"2023-10-16T13:11:40.973347+0000","last_became_peered":"2023-10-16T13:11:40.973347+0000","last_unstale":"2023-10-16T13:11:42.717498+0000","last_undegraded":"2023-10-16T13:11:42.717498+0000","last_fullsized":"2023-10-16T13:11:42.717498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:46.628383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.976643+0000","last_change":"2023-10-16T13:11:40.974996+0000","last_active":"2023-10-16T13:11:40.976643+0000","last_peered":"2023-10-16T13:11:40.976643+0000","last_clean":"2023-10-16T13:11:40.976643+0000","last_became_active":"2023-10-16T13:11:40.973807+0000","last_became_peered":"2023-10-16T13:11:40.973807+0000","last_unstale":"2023-10-16T13:11:40.976643+0000","last_undegraded":"2023-10-16T13:11:40.976643+0000","last_fullsized":"2023-10-16T13:11:40.976643+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:21:36.289788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.976980+0000","last_change":"2023-10-16T13:11:40.976558+0000","last_active":"2023-10-16T13:11:40.976980+0000","last_peered":"2023-10-16T13:11:40.976980+0000","last_clean":"2023-10-16T13:11:40.976980+0000","last_became_active":"2023-10-16T13:11:40.976159+0000","last_became_peered":"2023-10-16T13:11:40.976159+0000","last_unstale":"2023-10-16T13:11:40.976980+0000","last_undegraded":"2023-10-16T13:11:40.976980+0000","last_fullsized":"2023-10-16T13:11:40.976980+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:22.392751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.227919+0000","last_change":"2023-10-16T13:11:40.977510+0000","last_active":"2023-10-16T13:11:43.227919+0000","last_peered":"2023-10-16T13:11:43.227919+0000","last_clean":"2023-10-16T13:11:43.227919+0000","last_became_active":"2023-10-16T13:11:40.977184+0000","last_became_peered":"2023-10-16T13:11:40.977184+0000","last_unstale":"2023-10-16T13:11:43.227919+0000","last_undegraded":"2023-10-16T13:11:43.227919+0000","last_fullsized":"2023-10-16T13:11:43.227919+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:24:33.215430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972030+0000","last_change":"2023-10-16T13:11:40.969982+0000","last_active":"2023-10-16T13:11:42.972030+0000","last_peered":"2023-10-16T13:11:42.972030+0000","last_clean":"2023-10-16T13:11:42.972030+0000","last_became_active":"2023-10-16T13:11:40.969651+0000","last_became_peered":"2023-10-16T13:11:40.969651+0000","last_unstale":"2023-10-16T13:11:42.972030+0000","last_undegraded":"2023-10-16T13:11:42.972030+0000","last_fullsized":"2023-10-16T13:11:42.972030+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:37:01.702748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961091+0000","last_change":"2023-10-16T13:11:40.967952+0000","last_active":"2023-10-16T13:11:41.961091+0000","last_peered":"2023-10-16T13:11:41.961091+0000","last_clean":"2023-10-16T13:11:41.961091+0000","last_became_active":"2023-10-16T13:11:40.967621+0000","last_became_peered":"2023-10-16T13:11:40.967621+0000","last_unstale":"2023-10-16T13:11:41.961091+0000","last_undegraded":"2023-10-16T13:11:41.961091+0000","last_fullsized":"2023-10-16T13:11:41.961091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:04:09.243563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962240+0000","last_change":"2023-10-16T13:11:40.978172+0000","last_active":"2023-10-16T13:11:41.962240+0000","last_peered":"2023-10-16T13:11:41.962240+0000","last_clean":"2023-10-16T13:11:41.962240+0000","last_became_active":"2023-10-16T13:11:40.977727+0000","last_became_peered":"2023-10-16T13:11:40.977727+0000","last_unstale":"2023-10-16T13:11:41.962240+0000","last_undegraded":"2023-10-16T13:11:41.962240+0000","last_fullsized":"2023-10-16T13:11:41.962240+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:06:16.469370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228227+0000","last_change":"2023-10-16T13:11:40.973343+0000","last_active":"2023-10-16T13:11:43.228227+0000","last_peered":"2023-10-16T13:11:43.228227+0000","last_clean":"2023-10-16T13:11:43.228227+0000","last_became_active":"2023-10-16T13:11:40.972997+0000","last_became_peered":"2023-10-16T13:11:40.972997+0000","last_unstale":"2023-10-16T13:11:43.228227+0000","last_undegraded":"2023-10-16T13:11:43.228227+0000","last_fullsized":"2023-10-16T13:11:43.228227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:23:21.235742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972369+0000","last_change":"2023-10-16T13:11:40.980253+0000","last_active":"2023-10-16T13:11:42.972369+0000","last_peered":"2023-10-16T13:11:42.972369+0000","last_clean":"2023-10-16T13:11:42.972369+0000","last_became_active":"2023-10-16T13:11:40.979473+0000","last_became_peered":"2023-10-16T13:11:40.979473+0000","last_unstale":"2023-10-16T13:11:42.972369+0000","last_undegraded":"2023-10-16T13:11:42.972369+0000","last_fullsized":"2023-10-16T13:11:42.972369+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:37:46.976128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.976623+0000","last_change":"2023-10-16T13:11:40.974791+0000","last_active":"2023-10-16T13:11:40.976623+0000","last_peered":"2023-10-16T13:11:40.976623+0000","last_clean":"2023-10-16T13:11:40.976623+0000","last_became_active":"2023-10-16T13:11:40.973353+0000","last_became_peered":"2023-10-16T13:11:40.973353+0000","last_unstale":"2023-10-16T13:11:40.976623+0000","last_undegraded":"2023-10-16T13:11:40.976623+0000","last_fullsized":"2023-10-16T13:11:40.976623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:10:08.751872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228607+0000","last_change":"2023-10-16T13:11:40.971681+0000","last_active":"2023-10-16T13:11:43.228607+0000","last_peered":"2023-10-16T13:11:43.228607+0000","last_clean":"2023-10-16T13:11:43.228607+0000","last_became_active":"2023-10-16T13:11:40.971349+0000","last_became_peered":"2023-10-16T13:11:40.971349+0000","last_unstale":"2023-10-16T13:11:43.228607+0000","last_undegraded":"2023-10-16T13:11:43.228607+0000","last_fullsized":"2023-10-16T13:11:43.228607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:50:38.285478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717591+0000","last_change":"2023-10-16T13:11:40.971859+0000","last_active":"2023-10-16T13:11:42.717591+0000","last_peered":"2023-10-16T13:11:42.717591+0000","last_clean":"2023-10-16T13:11:42.717591+0000","last_became_active":"2023-10-16T13:11:40.971107+0000","last_became_peered":"2023-10-16T13:11:40.971107+0000","last_unstale":"2023-10-16T13:11:42.717591+0000","last_undegraded":"2023-10-16T13:11:42.717591+0000","last_fullsized":"2023-10-16T13:11:42.717591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:57:52.655130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717282+0000","last_change":"2023-10-16T13:11:40.976604+0000","last_active":"2023-10-16T13:11:42.717282+0000","last_peered":"2023-10-16T13:11:42.717282+0000","last_clean":"2023-10-16T13:11:42.717282+0000","last_became_active":"2023-10-16T13:11:40.976262+0000","last_became_peered":"2023-10-16T13:11:40.976262+0000","last_unstale":"2023-10-16T13:11:42.717282+0000","last_undegraded":"2023-10-16T13:11:42.717282+0000","last_fullsized":"2023-10-16T13:11:42.717282+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:18:55.867316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961792+0000","last_change":"2023-10-16T13:11:40.975785+0000","last_active":"2023-10-16T13:11:41.961792+0000","last_peered":"2023-10-16T13:11:41.961792+0000","last_clean":"2023-10-16T13:11:41.961792+0000","last_became_active":"2023-10-16T13:11:40.975463+0000","last_became_peered":"2023-10-16T13:11:40.975463+0000","last_unstale":"2023-10-16T13:11:41.961792+0000","last_undegraded":"2023-10-16T13:11:41.961792+0000","last_fullsized":"2023-10-16T13:11:41.961792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:37:29.337596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.981325+0000","last_change":"2023-10-16T13:11:40.980784+0000","last_active":"2023-10-16T13:11:40.981325+0000","last_peered":"2023-10-16T13:11:40.981325+0000","last_clean":"2023-10-16T13:11:40.981325+0000","last_became_active":"2023-10-16T13:11:40.980374+0000","last_became_peered":"2023-10-16T13:11:40.980374+0000","last_unstale":"2023-10-16T13:11:40.981325+0000","last_undegraded":"2023-10-16T13:11:40.981325+0000","last_fullsized":"2023-10-16T13:11:40.981325+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:37:40.034554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228219+0000","last_change":"2023-10-16T13:11:40.980775+0000","last_active":"2023-10-16T13:11:43.228219+0000","last_peered":"2023-10-16T13:11:43.228219+0000","last_clean":"2023-10-16T13:11:43.228219+0000","last_became_active":"2023-10-16T13:11:40.980261+0000","last_became_peered":"2023-10-16T13:11:40.980261+0000","last_unstale":"2023-10-16T13:11:43.228219+0000","last_undegraded":"2023-10-16T13:11:43.228219+0000","last_fullsized":"2023-10-16T13:11:43.228219+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:36:57.112989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.986406+0000","last_change":"2023-10-16T13:11:40.970030+0000","last_active":"2023-10-16T13:11:42.986406+0000","last_peered":"2023-10-16T13:11:42.986406+0000","last_clean":"2023-10-16T13:11:42.986406+0000","last_became_active":"2023-10-16T13:11:40.969698+0000","last_became_peered":"2023-10-16T13:11:40.969698+0000","last_unstale":"2023-10-16T13:11:42.986406+0000","last_undegraded":"2023-10-16T13:11:42.986406+0000","last_fullsized":"2023-10-16T13:11:42.986406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:42:00.520386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.307023+0000","last_change":"2023-10-16T13:11:39.957688+0000","last_active":"2023-10-16T13:11:41.307023+0000","last_peered":"2023-10-16T13:11:41.307023+0000","last_clean":"2023-10-16T13:11:41.307023+0000","last_became_active":"2023-10-16T13:11:39.957391+0000","last_became_peered":"2023-10-16T13:11:39.957391+0000","last_unstale":"2023-10-16T13:11:41.307023+0000","last_undegraded":"2023-10-16T13:11:41.307023+0000","last_fullsized":"2023-10-16T13:11:41.307023+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:42:17.875770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961607+0000","last_change":"2023-10-16T13:11:40.968984+0000","last_active":"2023-10-16T13:11:41.961607+0000","last_peered":"2023-10-16T13:11:41.961607+0000","last_clean":"2023-10-16T13:11:41.961607+0000","last_became_active":"2023-10-16T13:11:40.968338+0000","last_became_peered":"2023-10-16T13:11:40.968338+0000","last_unstale":"2023-10-16T13:11:41.961607+0000","last_undegraded":"2023-10-16T13:11:41.961607+0000","last_fullsized":"2023-10-16T13:11:41.961607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:49:21.643029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961716+0000","last_change":"2023-10-16T13:11:39.959458+0000","last_active":"2023-10-16T13:11:41.961716+0000","last_peered":"2023-10-16T13:11:41.961716+0000","last_clean":"2023-10-16T13:11:41.961716+0000","last_became_active":"2023-10-16T13:11:39.959155+0000","last_became_peered":"2023-10-16T13:11:39.959155+0000","last_unstale":"2023-10-16T13:11:41.961716+0000","last_undegraded":"2023-10-16T13:11:41.961716+0000","last_fullsized":"2023-10-16T13:11:41.961716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:18:30.725604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717655+0000","last_change":"2023-10-16T13:11:40.980168+0000","last_active":"2023-10-16T13:11:42.717655+0000","last_peered":"2023-10-16T13:11:42.717655+0000","last_clean":"2023-10-16T13:11:42.717655+0000","last_became_active":"2023-10-16T13:11:40.979839+0000","last_became_peered":"2023-10-16T13:11:40.979839+0000","last_unstale":"2023-10-16T13:11:42.717655+0000","last_undegraded":"2023-10-16T13:11:42.717655+0000","last_fullsized":"2023-10-16T13:11:42.717655+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:25:31.374291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.309228+0000","last_change":"2023-10-16T13:11:39.957065+0000","last_active":"2023-10-16T13:11:41.309228+0000","last_peered":"2023-10-16T13:11:41.309228+0000","last_clean":"2023-10-16T13:11:41.309228+0000","last_became_active":"2023-10-16T13:11:39.956759+0000","last_became_peered":"2023-10-16T13:11:39.956759+0000","last_unstale":"2023-10-16T13:11:41.309228+0000","last_undegraded":"2023-10-16T13:11:41.309228+0000","last_fullsized":"2023-10-16T13:11:41.309228+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:06:39.862025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961875+0000","last_change":"2023-10-16T13:11:40.978989+0000","last_active":"2023-10-16T13:11:41.961875+0000","last_peered":"2023-10-16T13:11:41.961875+0000","last_clean":"2023-10-16T13:11:41.961875+0000","last_became_active":"2023-10-16T13:11:40.978582+0000","last_became_peered":"2023-10-16T13:11:40.978582+0000","last_unstale":"2023-10-16T13:11:41.961875+0000","last_undegraded":"2023-10-16T13:11:41.961875+0000","last_fullsized":"2023-10-16T13:11:41.961875+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:29:54.733058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.308916+0000","last_change":"2023-10-16T13:11:39.955340+0000","last_active":"2023-10-16T13:11:41.308916+0000","last_peered":"2023-10-16T13:11:41.308916+0000","last_clean":"2023-10-16T13:11:41.308916+0000","last_became_active":"2023-10-16T13:11:39.955032+0000","last_became_peered":"2023-10-16T13:11:39.955032+0000","last_unstale":"2023-10-16T13:11:41.308916+0000","last_undegraded":"2023-10-16T13:11:41.308916+0000","last_fullsized":"2023-10-16T13:11:41.308916+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:01:11.518823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962697+0000","last_change":"2023-10-16T13:11:40.974458+0000","last_active":"2023-10-16T13:11:41.962697+0000","last_peered":"2023-10-16T13:11:41.962697+0000","last_clean":"2023-10-16T13:11:41.962697+0000","last_became_active":"2023-10-16T13:11:40.974146+0000","last_became_peered":"2023-10-16T13:11:40.974146+0000","last_unstale":"2023-10-16T13:11:41.962697+0000","last_undegraded":"2023-10-16T13:11:41.962697+0000","last_fullsized":"2023-10-16T13:11:41.962697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:57:58.851273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962486+0000","last_change":"2023-10-16T13:11:39.958561+0000","last_active":"2023-10-16T13:11:41.962486+0000","last_peered":"2023-10-16T13:11:41.962486+0000","last_clean":"2023-10-16T13:11:41.962486+0000","last_became_active":"2023-10-16T13:11:39.958272+0000","last_became_peered":"2023-10-16T13:11:39.958272+0000","last_unstale":"2023-10-16T13:11:41.962486+0000","last_undegraded":"2023-10-16T13:11:41.962486+0000","last_fullsized":"2023-10-16T13:11:41.962486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:46.162288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.971882+0000","last_change":"2023-10-16T13:11:40.970345+0000","last_active":"2023-10-16T13:11:40.971882+0000","last_peered":"2023-10-16T13:11:40.971882+0000","last_clean":"2023-10-16T13:11:40.971882+0000","last_became_active":"2023-10-16T13:11:40.970024+0000","last_became_peered":"2023-10-16T13:11:40.970024+0000","last_unstale":"2023-10-16T13:11:40.971882+0000","last_undegraded":"2023-10-16T13:11:40.971882+0000","last_fullsized":"2023-10-16T13:11:40.971882+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:51:11.150552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:45.311581+0000","last_change":"2023-10-16T13:11:39.951194+0000","last_active":"2023-10-16T13:11:45.311581+0000","last_peered":"2023-10-16T13:11:45.311581+0000","last_clean":"2023-10-16T13:11:45.311581+0000","last_became_active":"2023-10-16T13:11:39.950837+0000","last_became_peered":"2023-10-16T13:11:39.950837+0000","last_unstale":"2023-10-16T13:11:45.311581+0000","last_undegraded":"2023-10-16T13:11:45.311581+0000","last_fullsized":"2023-10-16T13:11:45.311581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:59:17.756924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962589+0000","last_change":"2023-10-16T13:11:40.959602+0000","last_active":"2023-10-16T13:11:41.962589+0000","last_peered":"2023-10-16T13:11:41.962589+0000","last_clean":"2023-10-16T13:11:41.962589+0000","last_became_active":"2023-10-16T13:11:40.959231+0000","last_became_peered":"2023-10-16T13:11:40.959231+0000","last_unstale":"2023-10-16T13:11:41.962589+0000","last_undegraded":"2023-10-16T13:11:41.962589+0000","last_fullsized":"2023-10-16T13:11:41.962589+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:59:54.623471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228231+0000","last_change":"2023-10-16T13:11:39.952655+0000","last_active":"2023-10-16T13:11:43.228231+0000","last_peered":"2023-10-16T13:11:43.228231+0000","last_clean":"2023-10-16T13:11:43.228231+0000","last_became_active":"2023-10-16T13:11:39.952324+0000","last_became_peered":"2023-10-16T13:11:39.952324+0000","last_unstale":"2023-10-16T13:11:43.228231+0000","last_undegraded":"2023-10-16T13:11:43.228231+0000","last_fullsized":"2023-10-16T13:11:43.228231+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:09:14.077837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961022+0000","last_change":"2023-10-16T13:11:40.969019+0000","last_active":"2023-10-16T13:11:41.961022+0000","last_peered":"2023-10-16T13:11:41.961022+0000","last_clean":"2023-10-16T13:11:41.961022+0000","last_became_active":"2023-10-16T13:11:40.968645+0000","last_became_peered":"2023-10-16T13:11:40.968645+0000","last_unstale":"2023-10-16T13:11:41.961022+0000","last_undegraded":"2023-10-16T13:11:41.961022+0000","last_fullsized":"2023-10-16T13:11:41.961022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:23:18.700377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962185+0000","last_change":"2023-10-16T13:11:39.959826+0000","last_active":"2023-10-16T13:11:41.962185+0000","last_peered":"2023-10-16T13:11:41.962185+0000","last_clean":"2023-10-16T13:11:41.962185+0000","last_became_active":"2023-10-16T13:11:39.959490+0000","last_became_peered":"2023-10-16T13:11:39.959490+0000","last_unstale":"2023-10-16T13:11:41.962185+0000","last_undegraded":"2023-10-16T13:11:41.962185+0000","last_fullsized":"2023-10-16T13:11:41.962185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:52:01.865005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228193+0000","last_change":"2023-10-16T13:11:40.977941+0000","last_active":"2023-10-16T13:11:43.228193+0000","last_peered":"2023-10-16T13:11:43.228193+0000","last_clean":"2023-10-16T13:11:43.228193+0000","last_became_active":"2023-10-16T13:11:40.977558+0000","last_became_peered":"2023-10-16T13:11:40.977558+0000","last_unstale":"2023-10-16T13:11:43.228193+0000","last_undegraded":"2023-10-16T13:11:43.228193+0000","last_fullsized":"2023-10-16T13:11:43.228193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:29:16.932234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:44.325775+0000","last_change":"2023-10-16T13:11:39.953728+0000","last_active":"2023-10-16T13:11:44.325775+0000","last_peered":"2023-10-16T13:11:44.325775+0000","last_clean":"2023-10-16T13:11:44.325775+0000","last_became_active":"2023-10-16T13:11:39.953421+0000","last_became_peered":"2023-10-16T13:11:39.953421+0000","last_unstale":"2023-10-16T13:11:44.325775+0000","last_undegraded":"2023-10-16T13:11:44.325775+0000","last_fullsized":"2023-10-16T13:11:44.325775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:22:14.537974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962178+0000","last_change":"2023-10-16T13:11:40.978214+0000","last_active":"2023-10-16T13:11:41.962178+0000","last_peered":"2023-10-16T13:11:41.962178+0000","last_clean":"2023-10-16T13:11:41.962178+0000","last_became_active":"2023-10-16T13:11:40.977786+0000","last_became_peered":"2023-10-16T13:11:40.977786+0000","last_unstale":"2023-10-16T13:11:41.962178+0000","last_undegraded":"2023-10-16T13:11:41.962178+0000","last_fullsized":"2023-10-16T13:11:41.962178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:43:51.218758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:44.324251+0000","last_change":"2023-10-16T13:11:39.959589+0000","last_active":"2023-10-16T13:11:44.324251+0000","last_peered":"2023-10-16T13:11:44.324251+0000","last_clean":"2023-10-16T13:11:44.324251+0000","last_became_active":"2023-10-16T13:11:39.959242+0000","last_became_peered":"2023-10-16T13:11:39.959242+0000","last_unstale":"2023-10-16T13:11:44.324251+0000","last_undegraded":"2023-10-16T13:11:44.324251+0000","last_fullsized":"2023-10-16T13:11:44.324251+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:54.955605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717681+0000","last_change":"2023-10-16T13:11:40.975814+0000","last_active":"2023-10-16T13:11:42.717681+0000","last_peered":"2023-10-16T13:11:42.717681+0000","last_clean":"2023-10-16T13:11:42.717681+0000","last_became_active":"2023-10-16T13:11:40.975485+0000","last_became_peered":"2023-10-16T13:11:40.975485+0000","last_unstale":"2023-10-16T13:11:42.717681+0000","last_undegraded":"2023-10-16T13:11:42.717681+0000","last_fullsized":"2023-10-16T13:11:42.717681+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:25.661616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962864+0000","last_change":"2023-10-16T13:11:39.956586+0000","last_active":"2023-10-16T13:11:41.962864+0000","last_peered":"2023-10-16T13:11:41.962864+0000","last_clean":"2023-10-16T13:11:41.962864+0000","last_became_active":"2023-10-16T13:11:39.956270+0000","last_became_peered":"2023-10-16T13:11:39.956270+0000","last_unstale":"2023-10-16T13:11:41.962864+0000","last_undegraded":"2023-10-16T13:11:41.962864+0000","last_fullsized":"2023-10-16T13:11:41.962864+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:11:12.435377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962008+0000","last_change":"2023-10-16T13:11:40.978918+0000","last_active":"2023-10-16T13:11:41.962008+0000","last_peered":"2023-10-16T13:11:41.962008+0000","last_clean":"2023-10-16T13:11:41.962008+0000","last_became_active":"2023-10-16T13:11:40.978520+0000","last_became_peered":"2023-10-16T13:11:40.978520+0000","last_unstale":"2023-10-16T13:11:41.962008+0000","last_undegraded":"2023-10-16T13:11:41.962008+0000","last_fullsized":"2023-10-16T13:11:41.962008+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:09:57.269111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:45.305604+0000","last_change":"2023-10-16T13:11:39.956692+0000","last_active":"2023-10-16T13:11:45.305604+0000","last_peered":"2023-10-16T13:11:45.305604+0000","last_clean":"2023-10-16T13:11:45.305604+0000","last_became_active":"2023-10-16T13:11:39.956340+0000","last_became_peered":"2023-10-16T13:11:39.956340+0000","last_unstale":"2023-10-16T13:11:45.305604+0000","last_undegraded":"2023-10-16T13:11:45.305604+0000","last_fullsized":"2023-10-16T13:11:45.305604+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:48:23.320743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.971767+0000","last_change":"2023-10-16T13:11:40.969423+0000","last_active":"2023-10-16T13:11:40.971767+0000","last_peered":"2023-10-16T13:11:40.971767+0000","last_clean":"2023-10-16T13:11:40.971767+0000","last_became_active":"2023-10-16T13:11:40.969022+0000","last_became_peered":"2023-10-16T13:11:40.969022+0000","last_unstale":"2023-10-16T13:11:40.971767+0000","last_undegraded":"2023-10-16T13:11:40.971767+0000","last_fullsized":"2023-10-16T13:11:40.971767+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:46:32.934437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:44.325797+0000","last_change":"2023-10-16T13:11:39.962364+0000","last_active":"2023-10-16T13:11:44.325797+0000","last_peered":"2023-10-16T13:11:44.325797+0000","last_clean":"2023-10-16T13:11:44.325797+0000","last_became_active":"2023-10-16T13:11:39.962077+0000","last_became_peered":"2023-10-16T13:11:39.962077+0000","last_unstale":"2023-10-16T13:11:44.325797+0000","last_undegraded":"2023-10-16T13:11:44.325797+0000","last_fullsized":"2023-10-16T13:11:44.325797+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:50:58.478054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228556+0000","last_change":"2023-10-16T13:11:40.970958+0000","last_active":"2023-10-16T13:11:43.228556+0000","last_peered":"2023-10-16T13:11:43.228556+0000","last_clean":"2023-10-16T13:11:43.228556+0000","last_became_active":"2023-10-16T13:11:40.970670+0000","last_became_peered":"2023-10-16T13:11:40.970670+0000","last_unstale":"2023-10-16T13:11:43.228556+0000","last_undegraded":"2023-10-16T13:11:43.228556+0000","last_fullsized":"2023-10-16T13:11:43.228556+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:47:30.594558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962683+0000","last_change":"2023-10-16T13:11:39.957334+0000","last_active":"2023-10-16T13:11:41.962683+0000","last_peered":"2023-10-16T13:11:41.962683+0000","last_clean":"2023-10-16T13:11:41.962683+0000","last_became_active":"2023-10-16T13:11:39.957027+0000","last_became_peered":"2023-10-16T13:11:39.957027+0000","last_unstale":"2023-10-16T13:11:41.962683+0000","last_undegraded":"2023-10-16T13:11:41.962683+0000","last_fullsized":"2023-10-16T13:11:41.962683+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:27:37.164359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972218+0000","last_change":"2023-10-16T13:11:40.977201+0000","last_active":"2023-10-16T13:11:42.972218+0000","last_peered":"2023-10-16T13:11:42.972218+0000","last_clean":"2023-10-16T13:11:42.972218+0000","last_became_active":"2023-10-16T13:11:40.976860+0000","last_became_peered":"2023-10-16T13:11:40.976860+0000","last_unstale":"2023-10-16T13:11:42.972218+0000","last_undegraded":"2023-10-16T13:11:42.972218+0000","last_fullsized":"2023-10-16T13:11:42.972218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:57.867339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.956610+0000","last_change":"2023-10-16T13:11:39.958627+0000","last_active":"2023-10-16T13:11:40.956610+0000","last_peered":"2023-10-16T13:11:40.956610+0000","last_clean":"2023-10-16T13:11:40.956610+0000","last_became_active":"2023-10-16T13:11:39.958230+0000","last_became_peered":"2023-10-16T13:11:39.958230+0000","last_unstale":"2023-10-16T13:11:40.956610+0000","last_undegraded":"2023-10-16T13:11:40.956610+0000","last_fullsized":"2023-10-16T13:11:40.956610+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:47:47.534392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.971981+0000","last_change":"2023-10-16T13:11:40.972841+0000","last_active":"2023-10-16T13:11:42.971981+0000","last_peered":"2023-10-16T13:11:42.971981+0000","last_clean":"2023-10-16T13:11:42.971981+0000","last_became_active":"2023-10-16T13:11:40.972406+0000","last_became_peered":"2023-10-16T13:11:40.972406+0000","last_unstale":"2023-10-16T13:11:42.971981+0000","last_undegraded":"2023-10-16T13:11:42.971981+0000","last_fullsized":"2023-10-16T13:11:42.971981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:04.134000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'8","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.311472+0000","last_change":"2023-10-16T13:11:39.955064+0000","last_active":"2023-10-16T13:11:41.311472+0000","last_peered":"2023-10-16T13:11:41.311472+0000","last_clean":"2023-10-16T13:11:41.311472+0000","last_became_active":"2023-10-16T13:11:39.954690+0000","last_became_peered":"2023-10-16T13:11:39.954690+0000","last_unstale":"2023-10-16T13:11:41.311472+0000","last_undegraded":"2023-10-16T13:11:41.311472+0000","last_fullsized":"2023-10-16T13:11:41.311472+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:30.341233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962429+0000","last_change":"2023-10-16T13:11:40.978373+0000","last_active":"2023-10-16T13:11:41.962429+0000","last_peered":"2023-10-16T13:11:41.962429+0000","last_clean":"2023-10-16T13:11:41.962429+0000","last_became_active":"2023-10-16T13:11:40.977890+0000","last_became_peered":"2023-10-16T13:11:40.977890+0000","last_unstale":"2023-10-16T13:11:41.962429+0000","last_undegraded":"2023-10-16T13:11:41.962429+0000","last_fullsized":"2023-10-16T13:11:41.962429+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:33:21.566200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.308167+0000","last_change":"2023-10-16T13:11:39.952698+0000","last_active":"2023-10-16T13:11:41.308167+0000","last_peered":"2023-10-16T13:11:41.308167+0000","last_clean":"2023-10-16T13:11:41.308167+0000","last_became_active":"2023-10-16T13:11:39.952383+0000","last_became_peered":"2023-10-16T13:11:39.952383+0000","last_unstale":"2023-10-16T13:11:41.308167+0000","last_undegraded":"2023-10-16T13:11:41.308167+0000","last_fullsized":"2023-10-16T13:11:41.308167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:06:57.841990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.978137+0000","last_change":"2023-10-16T13:11:40.977579+0000","last_active":"2023-10-16T13:11:40.978137+0000","last_peered":"2023-10-16T13:11:40.978137+0000","last_clean":"2023-10-16T13:11:40.978137+0000","last_became_active":"2023-10-16T13:11:40.977117+0000","last_became_peered":"2023-10-16T13:11:40.977117+0000","last_unstale":"2023-10-16T13:11:40.978137+0000","last_undegraded":"2023-10-16T13:11:40.978137+0000","last_fullsized":"2023-10-16T13:11:40.978137+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:18:10.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.963117+0000","last_change":"2023-10-16T13:11:39.957430+0000","last_active":"2023-10-16T13:11:40.963117+0000","last_peered":"2023-10-16T13:11:40.963117+0000","last_clean":"2023-10-16T13:11:40.963117+0000","last_became_active":"2023-10-16T13:11:39.957088+0000","last_became_peered":"2023-10-16T13:11:39.957088+0000","last_unstale":"2023-10-16T13:11:40.963117+0000","last_undegraded":"2023-10-16T13:11:40.963117+0000","last_fullsized":"2023-10-16T13:11:40.963117+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:21:57.307718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228189+0000","last_change":"2023-10-16T13:11:40.970009+0000","last_active":"2023-10-16T13:11:43.228189+0000","last_peered":"2023-10-16T13:11:43.228189+0000","last_clean":"2023-10-16T13:11:43.228189+0000","last_became_active":"2023-10-16T13:11:40.969668+0000","last_became_peered":"2023-10-16T13:11:40.969668+0000","last_unstale":"2023-10-16T13:11:43.228189+0000","last_undegraded":"2023-10-16T13:11:43.228189+0000","last_fullsized":"2023-10-16T13:11:43.228189+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:48:35.556712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972101+0000","last_change":"2023-10-16T13:11:39.958168+0000","last_active":"2023-10-16T13:11:42.972101+0000","last_peered":"2023-10-16T13:11:42.972101+0000","last_clean":"2023-10-16T13:11:42.972101+0000","last_became_active":"2023-10-16T13:11:39.957628+0000","last_became_peered":"2023-10-16T13:11:39.957628+0000","last_unstale":"2023-10-16T13:11:42.972101+0000","last_undegraded":"2023-10-16T13:11:42.972101+0000","last_fullsized":"2023-10-16T13:11:42.972101+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:55:52.658523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228154+0000","last_change":"2023-10-16T13:11:40.977161+0000","last_active":"2023-10-16T13:11:43.228154+0000","last_peered":"2023-10-16T13:11:43.228154+0000","last_clean":"2023-10-16T13:11:43.228154+0000","last_became_active":"2023-10-16T13:11:40.976821+0000","last_became_peered":"2023-10-16T13:11:40.976821+0000","last_unstale":"2023-10-16T13:11:43.228154+0000","last_undegraded":"2023-10-16T13:11:43.228154+0000","last_fullsized":"2023-10-16T13:11:43.228154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:42:26.712826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962502+0000","last_change":"2023-10-16T13:11:40.966680+0000","last_active":"2023-10-16T13:11:41.962502+0000","last_peered":"2023-10-16T13:11:41.962502+0000","last_clean":"2023-10-16T13:11:41.962502+0000","last_became_active":"2023-10-16T13:11:40.966332+0000","last_became_peered":"2023-10-16T13:11:40.966332+0000","last_unstale":"2023-10-16T13:11:41.962502+0000","last_undegraded":"2023-10-16T13:11:41.962502+0000","last_fullsized":"2023-10-16T13:11:41.962502+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:06:42.963312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228139+0000","last_change":"2023-10-16T13:11:39.960180+0000","last_active":"2023-10-16T13:11:43.228139+0000","last_peered":"2023-10-16T13:11:43.228139+0000","last_clean":"2023-10-16T13:11:43.228139+0000","last_became_active":"2023-10-16T13:11:39.959816+0000","last_became_peered":"2023-10-16T13:11:39.959816+0000","last_unstale":"2023-10-16T13:11:43.228139+0000","last_undegraded":"2023-10-16T13:11:43.228139+0000","last_fullsized":"2023-10-16T13:11:43.228139+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:14:08.890449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961527+0000","last_change":"2023-10-16T13:11:40.975271+0000","last_active":"2023-10-16T13:11:41.961527+0000","last_peered":"2023-10-16T13:11:41.961527+0000","last_clean":"2023-10-16T13:11:41.961527+0000","last_became_active":"2023-10-16T13:11:40.974960+0000","last_became_peered":"2023-10-16T13:11:40.974960+0000","last_unstale":"2023-10-16T13:11:41.961527+0000","last_undegraded":"2023-10-16T13:11:41.961527+0000","last_fullsized":"2023-10-16T13:11:41.961527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:09.467960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.956563+0000","last_change":"2023-10-16T13:11:39.951187+0000","last_active":"2023-10-16T13:11:40.956563+0000","last_peered":"2023-10-16T13:11:40.956563+0000","last_clean":"2023-10-16T13:11:40.956563+0000","last_became_active":"2023-10-16T13:11:39.950843+0000","last_became_peered":"2023-10-16T13:11:39.950843+0000","last_unstale":"2023-10-16T13:11:40.956563+0000","last_undegraded":"2023-10-16T13:11:40.956563+0000","last_fullsized":"2023-10-16T13:11:40.956563+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:48.930247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":308,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.963466+0000","last_change":"2023-10-16T13:10:38.800469+0000","last_active":"2023-10-16T13:11:40.963466+0000","last_peered":"2023-10-16T13:11:40.963466+0000","last_clean":"2023-10-16T13:11:40.963466+0000","last_became_active":"2023-10-16T13:10:38.799911+0000","last_became_peered":"2023-10-16T13:10:38.799911+0000","last_unstale":"2023-10-16T13:11:40.963466+0000","last_undegraded":"2023-10-16T13:11:40.963466+0000","last_fullsized":"2023-10-16T13:11:40.963466+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:07:46.238647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:07:46.238647+0000","last_clean_scrub_stamp":"2023-10-16T13:07:46.238647+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:43:42.258738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228225+0000","last_change":"2023-10-16T13:11:40.974984+0000","last_active":"2023-10-16T13:11:43.228225+0000","last_peered":"2023-10-16T13:11:43.228225+0000","last_clean":"2023-10-16T13:11:43.228225+0000","last_became_active":"2023-10-16T13:11:40.974689+0000","last_became_peered":"2023-10-16T13:11:40.974689+0000","last_unstale":"2023-10-16T13:11:43.228225+0000","last_undegraded":"2023-10-16T13:11:43.228225+0000","last_fullsized":"2023-10-16T13:11:43.228225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:04.119797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:45.313167+0000","last_change":"2023-10-16T13:11:39.957999+0000","last_active":"2023-10-16T13:11:45.313167+0000","last_peered":"2023-10-16T13:11:45.313167+0000","last_clean":"2023-10-16T13:11:45.313167+0000","last_became_active":"2023-10-16T13:11:39.957043+0000","last_became_peered":"2023-10-16T13:11:39.957043+0000","last_unstale":"2023-10-16T13:11:45.313167+0000","last_undegraded":"2023-10-16T13:11:45.313167+0000","last_fullsized":"2023-10-16T13:11:45.313167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:12:27.150065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.962975+0000","last_change":"2023-10-16T13:11:39.953082+0000","last_active":"2023-10-16T13:11:40.962975+0000","last_peered":"2023-10-16T13:11:40.962975+0000","last_clean":"2023-10-16T13:11:40.962975+0000","last_became_active":"2023-10-16T13:11:39.952785+0000","last_became_peered":"2023-10-16T13:11:39.952785+0000","last_unstale":"2023-10-16T13:11:40.962975+0000","last_undegraded":"2023-10-16T13:11:40.962975+0000","last_fullsized":"2023-10-16T13:11:40.962975+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:06:34.427841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228109+0000","last_change":"2023-10-16T13:11:40.968761+0000","last_active":"2023-10-16T13:11:43.228109+0000","last_peered":"2023-10-16T13:11:43.228109+0000","last_clean":"2023-10-16T13:11:43.228109+0000","last_became_active":"2023-10-16T13:11:40.968466+0000","last_became_peered":"2023-10-16T13:11:40.968466+0000","last_unstale":"2023-10-16T13:11:43.228109+0000","last_undegraded":"2023-10-16T13:11:43.228109+0000","last_fullsized":"2023-10-16T13:11:43.228109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:22:15.577411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228273+0000","last_change":"2023-10-16T13:11:39.957019+0000","last_active":"2023-10-16T13:11:43.228273+0000","last_peered":"2023-10-16T13:11:43.228273+0000","last_clean":"2023-10-16T13:11:43.228273+0000","last_became_active":"2023-10-16T13:11:39.956687+0000","last_became_peered":"2023-10-16T13:11:39.956687+0000","last_unstale":"2023-10-16T13:11:43.228273+0000","last_undegraded":"2023-10-16T13:11:43.228273+0000","last_fullsized":"2023-10-16T13:11:43.228273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:17.049740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961461+0000","last_change":"2023-10-16T13:11:40.973938+0000","last_active":"2023-10-16T13:11:41.961461+0000","last_peered":"2023-10-16T13:11:41.961461+0000","last_clean":"2023-10-16T13:11:41.961461+0000","last_became_active":"2023-10-16T13:11:40.973579+0000","last_became_peered":"2023-10-16T13:11:40.973579+0000","last_unstale":"2023-10-16T13:11:41.961461+0000","last_undegraded":"2023-10-16T13:11:41.961461+0000","last_fullsized":"2023-10-16T13:11:41.961461+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:49:29.153231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.307575+0000","last_change":"2023-10-16T13:11:39.954368+0000","last_active":"2023-10-16T13:11:41.307575+0000","last_peered":"2023-10-16T13:11:41.307575+0000","last_clean":"2023-10-16T13:11:41.307575+0000","last_became_active":"2023-10-16T13:11:39.953967+0000","last_became_peered":"2023-10-16T13:11:39.953967+0000","last_unstale":"2023-10-16T13:11:41.307575+0000","last_undegraded":"2023-10-16T13:11:41.307575+0000","last_fullsized":"2023-10-16T13:11:41.307575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:43:49.278655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717616+0000","last_change":"2023-10-16T13:11:40.975917+0000","last_active":"2023-10-16T13:11:42.717616+0000","last_peered":"2023-10-16T13:11:42.717616+0000","last_clean":"2023-10-16T13:11:42.717616+0000","last_became_active":"2023-10-16T13:11:40.975610+0000","last_became_peered":"2023-10-16T13:11:40.975610+0000","last_unstale":"2023-10-16T13:11:42.717616+0000","last_undegraded":"2023-10-16T13:11:42.717616+0000","last_fullsized":"2023-10-16T13:11:42.717616+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:41.006584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961666+0000","last_change":"2023-10-16T13:11:39.960169+0000","last_active":"2023-10-16T13:11:41.961666+0000","last_peered":"2023-10-16T13:11:41.961666+0000","last_clean":"2023-10-16T13:11:41.961666+0000","last_became_active":"2023-10-16T13:11:39.959385+0000","last_became_peered":"2023-10-16T13:11:39.959385+0000","last_unstale":"2023-10-16T13:11:41.961666+0000","last_undegraded":"2023-10-16T13:11:41.961666+0000","last_fullsized":"2023-10-16T13:11:41.961666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:50:12.442686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.971944+0000","last_change":"2023-10-16T13:11:40.971165+0000","last_active":"2023-10-16T13:11:40.971944+0000","last_peered":"2023-10-16T13:11:40.971944+0000","last_clean":"2023-10-16T13:11:40.971944+0000","last_became_active":"2023-10-16T13:11:40.970341+0000","last_became_peered":"2023-10-16T13:11:40.970341+0000","last_unstale":"2023-10-16T13:11:40.971944+0000","last_undegraded":"2023-10-16T13:11:40.971944+0000","last_fullsized":"2023-10-16T13:11:40.971944+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:31:35.827863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:44.323951+0000","last_change":"2023-10-16T13:11:39.953044+0000","last_active":"2023-10-16T13:11:44.323951+0000","last_peered":"2023-10-16T13:11:44.323951+0000","last_clean":"2023-10-16T13:11:44.323951+0000","last_became_active":"2023-10-16T13:11:39.952752+0000","last_became_peered":"2023-10-16T13:11:39.952752+0000","last_unstale":"2023-10-16T13:11:44.323951+0000","last_undegraded":"2023-10-16T13:11:44.323951+0000","last_fullsized":"2023-10-16T13:11:44.323951+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:33:12.277430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.975438+0000","last_change":"2023-10-16T13:11:40.974739+0000","last_active":"2023-10-16T13:11:40.975438+0000","last_peered":"2023-10-16T13:11:40.975438+0000","last_clean":"2023-10-16T13:11:40.975438+0000","last_became_active":"2023-10-16T13:11:40.974387+0000","last_became_peered":"2023-10-16T13:11:40.974387+0000","last_unstale":"2023-10-16T13:11:40.975438+0000","last_undegraded":"2023-10-16T13:11:40.975438+0000","last_fullsized":"2023-10-16T13:11:40.975438+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:24:49.060876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.961672+0000","last_change":"2023-10-16T13:11:39.960427+0000","last_active":"2023-10-16T13:11:40.961672+0000","last_peered":"2023-10-16T13:11:40.961672+0000","last_clean":"2023-10-16T13:11:40.961672+0000","last_became_active":"2023-10-16T13:11:39.959928+0000","last_became_peered":"2023-10-16T13:11:39.959928+0000","last_unstale":"2023-10-16T13:11:40.961672+0000","last_undegraded":"2023-10-16T13:11:40.961672+0000","last_fullsized":"2023-10-16T13:11:40.961672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:38:37.073782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961407+0000","last_change":"2023-10-16T13:11:40.971153+0000","last_active":"2023-10-16T13:11:41.961407+0000","last_peered":"2023-10-16T13:11:41.961407+0000","last_clean":"2023-10-16T13:11:41.961407+0000","last_became_active":"2023-10-16T13:11:40.970772+0000","last_became_peered":"2023-10-16T13:11:40.970772+0000","last_unstale":"2023-10-16T13:11:41.961407+0000","last_undegraded":"2023-10-16T13:11:41.961407+0000","last_fullsized":"2023-10-16T13:11:41.961407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:34.450600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.309343+0000","last_change":"2023-10-16T13:11:39.957589+0000","last_active":"2023-10-16T13:11:41.309343+0000","last_peered":"2023-10-16T13:11:41.309343+0000","last_clean":"2023-10-16T13:11:41.309343+0000","last_became_active":"2023-10-16T13:11:39.957334+0000","last_became_peered":"2023-10-16T13:11:39.957334+0000","last_unstale":"2023-10-16T13:11:41.309343+0000","last_undegraded":"2023-10-16T13:11:41.309343+0000","last_fullsized":"2023-10-16T13:11:41.309343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:42:58.126279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972160+0000","last_change":"2023-10-16T13:11:40.979906+0000","last_active":"2023-10-16T13:11:42.972160+0000","last_peered":"2023-10-16T13:11:42.972160+0000","last_clean":"2023-10-16T13:11:42.972160+0000","last_became_active":"2023-10-16T13:11:40.979506+0000","last_became_peered":"2023-10-16T13:11:40.979506+0000","last_unstale":"2023-10-16T13:11:42.972160+0000","last_undegraded":"2023-10-16T13:11:42.972160+0000","last_fullsized":"2023-10-16T13:11:42.972160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:06:33.566642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.963060+0000","last_change":"2023-10-16T13:11:39.961062+0000","last_active":"2023-10-16T13:11:40.963060+0000","last_peered":"2023-10-16T13:11:40.963060+0000","last_clean":"2023-10-16T13:11:40.963060+0000","last_became_active":"2023-10-16T13:11:39.960615+0000","last_became_peered":"2023-10-16T13:11:39.960615+0000","last_unstale":"2023-10-16T13:11:40.963060+0000","last_undegraded":"2023-10-16T13:11:40.963060+0000","last_fullsized":"2023-10-16T13:11:40.963060+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:59:52.598863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972447+0000","last_change":"2023-10-16T13:11:40.979874+0000","last_active":"2023-10-16T13:11:42.972447+0000","last_peered":"2023-10-16T13:11:42.972447+0000","last_clean":"2023-10-16T13:11:42.972447+0000","last_became_active":"2023-10-16T13:11:40.979444+0000","last_became_peered":"2023-10-16T13:11:40.979444+0000","last_unstale":"2023-10-16T13:11:42.972447+0000","last_undegraded":"2023-10-16T13:11:42.972447+0000","last_fullsized":"2023-10-16T13:11:42.972447+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:27:38.533986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962615+0000","last_change":"2023-10-16T13:11:39.962428+0000","last_active":"2023-10-16T13:11:41.962615+0000","last_peered":"2023-10-16T13:11:41.962615+0000","last_clean":"2023-10-16T13:11:41.962615+0000","last_became_active":"2023-10-16T13:11:39.962028+0000","last_became_peered":"2023-10-16T13:11:39.962028+0000","last_unstale":"2023-10-16T13:11:41.962615+0000","last_undegraded":"2023-10-16T13:11:41.962615+0000","last_fullsized":"2023-10-16T13:11:41.962615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:43:25.415571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972234+0000","last_change":"2023-10-16T13:11:40.969804+0000","last_active":"2023-10-16T13:11:42.972234+0000","last_peered":"2023-10-16T13:11:42.972234+0000","last_clean":"2023-10-16T13:11:42.972234+0000","last_became_active":"2023-10-16T13:11:40.969339+0000","last_became_peered":"2023-10-16T13:11:40.969339+0000","last_unstale":"2023-10-16T13:11:42.972234+0000","last_undegraded":"2023-10-16T13:11:42.972234+0000","last_fullsized":"2023-10-16T13:11:42.972234+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:14:15.533029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.306815+0000","last_change":"2023-10-16T13:11:39.960173+0000","last_active":"2023-10-16T13:11:41.306815+0000","last_peered":"2023-10-16T13:11:41.306815+0000","last_clean":"2023-10-16T13:11:41.306815+0000","last_became_active":"2023-10-16T13:11:39.959839+0000","last_became_peered":"2023-10-16T13:11:39.959839+0000","last_unstale":"2023-10-16T13:11:41.306815+0000","last_undegraded":"2023-10-16T13:11:41.306815+0000","last_fullsized":"2023-10-16T13:11:41.306815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:31:16.379341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972451+0000","last_change":"2023-10-16T13:11:40.974349+0000","last_active":"2023-10-16T13:11:42.972451+0000","last_peered":"2023-10-16T13:11:42.972451+0000","last_clean":"2023-10-16T13:11:42.972451+0000","last_became_active":"2023-10-16T13:11:40.973189+0000","last_became_peered":"2023-10-16T13:11:40.973189+0000","last_unstale":"2023-10-16T13:11:42.972451+0000","last_undegraded":"2023-10-16T13:11:42.972451+0000","last_fullsized":"2023-10-16T13:11:42.972451+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:45:05.177277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.974596+0000","last_change":"2023-10-16T13:11:40.972862+0000","last_active":"2023-10-16T13:11:40.974596+0000","last_peered":"2023-10-16T13:11:40.974596+0000","last_clean":"2023-10-16T13:11:40.974596+0000","last_became_active":"2023-10-16T13:11:40.972558+0000","last_became_peered":"2023-10-16T13:11:40.972558+0000","last_unstale":"2023-10-16T13:11:40.974596+0000","last_undegraded":"2023-10-16T13:11:40.974596+0000","last_fullsized":"2023-10-16T13:11:40.974596+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:22.438801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.985989+0000","last_change":"2023-10-16T13:11:40.973449+0000","last_active":"2023-10-16T13:11:42.985989+0000","last_peered":"2023-10-16T13:11:42.985989+0000","last_clean":"2023-10-16T13:11:42.985989+0000","last_became_active":"2023-10-16T13:11:40.973044+0000","last_became_peered":"2023-10-16T13:11:40.973044+0000","last_unstale":"2023-10-16T13:11:42.985989+0000","last_undegraded":"2023-10-16T13:11:42.985989+0000","last_fullsized":"2023-10-16T13:11:42.985989+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:22.883943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.986056+0000","last_change":"2023-10-16T13:11:40.970871+0000","last_active":"2023-10-16T13:11:42.986056+0000","last_peered":"2023-10-16T13:11:42.986056+0000","last_clean":"2023-10-16T13:11:42.986056+0000","last_became_active":"2023-10-16T13:11:40.970554+0000","last_became_peered":"2023-10-16T13:11:40.970554+0000","last_unstale":"2023-10-16T13:11:42.986056+0000","last_undegraded":"2023-10-16T13:11:42.986056+0000","last_fullsized":"2023-10-16T13:11:42.986056+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:46:34.449007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717476+0000","last_change":"2023-10-16T13:11:40.975827+0000","last_active":"2023-10-16T13:11:42.717476+0000","last_peered":"2023-10-16T13:11:42.717476+0000","last_clean":"2023-10-16T13:11:42.717476+0000","last_became_active":"2023-10-16T13:11:40.975514+0000","last_became_peered":"2023-10-16T13:11:40.975514+0000","last_unstale":"2023-10-16T13:11:42.717476+0000","last_undegraded":"2023-10-16T13:11:42.717476+0000","last_fullsized":"2023-10-16T13:11:42.717476+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:34:47.901390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228201+0000","last_change":"2023-10-16T13:11:40.975088+0000","last_active":"2023-10-16T13:11:43.228201+0000","last_peered":"2023-10-16T13:11:43.228201+0000","last_clean":"2023-10-16T13:11:43.228201+0000","last_became_active":"2023-10-16T13:11:40.974286+0000","last_became_peered":"2023-10-16T13:11:40.974286+0000","last_unstale":"2023-10-16T13:11:43.228201+0000","last_undegraded":"2023-10-16T13:11:43.228201+0000","last_fullsized":"2023-10-16T13:11:43.228201+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:15:50.270651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.974369+0000","last_change":"2023-10-16T13:11:40.973111+0000","last_active":"2023-10-16T13:11:40.974369+0000","last_peered":"2023-10-16T13:11:40.974369+0000","last_clean":"2023-10-16T13:11:40.974369+0000","last_became_active":"2023-10-16T13:11:40.972826+0000","last_became_peered":"2023-10-16T13:11:40.972826+0000","last_unstale":"2023-10-16T13:11:40.974369+0000","last_undegraded":"2023-10-16T13:11:40.974369+0000","last_fullsized":"2023-10-16T13:11:40.974369+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:28:59.134860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.986501+0000","last_change":"2023-10-16T13:11:40.980303+0000","last_active":"2023-10-16T13:11:42.986501+0000","last_peered":"2023-10-16T13:11:42.986501+0000","last_clean":"2023-10-16T13:11:42.986501+0000","last_became_active":"2023-10-16T13:11:40.979987+0000","last_became_peered":"2023-10-16T13:11:40.979987+0000","last_unstale":"2023-10-16T13:11:42.986501+0000","last_undegraded":"2023-10-16T13:11:42.986501+0000","last_fullsized":"2023-10-16T13:11:42.986501+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:38:16.402231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961388+0000","last_change":"2023-10-16T13:11:40.966547+0000","last_active":"2023-10-16T13:11:41.961388+0000","last_peered":"2023-10-16T13:11:41.961388+0000","last_clean":"2023-10-16T13:11:41.961388+0000","last_became_active":"2023-10-16T13:11:40.966149+0000","last_became_peered":"2023-10-16T13:11:40.966149+0000","last_unstale":"2023-10-16T13:11:41.961388+0000","last_undegraded":"2023-10-16T13:11:41.961388+0000","last_fullsized":"2023-10-16T13:11:41.961388+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:27:47.007356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962374+0000","last_change":"2023-10-16T13:11:40.968511+0000","last_active":"2023-10-16T13:11:41.962374+0000","last_peered":"2023-10-16T13:11:41.962374+0000","last_clean":"2023-10-16T13:11:41.962374+0000","last_became_active":"2023-10-16T13:11:40.968185+0000","last_became_peered":"2023-10-16T13:11:40.968185+0000","last_unstale":"2023-10-16T13:11:41.962374+0000","last_undegraded":"2023-10-16T13:11:41.962374+0000","last_fullsized":"2023-10-16T13:11:41.962374+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:31:43.779875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961188+0000","last_change":"2023-10-16T13:11:40.974616+0000","last_active":"2023-10-16T13:11:41.961188+0000","last_peered":"2023-10-16T13:11:41.961188+0000","last_clean":"2023-10-16T13:11:41.961188+0000","last_became_active":"2023-10-16T13:11:40.974295+0000","last_became_peered":"2023-10-16T13:11:40.974295+0000","last_unstale":"2023-10-16T13:11:41.961188+0000","last_undegraded":"2023-10-16T13:11:41.961188+0000","last_fullsized":"2023-10-16T13:11:41.961188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:47.838853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961878+0000","last_change":"2023-10-16T13:11:40.974927+0000","last_active":"2023-10-16T13:11:41.961878+0000","last_peered":"2023-10-16T13:11:41.961878+0000","last_clean":"2023-10-16T13:11:41.961878+0000","last_became_active":"2023-10-16T13:11:40.974332+0000","last_became_peered":"2023-10-16T13:11:40.974332+0000","last_unstale":"2023-10-16T13:11:41.961878+0000","last_undegraded":"2023-10-16T13:11:41.961878+0000","last_fullsized":"2023-10-16T13:11:41.961878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:07:24.974440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228631+0000","last_change":"2023-10-16T13:11:40.972793+0000","last_active":"2023-10-16T13:11:43.228631+0000","last_peered":"2023-10-16T13:11:43.228631+0000","last_clean":"2023-10-16T13:11:43.228631+0000","last_became_active":"2023-10-16T13:11:40.972008+0000","last_became_peered":"2023-10-16T13:11:40.972008+0000","last_unstale":"2023-10-16T13:11:43.228631+0000","last_undegraded":"2023-10-16T13:11:43.228631+0000","last_fullsized":"2023-10-16T13:11:43.228631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:53.487238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.978249+0000","last_change":"2023-10-16T13:11:40.977282+0000","last_active":"2023-10-16T13:11:40.978249+0000","last_peered":"2023-10-16T13:11:40.978249+0000","last_clean":"2023-10-16T13:11:40.978249+0000","last_became_active":"2023-10-16T13:11:40.976872+0000","last_became_peered":"2023-10-16T13:11:40.976872+0000","last_unstale":"2023-10-16T13:11:40.978249+0000","last_undegraded":"2023-10-16T13:11:40.978249+0000","last_fullsized":"2023-10-16T13:11:40.978249+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:12.766124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2590,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":71,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":192512,"data_stored":12894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449099,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":416430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":10,"up_from":71,"seq":304942678032,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1519616,"data_stored":1017936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.377},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48999999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47399999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.41099999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.57799999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.63},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.59199999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.504}]},{"osd":8,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.65600000000000003}]},{"osd":9,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.71099999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":9,"up_from":66,"seq":283467841557,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":892928,"data_stored":425582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.311},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.34300000000000003}]},{"osd":1,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.44900000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.505}]},{"osd":3,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.41099999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.438}]},{"osd":5,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.46000000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.39600000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.63800000000000001}]},{"osd":8,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.56299999999999994}]},{"osd":10,"last update":"Mon Oct 16 13:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.621}]}]},{"osd":8,"up_from":59,"seq":253403070488,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":417034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.51000000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.59899999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.68799999999999994}]},{"osd":3,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.65600000000000003}]},{"osd":4,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.79900000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.84499999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.91600000000000004}]},{"osd":9,"last update":"Mon Oct 16 13:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.92600000000000005}]},{"osd":10,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.694,"5min":3.694,"15min":3.694},"last":0.96499999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]}]},{"osd":7,"up_from":51,"seq":219043332125,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28480,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716672,"statfs":{"total":95995035648,"available":95965872128,"internally_reserved":0,"allocated":1499136,"data_stored":1017160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.38},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.34699999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41199999999999998,"15min":0.40799999999999997},"min":{"1min":0.29999999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.60199999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.433,"5min":0.40999999999999998,"15min":0.40600000000000003},"min":{"1min":0.29899999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.58499999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.57099999999999995}]},{"osd":2,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.42899999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.40500000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.66200000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.442,"5min":0.37,"15min":0.37},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.754,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.76500000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.49299999999999999,"15min":0.48599999999999999},"min":{"1min":0.35699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46800000000000003,"15min":0.46100000000000002},"min":{"1min":0.36499999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.72399999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.45000000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.66300000000000003,"15min":0.65400000000000003},"min":{"1min":0.56899999999999995,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.749}]},{"osd":6,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65900000000000003,"15min":0.65500000000000003},"min":{"1min":0.436,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.54100000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":1.0409999999999999}]},{"osd":8,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.88300000000000001}]},{"osd":9,"last update":"Mon Oct 16 13:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":1.073},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.95299999999999996}]},{"osd":10,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":1.0589999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]}]},{"osd":6,"up_from":46,"seq":197568495650,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":888832,"data_stored":425000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.376},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63600000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.34899999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.59199999999999997,"15min":0.58099999999999996},"min":{"1min":0.38700000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.40899999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.997,"5min":1,"15min":1},"last":0.68600000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.377,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61699999999999999,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.878,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.55900000000000005}]},{"osd":3,"last update":"Mon Oct 16 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45100000000000001,"15min":0.44600000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.47699999999999998,"15min":0.47099999999999997},"min":{"1min":0.316,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.39900000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63500000000000001,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.621},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.40500000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89000000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.60699999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.67900000000000005,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.50600000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.68400000000000005,"15min":0.67500000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.45500000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67100000000000004}]},{"osd":8,"last update":"Mon Oct 16 13:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.63900000000000001}]},{"osd":9,"last update":"Mon Oct 16 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.47499999999999998}]},{"osd":10,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.78900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":888832,"data_stored":418042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48299999999999998,"15min":0.45600000000000002},"min":{"1min":0.30099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73899999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.51600000000000001,"15min":0.47599999999999998},"min":{"1min":0.42699999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.83299999999999996,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.35099999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51800000000000002,"15min":0.51400000000000001},"min":{"1min":0.39100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.51800000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53500000000000003,"15min":0.503},"min":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72799999999999998,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.54900000000000004,"15min":0.51500000000000001},"min":{"1min":0.46200000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91900000000000004,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.495}]},{"osd":4,"last update":"Mon Oct 16 13:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.40400000000000003,"15min":0.39500000000000002},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.31},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.434,"15min":0.42599999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.42499999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.59699999999999998,"15min":0.58799999999999997},"min":{"1min":0.44900000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.57999999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:11:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64100000000000001,"15min":0.64300000000000002},"min":{"1min":0.44800000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93400000000000005,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63400000000000001,"15min":0.63100000000000001},"min":{"1min":0.39300000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95199999999999996,"5min":1.429,"15min":1.429},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Oct 16 13:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.44700000000000001}]},{"osd":8,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.57299999999999995}]},{"osd":9,"last update":"Mon Oct 16 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.53500000000000003}]},{"osd":10,"last update":"Mon Oct 16 13:11:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":427066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.51900000000000002,"15min":0.503},"min":{"1min":0.33400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.52900000000000003,"15min":0.501},"min":{"1min":0.35199999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.88900000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.77400000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:10:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54700000000000004,"15min":0.53200000000000003},"min":{"1min":0.42099999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76800000000000002,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.33500000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.752,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.56699999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41999999999999998,"15min":0.42199999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.55800000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.48099999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.53800000000000003,"15min":0.50600000000000001},"min":{"1min":0.36199999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.57099999999999995,"15min":0.55000000000000004},"min":{"1min":0.39200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.57599999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:10:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74099999999999999,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.70199999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.497,"15min":0.49399999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.85699999999999998,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.48599999999999999,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.39700000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.42099999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0169999999999999,"5min":1.51,"15min":1.51},"last":0.61199999999999999}]},{"osd":8,"last update":"Mon Oct 16 13:10:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.624}]},{"osd":9,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.53400000000000003}]},{"osd":10,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.75},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.73699999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411379,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":426646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.73399999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.51600000000000001,"15min":0.51400000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.747}]},{"osd":1,"last update":"Mon Oct 16 13:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.504,"15min":0.48599999999999999},"min":{"1min":0.40899999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.51300000000000001,"15min":0.49299999999999999},"min":{"1min":0.41999999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.74299999999999999,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.77800000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:11:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.39800000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81999999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.60799999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58199999999999996,"15min":0.57099999999999995},"min":{"1min":0.39700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.80400000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.56000000000000005,"15min":0.53100000000000003},"min":{"1min":0.52400000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85499999999999998,"5min":0.879,"15min":0.879},"last":0.98899999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32300000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.501,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.30099999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.97199999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:11:11 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.44500000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.81499999999999995}]},{"osd":7,"last update":"Mon Oct 16 13:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.49099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.58599999999999997}]},{"osd":8,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.84299999999999997}]},{"osd":9,"last update":"Mon Oct 16 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.95699999999999996}]},{"osd":10,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":1.034},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":1.0209999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]}]},{"osd":3,"up_from":25,"seq":107374182447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":425003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.34300000000000003,"15min":0.33000000000000002},"min":{"1min":0.26800000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.52600000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.36099999999999999,"15min":0.34300000000000003},"min":{"1min":0.29699999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55300000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.39400000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.51800000000000002,"15min":0.503},"min":{"1min":0.40100000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.74399999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.62},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.52100000000000002,"15min":0.495},"min":{"1min":0.42199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.504}]},{"osd":2,"last update":"Mon Oct 16 13:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.39800000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.745,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55600000000000005,"15min":0.53600000000000003},"min":{"1min":0.32400000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.73599999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58799999999999997,"15min":0.54100000000000004},"min":{"1min":0.38600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.76700000000000002,"5min":6.032,"15min":6.032},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.55000000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:10:51 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.45700000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.755,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.50600000000000001,"15min":0.502},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73699999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.43099999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.56899999999999995}]},{"osd":7,"last update":"Mon Oct 16 13:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65900000000000003,"15min":0.64800000000000002},"min":{"1min":0.40500000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.63500000000000001,"15min":0.625},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.65400000000000003}]},{"osd":8,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.55500000000000005}]},{"osd":9,"last update":"Mon Oct 16 13:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.58299999999999996}]},{"osd":10,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.68000000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":4,"up_from":33,"seq":141733920809,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":416452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.497,"15min":0.48799999999999999},"min":{"1min":0.377,"5min":0.318,"15min":0.318},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.51100000000000001,"15min":0.495},"min":{"1min":0.41899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.41899999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.36599999999999999},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.311},{"interface":"front","average":{"1min":0.499,"5min":0.41399999999999998,"15min":0.39600000000000002},"min":{"1min":0.27900000000000003,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52700000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77700000000000002,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.57399999999999995,"15min":0.54900000000000004},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.56000000000000005,"15min":0.54000000000000004},"min":{"1min":0.44900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78300000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.374,"5min":0.312,"15min":0.312},"max":{"1min":0.83499999999999996,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.39200000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.58899999999999997,"15min":0.57899999999999996},"min":{"1min":0.48199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.66400000000000003}]},{"osd":6,"last update":"Mon Oct 16 13:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91100000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.44500000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.55000000000000004,"15min":0.52900000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.78100000000000003}]},{"osd":8,"last update":"Mon Oct 16 13:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.70999999999999996}]},{"osd":9,"last update":"Mon Oct 16 13:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.48699999999999999}]},{"osd":10,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.65100000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":5,"up_from":38,"seq":163208757286,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1490944,"data_stored":1015219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.496},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54400000000000004,"15min":0.53800000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83199999999999996,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.52800000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.52000000000000002,"15min":0.51100000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.73799999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.35399999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83499999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40000000000000002},"min":{"1min":0.315,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.499,"5min":0.42199999999999999,"15min":0.40899999999999997},"min":{"1min":0.30499999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.628}]},{"osd":3,"last update":"Mon Oct 16 13:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.45400000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79800000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66300000000000003}]},{"osd":4,"last update":"Mon Oct 16 13:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.443,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77400000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.56499999999999995,"15min":0.55400000000000005},"min":{"1min":0.442,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.72099999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.623,"15min":0.62},"min":{"1min":0.42199999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.46600000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.83299999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.77000000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.876,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64900000000000002,"15min":0.65000000000000002},"min":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.85199999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.82899999999999996}]},{"osd":8,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.755},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.90600000000000003}]},{"osd":9,"last update":"Mon Oct 16 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.871}]},{"osd":10,"last update":"Mon Oct 16 13:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":4.4859999999999998,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.89500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:11:49.002 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:11:49.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.155+0000 7f893a55f700 1 -- 172.21.15.92:0/1849525731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8934102a50 msgr2=0x7f8934109370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:49.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.155+0000 7f893a55f700 1 --2- 172.21.15.92:0/1849525731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8934102a50 0x7f8934109370 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f892c00b0a0 tx=0x7f892c00b3b0 comp rx=0 tx=0).stop 2023-10-16T13:11:49.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.155+0000 7f893a55f700 1 -- 172.21.15.92:0/1849525731 shutdown_connections 2023-10-16T13:11:49.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.155+0000 7f893a55f700 1 --2- 172.21.15.92:0/1849525731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8934102a50 0x7f8934109370 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:49.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.155+0000 7f893a55f700 1 --2- 172.21.15.92:0/1849525731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8934100eb0 0x7f89341012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:49.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.155+0000 7f893a55f700 1 --2- 172.21.15.92:0/1849525731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8934102090 0x7f8934102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:49.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.155+0000 7f893a55f700 1 -- 172.21.15.92:0/1849525731 >> 172.21.15.92:0/1849525731 conn(0x7f89340fc470 msgr2=0x7f89340fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:49.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.155+0000 7f893a55f700 1 -- 172.21.15.92:0/1849525731 shutdown_connections 2023-10-16T13:11:49.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.155+0000 7f893a55f700 1 -- 172.21.15.92:0/1849525731 wait complete. 2023-10-16T13:11:49.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.155+0000 7f893a55f700 1 Processor -- start 2023-10-16T13:11:49.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.155+0000 7f893a55f700 1 -- start start 2023-10-16T13:11:49.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f893a55f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8934100eb0 0x7f8934196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:49.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f893a55f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8934102090 0x7f89341971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:49.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f893a55f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8934102a50 0x7f893419e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:49.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f893a55f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893419e800 con 0x7f8934102090 2023-10-16T13:11:49.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f893a55f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893419e970 con 0x7f8934100eb0 2023-10-16T13:11:49.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f893a55f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893419eb30 con 0x7f8934102a50 2023-10-16T13:11:49.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f89337fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8934102090 0x7f89341971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:49.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f89337fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8934102090 0x7f89341971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35442/0 (socket says 172.21.15.92:35442) 2023-10-16T13:11:49.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f89337fe700 1 -- 172.21.15.92:0/2935939174 learned_addr learned my addr 172.21.15.92:0/2935939174 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:49.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f8933fff700 1 --2- 172.21.15.92:0/2935939174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8934100eb0 0x7f8934196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:49.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f8938afc700 1 --2- 172.21.15.92:0/2935939174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8934102a50 0x7f893419e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:49.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f89337fe700 1 -- 172.21.15.92:0/2935939174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8934102a50 msgr2=0x7f893419e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:49.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f89337fe700 1 --2- 172.21.15.92:0/2935939174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8934102a50 0x7f893419e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:49.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f89337fe700 1 -- 172.21.15.92:0/2935939174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8934100eb0 msgr2=0x7f8934196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:49.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f89337fe700 1 --2- 172.21.15.92:0/2935939174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8934100eb0 0x7f8934196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:49.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f89337fe700 1 -- 172.21.15.92:0/2935939174 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892c009d00 con 0x7f8934102090 2023-10-16T13:11:49.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f89337fe700 1 --2- 172.21.15.92:0/2935939174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8934102090 0x7f89341971d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f892400d980 tx=0x7f892400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:49.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f89317fa700 1 -- 172.21.15.92:0/2935939174 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8924009b40 con 0x7f8934102090 2023-10-16T13:11:49.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f89317fa700 1 -- 172.21.15.92:0/2935939174 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f892400de60 con 0x7f8934102090 2023-10-16T13:11:49.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.156+0000 7f893a55f700 1 -- 172.21.15.92:0/2935939174 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893419ee10 con 0x7f8934102090 2023-10-16T13:11:49.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.157+0000 7f89317fa700 1 -- 172.21.15.92:0/2935939174 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892400f600 con 0x7f8934102090 2023-10-16T13:11:49.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.157+0000 7f893a55f700 1 -- 172.21.15.92:0/2935939174 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893419f240 con 0x7f8934102090 2023-10-16T13:11:49.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.157+0000 7f893a55f700 1 -- 172.21.15.92:0/2935939174 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893410c880 con 0x7f8934102090 2023-10-16T13:11:49.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.159+0000 7f89317fa700 1 -- 172.21.15.92:0/2935939174 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f8924010460 con 0x7f8934102090 2023-10-16T13:11:49.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.159+0000 7f89317fa700 1 --2- 172.21.15.92:0/2935939174 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f891c0a15c0 0x7f891c0a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:49.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.159+0000 7f8933fff700 1 --2- 172.21.15.92:0/2935939174 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f891c0a15c0 0x7f891c0a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:49.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.159+0000 7f89317fa700 1 -- 172.21.15.92:0/2935939174 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f89240cc860 con 0x7f8934102090 2023-10-16T13:11:49.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.160+0000 7f8933fff700 1 --2- 172.21.15.92:0/2935939174 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f891c0a15c0 0x7f891c0a3a80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8928005fd0 tx=0x7f8928005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:49.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.163+0000 7f89317fa700 1 -- 172.21.15.92:0/2935939174 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8924095f10 con 0x7f8934102090 2023-10-16T13:11:49.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.354+0000 7f893a55f700 1 -- 172.21.15.92:0/2935939174 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89340612f0 con 0x7f891c0a15c0 2023-10-16T13:11:49.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.364+0000 7f89317fa700 1 -- 172.21.15.92:0/2935939174 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336299 (secure 0 0 0) 0x7f89340612f0 con 0x7f891c0a15c0 2023-10-16T13:11:49.372 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:49.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.367+0000 7f893a55f700 1 -- 172.21.15.92:0/2935939174 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f891c0a15c0 msgr2=0x7f891c0a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:49.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.367+0000 7f893a55f700 1 --2- 172.21.15.92:0/2935939174 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f891c0a15c0 0x7f891c0a3a80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8928005fd0 tx=0x7f8928005dd0 comp rx=0 tx=0).stop 2023-10-16T13:11:49.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.367+0000 7f893a55f700 1 -- 172.21.15.92:0/2935939174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8934102090 msgr2=0x7f89341971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:49.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.367+0000 7f893a55f700 1 --2- 172.21.15.92:0/2935939174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8934102090 0x7f89341971d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f892400d980 tx=0x7f892400dd40 comp rx=0 tx=0).stop 2023-10-16T13:11:49.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.367+0000 7f893a55f700 1 -- 172.21.15.92:0/2935939174 shutdown_connections 2023-10-16T13:11:49.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.367+0000 7f893a55f700 1 --2- 172.21.15.92:0/2935939174 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f891c0a15c0 0x7f891c0a3a80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:49.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.367+0000 7f893a55f700 1 --2- 172.21.15.92:0/2935939174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8934102a50 0x7f893419e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:49.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.367+0000 7f893a55f700 1 --2- 172.21.15.92:0/2935939174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8934100eb0 0x7f8934196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:49.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.367+0000 7f893a55f700 1 --2- 172.21.15.92:0/2935939174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8934102090 0x7f89341971d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:49.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.367+0000 7f893a55f700 1 -- 172.21.15.92:0/2935939174 >> 172.21.15.92:0/2935939174 conn(0x7f89340fc470 msgr2=0x7f89340fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:49.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.367+0000 7f893a55f700 1 -- 172.21.15.92:0/2935939174 shutdown_connections 2023-10-16T13:11:49.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:49.368+0000 7f893a55f700 1 -- 172.21.15.92:0/2935939174 wait complete. 2023-10-16T13:11:49.378 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-10-16T13:11:49.382 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2023-10-16T13:11:49.261522+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597098,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":149,"num_read_kb":127,"num_write":320,"num_write_kb":2988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":261,"ondisk_log_size":261,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":284,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336588,"kb_used_data":12380,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605236,"statfs":{"total":1151940427776,"available":1151595761664,"internally_reserved":0,"allocated":12677120,"data_stored":6887943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19128,"internal_metadata":331855176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6730,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":23,"num_read_kb":18,"num_write":139,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.306663"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228907+0000","last_change":"2023-10-16T13:11:40.980978+0000","last_active":"2023-10-16T13:11:43.228907+0000","last_peered":"2023-10-16T13:11:43.228907+0000","last_clean":"2023-10-16T13:11:43.228907+0000","last_became_active":"2023-10-16T13:11:40.980468+0000","last_became_peered":"2023-10-16T13:11:40.980468+0000","last_unstale":"2023-10-16T13:11:43.228907+0000","last_undegraded":"2023-10-16T13:11:43.228907+0000","last_fullsized":"2023-10-16T13:11:43.228907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.261864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717598+0000","last_change":"2023-10-16T13:11:40.971625+0000","last_active":"2023-10-16T13:11:42.717598+0000","last_peered":"2023-10-16T13:11:42.717598+0000","last_clean":"2023-10-16T13:11:42.717598+0000","last_became_active":"2023-10-16T13:11:40.971028+0000","last_became_peered":"2023-10-16T13:11:40.971028+0000","last_unstale":"2023-10-16T13:11:42.717598+0000","last_undegraded":"2023-10-16T13:11:42.717598+0000","last_fullsized":"2023-10-16T13:11:42.717598+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:08.974553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717498+0000","last_change":"2023-10-16T13:11:40.973705+0000","last_active":"2023-10-16T13:11:42.717498+0000","last_peered":"2023-10-16T13:11:42.717498+0000","last_clean":"2023-10-16T13:11:42.717498+0000","last_became_active":"2023-10-16T13:11:40.973347+0000","last_became_peered":"2023-10-16T13:11:40.973347+0000","last_unstale":"2023-10-16T13:11:42.717498+0000","last_undegraded":"2023-10-16T13:11:42.717498+0000","last_fullsized":"2023-10-16T13:11:42.717498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:46.628383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.938443+0000","last_change":"2023-10-16T13:11:40.974996+0000","last_active":"2023-10-16T13:11:42.938443+0000","last_peered":"2023-10-16T13:11:42.938443+0000","last_clean":"2023-10-16T13:11:42.938443+0000","last_became_active":"2023-10-16T13:11:40.973807+0000","last_became_peered":"2023-10-16T13:11:40.973807+0000","last_unstale":"2023-10-16T13:11:42.938443+0000","last_undegraded":"2023-10-16T13:11:42.938443+0000","last_fullsized":"2023-10-16T13:11:42.938443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:02:14.901036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228247+0000","last_change":"2023-10-16T13:11:40.976558+0000","last_active":"2023-10-16T13:11:43.228247+0000","last_peered":"2023-10-16T13:11:43.228247+0000","last_clean":"2023-10-16T13:11:43.228247+0000","last_became_active":"2023-10-16T13:11:40.976159+0000","last_became_peered":"2023-10-16T13:11:40.976159+0000","last_unstale":"2023-10-16T13:11:43.228247+0000","last_undegraded":"2023-10-16T13:11:43.228247+0000","last_fullsized":"2023-10-16T13:11:43.228247+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:58:16.532294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.227919+0000","last_change":"2023-10-16T13:11:40.977510+0000","last_active":"2023-10-16T13:11:43.227919+0000","last_peered":"2023-10-16T13:11:43.227919+0000","last_clean":"2023-10-16T13:11:43.227919+0000","last_became_active":"2023-10-16T13:11:40.977184+0000","last_became_peered":"2023-10-16T13:11:40.977184+0000","last_unstale":"2023-10-16T13:11:43.227919+0000","last_undegraded":"2023-10-16T13:11:43.227919+0000","last_fullsized":"2023-10-16T13:11:43.227919+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:24:33.215430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972030+0000","last_change":"2023-10-16T13:11:40.969982+0000","last_active":"2023-10-16T13:11:42.972030+0000","last_peered":"2023-10-16T13:11:42.972030+0000","last_clean":"2023-10-16T13:11:42.972030+0000","last_became_active":"2023-10-16T13:11:40.969651+0000","last_became_peered":"2023-10-16T13:11:40.969651+0000","last_unstale":"2023-10-16T13:11:42.972030+0000","last_undegraded":"2023-10-16T13:11:42.972030+0000","last_fullsized":"2023-10-16T13:11:42.972030+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:37:01.702748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961091+0000","last_change":"2023-10-16T13:11:40.967952+0000","last_active":"2023-10-16T13:11:41.961091+0000","last_peered":"2023-10-16T13:11:41.961091+0000","last_clean":"2023-10-16T13:11:41.961091+0000","last_became_active":"2023-10-16T13:11:40.967621+0000","last_became_peered":"2023-10-16T13:11:40.967621+0000","last_unstale":"2023-10-16T13:11:41.961091+0000","last_undegraded":"2023-10-16T13:11:41.961091+0000","last_fullsized":"2023-10-16T13:11:41.961091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:04:09.243563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962240+0000","last_change":"2023-10-16T13:11:40.978172+0000","last_active":"2023-10-16T13:11:41.962240+0000","last_peered":"2023-10-16T13:11:41.962240+0000","last_clean":"2023-10-16T13:11:41.962240+0000","last_became_active":"2023-10-16T13:11:40.977727+0000","last_became_peered":"2023-10-16T13:11:40.977727+0000","last_unstale":"2023-10-16T13:11:41.962240+0000","last_undegraded":"2023-10-16T13:11:41.962240+0000","last_fullsized":"2023-10-16T13:11:41.962240+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:06:16.469370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228227+0000","last_change":"2023-10-16T13:11:40.973343+0000","last_active":"2023-10-16T13:11:43.228227+0000","last_peered":"2023-10-16T13:11:43.228227+0000","last_clean":"2023-10-16T13:11:43.228227+0000","last_became_active":"2023-10-16T13:11:40.972997+0000","last_became_peered":"2023-10-16T13:11:40.972997+0000","last_unstale":"2023-10-16T13:11:43.228227+0000","last_undegraded":"2023-10-16T13:11:43.228227+0000","last_fullsized":"2023-10-16T13:11:43.228227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:23:21.235742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972369+0000","last_change":"2023-10-16T13:11:40.980253+0000","last_active":"2023-10-16T13:11:42.972369+0000","last_peered":"2023-10-16T13:11:42.972369+0000","last_clean":"2023-10-16T13:11:42.972369+0000","last_became_active":"2023-10-16T13:11:40.979473+0000","last_became_peered":"2023-10-16T13:11:40.979473+0000","last_unstale":"2023-10-16T13:11:42.972369+0000","last_undegraded":"2023-10-16T13:11:42.972369+0000","last_fullsized":"2023-10-16T13:11:42.972369+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:37:46.976128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.938394+0000","last_change":"2023-10-16T13:11:40.974791+0000","last_active":"2023-10-16T13:11:42.938394+0000","last_peered":"2023-10-16T13:11:42.938394+0000","last_clean":"2023-10-16T13:11:42.938394+0000","last_became_active":"2023-10-16T13:11:40.973353+0000","last_became_peered":"2023-10-16T13:11:40.973353+0000","last_unstale":"2023-10-16T13:11:42.938394+0000","last_undegraded":"2023-10-16T13:11:42.938394+0000","last_fullsized":"2023-10-16T13:11:42.938394+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:35:40.649071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228607+0000","last_change":"2023-10-16T13:11:40.971681+0000","last_active":"2023-10-16T13:11:43.228607+0000","last_peered":"2023-10-16T13:11:43.228607+0000","last_clean":"2023-10-16T13:11:43.228607+0000","last_became_active":"2023-10-16T13:11:40.971349+0000","last_became_peered":"2023-10-16T13:11:40.971349+0000","last_unstale":"2023-10-16T13:11:43.228607+0000","last_undegraded":"2023-10-16T13:11:43.228607+0000","last_fullsized":"2023-10-16T13:11:43.228607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:50:38.285478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717591+0000","last_change":"2023-10-16T13:11:40.971859+0000","last_active":"2023-10-16T13:11:42.717591+0000","last_peered":"2023-10-16T13:11:42.717591+0000","last_clean":"2023-10-16T13:11:42.717591+0000","last_became_active":"2023-10-16T13:11:40.971107+0000","last_became_peered":"2023-10-16T13:11:40.971107+0000","last_unstale":"2023-10-16T13:11:42.717591+0000","last_undegraded":"2023-10-16T13:11:42.717591+0000","last_fullsized":"2023-10-16T13:11:42.717591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:57:52.655130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717282+0000","last_change":"2023-10-16T13:11:40.976604+0000","last_active":"2023-10-16T13:11:42.717282+0000","last_peered":"2023-10-16T13:11:42.717282+0000","last_clean":"2023-10-16T13:11:42.717282+0000","last_became_active":"2023-10-16T13:11:40.976262+0000","last_became_peered":"2023-10-16T13:11:40.976262+0000","last_unstale":"2023-10-16T13:11:42.717282+0000","last_undegraded":"2023-10-16T13:11:42.717282+0000","last_fullsized":"2023-10-16T13:11:42.717282+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:18:55.867316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961792+0000","last_change":"2023-10-16T13:11:40.975785+0000","last_active":"2023-10-16T13:11:41.961792+0000","last_peered":"2023-10-16T13:11:41.961792+0000","last_clean":"2023-10-16T13:11:41.961792+0000","last_became_active":"2023-10-16T13:11:40.975463+0000","last_became_peered":"2023-10-16T13:11:40.975463+0000","last_unstale":"2023-10-16T13:11:41.961792+0000","last_undegraded":"2023-10-16T13:11:41.961792+0000","last_fullsized":"2023-10-16T13:11:41.961792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:37:29.337596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228897+0000","last_change":"2023-10-16T13:11:40.980784+0000","last_active":"2023-10-16T13:11:43.228897+0000","last_peered":"2023-10-16T13:11:43.228897+0000","last_clean":"2023-10-16T13:11:43.228897+0000","last_became_active":"2023-10-16T13:11:40.980374+0000","last_became_peered":"2023-10-16T13:11:40.980374+0000","last_unstale":"2023-10-16T13:11:43.228897+0000","last_undegraded":"2023-10-16T13:11:43.228897+0000","last_fullsized":"2023-10-16T13:11:43.228897+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:38:12.236358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228219+0000","last_change":"2023-10-16T13:11:40.980775+0000","last_active":"2023-10-16T13:11:43.228219+0000","last_peered":"2023-10-16T13:11:43.228219+0000","last_clean":"2023-10-16T13:11:43.228219+0000","last_became_active":"2023-10-16T13:11:40.980261+0000","last_became_peered":"2023-10-16T13:11:40.980261+0000","last_unstale":"2023-10-16T13:11:43.228219+0000","last_undegraded":"2023-10-16T13:11:43.228219+0000","last_fullsized":"2023-10-16T13:11:43.228219+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:36:57.112989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.986406+0000","last_change":"2023-10-16T13:11:40.970030+0000","last_active":"2023-10-16T13:11:42.986406+0000","last_peered":"2023-10-16T13:11:42.986406+0000","last_clean":"2023-10-16T13:11:42.986406+0000","last_became_active":"2023-10-16T13:11:40.969698+0000","last_became_peered":"2023-10-16T13:11:40.969698+0000","last_unstale":"2023-10-16T13:11:42.986406+0000","last_undegraded":"2023-10-16T13:11:42.986406+0000","last_fullsized":"2023-10-16T13:11:42.986406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:42:00.520386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.307023+0000","last_change":"2023-10-16T13:11:39.957688+0000","last_active":"2023-10-16T13:11:41.307023+0000","last_peered":"2023-10-16T13:11:41.307023+0000","last_clean":"2023-10-16T13:11:41.307023+0000","last_became_active":"2023-10-16T13:11:39.957391+0000","last_became_peered":"2023-10-16T13:11:39.957391+0000","last_unstale":"2023-10-16T13:11:41.307023+0000","last_undegraded":"2023-10-16T13:11:41.307023+0000","last_fullsized":"2023-10-16T13:11:41.307023+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:42:17.875770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961607+0000","last_change":"2023-10-16T13:11:40.968984+0000","last_active":"2023-10-16T13:11:41.961607+0000","last_peered":"2023-10-16T13:11:41.961607+0000","last_clean":"2023-10-16T13:11:41.961607+0000","last_became_active":"2023-10-16T13:11:40.968338+0000","last_became_peered":"2023-10-16T13:11:40.968338+0000","last_unstale":"2023-10-16T13:11:41.961607+0000","last_undegraded":"2023-10-16T13:11:41.961607+0000","last_fullsized":"2023-10-16T13:11:41.961607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:49:21.643029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961716+0000","last_change":"2023-10-16T13:11:39.959458+0000","last_active":"2023-10-16T13:11:41.961716+0000","last_peered":"2023-10-16T13:11:41.961716+0000","last_clean":"2023-10-16T13:11:41.961716+0000","last_became_active":"2023-10-16T13:11:39.959155+0000","last_became_peered":"2023-10-16T13:11:39.959155+0000","last_unstale":"2023-10-16T13:11:41.961716+0000","last_undegraded":"2023-10-16T13:11:41.961716+0000","last_fullsized":"2023-10-16T13:11:41.961716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:18:30.725604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717655+0000","last_change":"2023-10-16T13:11:40.980168+0000","last_active":"2023-10-16T13:11:42.717655+0000","last_peered":"2023-10-16T13:11:42.717655+0000","last_clean":"2023-10-16T13:11:42.717655+0000","last_became_active":"2023-10-16T13:11:40.979839+0000","last_became_peered":"2023-10-16T13:11:40.979839+0000","last_unstale":"2023-10-16T13:11:42.717655+0000","last_undegraded":"2023-10-16T13:11:42.717655+0000","last_fullsized":"2023-10-16T13:11:42.717655+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:25:31.374291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'11","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.353730+0000","last_change":"2023-10-16T13:11:39.957065+0000","last_active":"2023-10-16T13:11:47.353730+0000","last_peered":"2023-10-16T13:11:47.353730+0000","last_clean":"2023-10-16T13:11:47.353730+0000","last_became_active":"2023-10-16T13:11:39.956759+0000","last_became_peered":"2023-10-16T13:11:39.956759+0000","last_unstale":"2023-10-16T13:11:47.353730+0000","last_undegraded":"2023-10-16T13:11:47.353730+0000","last_fullsized":"2023-10-16T13:11:47.353730+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:06:39.862025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961875+0000","last_change":"2023-10-16T13:11:40.978989+0000","last_active":"2023-10-16T13:11:41.961875+0000","last_peered":"2023-10-16T13:11:41.961875+0000","last_clean":"2023-10-16T13:11:41.961875+0000","last_became_active":"2023-10-16T13:11:40.978582+0000","last_became_peered":"2023-10-16T13:11:40.978582+0000","last_unstale":"2023-10-16T13:11:41.961875+0000","last_undegraded":"2023-10-16T13:11:41.961875+0000","last_fullsized":"2023-10-16T13:11:41.961875+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:29:54.733058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.353313+0000","last_change":"2023-10-16T13:11:39.955340+0000","last_active":"2023-10-16T13:11:47.353313+0000","last_peered":"2023-10-16T13:11:47.353313+0000","last_clean":"2023-10-16T13:11:47.353313+0000","last_became_active":"2023-10-16T13:11:39.955032+0000","last_became_peered":"2023-10-16T13:11:39.955032+0000","last_unstale":"2023-10-16T13:11:47.353313+0000","last_undegraded":"2023-10-16T13:11:47.353313+0000","last_fullsized":"2023-10-16T13:11:47.353313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:01:11.518823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962697+0000","last_change":"2023-10-16T13:11:40.974458+0000","last_active":"2023-10-16T13:11:41.962697+0000","last_peered":"2023-10-16T13:11:41.962697+0000","last_clean":"2023-10-16T13:11:41.962697+0000","last_became_active":"2023-10-16T13:11:40.974146+0000","last_became_peered":"2023-10-16T13:11:40.974146+0000","last_unstale":"2023-10-16T13:11:41.962697+0000","last_undegraded":"2023-10-16T13:11:41.962697+0000","last_fullsized":"2023-10-16T13:11:41.962697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:57:58.851273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.308585+0000","last_change":"2023-10-16T13:11:39.958561+0000","last_active":"2023-10-16T13:11:47.308585+0000","last_peered":"2023-10-16T13:11:47.308585+0000","last_clean":"2023-10-16T13:11:47.308585+0000","last_became_active":"2023-10-16T13:11:39.958272+0000","last_became_peered":"2023-10-16T13:11:39.958272+0000","last_unstale":"2023-10-16T13:11:47.308585+0000","last_undegraded":"2023-10-16T13:11:47.308585+0000","last_fullsized":"2023-10-16T13:11:47.308585+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:46.162288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228649+0000","last_change":"2023-10-16T13:11:40.970345+0000","last_active":"2023-10-16T13:11:43.228649+0000","last_peered":"2023-10-16T13:11:43.228649+0000","last_clean":"2023-10-16T13:11:43.228649+0000","last_became_active":"2023-10-16T13:11:40.970024+0000","last_became_peered":"2023-10-16T13:11:40.970024+0000","last_unstale":"2023-10-16T13:11:43.228649+0000","last_undegraded":"2023-10-16T13:11:43.228649+0000","last_fullsized":"2023-10-16T13:11:43.228649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:41.703074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:45.311581+0000","last_change":"2023-10-16T13:11:39.951194+0000","last_active":"2023-10-16T13:11:45.311581+0000","last_peered":"2023-10-16T13:11:45.311581+0000","last_clean":"2023-10-16T13:11:45.311581+0000","last_became_active":"2023-10-16T13:11:39.950837+0000","last_became_peered":"2023-10-16T13:11:39.950837+0000","last_unstale":"2023-10-16T13:11:45.311581+0000","last_undegraded":"2023-10-16T13:11:45.311581+0000","last_fullsized":"2023-10-16T13:11:45.311581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:59:17.756924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962589+0000","last_change":"2023-10-16T13:11:40.959602+0000","last_active":"2023-10-16T13:11:41.962589+0000","last_peered":"2023-10-16T13:11:41.962589+0000","last_clean":"2023-10-16T13:11:41.962589+0000","last_became_active":"2023-10-16T13:11:40.959231+0000","last_became_peered":"2023-10-16T13:11:40.959231+0000","last_unstale":"2023-10-16T13:11:41.962589+0000","last_undegraded":"2023-10-16T13:11:41.962589+0000","last_fullsized":"2023-10-16T13:11:41.962589+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:59:54.623471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228231+0000","last_change":"2023-10-16T13:11:39.952655+0000","last_active":"2023-10-16T13:11:43.228231+0000","last_peered":"2023-10-16T13:11:43.228231+0000","last_clean":"2023-10-16T13:11:43.228231+0000","last_became_active":"2023-10-16T13:11:39.952324+0000","last_became_peered":"2023-10-16T13:11:39.952324+0000","last_unstale":"2023-10-16T13:11:43.228231+0000","last_undegraded":"2023-10-16T13:11:43.228231+0000","last_fullsized":"2023-10-16T13:11:43.228231+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:09:14.077837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961022+0000","last_change":"2023-10-16T13:11:40.969019+0000","last_active":"2023-10-16T13:11:41.961022+0000","last_peered":"2023-10-16T13:11:41.961022+0000","last_clean":"2023-10-16T13:11:41.961022+0000","last_became_active":"2023-10-16T13:11:40.968645+0000","last_became_peered":"2023-10-16T13:11:40.968645+0000","last_unstale":"2023-10-16T13:11:41.961022+0000","last_undegraded":"2023-10-16T13:11:41.961022+0000","last_fullsized":"2023-10-16T13:11:41.961022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:23:18.700377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.353278+0000","last_change":"2023-10-16T13:11:39.959826+0000","last_active":"2023-10-16T13:11:47.353278+0000","last_peered":"2023-10-16T13:11:47.353278+0000","last_clean":"2023-10-16T13:11:47.353278+0000","last_became_active":"2023-10-16T13:11:39.959490+0000","last_became_peered":"2023-10-16T13:11:39.959490+0000","last_unstale":"2023-10-16T13:11:47.353278+0000","last_undegraded":"2023-10-16T13:11:47.353278+0000","last_fullsized":"2023-10-16T13:11:47.353278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:52:01.865005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228193+0000","last_change":"2023-10-16T13:11:40.977941+0000","last_active":"2023-10-16T13:11:43.228193+0000","last_peered":"2023-10-16T13:11:43.228193+0000","last_clean":"2023-10-16T13:11:43.228193+0000","last_became_active":"2023-10-16T13:11:40.977558+0000","last_became_peered":"2023-10-16T13:11:40.977558+0000","last_unstale":"2023-10-16T13:11:43.228193+0000","last_undegraded":"2023-10-16T13:11:43.228193+0000","last_fullsized":"2023-10-16T13:11:43.228193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:29:16.932234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:44.325775+0000","last_change":"2023-10-16T13:11:39.953728+0000","last_active":"2023-10-16T13:11:44.325775+0000","last_peered":"2023-10-16T13:11:44.325775+0000","last_clean":"2023-10-16T13:11:44.325775+0000","last_became_active":"2023-10-16T13:11:39.953421+0000","last_became_peered":"2023-10-16T13:11:39.953421+0000","last_unstale":"2023-10-16T13:11:44.325775+0000","last_undegraded":"2023-10-16T13:11:44.325775+0000","last_fullsized":"2023-10-16T13:11:44.325775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:22:14.537974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962178+0000","last_change":"2023-10-16T13:11:40.978214+0000","last_active":"2023-10-16T13:11:41.962178+0000","last_peered":"2023-10-16T13:11:41.962178+0000","last_clean":"2023-10-16T13:11:41.962178+0000","last_became_active":"2023-10-16T13:11:40.977786+0000","last_became_peered":"2023-10-16T13:11:40.977786+0000","last_unstale":"2023-10-16T13:11:41.962178+0000","last_undegraded":"2023-10-16T13:11:41.962178+0000","last_fullsized":"2023-10-16T13:11:41.962178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:43:51.218758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:44.324251+0000","last_change":"2023-10-16T13:11:39.959589+0000","last_active":"2023-10-16T13:11:44.324251+0000","last_peered":"2023-10-16T13:11:44.324251+0000","last_clean":"2023-10-16T13:11:44.324251+0000","last_became_active":"2023-10-16T13:11:39.959242+0000","last_became_peered":"2023-10-16T13:11:39.959242+0000","last_unstale":"2023-10-16T13:11:44.324251+0000","last_undegraded":"2023-10-16T13:11:44.324251+0000","last_fullsized":"2023-10-16T13:11:44.324251+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:54.955605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717681+0000","last_change":"2023-10-16T13:11:40.975814+0000","last_active":"2023-10-16T13:11:42.717681+0000","last_peered":"2023-10-16T13:11:42.717681+0000","last_clean":"2023-10-16T13:11:42.717681+0000","last_became_active":"2023-10-16T13:11:40.975485+0000","last_became_peered":"2023-10-16T13:11:40.975485+0000","last_unstale":"2023-10-16T13:11:42.717681+0000","last_undegraded":"2023-10-16T13:11:42.717681+0000","last_fullsized":"2023-10-16T13:11:42.717681+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:25.661616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:45.303902+0000","last_change":"2023-10-16T13:11:39.956586+0000","last_active":"2023-10-16T13:11:45.303902+0000","last_peered":"2023-10-16T13:11:45.303902+0000","last_clean":"2023-10-16T13:11:45.303902+0000","last_became_active":"2023-10-16T13:11:39.956270+0000","last_became_peered":"2023-10-16T13:11:39.956270+0000","last_unstale":"2023-10-16T13:11:45.303902+0000","last_undegraded":"2023-10-16T13:11:45.303902+0000","last_fullsized":"2023-10-16T13:11:45.303902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:11:12.435377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962008+0000","last_change":"2023-10-16T13:11:40.978918+0000","last_active":"2023-10-16T13:11:41.962008+0000","last_peered":"2023-10-16T13:11:41.962008+0000","last_clean":"2023-10-16T13:11:41.962008+0000","last_became_active":"2023-10-16T13:11:40.978520+0000","last_became_peered":"2023-10-16T13:11:40.978520+0000","last_unstale":"2023-10-16T13:11:41.962008+0000","last_undegraded":"2023-10-16T13:11:41.962008+0000","last_fullsized":"2023-10-16T13:11:41.962008+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:09:57.269111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:45.305604+0000","last_change":"2023-10-16T13:11:39.956692+0000","last_active":"2023-10-16T13:11:45.305604+0000","last_peered":"2023-10-16T13:11:45.305604+0000","last_clean":"2023-10-16T13:11:45.305604+0000","last_became_active":"2023-10-16T13:11:39.956340+0000","last_became_peered":"2023-10-16T13:11:39.956340+0000","last_unstale":"2023-10-16T13:11:45.305604+0000","last_undegraded":"2023-10-16T13:11:45.305604+0000","last_fullsized":"2023-10-16T13:11:45.305604+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:48:23.320743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228483+0000","last_change":"2023-10-16T13:11:40.969423+0000","last_active":"2023-10-16T13:11:43.228483+0000","last_peered":"2023-10-16T13:11:43.228483+0000","last_clean":"2023-10-16T13:11:43.228483+0000","last_became_active":"2023-10-16T13:11:40.969022+0000","last_became_peered":"2023-10-16T13:11:40.969022+0000","last_unstale":"2023-10-16T13:11:43.228483+0000","last_undegraded":"2023-10-16T13:11:43.228483+0000","last_fullsized":"2023-10-16T13:11:43.228483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:51:26.911443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:44.325797+0000","last_change":"2023-10-16T13:11:39.962364+0000","last_active":"2023-10-16T13:11:44.325797+0000","last_peered":"2023-10-16T13:11:44.325797+0000","last_clean":"2023-10-16T13:11:44.325797+0000","last_became_active":"2023-10-16T13:11:39.962077+0000","last_became_peered":"2023-10-16T13:11:39.962077+0000","last_unstale":"2023-10-16T13:11:44.325797+0000","last_undegraded":"2023-10-16T13:11:44.325797+0000","last_fullsized":"2023-10-16T13:11:44.325797+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:50:58.478054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228556+0000","last_change":"2023-10-16T13:11:40.970958+0000","last_active":"2023-10-16T13:11:43.228556+0000","last_peered":"2023-10-16T13:11:43.228556+0000","last_clean":"2023-10-16T13:11:43.228556+0000","last_became_active":"2023-10-16T13:11:40.970670+0000","last_became_peered":"2023-10-16T13:11:40.970670+0000","last_unstale":"2023-10-16T13:11:43.228556+0000","last_undegraded":"2023-10-16T13:11:43.228556+0000","last_fullsized":"2023-10-16T13:11:43.228556+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:47:30.594558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.353161+0000","last_change":"2023-10-16T13:11:39.957334+0000","last_active":"2023-10-16T13:11:47.353161+0000","last_peered":"2023-10-16T13:11:47.353161+0000","last_clean":"2023-10-16T13:11:47.353161+0000","last_became_active":"2023-10-16T13:11:39.957027+0000","last_became_peered":"2023-10-16T13:11:39.957027+0000","last_unstale":"2023-10-16T13:11:47.353161+0000","last_undegraded":"2023-10-16T13:11:47.353161+0000","last_fullsized":"2023-10-16T13:11:47.353161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:27:37.164359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972218+0000","last_change":"2023-10-16T13:11:40.977201+0000","last_active":"2023-10-16T13:11:42.972218+0000","last_peered":"2023-10-16T13:11:42.972218+0000","last_clean":"2023-10-16T13:11:42.972218+0000","last_became_active":"2023-10-16T13:11:40.976860+0000","last_became_peered":"2023-10-16T13:11:40.976860+0000","last_unstale":"2023-10-16T13:11:42.972218+0000","last_undegraded":"2023-10-16T13:11:42.972218+0000","last_fullsized":"2023-10-16T13:11:42.972218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:57.867339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:46.335530+0000","last_change":"2023-10-16T13:11:39.958627+0000","last_active":"2023-10-16T13:11:46.335530+0000","last_peered":"2023-10-16T13:11:46.335530+0000","last_clean":"2023-10-16T13:11:46.335530+0000","last_became_active":"2023-10-16T13:11:39.958230+0000","last_became_peered":"2023-10-16T13:11:39.958230+0000","last_unstale":"2023-10-16T13:11:46.335530+0000","last_undegraded":"2023-10-16T13:11:46.335530+0000","last_fullsized":"2023-10-16T13:11:46.335530+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:47:47.534392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.971981+0000","last_change":"2023-10-16T13:11:40.972841+0000","last_active":"2023-10-16T13:11:42.971981+0000","last_peered":"2023-10-16T13:11:42.971981+0000","last_clean":"2023-10-16T13:11:42.971981+0000","last_became_active":"2023-10-16T13:11:40.972406+0000","last_became_peered":"2023-10-16T13:11:40.972406+0000","last_unstale":"2023-10-16T13:11:42.971981+0000","last_undegraded":"2023-10-16T13:11:42.971981+0000","last_fullsized":"2023-10-16T13:11:42.971981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:04.134000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:46.334946+0000","last_change":"2023-10-16T13:11:39.955064+0000","last_active":"2023-10-16T13:11:46.334946+0000","last_peered":"2023-10-16T13:11:46.334946+0000","last_clean":"2023-10-16T13:11:46.334946+0000","last_became_active":"2023-10-16T13:11:39.954690+0000","last_became_peered":"2023-10-16T13:11:39.954690+0000","last_unstale":"2023-10-16T13:11:46.334946+0000","last_undegraded":"2023-10-16T13:11:46.334946+0000","last_fullsized":"2023-10-16T13:11:46.334946+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:30.341233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962429+0000","last_change":"2023-10-16T13:11:40.978373+0000","last_active":"2023-10-16T13:11:41.962429+0000","last_peered":"2023-10-16T13:11:41.962429+0000","last_clean":"2023-10-16T13:11:41.962429+0000","last_became_active":"2023-10-16T13:11:40.977890+0000","last_became_peered":"2023-10-16T13:11:40.977890+0000","last_unstale":"2023-10-16T13:11:41.962429+0000","last_undegraded":"2023-10-16T13:11:41.962429+0000","last_fullsized":"2023-10-16T13:11:41.962429+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:33:21.566200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228765+0000","last_change":"2023-10-16T13:11:39.952698+0000","last_active":"2023-10-16T13:11:43.228765+0000","last_peered":"2023-10-16T13:11:43.228765+0000","last_clean":"2023-10-16T13:11:43.228765+0000","last_became_active":"2023-10-16T13:11:39.952383+0000","last_became_peered":"2023-10-16T13:11:39.952383+0000","last_unstale":"2023-10-16T13:11:43.228765+0000","last_undegraded":"2023-10-16T13:11:43.228765+0000","last_fullsized":"2023-10-16T13:11:43.228765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:06:57.841990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228686+0000","last_change":"2023-10-16T13:11:40.977579+0000","last_active":"2023-10-16T13:11:43.228686+0000","last_peered":"2023-10-16T13:11:43.228686+0000","last_clean":"2023-10-16T13:11:43.228686+0000","last_became_active":"2023-10-16T13:11:40.977117+0000","last_became_peered":"2023-10-16T13:11:40.977117+0000","last_unstale":"2023-10-16T13:11:43.228686+0000","last_undegraded":"2023-10-16T13:11:43.228686+0000","last_fullsized":"2023-10-16T13:11:43.228686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:18.859388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.963117+0000","last_change":"2023-10-16T13:11:39.957430+0000","last_active":"2023-10-16T13:11:40.963117+0000","last_peered":"2023-10-16T13:11:40.963117+0000","last_clean":"2023-10-16T13:11:40.963117+0000","last_became_active":"2023-10-16T13:11:39.957088+0000","last_became_peered":"2023-10-16T13:11:39.957088+0000","last_unstale":"2023-10-16T13:11:40.963117+0000","last_undegraded":"2023-10-16T13:11:40.963117+0000","last_fullsized":"2023-10-16T13:11:40.963117+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:21:57.307718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228189+0000","last_change":"2023-10-16T13:11:40.970009+0000","last_active":"2023-10-16T13:11:43.228189+0000","last_peered":"2023-10-16T13:11:43.228189+0000","last_clean":"2023-10-16T13:11:43.228189+0000","last_became_active":"2023-10-16T13:11:40.969668+0000","last_became_peered":"2023-10-16T13:11:40.969668+0000","last_unstale":"2023-10-16T13:11:43.228189+0000","last_undegraded":"2023-10-16T13:11:43.228189+0000","last_fullsized":"2023-10-16T13:11:43.228189+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:48:35.556712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972101+0000","last_change":"2023-10-16T13:11:39.958168+0000","last_active":"2023-10-16T13:11:42.972101+0000","last_peered":"2023-10-16T13:11:42.972101+0000","last_clean":"2023-10-16T13:11:42.972101+0000","last_became_active":"2023-10-16T13:11:39.957628+0000","last_became_peered":"2023-10-16T13:11:39.957628+0000","last_unstale":"2023-10-16T13:11:42.972101+0000","last_undegraded":"2023-10-16T13:11:42.972101+0000","last_fullsized":"2023-10-16T13:11:42.972101+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:55:52.658523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228154+0000","last_change":"2023-10-16T13:11:40.977161+0000","last_active":"2023-10-16T13:11:43.228154+0000","last_peered":"2023-10-16T13:11:43.228154+0000","last_clean":"2023-10-16T13:11:43.228154+0000","last_became_active":"2023-10-16T13:11:40.976821+0000","last_became_peered":"2023-10-16T13:11:40.976821+0000","last_unstale":"2023-10-16T13:11:43.228154+0000","last_undegraded":"2023-10-16T13:11:43.228154+0000","last_fullsized":"2023-10-16T13:11:43.228154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:42:26.712826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962502+0000","last_change":"2023-10-16T13:11:40.966680+0000","last_active":"2023-10-16T13:11:41.962502+0000","last_peered":"2023-10-16T13:11:41.962502+0000","last_clean":"2023-10-16T13:11:41.962502+0000","last_became_active":"2023-10-16T13:11:40.966332+0000","last_became_peered":"2023-10-16T13:11:40.966332+0000","last_unstale":"2023-10-16T13:11:41.962502+0000","last_undegraded":"2023-10-16T13:11:41.962502+0000","last_fullsized":"2023-10-16T13:11:41.962502+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:06:42.963312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228139+0000","last_change":"2023-10-16T13:11:39.960180+0000","last_active":"2023-10-16T13:11:43.228139+0000","last_peered":"2023-10-16T13:11:43.228139+0000","last_clean":"2023-10-16T13:11:43.228139+0000","last_became_active":"2023-10-16T13:11:39.959816+0000","last_became_peered":"2023-10-16T13:11:39.959816+0000","last_unstale":"2023-10-16T13:11:43.228139+0000","last_undegraded":"2023-10-16T13:11:43.228139+0000","last_fullsized":"2023-10-16T13:11:43.228139+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:14:08.890449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961527+0000","last_change":"2023-10-16T13:11:40.975271+0000","last_active":"2023-10-16T13:11:41.961527+0000","last_peered":"2023-10-16T13:11:41.961527+0000","last_clean":"2023-10-16T13:11:41.961527+0000","last_became_active":"2023-10-16T13:11:40.974960+0000","last_became_peered":"2023-10-16T13:11:40.974960+0000","last_unstale":"2023-10-16T13:11:41.961527+0000","last_undegraded":"2023-10-16T13:11:41.961527+0000","last_fullsized":"2023-10-16T13:11:41.961527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:09.467960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:46.335557+0000","last_change":"2023-10-16T13:11:39.951187+0000","last_active":"2023-10-16T13:11:46.335557+0000","last_peered":"2023-10-16T13:11:46.335557+0000","last_clean":"2023-10-16T13:11:46.335557+0000","last_became_active":"2023-10-16T13:11:39.950843+0000","last_became_peered":"2023-10-16T13:11:39.950843+0000","last_unstale":"2023-10-16T13:11:46.335557+0000","last_undegraded":"2023-10-16T13:11:46.335557+0000","last_fullsized":"2023-10-16T13:11:46.335557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:48.930247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":308,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.963466+0000","last_change":"2023-10-16T13:10:38.800469+0000","last_active":"2023-10-16T13:11:40.963466+0000","last_peered":"2023-10-16T13:11:40.963466+0000","last_clean":"2023-10-16T13:11:40.963466+0000","last_became_active":"2023-10-16T13:10:38.799911+0000","last_became_peered":"2023-10-16T13:10:38.799911+0000","last_unstale":"2023-10-16T13:11:40.963466+0000","last_undegraded":"2023-10-16T13:11:40.963466+0000","last_fullsized":"2023-10-16T13:11:40.963466+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:07:46.238647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:07:46.238647+0000","last_clean_scrub_stamp":"2023-10-16T13:07:46.238647+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:43:42.258738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228225+0000","last_change":"2023-10-16T13:11:40.974984+0000","last_active":"2023-10-16T13:11:43.228225+0000","last_peered":"2023-10-16T13:11:43.228225+0000","last_clean":"2023-10-16T13:11:43.228225+0000","last_became_active":"2023-10-16T13:11:40.974689+0000","last_became_peered":"2023-10-16T13:11:40.974689+0000","last_unstale":"2023-10-16T13:11:43.228225+0000","last_undegraded":"2023-10-16T13:11:43.228225+0000","last_fullsized":"2023-10-16T13:11:43.228225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:04.119797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:45.313167+0000","last_change":"2023-10-16T13:11:39.957999+0000","last_active":"2023-10-16T13:11:45.313167+0000","last_peered":"2023-10-16T13:11:45.313167+0000","last_clean":"2023-10-16T13:11:45.313167+0000","last_became_active":"2023-10-16T13:11:39.957043+0000","last_became_peered":"2023-10-16T13:11:39.957043+0000","last_unstale":"2023-10-16T13:11:45.313167+0000","last_undegraded":"2023-10-16T13:11:45.313167+0000","last_fullsized":"2023-10-16T13:11:45.313167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:12:27.150065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:46.335581+0000","last_change":"2023-10-16T13:11:39.953082+0000","last_active":"2023-10-16T13:11:46.335581+0000","last_peered":"2023-10-16T13:11:46.335581+0000","last_clean":"2023-10-16T13:11:46.335581+0000","last_became_active":"2023-10-16T13:11:39.952785+0000","last_became_peered":"2023-10-16T13:11:39.952785+0000","last_unstale":"2023-10-16T13:11:46.335581+0000","last_undegraded":"2023-10-16T13:11:46.335581+0000","last_fullsized":"2023-10-16T13:11:46.335581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:06:34.427841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228109+0000","last_change":"2023-10-16T13:11:40.968761+0000","last_active":"2023-10-16T13:11:43.228109+0000","last_peered":"2023-10-16T13:11:43.228109+0000","last_clean":"2023-10-16T13:11:43.228109+0000","last_became_active":"2023-10-16T13:11:40.968466+0000","last_became_peered":"2023-10-16T13:11:40.968466+0000","last_unstale":"2023-10-16T13:11:43.228109+0000","last_undegraded":"2023-10-16T13:11:43.228109+0000","last_fullsized":"2023-10-16T13:11:43.228109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:22:15.577411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228273+0000","last_change":"2023-10-16T13:11:39.957019+0000","last_active":"2023-10-16T13:11:43.228273+0000","last_peered":"2023-10-16T13:11:43.228273+0000","last_clean":"2023-10-16T13:11:43.228273+0000","last_became_active":"2023-10-16T13:11:39.956687+0000","last_became_peered":"2023-10-16T13:11:39.956687+0000","last_unstale":"2023-10-16T13:11:43.228273+0000","last_undegraded":"2023-10-16T13:11:43.228273+0000","last_fullsized":"2023-10-16T13:11:43.228273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:17.049740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961461+0000","last_change":"2023-10-16T13:11:40.973938+0000","last_active":"2023-10-16T13:11:41.961461+0000","last_peered":"2023-10-16T13:11:41.961461+0000","last_clean":"2023-10-16T13:11:41.961461+0000","last_became_active":"2023-10-16T13:11:40.973579+0000","last_became_peered":"2023-10-16T13:11:40.973579+0000","last_unstale":"2023-10-16T13:11:41.961461+0000","last_undegraded":"2023-10-16T13:11:41.961461+0000","last_fullsized":"2023-10-16T13:11:41.961461+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:49:29.153231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.351692+0000","last_change":"2023-10-16T13:11:39.954368+0000","last_active":"2023-10-16T13:11:47.351692+0000","last_peered":"2023-10-16T13:11:47.351692+0000","last_clean":"2023-10-16T13:11:47.351692+0000","last_became_active":"2023-10-16T13:11:39.953967+0000","last_became_peered":"2023-10-16T13:11:39.953967+0000","last_unstale":"2023-10-16T13:11:47.351692+0000","last_undegraded":"2023-10-16T13:11:47.351692+0000","last_fullsized":"2023-10-16T13:11:47.351692+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:43:49.278655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717616+0000","last_change":"2023-10-16T13:11:40.975917+0000","last_active":"2023-10-16T13:11:42.717616+0000","last_peered":"2023-10-16T13:11:42.717616+0000","last_clean":"2023-10-16T13:11:42.717616+0000","last_became_active":"2023-10-16T13:11:40.975610+0000","last_became_peered":"2023-10-16T13:11:40.975610+0000","last_unstale":"2023-10-16T13:11:42.717616+0000","last_undegraded":"2023-10-16T13:11:42.717616+0000","last_fullsized":"2023-10-16T13:11:42.717616+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:41.006584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:44.324104+0000","last_change":"2023-10-16T13:11:39.960169+0000","last_active":"2023-10-16T13:11:44.324104+0000","last_peered":"2023-10-16T13:11:44.324104+0000","last_clean":"2023-10-16T13:11:44.324104+0000","last_became_active":"2023-10-16T13:11:39.959385+0000","last_became_peered":"2023-10-16T13:11:39.959385+0000","last_unstale":"2023-10-16T13:11:44.324104+0000","last_undegraded":"2023-10-16T13:11:44.324104+0000","last_fullsized":"2023-10-16T13:11:44.324104+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:50:12.442686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228128+0000","last_change":"2023-10-16T13:11:40.971165+0000","last_active":"2023-10-16T13:11:43.228128+0000","last_peered":"2023-10-16T13:11:43.228128+0000","last_clean":"2023-10-16T13:11:43.228128+0000","last_became_active":"2023-10-16T13:11:40.970341+0000","last_became_peered":"2023-10-16T13:11:40.970341+0000","last_unstale":"2023-10-16T13:11:43.228128+0000","last_undegraded":"2023-10-16T13:11:43.228128+0000","last_fullsized":"2023-10-16T13:11:43.228128+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:39:48.393642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:44.323951+0000","last_change":"2023-10-16T13:11:39.953044+0000","last_active":"2023-10-16T13:11:44.323951+0000","last_peered":"2023-10-16T13:11:44.323951+0000","last_clean":"2023-10-16T13:11:44.323951+0000","last_became_active":"2023-10-16T13:11:39.952752+0000","last_became_peered":"2023-10-16T13:11:39.952752+0000","last_unstale":"2023-10-16T13:11:44.323951+0000","last_undegraded":"2023-10-16T13:11:44.323951+0000","last_fullsized":"2023-10-16T13:11:44.323951+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:33:12.277430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228221+0000","last_change":"2023-10-16T13:11:40.974739+0000","last_active":"2023-10-16T13:11:43.228221+0000","last_peered":"2023-10-16T13:11:43.228221+0000","last_clean":"2023-10-16T13:11:43.228221+0000","last_became_active":"2023-10-16T13:11:40.974387+0000","last_became_peered":"2023-10-16T13:11:40.974387+0000","last_unstale":"2023-10-16T13:11:43.228221+0000","last_undegraded":"2023-10-16T13:11:43.228221+0000","last_fullsized":"2023-10-16T13:11:43.228221+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:28:16.384359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.961672+0000","last_change":"2023-10-16T13:11:39.960427+0000","last_active":"2023-10-16T13:11:40.961672+0000","last_peered":"2023-10-16T13:11:40.961672+0000","last_clean":"2023-10-16T13:11:40.961672+0000","last_became_active":"2023-10-16T13:11:39.959928+0000","last_became_peered":"2023-10-16T13:11:39.959928+0000","last_unstale":"2023-10-16T13:11:40.961672+0000","last_undegraded":"2023-10-16T13:11:40.961672+0000","last_fullsized":"2023-10-16T13:11:40.961672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:38:37.073782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961407+0000","last_change":"2023-10-16T13:11:40.971153+0000","last_active":"2023-10-16T13:11:41.961407+0000","last_peered":"2023-10-16T13:11:41.961407+0000","last_clean":"2023-10-16T13:11:41.961407+0000","last_became_active":"2023-10-16T13:11:40.970772+0000","last_became_peered":"2023-10-16T13:11:40.970772+0000","last_unstale":"2023-10-16T13:11:41.961407+0000","last_undegraded":"2023-10-16T13:11:41.961407+0000","last_fullsized":"2023-10-16T13:11:41.961407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:34.450600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:44.324888+0000","last_change":"2023-10-16T13:11:39.957589+0000","last_active":"2023-10-16T13:11:44.324888+0000","last_peered":"2023-10-16T13:11:44.324888+0000","last_clean":"2023-10-16T13:11:44.324888+0000","last_became_active":"2023-10-16T13:11:39.957334+0000","last_became_peered":"2023-10-16T13:11:39.957334+0000","last_unstale":"2023-10-16T13:11:44.324888+0000","last_undegraded":"2023-10-16T13:11:44.324888+0000","last_fullsized":"2023-10-16T13:11:44.324888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:42:58.126279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972160+0000","last_change":"2023-10-16T13:11:40.979906+0000","last_active":"2023-10-16T13:11:42.972160+0000","last_peered":"2023-10-16T13:11:42.972160+0000","last_clean":"2023-10-16T13:11:42.972160+0000","last_became_active":"2023-10-16T13:11:40.979506+0000","last_became_peered":"2023-10-16T13:11:40.979506+0000","last_unstale":"2023-10-16T13:11:42.972160+0000","last_undegraded":"2023-10-16T13:11:42.972160+0000","last_fullsized":"2023-10-16T13:11:42.972160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:06:33.566642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.963060+0000","last_change":"2023-10-16T13:11:39.961062+0000","last_active":"2023-10-16T13:11:40.963060+0000","last_peered":"2023-10-16T13:11:40.963060+0000","last_clean":"2023-10-16T13:11:40.963060+0000","last_became_active":"2023-10-16T13:11:39.960615+0000","last_became_peered":"2023-10-16T13:11:39.960615+0000","last_unstale":"2023-10-16T13:11:40.963060+0000","last_undegraded":"2023-10-16T13:11:40.963060+0000","last_fullsized":"2023-10-16T13:11:40.963060+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:59:52.598863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972447+0000","last_change":"2023-10-16T13:11:40.979874+0000","last_active":"2023-10-16T13:11:42.972447+0000","last_peered":"2023-10-16T13:11:42.972447+0000","last_clean":"2023-10-16T13:11:42.972447+0000","last_became_active":"2023-10-16T13:11:40.979444+0000","last_became_peered":"2023-10-16T13:11:40.979444+0000","last_unstale":"2023-10-16T13:11:42.972447+0000","last_undegraded":"2023-10-16T13:11:42.972447+0000","last_fullsized":"2023-10-16T13:11:42.972447+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:27:38.533986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:46.335169+0000","last_change":"2023-10-16T13:11:39.962428+0000","last_active":"2023-10-16T13:11:46.335169+0000","last_peered":"2023-10-16T13:11:46.335169+0000","last_clean":"2023-10-16T13:11:46.335169+0000","last_became_active":"2023-10-16T13:11:39.962028+0000","last_became_peered":"2023-10-16T13:11:39.962028+0000","last_unstale":"2023-10-16T13:11:46.335169+0000","last_undegraded":"2023-10-16T13:11:46.335169+0000","last_fullsized":"2023-10-16T13:11:46.335169+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:43:25.415571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972234+0000","last_change":"2023-10-16T13:11:40.969804+0000","last_active":"2023-10-16T13:11:42.972234+0000","last_peered":"2023-10-16T13:11:42.972234+0000","last_clean":"2023-10-16T13:11:42.972234+0000","last_became_active":"2023-10-16T13:11:40.969339+0000","last_became_peered":"2023-10-16T13:11:40.969339+0000","last_unstale":"2023-10-16T13:11:42.972234+0000","last_undegraded":"2023-10-16T13:11:42.972234+0000","last_fullsized":"2023-10-16T13:11:42.972234+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:14:15.533029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.306815+0000","last_change":"2023-10-16T13:11:39.960173+0000","last_active":"2023-10-16T13:11:41.306815+0000","last_peered":"2023-10-16T13:11:41.306815+0000","last_clean":"2023-10-16T13:11:41.306815+0000","last_became_active":"2023-10-16T13:11:39.959839+0000","last_became_peered":"2023-10-16T13:11:39.959839+0000","last_unstale":"2023-10-16T13:11:41.306815+0000","last_undegraded":"2023-10-16T13:11:41.306815+0000","last_fullsized":"2023-10-16T13:11:41.306815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:31:16.379341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972451+0000","last_change":"2023-10-16T13:11:40.974349+0000","last_active":"2023-10-16T13:11:42.972451+0000","last_peered":"2023-10-16T13:11:42.972451+0000","last_clean":"2023-10-16T13:11:42.972451+0000","last_became_active":"2023-10-16T13:11:40.973189+0000","last_became_peered":"2023-10-16T13:11:40.973189+0000","last_unstale":"2023-10-16T13:11:42.972451+0000","last_undegraded":"2023-10-16T13:11:42.972451+0000","last_fullsized":"2023-10-16T13:11:42.972451+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:45:05.177277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228644+0000","last_change":"2023-10-16T13:11:40.972862+0000","last_active":"2023-10-16T13:11:43.228644+0000","last_peered":"2023-10-16T13:11:43.228644+0000","last_clean":"2023-10-16T13:11:43.228644+0000","last_became_active":"2023-10-16T13:11:40.972558+0000","last_became_peered":"2023-10-16T13:11:40.972558+0000","last_unstale":"2023-10-16T13:11:43.228644+0000","last_undegraded":"2023-10-16T13:11:43.228644+0000","last_fullsized":"2023-10-16T13:11:43.228644+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:09:36.149610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.985989+0000","last_change":"2023-10-16T13:11:40.973449+0000","last_active":"2023-10-16T13:11:42.985989+0000","last_peered":"2023-10-16T13:11:42.985989+0000","last_clean":"2023-10-16T13:11:42.985989+0000","last_became_active":"2023-10-16T13:11:40.973044+0000","last_became_peered":"2023-10-16T13:11:40.973044+0000","last_unstale":"2023-10-16T13:11:42.985989+0000","last_undegraded":"2023-10-16T13:11:42.985989+0000","last_fullsized":"2023-10-16T13:11:42.985989+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:22.883943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.986056+0000","last_change":"2023-10-16T13:11:40.970871+0000","last_active":"2023-10-16T13:11:42.986056+0000","last_peered":"2023-10-16T13:11:42.986056+0000","last_clean":"2023-10-16T13:11:42.986056+0000","last_became_active":"2023-10-16T13:11:40.970554+0000","last_became_peered":"2023-10-16T13:11:40.970554+0000","last_unstale":"2023-10-16T13:11:42.986056+0000","last_undegraded":"2023-10-16T13:11:42.986056+0000","last_fullsized":"2023-10-16T13:11:42.986056+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:46:34.449007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717476+0000","last_change":"2023-10-16T13:11:40.975827+0000","last_active":"2023-10-16T13:11:42.717476+0000","last_peered":"2023-10-16T13:11:42.717476+0000","last_clean":"2023-10-16T13:11:42.717476+0000","last_became_active":"2023-10-16T13:11:40.975514+0000","last_became_peered":"2023-10-16T13:11:40.975514+0000","last_unstale":"2023-10-16T13:11:42.717476+0000","last_undegraded":"2023-10-16T13:11:42.717476+0000","last_fullsized":"2023-10-16T13:11:42.717476+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:34:47.901390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228201+0000","last_change":"2023-10-16T13:11:40.975088+0000","last_active":"2023-10-16T13:11:43.228201+0000","last_peered":"2023-10-16T13:11:43.228201+0000","last_clean":"2023-10-16T13:11:43.228201+0000","last_became_active":"2023-10-16T13:11:40.974286+0000","last_became_peered":"2023-10-16T13:11:40.974286+0000","last_unstale":"2023-10-16T13:11:43.228201+0000","last_undegraded":"2023-10-16T13:11:43.228201+0000","last_fullsized":"2023-10-16T13:11:43.228201+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:15:50.270651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228527+0000","last_change":"2023-10-16T13:11:40.973111+0000","last_active":"2023-10-16T13:11:43.228527+0000","last_peered":"2023-10-16T13:11:43.228527+0000","last_clean":"2023-10-16T13:11:43.228527+0000","last_became_active":"2023-10-16T13:11:40.972826+0000","last_became_peered":"2023-10-16T13:11:40.972826+0000","last_unstale":"2023-10-16T13:11:43.228527+0000","last_undegraded":"2023-10-16T13:11:43.228527+0000","last_fullsized":"2023-10-16T13:11:43.228527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:43.523165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.986501+0000","last_change":"2023-10-16T13:11:40.980303+0000","last_active":"2023-10-16T13:11:42.986501+0000","last_peered":"2023-10-16T13:11:42.986501+0000","last_clean":"2023-10-16T13:11:42.986501+0000","last_became_active":"2023-10-16T13:11:40.979987+0000","last_became_peered":"2023-10-16T13:11:40.979987+0000","last_unstale":"2023-10-16T13:11:42.986501+0000","last_undegraded":"2023-10-16T13:11:42.986501+0000","last_fullsized":"2023-10-16T13:11:42.986501+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:38:16.402231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961388+0000","last_change":"2023-10-16T13:11:40.966547+0000","last_active":"2023-10-16T13:11:41.961388+0000","last_peered":"2023-10-16T13:11:41.961388+0000","last_clean":"2023-10-16T13:11:41.961388+0000","last_became_active":"2023-10-16T13:11:40.966149+0000","last_became_peered":"2023-10-16T13:11:40.966149+0000","last_unstale":"2023-10-16T13:11:41.961388+0000","last_undegraded":"2023-10-16T13:11:41.961388+0000","last_fullsized":"2023-10-16T13:11:41.961388+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:27:47.007356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962374+0000","last_change":"2023-10-16T13:11:40.968511+0000","last_active":"2023-10-16T13:11:41.962374+0000","last_peered":"2023-10-16T13:11:41.962374+0000","last_clean":"2023-10-16T13:11:41.962374+0000","last_became_active":"2023-10-16T13:11:40.968185+0000","last_became_peered":"2023-10-16T13:11:40.968185+0000","last_unstale":"2023-10-16T13:11:41.962374+0000","last_undegraded":"2023-10-16T13:11:41.962374+0000","last_fullsized":"2023-10-16T13:11:41.962374+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:31:43.779875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961188+0000","last_change":"2023-10-16T13:11:40.974616+0000","last_active":"2023-10-16T13:11:41.961188+0000","last_peered":"2023-10-16T13:11:41.961188+0000","last_clean":"2023-10-16T13:11:41.961188+0000","last_became_active":"2023-10-16T13:11:40.974295+0000","last_became_peered":"2023-10-16T13:11:40.974295+0000","last_unstale":"2023-10-16T13:11:41.961188+0000","last_undegraded":"2023-10-16T13:11:41.961188+0000","last_fullsized":"2023-10-16T13:11:41.961188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:47.838853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961878+0000","last_change":"2023-10-16T13:11:40.974927+0000","last_active":"2023-10-16T13:11:41.961878+0000","last_peered":"2023-10-16T13:11:41.961878+0000","last_clean":"2023-10-16T13:11:41.961878+0000","last_became_active":"2023-10-16T13:11:40.974332+0000","last_became_peered":"2023-10-16T13:11:40.974332+0000","last_unstale":"2023-10-16T13:11:41.961878+0000","last_undegraded":"2023-10-16T13:11:41.961878+0000","last_fullsized":"2023-10-16T13:11:41.961878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:07:24.974440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228631+0000","last_change":"2023-10-16T13:11:40.972793+0000","last_active":"2023-10-16T13:11:43.228631+0000","last_peered":"2023-10-16T13:11:43.228631+0000","last_clean":"2023-10-16T13:11:43.228631+0000","last_became_active":"2023-10-16T13:11:40.972008+0000","last_became_peered":"2023-10-16T13:11:40.972008+0000","last_unstale":"2023-10-16T13:11:43.228631+0000","last_undegraded":"2023-10-16T13:11:43.228631+0000","last_fullsized":"2023-10-16T13:11:43.228631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:53.487238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228280+0000","last_change":"2023-10-16T13:11:40.977282+0000","last_active":"2023-10-16T13:11:43.228280+0000","last_peered":"2023-10-16T13:11:43.228280+0000","last_clean":"2023-10-16T13:11:43.228280+0000","last_became_active":"2023-10-16T13:11:40.976872+0000","last_became_peered":"2023-10-16T13:11:40.976872+0000","last_unstale":"2023-10-16T13:11:43.228280+0000","last_undegraded":"2023-10-16T13:11:43.228280+0000","last_fullsized":"2023-10-16T13:11:43.228280+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:43:48.735584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6730,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":23,"num_read_kb":18,"num_write":139,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":38195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449100,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":426192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":10,"up_from":71,"seq":304942678032,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1519616,"data_stored":1017936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.377},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48999999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47399999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.41099999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.57799999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.63},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.59199999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.504}]},{"osd":8,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.65600000000000003}]},{"osd":9,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.71099999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":9,"up_from":66,"seq":283467841557,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":892928,"data_stored":425582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.311},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.34300000000000003}]},{"osd":1,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.44900000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.505}]},{"osd":3,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.41099999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.438}]},{"osd":5,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.46000000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.39600000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.63800000000000001}]},{"osd":8,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.56299999999999994}]},{"osd":10,"last update":"Mon Oct 16 13:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.621}]}]},{"osd":8,"up_from":59,"seq":253403070489,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":425738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.56200000000000006}]},{"osd":1,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.71299999999999997}]},{"osd":2,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.64000000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.73799999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.88800000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.95199999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.83499999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.0629999999999999}]},{"osd":9,"last update":"Mon Oct 16 13:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.874},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.96799999999999997}]},{"osd":10,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.694,"5min":3.694,"15min":3.694},"last":1.046}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]}]},{"osd":7,"up_from":51,"seq":219043332125,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28480,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716672,"statfs":{"total":95995035648,"available":95965872128,"internally_reserved":0,"allocated":1499136,"data_stored":1017160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.38},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.34699999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41199999999999998,"15min":0.40799999999999997},"min":{"1min":0.29999999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.60199999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.433,"5min":0.40999999999999998,"15min":0.40600000000000003},"min":{"1min":0.29899999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.58499999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.57099999999999995}]},{"osd":2,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.42899999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.40500000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.66200000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.442,"5min":0.37,"15min":0.37},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.754,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.76500000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.49299999999999999,"15min":0.48599999999999999},"min":{"1min":0.35699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46800000000000003,"15min":0.46100000000000002},"min":{"1min":0.36499999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.72399999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.45000000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.66300000000000003,"15min":0.65400000000000003},"min":{"1min":0.56899999999999995,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.749}]},{"osd":6,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65900000000000003,"15min":0.65500000000000003},"min":{"1min":0.436,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.54100000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":1.0409999999999999}]},{"osd":8,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.88300000000000001}]},{"osd":9,"last update":"Mon Oct 16 13:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":1.073},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.95299999999999996}]},{"osd":10,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":1.0589999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]}]},{"osd":6,"up_from":46,"seq":197568495650,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":888832,"data_stored":425000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.376},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63600000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.34899999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.59199999999999997,"15min":0.58099999999999996},"min":{"1min":0.38700000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.40899999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.997,"5min":1,"15min":1},"last":0.68600000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.377,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61699999999999999,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.878,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.55900000000000005}]},{"osd":3,"last update":"Mon Oct 16 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45100000000000001,"15min":0.44600000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.47699999999999998,"15min":0.47099999999999997},"min":{"1min":0.316,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.39900000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63500000000000001,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.621},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.40500000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89000000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.60699999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.67900000000000005,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.50600000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.68400000000000005,"15min":0.67500000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.45500000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67100000000000004}]},{"osd":8,"last update":"Mon Oct 16 13:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.63900000000000001}]},{"osd":9,"last update":"Mon Oct 16 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.47499999999999998}]},{"osd":10,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.78900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":427194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48299999999999998,"15min":0.45600000000000002},"min":{"1min":0.30099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73899999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.51600000000000001,"15min":0.47599999999999998},"min":{"1min":0.42699999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.83299999999999996,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.55100000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51800000000000002,"15min":0.51400000000000001},"min":{"1min":0.39100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.73899999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53500000000000003,"15min":0.503},"min":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72799999999999998,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.54900000000000004,"15min":0.51500000000000001},"min":{"1min":0.46200000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91900000000000004,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.66400000000000003}]},{"osd":4,"last update":"Mon Oct 16 13:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.40400000000000003,"15min":0.39500000000000002},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.434,"15min":0.42599999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.80300000000000005}]},{"osd":5,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.59699999999999998,"15min":0.58799999999999997},"min":{"1min":0.44900000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.89700000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:11:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64100000000000001,"15min":0.64300000000000002},"min":{"1min":0.44800000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93400000000000005,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.752},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63400000000000001,"15min":0.63100000000000001},"min":{"1min":0.39300000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95199999999999996,"5min":1.429,"15min":1.429},"last":0.876}]},{"osd":7,"last update":"Mon Oct 16 13:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":1.006},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.83299999999999996}]},{"osd":8,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":1.0469999999999999}]},{"osd":9,"last update":"Mon Oct 16 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.91600000000000004}]},{"osd":10,"last update":"Mon Oct 16 13:11:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":1.022},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":1.034}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":427066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.51900000000000002,"15min":0.503},"min":{"1min":0.33400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.52900000000000003,"15min":0.501},"min":{"1min":0.35199999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.88900000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.77400000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:10:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54700000000000004,"15min":0.53200000000000003},"min":{"1min":0.42099999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76800000000000002,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.33500000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.752,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.56699999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41999999999999998,"15min":0.42199999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.55800000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.48099999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.53800000000000003,"15min":0.50600000000000001},"min":{"1min":0.36199999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.57099999999999995,"15min":0.55000000000000004},"min":{"1min":0.39200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.57599999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:10:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74099999999999999,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.70199999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.497,"15min":0.49399999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.85699999999999998,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.48599999999999999,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.39700000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.42099999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0169999999999999,"5min":1.51,"15min":1.51},"last":0.61199999999999999}]},{"osd":8,"last update":"Mon Oct 16 13:10:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.624}]},{"osd":9,"last update":"Mon Oct 16 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.53400000000000003}]},{"osd":10,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.75},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.73699999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411379,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":426646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.73399999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.51600000000000001,"15min":0.51400000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.747}]},{"osd":1,"last update":"Mon Oct 16 13:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.504,"15min":0.48599999999999999},"min":{"1min":0.40899999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.51300000000000001,"15min":0.49299999999999999},"min":{"1min":0.41999999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.74299999999999999,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.77800000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:11:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.39800000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81999999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.60799999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58199999999999996,"15min":0.57099999999999995},"min":{"1min":0.39700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.80400000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.56000000000000005,"15min":0.53100000000000003},"min":{"1min":0.52400000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85499999999999998,"5min":0.879,"15min":0.879},"last":0.98899999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32300000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.501,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.30099999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.97199999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:11:11 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.44500000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.81499999999999995}]},{"osd":7,"last update":"Mon Oct 16 13:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.49099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.58599999999999997}]},{"osd":8,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.84299999999999997}]},{"osd":9,"last update":"Mon Oct 16 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.95699999999999996}]},{"osd":10,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":1.034},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":1.0209999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]}]},{"osd":3,"up_from":25,"seq":107374182447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":425003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.34300000000000003,"15min":0.33000000000000002},"min":{"1min":0.26800000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.52600000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.36099999999999999,"15min":0.34300000000000003},"min":{"1min":0.29699999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55300000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.39400000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.51800000000000002,"15min":0.503},"min":{"1min":0.40100000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.74399999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.62},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.52100000000000002,"15min":0.495},"min":{"1min":0.42199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.504}]},{"osd":2,"last update":"Mon Oct 16 13:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.39800000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.745,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55600000000000005,"15min":0.53600000000000003},"min":{"1min":0.32400000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.73599999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58799999999999997,"15min":0.54100000000000004},"min":{"1min":0.38600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.76700000000000002,"5min":6.032,"15min":6.032},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.55000000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:10:51 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.45700000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.755,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.50600000000000001,"15min":0.502},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73699999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.43099999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.56899999999999995}]},{"osd":7,"last update":"Mon Oct 16 13:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65900000000000003,"15min":0.64800000000000002},"min":{"1min":0.40500000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.63500000000000001,"15min":0.625},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.65400000000000003}]},{"osd":8,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.55500000000000005}]},{"osd":9,"last update":"Mon Oct 16 13:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.58299999999999996}]},{"osd":10,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.68000000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":4,"up_from":33,"seq":141733920810,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":426056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.497,"15min":0.48799999999999999},"min":{"1min":0.377,"5min":0.318,"15min":0.318},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.51100000000000001,"15min":0.495},"min":{"1min":0.41899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.41899999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.36599999999999999},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.41399999999999998,"15min":0.39600000000000002},"min":{"1min":0.27900000000000003,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.42799999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77700000000000002,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.57399999999999995,"15min":0.54900000000000004},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.61699999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.56000000000000005,"15min":0.54000000000000004},"min":{"1min":0.44900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78300000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.374,"5min":0.312,"15min":0.312},"max":{"1min":0.83499999999999996,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.47999999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.58899999999999997,"15min":0.57899999999999996},"min":{"1min":0.48199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.73799999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91100000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.54800000000000004}]},{"osd":7,"last update":"Mon Oct 16 13:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.55000000000000004,"15min":0.52900000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.71199999999999997}]},{"osd":8,"last update":"Mon Oct 16 13:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.755},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.83299999999999996}]},{"osd":9,"last update":"Mon Oct 16 13:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.78300000000000003}]},{"osd":10,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.81799999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757287,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1527808,"data_stored":1018370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.496},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54400000000000004,"15min":0.53800000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83199999999999996,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.52800000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.52000000000000002,"15min":0.51100000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.73799999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.35399999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83499999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40000000000000002},"min":{"1min":0.315,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.499,"5min":0.42199999999999999,"15min":0.40899999999999997},"min":{"1min":0.30499999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.628}]},{"osd":3,"last update":"Mon Oct 16 13:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.45400000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79800000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66300000000000003}]},{"osd":4,"last update":"Mon Oct 16 13:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.443,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77400000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.56499999999999995,"15min":0.55400000000000005},"min":{"1min":0.442,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.72099999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.623,"15min":0.62},"min":{"1min":0.42199999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.46600000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.83299999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.77000000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.876,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64900000000000002,"15min":0.65000000000000002},"min":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.85199999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.82899999999999996}]},{"osd":8,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.755},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.90600000000000003}]},{"osd":9,"last update":"Mon Oct 16 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.871}]},{"osd":10,"last update":"Mon Oct 16 13:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":4.4859999999999998,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.89500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":20729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:11:49.391 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T13:11:49.392 INFO:tasks.cephadm:Setting up client nodes... 2023-10-16T13:11:49.392 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-10-16T13:11:49.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:49 smithi152 ceph-mon[104423]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:11:49.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:49 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] up:active 2023-10-16T13:11:49.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:49 smithi152 ceph-mon[104423]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2023-10-16T13:11:49.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:49 smithi152 ceph-mon[104423]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:11:49.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:49 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3821815738' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:49.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:49 smithi092 ceph-mon[99542]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:11:49.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:49 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] up:active 2023-10-16T13:11:49.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:49 smithi092 ceph-mon[99542]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2023-10-16T13:11:49.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:49 smithi092 ceph-mon[99542]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:11:49.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:49 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3821815738' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:49.783 INFO:journalctl@ceph.mds.b.smithi118.stdout:Oct 16 13:11:49 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-b[141414]: 2023-10-16T13:11:49.316+0000 7fe3e1f89700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-10-16T13:11:49.784 INFO:journalctl@ceph.mds.b.smithi118.stdout:Oct 16 13:11:49 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-b[141414]: 2023-10-16T13:11:49.316+0000 7fe3e1f89700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-10-16T13:11:49.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:49 smithi118 ceph-mon[103969]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:11:49.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:49 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] up:active 2023-10-16T13:11:49.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:49 smithi118 ceph-mon[103969]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2023-10-16T13:11:49.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:49 smithi118 ceph-mon[103969]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:11:49.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:49 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3821815738' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:49.971 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:11:50.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:50 smithi092 ceph-mon[99542]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:11:50.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:50 smithi092 ceph-mon[99542]: pgmap v260: 97 pgs: 97 active+clean; 583 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 6.0 KiB/s wr, 19 op/s 2023-10-16T13:11:50.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:50 smithi092 ceph-mon[99542]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:11:50.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:50 smithi152 ceph-mon[104423]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:11:50.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:50 smithi152 ceph-mon[104423]: pgmap v260: 97 pgs: 97 active+clean; 583 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 6.0 KiB/s wr, 19 op/s 2023-10-16T13:11:50.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:50 smithi152 ceph-mon[104423]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:11:50.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:50 smithi118 ceph-mon[103969]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:11:50.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:50 smithi118 ceph-mon[103969]: pgmap v260: 97 pgs: 97 active+clean; 583 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 6.0 KiB/s wr, 19 op/s 2023-10-16T13:11:50.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:50 smithi118 ceph-mon[103969]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:11:51.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.213+0000 7f43af729700 1 -- 172.21.15.92:0/3469021156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43a8101040 msgr2=0x7f43a81014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:51.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.213+0000 7f43af729700 1 --2- 172.21.15.92:0/3469021156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43a8101040 0x7f43a81014c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009990 tx=0x7f43a4009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:51.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.213+0000 7f43af729700 1 -- 172.21.15.92:0/3469021156 shutdown_connections 2023-10-16T13:11:51.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.213+0000 7f43af729700 1 --2- 172.21.15.92:0/3469021156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43a8101a00 0x7f43a8108320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:51.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.213+0000 7f43af729700 1 --2- 172.21.15.92:0/3469021156 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43a80ffe50 0x7f43a8100270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:51.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.213+0000 7f43af729700 1 --2- 172.21.15.92:0/3469021156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43a8101040 0x7f43a81014c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:51.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.213+0000 7f43af729700 1 -- 172.21.15.92:0/3469021156 >> 172.21.15.92:0/3469021156 conn(0x7f43a80fb420 msgr2=0x7f43a80fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:51.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.213+0000 7f43af729700 1 -- 172.21.15.92:0/3469021156 shutdown_connections 2023-10-16T13:11:51.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.213+0000 7f43af729700 1 -- 172.21.15.92:0/3469021156 wait complete. 2023-10-16T13:11:51.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.213+0000 7f43af729700 1 Processor -- start 2023-10-16T13:11:51.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.214+0000 7f43af729700 1 -- start start 2023-10-16T13:11:51.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.214+0000 7f43af729700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43a80ffe50 0x7f43a8069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:51.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.214+0000 7f43af729700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43a8101040 0x7f43a819baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:51.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.214+0000 7f43af729700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43a8101a00 0x7f43a819e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:51.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.214+0000 7f43af729700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a819e890 con 0x7f43a8101a00 2023-10-16T13:11:51.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.214+0000 7f43af729700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a819ea00 con 0x7f43a80ffe50 2023-10-16T13:11:51.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.214+0000 7f43af729700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a819ebc0 con 0x7f43a8101040 2023-10-16T13:11:51.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.214+0000 7f43adcc6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43a8101a00 0x7f43a819e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:51.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.214+0000 7f43adcc6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43a8101a00 0x7f43a819e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35458/0 (socket says 172.21.15.92:35458) 2023-10-16T13:11:51.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.214+0000 7f43adcc6700 1 -- 172.21.15.92:0/3703793829 learned_addr learned my addr 172.21.15.92:0/3703793829 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:51.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.214+0000 7f43ad4c5700 1 --2- 172.21.15.92:0/3703793829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43a80ffe50 0x7f43a8069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:51.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.214+0000 7f43accc4700 1 --2- 172.21.15.92:0/3703793829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43a8101040 0x7f43a819baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:51.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.214+0000 7f43adcc6700 1 -- 172.21.15.92:0/3703793829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43a8101040 msgr2=0x7f43a819baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:51.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.214+0000 7f43adcc6700 1 --2- 172.21.15.92:0/3703793829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43a8101040 0x7f43a819baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:51.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.214+0000 7f43adcc6700 1 -- 172.21.15.92:0/3703793829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43a80ffe50 msgr2=0x7f43a8069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:51.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.214+0000 7f43adcc6700 1 --2- 172.21.15.92:0/3703793829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43a80ffe50 0x7f43a8069520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:51.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.214+0000 7f43adcc6700 1 -- 172.21.15.92:0/3703793829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a40095f0 con 0x7f43a8101a00 2023-10-16T13:11:51.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.214+0000 7f43adcc6700 1 --2- 172.21.15.92:0/3703793829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43a8101a00 0x7f43a819e0f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f43a000ada0 tx=0x7f43a000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:51.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.215+0000 7f439e7fc700 1 -- 172.21.15.92:0/3703793829 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a000f070 con 0x7f43a8101a00 2023-10-16T13:11:51.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.215+0000 7f43af729700 1 -- 172.21.15.92:0/3703793829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a819eea0 con 0x7f43a8101a00 2023-10-16T13:11:51.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.215+0000 7f439e7fc700 1 -- 172.21.15.92:0/3703793829 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f43a0007b30 con 0x7f43a8101a00 2023-10-16T13:11:51.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.215+0000 7f439e7fc700 1 -- 172.21.15.92:0/3703793829 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a00053c0 con 0x7f43a8101a00 2023-10-16T13:11:51.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.215+0000 7f43af729700 1 -- 172.21.15.92:0/3703793829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a8195870 con 0x7f43a8101a00 2023-10-16T13:11:51.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.216+0000 7f43af729700 1 -- 172.21.15.92:0/3703793829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a810b810 con 0x7f43a8101a00 2023-10-16T13:11:51.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.217+0000 7f439e7fc700 1 -- 172.21.15.92:0/3703793829 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f43a000c980 con 0x7f43a8101a00 2023-10-16T13:11:51.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.217+0000 7f439e7fc700 1 --2- 172.21.15.92:0/3703793829 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f43940a5920 0x7f43940a7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:51.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.217+0000 7f43ad4c5700 1 --2- 172.21.15.92:0/3703793829 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f43940a5920 0x7f43940a7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:51.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.217+0000 7f439e7fc700 1 -- 172.21.15.92:0/3703793829 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f43a00cc2d0 con 0x7f43a8101a00 2023-10-16T13:11:51.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.218+0000 7f43ad4c5700 1 --2- 172.21.15.92:0/3703793829 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f43940a5920 0x7f43940a7de0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f43a8100bb0 tx=0x7f439800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:51.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.221+0000 7f439e7fc700 1 -- 172.21.15.92:0/3703793829 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f43a0095a10 con 0x7f43a8101a00 2023-10-16T13:11:51.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.489+0000 7f43af729700 1 -- 172.21.15.92:0/3703793829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f43a8195b30 con 0x7f43a8101a00 2023-10-16T13:11:51.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.493+0000 7f439e7fc700 1 -- 172.21.15.92:0/3703793829 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7f43a0099030 con 0x7f43a8101a00 2023-10-16T13:11:51.498 INFO:teuthology.orchestra.run.smithi092.stdout:[client.0] 2023-10-16T13:11:51.498 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCXNi1lDTZHHRAAeXKLJ4LIVq7XBd3hoD+gZA== 2023-10-16T13:11:51.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.495+0000 7f43af729700 1 -- 172.21.15.92:0/3703793829 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f43940a5920 msgr2=0x7f43940a7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:51.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.495+0000 7f43af729700 1 --2- 172.21.15.92:0/3703793829 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f43940a5920 0x7f43940a7de0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f43a8100bb0 tx=0x7f439800a380 comp rx=0 tx=0).stop 2023-10-16T13:11:51.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.495+0000 7f43af729700 1 -- 172.21.15.92:0/3703793829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43a8101a00 msgr2=0x7f43a819e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:51.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.495+0000 7f43af729700 1 --2- 172.21.15.92:0/3703793829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43a8101a00 0x7f43a819e0f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f43a000ada0 tx=0x7f43a000c330 comp rx=0 tx=0).stop 2023-10-16T13:11:51.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.495+0000 7f43af729700 1 -- 172.21.15.92:0/3703793829 shutdown_connections 2023-10-16T13:11:51.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.495+0000 7f43af729700 1 --2- 172.21.15.92:0/3703793829 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f43940a5920 0x7f43940a7de0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:51.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.495+0000 7f43af729700 1 --2- 172.21.15.92:0/3703793829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43a8101a00 0x7f43a819e0f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:51.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.496+0000 7f43af729700 1 --2- 172.21.15.92:0/3703793829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43a80ffe50 0x7f43a8069520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:51.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.496+0000 7f43af729700 1 --2- 172.21.15.92:0/3703793829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43a8101040 0x7f43a819baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:51.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.496+0000 7f43af729700 1 -- 172.21.15.92:0/3703793829 >> 172.21.15.92:0/3703793829 conn(0x7f43a80fb420 msgr2=0x7f43a80fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:51.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.496+0000 7f43af729700 1 -- 172.21.15.92:0/3703793829 shutdown_connections 2023-10-16T13:11:51.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:51.496+0000 7f43af729700 1 -- 172.21.15.92:0/3703793829 wait complete. 2023-10-16T13:11:51.915 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T13:11:51.915 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-10-16T13:11:51.916 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-16T13:11:51.956 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-16T13:11:51.957 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-10-16T13:11:51.958 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph mgr dump --format=json 2023-10-16T13:11:52.553 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:11:52.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:52 smithi152 ceph-mon[104423]: pgmap v261: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 11 KiB/s wr, 27 op/s 2023-10-16T13:11:52.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:52 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3703793829' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-16T13:11:52.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:52 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3703793829' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-16T13:11:52.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:52 smithi092 ceph-mon[99542]: pgmap v261: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 11 KiB/s wr, 27 op/s 2023-10-16T13:11:52.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:52 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3703793829' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-16T13:11:52.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:52 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3703793829' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-16T13:11:52.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:52 smithi118 ceph-mon[103969]: pgmap v261: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 11 KiB/s wr, 27 op/s 2023-10-16T13:11:52.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:52 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3703793829' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-16T13:11:52.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:52 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3703793829' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-16T13:11:54.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.019+0000 7f78316bd700 1 -- 172.21.15.92:0/145294833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f782c100070 msgr2=0x7f782c100450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:54.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.019+0000 7f78316bd700 1 --2- 172.21.15.92:0/145294833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f782c100070 0x7f782c100450 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7820009990 tx=0x7f7820009ca0 comp rx=0 tx=0).stop 2023-10-16T13:11:54.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.019+0000 7f78316bd700 1 -- 172.21.15.92:0/145294833 shutdown_connections 2023-10-16T13:11:54.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.019+0000 7f78316bd700 1 --2- 172.21.15.92:0/145294833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f782c100070 0x7f782c100450 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:54.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.019+0000 7f78316bd700 1 --2- 172.21.15.92:0/145294833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f782c105150 0x7f782c10cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:54.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.019+0000 7f78316bd700 1 --2- 172.21.15.92:0/145294833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f782c100a20 0x7f782c104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:54.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.019+0000 7f78316bd700 1 -- 172.21.15.92:0/145294833 >> 172.21.15.92:0/145294833 conn(0x7f782c076ea0 msgr2=0x7f782c0772b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:54.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.019+0000 7f78316bd700 1 -- 172.21.15.92:0/145294833 shutdown_connections 2023-10-16T13:11:54.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.019+0000 7f78316bd700 1 -- 172.21.15.92:0/145294833 wait complete. 2023-10-16T13:11:54.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.020+0000 7f78316bd700 1 Processor -- start 2023-10-16T13:11:54.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.020+0000 7f78316bd700 1 -- start start 2023-10-16T13:11:54.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f78316bd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f782c100070 0x7f782c101b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:54.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f78316bd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f782c100a20 0x7f782c102050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:54.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f78316bd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f782c105150 0x7f782c1025d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:54.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f78316bd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c1a5460 con 0x7f782c100a20 2023-10-16T13:11:54.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f78316bd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c1a55d0 con 0x7f782c105150 2023-10-16T13:11:54.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f78316bd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c1a5790 con 0x7f782c100070 2023-10-16T13:11:54.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f782a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f782c100a20 0x7f782c102050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:54.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f782a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f782c100a20 0x7f782c102050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35468/0 (socket says 172.21.15.92:35468) 2023-10-16T13:11:54.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f782a7fc700 1 -- 172.21.15.92:0/3135326362 learned_addr learned my addr 172.21.15.92:0/3135326362 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:54.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f782b7fe700 1 --2- 172.21.15.92:0/3135326362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f782c105150 0x7f782c1025d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:54.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f782affd700 1 --2- 172.21.15.92:0/3135326362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f782c100070 0x7f782c101b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:54.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f782a7fc700 1 -- 172.21.15.92:0/3135326362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f782c100070 msgr2=0x7f782c101b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:54.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f782a7fc700 1 --2- 172.21.15.92:0/3135326362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f782c100070 0x7f782c101b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:54.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f782a7fc700 1 -- 172.21.15.92:0/3135326362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f782c105150 msgr2=0x7f782c1025d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:54.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f782a7fc700 1 --2- 172.21.15.92:0/3135326362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f782c105150 0x7f782c1025d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:54.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f782a7fc700 1 -- 172.21.15.92:0/3135326362 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78200095f0 con 0x7f782c100a20 2023-10-16T13:11:54.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f782a7fc700 1 --2- 172.21.15.92:0/3135326362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f782c100a20 0x7f782c102050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f781c00c8f0 tx=0x7f781c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:54.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f7813fff700 1 -- 172.21.15.92:0/3135326362 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c007940 con 0x7f782c100a20 2023-10-16T13:11:54.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f7813fff700 1 -- 172.21.15.92:0/3135326362 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f781c00f450 con 0x7f782c100a20 2023-10-16T13:11:54.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f7813fff700 1 -- 172.21.15.92:0/3135326362 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c018660 con 0x7f782c100a20 2023-10-16T13:11:54.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.021+0000 7f78316bd700 1 -- 172.21.15.92:0/3135326362 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c1a5a70 con 0x7f782c100a20 2023-10-16T13:11:54.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.022+0000 7f78316bd700 1 -- 172.21.15.92:0/3135326362 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c1a5f20 con 0x7f782c100a20 2023-10-16T13:11:54.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.022+0000 7f78316bd700 1 -- 172.21.15.92:0/3135326362 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782c04ebb0 con 0x7f782c100a20 2023-10-16T13:11:54.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.023+0000 7f7813fff700 1 -- 172.21.15.92:0/3135326362 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f781c00f5c0 con 0x7f782c100a20 2023-10-16T13:11:54.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.024+0000 7f7813fff700 1 --2- 172.21.15.92:0/3135326362 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f78140a1510 0x7f78140a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:54.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.024+0000 7f782affd700 1 --2- 172.21.15.92:0/3135326362 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f78140a1510 0x7f78140a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:54.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.024+0000 7f7813fff700 1 -- 172.21.15.92:0/3135326362 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f781c0ccbe0 con 0x7f782c100a20 2023-10-16T13:11:54.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.024+0000 7f782affd700 1 --2- 172.21.15.92:0/3135326362 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f78140a1510 0x7f78140a39d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7820005f50 tx=0x7f7820005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:54.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.028+0000 7f7813fff700 1 -- 172.21.15.92:0/3135326362 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f781c096290 con 0x7f782c100a20 2023-10-16T13:11:54.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.271+0000 7f78316bd700 1 -- 172.21.15.92:0/3135326362 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f782c103040 con 0x7f782c100a20 2023-10-16T13:11:54.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.275+0000 7f7813fff700 1 -- 172.21.15.92:0/3135326362 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260407 (secure 0 0 0) 0x7f781c0998b0 con 0x7f782c100a20 2023-10-16T13:11:54.281 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:54.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.278+0000 7f78316bd700 1 -- 172.21.15.92:0/3135326362 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f78140a1510 msgr2=0x7f78140a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:54.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.278+0000 7f78316bd700 1 --2- 172.21.15.92:0/3135326362 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f78140a1510 0x7f78140a39d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7820005f50 tx=0x7f7820005e80 comp rx=0 tx=0).stop 2023-10-16T13:11:54.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.278+0000 7f78316bd700 1 -- 172.21.15.92:0/3135326362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f782c100a20 msgr2=0x7f782c102050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:54.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.278+0000 7f78316bd700 1 --2- 172.21.15.92:0/3135326362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f782c100a20 0x7f782c102050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f781c00c8f0 tx=0x7f781c00cc00 comp rx=0 tx=0).stop 2023-10-16T13:11:54.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.278+0000 7f78316bd700 1 -- 172.21.15.92:0/3135326362 shutdown_connections 2023-10-16T13:11:54.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.278+0000 7f78316bd700 1 --2- 172.21.15.92:0/3135326362 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f78140a1510 0x7f78140a39d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:54.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.278+0000 7f78316bd700 1 --2- 172.21.15.92:0/3135326362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f782c105150 0x7f782c1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:54.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.278+0000 7f78316bd700 1 --2- 172.21.15.92:0/3135326362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f782c100070 0x7f782c101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:54.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.278+0000 7f78316bd700 1 --2- 172.21.15.92:0/3135326362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f782c100a20 0x7f782c102050 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:54.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.278+0000 7f78316bd700 1 -- 172.21.15.92:0/3135326362 >> 172.21.15.92:0/3135326362 conn(0x7f782c076ea0 msgr2=0x7f782c069400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:54.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.279+0000 7f78316bd700 1 -- 172.21.15.92:0/3135326362 shutdown_connections 2023-10-16T13:11:54.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:54.279+0000 7f78316bd700 1 -- 172.21.15.92:0/3135326362 wait complete. 2023-10-16T13:11:54.679 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:54 smithi092 ceph-mon[99542]: pgmap v262: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 9.5 KiB/s wr, 26 op/s 2023-10-16T13:11:54.680 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:54 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3135326362' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-16T13:11:54.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:54 smithi152 ceph-mon[104423]: pgmap v262: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 9.5 KiB/s wr, 26 op/s 2023-10-16T13:11:54.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:54 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3135326362' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-16T13:11:54.711 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":17,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2605982588},{"type":"v1","addr":"172.21.15.92:6801","nonce":2605982588}]},"active_addr":"172.21.15.92:6801/2605982588","active_change":"2023-10-16T13:05:35.186582+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.92:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":293199301}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":1118703259}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":4070135528}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":2515872870}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":1236627658}]}]} 2023-10-16T13:11:54.718 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-10-16T13:11:54.718 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-10-16T13:11:54.719 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph osd dump --format=json 2023-10-16T13:11:54.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:54 smithi118 ceph-mon[103969]: pgmap v262: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 9.5 KiB/s wr, 26 op/s 2023-10-16T13:11:54.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:54 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3135326362' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-16T13:11:55.274 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:11:56.385 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:56 smithi092 ceph-mon[99542]: pgmap v263: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 8.9 KiB/s wr, 24 op/s 2023-10-16T13:11:56.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.561+0000 7f293b712700 1 -- 172.21.15.92:0/1455888255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2934100820 msgr2=0x7f293410cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:56.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.561+0000 7f293b712700 1 --2- 172.21.15.92:0/1455888255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2934100820 0x7f293410cc90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f292c00b0d0 tx=0x7f292c00b3e0 comp rx=0 tx=0).stop 2023-10-16T13:11:56.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.561+0000 7f293b712700 1 -- 172.21.15.92:0/1455888255 shutdown_connections 2023-10-16T13:11:56.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.561+0000 7f293b712700 1 --2- 172.21.15.92:0/1455888255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2934100820 0x7f293410cc90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:56.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.561+0000 7f293b712700 1 --2- 172.21.15.92:0/1455888255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2934105e70 0x7f2934106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:56.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.561+0000 7f293b712700 1 --2- 172.21.15.92:0/1455888255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29340ffe60 0x7f29341002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:56.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.561+0000 7f293b712700 1 -- 172.21.15.92:0/1455888255 >> 172.21.15.92:0/1455888255 conn(0x7f2934075e00 msgr2=0x7f2934076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:56.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.561+0000 7f293b712700 1 -- 172.21.15.92:0/1455888255 shutdown_connections 2023-10-16T13:11:56.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.561+0000 7f293b712700 1 -- 172.21.15.92:0/1455888255 wait complete. 2023-10-16T13:11:56.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.561+0000 7f293b712700 1 Processor -- start 2023-10-16T13:11:56.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.561+0000 7f293b712700 1 -- start start 2023-10-16T13:11:56.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f293b712700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29340ffe60 0x7f2934197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:56.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f293b712700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2934100820 0x7f29341983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:56.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f293b712700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2934105e70 0x7f29341a2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:56.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f293b712700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2934198d20 con 0x7f2934105e70 2023-10-16T13:11:56.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f293b712700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29341a3460 con 0x7f2934100820 2023-10-16T13:11:56.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f293b712700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29341a3620 con 0x7f29340ffe60 2023-10-16T13:11:56.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f2939caf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2934105e70 0x7f29341a2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:56.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f2939caf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2934105e70 0x7f29341a2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35480/0 (socket says 172.21.15.92:35480) 2023-10-16T13:11:56.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f2939caf700 1 -- 172.21.15.92:0/1572867984 learned_addr learned my addr 172.21.15.92:0/1572867984 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:56.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f2938cad700 1 --2- 172.21.15.92:0/1572867984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2934100820 0x7f29341983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:56.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f29394ae700 1 --2- 172.21.15.92:0/1572867984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29340ffe60 0x7f2934197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:56.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f2939caf700 1 -- 172.21.15.92:0/1572867984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29340ffe60 msgr2=0x7f2934197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:56.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f2939caf700 1 --2- 172.21.15.92:0/1572867984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29340ffe60 0x7f2934197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:56.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f2939caf700 1 -- 172.21.15.92:0/1572867984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2934100820 msgr2=0x7f29341983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:56.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f2939caf700 1 --2- 172.21.15.92:0/1572867984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2934100820 0x7f29341983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:56.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f2939caf700 1 -- 172.21.15.92:0/1572867984 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292c009d00 con 0x7f2934105e70 2023-10-16T13:11:56.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f29394ae700 1 --2- 172.21.15.92:0/1572867984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29340ffe60 0x7f2934197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:11:56.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f2939caf700 1 --2- 172.21.15.92:0/1572867984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2934105e70 0x7f29341a2f20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f292c004c90 tx=0x7f292c004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:56.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f292a7fc700 1 -- 172.21.15.92:0/1572867984 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c00e040 con 0x7f2934105e70 2023-10-16T13:11:56.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f292a7fc700 1 -- 172.21.15.92:0/1572867984 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f292c00ce90 con 0x7f2934105e70 2023-10-16T13:11:56.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f292a7fc700 1 -- 172.21.15.92:0/1572867984 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c005280 con 0x7f2934105e70 2023-10-16T13:11:56.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.562+0000 7f293b712700 1 -- 172.21.15.92:0/1572867984 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29341a38a0 con 0x7f2934105e70 2023-10-16T13:11:56.574 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.563+0000 7f293b712700 1 -- 172.21.15.92:0/1572867984 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29341a3cc0 con 0x7f2934105e70 2023-10-16T13:11:56.574 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.564+0000 7f293b712700 1 -- 172.21.15.92:0/1572867984 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f293404ebb0 con 0x7f2934105e70 2023-10-16T13:11:56.575 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.564+0000 7f292a7fc700 1 -- 172.21.15.92:0/1572867984 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f292c01b9c0 con 0x7f2934105e70 2023-10-16T13:11:56.575 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.565+0000 7f292a7fc700 1 --2- 172.21.15.92:0/1572867984 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f29200a1610 0x7f29200a3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:56.575 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.565+0000 7f29394ae700 1 --2- 172.21.15.92:0/1572867984 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f29200a1610 0x7f29200a3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:56.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.565+0000 7f292a7fc700 1 -- 172.21.15.92:0/1572867984 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f292c0ce4d0 con 0x7f2934105e70 2023-10-16T13:11:56.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.565+0000 7f29394ae700 1 --2- 172.21.15.92:0/1572867984 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f29200a1610 0x7f29200a3ad0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2930005fd0 tx=0x7f2930005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:56.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.569+0000 7f292a7fc700 1 -- 172.21.15.92:0/1572867984 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f292c097b10 con 0x7f2934105e70 2023-10-16T13:11:56.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:56 smithi152 ceph-mon[104423]: pgmap v263: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 8.9 KiB/s wr, 24 op/s 2023-10-16T13:11:56.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.757+0000 7f293b712700 1 -- 172.21.15.92:0/1572867984 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2934068fb0 con 0x7f2934105e70 2023-10-16T13:11:56.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.759+0000 7f292a7fc700 1 -- 172.21.15.92:0/1572867984 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22119 (secure 0 0 0) 0x7f292c09b130 con 0x7f2934105e70 2023-10-16T13:11:56.762 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:56.762 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":83,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:11:41.954264+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:11:38.345035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:11:39.549912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:11:56.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.761+0000 7f293b712700 1 -- 172.21.15.92:0/1572867984 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f29200a1610 msgr2=0x7f29200a3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:56.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.761+0000 7f293b712700 1 --2- 172.21.15.92:0/1572867984 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f29200a1610 0x7f29200a3ad0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2930005fd0 tx=0x7f2930005e20 comp rx=0 tx=0).stop 2023-10-16T13:11:56.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.761+0000 7f293b712700 1 -- 172.21.15.92:0/1572867984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2934105e70 msgr2=0x7f29341a2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:56.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.761+0000 7f293b712700 1 --2- 172.21.15.92:0/1572867984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2934105e70 0x7f29341a2f20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f292c004c90 tx=0x7f292c004cc0 comp rx=0 tx=0).stop 2023-10-16T13:11:56.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.761+0000 7f293b712700 1 -- 172.21.15.92:0/1572867984 shutdown_connections 2023-10-16T13:11:56.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.761+0000 7f293b712700 1 --2- 172.21.15.92:0/1572867984 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f29200a1610 0x7f29200a3ad0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:56.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.761+0000 7f293b712700 1 --2- 172.21.15.92:0/1572867984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2934105e70 0x7f29341a2f20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:56.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.761+0000 7f293b712700 1 --2- 172.21.15.92:0/1572867984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29340ffe60 0x7f2934197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:56.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.761+0000 7f293b712700 1 --2- 172.21.15.92:0/1572867984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2934100820 0x7f29341983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:56.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.761+0000 7f293b712700 1 -- 172.21.15.92:0/1572867984 >> 172.21.15.92:0/1572867984 conn(0x7f2934075e00 msgr2=0x7f2934106c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:56.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.761+0000 7f293b712700 1 -- 172.21.15.92:0/1572867984 shutdown_connections 2023-10-16T13:11:56.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:56.761+0000 7f293b712700 1 -- 172.21.15.92:0/1572867984 wait complete. 2023-10-16T13:11:56.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:56 smithi118 ceph-mon[103969]: pgmap v263: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 8.9 KiB/s wr, 24 op/s 2023-10-16T13:11:57.219 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-10-16T13:11:57.220 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph osd dump --format=json 2023-10-16T13:11:57.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:57 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1572867984' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:57.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:57 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1572867984' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:57.779 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:11:57.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:57 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1572867984' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:58.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:58 smithi152 ceph-mon[104423]: pgmap v264: 97 pgs: 97 active+clean; 632 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 KiB/s wr, 25 op/s 2023-10-16T13:11:58.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:58 smithi092 ceph-mon[99542]: pgmap v264: 97 pgs: 97 active+clean; 632 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 KiB/s wr, 25 op/s 2023-10-16T13:11:58.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:58 smithi118 ceph-mon[103969]: pgmap v264: 97 pgs: 97 active+clean; 632 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 KiB/s wr, 25 op/s 2023-10-16T13:11:58.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.985+0000 7f1331b94700 1 -- 172.21.15.92:0/4159090562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f132c0ff5a0 msgr2=0x7f132c0ffa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:58.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.985+0000 7f1331b94700 1 --2- 172.21.15.92:0/4159090562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f132c0ff5a0 0x7f132c0ffa20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f131c0099c0 tx=0x7f131c009cd0 comp rx=0 tx=0).stop 2023-10-16T13:11:58.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.985+0000 7f1331b94700 1 -- 172.21.15.92:0/4159090562 shutdown_connections 2023-10-16T13:11:58.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.985+0000 7f1331b94700 1 --2- 172.21.15.92:0/4159090562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f132c0fff60 0x7f132c10c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:58.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.985+0000 7f1331b94700 1 --2- 172.21.15.92:0/4159090562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f132c105650 0x7f132c105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:58.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.985+0000 7f1331b94700 1 --2- 172.21.15.92:0/4159090562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f132c0ff5a0 0x7f132c0ffa20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:58.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.985+0000 7f1331b94700 1 -- 172.21.15.92:0/4159090562 >> 172.21.15.92:0/4159090562 conn(0x7f132c076360 msgr2=0x7f132c0fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:58.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.985+0000 7f1331b94700 1 -- 172.21.15.92:0/4159090562 shutdown_connections 2023-10-16T13:11:58.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.985+0000 7f1331b94700 1 -- 172.21.15.92:0/4159090562 wait complete. 2023-10-16T13:11:58.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.986+0000 7f1331b94700 1 Processor -- start 2023-10-16T13:11:58.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.986+0000 7f1331b94700 1 -- start start 2023-10-16T13:11:58.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.986+0000 7f1331b94700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f132c0ff5a0 0x7f132c196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:58.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.986+0000 7f1331b94700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f132c0fff60 0x7f132c197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:58.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.986+0000 7f1331b94700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f132c105650 0x7f132c19b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:58.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.986+0000 7f1331b94700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c19bfb0 con 0x7f132c105650 2023-10-16T13:11:58.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.986+0000 7f1331b94700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c19c120 con 0x7f132c0fff60 2023-10-16T13:11:58.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.986+0000 7f1331b94700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c19c2e0 con 0x7f132c0ff5a0 2023-10-16T13:11:58.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.986+0000 7f132bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f132c105650 0x7f132c19b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:58.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.986+0000 7f132bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f132c105650 0x7f132c19b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35494/0 (socket says 172.21.15.92:35494) 2023-10-16T13:11:58.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.986+0000 7f132bfff700 1 -- 172.21.15.92:0/2348250278 learned_addr learned my addr 172.21.15.92:0/2348250278 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:11:58.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.986+0000 7f132b7fe700 1 --2- 172.21.15.92:0/2348250278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f132c0ff5a0 0x7f132c196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:58.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.986+0000 7f132affd700 1 --2- 172.21.15.92:0/2348250278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f132c0fff60 0x7f132c197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:58.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.986+0000 7f132bfff700 1 -- 172.21.15.92:0/2348250278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f132c0ff5a0 msgr2=0x7f132c196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:58.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.986+0000 7f132bfff700 1 --2- 172.21.15.92:0/2348250278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f132c0ff5a0 0x7f132c196ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:58.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.986+0000 7f132bfff700 1 -- 172.21.15.92:0/2348250278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f132c0fff60 msgr2=0x7f132c197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:58.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.986+0000 7f132bfff700 1 --2- 172.21.15.92:0/2348250278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f132c0fff60 0x7f132c197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:58.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.987+0000 7f132bfff700 1 -- 172.21.15.92:0/2348250278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c0095f0 con 0x7f132c105650 2023-10-16T13:11:58.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.987+0000 7f132bfff700 1 --2- 172.21.15.92:0/2348250278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f132c105650 0x7f132c19b9a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f132400cca0 tx=0x7f132400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:58.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.987+0000 7f1328ff9700 1 -- 172.21.15.92:0/2348250278 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132400cea0 con 0x7f132c105650 2023-10-16T13:11:58.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.987+0000 7f1328ff9700 1 -- 172.21.15.92:0/2348250278 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f132400ad60 con 0x7f132c105650 2023-10-16T13:11:58.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.987+0000 7f1331b94700 1 -- 172.21.15.92:0/2348250278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f132c19c5c0 con 0x7f132c105650 2023-10-16T13:11:58.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.987+0000 7f1328ff9700 1 -- 172.21.15.92:0/2348250278 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324011780 con 0x7f132c105650 2023-10-16T13:11:58.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.987+0000 7f1331b94700 1 -- 172.21.15.92:0/2348250278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f132c1a3e20 con 0x7f132c105650 2023-10-16T13:11:58.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.988+0000 7f1331b94700 1 -- 172.21.15.92:0/2348250278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f132c04ebb0 con 0x7f132c105650 2023-10-16T13:11:58.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.989+0000 7f1328ff9700 1 -- 172.21.15.92:0/2348250278 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f1324012420 con 0x7f132c105650 2023-10-16T13:11:58.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.989+0000 7f1328ff9700 1 --2- 172.21.15.92:0/2348250278 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f13140a1510 0x7f13140a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:11:58.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.989+0000 7f132b7fe700 1 --2- 172.21.15.92:0/2348250278 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f13140a1510 0x7f13140a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:11:58.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.989+0000 7f1328ff9700 1 -- 172.21.15.92:0/2348250278 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f13240ccef0 con 0x7f132c105650 2023-10-16T13:11:58.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.990+0000 7f132b7fe700 1 --2- 172.21.15.92:0/2348250278 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f13140a1510 0x7f13140a39d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1320006fd0 tx=0x7f1320008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:11:59.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:58.994+0000 7f1328ff9700 1 -- 172.21.15.92:0/2348250278 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f13240966b0 con 0x7f132c105650 2023-10-16T13:11:59.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:59.183+0000 7f1331b94700 1 -- 172.21.15.92:0/2348250278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f132c110010 con 0x7f132c105650 2023-10-16T13:11:59.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:59.185+0000 7f1328ff9700 1 -- 172.21.15.92:0/2348250278 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22119 (secure 0 0 0) 0x7f1324099cd0 con 0x7f132c105650 2023-10-16T13:11:59.188 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:11:59.188 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":83,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:11:41.954264+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:11:38.345035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:11:39.549912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:11:59.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:59.187+0000 7f1331b94700 1 -- 172.21.15.92:0/2348250278 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f13140a1510 msgr2=0x7f13140a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:59.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:59.187+0000 7f1331b94700 1 --2- 172.21.15.92:0/2348250278 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f13140a1510 0x7f13140a39d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1320006fd0 tx=0x7f1320008040 comp rx=0 tx=0).stop 2023-10-16T13:11:59.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:59.187+0000 7f1331b94700 1 -- 172.21.15.92:0/2348250278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f132c105650 msgr2=0x7f132c19b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:11:59.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:59.187+0000 7f1331b94700 1 --2- 172.21.15.92:0/2348250278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f132c105650 0x7f132c19b9a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f132400cca0 tx=0x7f132400a340 comp rx=0 tx=0).stop 2023-10-16T13:11:59.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:59.187+0000 7f1331b94700 1 -- 172.21.15.92:0/2348250278 shutdown_connections 2023-10-16T13:11:59.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:59.187+0000 7f1331b94700 1 --2- 172.21.15.92:0/2348250278 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f13140a1510 0x7f13140a39d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:59.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:59.187+0000 7f1331b94700 1 --2- 172.21.15.92:0/2348250278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f132c105650 0x7f132c19b9a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:59.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:59.187+0000 7f1331b94700 1 --2- 172.21.15.92:0/2348250278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f132c0ff5a0 0x7f132c196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:59.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:59.187+0000 7f1331b94700 1 --2- 172.21.15.92:0/2348250278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f132c0fff60 0x7f132c197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:11:59.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:59.187+0000 7f1331b94700 1 -- 172.21.15.92:0/2348250278 >> 172.21.15.92:0/2348250278 conn(0x7f132c076360 msgr2=0x7f132c10cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:11:59.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:59.187+0000 7f1331b94700 1 -- 172.21.15.92:0/2348250278 shutdown_connections 2023-10-16T13:11:59.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:11:59.187+0000 7f1331b94700 1 -- 172.21.15.92:0/2348250278 wait complete. 2023-10-16T13:11:59.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:11:59 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2348250278' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:59.623 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph tell osd.0 flush_pg_stats 2023-10-16T13:11:59.624 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph tell osd.1 flush_pg_stats 2023-10-16T13:11:59.624 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph tell osd.2 flush_pg_stats 2023-10-16T13:11:59.625 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph tell osd.3 flush_pg_stats 2023-10-16T13:11:59.626 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph tell osd.4 flush_pg_stats 2023-10-16T13:11:59.626 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph tell osd.5 flush_pg_stats 2023-10-16T13:11:59.627 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph tell osd.6 flush_pg_stats 2023-10-16T13:11:59.627 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph tell osd.7 flush_pg_stats 2023-10-16T13:11:59.628 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph tell osd.8 flush_pg_stats 2023-10-16T13:11:59.629 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph tell osd.9 flush_pg_stats 2023-10-16T13:11:59.629 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph tell osd.10 flush_pg_stats 2023-10-16T13:11:59.630 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph tell osd.11 flush_pg_stats 2023-10-16T13:11:59.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:11:59 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2348250278' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:11:59.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:11:59 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2348250278' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:12:00.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:00 smithi152 ceph-mon[104423]: pgmap v265: 97 pgs: 97 active+clean; 632 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.6 KiB/s wr, 23 op/s 2023-10-16T13:12:00.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:00 smithi092 ceph-mon[99542]: pgmap v265: 97 pgs: 97 active+clean; 632 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.6 KiB/s wr, 23 op/s 2023-10-16T13:12:00.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:00 smithi118 ceph-mon[103969]: pgmap v265: 97 pgs: 97 active+clean; 632 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.6 KiB/s wr, 23 op/s 2023-10-16T13:12:00.801 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:00.835 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:01.122 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:01.371 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:01.374 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:01.375 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:01.429 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:01.659 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:01.944 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:01.947 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:02.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:02 smithi092 ceph-mon[99542]: pgmap v266: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 20 op/s 2023-10-16T13:12:02.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:02 smithi152 ceph-mon[104423]: pgmap v266: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 20 op/s 2023-10-16T13:12:02.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:02 smithi118 ceph-mon[103969]: pgmap v266: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 20 op/s 2023-10-16T13:12:04.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:04 smithi152 ceph-mon[104423]: pgmap v267: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2023-10-16T13:12:04.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:04 smithi092 ceph-mon[99542]: pgmap v267: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2023-10-16T13:12:04.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:04 smithi118 ceph-mon[103969]: pgmap v267: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2023-10-16T13:12:05.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.985+0000 7f2273155700 1 -- 172.21.15.92:0/3571115052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f226c100020 msgr2=0x7f226c105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:05.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.985+0000 7f2273155700 1 --2- 172.21.15.92:0/3571115052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f226c100020 0x7f226c105b60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2258009990 tx=0x7f2258009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:05.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.985+0000 7f2273155700 1 -- 172.21.15.92:0/3571115052 shutdown_connections 2023-10-16T13:12:05.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.985+0000 7f2273155700 1 --2- 172.21.15.92:0/3571115052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f226c106240 0x7f226c10de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:05.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.985+0000 7f2273155700 1 --2- 172.21.15.92:0/3571115052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226c0ff670 0x7f226c0ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:05.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.985+0000 7f2273155700 1 --2- 172.21.15.92:0/3571115052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f226c100020 0x7f226c105b60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:05.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.985+0000 7f2273155700 1 -- 172.21.15.92:0/3571115052 >> 172.21.15.92:0/3571115052 conn(0x7f226c076360 msgr2=0x7f226c0fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:05.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.985+0000 7f2273155700 1 -- 172.21.15.92:0/3571115052 shutdown_connections 2023-10-16T13:12:05.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.985+0000 7f2273155700 1 -- 172.21.15.92:0/3571115052 wait complete. 2023-10-16T13:12:05.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.986+0000 7f2273155700 1 Processor -- start 2023-10-16T13:12:05.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.986+0000 7f2273155700 1 -- start start 2023-10-16T13:12:05.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.986+0000 7f2273155700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f226c0ff670 0x7f226c1970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:05.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.986+0000 7f2273155700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f226c100020 0x7f226c1975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:05.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.986+0000 7f2273155700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226c106240 0x7f226c19ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:05.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.986+0000 7f2273155700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c19c070 con 0x7f226c100020 2023-10-16T13:12:05.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.986+0000 7f2273155700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c19c1e0 con 0x7f226c106240 2023-10-16T13:12:05.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.986+0000 7f2273155700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c19c3a0 con 0x7f226c0ff670 2023-10-16T13:12:05.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.986+0000 7f226bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f226c100020 0x7f226c1975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:05.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.986+0000 7f226bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f226c100020 0x7f226c1975f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35504/0 (socket says 172.21.15.92:35504) 2023-10-16T13:12:05.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.986+0000 7f226bfff700 1 -- 172.21.15.92:0/799524670 learned_addr learned my addr 172.21.15.92:0/799524670 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:05.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.986+0000 7f2270ef1700 1 --2- 172.21.15.92:0/799524670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f226c0ff670 0x7f226c1970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:05.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.986+0000 7f22716f2700 1 --2- 172.21.15.92:0/799524670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226c106240 0x7f226c19ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:05.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.987+0000 7f226bfff700 1 -- 172.21.15.92:0/799524670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f226c0ff670 msgr2=0x7f226c1970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:05.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.987+0000 7f226bfff700 1 --2- 172.21.15.92:0/799524670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f226c0ff670 0x7f226c1970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:05.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.987+0000 7f226bfff700 1 -- 172.21.15.92:0/799524670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226c106240 msgr2=0x7f226c19ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:05.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.987+0000 7f226bfff700 1 --2- 172.21.15.92:0/799524670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226c106240 0x7f226c19ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:05.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.987+0000 7f226bfff700 1 -- 172.21.15.92:0/799524670 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22580095f0 con 0x7f226c100020 2023-10-16T13:12:05.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.987+0000 7f226bfff700 1 --2- 172.21.15.92:0/799524670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f226c100020 0x7f226c1975f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2258000c00 tx=0x7f2258004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:05.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.987+0000 7f2269ffb700 1 -- 172.21.15.92:0/799524670 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225801d070 con 0x7f226c100020 2023-10-16T13:12:05.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.987+0000 7f2269ffb700 1 -- 172.21.15.92:0/799524670 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2258022470 con 0x7f226c100020 2023-10-16T13:12:05.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.987+0000 7f2273155700 1 -- 172.21.15.92:0/799524670 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226c19c620 con 0x7f226c100020 2023-10-16T13:12:05.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.987+0000 7f2269ffb700 1 -- 172.21.15.92:0/799524670 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2258017650 con 0x7f226c100020 2023-10-16T13:12:05.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.987+0000 7f2273155700 1 -- 172.21.15.92:0/799524670 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226c1a3ee0 con 0x7f226c100020 2023-10-16T13:12:05.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.988+0000 7f2273155700 1 -- 172.21.15.92:0/799524670 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f226c111230 con 0x7f226c100020 2023-10-16T13:12:05.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.989+0000 7f2269ffb700 1 -- 172.21.15.92:0/799524670 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f2258022970 con 0x7f226c100020 2023-10-16T13:12:05.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.990+0000 7f2269ffb700 1 --2- 172.21.15.92:0/799524670 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f225c0a1590 0x7f225c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:06.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.990+0000 7f2269ffb700 1 -- 172.21.15.92:0/799524670 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f22580ce790 con 0x7f226c100020 2023-10-16T13:12:06.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.990+0000 7f2270ef1700 1 --2- 172.21.15.92:0/799524670 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f225c0a1590 0x7f225c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:06.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.990+0000 7f2269ffb700 1 --2- 172.21.15.92:0/799524670 >> [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261] conn(0x7f225c0aad70 0x7f225c0ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:06.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.990+0000 7f2269ffb700 1 -- 172.21.15.92:0/799524670 --> [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f225c0ad840 con 0x7f225c0aad70 2023-10-16T13:12:06.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.990+0000 7f2269ffb700 1 -- 172.21.15.92:0/799524670 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22580cec30 con 0x7f226c100020 2023-10-16T13:12:06.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.990+0000 7f22716f2700 1 --2- 172.21.15.92:0/799524670 >> [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261] conn(0x7f225c0aad70 0x7f225c0ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:06.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.990+0000 7f2270ef1700 1 --2- 172.21.15.92:0/799524670 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f225c0a1590 0x7f225c0a3a50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2260005950 tx=0x7f226000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:06.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.990+0000 7f22716f2700 1 --2- 172.21.15.92:0/799524670 >> [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261] conn(0x7f225c0aad70 0x7f225c0ad190 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:06.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:05.991+0000 7f2269ffb700 1 -- 172.21.15.92:0/799524670 <== osd.0 v2:172.21.15.92:6802/209585261 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f225c0ad840 con 0x7f225c0aad70 2023-10-16T13:12:06.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.007+0000 7f2273155700 1 -- 172.21.15.92:0/799524670 --> [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f226c04ebb0 con 0x7f225c0aad70 2023-10-16T13:12:06.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.008+0000 7f2269ffb700 1 -- 172.21.15.92:0/799524670 <== osd.0 v2:172.21.15.92:6802/209585261 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f226c04ebb0 con 0x7f225c0aad70 2023-10-16T13:12:06.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.008+0000 7f2273155700 1 -- 172.21.15.92:0/799524670 >> [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261] conn(0x7f225c0aad70 msgr2=0x7f225c0ad190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:06.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.008+0000 7f2273155700 1 --2- 172.21.15.92:0/799524670 >> [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261] conn(0x7f225c0aad70 0x7f225c0ad190 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:06.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.008+0000 7f2273155700 1 -- 172.21.15.92:0/799524670 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f225c0a1590 msgr2=0x7f225c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:06.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.008+0000 7f2273155700 1 --2- 172.21.15.92:0/799524670 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f225c0a1590 0x7f225c0a3a50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2260005950 tx=0x7f226000b410 comp rx=0 tx=0).stop 2023-10-16T13:12:06.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.008+0000 7f2273155700 1 -- 172.21.15.92:0/799524670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f226c100020 msgr2=0x7f226c1975f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:06.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.008+0000 7f2273155700 1 --2- 172.21.15.92:0/799524670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f226c100020 0x7f226c1975f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2258000c00 tx=0x7f2258004730 comp rx=0 tx=0).stop 2023-10-16T13:12:06.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.008+0000 7f22716f2700 1 -- 172.21.15.92:0/799524670 reap_dead start 2023-10-16T13:12:06.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.008+0000 7f2273155700 1 -- 172.21.15.92:0/799524670 shutdown_connections 2023-10-16T13:12:06.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.008+0000 7f2273155700 1 -- 172.21.15.92:0/799524670 >> 172.21.15.92:0/799524670 conn(0x7f226c076360 msgr2=0x7f226c104ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:06.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.008+0000 7f2273155700 1 -- 172.21.15.92:0/799524670 shutdown_connections 2023-10-16T13:12:06.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.008+0000 7f2273155700 1 -- 172.21.15.92:0/799524670 wait complete. 2023-10-16T13:12:06.088 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.050+0000 7faf8ff19700 1 -- 172.21.15.92:0/1710637488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf88105e70 msgr2=0x7faf88106250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:06.088 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.050+0000 7faf8ff19700 1 --2- 172.21.15.92:0/1710637488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf88105e70 0x7faf88106250 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faf840099c0 tx=0x7faf84009cd0 comp rx=0 tx=0).stop 2023-10-16T13:12:06.088 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.050+0000 7faf8ff19700 1 -- 172.21.15.92:0/1710637488 shutdown_connections 2023-10-16T13:12:06.088 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.050+0000 7faf8ff19700 1 --2- 172.21.15.92:0/1710637488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf88105e70 0x7faf88106250 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:06.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.051+0000 7faf8ff19700 1 --2- 172.21.15.92:0/1710637488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf88100820 0x7faf8810cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:06.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.051+0000 7faf8ff19700 1 --2- 172.21.15.92:0/1710637488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf880ffe60 0x7faf881002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:06.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.051+0000 7faf8ff19700 1 -- 172.21.15.92:0/1710637488 >> 172.21.15.92:0/1710637488 conn(0x7faf88075e00 msgr2=0x7faf88076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:06.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.051+0000 7faf8ff19700 1 -- 172.21.15.92:0/1710637488 shutdown_connections 2023-10-16T13:12:06.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.051+0000 7faf8ff19700 1 -- 172.21.15.92:0/1710637488 wait complete. 2023-10-16T13:12:06.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.051+0000 7faf8ff19700 1 Processor -- start 2023-10-16T13:12:06.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.051+0000 7faf8ff19700 1 -- start start 2023-10-16T13:12:06.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.051+0000 7faf8ff19700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf880ffe60 0x7faf88195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:06.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.051+0000 7faf8ff19700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf88100820 0x7faf88196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:06.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.051+0000 7faf8ff19700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf88105e70 0x7faf8819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:06.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.051+0000 7faf8ff19700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8819aed0 con 0x7faf880ffe60 2023-10-16T13:12:06.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.051+0000 7faf8ff19700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8819b040 con 0x7faf88100820 2023-10-16T13:12:06.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.051+0000 7faf8ff19700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8819b200 con 0x7faf88105e70 2023-10-16T13:12:06.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.052+0000 7faf8dcb5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf880ffe60 0x7faf88195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:06.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.052+0000 7faf8dcb5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf880ffe60 0x7faf88195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35518/0 (socket says 172.21.15.92:35518) 2023-10-16T13:12:06.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.052+0000 7faf8dcb5700 1 -- 172.21.15.92:0/3700305595 learned_addr learned my addr 172.21.15.92:0/3700305595 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:06.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.052+0000 7faf8d4b4700 1 --2- 172.21.15.92:0/3700305595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf88100820 0x7faf88196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:06.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.052+0000 7faf8dcb5700 1 -- 172.21.15.92:0/3700305595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf88105e70 msgr2=0x7faf8819a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:06.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.052+0000 7faf8dcb5700 1 --2- 172.21.15.92:0/3700305595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf88105e70 0x7faf8819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:06.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.052+0000 7faf8dcb5700 1 -- 172.21.15.92:0/3700305595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf88100820 msgr2=0x7faf88196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:06.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.052+0000 7faf8dcb5700 1 --2- 172.21.15.92:0/3700305595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf88100820 0x7faf88196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:06.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.052+0000 7faf8dcb5700 1 -- 172.21.15.92:0/3700305595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf840095f0 con 0x7faf880ffe60 2023-10-16T13:12:06.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.052+0000 7faf8dcb5700 1 --2- 172.21.15.92:0/3700305595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf880ffe60 0x7faf88195f10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faf840098e0 tx=0x7faf840055c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:06.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.052+0000 7faf7effd700 1 -- 172.21.15.92:0/3700305595 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8401d070 con 0x7faf880ffe60 2023-10-16T13:12:06.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.052+0000 7faf8ff19700 1 -- 172.21.15.92:0/3700305595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8819b480 con 0x7faf880ffe60 2023-10-16T13:12:06.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.052+0000 7faf7effd700 1 -- 172.21.15.92:0/3700305595 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faf84004120 con 0x7faf880ffe60 2023-10-16T13:12:06.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.052+0000 7faf8ff19700 1 -- 172.21.15.92:0/3700305595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf881a2d40 con 0x7faf880ffe60 2023-10-16T13:12:06.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.052+0000 7faf7effd700 1 -- 172.21.15.92:0/3700305595 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8400f460 con 0x7faf880ffe60 2023-10-16T13:12:06.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.053+0000 7faf8ff19700 1 -- 172.21.15.92:0/3700305595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faf8804ebb0 con 0x7faf880ffe60 2023-10-16T13:12:06.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.055+0000 7faf7effd700 1 -- 172.21.15.92:0/3700305595 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7faf840226e0 con 0x7faf880ffe60 2023-10-16T13:12:06.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.055+0000 7faf7effd700 1 --2- 172.21.15.92:0/3700305595 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faf740a1510 0x7faf740a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:06.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.055+0000 7faf8d4b4700 1 --2- 172.21.15.92:0/3700305595 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faf740a1510 0x7faf740a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:06.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.055+0000 7faf7effd700 1 -- 172.21.15.92:0/3700305595 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7faf840ce850 con 0x7faf880ffe60 2023-10-16T13:12:06.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.055+0000 7faf7effd700 1 --2- 172.21.15.92:0/3700305595 >> [v2:172.21.15.118:6824/3622143535,v1:172.21.15.118:6825/3622143535] conn(0x7faf740aacf0 0x7faf740ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:06.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.055+0000 7faf7effd700 1 -- 172.21.15.92:0/3700305595 --> [v2:172.21.15.118:6824/3622143535,v1:172.21.15.118:6825/3622143535] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf740ad7c0 con 0x7faf740aacf0 2023-10-16T13:12:06.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.055+0000 7faf7effd700 1 -- 172.21.15.92:0/3700305595 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf840cecf0 con 0x7faf880ffe60 2023-10-16T13:12:06.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.055+0000 7faf8d4b4700 1 --2- 172.21.15.92:0/3700305595 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faf740a1510 0x7faf740a39d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf78006fd0 tx=0x7faf78008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:06.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.056+0000 7faf8e4b6700 1 --2- 172.21.15.92:0/3700305595 >> [v2:172.21.15.118:6824/3622143535,v1:172.21.15.118:6825/3622143535] conn(0x7faf740aacf0 0x7faf740ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:06.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.056+0000 7faf8e4b6700 1 --2- 172.21.15.92:0/3700305595 >> [v2:172.21.15.118:6824/3622143535,v1:172.21.15.118:6825/3622143535] conn(0x7faf740aacf0 0x7faf740ad110 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:06.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.057+0000 7faf7effd700 1 -- 172.21.15.92:0/3700305595 <== osd.10 v2:172.21.15.118:6824/3622143535 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7faf740ad7c0 con 0x7faf740aacf0 2023-10-16T13:12:06.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.073+0000 7faf8ff19700 1 -- 172.21.15.92:0/3700305595 --> [v2:172.21.15.118:6824/3622143535,v1:172.21.15.118:6825/3622143535] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faf881101f0 con 0x7faf740aacf0 2023-10-16T13:12:06.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.074+0000 7faf7effd700 1 -- 172.21.15.92:0/3700305595 <== osd.10 v2:172.21.15.118:6824/3622143535 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7faf80008b30 con 0x7faf740aacf0 2023-10-16T13:12:06.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.074+0000 7faf8ff19700 1 -- 172.21.15.92:0/3700305595 >> [v2:172.21.15.118:6824/3622143535,v1:172.21.15.118:6825/3622143535] conn(0x7faf740aacf0 msgr2=0x7faf740ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:06.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.074+0000 7faf8ff19700 1 --2- 172.21.15.92:0/3700305595 >> [v2:172.21.15.118:6824/3622143535,v1:172.21.15.118:6825/3622143535] conn(0x7faf740aacf0 0x7faf740ad110 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:06.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.074+0000 7faf8ff19700 1 -- 172.21.15.92:0/3700305595 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faf740a1510 msgr2=0x7faf740a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:06.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.074+0000 7faf8ff19700 1 --2- 172.21.15.92:0/3700305595 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faf740a1510 0x7faf740a39d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf78006fd0 tx=0x7faf78008040 comp rx=0 tx=0).stop 2023-10-16T13:12:06.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.074+0000 7faf8ff19700 1 -- 172.21.15.92:0/3700305595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf880ffe60 msgr2=0x7faf88195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:06.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.074+0000 7faf8ff19700 1 --2- 172.21.15.92:0/3700305595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf880ffe60 0x7faf88195f10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faf840098e0 tx=0x7faf840055c0 comp rx=0 tx=0).stop 2023-10-16T13:12:06.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.074+0000 7faf8e4b6700 1 -- 172.21.15.92:0/3700305595 reap_dead start 2023-10-16T13:12:06.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.074+0000 7faf8ff19700 1 -- 172.21.15.92:0/3700305595 shutdown_connections 2023-10-16T13:12:06.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.074+0000 7faf8ff19700 1 -- 172.21.15.92:0/3700305595 >> 172.21.15.92:0/3700305595 conn(0x7faf88075e00 msgr2=0x7faf880fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:06.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.074+0000 7faf8ff19700 1 -- 172.21.15.92:0/3700305595 shutdown_connections 2023-10-16T13:12:06.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:06.074+0000 7faf8ff19700 1 -- 172.21.15.92:0/3700305595 wait complete. 2023-10-16T13:12:06.235 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:06.236 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:06.609 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:06 smithi092 ceph-mon[99542]: pgmap v268: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2023-10-16T13:12:06.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:06 smithi152 ceph-mon[104423]: pgmap v268: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2023-10-16T13:12:06.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:06 smithi118 ceph-mon[103969]: pgmap v268: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2023-10-16T13:12:07.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.082+0000 7f546fb45700 1 -- 172.21.15.92:0/3203022538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54681007d0 msgr2=0x7f546810cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:07.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.082+0000 7f546fb45700 1 --2- 172.21.15.92:0/3203022538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54681007d0 0x7f546810cc70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f546000b0a0 tx=0x7f546000b3b0 comp rx=0 tx=0).stop 2023-10-16T13:12:07.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.082+0000 7f546fb45700 1 -- 172.21.15.92:0/3203022538 shutdown_connections 2023-10-16T13:12:07.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.082+0000 7f546fb45700 1 --2- 172.21.15.92:0/3203022538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54681007d0 0x7f546810cc70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:07.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.082+0000 7f546fb45700 1 --2- 172.21.15.92:0/3203022538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5468105ec0 0x7f54681062a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:07.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.082+0000 7f546fb45700 1 --2- 172.21.15.92:0/3203022538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54680ffe10 0x7f5468100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:07.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.082+0000 7f546fb45700 1 -- 172.21.15.92:0/3203022538 >> 172.21.15.92:0/3203022538 conn(0x7f5468076dc0 msgr2=0x7f54680771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:07.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.082+0000 7f546fb45700 1 -- 172.21.15.92:0/3203022538 shutdown_connections 2023-10-16T13:12:07.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.082+0000 7f546fb45700 1 -- 172.21.15.92:0/3203022538 wait complete. 2023-10-16T13:12:07.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.083+0000 7f546fb45700 1 Processor -- start 2023-10-16T13:12:07.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.083+0000 7f546fb45700 1 -- start start 2023-10-16T13:12:07.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.083+0000 7f546fb45700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54680ffe10 0x7f5468197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:07.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.083+0000 7f546fb45700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54681007d0 0x7f5468198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:07.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.083+0000 7f546fb45700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5468105ec0 0x7f54681a2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:07.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.083+0000 7f546fb45700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54681a3510 con 0x7f54680ffe10 2023-10-16T13:12:07.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.083+0000 7f546fb45700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54681a3650 con 0x7f54681007d0 2023-10-16T13:12:07.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.083+0000 7f546fb45700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54681a3790 con 0x7f5468105ec0 2023-10-16T13:12:07.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.083+0000 7f546d8e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54680ffe10 0x7f5468197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:07.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.083+0000 7f546d8e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54680ffe10 0x7f5468197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35534/0 (socket says 172.21.15.92:35534) 2023-10-16T13:12:07.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.083+0000 7f546d8e1700 1 -- 172.21.15.92:0/1147198228 learned_addr learned my addr 172.21.15.92:0/1147198228 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.083+0000 7f546d0e0700 1 --2- 172.21.15.92:0/1147198228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54681007d0 0x7f5468198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.084+0000 7f546d8e1700 1 -- 172.21.15.92:0/1147198228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5468105ec0 msgr2=0x7f54681a2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.084+0000 7f546d8e1700 1 --2- 172.21.15.92:0/1147198228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5468105ec0 0x7f54681a2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.084+0000 7f546d8e1700 1 -- 172.21.15.92:0/1147198228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54681007d0 msgr2=0x7f5468198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.084+0000 7f546d8e1700 1 --2- 172.21.15.92:0/1147198228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54681007d0 0x7f5468198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.084+0000 7f546d8e1700 1 -- 172.21.15.92:0/1147198228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5460009d00 con 0x7f54680ffe10 2023-10-16T13:12:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.084+0000 7f546d0e0700 1 --2- 172.21.15.92:0/1147198228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54681007d0 0x7f5468198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:12:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.084+0000 7f546d8e1700 1 --2- 172.21.15.92:0/1147198228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54680ffe10 0x7f5468197f50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f546400d980 tx=0x7f546400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.084+0000 7f545effd700 1 -- 172.21.15.92:0/1147198228 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5464009b40 con 0x7f54680ffe10 2023-10-16T13:12:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.084+0000 7f545effd700 1 -- 172.21.15.92:0/1147198228 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f546400b6e0 con 0x7f54680ffe10 2023-10-16T13:12:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.084+0000 7f546fb45700 1 -- 172.21.15.92:0/1147198228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54681a39f0 con 0x7f54680ffe10 2023-10-16T13:12:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.084+0000 7f545effd700 1 -- 172.21.15.92:0/1147198228 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546400f620 con 0x7f54680ffe10 2023-10-16T13:12:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.084+0000 7f546fb45700 1 -- 172.21.15.92:0/1147198228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54681a3ef0 con 0x7f54680ffe10 2023-10-16T13:12:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.085+0000 7f546fb45700 1 -- 172.21.15.92:0/1147198228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f546804ebb0 con 0x7f54680ffe10 2023-10-16T13:12:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.086+0000 7f545effd700 1 -- 172.21.15.92:0/1147198228 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f5464010460 con 0x7f54680ffe10 2023-10-16T13:12:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.086+0000 7f545effd700 1 --2- 172.21.15.92:0/1147198228 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f54540a1590 0x7f54540a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.086+0000 7f546d0e0700 1 --2- 172.21.15.92:0/1147198228 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f54540a1590 0x7f54540a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.087+0000 7f545effd700 1 -- 172.21.15.92:0/1147198228 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f54640cd1d0 con 0x7f54680ffe10 2023-10-16T13:12:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.087+0000 7f545effd700 1 --2- 172.21.15.92:0/1147198228 >> [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740] conn(0x7f54540aad70 0x7f54540ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.087+0000 7f545effd700 1 -- 172.21.15.92:0/1147198228 --> [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f54540ad840 con 0x7f54540aad70 2023-10-16T13:12:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.087+0000 7f545effd700 1 -- 172.21.15.92:0/1147198228 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54640cd580 con 0x7f54680ffe10 2023-10-16T13:12:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.087+0000 7f546e0e2700 1 --2- 172.21.15.92:0/1147198228 >> [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740] conn(0x7f54540aad70 0x7f54540ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.087+0000 7f546d0e0700 1 --2- 172.21.15.92:0/1147198228 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f54540a1590 0x7f54540a3a50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5458005950 tx=0x7f54580058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.087+0000 7f546e0e2700 1 --2- 172.21.15.92:0/1147198228 >> [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740] conn(0x7f54540aad70 0x7f54540ad190 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.088+0000 7f545effd700 1 -- 172.21.15.92:0/1147198228 <== osd.6 v2:172.21.15.92:6818/3198015740 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f54540ad840 con 0x7f54540aad70 2023-10-16T13:12:07.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.103+0000 7f546fb45700 1 -- 172.21.15.92:0/1147198228 --> [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5468110150 con 0x7f54540aad70 2023-10-16T13:12:07.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.104+0000 7f545effd700 1 -- 172.21.15.92:0/1147198228 <== osd.6 v2:172.21.15.92:6818/3198015740 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f546000cea0 con 0x7f54540aad70 2023-10-16T13:12:07.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.104+0000 7f546fb45700 1 -- 172.21.15.92:0/1147198228 >> [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740] conn(0x7f54540aad70 msgr2=0x7f54540ad190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:07.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.104+0000 7f546fb45700 1 --2- 172.21.15.92:0/1147198228 >> [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740] conn(0x7f54540aad70 0x7f54540ad190 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:07.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.104+0000 7f546fb45700 1 -- 172.21.15.92:0/1147198228 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f54540a1590 msgr2=0x7f54540a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:07.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.104+0000 7f546fb45700 1 --2- 172.21.15.92:0/1147198228 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f54540a1590 0x7f54540a3a50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5458005950 tx=0x7f54580058e0 comp rx=0 tx=0).stop 2023-10-16T13:12:07.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.104+0000 7f546fb45700 1 -- 172.21.15.92:0/1147198228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54680ffe10 msgr2=0x7f5468197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:07.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.104+0000 7f546fb45700 1 --2- 172.21.15.92:0/1147198228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54680ffe10 0x7f5468197f50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f546400d980 tx=0x7f546400dd40 comp rx=0 tx=0).stop 2023-10-16T13:12:07.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.104+0000 7f546e0e2700 1 -- 172.21.15.92:0/1147198228 reap_dead start 2023-10-16T13:12:07.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.104+0000 7f546fb45700 1 -- 172.21.15.92:0/1147198228 shutdown_connections 2023-10-16T13:12:07.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.104+0000 7f546fb45700 1 -- 172.21.15.92:0/1147198228 >> 172.21.15.92:0/1147198228 conn(0x7f5468076dc0 msgr2=0x7f54680fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:07.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.104+0000 7f546fb45700 1 -- 172.21.15.92:0/1147198228 shutdown_connections 2023-10-16T13:12:07.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.104+0000 7f546fb45700 1 -- 172.21.15.92:0/1147198228 wait complete. 2023-10-16T13:12:07.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.244+0000 7f434111e700 1 -- 172.21.15.92:0/1818732624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f433c100a00 msgr2=0x7f433c104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:07.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.244+0000 7f434111e700 1 --2- 172.21.15.92:0/1818732624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f433c100a00 0x7f433c104a50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4324009990 tx=0x7f4324009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:07.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.244+0000 7f434111e700 1 -- 172.21.15.92:0/1818732624 shutdown_connections 2023-10-16T13:12:07.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.244+0000 7f434111e700 1 --2- 172.21.15.92:0/1818732624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f433c105130 0x7f433c10cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:07.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.244+0000 7f434111e700 1 --2- 172.21.15.92:0/1818732624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f433c100050 0x7f433c100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:07.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.244+0000 7f434111e700 1 --2- 172.21.15.92:0/1818732624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f433c100a00 0x7f433c104a50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:07.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.244+0000 7f434111e700 1 -- 172.21.15.92:0/1818732624 >> 172.21.15.92:0/1818732624 conn(0x7f433c0fb920 msgr2=0x7f433c0fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:07.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.244+0000 7f434111e700 1 -- 172.21.15.92:0/1818732624 shutdown_connections 2023-10-16T13:12:07.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.244+0000 7f434111e700 1 -- 172.21.15.92:0/1818732624 wait complete. 2023-10-16T13:12:07.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.245+0000 7f434111e700 1 Processor -- start 2023-10-16T13:12:07.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.245+0000 7f434111e700 1 -- start start 2023-10-16T13:12:07.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.245+0000 7f434111e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f433c100050 0x7f433c197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:07.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.245+0000 7f434111e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f433c100a00 0x7f433c197690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:07.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.245+0000 7f434111e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f433c105130 0x7f433c19bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:07.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.245+0000 7f434111e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c19c110 con 0x7f433c100050 2023-10-16T13:12:07.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.245+0000 7f434111e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c19c280 con 0x7f433c105130 2023-10-16T13:12:07.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.245+0000 7f434111e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c19c440 con 0x7f433c100a00 2023-10-16T13:12:07.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.245+0000 7f433ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f433c100050 0x7f433c197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:07.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.245+0000 7f433ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f433c100050 0x7f433c197150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35550/0 (socket says 172.21.15.92:35550) 2023-10-16T13:12:07.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.245+0000 7f433ad9d700 1 -- 172.21.15.92:0/2313531927 learned_addr learned my addr 172.21.15.92:0/2313531927 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:07.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.245+0000 7f433b59e700 1 --2- 172.21.15.92:0/2313531927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f433c105130 0x7f433c19bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:07.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.245+0000 7f433a59c700 1 --2- 172.21.15.92:0/2313531927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f433c100a00 0x7f433c197690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:07.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.246+0000 7f433ad9d700 1 -- 172.21.15.92:0/2313531927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f433c100a00 msgr2=0x7f433c197690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:07.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.246+0000 7f433ad9d700 1 --2- 172.21.15.92:0/2313531927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f433c100a00 0x7f433c197690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:07.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.246+0000 7f433ad9d700 1 -- 172.21.15.92:0/2313531927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f433c105130 msgr2=0x7f433c19bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:07.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.246+0000 7f433ad9d700 1 --2- 172.21.15.92:0/2313531927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f433c105130 0x7f433c19bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:07.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.246+0000 7f433ad9d700 1 -- 172.21.15.92:0/2313531927 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43240095f0 con 0x7f433c100050 2023-10-16T13:12:07.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.246+0000 7f433ad9d700 1 --2- 172.21.15.92:0/2313531927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f433c100050 0x7f433c197150 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f432c00ada0 tx=0x7f432c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:07.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.246+0000 7f4333fff700 1 -- 172.21.15.92:0/2313531927 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c00f070 con 0x7f433c100050 2023-10-16T13:12:07.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.246+0000 7f434111e700 1 -- 172.21.15.92:0/2313531927 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433c19c720 con 0x7f433c100050 2023-10-16T13:12:07.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.246+0000 7f4333fff700 1 -- 172.21.15.92:0/2313531927 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f432c00ae90 con 0x7f433c100050 2023-10-16T13:12:07.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.246+0000 7f4333fff700 1 -- 172.21.15.92:0/2313531927 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c005390 con 0x7f433c100050 2023-10-16T13:12:07.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.246+0000 7f434111e700 1 -- 172.21.15.92:0/2313531927 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433c1a3f80 con 0x7f433c100050 2023-10-16T13:12:07.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.247+0000 7f434111e700 1 -- 172.21.15.92:0/2313531927 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f433c1101a0 con 0x7f433c100050 2023-10-16T13:12:07.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.248+0000 7f4333fff700 1 -- 172.21.15.92:0/2313531927 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f432c00c8d0 con 0x7f433c100050 2023-10-16T13:12:07.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.248+0000 7f4333fff700 1 --2- 172.21.15.92:0/2313531927 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f43280a1510 0x7f43280a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:07.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.249+0000 7f433a59c700 1 --2- 172.21.15.92:0/2313531927 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f43280a1510 0x7f43280a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:07.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.249+0000 7f4333fff700 1 -- 172.21.15.92:0/2313531927 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f432c0ccc50 con 0x7f433c100050 2023-10-16T13:12:07.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.249+0000 7f4333fff700 1 --2- 172.21.15.92:0/2313531927 >> [v2:172.21.15.118:6800/106427465,v1:172.21.15.118:6801/106427465] conn(0x7f43280aacf0 0x7f43280ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:07.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.249+0000 7f4333fff700 1 -- 172.21.15.92:0/2313531927 --> [v2:172.21.15.118:6800/106427465,v1:172.21.15.118:6801/106427465] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f43280ad7c0 con 0x7f43280aacf0 2023-10-16T13:12:07.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.249+0000 7f4333fff700 1 -- 172.21.15.92:0/2313531927 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f432c0cd0f0 con 0x7f433c100050 2023-10-16T13:12:07.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.249+0000 7f433a59c700 1 --2- 172.21.15.92:0/2313531927 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f43280a1510 0x7f43280a39d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f433c198770 tx=0x7f4324005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:07.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.249+0000 7f433b59e700 1 --2- 172.21.15.92:0/2313531927 >> [v2:172.21.15.118:6800/106427465,v1:172.21.15.118:6801/106427465] conn(0x7f43280aacf0 0x7f43280ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:07.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.250+0000 7f433b59e700 1 --2- 172.21.15.92:0/2313531927 >> [v2:172.21.15.118:6800/106427465,v1:172.21.15.118:6801/106427465] conn(0x7f43280aacf0 0x7f43280ad110 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:07.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.250+0000 7f4333fff700 1 -- 172.21.15.92:0/2313531927 <== osd.1 v2:172.21.15.118:6800/106427465 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f43280ad7c0 con 0x7f43280aacf0 2023-10-16T13:12:07.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.266+0000 7f434111e700 1 -- 172.21.15.92:0/2313531927 --> [v2:172.21.15.118:6800/106427465,v1:172.21.15.118:6801/106427465] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f433c04ebb0 con 0x7f43280aacf0 2023-10-16T13:12:07.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.267+0000 7f4333fff700 1 -- 172.21.15.92:0/2313531927 <== osd.1 v2:172.21.15.118:6800/106427465 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f433c04ebb0 con 0x7f43280aacf0 2023-10-16T13:12:07.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.267+0000 7f434111e700 1 -- 172.21.15.92:0/2313531927 >> [v2:172.21.15.118:6800/106427465,v1:172.21.15.118:6801/106427465] conn(0x7f43280aacf0 msgr2=0x7f43280ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:07.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.267+0000 7f434111e700 1 --2- 172.21.15.92:0/2313531927 >> [v2:172.21.15.118:6800/106427465,v1:172.21.15.118:6801/106427465] conn(0x7f43280aacf0 0x7f43280ad110 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:07.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.267+0000 7f434111e700 1 -- 172.21.15.92:0/2313531927 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f43280a1510 msgr2=0x7f43280a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:07.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.267+0000 7f434111e700 1 --2- 172.21.15.92:0/2313531927 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f43280a1510 0x7f43280a39d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f433c198770 tx=0x7f4324005fd0 comp rx=0 tx=0).stop 2023-10-16T13:12:07.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.267+0000 7f434111e700 1 -- 172.21.15.92:0/2313531927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f433c100050 msgr2=0x7f433c197150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:07.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.267+0000 7f434111e700 1 --2- 172.21.15.92:0/2313531927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f433c100050 0x7f433c197150 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f432c00ada0 tx=0x7f432c00c330 comp rx=0 tx=0).stop 2023-10-16T13:12:07.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.267+0000 7f433b59e700 1 -- 172.21.15.92:0/2313531927 reap_dead start 2023-10-16T13:12:07.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.267+0000 7f434111e700 1 -- 172.21.15.92:0/2313531927 shutdown_connections 2023-10-16T13:12:07.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.267+0000 7f434111e700 1 -- 172.21.15.92:0/2313531927 >> 172.21.15.92:0/2313531927 conn(0x7f433c0fb920 msgr2=0x7f433c103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:07.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.268+0000 7f434111e700 1 -- 172.21.15.92:0/2313531927 shutdown_connections 2023-10-16T13:12:07.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.268+0000 7f434111e700 1 -- 172.21.15.92:0/2313531927 wait complete. 2023-10-16T13:12:07.938 INFO:teuthology.orchestra.run.smithi092.stdout:304942678037 2023-10-16T13:12:07.939 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.10 2023-10-16T13:12:08.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.897+0000 7feae075a700 1 -- 172.21.15.92:0/3656414508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fead8105e70 msgr2=0x7fead8106250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:08.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.897+0000 7feae075a700 1 --2- 172.21.15.92:0/3656414508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fead8105e70 0x7fead8106250 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fead40099c0 tx=0x7fead4009cd0 comp rx=0 tx=0).stop 2023-10-16T13:12:08.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.897+0000 7feae075a700 1 -- 172.21.15.92:0/3656414508 shutdown_connections 2023-10-16T13:12:08.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.897+0000 7feae075a700 1 --2- 172.21.15.92:0/3656414508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fead8105e70 0x7fead8106250 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:08.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.897+0000 7feae075a700 1 --2- 172.21.15.92:0/3656414508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fead8100820 0x7fead810cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:08.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.897+0000 7feae075a700 1 --2- 172.21.15.92:0/3656414508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead80ffe60 0x7fead81002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:08.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.897+0000 7feae075a700 1 -- 172.21.15.92:0/3656414508 >> 172.21.15.92:0/3656414508 conn(0x7fead8075e00 msgr2=0x7fead8076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:08.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.897+0000 7feae075a700 1 -- 172.21.15.92:0/3656414508 shutdown_connections 2023-10-16T13:12:08.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.897+0000 7feae075a700 1 -- 172.21.15.92:0/3656414508 wait complete. 2023-10-16T13:12:08.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.897+0000 7feae075a700 1 Processor -- start 2023-10-16T13:12:08.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.897+0000 7feae075a700 1 -- start start 2023-10-16T13:12:08.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feae075a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead80ffe60 0x7fead8195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:08.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feae075a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fead8100820 0x7fead81964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:08.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feae075a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fead8105e70 0x7fead819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:08.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feae075a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead819af60 con 0x7fead8105e70 2023-10-16T13:12:08.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feae075a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead819b0d0 con 0x7fead80ffe60 2023-10-16T13:12:08.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feae075a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead819b290 con 0x7fead8100820 2023-10-16T13:12:08.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feadecf7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fead8105e70 0x7fead819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:08.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feadecf7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fead8105e70 0x7fead819a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35570/0 (socket says 172.21.15.92:35570) 2023-10-16T13:12:08.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feadecf7700 1 -- 172.21.15.92:0/3729449201 learned_addr learned my addr 172.21.15.92:0/3729449201 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:08.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feaddcf5700 1 --2- 172.21.15.92:0/3729449201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fead8100820 0x7fead81964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:08.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feadecf7700 1 -- 172.21.15.92:0/3729449201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fead8100820 msgr2=0x7fead81964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:08.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feade4f6700 1 --2- 172.21.15.92:0/3729449201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead80ffe60 0x7fead8195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:08.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feadecf7700 1 --2- 172.21.15.92:0/3729449201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fead8100820 0x7fead81964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:08.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feadecf7700 1 -- 172.21.15.92:0/3729449201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead80ffe60 msgr2=0x7fead8195fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:08.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feadecf7700 1 --2- 172.21.15.92:0/3729449201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead80ffe60 0x7fead8195fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:08.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feadecf7700 1 -- 172.21.15.92:0/3729449201 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead40095f0 con 0x7fead8105e70 2023-10-16T13:12:08.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feaddcf5700 1 --2- 172.21.15.92:0/3729449201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fead8100820 0x7fead81964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:12:08.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feadecf7700 1 --2- 172.21.15.92:0/3729449201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fead8105e70 0x7fead819a950 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fead0007ee0 tx=0x7fead000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:08.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feacf7fe700 1 -- 172.21.15.92:0/3729449201 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0017070 con 0x7fead8105e70 2023-10-16T13:12:08.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feae075a700 1 -- 172.21.15.92:0/3729449201 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead819b570 con 0x7fead8105e70 2023-10-16T13:12:08.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feacf7fe700 1 -- 172.21.15.92:0/3729449201 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fead000f040 con 0x7fead8105e70 2023-10-16T13:12:08.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feacf7fe700 1 -- 172.21.15.92:0/3729449201 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0005740 con 0x7fead8105e70 2023-10-16T13:12:08.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.898+0000 7feae075a700 1 -- 172.21.15.92:0/3729449201 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead81a2dd0 con 0x7fead8105e70 2023-10-16T13:12:08.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.899+0000 7feae075a700 1 -- 172.21.15.92:0/3729449201 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fead8110180 con 0x7fead8105e70 2023-10-16T13:12:08.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.900+0000 7feacf7fe700 1 -- 172.21.15.92:0/3729449201 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fead00058a0 con 0x7fead8105e70 2023-10-16T13:12:08.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.901+0000 7feacf7fe700 1 --2- 172.21.15.92:0/3729449201 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7feac40a1510 0x7feac40a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:08.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.901+0000 7feade4f6700 1 --2- 172.21.15.92:0/3729449201 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7feac40a1510 0x7feac40a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:08.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.901+0000 7feacf7fe700 1 -- 172.21.15.92:0/3729449201 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fead00ccbc0 con 0x7fead8105e70 2023-10-16T13:12:08.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.901+0000 7feacf7fe700 1 --2- 172.21.15.92:0/3729449201 >> [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450] conn(0x7feac40aacf0 0x7feac40ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:08.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.901+0000 7feacf7fe700 1 -- 172.21.15.92:0/3729449201 --> [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feac40ad7c0 con 0x7feac40aacf0 2023-10-16T13:12:08.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.901+0000 7feacf7fe700 1 -- 172.21.15.92:0/3729449201 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fead00cd060 con 0x7fead8105e70 2023-10-16T13:12:08.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.901+0000 7feaddcf5700 1 --2- 172.21.15.92:0/3729449201 >> [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450] conn(0x7feac40aacf0 0x7feac40ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:08.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.901+0000 7feade4f6700 1 --2- 172.21.15.92:0/3729449201 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7feac40a1510 0x7feac40a39d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fead40098e0 tx=0x7fead4009510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:08.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.901+0000 7feaddcf5700 1 --2- 172.21.15.92:0/3729449201 >> [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450] conn(0x7feac40aacf0 0x7feac40ad110 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:08.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.902+0000 7feacf7fe700 1 -- 172.21.15.92:0/3729449201 <== osd.3 v2:172.21.15.92:6810/1274183450 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7feac40ad7c0 con 0x7feac40aacf0 2023-10-16T13:12:08.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.930+0000 7feae075a700 1 -- 172.21.15.92:0/3729449201 --> [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fead804ebb0 con 0x7feac40aacf0 2023-10-16T13:12:08.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.930+0000 7feacf7fe700 1 -- 172.21.15.92:0/3729449201 <== osd.3 v2:172.21.15.92:6810/1274183450 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fead804ebb0 con 0x7feac40aacf0 2023-10-16T13:12:08.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.931+0000 7feae075a700 1 -- 172.21.15.92:0/3729449201 >> [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450] conn(0x7feac40aacf0 msgr2=0x7feac40ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:08.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.931+0000 7feae075a700 1 --2- 172.21.15.92:0/3729449201 >> [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450] conn(0x7feac40aacf0 0x7feac40ad110 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:08.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.931+0000 7feae075a700 1 -- 172.21.15.92:0/3729449201 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7feac40a1510 msgr2=0x7feac40a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:08.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.931+0000 7feae075a700 1 --2- 172.21.15.92:0/3729449201 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7feac40a1510 0x7feac40a39d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fead40098e0 tx=0x7fead4009510 comp rx=0 tx=0).stop 2023-10-16T13:12:08.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.931+0000 7feae075a700 1 -- 172.21.15.92:0/3729449201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fead8105e70 msgr2=0x7fead819a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:08.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.931+0000 7feae075a700 1 --2- 172.21.15.92:0/3729449201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fead8105e70 0x7fead819a950 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fead0007ee0 tx=0x7fead000d3b0 comp rx=0 tx=0).stop 2023-10-16T13:12:08.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.931+0000 7feadecf7700 1 -- 172.21.15.92:0/3729449201 reap_dead start 2023-10-16T13:12:08.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.931+0000 7feae075a700 1 -- 172.21.15.92:0/3729449201 shutdown_connections 2023-10-16T13:12:08.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.931+0000 7feae075a700 1 -- 172.21.15.92:0/3729449201 >> 172.21.15.92:0/3729449201 conn(0x7fead8075e00 msgr2=0x7fead80fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:08.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.931+0000 7feae075a700 1 -- 172.21.15.92:0/3729449201 shutdown_connections 2023-10-16T13:12:08.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:07.931+0000 7feae075a700 1 -- 172.21.15.92:0/3729449201 wait complete. 2023-10-16T13:12:08.296 INFO:teuthology.orchestra.run.smithi092.stdout:197568495655 2023-10-16T13:12:08.297 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.6 2023-10-16T13:12:08.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.652+0000 7f36957b9700 1 -- 172.21.15.92:0/1591026397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36901089a0 msgr2=0x7f3690108d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:08.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.652+0000 7f36957b9700 1 --2- 172.21.15.92:0/1591026397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36901089a0 0x7f3690108d80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3680009990 tx=0x7f3680009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:08.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.652+0000 7f36957b9700 1 -- 172.21.15.92:0/1591026397 shutdown_connections 2023-10-16T13:12:08.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.652+0000 7f36957b9700 1 --2- 172.21.15.92:0/1591026397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36901089a0 0x7f3690108d80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:08.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.652+0000 7f36957b9700 1 --2- 172.21.15.92:0/1591026397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f369010d0e0 0x7f3690114cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:08.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.652+0000 7f36957b9700 1 --2- 172.21.15.92:0/1591026397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3690109350 0x7f369010ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:08.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.652+0000 7f36957b9700 1 -- 172.21.15.92:0/1591026397 >> 172.21.15.92:0/1591026397 conn(0x7f369006d0e0 msgr2=0x7f369006d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:08.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.652+0000 7f36957b9700 1 -- 172.21.15.92:0/1591026397 shutdown_connections 2023-10-16T13:12:08.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.652+0000 7f36957b9700 1 -- 172.21.15.92:0/1591026397 wait complete. 2023-10-16T13:12:08.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.653+0000 7f36957b9700 1 Processor -- start 2023-10-16T13:12:08.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.653+0000 7f36957b9700 1 -- start start 2023-10-16T13:12:08.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f36957b9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36901089a0 0x7f36901a4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:08.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f36957b9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3690109350 0x7f36901a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:08.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f36957b9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f369010d0e0 0x7f369019e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:08.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f36957b9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369019ed10 con 0x7f36901089a0 2023-10-16T13:12:08.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f36957b9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369019ee80 con 0x7f3690109350 2023-10-16T13:12:08.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f368effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36901089a0 0x7f36901a4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:08.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f36957b9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369019f040 con 0x7f369010d0e0 2023-10-16T13:12:08.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f368effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36901089a0 0x7f36901a4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35580/0 (socket says 172.21.15.92:35580) 2023-10-16T13:12:08.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f368effd700 1 -- 172.21.15.92:0/1653422027 learned_addr learned my addr 172.21.15.92:0/1653422027 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:08.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f368f7fe700 1 --2- 172.21.15.92:0/1653422027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f369010d0e0 0x7f369019e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:08.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f368e7fc700 1 --2- 172.21.15.92:0/1653422027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3690109350 0x7f36901a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:08.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f368effd700 1 -- 172.21.15.92:0/1653422027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f369010d0e0 msgr2=0x7f369019e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:08.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f368effd700 1 --2- 172.21.15.92:0/1653422027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f369010d0e0 0x7f369019e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:08.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f368effd700 1 -- 172.21.15.92:0/1653422027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3690109350 msgr2=0x7f36901a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:08.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f368effd700 1 --2- 172.21.15.92:0/1653422027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3690109350 0x7f36901a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:08.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f368effd700 1 -- 172.21.15.92:0/1653422027 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36800095f0 con 0x7f36901089a0 2023-10-16T13:12:08.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f368e7fc700 1 --2- 172.21.15.92:0/1653422027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3690109350 0x7f36901a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:12:08.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f368effd700 1 --2- 172.21.15.92:0/1653422027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36901089a0 0x7f36901a4590 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3680000c00 tx=0x7f368000f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:08.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f3677fff700 1 -- 172.21.15.92:0/1653422027 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368001d070 con 0x7f36901089a0 2023-10-16T13:12:08.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f36957b9700 1 -- 172.21.15.92:0/1653422027 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369019f2c0 con 0x7f36901089a0 2023-10-16T13:12:08.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f3677fff700 1 -- 172.21.15.92:0/1653422027 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3680003680 con 0x7f36901089a0 2023-10-16T13:12:08.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f3677fff700 1 -- 172.21.15.92:0/1653422027 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680017650 con 0x7f36901089a0 2023-10-16T13:12:08.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.654+0000 7f36957b9700 1 -- 172.21.15.92:0/1653422027 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36901ab580 con 0x7f36901089a0 2023-10-16T13:12:08.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.655+0000 7f36957b9700 1 -- 172.21.15.92:0/1653422027 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f36901189a0 con 0x7f36901089a0 2023-10-16T13:12:08.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.656+0000 7f3677fff700 1 -- 172.21.15.92:0/1653422027 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f3680022470 con 0x7f36901089a0 2023-10-16T13:12:08.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.657+0000 7f3677fff700 1 --2- 172.21.15.92:0/1653422027 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f36780a1590 0x7f36780a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:08.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.657+0000 7f368e7fc700 1 --2- 172.21.15.92:0/1653422027 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f36780a1590 0x7f36780a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:08.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.657+0000 7f3677fff700 1 -- 172.21.15.92:0/1653422027 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f36800ce910 con 0x7f36901089a0 2023-10-16T13:12:08.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.657+0000 7f3677fff700 1 --2- 172.21.15.92:0/1653422027 >> [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763] conn(0x7f36780aac40 0x7f36780ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:08.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.657+0000 7f3677fff700 1 -- 172.21.15.92:0/1653422027 --> [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36780ad710 con 0x7f36780aac40 2023-10-16T13:12:08.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.657+0000 7f3677fff700 1 -- 172.21.15.92:0/1653422027 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36800cecc0 con 0x7f36901089a0 2023-10-16T13:12:08.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.657+0000 7f368e7fc700 1 --2- 172.21.15.92:0/1653422027 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f36780a1590 0x7f36780a3a50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3684005fd0 tx=0x7f3684005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:08.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.657+0000 7f368f7fe700 1 --2- 172.21.15.92:0/1653422027 >> [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763] conn(0x7f36780aac40 0x7f36780ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:08.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.658+0000 7f368f7fe700 1 --2- 172.21.15.92:0/1653422027 >> [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763] conn(0x7f36780aac40 0x7f36780ad060 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:08.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.659+0000 7f3677fff700 1 -- 172.21.15.92:0/1653422027 <== osd.11 v2:172.21.15.152:6824/3082644763 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f36780ad710 con 0x7f36780aac40 2023-10-16T13:12:08.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.677+0000 7f36957b9700 1 -- 172.21.15.92:0/1653422027 --> [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f369004ebb0 con 0x7f36780aac40 2023-10-16T13:12:08.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.677+0000 7f3677fff700 1 -- 172.21.15.92:0/1653422027 <== osd.11 v2:172.21.15.152:6824/3082644763 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f369004ebb0 con 0x7f36780aac40 2023-10-16T13:12:08.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.678+0000 7f36957b9700 1 -- 172.21.15.92:0/1653422027 >> [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763] conn(0x7f36780aac40 msgr2=0x7f36780ad060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:08.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.678+0000 7f36957b9700 1 --2- 172.21.15.92:0/1653422027 >> [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763] conn(0x7f36780aac40 0x7f36780ad060 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:08.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.678+0000 7f36957b9700 1 -- 172.21.15.92:0/1653422027 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f36780a1590 msgr2=0x7f36780a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:08.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.678+0000 7f36957b9700 1 --2- 172.21.15.92:0/1653422027 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f36780a1590 0x7f36780a3a50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3684005fd0 tx=0x7f3684005ee0 comp rx=0 tx=0).stop 2023-10-16T13:12:08.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.678+0000 7f36957b9700 1 -- 172.21.15.92:0/1653422027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36901089a0 msgr2=0x7f36901a4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:08.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.678+0000 7f36957b9700 1 --2- 172.21.15.92:0/1653422027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36901089a0 0x7f36901a4590 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3680000c00 tx=0x7f368000f710 comp rx=0 tx=0).stop 2023-10-16T13:12:08.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.678+0000 7f368f7fe700 1 -- 172.21.15.92:0/1653422027 reap_dead start 2023-10-16T13:12:08.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.678+0000 7f36957b9700 1 -- 172.21.15.92:0/1653422027 shutdown_connections 2023-10-16T13:12:08.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.678+0000 7f36957b9700 1 -- 172.21.15.92:0/1653422027 >> 172.21.15.92:0/1653422027 conn(0x7f369006d0e0 msgr2=0x7f3690070a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:08.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.678+0000 7f36957b9700 1 -- 172.21.15.92:0/1653422027 shutdown_connections 2023-10-16T13:12:08.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:08.678+0000 7f36957b9700 1 -- 172.21.15.92:0/1653422027 wait complete. 2023-10-16T13:12:08.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:08 smithi152 ceph-mon[104423]: pgmap v269: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-10-16T13:12:08.705 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:08 smithi092 ceph-mon[99542]: pgmap v269: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-10-16T13:12:08.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:08 smithi118 ceph-mon[103969]: pgmap v269: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-10-16T13:12:10.204 INFO:teuthology.orchestra.run.smithi092.stdout:34359738431 2023-10-16T13:12:10.205 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.0 2023-10-16T13:12:10.404 INFO:teuthology.orchestra.run.smithi092.stdout:335007449105 2023-10-16T13:12:10.405 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.11 2023-10-16T13:12:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:10 smithi092 ceph-mon[99542]: pgmap v270: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 10 op/s 2023-10-16T13:12:10.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:10 smithi152 ceph-mon[104423]: pgmap v270: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 10 op/s 2023-10-16T13:12:10.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:10 smithi118 ceph-mon[103969]: pgmap v270: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 10 op/s 2023-10-16T13:12:11.139 INFO:teuthology.orchestra.run.smithi092.stdout:55834574907 2023-10-16T13:12:11.140 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.1 2023-10-16T13:12:11.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.725+0000 7f66cacaf700 1 -- 172.21.15.92:0/1979965906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66c4069c10 msgr2=0x7f66c410ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:11.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.725+0000 7f66cacaf700 1 --2- 172.21.15.92:0/1979965906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66c4069c10 0x7f66c410ddc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f66bc00b0a0 tx=0x7f66bc00b3b0 comp rx=0 tx=0).stop 2023-10-16T13:12:11.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.725+0000 7f66cacaf700 1 -- 172.21.15.92:0/1979965906 shutdown_connections 2023-10-16T13:12:11.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.725+0000 7f66cacaf700 1 --2- 172.21.15.92:0/1979965906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66c4069c10 0x7f66c410ddc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:11.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.725+0000 7f66cacaf700 1 --2- 172.21.15.92:0/1979965906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66c4106f80 0x7f66c4107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:11.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.725+0000 7f66cacaf700 1 --2- 172.21.15.92:0/1979965906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66c4069270 0x7f66c40696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:11.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.725+0000 7f66cacaf700 1 -- 172.21.15.92:0/1979965906 >> 172.21.15.92:0/1979965906 conn(0x7f66c4076dc0 msgr2=0x7f66c40771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:11.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.725+0000 7f66cacaf700 1 -- 172.21.15.92:0/1979965906 shutdown_connections 2023-10-16T13:12:11.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.725+0000 7f66cacaf700 1 -- 172.21.15.92:0/1979965906 wait complete. 2023-10-16T13:12:11.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.726+0000 7f66cacaf700 1 Processor -- start 2023-10-16T13:12:11.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.726+0000 7f66cacaf700 1 -- start start 2023-10-16T13:12:11.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.726+0000 7f66cacaf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66c4069270 0x7f66c4197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:11.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.726+0000 7f66cacaf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66c4069c10 0x7f66c41976c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:11.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.726+0000 7f66cacaf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66c4106f80 0x7f66c419bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:11.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.726+0000 7f66cacaf700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c419c0d0 con 0x7f66c4069270 2023-10-16T13:12:11.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.726+0000 7f66cacaf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c419c240 con 0x7f66c4106f80 2023-10-16T13:12:11.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.726+0000 7f66cacaf700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c419c400 con 0x7f66c4069c10 2023-10-16T13:12:11.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.726+0000 7f66c8a4b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66c4069270 0x7f66c4197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:11.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.727+0000 7f66c8a4b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66c4069270 0x7f66c4197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35594/0 (socket says 172.21.15.92:35594) 2023-10-16T13:12:11.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.727+0000 7f66c8a4b700 1 -- 172.21.15.92:0/57235453 learned_addr learned my addr 172.21.15.92:0/57235453 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:11.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.727+0000 7f66c924c700 1 --2- 172.21.15.92:0/57235453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66c4106f80 0x7f66c419bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:11.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.727+0000 7f66c3fff700 1 --2- 172.21.15.92:0/57235453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66c4069c10 0x7f66c41976c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:11.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.727+0000 7f66c8a4b700 1 -- 172.21.15.92:0/57235453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66c4069c10 msgr2=0x7f66c41976c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:11.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.727+0000 7f66c8a4b700 1 --2- 172.21.15.92:0/57235453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66c4069c10 0x7f66c41976c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:11.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.727+0000 7f66c8a4b700 1 -- 172.21.15.92:0/57235453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66c4106f80 msgr2=0x7f66c419bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:11.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.727+0000 7f66c8a4b700 1 --2- 172.21.15.92:0/57235453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66c4106f80 0x7f66c419bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:11.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.727+0000 7f66c8a4b700 1 -- 172.21.15.92:0/57235453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc009d00 con 0x7f66c4069270 2023-10-16T13:12:11.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.727+0000 7f66c3fff700 1 --2- 172.21.15.92:0/57235453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66c4069c10 0x7f66c41976c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:12:11.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.727+0000 7f66c8a4b700 1 --2- 172.21.15.92:0/57235453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66c4069270 0x7f66c4197180 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f66b800e9a0 tx=0x7f66b800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:11.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.727+0000 7f66c1ffb700 1 -- 172.21.15.92:0/57235453 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8009790 con 0x7f66c4069270 2023-10-16T13:12:11.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.727+0000 7f66cacaf700 1 -- 172.21.15.92:0/57235453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c419c6e0 con 0x7f66c4069270 2023-10-16T13:12:11.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.727+0000 7f66c1ffb700 1 -- 172.21.15.92:0/57235453 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f66b800cbd0 con 0x7f66c4069270 2023-10-16T13:12:11.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.727+0000 7f66c1ffb700 1 -- 172.21.15.92:0/57235453 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8018680 con 0x7f66c4069270 2023-10-16T13:12:11.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.727+0000 7f66cacaf700 1 -- 172.21.15.92:0/57235453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c41a3f40 con 0x7f66c4069270 2023-10-16T13:12:11.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.728+0000 7f66cacaf700 1 -- 172.21.15.92:0/57235453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f66c404ebb0 con 0x7f66c4069270 2023-10-16T13:12:11.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.729+0000 7f66c1ffb700 1 -- 172.21.15.92:0/57235453 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f66b80188a0 con 0x7f66c4069270 2023-10-16T13:12:11.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.730+0000 7f66c1ffb700 1 --2- 172.21.15.92:0/57235453 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f66b40a1590 0x7f66b40a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:11.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.730+0000 7f66c3fff700 1 --2- 172.21.15.92:0/57235453 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f66b40a1590 0x7f66b40a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:11.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.730+0000 7f66c1ffb700 1 -- 172.21.15.92:0/57235453 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f66b8014070 con 0x7f66c4069270 2023-10-16T13:12:11.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.730+0000 7f66c1ffb700 1 --2- 172.21.15.92:0/57235453 >> [v2:172.21.15.118:6816/3103702893,v1:172.21.15.118:6817/3103702893] conn(0x7f66b40aad70 0x7f66b40ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:11.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.730+0000 7f66c1ffb700 1 -- 172.21.15.92:0/57235453 --> [v2:172.21.15.118:6816/3103702893,v1:172.21.15.118:6817/3103702893] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66b40ad840 con 0x7f66b40aad70 2023-10-16T13:12:11.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.730+0000 7f66c1ffb700 1 -- 172.21.15.92:0/57235453 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66b80cda10 con 0x7f66c4069270 2023-10-16T13:12:11.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.730+0000 7f66c3fff700 1 --2- 172.21.15.92:0/57235453 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f66b40a1590 0x7f66b40a3a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f66c4198730 tx=0x7f66b0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:11.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.731+0000 7f66c924c700 1 --2- 172.21.15.92:0/57235453 >> [v2:172.21.15.118:6816/3103702893,v1:172.21.15.118:6817/3103702893] conn(0x7f66b40aad70 0x7f66b40ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:11.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.731+0000 7f66c924c700 1 --2- 172.21.15.92:0/57235453 >> [v2:172.21.15.118:6816/3103702893,v1:172.21.15.118:6817/3103702893] conn(0x7f66b40aad70 0x7f66b40ad190 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:11.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.732+0000 7f66c1ffb700 1 -- 172.21.15.92:0/57235453 <== osd.7 v2:172.21.15.118:6816/3103702893 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f66b40ad840 con 0x7f66b40aad70 2023-10-16T13:12:11.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.748+0000 7f66cacaf700 1 -- 172.21.15.92:0/57235453 --> [v2:172.21.15.118:6816/3103702893,v1:172.21.15.118:6817/3103702893] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f66c4111190 con 0x7f66b40aad70 2023-10-16T13:12:11.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.748+0000 7f66c1ffb700 1 -- 172.21.15.92:0/57235453 <== osd.7 v2:172.21.15.118:6816/3103702893 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f66c4111190 con 0x7f66b40aad70 2023-10-16T13:12:11.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.748+0000 7f66cacaf700 1 -- 172.21.15.92:0/57235453 >> [v2:172.21.15.118:6816/3103702893,v1:172.21.15.118:6817/3103702893] conn(0x7f66b40aad70 msgr2=0x7f66b40ad190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:11.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.748+0000 7f66cacaf700 1 --2- 172.21.15.92:0/57235453 >> [v2:172.21.15.118:6816/3103702893,v1:172.21.15.118:6817/3103702893] conn(0x7f66b40aad70 0x7f66b40ad190 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:11.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.749+0000 7f66cacaf700 1 -- 172.21.15.92:0/57235453 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f66b40a1590 msgr2=0x7f66b40a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:11.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.749+0000 7f66cacaf700 1 --2- 172.21.15.92:0/57235453 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f66b40a1590 0x7f66b40a3a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f66c4198730 tx=0x7f66b0009260 comp rx=0 tx=0).stop 2023-10-16T13:12:11.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.749+0000 7f66cacaf700 1 -- 172.21.15.92:0/57235453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66c4069270 msgr2=0x7f66c4197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:11.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.749+0000 7f66cacaf700 1 --2- 172.21.15.92:0/57235453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66c4069270 0x7f66c4197180 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f66b800e9a0 tx=0x7f66b800ecb0 comp rx=0 tx=0).stop 2023-10-16T13:12:11.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.749+0000 7f66c924c700 1 -- 172.21.15.92:0/57235453 reap_dead start 2023-10-16T13:12:11.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.749+0000 7f66cacaf700 1 -- 172.21.15.92:0/57235453 shutdown_connections 2023-10-16T13:12:11.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.749+0000 7f66cacaf700 1 -- 172.21.15.92:0/57235453 >> 172.21.15.92:0/57235453 conn(0x7f66c4076dc0 msgr2=0x7f66c4104ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:11.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.749+0000 7f66cacaf700 1 -- 172.21.15.92:0/57235453 shutdown_connections 2023-10-16T13:12:11.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:11.749+0000 7f66cacaf700 1 -- 172.21.15.92:0/57235453 wait complete. 2023-10-16T13:12:12.042 INFO:teuthology.orchestra.run.smithi092.stdout:107374182452 2023-10-16T13:12:12.042 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.3 2023-10-16T13:12:12.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.308+0000 7f697169c700 1 -- 172.21.15.92:0/2745641579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c105ec0 msgr2=0x7f696c1062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.309+0000 7f697169c700 1 --2- 172.21.15.92:0/2745641579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c105ec0 0x7f696c1062a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f695c009990 tx=0x7f695c009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.309+0000 7f697169c700 1 -- 172.21.15.92:0/2745641579 shutdown_connections 2023-10-16T13:12:12.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.309+0000 7f697169c700 1 --2- 172.21.15.92:0/2745641579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c105ec0 0x7f696c1062a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.309+0000 7f697169c700 1 --2- 172.21.15.92:0/2745641579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f696c1007d0 0x7f696c10cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.309+0000 7f697169c700 1 --2- 172.21.15.92:0/2745641579 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f696c0ffe10 0x7f696c100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.309+0000 7f697169c700 1 -- 172.21.15.92:0/2745641579 >> 172.21.15.92:0/2745641579 conn(0x7f696c076dc0 msgr2=0x7f696c0771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:12.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.309+0000 7f697169c700 1 -- 172.21.15.92:0/2745641579 shutdown_connections 2023-10-16T13:12:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.309+0000 7f697169c700 1 -- 172.21.15.92:0/2745641579 wait complete. 2023-10-16T13:12:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.309+0000 7f697169c700 1 Processor -- start 2023-10-16T13:12:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.309+0000 7f697169c700 1 -- start start 2023-10-16T13:12:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.310+0000 7f697169c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c0ffe10 0x7f696c197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.310+0000 7f697169c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f696c1007d0 0x7f696c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.310+0000 7f697169c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f696c105ec0 0x7f696c1a2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.310+0000 7f697169c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c198d50 con 0x7f696c0ffe10 2023-10-16T13:12:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.310+0000 7f697169c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c1a34c0 con 0x7f696c1007d0 2023-10-16T13:12:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.310+0000 7f697169c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c1a3630 con 0x7f696c105ec0 2023-10-16T13:12:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.310+0000 7f696affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c0ffe10 0x7f696c197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.310+0000 7f696affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c0ffe10 0x7f696c197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35638/0 (socket says 172.21.15.92:35638) 2023-10-16T13:12:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.310+0000 7f696affd700 1 -- 172.21.15.92:0/3528610958 learned_addr learned my addr 172.21.15.92:0/3528610958 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.310+0000 7f696a7fc700 1 --2- 172.21.15.92:0/3528610958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f696c1007d0 0x7f696c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.310+0000 7f696b7fe700 1 --2- 172.21.15.92:0/3528610958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f696c105ec0 0x7f696c1a2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.310+0000 7f696affd700 1 -- 172.21.15.92:0/3528610958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f696c105ec0 msgr2=0x7f696c1a2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.310+0000 7f696affd700 1 --2- 172.21.15.92:0/3528610958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f696c105ec0 0x7f696c1a2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.310+0000 7f696affd700 1 -- 172.21.15.92:0/3528610958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f696c1007d0 msgr2=0x7f696c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.310+0000 7f696affd700 1 --2- 172.21.15.92:0/3528610958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f696c1007d0 0x7f696c198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.310+0000 7f696affd700 1 -- 172.21.15.92:0/3528610958 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c0095f0 con 0x7f696c0ffe10 2023-10-16T13:12:12.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.310+0000 7f696a7fc700 1 --2- 172.21.15.92:0/3528610958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f696c1007d0 0x7f696c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:12:12.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.310+0000 7f696affd700 1 --2- 172.21.15.92:0/3528610958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c0ffe10 0x7f696c197f00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f695c005910 tx=0x7f695c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:12.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.311+0000 7f6953fff700 1 -- 172.21.15.92:0/3528610958 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c01d070 con 0x7f696c0ffe10 2023-10-16T13:12:12.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.311+0000 7f6953fff700 1 -- 172.21.15.92:0/3528610958 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f695c003680 con 0x7f696c0ffe10 2023-10-16T13:12:12.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.311+0000 7f697169c700 1 -- 172.21.15.92:0/3528610958 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696c1a38b0 con 0x7f696c0ffe10 2023-10-16T13:12:12.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.311+0000 7f6953fff700 1 -- 172.21.15.92:0/3528610958 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c017650 con 0x7f696c0ffe10 2023-10-16T13:12:12.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.311+0000 7f697169c700 1 -- 172.21.15.92:0/3528610958 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696c1a3d50 con 0x7f696c0ffe10 2023-10-16T13:12:12.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.311+0000 7f697169c700 1 -- 172.21.15.92:0/3528610958 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f696c04ebb0 con 0x7f696c0ffe10 2023-10-16T13:12:12.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.313+0000 7f6953fff700 1 -- 172.21.15.92:0/3528610958 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f695c022470 con 0x7f696c0ffe10 2023-10-16T13:12:12.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.314+0000 7f6953fff700 1 --2- 172.21.15.92:0/3528610958 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f69540a1590 0x7f69540a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.314+0000 7f6953fff700 1 -- 172.21.15.92:0/3528610958 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f695c0ced10 con 0x7f696c0ffe10 2023-10-16T13:12:12.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.314+0000 7f696a7fc700 1 --2- 172.21.15.92:0/3528610958 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f69540a1590 0x7f69540a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.314+0000 7f6953fff700 1 --2- 172.21.15.92:0/3528610958 >> [v2:172.21.15.118:6808/3903514094,v1:172.21.15.118:6809/3903514094] conn(0x7f69540aad70 0x7f69540ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.314+0000 7f6953fff700 1 -- 172.21.15.92:0/3528610958 --> [v2:172.21.15.118:6808/3903514094,v1:172.21.15.118:6809/3903514094] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69540ad840 con 0x7f69540aad70 2023-10-16T13:12:12.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.314+0000 7f6953fff700 1 -- 172.21.15.92:0/3528610958 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f695c0cf0c0 con 0x7f696c0ffe10 2023-10-16T13:12:12.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.315+0000 7f696a7fc700 1 --2- 172.21.15.92:0/3528610958 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f69540a1590 0x7f69540a3a50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6960005950 tx=0x7f69600058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:12.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.315+0000 7f696b7fe700 1 --2- 172.21.15.92:0/3528610958 >> [v2:172.21.15.118:6808/3903514094,v1:172.21.15.118:6809/3903514094] conn(0x7f69540aad70 0x7f69540ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.315+0000 7f696b7fe700 1 --2- 172.21.15.92:0/3528610958 >> [v2:172.21.15.118:6808/3903514094,v1:172.21.15.118:6809/3903514094] conn(0x7f69540aad70 0x7f69540ad190 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:12.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.316+0000 7f6953fff700 1 -- 172.21.15.92:0/3528610958 <== osd.4 v2:172.21.15.118:6808/3903514094 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f69540ad840 con 0x7f69540aad70 2023-10-16T13:12:12.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.010+0000 7f0cdcb4c700 1 -- 172.21.15.92:0/1961779295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cd80ffe10 msgr2=0x7f0cd8100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.010+0000 7f0cdcb4c700 1 --2- 172.21.15.92:0/1961779295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cd80ffe10 0x7f0cd8100290 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009990 tx=0x7f0ccc009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.010+0000 7f0cdcb4c700 1 -- 172.21.15.92:0/1961779295 shutdown_connections 2023-10-16T13:12:12.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.010+0000 7f0cdcb4c700 1 --2- 172.21.15.92:0/1961779295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cd81007d0 0x7f0cd810cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.010+0000 7f0cdcb4c700 1 --2- 172.21.15.92:0/1961779295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cd8105ec0 0x7f0cd81062a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.010+0000 7f0cdcb4c700 1 --2- 172.21.15.92:0/1961779295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cd80ffe10 0x7f0cd8100290 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.010+0000 7f0cdcb4c700 1 -- 172.21.15.92:0/1961779295 >> 172.21.15.92:0/1961779295 conn(0x7f0cd8076dc0 msgr2=0x7f0cd80771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.010+0000 7f0cdcb4c700 1 -- 172.21.15.92:0/1961779295 shutdown_connections 2023-10-16T13:12:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.010+0000 7f0cdcb4c700 1 -- 172.21.15.92:0/1961779295 wait complete. 2023-10-16T13:12:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.011+0000 7f0cdcb4c700 1 Processor -- start 2023-10-16T13:12:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.011+0000 7f0cdcb4c700 1 -- start start 2023-10-16T13:12:12.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.011+0000 7f0cdcb4c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cd80ffe10 0x7f0cd819f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.011+0000 7f0cdcb4c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cd81007d0 0x7f0cd819f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.011+0000 7f0cdcb4c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cd8105ec0 0x7f0cd810c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.011+0000 7f0cdcb4c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd810c750 con 0x7f0cd80ffe10 2023-10-16T13:12:12.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.011+0000 7f0cdcb4c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd810c8c0 con 0x7f0cd81007d0 2023-10-16T13:12:12.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.011+0000 7f0cdcb4c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd810ca80 con 0x7f0cd8105ec0 2023-10-16T13:12:12.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.011+0000 7f0cd659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cd80ffe10 0x7f0cd819f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.012+0000 7f0cd659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cd80ffe10 0x7f0cd819f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35606/0 (socket says 172.21.15.92:35606) 2023-10-16T13:12:12.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.012+0000 7f0cd5d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cd81007d0 0x7f0cd819f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.012+0000 7f0cd659c700 1 -- 172.21.15.92:0/2066655785 learned_addr learned my addr 172.21.15.92:0/2066655785 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:12.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.012+0000 7f0cd6d9d700 1 --2- 172.21.15.92:0/2066655785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cd8105ec0 0x7f0cd810c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.012+0000 7f0cd5d9b700 1 -- 172.21.15.92:0/2066655785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cd8105ec0 msgr2=0x7f0cd810c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.012+0000 7f0cd5d9b700 1 --2- 172.21.15.92:0/2066655785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cd8105ec0 0x7f0cd810c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.012+0000 7f0cd5d9b700 1 -- 172.21.15.92:0/2066655785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cd80ffe10 msgr2=0x7f0cd819f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.012+0000 7f0cd5d9b700 1 --2- 172.21.15.92:0/2066655785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cd80ffe10 0x7f0cd819f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.012+0000 7f0cd5d9b700 1 -- 172.21.15.92:0/2066655785 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc0095f0 con 0x7f0cd81007d0 2023-10-16T13:12:12.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.012+0000 7f0cd6d9d700 1 --2- 172.21.15.92:0/2066655785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cd8105ec0 0x7f0cd810c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:12:12.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.012+0000 7f0cd659c700 1 --2- 172.21.15.92:0/2066655785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cd80ffe10 0x7f0cd819f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:12:12.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.012+0000 7f0cd5d9b700 1 --2- 172.21.15.92:0/2066655785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cd81007d0 0x7f0cd819f550 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc000c00 tx=0x7f0ccc00f670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:12.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.013+0000 7f0cc77fe700 1 -- 172.21.15.92:0/2066655785 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc01d070 con 0x7f0cd81007d0 2023-10-16T13:12:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.013+0000 7f0cc77fe700 1 -- 172.21.15.92:0/2066655785 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0ccc003680 con 0x7f0cd81007d0 2023-10-16T13:12:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.013+0000 7f0cdcb4c700 1 -- 172.21.15.92:0/2066655785 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd810cca0 con 0x7f0cd81007d0 2023-10-16T13:12:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.013+0000 7f0cc77fe700 1 -- 172.21.15.92:0/2066655785 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc004a00 con 0x7f0cd81007d0 2023-10-16T13:12:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.013+0000 7f0cdcb4c700 1 -- 172.21.15.92:0/2066655785 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd8111240 con 0x7f0cd81007d0 2023-10-16T13:12:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.014+0000 7f0cdcb4c700 1 -- 172.21.15.92:0/2066655785 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0cd804ebb0 con 0x7f0cd81007d0 2023-10-16T13:12:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.015+0000 7f0cc77fe700 1 -- 172.21.15.92:0/2066655785 <== mon.2 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f0ccc005270 con 0x7f0cd81007d0 2023-10-16T13:12:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.016+0000 7f0cc77fe700 1 --2- 172.21.15.92:0/2066655785 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0cc00a1590 0x7f0cc00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.016+0000 7f0cd659c700 1 --2- 172.21.15.92:0/2066655785 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0cc00a1590 0x7f0cc00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.016+0000 7f0cc77fe700 1 -- 172.21.15.92:0/2066655785 <== mon.2 v2:172.21.15.118:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0ccc0ce2c0 con 0x7f0cd81007d0 2023-10-16T13:12:12.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.016+0000 7f0cc77fe700 1 --2- 172.21.15.92:0/2066655785 >> [v2:172.21.15.152:6808/3958877515,v1:172.21.15.152:6809/3958877515] conn(0x7f0cc00aad70 0x7f0cc00ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.016+0000 7f0cc77fe700 1 -- 172.21.15.92:0/2066655785 --> [v2:172.21.15.152:6808/3958877515,v1:172.21.15.152:6809/3958877515] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0cc00ad840 con 0x7f0cc00aad70 2023-10-16T13:12:12.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.016+0000 7f0cc77fe700 1 -- 172.21.15.92:0/2066655785 <== mon.2 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ccc0ce630 con 0x7f0cd81007d0 2023-10-16T13:12:12.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.016+0000 7f0cd659c700 1 --2- 172.21.15.92:0/2066655785 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0cc00a1590 0x7f0cc00a3a50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80104e0 tx=0x7f0cc8007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:12.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.016+0000 7f0cd6d9d700 1 --2- 172.21.15.92:0/2066655785 >> [v2:172.21.15.152:6808/3958877515,v1:172.21.15.152:6809/3958877515] conn(0x7f0cc00aad70 0x7f0cc00ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.017+0000 7f0cd6d9d700 1 --2- 172.21.15.92:0/2066655785 >> [v2:172.21.15.152:6808/3958877515,v1:172.21.15.152:6809/3958877515] conn(0x7f0cc00aad70 0x7f0cc00ad190 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.018+0000 7f0cc77fe700 1 -- 172.21.15.92:0/2066655785 <== osd.5 v2:172.21.15.152:6808/3958877515 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f0cc00ad840 con 0x7f0cc00aad70 2023-10-16T13:12:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.038+0000 7f0cdcb4c700 1 -- 172.21.15.92:0/2066655785 --> [v2:172.21.15.152:6808/3958877515,v1:172.21.15.152:6809/3958877515] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0cd810f160 con 0x7f0cc00aad70 2023-10-16T13:12:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.039+0000 7f0cc77fe700 1 -- 172.21.15.92:0/2066655785 <== osd.5 v2:172.21.15.152:6808/3958877515 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0cd000d350 con 0x7f0cc00aad70 2023-10-16T13:12:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.040+0000 7f0cdcb4c700 1 -- 172.21.15.92:0/2066655785 >> [v2:172.21.15.152:6808/3958877515,v1:172.21.15.152:6809/3958877515] conn(0x7f0cc00aad70 msgr2=0x7f0cc00ad190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.040+0000 7f0cdcb4c700 1 --2- 172.21.15.92:0/2066655785 >> [v2:172.21.15.152:6808/3958877515,v1:172.21.15.152:6809/3958877515] conn(0x7f0cc00aad70 0x7f0cc00ad190 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.040+0000 7f0cdcb4c700 1 -- 172.21.15.92:0/2066655785 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0cc00a1590 msgr2=0x7f0cc00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.040+0000 7f0cdcb4c700 1 --2- 172.21.15.92:0/2066655785 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0cc00a1590 0x7f0cc00a3a50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80104e0 tx=0x7f0cc8007480 comp rx=0 tx=0).stop 2023-10-16T13:12:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.040+0000 7f0cdcb4c700 1 -- 172.21.15.92:0/2066655785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cd81007d0 msgr2=0x7f0cd819f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.040+0000 7f0cdcb4c700 1 --2- 172.21.15.92:0/2066655785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cd81007d0 0x7f0cd819f550 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc000c00 tx=0x7f0ccc00f670 comp rx=0 tx=0).stop 2023-10-16T13:12:12.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.040+0000 7f0cd6d9d700 1 -- 172.21.15.92:0/2066655785 reap_dead start 2023-10-16T13:12:12.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.040+0000 7f0cdcb4c700 1 -- 172.21.15.92:0/2066655785 shutdown_connections 2023-10-16T13:12:12.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.040+0000 7f0cdcb4c700 1 -- 172.21.15.92:0/2066655785 >> 172.21.15.92:0/2066655785 conn(0x7f0cd8076dc0 msgr2=0x7f0cd80ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:12.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.040+0000 7f0cdcb4c700 1 -- 172.21.15.92:0/2066655785 shutdown_connections 2023-10-16T13:12:12.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.040+0000 7f0cdcb4c700 1 -- 172.21.15.92:0/2066655785 wait complete. 2023-10-16T13:12:12.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.333+0000 7f697169c700 1 -- 172.21.15.92:0/3528610958 --> [v2:172.21.15.118:6808/3903514094,v1:172.21.15.118:6809/3903514094] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f696c1101a0 con 0x7f69540aad70 2023-10-16T13:12:12.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.333+0000 7f6953fff700 1 -- 172.21.15.92:0/3528610958 <== osd.4 v2:172.21.15.118:6808/3903514094 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6964008bb0 con 0x7f69540aad70 2023-10-16T13:12:12.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.333+0000 7f697169c700 1 -- 172.21.15.92:0/3528610958 >> [v2:172.21.15.118:6808/3903514094,v1:172.21.15.118:6809/3903514094] conn(0x7f69540aad70 msgr2=0x7f69540ad190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.333+0000 7f697169c700 1 --2- 172.21.15.92:0/3528610958 >> [v2:172.21.15.118:6808/3903514094,v1:172.21.15.118:6809/3903514094] conn(0x7f69540aad70 0x7f69540ad190 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.333+0000 7f697169c700 1 -- 172.21.15.92:0/3528610958 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f69540a1590 msgr2=0x7f69540a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.333+0000 7f697169c700 1 --2- 172.21.15.92:0/3528610958 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f69540a1590 0x7f69540a3a50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6960005950 tx=0x7f69600058e0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.333+0000 7f697169c700 1 -- 172.21.15.92:0/3528610958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c0ffe10 msgr2=0x7f696c197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.333+0000 7f697169c700 1 --2- 172.21.15.92:0/3528610958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c0ffe10 0x7f696c197f00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f695c005910 tx=0x7f695c00f740 comp rx=0 tx=0).stop 2023-10-16T13:12:12.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.333+0000 7f696b7fe700 1 -- 172.21.15.92:0/3528610958 reap_dead start 2023-10-16T13:12:12.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.334+0000 7f697169c700 1 -- 172.21.15.92:0/3528610958 shutdown_connections 2023-10-16T13:12:12.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.334+0000 7f697169c700 1 -- 172.21.15.92:0/3528610958 >> 172.21.15.92:0/3528610958 conn(0x7f696c076dc0 msgr2=0x7f696c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:12.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.334+0000 7f697169c700 1 -- 172.21.15.92:0/3528610958 shutdown_connections 2023-10-16T13:12:12.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.334+0000 7f697169c700 1 -- 172.21.15.92:0/3528610958 wait complete. 2023-10-16T13:12:12.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:12 smithi152 ceph-mon[104423]: pgmap v271: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 853 B/s wr, 12 op/s 2023-10-16T13:12:12.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:12 smithi092 ceph-mon[99542]: pgmap v271: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 853 B/s wr, 12 op/s 2023-10-16T13:12:12.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.768+0000 7f7b9f4b3700 1 -- 172.21.15.92:0/3773028159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b980695b0 msgr2=0x7f7b98105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.768+0000 7f7b9f4b3700 1 --2- 172.21.15.92:0/3773028159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b980695b0 0x7f7b98105b80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009990 tx=0x7f7b94009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.768+0000 7f7b9f4b3700 1 -- 172.21.15.92:0/3773028159 shutdown_connections 2023-10-16T13:12:12.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.768+0000 7f7b9f4b3700 1 --2- 172.21.15.92:0/3773028159 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b981062b0 0x7f7b9810de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.768+0000 7f7b9f4b3700 1 --2- 172.21.15.92:0/3773028159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b98068c00 0x7f7b98068fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.768+0000 7f7b9f4b3700 1 --2- 172.21.15.92:0/3773028159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b980695b0 0x7f7b98105b80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.768+0000 7f7b9f4b3700 1 -- 172.21.15.92:0/3773028159 >> 172.21.15.92:0/3773028159 conn(0x7f7b98075e00 msgr2=0x7f7b98076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:12.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.768+0000 7f7b9f4b3700 1 -- 172.21.15.92:0/3773028159 shutdown_connections 2023-10-16T13:12:12.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.768+0000 7f7b9f4b3700 1 -- 172.21.15.92:0/3773028159 wait complete. 2023-10-16T13:12:12.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b9f4b3700 1 Processor -- start 2023-10-16T13:12:12.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b9f4b3700 1 -- start start 2023-10-16T13:12:12.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b9f4b3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b98068c00 0x7f7b980fff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b9f4b3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b980695b0 0x7f7b98100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b9f4b3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b981062b0 0x7f7b981009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b9f4b3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b981a5550 con 0x7f7b981062b0 2023-10-16T13:12:12.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b9f4b3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b981a56c0 con 0x7f7b980695b0 2023-10-16T13:12:12.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b9f4b3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b981a5880 con 0x7f7b98068c00 2023-10-16T13:12:12.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b9da50700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b981062b0 0x7f7b981009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b9da50700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b981062b0 0x7f7b981009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35658/0 (socket says 172.21.15.92:35658) 2023-10-16T13:12:12.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b9da50700 1 -- 172.21.15.92:0/3002285711 learned_addr learned my addr 172.21.15.92:0/3002285711 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:12.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b9d24f700 1 --2- 172.21.15.92:0/3002285711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b98068c00 0x7f7b980fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b9ca4e700 1 --2- 172.21.15.92:0/3002285711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b980695b0 0x7f7b98100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b9da50700 1 -- 172.21.15.92:0/3002285711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b98068c00 msgr2=0x7f7b980fff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b9da50700 1 --2- 172.21.15.92:0/3002285711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b98068c00 0x7f7b980fff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b9da50700 1 -- 172.21.15.92:0/3002285711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b980695b0 msgr2=0x7f7b98100470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b9da50700 1 --2- 172.21.15.92:0/3002285711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b980695b0 0x7f7b98100470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b9da50700 1 -- 172.21.15.92:0/3002285711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b940095f0 con 0x7f7b981062b0 2023-10-16T13:12:12.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b9da50700 1 --2- 172.21.15.92:0/3002285711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b981062b0 0x7f7b981009f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7b90007ee0 tx=0x7f7b9000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:12.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.769+0000 7f7b8e7fc700 1 -- 172.21.15.92:0/3002285711 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b90017070 con 0x7f7b981062b0 2023-10-16T13:12:12.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.770+0000 7f7b8e7fc700 1 -- 172.21.15.92:0/3002285711 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7b9000f040 con 0x7f7b981062b0 2023-10-16T13:12:12.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.770+0000 7f7b9f4b3700 1 -- 172.21.15.92:0/3002285711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b981a5b60 con 0x7f7b981062b0 2023-10-16T13:12:12.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.770+0000 7f7b8e7fc700 1 -- 172.21.15.92:0/3002285711 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b90005610 con 0x7f7b981062b0 2023-10-16T13:12:12.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.770+0000 7f7b9f4b3700 1 -- 172.21.15.92:0/3002285711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b981a6030 con 0x7f7b981062b0 2023-10-16T13:12:12.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.770+0000 7f7b9f4b3700 1 -- 172.21.15.92:0/3002285711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b98111230 con 0x7f7b981062b0 2023-10-16T13:12:12.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.182+0000 7f149aa8f700 1 -- 172.21.15.92:0/1352350842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14940695b0 msgr2=0x7f1494105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.182+0000 7f149aa8f700 1 --2- 172.21.15.92:0/1352350842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14940695b0 0x7f1494105b80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1480009990 tx=0x7f1480009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.182+0000 7f149aa8f700 1 -- 172.21.15.92:0/1352350842 shutdown_connections 2023-10-16T13:12:12.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.182+0000 7f149aa8f700 1 --2- 172.21.15.92:0/1352350842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14941062b0 0x7f149410de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.182+0000 7f149aa8f700 1 --2- 172.21.15.92:0/1352350842 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1494068c00 0x7f1494068fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.182+0000 7f149aa8f700 1 --2- 172.21.15.92:0/1352350842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14940695b0 0x7f1494105b80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.182+0000 7f149aa8f700 1 -- 172.21.15.92:0/1352350842 >> 172.21.15.92:0/1352350842 conn(0x7f1494075e00 msgr2=0x7f1494076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:12.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.182+0000 7f149aa8f700 1 -- 172.21.15.92:0/1352350842 shutdown_connections 2023-10-16T13:12:12.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.182+0000 7f149aa8f700 1 -- 172.21.15.92:0/1352350842 wait complete. 2023-10-16T13:12:12.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.182+0000 7f149aa8f700 1 Processor -- start 2023-10-16T13:12:12.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.183+0000 7f149aa8f700 1 -- start start 2023-10-16T13:12:12.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.183+0000 7f149aa8f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1494068c00 0x7f14941970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.183+0000 7f149aa8f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14940695b0 0x7f1494197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.183+0000 7f149aa8f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14941062b0 0x7f149419ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.183+0000 7f149aa8f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149419c0a0 con 0x7f1494068c00 2023-10-16T13:12:12.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.183+0000 7f149aa8f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149419c210 con 0x7f14941062b0 2023-10-16T13:12:12.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.183+0000 7f149aa8f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149419c3d0 con 0x7f14940695b0 2023-10-16T13:12:12.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.183+0000 7f149882b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1494068c00 0x7f14941970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.183+0000 7f149882b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1494068c00 0x7f14941970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35622/0 (socket says 172.21.15.92:35622) 2023-10-16T13:12:12.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.183+0000 7f149882b700 1 -- 172.21.15.92:0/2912105167 learned_addr learned my addr 172.21.15.92:0/2912105167 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:12.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.183+0000 7f1493fff700 1 --2- 172.21.15.92:0/2912105167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14940695b0 0x7f1494197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.183+0000 7f149902c700 1 --2- 172.21.15.92:0/2912105167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14941062b0 0x7f149419ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.183+0000 7f149882b700 1 -- 172.21.15.92:0/2912105167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14940695b0 msgr2=0x7f1494197620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.183+0000 7f149882b700 1 --2- 172.21.15.92:0/2912105167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14940695b0 0x7f1494197620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.183+0000 7f149882b700 1 -- 172.21.15.92:0/2912105167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14941062b0 msgr2=0x7f149419ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.183+0000 7f149882b700 1 --2- 172.21.15.92:0/2912105167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14941062b0 0x7f149419ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.183+0000 7f149882b700 1 -- 172.21.15.92:0/2912105167 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14800095f0 con 0x7f1494068c00 2023-10-16T13:12:12.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.183+0000 7f1493fff700 1 --2- 172.21.15.92:0/2912105167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14940695b0 0x7f1494197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:12:12.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.183+0000 7f149882b700 1 --2- 172.21.15.92:0/2912105167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1494068c00 0x7f14941970e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f148800e9a0 tx=0x7f148800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:12.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.184+0000 7f1491ffb700 1 -- 172.21.15.92:0/2912105167 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488009790 con 0x7f1494068c00 2023-10-16T13:12:12.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.184+0000 7f1491ffb700 1 -- 172.21.15.92:0/2912105167 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f148800cbd0 con 0x7f1494068c00 2023-10-16T13:12:12.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.184+0000 7f149aa8f700 1 -- 172.21.15.92:0/2912105167 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149419c6b0 con 0x7f1494068c00 2023-10-16T13:12:12.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.184+0000 7f1491ffb700 1 -- 172.21.15.92:0/2912105167 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488018730 con 0x7f1494068c00 2023-10-16T13:12:12.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.184+0000 7f149aa8f700 1 -- 172.21.15.92:0/2912105167 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14941a3f10 con 0x7f1494068c00 2023-10-16T13:12:12.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.185+0000 7f149aa8f700 1 -- 172.21.15.92:0/2912105167 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1494111270 con 0x7f1494068c00 2023-10-16T13:12:12.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.186+0000 7f1491ffb700 1 -- 172.21.15.92:0/2912105167 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f1488010430 con 0x7f1494068c00 2023-10-16T13:12:12.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.187+0000 7f1491ffb700 1 --2- 172.21.15.92:0/2912105167 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f14840a1510 0x7f14840a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.187+0000 7f1493fff700 1 --2- 172.21.15.92:0/2912105167 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f14840a1510 0x7f14840a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.187+0000 7f1491ffb700 1 -- 172.21.15.92:0/2912105167 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1488014070 con 0x7f1494068c00 2023-10-16T13:12:12.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.187+0000 7f1491ffb700 1 --2- 172.21.15.92:0/2912105167 >> [v2:172.21.15.152:6800/304464027,v1:172.21.15.152:6801/304464027] conn(0x7f14840aacf0 0x7f14840ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.187+0000 7f1491ffb700 1 -- 172.21.15.92:0/2912105167 --> [v2:172.21.15.152:6800/304464027,v1:172.21.15.152:6801/304464027] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14840ad7c0 con 0x7f14840aacf0 2023-10-16T13:12:12.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.187+0000 7f1491ffb700 1 -- 172.21.15.92:0/2912105167 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14880cda80 con 0x7f1494068c00 2023-10-16T13:12:12.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.187+0000 7f1493fff700 1 --2- 172.21.15.92:0/2912105167 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f14840a1510 0x7f14840a39d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1480006010 tx=0x7f1480005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:12.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.187+0000 7f149902c700 1 --2- 172.21.15.92:0/2912105167 >> [v2:172.21.15.152:6800/304464027,v1:172.21.15.152:6801/304464027] conn(0x7f14840aacf0 0x7f14840ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.188+0000 7f149902c700 1 --2- 172.21.15.92:0/2912105167 >> [v2:172.21.15.152:6800/304464027,v1:172.21.15.152:6801/304464027] conn(0x7f14840aacf0 0x7f14840ad110 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:12.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.188+0000 7f1491ffb700 1 -- 172.21.15.92:0/2912105167 <== osd.2 v2:172.21.15.152:6800/304464027 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f14840ad7c0 con 0x7f14840aacf0 2023-10-16T13:12:12.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.214+0000 7f149aa8f700 1 -- 172.21.15.92:0/2912105167 --> [v2:172.21.15.152:6800/304464027,v1:172.21.15.152:6801/304464027] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f149404ebb0 con 0x7f14840aacf0 2023-10-16T13:12:12.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.215+0000 7f1491ffb700 1 -- 172.21.15.92:0/2912105167 <== osd.2 v2:172.21.15.152:6800/304464027 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f149404ebb0 con 0x7f14840aacf0 2023-10-16T13:12:12.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.215+0000 7f149aa8f700 1 -- 172.21.15.92:0/2912105167 >> [v2:172.21.15.152:6800/304464027,v1:172.21.15.152:6801/304464027] conn(0x7f14840aacf0 msgr2=0x7f14840ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.216+0000 7f149aa8f700 1 --2- 172.21.15.92:0/2912105167 >> [v2:172.21.15.152:6800/304464027,v1:172.21.15.152:6801/304464027] conn(0x7f14840aacf0 0x7f14840ad110 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.216+0000 7f149aa8f700 1 -- 172.21.15.92:0/2912105167 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f14840a1510 msgr2=0x7f14840a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.216+0000 7f149aa8f700 1 --2- 172.21.15.92:0/2912105167 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f14840a1510 0x7f14840a39d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1480006010 tx=0x7f1480005e80 comp rx=0 tx=0).stop 2023-10-16T13:12:12.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.216+0000 7f149aa8f700 1 -- 172.21.15.92:0/2912105167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1494068c00 msgr2=0x7f14941970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.216+0000 7f149aa8f700 1 --2- 172.21.15.92:0/2912105167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1494068c00 0x7f14941970e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f148800e9a0 tx=0x7f148800ed60 comp rx=0 tx=0).stop 2023-10-16T13:12:12.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.216+0000 7f149902c700 1 -- 172.21.15.92:0/2912105167 reap_dead start 2023-10-16T13:12:12.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.216+0000 7f149aa8f700 1 -- 172.21.15.92:0/2912105167 shutdown_connections 2023-10-16T13:12:12.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.216+0000 7f149aa8f700 1 -- 172.21.15.92:0/2912105167 >> 172.21.15.92:0/2912105167 conn(0x7f1494075e00 msgr2=0x7f14940fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:12.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.216+0000 7f149aa8f700 1 -- 172.21.15.92:0/2912105167 shutdown_connections 2023-10-16T13:12:12.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.216+0000 7f149aa8f700 1 -- 172.21.15.92:0/2912105167 wait complete. 2023-10-16T13:12:12.791 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:12 smithi118 ceph-mon[103969]: pgmap v271: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 853 B/s wr, 12 op/s 2023-10-16T13:12:12.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.772+0000 7f7b8e7fc700 1 -- 172.21.15.92:0/3002285711 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f7b90005770 con 0x7f7b981062b0 2023-10-16T13:12:12.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.772+0000 7f7b8e7fc700 1 --2- 172.21.15.92:0/3002285711 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7b840a1510 0x7f7b840a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.772+0000 7f7b9d24f700 1 --2- 172.21.15.92:0/3002285711 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7b840a1510 0x7f7b840a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.772+0000 7f7b8e7fc700 1 -- 172.21.15.92:0/3002285711 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7b900cca30 con 0x7f7b981062b0 2023-10-16T13:12:12.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.772+0000 7f7b8e7fc700 1 --2- 172.21.15.92:0/3002285711 >> [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271] conn(0x7f7b840aacf0 0x7f7b840ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:12.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.773+0000 7f7b8e7fc700 1 -- 172.21.15.92:0/3002285711 --> [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b840ad7c0 con 0x7f7b840aacf0 2023-10-16T13:12:12.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.773+0000 7f7b8e7fc700 1 -- 172.21.15.92:0/3002285711 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b900cced0 con 0x7f7b981062b0 2023-10-16T13:12:12.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.773+0000 7f7b9ca4e700 1 --2- 172.21.15.92:0/3002285711 >> [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271] conn(0x7f7b840aacf0 0x7f7b840ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:12.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.773+0000 7f7b9d24f700 1 --2- 172.21.15.92:0/3002285711 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7b840a1510 0x7f7b840a39d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7b88005950 tx=0x7f7b8800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:12.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.773+0000 7f7b9ca4e700 1 --2- 172.21.15.92:0/3002285711 >> [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271] conn(0x7f7b840aacf0 0x7f7b840ad110 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:12.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.774+0000 7f7b8e7fc700 1 -- 172.21.15.92:0/3002285711 <== osd.9 v2:172.21.15.92:6826/3153036271 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f7b840ad7c0 con 0x7f7b840aacf0 2023-10-16T13:12:12.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.791+0000 7f7b9f4b3700 1 -- 172.21.15.92:0/3002285711 --> [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7b9804ebb0 con 0x7f7b840aacf0 2023-10-16T13:12:12.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.791+0000 7f7b8e7fc700 1 -- 172.21.15.92:0/3002285711 <== osd.9 v2:172.21.15.92:6826/3153036271 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7b9804ebb0 con 0x7f7b840aacf0 2023-10-16T13:12:12.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.791+0000 7f7b9f4b3700 1 -- 172.21.15.92:0/3002285711 >> [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271] conn(0x7f7b840aacf0 msgr2=0x7f7b840ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.791+0000 7f7b9f4b3700 1 --2- 172.21.15.92:0/3002285711 >> [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271] conn(0x7f7b840aacf0 0x7f7b840ad110 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.791+0000 7f7b9f4b3700 1 -- 172.21.15.92:0/3002285711 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7b840a1510 msgr2=0x7f7b840a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.791+0000 7f7b9f4b3700 1 --2- 172.21.15.92:0/3002285711 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7b840a1510 0x7f7b840a39d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7b88005950 tx=0x7f7b8800a300 comp rx=0 tx=0).stop 2023-10-16T13:12:12.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.791+0000 7f7b9f4b3700 1 -- 172.21.15.92:0/3002285711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b981062b0 msgr2=0x7f7b981009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:12.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.791+0000 7f7b9f4b3700 1 --2- 172.21.15.92:0/3002285711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b981062b0 0x7f7b981009f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7b90007ee0 tx=0x7f7b9000d3b0 comp rx=0 tx=0).stop 2023-10-16T13:12:12.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.791+0000 7f7b9da50700 1 -- 172.21.15.92:0/3002285711 reap_dead start 2023-10-16T13:12:12.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.792+0000 7f7b9f4b3700 1 -- 172.21.15.92:0/3002285711 shutdown_connections 2023-10-16T13:12:12.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.792+0000 7f7b9f4b3700 1 -- 172.21.15.92:0/3002285711 >> 172.21.15.92:0/3002285711 conn(0x7f7b98075e00 msgr2=0x7f7b980fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:12.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.792+0000 7f7b9f4b3700 1 -- 172.21.15.92:0/3002285711 shutdown_connections 2023-10-16T13:12:12.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:12.792+0000 7f7b9f4b3700 1 -- 172.21.15.92:0/3002285711 wait complete. 2023-10-16T13:12:13.359 INFO:teuthology.orchestra.run.smithi092.stdout:163208757292 2023-10-16T13:12:13.359 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.5 2023-10-16T13:12:13.744 INFO:teuthology.orchestra.run.smithi092.stdout:77309411385 2023-10-16T13:12:13.745 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.2 2023-10-16T13:12:13.799 INFO:teuthology.orchestra.run.smithi092.stdout:283467841563 2023-10-16T13:12:13.800 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.9 2023-10-16T13:12:14.117 INFO:teuthology.orchestra.run.smithi092.stdout:219043332131 2023-10-16T13:12:14.117 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.7 2023-10-16T13:12:14.455 INFO:teuthology.orchestra.run.smithi092.stdout:141733920815 2023-10-16T13:12:14.455 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.4 2023-10-16T13:12:14.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:14 smithi092 ceph-mon[99542]: pgmap v272: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-16T13:12:14.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.152+0000 7f3039f16700 1 -- 172.21.15.92:0/44972235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3034069270 msgr2=0x7f30340696d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:14.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.152+0000 7f3039f16700 1 --2- 172.21.15.92:0/44972235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3034069270 0x7f30340696d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3028009990 tx=0x7f3028009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:14.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.153+0000 7f3039f16700 1 -- 172.21.15.92:0/44972235 shutdown_connections 2023-10-16T13:12:14.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.153+0000 7f3039f16700 1 --2- 172.21.15.92:0/44972235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3034069c10 0x7f303410ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:14.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.153+0000 7f3039f16700 1 --2- 172.21.15.92:0/44972235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3034106f80 0x7f3034107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:14.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.153+0000 7f3039f16700 1 --2- 172.21.15.92:0/44972235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3034069270 0x7f30340696d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:14.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.153+0000 7f3039f16700 1 -- 172.21.15.92:0/44972235 >> 172.21.15.92:0/44972235 conn(0x7f3034076dc0 msgr2=0x7f30340771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:14.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.153+0000 7f3039f16700 1 -- 172.21.15.92:0/44972235 shutdown_connections 2023-10-16T13:12:14.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.153+0000 7f3039f16700 1 -- 172.21.15.92:0/44972235 wait complete. 2023-10-16T13:12:14.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.153+0000 7f3039f16700 1 Processor -- start 2023-10-16T13:12:14.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.153+0000 7f3039f16700 1 -- start start 2023-10-16T13:12:14.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3039f16700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3034069270 0x7f3034197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:14.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3039f16700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3034069c10 0x7f3034197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:14.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3039f16700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3034106f80 0x7f303419bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:14.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3039f16700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303419c0f0 con 0x7f3034106f80 2023-10-16T13:12:14.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3039f16700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303419c260 con 0x7f3034069c10 2023-10-16T13:12:14.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3039f16700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303419c420 con 0x7f3034069270 2023-10-16T13:12:14.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3033fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3034106f80 0x7f303419bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:14.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3033fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3034106f80 0x7f303419bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35672/0 (socket says 172.21.15.92:35672) 2023-10-16T13:12:14.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3033fff700 1 -- 172.21.15.92:0/3303970693 learned_addr learned my addr 172.21.15.92:0/3303970693 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:14.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3032ffd700 1 --2- 172.21.15.92:0/3303970693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3034069c10 0x7f3034197670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:14.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f30337fe700 1 --2- 172.21.15.92:0/3303970693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3034069270 0x7f3034197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:14.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3033fff700 1 -- 172.21.15.92:0/3303970693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3034069270 msgr2=0x7f3034197130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:14.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3033fff700 1 --2- 172.21.15.92:0/3303970693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3034069270 0x7f3034197130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:14.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3033fff700 1 -- 172.21.15.92:0/3303970693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3034069c10 msgr2=0x7f3034197670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:14.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3033fff700 1 --2- 172.21.15.92:0/3303970693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3034069c10 0x7f3034197670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:14.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3033fff700 1 -- 172.21.15.92:0/3303970693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30280095f0 con 0x7f3034106f80 2023-10-16T13:12:14.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f30337fe700 1 --2- 172.21.15.92:0/3303970693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3034069270 0x7f3034197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:12:14.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3032ffd700 1 --2- 172.21.15.92:0/3303970693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3034069c10 0x7f3034197670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:12:14.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3033fff700 1 --2- 172.21.15.92:0/3303970693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3034106f80 0x7f303419bae0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f302c00ada0 tx=0x7f302c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:14.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3030ff9700 1 -- 172.21.15.92:0/3303970693 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c00f070 con 0x7f3034106f80 2023-10-16T13:12:14.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3030ff9700 1 -- 172.21.15.92:0/3303970693 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f302c007b30 con 0x7f3034106f80 2023-10-16T13:12:14.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3039f16700 1 -- 172.21.15.92:0/3303970693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303419c700 con 0x7f3034106f80 2023-10-16T13:12:14.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3030ff9700 1 -- 172.21.15.92:0/3303970693 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c0054a0 con 0x7f3034106f80 2023-10-16T13:12:14.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.154+0000 7f3039f16700 1 -- 172.21.15.92:0/3303970693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30341a3f60 con 0x7f3034106f80 2023-10-16T13:12:14.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.155+0000 7f3039f16700 1 -- 172.21.15.92:0/3303970693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f30341111c0 con 0x7f3034106f80 2023-10-16T13:12:14.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.156+0000 7f3030ff9700 1 -- 172.21.15.92:0/3303970693 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f302c004ad0 con 0x7f3034106f80 2023-10-16T13:12:14.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.157+0000 7f3030ff9700 1 --2- 172.21.15.92:0/3303970693 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f301c0a1510 0x7f301c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:14.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.157+0000 7f30337fe700 1 --2- 172.21.15.92:0/3303970693 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f301c0a1510 0x7f301c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:14.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.157+0000 7f3030ff9700 1 -- 172.21.15.92:0/3303970693 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f302c0ccd90 con 0x7f3034106f80 2023-10-16T13:12:14.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.157+0000 7f3030ff9700 1 --2- 172.21.15.92:0/3303970693 >> [v2:172.21.15.152:6816/3968044260,v1:172.21.15.152:6817/3968044260] conn(0x7f301c0aacf0 0x7f301c0ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:14.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.157+0000 7f3030ff9700 1 -- 172.21.15.92:0/3303970693 --> [v2:172.21.15.152:6816/3968044260,v1:172.21.15.152:6817/3968044260] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f301c0ad7c0 con 0x7f301c0aacf0 2023-10-16T13:12:14.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.157+0000 7f3030ff9700 1 -- 172.21.15.92:0/3303970693 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f302c0cd230 con 0x7f3034106f80 2023-10-16T13:12:14.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.157+0000 7f30337fe700 1 --2- 172.21.15.92:0/3303970693 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f301c0a1510 0x7f301c0a39d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3024005fd0 tx=0x7f3024005d40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:14.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.158+0000 7f3032ffd700 1 --2- 172.21.15.92:0/3303970693 >> [v2:172.21.15.152:6816/3968044260,v1:172.21.15.152:6817/3968044260] conn(0x7f301c0aacf0 0x7f301c0ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:14.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.158+0000 7f3032ffd700 1 --2- 172.21.15.92:0/3303970693 >> [v2:172.21.15.152:6816/3968044260,v1:172.21.15.152:6817/3968044260] conn(0x7f301c0aacf0 0x7f301c0ad110 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:14.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.159+0000 7f3030ff9700 1 -- 172.21.15.92:0/3303970693 <== osd.8 v2:172.21.15.152:6816/3968044260 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f301c0ad7c0 con 0x7f301c0aacf0 2023-10-16T13:12:14.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.190+0000 7f3039f16700 1 -- 172.21.15.92:0/3303970693 --> [v2:172.21.15.152:6816/3968044260,v1:172.21.15.152:6817/3968044260] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f303404ebb0 con 0x7f301c0aacf0 2023-10-16T13:12:14.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.191+0000 7f3030ff9700 1 -- 172.21.15.92:0/3303970693 <== osd.8 v2:172.21.15.152:6816/3968044260 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f303404ebb0 con 0x7f301c0aacf0 2023-10-16T13:12:14.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.191+0000 7f3039f16700 1 -- 172.21.15.92:0/3303970693 >> [v2:172.21.15.152:6816/3968044260,v1:172.21.15.152:6817/3968044260] conn(0x7f301c0aacf0 msgr2=0x7f301c0ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:14.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.191+0000 7f3039f16700 1 --2- 172.21.15.92:0/3303970693 >> [v2:172.21.15.152:6816/3968044260,v1:172.21.15.152:6817/3968044260] conn(0x7f301c0aacf0 0x7f301c0ad110 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:14.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.191+0000 7f3039f16700 1 -- 172.21.15.92:0/3303970693 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f301c0a1510 msgr2=0x7f301c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:14.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.191+0000 7f3039f16700 1 --2- 172.21.15.92:0/3303970693 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f301c0a1510 0x7f301c0a39d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3024005fd0 tx=0x7f3024005d40 comp rx=0 tx=0).stop 2023-10-16T13:12:14.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.192+0000 7f3039f16700 1 -- 172.21.15.92:0/3303970693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3034106f80 msgr2=0x7f303419bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:14.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.192+0000 7f3039f16700 1 --2- 172.21.15.92:0/3303970693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3034106f80 0x7f303419bae0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f302c00ada0 tx=0x7f302c00c330 comp rx=0 tx=0).stop 2023-10-16T13:12:14.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.192+0000 7f3033fff700 1 -- 172.21.15.92:0/3303970693 reap_dead start 2023-10-16T13:12:14.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.192+0000 7f3039f16700 1 -- 172.21.15.92:0/3303970693 shutdown_connections 2023-10-16T13:12:14.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.192+0000 7f3039f16700 1 -- 172.21.15.92:0/3303970693 >> 172.21.15.92:0/3303970693 conn(0x7f3034076dc0 msgr2=0x7f30340fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:14.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.192+0000 7f3039f16700 1 -- 172.21.15.92:0/3303970693 shutdown_connections 2023-10-16T13:12:14.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:14.192+0000 7f3039f16700 1 -- 172.21.15.92:0/3303970693 wait complete. 2023-10-16T13:12:14.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:14 smithi152 ceph-mon[104423]: pgmap v272: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-16T13:12:14.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:14 smithi118 ceph-mon[103969]: pgmap v272: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-16T13:12:14.965 INFO:teuthology.orchestra.run.smithi092.stdout:253403070495 2023-10-16T13:12:14.966 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.8 2023-10-16T13:12:15.082 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:15.105 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:15.303 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:15.556 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:15.790 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:16.268 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:16.620 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:16.626 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:16 smithi092 ceph-mon[99542]: pgmap v273: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-16T13:12:16.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:16 smithi152 ceph-mon[104423]: pgmap v273: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-16T13:12:16.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:16 smithi118 ceph-mon[103969]: pgmap v273: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-16T13:12:18.396 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:18.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:18 smithi152 ceph-mon[104423]: pgmap v274: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2023-10-16T13:12:18.694 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:18.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.731+0000 7f4df675e700 1 -- 172.21.15.92:0/4124194647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4df0100ee0 msgr2=0x7f4df010ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:18.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.731+0000 7f4df675e700 1 --2- 172.21.15.92:0/4124194647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4df0100ee0 0x7f4df010ccd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4de800b0d0 tx=0x7f4de800b3e0 comp rx=0 tx=0).stop 2023-10-16T13:12:18.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.731+0000 7f4df675e700 1 -- 172.21.15.92:0/4124194647 shutdown_connections 2023-10-16T13:12:18.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.731+0000 7f4df675e700 1 --2- 172.21.15.92:0/4124194647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4df0100ee0 0x7f4df010ccd0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:18.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.731+0000 7f4df675e700 1 --2- 172.21.15.92:0/4124194647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4df0104e30 0x7f4df0105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:18.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.731+0000 7f4df675e700 1 --2- 172.21.15.92:0/4124194647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4df0100520 0x7f4df01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:18.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.731+0000 7f4df675e700 1 -- 172.21.15.92:0/4124194647 >> 172.21.15.92:0/4124194647 conn(0x7f4df0076360 msgr2=0x7f4df00fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:18.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.731+0000 7f4df675e700 1 -- 172.21.15.92:0/4124194647 shutdown_connections 2023-10-16T13:12:18.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.731+0000 7f4df675e700 1 -- 172.21.15.92:0/4124194647 wait complete. 2023-10-16T13:12:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.731+0000 7f4df675e700 1 Processor -- start 2023-10-16T13:12:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.732+0000 7f4df675e700 1 -- start start 2023-10-16T13:12:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.732+0000 7f4df675e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4df0100520 0x7f4df0197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.732+0000 7f4df675e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4df0100ee0 0x7f4df0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.732+0000 7f4df675e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4df0104e30 0x7f4df01a2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.732+0000 7f4df675e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df01a3510 con 0x7f4df0100520 2023-10-16T13:12:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.732+0000 7f4df675e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df01a3650 con 0x7f4df0100ee0 2023-10-16T13:12:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.732+0000 7f4df675e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df01a3790 con 0x7f4df0104e30 2023-10-16T13:12:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.732+0000 7f4deffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4df0100520 0x7f4df0197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.732+0000 7f4deffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4df0100520 0x7f4df0197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35684/0 (socket says 172.21.15.92:35684) 2023-10-16T13:12:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.732+0000 7f4deffff700 1 -- 172.21.15.92:0/3811032641 learned_addr learned my addr 172.21.15.92:0/3811032641 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.732+0000 7f4df4cfb700 1 --2- 172.21.15.92:0/3811032641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4df0104e30 0x7f4df01a2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.732+0000 7f4def7fe700 1 --2- 172.21.15.92:0/3811032641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4df0100ee0 0x7f4df0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.732+0000 7f4deffff700 1 -- 172.21.15.92:0/3811032641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4df0104e30 msgr2=0x7f4df01a2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.732+0000 7f4deffff700 1 --2- 172.21.15.92:0/3811032641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4df0104e30 0x7f4df01a2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.732+0000 7f4deffff700 1 -- 172.21.15.92:0/3811032641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4df0100ee0 msgr2=0x7f4df0198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.732+0000 7f4deffff700 1 --2- 172.21.15.92:0/3811032641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4df0100ee0 0x7f4df0198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.732+0000 7f4deffff700 1 -- 172.21.15.92:0/3811032641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de8009d00 con 0x7f4df0100520 2023-10-16T13:12:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.732+0000 7f4def7fe700 1 --2- 172.21.15.92:0/3811032641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4df0100ee0 0x7f4df0198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:12:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.732+0000 7f4deffff700 1 --2- 172.21.15.92:0/3811032641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4df0100520 0x7f4df0197f50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800d950 tx=0x7f4dd800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.733+0000 7f4ded7fa700 1 -- 172.21.15.92:0/3811032641 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8009b40 con 0x7f4df0100520 2023-10-16T13:12:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.733+0000 7f4df675e700 1 -- 172.21.15.92:0/3811032641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df01a39f0 con 0x7f4df0100520 2023-10-16T13:12:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.733+0000 7f4ded7fa700 1 -- 172.21.15.92:0/3811032641 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4dd8009ca0 con 0x7f4df0100520 2023-10-16T13:12:18.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.733+0000 7f4ded7fa700 1 -- 172.21.15.92:0/3811032641 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd800f6b0 con 0x7f4df0100520 2023-10-16T13:12:18.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.733+0000 7f4df675e700 1 -- 172.21.15.92:0/3811032641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df01a3ec0 con 0x7f4df0100520 2023-10-16T13:12:18.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.734+0000 7f4df675e700 1 -- 172.21.15.92:0/3811032641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df004ebb0 con 0x7f4df0100520 2023-10-16T13:12:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.735+0000 7f4ded7fa700 1 -- 172.21.15.92:0/3811032641 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f4dd8010460 con 0x7f4df0100520 2023-10-16T13:12:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.736+0000 7f4ded7fa700 1 --2- 172.21.15.92:0/3811032641 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4ddc0a1510 0x7f4ddc0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.736+0000 7f4def7fe700 1 --2- 172.21.15.92:0/3811032641 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4ddc0a1510 0x7f4ddc0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:18.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.736+0000 7f4ded7fa700 1 -- 172.21.15.92:0/3811032641 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4dd80ccfe0 con 0x7f4df0100520 2023-10-16T13:12:18.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.736+0000 7f4def7fe700 1 --2- 172.21.15.92:0/3811032641 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4ddc0a1510 0x7f4ddc0a39d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4df01004f0 tx=0x7f4de0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:18.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.740+0000 7f4ded7fa700 1 -- 172.21.15.92:0/3811032641 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4dd8096690 con 0x7f4df0100520 2023-10-16T13:12:18.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:18 smithi092 ceph-mon[99542]: pgmap v274: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2023-10-16T13:12:18.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:18 smithi118 ceph-mon[103969]: pgmap v274: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2023-10-16T13:12:18.952 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:18.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.958+0000 7f4df675e700 1 -- 172.21.15.92:0/3811032641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4df00ffa60 con 0x7f4df0100520 2023-10-16T13:12:18.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.958+0000 7f4ded7fa700 1 -- 172.21.15.92:0/3811032641 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4dd8020020 con 0x7f4df0100520 2023-10-16T13:12:18.961 INFO:teuthology.orchestra.run.smithi092.stdout:197568495657 2023-10-16T13:12:18.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.961+0000 7f4df675e700 1 -- 172.21.15.92:0/3811032641 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4ddc0a1510 msgr2=0x7f4ddc0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:18.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.961+0000 7f4df675e700 1 --2- 172.21.15.92:0/3811032641 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4ddc0a1510 0x7f4ddc0a39d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4df01004f0 tx=0x7f4de0009260 comp rx=0 tx=0).stop 2023-10-16T13:12:18.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.961+0000 7f4df675e700 1 -- 172.21.15.92:0/3811032641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4df0100520 msgr2=0x7f4df0197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:18.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.961+0000 7f4df675e700 1 --2- 172.21.15.92:0/3811032641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4df0100520 0x7f4df0197f50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800d950 tx=0x7f4dd800dd10 comp rx=0 tx=0).stop 2023-10-16T13:12:18.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.961+0000 7f4df675e700 1 -- 172.21.15.92:0/3811032641 shutdown_connections 2023-10-16T13:12:18.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.961+0000 7f4df675e700 1 --2- 172.21.15.92:0/3811032641 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4ddc0a1510 0x7f4ddc0a39d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:18.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.961+0000 7f4df675e700 1 --2- 172.21.15.92:0/3811032641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4df0100520 0x7f4df0197f50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:18.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.961+0000 7f4df675e700 1 --2- 172.21.15.92:0/3811032641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4df0104e30 0x7f4df01a2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:18.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.961+0000 7f4df675e700 1 --2- 172.21.15.92:0/3811032641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4df0100ee0 0x7f4df0198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:18.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.961+0000 7f4df675e700 1 -- 172.21.15.92:0/3811032641 >> 172.21.15.92:0/3811032641 conn(0x7f4df0076360 msgr2=0x7f4df0102c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:18.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.961+0000 7f4df675e700 1 -- 172.21.15.92:0/3811032641 shutdown_connections 2023-10-16T13:12:18.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:18.961+0000 7f4df675e700 1 -- 172.21.15.92:0/3811032641 wait complete. 2023-10-16T13:12:19.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.277+0000 7f5c8ace6700 1 -- 172.21.15.92:0/4144724057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c84105e70 msgr2=0x7f5c84106250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:19.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.277+0000 7f5c8ace6700 1 --2- 172.21.15.92:0/4144724057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c84105e70 0x7f5c84106250 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c00b0d0 tx=0x7f5c7c00b3e0 comp rx=0 tx=0).stop 2023-10-16T13:12:19.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.277+0000 7f5c8ace6700 1 -- 172.21.15.92:0/4144724057 shutdown_connections 2023-10-16T13:12:19.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.277+0000 7f5c8ace6700 1 --2- 172.21.15.92:0/4144724057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c84105e70 0x7f5c84106250 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:19.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.277+0000 7f5c8ace6700 1 --2- 172.21.15.92:0/4144724057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c84100820 0x7f5c8410cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:19.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.277+0000 7f5c8ace6700 1 --2- 172.21.15.92:0/4144724057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c840ffe60 0x7f5c841002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:19.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.277+0000 7f5c8ace6700 1 -- 172.21.15.92:0/4144724057 >> 172.21.15.92:0/4144724057 conn(0x7f5c84075e00 msgr2=0x7f5c84076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:19.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.277+0000 7f5c8ace6700 1 -- 172.21.15.92:0/4144724057 shutdown_connections 2023-10-16T13:12:19.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.277+0000 7f5c8ace6700 1 -- 172.21.15.92:0/4144724057 wait complete. 2023-10-16T13:12:19.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.278+0000 7f5c8ace6700 1 Processor -- start 2023-10-16T13:12:19.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.278+0000 7f5c8ace6700 1 -- start start 2023-10-16T13:12:19.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.278+0000 7f5c8ace6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c840ffe60 0x7f5c84197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:19.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.278+0000 7f5c8ace6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c84100820 0x7f5c84197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:19.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.278+0000 7f5c8ace6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c84105e70 0x7f5c8419bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:19.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.278+0000 7f5c8ace6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8419c1d0 con 0x7f5c84100820 2023-10-16T13:12:19.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.278+0000 7f5c8ace6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8419c340 con 0x7f5c84105e70 2023-10-16T13:12:19.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.278+0000 7f5c8ace6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8419c500 con 0x7f5c840ffe60 2023-10-16T13:12:19.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.278+0000 7f5c83fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c84100820 0x7f5c84197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:19.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.278+0000 7f5c83fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c84100820 0x7f5c84197750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35700/0 (socket says 172.21.15.92:35700) 2023-10-16T13:12:19.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.278+0000 7f5c83fff700 1 -- 172.21.15.92:0/1186654892 learned_addr learned my addr 172.21.15.92:0/1186654892 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:19.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.278+0000 7f5c88a82700 1 --2- 172.21.15.92:0/1186654892 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c840ffe60 0x7f5c84197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:19.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.278+0000 7f5c89283700 1 --2- 172.21.15.92:0/1186654892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c84105e70 0x7f5c8419bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:19.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.279+0000 7f5c83fff700 1 -- 172.21.15.92:0/1186654892 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c840ffe60 msgr2=0x7f5c84197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:19.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.279+0000 7f5c83fff700 1 --2- 172.21.15.92:0/1186654892 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c840ffe60 0x7f5c84197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:19.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.279+0000 7f5c83fff700 1 -- 172.21.15.92:0/1186654892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c84105e70 msgr2=0x7f5c8419bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:19.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.279+0000 7f5c83fff700 1 --2- 172.21.15.92:0/1186654892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c84105e70 0x7f5c8419bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:19.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.279+0000 7f5c83fff700 1 -- 172.21.15.92:0/1186654892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c009d00 con 0x7f5c84100820 2023-10-16T13:12:19.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.279+0000 7f5c83fff700 1 --2- 172.21.15.92:0/1186654892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c84100820 0x7f5c84197750 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c00d980 tx=0x7f5c6c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:19.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.279+0000 7f5c81ffb700 1 -- 172.21.15.92:0/1186654892 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c004a30 con 0x7f5c84100820 2023-10-16T13:12:19.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.279+0000 7f5c81ffb700 1 -- 172.21.15.92:0/1186654892 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5c6c005500 con 0x7f5c84100820 2023-10-16T13:12:19.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.279+0000 7f5c8ace6700 1 -- 172.21.15.92:0/1186654892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c8419c7e0 con 0x7f5c84100820 2023-10-16T13:12:19.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.279+0000 7f5c81ffb700 1 -- 172.21.15.92:0/1186654892 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c00fc80 con 0x7f5c84100820 2023-10-16T13:12:19.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.279+0000 7f5c8ace6700 1 -- 172.21.15.92:0/1186654892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c841a4040 con 0x7f5c84100820 2023-10-16T13:12:19.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.280+0000 7f5c8ace6700 1 -- 172.21.15.92:0/1186654892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c8404ebb0 con 0x7f5c84100820 2023-10-16T13:12:19.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.281+0000 7f5c81ffb700 1 -- 172.21.15.92:0/1186654892 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f5c6c004c90 con 0x7f5c84100820 2023-10-16T13:12:19.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.282+0000 7f5c81ffb700 1 --2- 172.21.15.92:0/1186654892 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5c700a1590 0x7f5c700a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:19.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.282+0000 7f5c88a82700 1 --2- 172.21.15.92:0/1186654892 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5c700a1590 0x7f5c700a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:19.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.282+0000 7f5c81ffb700 1 -- 172.21.15.92:0/1186654892 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5c6c0cca90 con 0x7f5c84100820 2023-10-16T13:12:19.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.282+0000 7f5c88a82700 1 --2- 172.21.15.92:0/1186654892 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5c700a1590 0x7f5c700a3a50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c009fd0 tx=0x7f5c7c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:19.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.286+0000 7f5c81ffb700 1 -- 172.21.15.92:0/1186654892 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5c6c096140 con 0x7f5c84100820 2023-10-16T13:12:19.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.486+0000 7f5c8ace6700 1 -- 172.21.15.92:0/1186654892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5c84110100 con 0x7f5c84100820 2023-10-16T13:12:19.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.487+0000 7f5c81ffb700 1 -- 172.21.15.92:0/1186654892 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5c6c017090 con 0x7f5c84100820 2023-10-16T13:12:19.489 INFO:teuthology.orchestra.run.smithi092.stdout:34359738434 2023-10-16T13:12:19.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.490+0000 7f5c8ace6700 1 -- 172.21.15.92:0/1186654892 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5c700a1590 msgr2=0x7f5c700a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:19.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.490+0000 7f5c8ace6700 1 --2- 172.21.15.92:0/1186654892 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5c700a1590 0x7f5c700a3a50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c009fd0 tx=0x7f5c7c00b040 comp rx=0 tx=0).stop 2023-10-16T13:12:19.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.490+0000 7f5c8ace6700 1 -- 172.21.15.92:0/1186654892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c84100820 msgr2=0x7f5c84197750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:19.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.490+0000 7f5c8ace6700 1 --2- 172.21.15.92:0/1186654892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c84100820 0x7f5c84197750 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c00d980 tx=0x7f5c6c00dc90 comp rx=0 tx=0).stop 2023-10-16T13:12:19.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.490+0000 7f5c8ace6700 1 -- 172.21.15.92:0/1186654892 shutdown_connections 2023-10-16T13:12:19.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.490+0000 7f5c8ace6700 1 --2- 172.21.15.92:0/1186654892 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5c700a1590 0x7f5c700a3a50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:19.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.490+0000 7f5c8ace6700 1 --2- 172.21.15.92:0/1186654892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c84105e70 0x7f5c8419bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:19.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.490+0000 7f5c8ace6700 1 --2- 172.21.15.92:0/1186654892 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c840ffe60 0x7f5c84197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:19.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.490+0000 7f5c8ace6700 1 --2- 172.21.15.92:0/1186654892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c84100820 0x7f5c84197750 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:19.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.490+0000 7f5c8ace6700 1 -- 172.21.15.92:0/1186654892 >> 172.21.15.92:0/1186654892 conn(0x7f5c84075e00 msgr2=0x7f5c84103d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:19.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.490+0000 7f5c8ace6700 1 -- 172.21.15.92:0/1186654892 shutdown_connections 2023-10-16T13:12:19.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:19.491+0000 7f5c8ace6700 1 -- 172.21.15.92:0/1186654892 wait complete. 2023-10-16T13:12:19.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:19 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3811032641' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-16T13:12:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:19 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3811032641' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-16T13:12:19.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:19 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3811032641' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-16T13:12:20.070 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:20.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:20 smithi152 ceph-mon[104423]: pgmap v275: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-16T13:12:20.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:20 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1186654892' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-16T13:12:20.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:20 smithi092 ceph-mon[99542]: pgmap v275: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-16T13:12:20.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:20 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1186654892' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-16T13:12:20.765 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495655 got 197568495657 for osd.6 2023-10-16T13:12:20.765 DEBUG:teuthology.parallel:result is None 2023-10-16T13:12:20.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:20 smithi118 ceph-mon[103969]: pgmap v275: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-16T13:12:20.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:20 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1186654892' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-16T13:12:21.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.745+0000 7f63bcba4700 1 -- 172.21.15.92:0/3586682931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63b80695b0 msgr2=0x7f63b8105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:21.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.745+0000 7f63bcba4700 1 --2- 172.21.15.92:0/3586682931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63b80695b0 0x7f63b8105b80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009990 tx=0x7f63ac009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:21.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.745+0000 7f63bcba4700 1 -- 172.21.15.92:0/3586682931 shutdown_connections 2023-10-16T13:12:21.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.745+0000 7f63bcba4700 1 --2- 172.21.15.92:0/3586682931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63b81062b0 0x7f63b810de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:21.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.745+0000 7f63bcba4700 1 --2- 172.21.15.92:0/3586682931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63b8068c00 0x7f63b8068fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:21.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.745+0000 7f63bcba4700 1 --2- 172.21.15.92:0/3586682931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63b80695b0 0x7f63b8105b80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:21.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.745+0000 7f63bcba4700 1 -- 172.21.15.92:0/3586682931 >> 172.21.15.92:0/3586682931 conn(0x7f63b8075e00 msgr2=0x7f63b8076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:21.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.745+0000 7f63bcba4700 1 -- 172.21.15.92:0/3586682931 shutdown_connections 2023-10-16T13:12:21.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.745+0000 7f63bcba4700 1 -- 172.21.15.92:0/3586682931 wait complete. 2023-10-16T13:12:21.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.746+0000 7f63bcba4700 1 Processor -- start 2023-10-16T13:12:21.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.746+0000 7f63bcba4700 1 -- start start 2023-10-16T13:12:21.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.746+0000 7f63bcba4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63b8068c00 0x7f63b8197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:21.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.746+0000 7f63bcba4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63b80695b0 0x7f63b81976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:21.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63bcba4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63b81062b0 0x7f63b819bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:21.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63bcba4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b819c130 con 0x7f63b81062b0 2023-10-16T13:12:21.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63bcba4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b819c2a0 con 0x7f63b8068c00 2023-10-16T13:12:21.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63bcba4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b819c460 con 0x7f63b80695b0 2023-10-16T13:12:21.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63b6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63b81062b0 0x7f63b819bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:21.242 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63b6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63b81062b0 0x7f63b819bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35716/0 (socket says 172.21.15.92:35716) 2023-10-16T13:12:21.242 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63b6d9d700 1 -- 172.21.15.92:0/2959280968 learned_addr learned my addr 172.21.15.92:0/2959280968 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:21.242 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63b5d9b700 1 --2- 172.21.15.92:0/2959280968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63b80695b0 0x7f63b81976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:21.242 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63b659c700 1 --2- 172.21.15.92:0/2959280968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63b8068c00 0x7f63b8197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:21.242 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63b6d9d700 1 -- 172.21.15.92:0/2959280968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63b80695b0 msgr2=0x7f63b81976b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:21.243 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63b6d9d700 1 --2- 172.21.15.92:0/2959280968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63b80695b0 0x7f63b81976b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:21.243 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63b6d9d700 1 -- 172.21.15.92:0/2959280968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63b8068c00 msgr2=0x7f63b8197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:21.243 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63b6d9d700 1 --2- 172.21.15.92:0/2959280968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63b8068c00 0x7f63b8197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:21.243 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63b6d9d700 1 -- 172.21.15.92:0/2959280968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac0095f0 con 0x7f63b81062b0 2023-10-16T13:12:21.244 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63b5d9b700 1 --2- 172.21.15.92:0/2959280968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63b80695b0 0x7f63b81976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:12:21.244 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63b659c700 1 --2- 172.21.15.92:0/2959280968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63b8068c00 0x7f63b8197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:12:21.244 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63b6d9d700 1 --2- 172.21.15.92:0/2959280968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63b81062b0 0x7f63b819bb20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f63b0007ee0 tx=0x7f63b000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:21.244 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63a77fe700 1 -- 172.21.15.92:0/2959280968 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b0017070 con 0x7f63b81062b0 2023-10-16T13:12:21.245 INFO:teuthology.orchestra.run.smithi092.stdout:107374182454 2023-10-16T13:12:21.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63bcba4700 1 -- 172.21.15.92:0/2959280968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b819c740 con 0x7f63b81062b0 2023-10-16T13:12:21.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63a77fe700 1 -- 172.21.15.92:0/2959280968 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f63b000f040 con 0x7f63b81062b0 2023-10-16T13:12:21.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63a77fe700 1 -- 172.21.15.92:0/2959280968 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b0005740 con 0x7f63b81062b0 2023-10-16T13:12:21.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.747+0000 7f63bcba4700 1 -- 172.21.15.92:0/2959280968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b81a3fa0 con 0x7f63b81062b0 2023-10-16T13:12:21.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.748+0000 7f63bcba4700 1 -- 172.21.15.92:0/2959280968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b8109480 con 0x7f63b81062b0 2023-10-16T13:12:21.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.750+0000 7f63a77fe700 1 -- 172.21.15.92:0/2959280968 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f63b00058a0 con 0x7f63b81062b0 2023-10-16T13:12:21.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.751+0000 7f63a77fe700 1 --2- 172.21.15.92:0/2959280968 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f63a00a1510 0x7f63a00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:21.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.751+0000 7f63a77fe700 1 -- 172.21.15.92:0/2959280968 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f63b00ccaf0 con 0x7f63b81062b0 2023-10-16T13:12:21.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.751+0000 7f63b659c700 1 --2- 172.21.15.92:0/2959280968 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f63a00a1510 0x7f63a00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:21.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.751+0000 7f63b659c700 1 --2- 172.21.15.92:0/2959280968 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f63a00a1510 0x7f63a00a39d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f63a8005fd0 tx=0x7f63a8005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:21.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.754+0000 7f63a77fe700 1 -- 172.21.15.92:0/2959280968 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f63b00961a0 con 0x7f63b81062b0 2023-10-16T13:12:21.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.968+0000 7f63bcba4700 1 -- 172.21.15.92:0/2959280968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f63b819c930 con 0x7f63b81062b0 2023-10-16T13:12:21.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.968+0000 7f63a77fe700 1 -- 172.21.15.92:0/2959280968 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63b00997c0 con 0x7f63b81062b0 2023-10-16T13:12:21.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.971+0000 7f63bcba4700 1 -- 172.21.15.92:0/2959280968 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f63a00a1510 msgr2=0x7f63a00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:21.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.971+0000 7f63bcba4700 1 --2- 172.21.15.92:0/2959280968 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f63a00a1510 0x7f63a00a39d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f63a8005fd0 tx=0x7f63a8005dc0 comp rx=0 tx=0).stop 2023-10-16T13:12:21.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.971+0000 7f63bcba4700 1 -- 172.21.15.92:0/2959280968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63b81062b0 msgr2=0x7f63b819bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:21.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.971+0000 7f63bcba4700 1 --2- 172.21.15.92:0/2959280968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63b81062b0 0x7f63b819bb20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f63b0007ee0 tx=0x7f63b000d3b0 comp rx=0 tx=0).stop 2023-10-16T13:12:21.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.971+0000 7f63bcba4700 1 -- 172.21.15.92:0/2959280968 shutdown_connections 2023-10-16T13:12:21.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.971+0000 7f63bcba4700 1 --2- 172.21.15.92:0/2959280968 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f63a00a1510 0x7f63a00a39d0 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f63a8005fd0 tx=0x7f63a8005dc0 comp rx=0 tx=0).stop 2023-10-16T13:12:21.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.971+0000 7f63bcba4700 1 --2- 172.21.15.92:0/2959280968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63b81062b0 0x7f63b819bb20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:21.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.971+0000 7f63bcba4700 1 --2- 172.21.15.92:0/2959280968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63b8068c00 0x7f63b8197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:21.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.971+0000 7f63bcba4700 1 --2- 172.21.15.92:0/2959280968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63b80695b0 0x7f63b81976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:21.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.971+0000 7f63bcba4700 1 -- 172.21.15.92:0/2959280968 >> 172.21.15.92:0/2959280968 conn(0x7f63b8075e00 msgr2=0x7f63b80ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:21.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.971+0000 7f63bcba4700 1 -- 172.21.15.92:0/2959280968 shutdown_connections 2023-10-16T13:12:21.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:20.971+0000 7f63bcba4700 1 -- 172.21.15.92:0/2959280968 wait complete. 2023-10-16T13:12:21.569 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:21 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2959280968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-16T13:12:21.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:21 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2959280968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-16T13:12:21.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:21 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2959280968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-16T13:12:21.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.936+0000 7f561c1e3700 1 -- 172.21.15.92:0/2433421975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56140ffe60 msgr2=0x7f56141002e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:21.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.936+0000 7f561c1e3700 1 --2- 172.21.15.92:0/2433421975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56140ffe60 0x7f56141002e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f56040099c0 tx=0x7f5604009cd0 comp rx=0 tx=0).stop 2023-10-16T13:12:21.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.936+0000 7f561c1e3700 1 -- 172.21.15.92:0/2433421975 shutdown_connections 2023-10-16T13:12:21.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.936+0000 7f561c1e3700 1 --2- 172.21.15.92:0/2433421975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5614100820 0x7f561410cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:21.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.936+0000 7f561c1e3700 1 --2- 172.21.15.92:0/2433421975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5614105e70 0x7f5614106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:21.942 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.936+0000 7f561c1e3700 1 --2- 172.21.15.92:0/2433421975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56140ffe60 0x7f56141002e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:21.942 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.936+0000 7f561c1e3700 1 -- 172.21.15.92:0/2433421975 >> 172.21.15.92:0/2433421975 conn(0x7f5614075e00 msgr2=0x7f5614076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:21.942 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.936+0000 7f561c1e3700 1 -- 172.21.15.92:0/2433421975 shutdown_connections 2023-10-16T13:12:21.942 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.936+0000 7f561c1e3700 1 -- 172.21.15.92:0/2433421975 wait complete. 2023-10-16T13:12:21.942 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.936+0000 7f561c1e3700 1 Processor -- start 2023-10-16T13:12:21.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f561c1e3700 1 -- start start 2023-10-16T13:12:21.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f561c1e3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56140ffe60 0x7f5614197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:21.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f561c1e3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5614100820 0x7f5614198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:21.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f561c1e3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5614105e70 0x7f56141a2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:21.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f561c1e3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56141a3510 con 0x7f5614100820 2023-10-16T13:12:21.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f561c1e3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56141a3650 con 0x7f5614105e70 2023-10-16T13:12:21.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f561c1e3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56141a3790 con 0x7f56140ffe60 2023-10-16T13:12:21.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f561977e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5614100820 0x7f5614198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:21.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f561977e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5614100820 0x7f5614198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35726/0 (socket says 172.21.15.92:35726) 2023-10-16T13:12:21.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f561977e700 1 -- 172.21.15.92:0/1933370662 learned_addr learned my addr 172.21.15.92:0/1933370662 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:21.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f5619f7f700 1 --2- 172.21.15.92:0/1933370662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56140ffe60 0x7f5614197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:21.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f561a780700 1 --2- 172.21.15.92:0/1933370662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5614105e70 0x7f56141a2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:21.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f561977e700 1 -- 172.21.15.92:0/1933370662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56140ffe60 msgr2=0x7f5614197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:21.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f561977e700 1 --2- 172.21.15.92:0/1933370662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56140ffe60 0x7f5614197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:21.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f561977e700 1 -- 172.21.15.92:0/1933370662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5614105e70 msgr2=0x7f56141a2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:21.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f561977e700 1 --2- 172.21.15.92:0/1933370662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5614105e70 0x7f56141a2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:21.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f561977e700 1 -- 172.21.15.92:0/1933370662 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56040095f0 con 0x7f5614100820 2023-10-16T13:12:21.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f5619f7f700 1 --2- 172.21.15.92:0/1933370662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56140ffe60 0x7f5614197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:12:21.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f561977e700 1 --2- 172.21.15.92:0/1933370662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5614100820 0x7f5614198490 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5604005910 tx=0x7f5604003710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:21.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.937+0000 7f560affd700 1 -- 172.21.15.92:0/1933370662 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560401d070 con 0x7f5614100820 2023-10-16T13:12:21.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.938+0000 7f561c1e3700 1 -- 172.21.15.92:0/1933370662 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56141a3990 con 0x7f5614100820 2023-10-16T13:12:21.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.938+0000 7f560affd700 1 -- 172.21.15.92:0/1933370662 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5604004220 con 0x7f5614100820 2023-10-16T13:12:21.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.938+0000 7f560affd700 1 -- 172.21.15.92:0/1933370662 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560400f6c0 con 0x7f5614100820 2023-10-16T13:12:21.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.938+0000 7f561c1e3700 1 -- 172.21.15.92:0/1933370662 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56141a3db0 con 0x7f5614100820 2023-10-16T13:12:21.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.939+0000 7f561c1e3700 1 -- 172.21.15.92:0/1933370662 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f561404ebb0 con 0x7f5614100820 2023-10-16T13:12:21.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.940+0000 7f560affd700 1 -- 172.21.15.92:0/1933370662 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f5604022470 con 0x7f5614100820 2023-10-16T13:12:21.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.940+0000 7f560affd700 1 --2- 172.21.15.92:0/1933370662 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f56000a1510 0x7f56000a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:21.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.940+0000 7f5619f7f700 1 --2- 172.21.15.92:0/1933370662 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f56000a1510 0x7f56000a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:21.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.940+0000 7f560affd700 1 -- 172.21.15.92:0/1933370662 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f56040ce7b0 con 0x7f5614100820 2023-10-16T13:12:21.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.941+0000 7f5619f7f700 1 --2- 172.21.15.92:0/1933370662 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f56000a1510 0x7f56000a39d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5610007900 tx=0x7f5610008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:21.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:21.944+0000 7f560affd700 1 -- 172.21.15.92:0/1933370662 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5604097ef0 con 0x7f5614100820 2023-10-16T13:12:22.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:22.146+0000 7f561c1e3700 1 -- 172.21.15.92:0/1933370662 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f5614110010 con 0x7f5614100820 2023-10-16T13:12:22.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:22.147+0000 7f560affd700 1 -- 172.21.15.92:0/1933370662 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f5604027090 con 0x7f5614100820 2023-10-16T13:12:22.150 INFO:teuthology.orchestra.run.smithi092.stdout:335007449107 2023-10-16T13:12:22.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:22.149+0000 7f561c1e3700 1 -- 172.21.15.92:0/1933370662 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f56000a1510 msgr2=0x7f56000a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:22.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:22.149+0000 7f561c1e3700 1 --2- 172.21.15.92:0/1933370662 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f56000a1510 0x7f56000a39d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5610007900 tx=0x7f5610008040 comp rx=0 tx=0).stop 2023-10-16T13:12:22.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:22.149+0000 7f561c1e3700 1 -- 172.21.15.92:0/1933370662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5614100820 msgr2=0x7f5614198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:22.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:22.149+0000 7f561c1e3700 1 --2- 172.21.15.92:0/1933370662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5614100820 0x7f5614198490 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5604005910 tx=0x7f5604003710 comp rx=0 tx=0).stop 2023-10-16T13:12:22.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:22.149+0000 7f561c1e3700 1 -- 172.21.15.92:0/1933370662 shutdown_connections 2023-10-16T13:12:22.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:22.149+0000 7f561c1e3700 1 --2- 172.21.15.92:0/1933370662 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f56000a1510 0x7f56000a39d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:22.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:22.149+0000 7f561c1e3700 1 --2- 172.21.15.92:0/1933370662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5614105e70 0x7f56141a2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:22.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:22.149+0000 7f561c1e3700 1 --2- 172.21.15.92:0/1933370662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56140ffe60 0x7f5614197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:22.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:22.149+0000 7f561c1e3700 1 --2- 172.21.15.92:0/1933370662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5614100820 0x7f5614198490 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:22.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:22.149+0000 7f561c1e3700 1 -- 172.21.15.92:0/1933370662 >> 172.21.15.92:0/1933370662 conn(0x7f5614075e00 msgr2=0x7f56140fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:22.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:22.149+0000 7f561c1e3700 1 -- 172.21.15.92:0/1933370662 shutdown_connections 2023-10-16T13:12:22.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:22.149+0000 7f561c1e3700 1 -- 172.21.15.92:0/1933370662 wait complete. 2023-10-16T13:12:22.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:22 smithi152 ceph-mon[104423]: pgmap v276: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-16T13:12:22.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:22 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1933370662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-16T13:12:22.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:22 smithi092 ceph-mon[99542]: pgmap v276: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-16T13:12:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:22 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1933370662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-16T13:12:22.744 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738431 got 34359738434 for osd.0 2023-10-16T13:12:22.744 DEBUG:teuthology.parallel:result is None 2023-10-16T13:12:22.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:22 smithi118 ceph-mon[103969]: pgmap v276: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-16T13:12:22.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:22 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1933370662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-16T13:12:23.964 INFO:teuthology.orchestra.run.smithi092.stdout:304942678040 2023-10-16T13:12:23.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.231+0000 7f382049a700 1 -- 172.21.15.92:0/4250661787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3818100820 msgr2=0x7f381810cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:23.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.231+0000 7f382049a700 1 --2- 172.21.15.92:0/4250661787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3818100820 0x7f381810cc90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f381000b0d0 tx=0x7f381000b3e0 comp rx=0 tx=0).stop 2023-10-16T13:12:23.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.231+0000 7f382049a700 1 -- 172.21.15.92:0/4250661787 shutdown_connections 2023-10-16T13:12:23.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.231+0000 7f382049a700 1 --2- 172.21.15.92:0/4250661787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3818100820 0x7f381810cc90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:23.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.231+0000 7f382049a700 1 --2- 172.21.15.92:0/4250661787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3818105e70 0x7f3818106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:23.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.231+0000 7f382049a700 1 --2- 172.21.15.92:0/4250661787 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38180ffe60 0x7f38181002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:23.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.231+0000 7f382049a700 1 -- 172.21.15.92:0/4250661787 >> 172.21.15.92:0/4250661787 conn(0x7f3818075e00 msgr2=0x7f3818076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:23.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.231+0000 7f382049a700 1 -- 172.21.15.92:0/4250661787 shutdown_connections 2023-10-16T13:12:23.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.231+0000 7f382049a700 1 -- 172.21.15.92:0/4250661787 wait complete. 2023-10-16T13:12:23.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.231+0000 7f382049a700 1 Processor -- start 2023-10-16T13:12:23.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f382049a700 1 -- start start 2023-10-16T13:12:23.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f382049a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38180ffe60 0x7f38181960b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:23.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f382049a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3818100820 0x7f38181965f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:23.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f382049a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3818105e70 0x7f381819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:23.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f382049a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381819b070 con 0x7f38180ffe60 2023-10-16T13:12:23.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f382049a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381819b1e0 con 0x7f3818100820 2023-10-16T13:12:23.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f382049a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381819b3a0 con 0x7f3818105e70 2023-10-16T13:12:23.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f381e236700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38180ffe60 0x7f38181960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:23.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f381e236700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38180ffe60 0x7f38181960b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35736/0 (socket says 172.21.15.92:35736) 2023-10-16T13:12:23.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f381e236700 1 -- 172.21.15.92:0/1952467820 learned_addr learned my addr 172.21.15.92:0/1952467820 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:23.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f381da35700 1 --2- 172.21.15.92:0/1952467820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3818100820 0x7f38181965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:23.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f381e236700 1 -- 172.21.15.92:0/1952467820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3818105e70 msgr2=0x7f381819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:23.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f381ea37700 1 --2- 172.21.15.92:0/1952467820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3818105e70 0x7f381819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:23.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f381e236700 1 --2- 172.21.15.92:0/1952467820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3818105e70 0x7f381819aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:23.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f381e236700 1 -- 172.21.15.92:0/1952467820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3818100820 msgr2=0x7f38181965f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:23.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f381e236700 1 --2- 172.21.15.92:0/1952467820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3818100820 0x7f38181965f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:23.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f381e236700 1 -- 172.21.15.92:0/1952467820 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3810009d00 con 0x7f38180ffe60 2023-10-16T13:12:23.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f381da35700 1 --2- 172.21.15.92:0/1952467820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3818100820 0x7f38181965f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:12:23.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f381e236700 1 --2- 172.21.15.92:0/1952467820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38180ffe60 0x7f38181960b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f381400c920 tx=0x7f381400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:23.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f380f7fe700 1 -- 172.21.15.92:0/1952467820 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814007b00 con 0x7f38180ffe60 2023-10-16T13:12:23.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f382049a700 1 -- 172.21.15.92:0/1952467820 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381819b680 con 0x7f38180ffe60 2023-10-16T13:12:23.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f380f7fe700 1 -- 172.21.15.92:0/1952467820 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3814004d10 con 0x7f38180ffe60 2023-10-16T13:12:23.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f380f7fe700 1 -- 172.21.15.92:0/1952467820 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814005670 con 0x7f38180ffe60 2023-10-16T13:12:23.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.232+0000 7f382049a700 1 -- 172.21.15.92:0/1952467820 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38181a2ee0 con 0x7f38180ffe60 2023-10-16T13:12:23.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.233+0000 7f382049a700 1 -- 172.21.15.92:0/1952467820 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381804ebb0 con 0x7f38180ffe60 2023-10-16T13:12:23.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.235+0000 7f380f7fe700 1 -- 172.21.15.92:0/1952467820 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f3814004750 con 0x7f38180ffe60 2023-10-16T13:12:23.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.235+0000 7f380f7fe700 1 --2- 172.21.15.92:0/1952467820 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f38040a1510 0x7f38040a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:23.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.235+0000 7f381da35700 1 --2- 172.21.15.92:0/1952467820 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f38040a1510 0x7f38040a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:23.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.235+0000 7f380f7fe700 1 -- 172.21.15.92:0/1952467820 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f38140ccbf0 con 0x7f38180ffe60 2023-10-16T13:12:23.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.236+0000 7f381da35700 1 --2- 172.21.15.92:0/1952467820 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f38040a1510 0x7f38040a39d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3808005fd0 tx=0x7f3808005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:23.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.238+0000 7f380f7fe700 1 -- 172.21.15.92:0/1952467820 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f38140962a0 con 0x7f38180ffe60 2023-10-16T13:12:23.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.438+0000 7f382049a700 1 -- 172.21.15.92:0/1952467820 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f38181100e0 con 0x7f38180ffe60 2023-10-16T13:12:23.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.438+0000 7f380f7fe700 1 -- 172.21.15.92:0/1952467820 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f381401d020 con 0x7f38180ffe60 2023-10-16T13:12:23.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.440+0000 7f382049a700 1 -- 172.21.15.92:0/1952467820 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f38040a1510 msgr2=0x7f38040a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:23.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.440+0000 7f382049a700 1 --2- 172.21.15.92:0/1952467820 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f38040a1510 0x7f38040a39d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3808005fd0 tx=0x7f3808005dc0 comp rx=0 tx=0).stop 2023-10-16T13:12:23.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.440+0000 7f382049a700 1 -- 172.21.15.92:0/1952467820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38180ffe60 msgr2=0x7f38181960b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:23.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.440+0000 7f382049a700 1 --2- 172.21.15.92:0/1952467820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38180ffe60 0x7f38181960b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f381400c920 tx=0x7f381400cce0 comp rx=0 tx=0).stop 2023-10-16T13:12:23.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.440+0000 7f382049a700 1 -- 172.21.15.92:0/1952467820 shutdown_connections 2023-10-16T13:12:23.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.441+0000 7f382049a700 1 --2- 172.21.15.92:0/1952467820 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f38040a1510 0x7f38040a39d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:23.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.441+0000 7f382049a700 1 --2- 172.21.15.92:0/1952467820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38180ffe60 0x7f38181960b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:23.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.441+0000 7f382049a700 1 --2- 172.21.15.92:0/1952467820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3818105e70 0x7f381819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:23.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.441+0000 7f382049a700 1 --2- 172.21.15.92:0/1952467820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3818100820 0x7f38181965f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:23.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.441+0000 7f382049a700 1 -- 172.21.15.92:0/1952467820 >> 172.21.15.92:0/1952467820 conn(0x7f3818075e00 msgr2=0x7f38180fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:23.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.441+0000 7f382049a700 1 -- 172.21.15.92:0/1952467820 shutdown_connections 2023-10-16T13:12:23.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:23.441+0000 7f382049a700 1 -- 172.21.15.92:0/1952467820 wait complete. 2023-10-16T13:12:24.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:24 smithi152 ceph-mon[104423]: pgmap v277: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-10-16T13:12:24.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:24 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1952467820' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-16T13:12:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:24 smithi092 ceph-mon[99542]: pgmap v277: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-10-16T13:12:24.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:24 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1952467820' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-16T13:12:24.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:24 smithi118 ceph-mon[103969]: pgmap v277: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-10-16T13:12:24.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:24 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1952467820' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-16T13:12:24.804 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678037 got 304942678040 for osd.10 2023-10-16T13:12:24.804 DEBUG:teuthology.parallel:result is None 2023-10-16T13:12:24.827 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182452 got 107374182454 for osd.3 2023-10-16T13:12:24.828 DEBUG:teuthology.parallel:result is None 2023-10-16T13:12:25.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.165+0000 7fad62846700 1 -- 172.21.15.92:0/416897267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c0ffe10 msgr2=0x7fad5c100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:25.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.165+0000 7fad62846700 1 --2- 172.21.15.92:0/416897267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c0ffe10 0x7fad5c100290 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fad50009990 tx=0x7fad50009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.165+0000 7fad62846700 1 -- 172.21.15.92:0/416897267 shutdown_connections 2023-10-16T13:12:25.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.165+0000 7fad62846700 1 --2- 172.21.15.92:0/416897267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad5c1007d0 0x7fad5c10cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.165+0000 7fad62846700 1 --2- 172.21.15.92:0/416897267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad5c105ec0 0x7fad5c1062a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.165+0000 7fad62846700 1 --2- 172.21.15.92:0/416897267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c0ffe10 0x7fad5c100290 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.165+0000 7fad62846700 1 -- 172.21.15.92:0/416897267 >> 172.21.15.92:0/416897267 conn(0x7fad5c076dc0 msgr2=0x7fad5c0771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:25.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.165+0000 7fad62846700 1 -- 172.21.15.92:0/416897267 shutdown_connections 2023-10-16T13:12:25.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.165+0000 7fad62846700 1 -- 172.21.15.92:0/416897267 wait complete. 2023-10-16T13:12:25.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.165+0000 7fad62846700 1 Processor -- start 2023-10-16T13:12:25.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.165+0000 7fad62846700 1 -- start start 2023-10-16T13:12:25.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad62846700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad5c0ffe10 0x7fad5c197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:25.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad62846700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad5c1007d0 0x7fad5c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:25.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad62846700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c105ec0 0x7fad5c1a2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:25.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad62846700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c1a34a0 con 0x7fad5c105ec0 2023-10-16T13:12:25.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad62846700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c1a35e0 con 0x7fad5c0ffe10 2023-10-16T13:12:25.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad62846700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c1a3720 con 0x7fad5c1007d0 2023-10-16T13:12:25.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad60de3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c105ec0 0x7fad5c1a2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:25.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad60de3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c105ec0 0x7fad5c1a2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35754/0 (socket says 172.21.15.92:35754) 2023-10-16T13:12:25.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad60de3700 1 -- 172.21.15.92:0/1203529968 learned_addr learned my addr 172.21.15.92:0/1203529968 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:25.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad5b7fe700 1 --2- 172.21.15.92:0/1203529968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad5c1007d0 0x7fad5c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:25.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad60de3700 1 -- 172.21.15.92:0/1203529968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad5c1007d0 msgr2=0x7fad5c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:25.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad5bfff700 1 --2- 172.21.15.92:0/1203529968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad5c0ffe10 0x7fad5c197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:25.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad60de3700 1 --2- 172.21.15.92:0/1203529968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad5c1007d0 0x7fad5c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad60de3700 1 -- 172.21.15.92:0/1203529968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad5c0ffe10 msgr2=0x7fad5c197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:25.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad60de3700 1 --2- 172.21.15.92:0/1203529968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad5c0ffe10 0x7fad5c197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad60de3700 1 -- 172.21.15.92:0/1203529968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad500095f0 con 0x7fad5c105ec0 2023-10-16T13:12:25.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad5b7fe700 1 --2- 172.21.15.92:0/1203529968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad5c1007d0 0x7fad5c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:12:25.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad5bfff700 1 --2- 172.21.15.92:0/1203529968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad5c0ffe10 0x7fad5c197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:12:25.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad60de3700 1 --2- 172.21.15.92:0/1203529968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c105ec0 0x7fad5c1a2f60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fad54007ee0 tx=0x7fad5400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:25.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad597fa700 1 -- 172.21.15.92:0/1203529968 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54017070 con 0x7fad5c105ec0 2023-10-16T13:12:25.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad597fa700 1 -- 172.21.15.92:0/1203529968 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fad5400f040 con 0x7fad5c105ec0 2023-10-16T13:12:25.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad62846700 1 -- 172.21.15.92:0/1203529968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5c1a3980 con 0x7fad5c105ec0 2023-10-16T13:12:25.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.166+0000 7fad597fa700 1 -- 172.21.15.92:0/1203529968 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54005740 con 0x7fad5c105ec0 2023-10-16T13:12:25.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.167+0000 7fad62846700 1 -- 172.21.15.92:0/1203529968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5c1a3e30 con 0x7fad5c105ec0 2023-10-16T13:12:25.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.168+0000 7fad62846700 1 -- 172.21.15.92:0/1203529968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5c04ebb0 con 0x7fad5c105ec0 2023-10-16T13:12:25.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.169+0000 7fad597fa700 1 -- 172.21.15.92:0/1203529968 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fad54005940 con 0x7fad5c105ec0 2023-10-16T13:12:25.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.169+0000 7fad597fa700 1 --2- 172.21.15.92:0/1203529968 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fad440a1510 0x7fad440a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:25.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.169+0000 7fad5bfff700 1 --2- 172.21.15.92:0/1203529968 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fad440a1510 0x7fad440a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:25.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.169+0000 7fad597fa700 1 -- 172.21.15.92:0/1203529968 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fad540cc550 con 0x7fad5c105ec0 2023-10-16T13:12:25.178 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.170+0000 7fad5bfff700 1 --2- 172.21.15.92:0/1203529968 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fad440a1510 0x7fad440a39d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad4c007900 tx=0x7fad4c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:25.178 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.173+0000 7fad597fa700 1 -- 172.21.15.92:0/1203529968 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fad54095c00 con 0x7fad5c105ec0 2023-10-16T13:12:25.365 INFO:tasks.cephadm.ceph_manager.ceph:need seq 335007449105 got 335007449107 for osd.11 2023-10-16T13:12:25.365 DEBUG:teuthology.parallel:result is None 2023-10-16T13:12:25.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.374+0000 7fad62846700 1 -- 172.21.15.92:0/1203529968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fad5c069820 con 0x7fad5c105ec0 2023-10-16T13:12:25.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.375+0000 7fad597fa700 1 -- 172.21.15.92:0/1203529968 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad54099220 con 0x7fad5c105ec0 2023-10-16T13:12:25.378 INFO:teuthology.orchestra.run.smithi092.stdout:219043332133 2023-10-16T13:12:25.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.377+0000 7fad62846700 1 -- 172.21.15.92:0/1203529968 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fad440a1510 msgr2=0x7fad440a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:25.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.377+0000 7fad62846700 1 --2- 172.21.15.92:0/1203529968 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fad440a1510 0x7fad440a39d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad4c007900 tx=0x7fad4c008040 comp rx=0 tx=0).stop 2023-10-16T13:12:25.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.377+0000 7fad62846700 1 -- 172.21.15.92:0/1203529968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c105ec0 msgr2=0x7fad5c1a2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:25.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.377+0000 7fad62846700 1 --2- 172.21.15.92:0/1203529968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c105ec0 0x7fad5c1a2f60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fad54007ee0 tx=0x7fad5400d3b0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.377+0000 7fad62846700 1 -- 172.21.15.92:0/1203529968 shutdown_connections 2023-10-16T13:12:25.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.377+0000 7fad62846700 1 --2- 172.21.15.92:0/1203529968 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fad440a1510 0x7fad440a39d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.377+0000 7fad62846700 1 --2- 172.21.15.92:0/1203529968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c105ec0 0x7fad5c1a2f60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.377+0000 7fad62846700 1 --2- 172.21.15.92:0/1203529968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad5c0ffe10 0x7fad5c197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.377+0000 7fad62846700 1 --2- 172.21.15.92:0/1203529968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad5c1007d0 0x7fad5c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.377+0000 7fad62846700 1 -- 172.21.15.92:0/1203529968 >> 172.21.15.92:0/1203529968 conn(0x7fad5c076dc0 msgr2=0x7fad5c0feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:25.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.377+0000 7fad62846700 1 -- 172.21.15.92:0/1203529968 shutdown_connections 2023-10-16T13:12:25.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.377+0000 7fad62846700 1 -- 172.21.15.92:0/1203529968 wait complete. 2023-10-16T13:12:25.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.729+0000 7f2d00dcb700 1 -- 172.21.15.92:0/1563154994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cfc100080 msgr2=0x7f2cfc100460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:25.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.729+0000 7f2d00dcb700 1 --2- 172.21.15.92:0/1563154994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cfc100080 0x7f2cfc100460 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2cec009990 tx=0x7f2cec009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.729+0000 7f2d00dcb700 1 -- 172.21.15.92:0/1563154994 shutdown_connections 2023-10-16T13:12:25.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.729+0000 7f2d00dcb700 1 --2- 172.21.15.92:0/1563154994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cfc100080 0x7f2cfc100460 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.729+0000 7f2d00dcb700 1 --2- 172.21.15.92:0/1563154994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cfc105160 0x7f2cfc10cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.729+0000 7f2d00dcb700 1 --2- 172.21.15.92:0/1563154994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cfc100a30 0x7f2cfc104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.729+0000 7f2d00dcb700 1 -- 172.21.15.92:0/1563154994 >> 172.21.15.92:0/1563154994 conn(0x7f2cfc0fb8d0 msgr2=0x7f2cfc0fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:25.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.729+0000 7f2d00dcb700 1 -- 172.21.15.92:0/1563154994 shutdown_connections 2023-10-16T13:12:25.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.729+0000 7f2d00dcb700 1 -- 172.21.15.92:0/1563154994 wait complete. 2023-10-16T13:12:25.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.730+0000 7f2d00dcb700 1 Processor -- start 2023-10-16T13:12:25.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.730+0000 7f2d00dcb700 1 -- start start 2023-10-16T13:12:25.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.730+0000 7f2d00dcb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cfc100080 0x7f2cfc195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:25.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.730+0000 7f2d00dcb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cfc100a30 0x7f2cfc196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:25.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.730+0000 7f2d00dcb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cfc105160 0x7f2cfc1968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:25.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.730+0000 7f2d00dcb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc1a5690 con 0x7f2cfc105160 2023-10-16T13:12:25.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.730+0000 7f2d00dcb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc1a5800 con 0x7f2cfc100080 2023-10-16T13:12:25.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.730+0000 7f2d00dcb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc1a59c0 con 0x7f2cfc100a30 2023-10-16T13:12:25.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.730+0000 7f2cfad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cfc105160 0x7f2cfc1968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:25.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.730+0000 7f2cfad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cfc105160 0x7f2cfc1968d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35766/0 (socket says 172.21.15.92:35766) 2023-10-16T13:12:25.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.730+0000 7f2cfad9d700 1 -- 172.21.15.92:0/1176961490 learned_addr learned my addr 172.21.15.92:0/1176961490 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:25.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.730+0000 7f2cf9d9b700 1 --2- 172.21.15.92:0/1176961490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cfc100a30 0x7f2cfc196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:25.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.730+0000 7f2cfa59c700 1 --2- 172.21.15.92:0/1176961490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cfc100080 0x7f2cfc195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:25.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.730+0000 7f2cfad9d700 1 -- 172.21.15.92:0/1176961490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cfc100a30 msgr2=0x7f2cfc196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:25.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.730+0000 7f2cfad9d700 1 --2- 172.21.15.92:0/1176961490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cfc100a30 0x7f2cfc196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.730+0000 7f2cfad9d700 1 -- 172.21.15.92:0/1176961490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cfc100080 msgr2=0x7f2cfc195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:25.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.730+0000 7f2cfad9d700 1 --2- 172.21.15.92:0/1176961490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cfc100080 0x7f2cfc195e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.731+0000 7f2cfad9d700 1 -- 172.21.15.92:0/1176961490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec0095f0 con 0x7f2cfc105160 2023-10-16T13:12:25.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.731+0000 7f2cf9d9b700 1 --2- 172.21.15.92:0/1176961490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cfc100a30 0x7f2cfc196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:12:25.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.731+0000 7f2cfa59c700 1 --2- 172.21.15.92:0/1176961490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cfc100080 0x7f2cfc195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:12:25.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.731+0000 7f2cfad9d700 1 --2- 172.21.15.92:0/1176961490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cfc105160 0x7f2cfc1968d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2cf400b970 tx=0x7f2cf400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:25.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.731+0000 7f2ceb7fe700 1 -- 172.21.15.92:0/1176961490 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf400c9b0 con 0x7f2cfc105160 2023-10-16T13:12:25.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.731+0000 7f2ceb7fe700 1 -- 172.21.15.92:0/1176961490 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2cf4014440 con 0x7f2cfc105160 2023-10-16T13:12:25.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.731+0000 7f2d00dcb700 1 -- 172.21.15.92:0/1176961490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cfc1a5ca0 con 0x7f2cfc105160 2023-10-16T13:12:25.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.731+0000 7f2ceb7fe700 1 -- 172.21.15.92:0/1176961490 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf40075d0 con 0x7f2cfc105160 2023-10-16T13:12:25.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.731+0000 7f2d00dcb700 1 -- 172.21.15.92:0/1176961490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cfc1a6150 con 0x7f2cfc105160 2023-10-16T13:12:25.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.732+0000 7f2d00dcb700 1 -- 172.21.15.92:0/1176961490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cfc04ebb0 con 0x7f2cfc105160 2023-10-16T13:12:25.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.734+0000 7f2ceb7fe700 1 -- 172.21.15.92:0/1176961490 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f2cf4014920 con 0x7f2cfc105160 2023-10-16T13:12:25.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.734+0000 7f2ceb7fe700 1 --2- 172.21.15.92:0/1176961490 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f2ce40a1510 0x7f2ce40a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:25.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.735+0000 7f2cfa59c700 1 --2- 172.21.15.92:0/1176961490 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f2ce40a1510 0x7f2ce40a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:25.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.735+0000 7f2ceb7fe700 1 -- 172.21.15.92:0/1176961490 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2cf4006e40 con 0x7f2cfc105160 2023-10-16T13:12:25.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.735+0000 7f2cfa59c700 1 --2- 172.21.15.92:0/1176961490 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f2ce40a1510 0x7f2ce40a39d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00b5c0 tx=0x7f2cec005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:25.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.739+0000 7f2ceb7fe700 1 -- 172.21.15.92:0/1176961490 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2cf404f100 con 0x7f2cfc105160 2023-10-16T13:12:25.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.906+0000 7f22eb8d5700 1 -- 172.21.15.92:0/210133684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e4101940 msgr2=0x7f22e410ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:25.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.906+0000 7f22eb8d5700 1 --2- 172.21.15.92:0/210133684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e4101940 0x7f22e410ddb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00b0d0 tx=0x7f22dc00b3e0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.906+0000 7f22eb8d5700 1 -- 172.21.15.92:0/210133684 shutdown_connections 2023-10-16T13:12:25.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.906+0000 7f22eb8d5700 1 --2- 172.21.15.92:0/210133684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e4101940 0x7f22e410ddb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.906+0000 7f22eb8d5700 1 --2- 172.21.15.92:0/210133684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22e4106f90 0x7f22e4107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.906+0000 7f22eb8d5700 1 --2- 172.21.15.92:0/210133684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e4100f80 0x7f22e4101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.906+0000 7f22eb8d5700 1 -- 172.21.15.92:0/210133684 >> 172.21.15.92:0/210133684 conn(0x7f22e40780a0 msgr2=0x7f22e40784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:25.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.907+0000 7f22eb8d5700 1 -- 172.21.15.92:0/210133684 shutdown_connections 2023-10-16T13:12:25.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.907+0000 7f22eb8d5700 1 -- 172.21.15.92:0/210133684 wait complete. 2023-10-16T13:12:25.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.907+0000 7f22eb8d5700 1 Processor -- start 2023-10-16T13:12:25.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.907+0000 7f22eb8d5700 1 -- start start 2023-10-16T13:12:25.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22eb8d5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e4100f80 0x7f22e41971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:25.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22eb8d5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e4101940 0x7f22e4197710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:25.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22eb8d5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22e4106f90 0x7f22e419bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:25.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22eb8d5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e419c190 con 0x7f22e4100f80 2023-10-16T13:12:25.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22eb8d5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e419c300 con 0x7f22e4101940 2023-10-16T13:12:25.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22eb8d5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e419c4c0 con 0x7f22e4106f90 2023-10-16T13:12:25.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22e9671700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e4100f80 0x7f22e41971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:25.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22e9671700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e4100f80 0x7f22e41971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35790/0 (socket says 172.21.15.92:35790) 2023-10-16T13:12:25.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22e9671700 1 -- 172.21.15.92:0/529112647 learned_addr learned my addr 172.21.15.92:0/529112647 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:25.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22e9e72700 1 --2- 172.21.15.92:0/529112647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22e4106f90 0x7f22e419bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:25.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22e8e70700 1 --2- 172.21.15.92:0/529112647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e4101940 0x7f22e4197710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:25.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22e9671700 1 -- 172.21.15.92:0/529112647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22e4106f90 msgr2=0x7f22e419bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:25.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22e9671700 1 --2- 172.21.15.92:0/529112647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22e4106f90 0x7f22e419bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22e9671700 1 -- 172.21.15.92:0/529112647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e4101940 msgr2=0x7f22e4197710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:25.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22e9671700 1 --2- 172.21.15.92:0/529112647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e4101940 0x7f22e4197710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22e9671700 1 -- 172.21.15.92:0/529112647 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc009d00 con 0x7f22e4100f80 2023-10-16T13:12:25.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22e8e70700 1 --2- 172.21.15.92:0/529112647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e4101940 0x7f22e4197710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:12:25.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22e9671700 1 --2- 172.21.15.92:0/529112647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e4100f80 0x7f22e41971d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f22e000d980 tx=0x7f22e000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:25.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22da7fc700 1 -- 172.21.15.92:0/529112647 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e000bb60 con 0x7f22e4100f80 2023-10-16T13:12:25.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22eb8d5700 1 -- 172.21.15.92:0/529112647 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e419c7a0 con 0x7f22e4100f80 2023-10-16T13:12:25.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22da7fc700 1 -- 172.21.15.92:0/529112647 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f22e000de60 con 0x7f22e4100f80 2023-10-16T13:12:25.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.908+0000 7f22da7fc700 1 -- 172.21.15.92:0/529112647 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e0005020 con 0x7f22e4100f80 2023-10-16T13:12:25.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.909+0000 7f22eb8d5700 1 -- 172.21.15.92:0/529112647 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e41a4000 con 0x7f22e4100f80 2023-10-16T13:12:25.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.910+0000 7f22eb8d5700 1 -- 172.21.15.92:0/529112647 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e404ebb0 con 0x7f22e4100f80 2023-10-16T13:12:25.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.911+0000 7f22da7fc700 1 -- 172.21.15.92:0/529112647 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f22e0004020 con 0x7f22e4100f80 2023-10-16T13:12:25.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.912+0000 7f22da7fc700 1 --2- 172.21.15.92:0/529112647 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f22d00a1510 0x7f22d00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:25.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.912+0000 7f22e8e70700 1 --2- 172.21.15.92:0/529112647 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f22d00a1510 0x7f22d00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:25.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.912+0000 7f22da7fc700 1 -- 172.21.15.92:0/529112647 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f22e00ccc20 con 0x7f22e4100f80 2023-10-16T13:12:25.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.912+0000 7f22e8e70700 1 --2- 172.21.15.92:0/529112647 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f22d00a1510 0x7f22d00a39d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f22e41987f0 tx=0x7f22d4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:25.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.918+0000 7f22da7fc700 1 -- 172.21.15.92:0/529112647 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f22e00961d0 con 0x7f22e4100f80 2023-10-16T13:12:25.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.975+0000 7f2d00dcb700 1 -- 172.21.15.92:0/1176961490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f2cfc1100b0 con 0x7f2cfc105160 2023-10-16T13:12:25.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.975+0000 7f2ceb7fe700 1 -- 172.21.15.92:0/1176961490 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2cf4095ae0 con 0x7f2cfc105160 2023-10-16T13:12:25.979 INFO:teuthology.orchestra.run.smithi092.stdout:283467841566 2023-10-16T13:12:25.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.872+0000 7f0d4f632700 1 -- 172.21.15.92:0/2040917971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d48102200 msgr2=0x7f0d480ff950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:25.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.872+0000 7f0d4f632700 1 --2- 172.21.15.92:0/2040917971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d48102200 0x7f0d480ff950 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009990 tx=0x7f0d38009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.872+0000 7f0d4f632700 1 -- 172.21.15.92:0/2040917971 shutdown_connections 2023-10-16T13:12:25.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.872+0000 7f0d4f632700 1 --2- 172.21.15.92:0/2040917971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d480fff70 0x7f0d4810fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.872+0000 7f0d4f632700 1 --2- 172.21.15.92:0/2040917971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d48101e20 0x7f0d480ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.872+0000 7f0d4f632700 1 --2- 172.21.15.92:0/2040917971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d48102200 0x7f0d480ff950 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.872+0000 7f0d4f632700 1 -- 172.21.15.92:0/2040917971 >> 172.21.15.92:0/2040917971 conn(0x7f0d48076360 msgr2=0x7f0d480fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:25.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.872+0000 7f0d4f632700 1 -- 172.21.15.92:0/2040917971 shutdown_connections 2023-10-16T13:12:25.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.872+0000 7f0d4f632700 1 -- 172.21.15.92:0/2040917971 wait complete. 2023-10-16T13:12:25.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.873+0000 7f0d4f632700 1 Processor -- start 2023-10-16T13:12:25.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.873+0000 7f0d4f632700 1 -- start start 2023-10-16T13:12:25.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.873+0000 7f0d4f632700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d480fff70 0x7f0d481992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:25.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.873+0000 7f0d4f632700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d48101e20 0x7f0d48199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:25.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.873+0000 7f0d4f632700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d48102200 0x7f0d4819dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:25.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.873+0000 7f0d4f632700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4819e280 con 0x7f0d48102200 2023-10-16T13:12:25.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.873+0000 7f0d4f632700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4819e3f0 con 0x7f0d48101e20 2023-10-16T13:12:25.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.873+0000 7f0d4f632700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4819e5b0 con 0x7f0d480fff70 2023-10-16T13:12:25.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.873+0000 7f0d4dbcf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d48102200 0x7f0d4819dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:25.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.873+0000 7f0d4dbcf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d48102200 0x7f0d4819dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35780/0 (socket says 172.21.15.92:35780) 2023-10-16T13:12:25.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.873+0000 7f0d4dbcf700 1 -- 172.21.15.92:0/1539764351 learned_addr learned my addr 172.21.15.92:0/1539764351 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:25.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.873+0000 7f0d4cbcd700 1 --2- 172.21.15.92:0/1539764351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d48101e20 0x7f0d48199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:25.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.873+0000 7f0d4d3ce700 1 --2- 172.21.15.92:0/1539764351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d480fff70 0x7f0d481992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:25.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.874+0000 7f0d4dbcf700 1 -- 172.21.15.92:0/1539764351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d480fff70 msgr2=0x7f0d481992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:25.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.874+0000 7f0d4dbcf700 1 --2- 172.21.15.92:0/1539764351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d480fff70 0x7f0d481992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.874+0000 7f0d4dbcf700 1 -- 172.21.15.92:0/1539764351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d48101e20 msgr2=0x7f0d48199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:25.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.874+0000 7f0d4dbcf700 1 --2- 172.21.15.92:0/1539764351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d48101e20 0x7f0d48199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.874+0000 7f0d4dbcf700 1 -- 172.21.15.92:0/1539764351 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d380095f0 con 0x7f0d48102200 2023-10-16T13:12:25.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.874+0000 7f0d4dbcf700 1 --2- 172.21.15.92:0/1539764351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d48102200 0x7f0d4819dc70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0d40007f10 tx=0x7f0d4000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:25.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.874+0000 7f0d3e7fc700 1 -- 172.21.15.92:0/1539764351 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40017070 con 0x7f0d48102200 2023-10-16T13:12:25.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.874+0000 7f0d3e7fc700 1 -- 172.21.15.92:0/1539764351 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0d4000f040 con 0x7f0d48102200 2023-10-16T13:12:25.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.874+0000 7f0d4f632700 1 -- 172.21.15.92:0/1539764351 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4819e890 con 0x7f0d48102200 2023-10-16T13:12:25.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.874+0000 7f0d3e7fc700 1 -- 172.21.15.92:0/1539764351 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40005610 con 0x7f0d48102200 2023-10-16T13:12:25.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.874+0000 7f0d4f632700 1 -- 172.21.15.92:0/1539764351 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d481a60f0 con 0x7f0d48102200 2023-10-16T13:12:25.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.876+0000 7f0d4f632700 1 -- 172.21.15.92:0/1539764351 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4804ebb0 con 0x7f0d48102200 2023-10-16T13:12:25.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.877+0000 7f0d3e7fc700 1 -- 172.21.15.92:0/1539764351 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f0d40004c40 con 0x7f0d48102200 2023-10-16T13:12:25.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.877+0000 7f0d3e7fc700 1 --2- 172.21.15.92:0/1539764351 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0d340a1510 0x7f0d340a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:25.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.877+0000 7f0d3e7fc700 1 -- 172.21.15.92:0/1539764351 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0d400cc350 con 0x7f0d48102200 2023-10-16T13:12:25.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.877+0000 7f0d4d3ce700 1 --2- 172.21.15.92:0/1539764351 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0d340a1510 0x7f0d340a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:25.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.878+0000 7f0d4d3ce700 1 --2- 172.21.15.92:0/1539764351 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0d340a1510 0x7f0d340a39d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0d44005950 tx=0x7f0d4400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:25.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.881+0000 7f0d3e7fc700 1 -- 172.21.15.92:0/1539764351 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0d40095a00 con 0x7f0d48102200 2023-10-16T13:12:25.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.978+0000 7f2d00dcb700 1 -- 172.21.15.92:0/1176961490 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f2ce40a1510 msgr2=0x7f2ce40a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:25.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.978+0000 7f2d00dcb700 1 --2- 172.21.15.92:0/1176961490 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f2ce40a1510 0x7f2ce40a39d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00b5c0 tx=0x7f2cec005fb0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.978+0000 7f2d00dcb700 1 -- 172.21.15.92:0/1176961490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cfc105160 msgr2=0x7f2cfc1968d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:25.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.978+0000 7f2d00dcb700 1 --2- 172.21.15.92:0/1176961490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cfc105160 0x7f2cfc1968d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2cf400b970 tx=0x7f2cf400bd30 comp rx=0 tx=0).stop 2023-10-16T13:12:25.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.979+0000 7f2d00dcb700 1 -- 172.21.15.92:0/1176961490 shutdown_connections 2023-10-16T13:12:25.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.979+0000 7f2d00dcb700 1 --2- 172.21.15.92:0/1176961490 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f2ce40a1510 0x7f2ce40a39d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.979+0000 7f2d00dcb700 1 --2- 172.21.15.92:0/1176961490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cfc105160 0x7f2cfc1968d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.979+0000 7f2d00dcb700 1 --2- 172.21.15.92:0/1176961490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cfc100080 0x7f2cfc195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.979+0000 7f2d00dcb700 1 --2- 172.21.15.92:0/1176961490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cfc100a30 0x7f2cfc196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:25.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.979+0000 7f2d00dcb700 1 -- 172.21.15.92:0/1176961490 >> 172.21.15.92:0/1176961490 conn(0x7f2cfc0fb8d0 msgr2=0x7f2cfc0fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:25.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.979+0000 7f2d00dcb700 1 -- 172.21.15.92:0/1176961490 shutdown_connections 2023-10-16T13:12:25.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:25.979+0000 7f2d00dcb700 1 -- 172.21.15.92:0/1176961490 wait complete. 2023-10-16T13:12:26.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.107+0000 7f0d4f632700 1 -- 172.21.15.92:0/1539764351 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0d4819a620 con 0x7f0d48102200 2023-10-16T13:12:26.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.108+0000 7f0d3e7fc700 1 -- 172.21.15.92:0/1539764351 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d40099020 con 0x7f0d48102200 2023-10-16T13:12:26.111 INFO:teuthology.orchestra.run.smithi092.stdout:141733920818 2023-10-16T13:12:26.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.110+0000 7f0d4f632700 1 -- 172.21.15.92:0/1539764351 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0d340a1510 msgr2=0x7f0d340a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:26.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.110+0000 7f0d4f632700 1 --2- 172.21.15.92:0/1539764351 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0d340a1510 0x7f0d340a39d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0d44005950 tx=0x7f0d4400b410 comp rx=0 tx=0).stop 2023-10-16T13:12:26.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.110+0000 7f0d4f632700 1 -- 172.21.15.92:0/1539764351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d48102200 msgr2=0x7f0d4819dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:26.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.110+0000 7f0d4f632700 1 --2- 172.21.15.92:0/1539764351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d48102200 0x7f0d4819dc70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0d40007f10 tx=0x7f0d4000d3b0 comp rx=0 tx=0).stop 2023-10-16T13:12:26.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.110+0000 7f0d4f632700 1 -- 172.21.15.92:0/1539764351 shutdown_connections 2023-10-16T13:12:26.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.110+0000 7f0d4f632700 1 --2- 172.21.15.92:0/1539764351 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0d340a1510 0x7f0d340a39d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:26.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.110+0000 7f0d4f632700 1 --2- 172.21.15.92:0/1539764351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d48102200 0x7f0d4819dc70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:26.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.110+0000 7f0d4f632700 1 --2- 172.21.15.92:0/1539764351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d480fff70 0x7f0d481992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:26.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.110+0000 7f0d4f632700 1 --2- 172.21.15.92:0/1539764351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d48101e20 0x7f0d48199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:26.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.110+0000 7f0d4f632700 1 -- 172.21.15.92:0/1539764351 >> 172.21.15.92:0/1539764351 conn(0x7f0d48076360 msgr2=0x7f0d480fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:26.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.110+0000 7f0d4f632700 1 -- 172.21.15.92:0/1539764351 shutdown_connections 2023-10-16T13:12:26.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.110+0000 7f0d4f632700 1 -- 172.21.15.92:0/1539764351 wait complete. 2023-10-16T13:12:26.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.138+0000 7f22eb8d5700 1 -- 172.21.15.92:0/529112647 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f22e4111060 con 0x7f22e4100f80 2023-10-16T13:12:26.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.138+0000 7f22da7fc700 1 -- 172.21.15.92:0/529112647 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22e0016020 con 0x7f22e4100f80 2023-10-16T13:12:26.142 INFO:teuthology.orchestra.run.smithi092.stdout:77309411388 2023-10-16T13:12:26.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.140+0000 7f22eb8d5700 1 -- 172.21.15.92:0/529112647 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f22d00a1510 msgr2=0x7f22d00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:26.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.140+0000 7f22eb8d5700 1 --2- 172.21.15.92:0/529112647 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f22d00a1510 0x7f22d00a39d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f22e41987f0 tx=0x7f22d4009260 comp rx=0 tx=0).stop 2023-10-16T13:12:26.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.140+0000 7f22eb8d5700 1 -- 172.21.15.92:0/529112647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e4100f80 msgr2=0x7f22e41971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:26.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.140+0000 7f22eb8d5700 1 --2- 172.21.15.92:0/529112647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e4100f80 0x7f22e41971d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f22e000d980 tx=0x7f22e000dd40 comp rx=0 tx=0).stop 2023-10-16T13:12:26.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.140+0000 7f22eb8d5700 1 -- 172.21.15.92:0/529112647 shutdown_connections 2023-10-16T13:12:26.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.141+0000 7f22eb8d5700 1 --2- 172.21.15.92:0/529112647 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f22d00a1510 0x7f22d00a39d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:26.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.141+0000 7f22eb8d5700 1 --2- 172.21.15.92:0/529112647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e4100f80 0x7f22e41971d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:26.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.141+0000 7f22eb8d5700 1 --2- 172.21.15.92:0/529112647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22e4106f90 0x7f22e419bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:26.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.141+0000 7f22eb8d5700 1 --2- 172.21.15.92:0/529112647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e4101940 0x7f22e4197710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:26.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.141+0000 7f22eb8d5700 1 -- 172.21.15.92:0/529112647 >> 172.21.15.92:0/529112647 conn(0x7f22e40780a0 msgr2=0x7f22e40ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:26.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.141+0000 7f22eb8d5700 1 -- 172.21.15.92:0/529112647 shutdown_connections 2023-10-16T13:12:26.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.141+0000 7f22eb8d5700 1 -- 172.21.15.92:0/529112647 wait complete. 2023-10-16T13:12:26.560 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:26 smithi092 ceph-mon[99542]: pgmap v278: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2023-10-16T13:12:26.561 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:26 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1203529968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-16T13:12:26.561 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:26 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1176961490' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-16T13:12:26.561 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:26 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1539764351' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-16T13:12:26.561 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:26 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/529112647' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-16T13:12:26.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:26 smithi152 ceph-mon[104423]: pgmap v278: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2023-10-16T13:12:26.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:26 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1203529968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-16T13:12:26.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:26 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1176961490' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-16T13:12:26.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:26 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1539764351' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-16T13:12:26.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:26 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/529112647' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-16T13:12:26.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:26 smithi118 ceph-mon[103969]: pgmap v278: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2023-10-16T13:12:26.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:26 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1203529968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-16T13:12:26.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:26 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1176961490' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-16T13:12:26.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:26 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1539764351' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-16T13:12:26.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:26 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/529112647' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-16T13:12:26.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.815+0000 7f45f99c7700 1 -- 172.21.15.92:0/4273089376 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45f4105e70 msgr2=0x7f45f4106250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:26.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.815+0000 7f45f99c7700 1 --2- 172.21.15.92:0/4273089376 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45f4105e70 0x7f45f4106250 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f45e40099c0 tx=0x7f45e4009cd0 comp rx=0 tx=0).stop 2023-10-16T13:12:26.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.815+0000 7f45f99c7700 1 -- 172.21.15.92:0/4273089376 shutdown_connections 2023-10-16T13:12:26.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.815+0000 7f45f99c7700 1 --2- 172.21.15.92:0/4273089376 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45f4105e70 0x7f45f4106250 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:26.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.815+0000 7f45f99c7700 1 --2- 172.21.15.92:0/4273089376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45f4100820 0x7f45f410cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:26.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.815+0000 7f45f99c7700 1 --2- 172.21.15.92:0/4273089376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45f40ffe60 0x7f45f41002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:26.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.815+0000 7f45f99c7700 1 -- 172.21.15.92:0/4273089376 >> 172.21.15.92:0/4273089376 conn(0x7f45f4075e00 msgr2=0x7f45f4076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:26.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.815+0000 7f45f99c7700 1 -- 172.21.15.92:0/4273089376 shutdown_connections 2023-10-16T13:12:26.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.815+0000 7f45f99c7700 1 -- 172.21.15.92:0/4273089376 wait complete. 2023-10-16T13:12:26.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.815+0000 7f45f99c7700 1 Processor -- start 2023-10-16T13:12:26.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.816+0000 7f45f99c7700 1 -- start start 2023-10-16T13:12:26.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.816+0000 7f45f99c7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45f40ffe60 0x7f45f4101ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:26.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.816+0000 7f45f99c7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45f4100820 0x7f45f4102020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:26.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.816+0000 7f45f99c7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45f4105e70 0x7f45f41a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:26.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.816+0000 7f45f99c7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f4102910 con 0x7f45f4105e70 2023-10-16T13:12:26.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.816+0000 7f45f99c7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f41a57a0 con 0x7f45f4100820 2023-10-16T13:12:26.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.816+0000 7f45f99c7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f41a5910 con 0x7f45f40ffe60 2023-10-16T13:12:26.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.816+0000 7f45f37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45f4105e70 0x7f45f41a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:26.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.816+0000 7f45f37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45f4105e70 0x7f45f41a5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35808/0 (socket says 172.21.15.92:35808) 2023-10-16T13:12:26.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.816+0000 7f45f37fe700 1 -- 172.21.15.92:0/1354994173 learned_addr learned my addr 172.21.15.92:0/1354994173 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:26.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.816+0000 7f45f2ffd700 1 --2- 172.21.15.92:0/1354994173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45f40ffe60 0x7f45f4101ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:26.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.816+0000 7f45f37fe700 1 -- 172.21.15.92:0/1354994173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45f40ffe60 msgr2=0x7f45f4101ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:26.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.816+0000 7f45f37fe700 1 --2- 172.21.15.92:0/1354994173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45f40ffe60 0x7f45f4101ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:26.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.816+0000 7f45f37fe700 1 -- 172.21.15.92:0/1354994173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45f4100820 msgr2=0x7f45f4102020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:26.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.816+0000 7f45f27fc700 1 --2- 172.21.15.92:0/1354994173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45f4100820 0x7f45f4102020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:26.826 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.816+0000 7f45f37fe700 1 --2- 172.21.15.92:0/1354994173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45f4100820 0x7f45f4102020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:26.826 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.816+0000 7f45f37fe700 1 -- 172.21.15.92:0/1354994173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e40095f0 con 0x7f45f4105e70 2023-10-16T13:12:26.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.816+0000 7f45f2ffd700 1 --2- 172.21.15.92:0/1354994173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45f40ffe60 0x7f45f4101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:12:26.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.817+0000 7f45f37fe700 1 --2- 172.21.15.92:0/1354994173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45f4105e70 0x7f45f41a5260 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f45ec007ee0 tx=0x7f45ec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:26.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.817+0000 7f45f89c5700 1 -- 172.21.15.92:0/1354994173 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec017070 con 0x7f45f4105e70 2023-10-16T13:12:26.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.817+0000 7f45f89c5700 1 -- 172.21.15.92:0/1354994173 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f45ec00f040 con 0x7f45f4105e70 2023-10-16T13:12:26.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.817+0000 7f45f99c7700 1 -- 172.21.15.92:0/1354994173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f41a5b90 con 0x7f45f4105e70 2023-10-16T13:12:26.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.817+0000 7f45f89c5700 1 -- 172.21.15.92:0/1354994173 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec005740 con 0x7f45f4105e70 2023-10-16T13:12:26.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.817+0000 7f45f99c7700 1 -- 172.21.15.92:0/1354994173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f41a6040 con 0x7f45f4105e70 2023-10-16T13:12:26.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.818+0000 7f45f99c7700 1 -- 172.21.15.92:0/1354994173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f404ebb0 con 0x7f45f4105e70 2023-10-16T13:12:26.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.819+0000 7f45f89c5700 1 -- 172.21.15.92:0/1354994173 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f45ec0058e0 con 0x7f45f4105e70 2023-10-16T13:12:26.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.819+0000 7f45f89c5700 1 --2- 172.21.15.92:0/1354994173 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f45dc0a1510 0x7f45dc0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:26.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.820+0000 7f45f2ffd700 1 --2- 172.21.15.92:0/1354994173 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f45dc0a1510 0x7f45dc0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:26.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.820+0000 7f45f89c5700 1 -- 172.21.15.92:0/1354994173 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f45ec0cc470 con 0x7f45f4105e70 2023-10-16T13:12:26.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.820+0000 7f45f2ffd700 1 --2- 172.21.15.92:0/1354994173 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f45dc0a1510 0x7f45dc0a39d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009fd0 tx=0x7f45e4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:26.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:26.824+0000 7f45f89c5700 1 -- 172.21.15.92:0/1354994173 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f45ec095b20 con 0x7f45f4105e70 2023-10-16T13:12:26.945 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411385 got 77309411388 for osd.2 2023-10-16T13:12:26.945 DEBUG:teuthology.parallel:result is None 2023-10-16T13:12:27.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.023+0000 7f45f99c7700 1 -- 172.21.15.92:0/1354994173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f45f4103010 con 0x7f45f4105e70 2023-10-16T13:12:27.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.024+0000 7f45f89c5700 1 -- 172.21.15.92:0/1354994173 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f45ec099140 con 0x7f45f4105e70 2023-10-16T13:12:27.027 INFO:teuthology.orchestra.run.smithi092.stdout:163208757295 2023-10-16T13:12:27.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.026+0000 7f45f99c7700 1 -- 172.21.15.92:0/1354994173 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f45dc0a1510 msgr2=0x7f45dc0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:27.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.026+0000 7f45f99c7700 1 --2- 172.21.15.92:0/1354994173 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f45dc0a1510 0x7f45dc0a39d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009fd0 tx=0x7f45e4005fd0 comp rx=0 tx=0).stop 2023-10-16T13:12:27.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.026+0000 7f45f99c7700 1 -- 172.21.15.92:0/1354994173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45f4105e70 msgr2=0x7f45f41a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:27.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.026+0000 7f45f99c7700 1 --2- 172.21.15.92:0/1354994173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45f4105e70 0x7f45f41a5260 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f45ec007ee0 tx=0x7f45ec00d3b0 comp rx=0 tx=0).stop 2023-10-16T13:12:27.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.026+0000 7f45f99c7700 1 -- 172.21.15.92:0/1354994173 shutdown_connections 2023-10-16T13:12:27.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.026+0000 7f45f99c7700 1 --2- 172.21.15.92:0/1354994173 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f45dc0a1510 0x7f45dc0a39d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:27.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.026+0000 7f45f99c7700 1 --2- 172.21.15.92:0/1354994173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45f4105e70 0x7f45f41a5260 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:27.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.026+0000 7f45f99c7700 1 --2- 172.21.15.92:0/1354994173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45f40ffe60 0x7f45f4101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:27.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.026+0000 7f45f99c7700 1 --2- 172.21.15.92:0/1354994173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45f4100820 0x7f45f4102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:27.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.026+0000 7f45f99c7700 1 -- 172.21.15.92:0/1354994173 >> 172.21.15.92:0/1354994173 conn(0x7f45f4075e00 msgr2=0x7f45f4068a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:27.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.026+0000 7f45f99c7700 1 -- 172.21.15.92:0/1354994173 shutdown_connections 2023-10-16T13:12:27.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.026+0000 7f45f99c7700 1 -- 172.21.15.92:0/1354994173 wait complete. 2023-10-16T13:12:27.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.325+0000 7f3e67d09700 1 -- 172.21.15.92:0/1892207571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e60106250 msgr2=0x7f3e6010de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:27.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.325+0000 7f3e67d09700 1 --2- 172.21.15.92:0/1892207571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e60106250 0x7f3e6010de20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800b0a0 tx=0x7f3e5800b3b0 comp rx=0 tx=0).stop 2023-10-16T13:12:27.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.325+0000 7f3e67d09700 1 -- 172.21.15.92:0/1892207571 shutdown_connections 2023-10-16T13:12:27.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.325+0000 7f3e67d09700 1 --2- 172.21.15.92:0/1892207571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e60106250 0x7f3e6010de20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:27.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.325+0000 7f3e67d09700 1 --2- 172.21.15.92:0/1892207571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e60101170 0x7f3e60101550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:27.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.325+0000 7f3e67d09700 1 --2- 172.21.15.92:0/1892207571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e60101b20 0x7f3e60105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:27.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.325+0000 7f3e67d09700 1 -- 172.21.15.92:0/1892207571 >> 172.21.15.92:0/1892207571 conn(0x7f3e600fc9a0 msgr2=0x7f3e600fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:27.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.325+0000 7f3e67d09700 1 -- 172.21.15.92:0/1892207571 shutdown_connections 2023-10-16T13:12:27.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.325+0000 7f3e67d09700 1 -- 172.21.15.92:0/1892207571 wait complete. 2023-10-16T13:12:27.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.325+0000 7f3e67d09700 1 Processor -- start 2023-10-16T13:12:27.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.326+0000 7f3e67d09700 1 -- start start 2023-10-16T13:12:27.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.326+0000 7f3e67d09700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e60101170 0x7f3e601971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:27.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.326+0000 7f3e67d09700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e60101b20 0x7f3e60197710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:27.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.326+0000 7f3e67d09700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e60106250 0x7f3e6019bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:27.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.326+0000 7f3e67d09700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6019c190 con 0x7f3e60101b20 2023-10-16T13:12:27.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.326+0000 7f3e67d09700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6019c300 con 0x7f3e60106250 2023-10-16T13:12:27.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.326+0000 7f3e67d09700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6019c4c0 con 0x7f3e60101170 2023-10-16T13:12:27.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.326+0000 7f3e652a4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e60101b20 0x7f3e60197710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:27.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.326+0000 7f3e652a4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e60101b20 0x7f3e60197710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35820/0 (socket says 172.21.15.92:35820) 2023-10-16T13:12:27.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.326+0000 7f3e652a4700 1 -- 172.21.15.92:0/168620950 learned_addr learned my addr 172.21.15.92:0/168620950 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:27.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.326+0000 7f3e65aa5700 1 --2- 172.21.15.92:0/168620950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e60101170 0x7f3e601971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:27.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.326+0000 7f3e662a6700 1 --2- 172.21.15.92:0/168620950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e60106250 0x7f3e6019bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:27.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.326+0000 7f3e652a4700 1 -- 172.21.15.92:0/168620950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e60101170 msgr2=0x7f3e601971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:27.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.326+0000 7f3e652a4700 1 --2- 172.21.15.92:0/168620950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e60101170 0x7f3e601971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:27.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.326+0000 7f3e652a4700 1 -- 172.21.15.92:0/168620950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e60106250 msgr2=0x7f3e6019bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:27.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.326+0000 7f3e652a4700 1 --2- 172.21.15.92:0/168620950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e60106250 0x7f3e6019bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:27.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.326+0000 7f3e652a4700 1 -- 172.21.15.92:0/168620950 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e58009d00 con 0x7f3e60101b20 2023-10-16T13:12:27.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.326+0000 7f3e662a6700 1 --2- 172.21.15.92:0/168620950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e60106250 0x7f3e6019bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:12:27.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.326+0000 7f3e652a4700 1 --2- 172.21.15.92:0/168620950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e60101b20 0x7f3e60197710 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000d980 tx=0x7f3e5000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:27.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.327+0000 7f3e56ffd700 1 -- 172.21.15.92:0/168620950 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e50009b40 con 0x7f3e60101b20 2023-10-16T13:12:27.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.327+0000 7f3e67d09700 1 -- 172.21.15.92:0/168620950 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e6019c7a0 con 0x7f3e60101b20 2023-10-16T13:12:27.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.327+0000 7f3e56ffd700 1 -- 172.21.15.92:0/168620950 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3e5000de60 con 0x7f3e60101b20 2023-10-16T13:12:27.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.327+0000 7f3e56ffd700 1 -- 172.21.15.92:0/168620950 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000f6b0 con 0x7f3e60101b20 2023-10-16T13:12:27.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.327+0000 7f3e67d09700 1 -- 172.21.15.92:0/168620950 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e601a4000 con 0x7f3e60101b20 2023-10-16T13:12:27.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.328+0000 7f3e67d09700 1 -- 172.21.15.92:0/168620950 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e6004ebb0 con 0x7f3e60101b20 2023-10-16T13:12:27.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.329+0000 7f3e56ffd700 1 -- 172.21.15.92:0/168620950 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f3e50009ca0 con 0x7f3e60101b20 2023-10-16T13:12:27.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.329+0000 7f3e56ffd700 1 --2- 172.21.15.92:0/168620950 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3e4c0a1510 0x7f3e4c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:27.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.329+0000 7f3e56ffd700 1 -- 172.21.15.92:0/168620950 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3e500cc840 con 0x7f3e60101b20 2023-10-16T13:12:27.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.329+0000 7f3e65aa5700 1 --2- 172.21.15.92:0/168620950 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3e4c0a1510 0x7f3e4c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:27.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.330+0000 7f3e65aa5700 1 --2- 172.21.15.92:0/168620950 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3e4c0a1510 0x7f3e4c0a39d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c005950 tx=0x7f3e5c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:27.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.333+0000 7f3e56ffd700 1 -- 172.21.15.92:0/168620950 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3e50095ef0 con 0x7f3e60101b20 2023-10-16T13:12:27.346 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841563 got 283467841566 for osd.9 2023-10-16T13:12:27.346 DEBUG:teuthology.parallel:result is None 2023-10-16T13:12:27.365 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:27.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.537+0000 7f3e67d09700 1 -- 172.21.15.92:0/168620950 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3e6019c990 con 0x7f3e60101b20 2023-10-16T13:12:27.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.538+0000 7f3e56ffd700 1 -- 172.21.15.92:0/168620950 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3e50017090 con 0x7f3e60101b20 2023-10-16T13:12:27.541 INFO:teuthology.orchestra.run.smithi092.stdout:55834574911 2023-10-16T13:12:27.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.540+0000 7f3e67d09700 1 -- 172.21.15.92:0/168620950 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3e4c0a1510 msgr2=0x7f3e4c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:27.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.540+0000 7f3e67d09700 1 --2- 172.21.15.92:0/168620950 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3e4c0a1510 0x7f3e4c0a39d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c005950 tx=0x7f3e5c0058e0 comp rx=0 tx=0).stop 2023-10-16T13:12:27.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.540+0000 7f3e67d09700 1 -- 172.21.15.92:0/168620950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e60101b20 msgr2=0x7f3e60197710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:27.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.540+0000 7f3e67d09700 1 --2- 172.21.15.92:0/168620950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e60101b20 0x7f3e60197710 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000d980 tx=0x7f3e5000dd40 comp rx=0 tx=0).stop 2023-10-16T13:12:27.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.540+0000 7f3e67d09700 1 -- 172.21.15.92:0/168620950 shutdown_connections 2023-10-16T13:12:27.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.540+0000 7f3e67d09700 1 --2- 172.21.15.92:0/168620950 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3e4c0a1510 0x7f3e4c0a39d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:27.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.540+0000 7f3e67d09700 1 --2- 172.21.15.92:0/168620950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e60106250 0x7f3e6019bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:27.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.540+0000 7f3e67d09700 1 --2- 172.21.15.92:0/168620950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e60101170 0x7f3e601971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:27.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.540+0000 7f3e67d09700 1 --2- 172.21.15.92:0/168620950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e60101b20 0x7f3e60197710 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:27.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.540+0000 7f3e67d09700 1 -- 172.21.15.92:0/168620950 >> 172.21.15.92:0/168620950 conn(0x7f3e600fc9a0 msgr2=0x7f3e600fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:27.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.540+0000 7f3e67d09700 1 -- 172.21.15.92:0/168620950 shutdown_connections 2023-10-16T13:12:27.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:27.540+0000 7f3e67d09700 1 -- 172.21.15.92:0/168620950 wait complete. 2023-10-16T13:12:27.567 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:27 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1354994173' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-16T13:12:27.578 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920815 got 141733920818 for osd.4 2023-10-16T13:12:27.578 DEBUG:teuthology.parallel:result is None 2023-10-16T13:12:27.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:27 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1354994173' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-16T13:12:27.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:27 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1354994173' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-16T13:12:28.239 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757292 got 163208757295 for osd.5 2023-10-16T13:12:28.240 DEBUG:teuthology.parallel:result is None 2023-10-16T13:12:28.241 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574907 got 55834574911 for osd.1 2023-10-16T13:12:28.241 DEBUG:teuthology.parallel:result is None 2023-10-16T13:12:28.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:28 smithi092 ceph-mon[99542]: pgmap v279: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-16T13:12:28.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:28 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/168620950' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-16T13:12:28.692 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332131 got 219043332133 for osd.7 2023-10-16T13:12:28.692 DEBUG:teuthology.parallel:result is None 2023-10-16T13:12:28.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:28 smithi152 ceph-mon[104423]: pgmap v279: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-16T13:12:28.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:28 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/168620950' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-16T13:12:28.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:28 smithi118 ceph-mon[103969]: pgmap v279: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-16T13:12:28.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:28 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/168620950' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-16T13:12:29.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.574+0000 7f39758aa700 1 -- 172.21.15.92:0/4211158097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3970101b30 msgr2=0x7f3970105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:29.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.574+0000 7f39758aa700 1 --2- 172.21.15.92:0/4211158097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3970101b30 0x7f3970105b80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3964009990 tx=0x7f3964009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:29.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.574+0000 7f39758aa700 1 -- 172.21.15.92:0/4211158097 shutdown_connections 2023-10-16T13:12:29.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.574+0000 7f39758aa700 1 --2- 172.21.15.92:0/4211158097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3970106260 0x7f397010de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:29.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.574+0000 7f39758aa700 1 --2- 172.21.15.92:0/4211158097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3970101180 0x7f3970101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:29.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.575+0000 7f39758aa700 1 --2- 172.21.15.92:0/4211158097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3970101b30 0x7f3970105b80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:29.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.575+0000 7f39758aa700 1 -- 172.21.15.92:0/4211158097 >> 172.21.15.92:0/4211158097 conn(0x7f39700fc9d0 msgr2=0x7f39700fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:29.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.575+0000 7f39758aa700 1 -- 172.21.15.92:0/4211158097 shutdown_connections 2023-10-16T13:12:29.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.575+0000 7f39758aa700 1 -- 172.21.15.92:0/4211158097 wait complete. 2023-10-16T13:12:29.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.575+0000 7f39758aa700 1 Processor -- start 2023-10-16T13:12:29.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.575+0000 7f39758aa700 1 -- start start 2023-10-16T13:12:29.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f39758aa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3970101180 0x7f3970197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:29.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f39758aa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3970101b30 0x7f39701976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:29.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f39758aa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3970106260 0x7f397019bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:29.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f39758aa700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397019c130 con 0x7f3970101b30 2023-10-16T13:12:29.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f39758aa700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397019c2a0 con 0x7f3970101180 2023-10-16T13:12:29.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f39758aa700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397019c460 con 0x7f3970106260 2023-10-16T13:12:29.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f396e7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3970101b30 0x7f39701976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:29.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f396e7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3970101b30 0x7f39701976b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35832/0 (socket says 172.21.15.92:35832) 2023-10-16T13:12:29.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f396e7fc700 1 -- 172.21.15.92:0/2405830108 learned_addr learned my addr 172.21.15.92:0/2405830108 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:29.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f396e7fc700 1 -- 172.21.15.92:0/2405830108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3970106260 msgr2=0x7f397019bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:29.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f396f7fe700 1 --2- 172.21.15.92:0/2405830108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3970106260 0x7f397019bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:29.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f396effd700 1 --2- 172.21.15.92:0/2405830108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3970101180 0x7f3970197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:29.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f396e7fc700 1 --2- 172.21.15.92:0/2405830108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3970106260 0x7f397019bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:29.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f396e7fc700 1 -- 172.21.15.92:0/2405830108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3970101180 msgr2=0x7f3970197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:29.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f396e7fc700 1 --2- 172.21.15.92:0/2405830108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3970101180 0x7f3970197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:29.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f396e7fc700 1 -- 172.21.15.92:0/2405830108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39640095f0 con 0x7f3970101b30 2023-10-16T13:12:29.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f396f7fe700 1 --2- 172.21.15.92:0/2405830108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3970106260 0x7f397019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:12:29.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f396effd700 1 --2- 172.21.15.92:0/2405830108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3970101180 0x7f3970197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:12:29.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f396e7fc700 1 --2- 172.21.15.92:0/2405830108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3970101b30 0x7f39701976b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f39640095c0 tx=0x7f396400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:29.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f39748a8700 1 -- 172.21.15.92:0/2405830108 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396401d070 con 0x7f3970101b30 2023-10-16T13:12:29.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f39758aa700 1 -- 172.21.15.92:0/2405830108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397019c6e0 con 0x7f3970101b30 2023-10-16T13:12:29.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f39748a8700 1 -- 172.21.15.92:0/2405830108 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3964003680 con 0x7f3970101b30 2023-10-16T13:12:29.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f39748a8700 1 -- 172.21.15.92:0/2405830108 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39640173f0 con 0x7f3970101b30 2023-10-16T13:12:29.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.576+0000 7f39758aa700 1 -- 172.21.15.92:0/2405830108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39701a3fa0 con 0x7f3970101b30 2023-10-16T13:12:29.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.577+0000 7f39758aa700 1 -- 172.21.15.92:0/2405830108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f397004ebb0 con 0x7f3970101b30 2023-10-16T13:12:29.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.578+0000 7f39748a8700 1 -- 172.21.15.92:0/2405830108 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f396400fd10 con 0x7f3970101b30 2023-10-16T13:12:29.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.579+0000 7f39748a8700 1 --2- 172.21.15.92:0/2405830108 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f39580a1510 0x7f39580a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:29.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.579+0000 7f396effd700 1 --2- 172.21.15.92:0/2405830108 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f39580a1510 0x7f39580a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:29.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.579+0000 7f39748a8700 1 -- 172.21.15.92:0/2405830108 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f39640ce370 con 0x7f3970101b30 2023-10-16T13:12:29.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.579+0000 7f396effd700 1 --2- 172.21.15.92:0/2405830108 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f39580a1510 0x7f39580a39d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3960005fd0 tx=0x7f3960005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:29.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.582+0000 7f39748a8700 1 -- 172.21.15.92:0/2405830108 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3964097ab0 con 0x7f3970101b30 2023-10-16T13:12:29.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.774+0000 7f39758aa700 1 -- 172.21.15.92:0/2405830108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f3970110fb0 con 0x7f3970101b30 2023-10-16T13:12:29.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.775+0000 7f39748a8700 1 -- 172.21.15.92:0/2405830108 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f396409b0d0 con 0x7f3970101b30 2023-10-16T13:12:29.778 INFO:teuthology.orchestra.run.smithi092.stdout:253403070498 2023-10-16T13:12:29.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.777+0000 7f39758aa700 1 -- 172.21.15.92:0/2405830108 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f39580a1510 msgr2=0x7f39580a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:29.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.777+0000 7f39758aa700 1 --2- 172.21.15.92:0/2405830108 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f39580a1510 0x7f39580a39d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3960005fd0 tx=0x7f3960005dc0 comp rx=0 tx=0).stop 2023-10-16T13:12:29.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.777+0000 7f39758aa700 1 -- 172.21.15.92:0/2405830108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3970101b30 msgr2=0x7f39701976b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:29.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.777+0000 7f39758aa700 1 --2- 172.21.15.92:0/2405830108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3970101b30 0x7f39701976b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f39640095c0 tx=0x7f396400f690 comp rx=0 tx=0).stop 2023-10-16T13:12:29.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.777+0000 7f39758aa700 1 -- 172.21.15.92:0/2405830108 shutdown_connections 2023-10-16T13:12:29.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.777+0000 7f39758aa700 1 --2- 172.21.15.92:0/2405830108 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f39580a1510 0x7f39580a39d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:29.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.777+0000 7f39758aa700 1 --2- 172.21.15.92:0/2405830108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3970106260 0x7f397019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:29.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.777+0000 7f39758aa700 1 --2- 172.21.15.92:0/2405830108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3970101180 0x7f3970197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:29.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.777+0000 7f39758aa700 1 --2- 172.21.15.92:0/2405830108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3970101b30 0x7f39701976b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:29.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.777+0000 7f39758aa700 1 -- 172.21.15.92:0/2405830108 >> 172.21.15.92:0/2405830108 conn(0x7f39700fc9d0 msgr2=0x7f39700fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:29.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.777+0000 7f39758aa700 1 -- 172.21.15.92:0/2405830108 shutdown_connections 2023-10-16T13:12:29.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:29.777+0000 7f39758aa700 1 -- 172.21.15.92:0/2405830108 wait complete. 2023-10-16T13:12:30.219 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070495 got 253403070498 for osd.8 2023-10-16T13:12:30.220 DEBUG:teuthology.parallel:result is None 2023-10-16T13:12:30.220 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-10-16T13:12:30.221 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph pg dump --format=json 2023-10-16T13:12:30.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:30 smithi092 ceph-mon[99542]: pgmap v280: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-16T13:12:30.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:30 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2405830108' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-16T13:12:30.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:30 smithi152 ceph-mon[104423]: pgmap v280: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-16T13:12:30.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:30 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2405830108' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-16T13:12:30.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:30 smithi118 ceph-mon[103969]: pgmap v280: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-16T13:12:30.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:30 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2405830108' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-16T13:12:30.784 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:32.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.087+0000 7f344820d700 1 -- 172.21.15.92:0/3385167237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3440104e30 msgr2=0x7f3440105210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:32.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.087+0000 7f344820d700 1 --2- 172.21.15.92:0/3385167237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3440104e30 0x7f3440105210 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f34300099c0 tx=0x7f3430009cd0 comp rx=0 tx=0).stop 2023-10-16T13:12:32.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.087+0000 7f344820d700 1 -- 172.21.15.92:0/3385167237 shutdown_connections 2023-10-16T13:12:32.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.087+0000 7f344820d700 1 --2- 172.21.15.92:0/3385167237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3440104e30 0x7f3440105210 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:32.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.087+0000 7f344820d700 1 --2- 172.21.15.92:0/3385167237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3440100f20 0x7f344010ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:32.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.087+0000 7f344820d700 1 --2- 172.21.15.92:0/3385167237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3440100560 0x7f34401009e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:32.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.087+0000 7f344820d700 1 -- 172.21.15.92:0/3385167237 >> 172.21.15.92:0/3385167237 conn(0x7f3440076360 msgr2=0x7f34400fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:32.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.087+0000 7f344820d700 1 -- 172.21.15.92:0/3385167237 shutdown_connections 2023-10-16T13:12:32.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.087+0000 7f344820d700 1 -- 172.21.15.92:0/3385167237 wait complete. 2023-10-16T13:12:32.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.088+0000 7f344820d700 1 Processor -- start 2023-10-16T13:12:32.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.088+0000 7f344820d700 1 -- start start 2023-10-16T13:12:32.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.088+0000 7f344820d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3440100560 0x7f3440197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:32.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.088+0000 7f344820d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3440100f20 0x7f3440197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:32.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.088+0000 7f344820d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3440104e30 0x7f344019bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:32.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.088+0000 7f344820d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344019c0d0 con 0x7f3440100560 2023-10-16T13:12:32.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.088+0000 7f344820d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344019c240 con 0x7f3440104e30 2023-10-16T13:12:32.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.088+0000 7f344820d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344019c400 con 0x7f3440100f20 2023-10-16T13:12:32.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.088+0000 7f3445fa9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3440100560 0x7f3440197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:32.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.088+0000 7f3445fa9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3440100560 0x7f3440197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35842/0 (socket says 172.21.15.92:35842) 2023-10-16T13:12:32.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.088+0000 7f3445fa9700 1 -- 172.21.15.92:0/3142575124 learned_addr learned my addr 172.21.15.92:0/3142575124 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:32.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.088+0000 7f34457a8700 1 --2- 172.21.15.92:0/3142575124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3440100f20 0x7f3440197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:32.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.088+0000 7f34467aa700 1 --2- 172.21.15.92:0/3142575124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3440104e30 0x7f344019bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:32.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.088+0000 7f3445fa9700 1 -- 172.21.15.92:0/3142575124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3440100f20 msgr2=0x7f3440197650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:32.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.088+0000 7f3445fa9700 1 --2- 172.21.15.92:0/3142575124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3440100f20 0x7f3440197650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:32.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.088+0000 7f3445fa9700 1 -- 172.21.15.92:0/3142575124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3440104e30 msgr2=0x7f344019bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:32.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.088+0000 7f3445fa9700 1 --2- 172.21.15.92:0/3142575124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3440104e30 0x7f344019bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:32.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.088+0000 7f3445fa9700 1 -- 172.21.15.92:0/3142575124 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34300095f0 con 0x7f3440100560 2023-10-16T13:12:32.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.088+0000 7f34467aa700 1 --2- 172.21.15.92:0/3142575124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3440104e30 0x7f344019bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:12:32.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.089+0000 7f3445fa9700 1 --2- 172.21.15.92:0/3142575124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3440100560 0x7f3440197110 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f343000b580 tx=0x7f3430005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:32.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.089+0000 7f3436ffd700 1 -- 172.21.15.92:0/3142575124 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343001d070 con 0x7f3440100560 2023-10-16T13:12:32.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.089+0000 7f344820d700 1 -- 172.21.15.92:0/3142575124 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f344019c680 con 0x7f3440100560 2023-10-16T13:12:32.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.089+0000 7f3436ffd700 1 -- 172.21.15.92:0/3142575124 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f34300040a0 con 0x7f3440100560 2023-10-16T13:12:32.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.089+0000 7f3436ffd700 1 -- 172.21.15.92:0/3142575124 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430022e20 con 0x7f3440100560 2023-10-16T13:12:32.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.089+0000 7f344820d700 1 -- 172.21.15.92:0/3142575124 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34401a3f40 con 0x7f3440100560 2023-10-16T13:12:32.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.090+0000 7f344820d700 1 -- 172.21.15.92:0/3142575124 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344004ebb0 con 0x7f3440100560 2023-10-16T13:12:32.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.091+0000 7f3436ffd700 1 -- 172.21.15.92:0/3142575124 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f3430022470 con 0x7f3440100560 2023-10-16T13:12:32.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.091+0000 7f3436ffd700 1 --2- 172.21.15.92:0/3142575124 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f342c0a1510 0x7f342c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:32.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.091+0000 7f34457a8700 1 --2- 172.21.15.92:0/3142575124 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f342c0a1510 0x7f342c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:32.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.091+0000 7f3436ffd700 1 -- 172.21.15.92:0/3142575124 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f34300ce0e0 con 0x7f3440100560 2023-10-16T13:12:32.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.092+0000 7f34457a8700 1 --2- 172.21.15.92:0/3142575124 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f342c0a1510 0x7f342c0a39d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3440198730 tx=0x7f343c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:32.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.096+0000 7f3436ffd700 1 -- 172.21.15.92:0/3142575124 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3430097940 con 0x7f3440100560 2023-10-16T13:12:32.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.279+0000 7f344820d700 1 -- 172.21.15.92:0/3142575124 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f344010ffc0 con 0x7f342c0a1510 2023-10-16T13:12:32.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.289+0000 7f3436ffd700 1 -- 172.21.15.92:0/3142575124 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+341213 (secure 0 0 0) 0x7f344010ffc0 con 0x7f342c0a1510 2023-10-16T13:12:32.296 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:12:32.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.292+0000 7f344820d700 1 -- 172.21.15.92:0/3142575124 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f342c0a1510 msgr2=0x7f342c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:32.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.292+0000 7f344820d700 1 --2- 172.21.15.92:0/3142575124 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f342c0a1510 0x7f342c0a39d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3440198730 tx=0x7f343c00a300 comp rx=0 tx=0).stop 2023-10-16T13:12:32.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.292+0000 7f344820d700 1 -- 172.21.15.92:0/3142575124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3440100560 msgr2=0x7f3440197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:32.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.292+0000 7f344820d700 1 --2- 172.21.15.92:0/3142575124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3440100560 0x7f3440197110 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f343000b580 tx=0x7f3430005e80 comp rx=0 tx=0).stop 2023-10-16T13:12:32.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.292+0000 7f344820d700 1 -- 172.21.15.92:0/3142575124 shutdown_connections 2023-10-16T13:12:32.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.292+0000 7f344820d700 1 --2- 172.21.15.92:0/3142575124 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f342c0a1510 0x7f342c0a39d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:32.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.292+0000 7f344820d700 1 --2- 172.21.15.92:0/3142575124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3440100560 0x7f3440197110 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:32.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.292+0000 7f344820d700 1 --2- 172.21.15.92:0/3142575124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3440104e30 0x7f344019bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:32.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.292+0000 7f344820d700 1 --2- 172.21.15.92:0/3142575124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3440100f20 0x7f3440197650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:32.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.292+0000 7f344820d700 1 -- 172.21.15.92:0/3142575124 >> 172.21.15.92:0/3142575124 conn(0x7f3440076360 msgr2=0x7f34400fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:32.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.292+0000 7f344820d700 1 -- 172.21.15.92:0/3142575124 shutdown_connections 2023-10-16T13:12:32.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:32.292+0000 7f344820d700 1 -- 172.21.15.92:0/3142575124 wait complete. 2023-10-16T13:12:32.301 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-10-16T13:12:32.687 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:32 smithi092 ceph-mon[99542]: pgmap v281: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-10-16T13:12:32.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:32 smithi152 ceph-mon[104423]: pgmap v281: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-10-16T13:12:32.743 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2023-10-16T13:12:31.271663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655362,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":599,"num_read_kb":419,"num_write":418,"num_write_kb":3070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":344,"ondisk_log_size":344,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336904,"kb_used_data":12712,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604920,"statfs":{"total":1151940427776,"available":1151595438080,"internally_reserved":0,"allocated":13017088,"data_stored":7065474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19128,"internal_metadata":331855176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":75,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002662"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228907+0000","last_change":"2023-10-16T13:11:40.980978+0000","last_active":"2023-10-16T13:11:43.228907+0000","last_peered":"2023-10-16T13:11:43.228907+0000","last_clean":"2023-10-16T13:11:43.228907+0000","last_became_active":"2023-10-16T13:11:40.980468+0000","last_became_peered":"2023-10-16T13:11:40.980468+0000","last_unstale":"2023-10-16T13:11:43.228907+0000","last_undegraded":"2023-10-16T13:11:43.228907+0000","last_fullsized":"2023-10-16T13:11:43.228907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.261864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717598+0000","last_change":"2023-10-16T13:11:40.971625+0000","last_active":"2023-10-16T13:11:42.717598+0000","last_peered":"2023-10-16T13:11:42.717598+0000","last_clean":"2023-10-16T13:11:42.717598+0000","last_became_active":"2023-10-16T13:11:40.971028+0000","last_became_peered":"2023-10-16T13:11:40.971028+0000","last_unstale":"2023-10-16T13:11:42.717598+0000","last_undegraded":"2023-10-16T13:11:42.717598+0000","last_fullsized":"2023-10-16T13:11:42.717598+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:08.974553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717498+0000","last_change":"2023-10-16T13:11:40.973705+0000","last_active":"2023-10-16T13:11:42.717498+0000","last_peered":"2023-10-16T13:11:42.717498+0000","last_clean":"2023-10-16T13:11:42.717498+0000","last_became_active":"2023-10-16T13:11:40.973347+0000","last_became_peered":"2023-10-16T13:11:40.973347+0000","last_unstale":"2023-10-16T13:11:42.717498+0000","last_undegraded":"2023-10-16T13:11:42.717498+0000","last_fullsized":"2023-10-16T13:11:42.717498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:46.628383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.938443+0000","last_change":"2023-10-16T13:11:40.974996+0000","last_active":"2023-10-16T13:11:42.938443+0000","last_peered":"2023-10-16T13:11:42.938443+0000","last_clean":"2023-10-16T13:11:42.938443+0000","last_became_active":"2023-10-16T13:11:40.973807+0000","last_became_peered":"2023-10-16T13:11:40.973807+0000","last_unstale":"2023-10-16T13:11:42.938443+0000","last_undegraded":"2023-10-16T13:11:42.938443+0000","last_fullsized":"2023-10-16T13:11:42.938443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:02:14.901036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228247+0000","last_change":"2023-10-16T13:11:40.976558+0000","last_active":"2023-10-16T13:11:43.228247+0000","last_peered":"2023-10-16T13:11:43.228247+0000","last_clean":"2023-10-16T13:11:43.228247+0000","last_became_active":"2023-10-16T13:11:40.976159+0000","last_became_peered":"2023-10-16T13:11:40.976159+0000","last_unstale":"2023-10-16T13:11:43.228247+0000","last_undegraded":"2023-10-16T13:11:43.228247+0000","last_fullsized":"2023-10-16T13:11:43.228247+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:58:16.532294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.227919+0000","last_change":"2023-10-16T13:11:40.977510+0000","last_active":"2023-10-16T13:11:43.227919+0000","last_peered":"2023-10-16T13:11:43.227919+0000","last_clean":"2023-10-16T13:11:43.227919+0000","last_became_active":"2023-10-16T13:11:40.977184+0000","last_became_peered":"2023-10-16T13:11:40.977184+0000","last_unstale":"2023-10-16T13:11:43.227919+0000","last_undegraded":"2023-10-16T13:11:43.227919+0000","last_fullsized":"2023-10-16T13:11:43.227919+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:24:33.215430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972030+0000","last_change":"2023-10-16T13:11:40.969982+0000","last_active":"2023-10-16T13:11:42.972030+0000","last_peered":"2023-10-16T13:11:42.972030+0000","last_clean":"2023-10-16T13:11:42.972030+0000","last_became_active":"2023-10-16T13:11:40.969651+0000","last_became_peered":"2023-10-16T13:11:40.969651+0000","last_unstale":"2023-10-16T13:11:42.972030+0000","last_undegraded":"2023-10-16T13:11:42.972030+0000","last_fullsized":"2023-10-16T13:11:42.972030+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:37:01.702748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961091+0000","last_change":"2023-10-16T13:11:40.967952+0000","last_active":"2023-10-16T13:11:41.961091+0000","last_peered":"2023-10-16T13:11:41.961091+0000","last_clean":"2023-10-16T13:11:41.961091+0000","last_became_active":"2023-10-16T13:11:40.967621+0000","last_became_peered":"2023-10-16T13:11:40.967621+0000","last_unstale":"2023-10-16T13:11:41.961091+0000","last_undegraded":"2023-10-16T13:11:41.961091+0000","last_fullsized":"2023-10-16T13:11:41.961091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:04:09.243563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962240+0000","last_change":"2023-10-16T13:11:40.978172+0000","last_active":"2023-10-16T13:11:41.962240+0000","last_peered":"2023-10-16T13:11:41.962240+0000","last_clean":"2023-10-16T13:11:41.962240+0000","last_became_active":"2023-10-16T13:11:40.977727+0000","last_became_peered":"2023-10-16T13:11:40.977727+0000","last_unstale":"2023-10-16T13:11:41.962240+0000","last_undegraded":"2023-10-16T13:11:41.962240+0000","last_fullsized":"2023-10-16T13:11:41.962240+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:06:16.469370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228227+0000","last_change":"2023-10-16T13:11:40.973343+0000","last_active":"2023-10-16T13:11:43.228227+0000","last_peered":"2023-10-16T13:11:43.228227+0000","last_clean":"2023-10-16T13:11:43.228227+0000","last_became_active":"2023-10-16T13:11:40.972997+0000","last_became_peered":"2023-10-16T13:11:40.972997+0000","last_unstale":"2023-10-16T13:11:43.228227+0000","last_undegraded":"2023-10-16T13:11:43.228227+0000","last_fullsized":"2023-10-16T13:11:43.228227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:23:21.235742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972369+0000","last_change":"2023-10-16T13:11:40.980253+0000","last_active":"2023-10-16T13:11:42.972369+0000","last_peered":"2023-10-16T13:11:42.972369+0000","last_clean":"2023-10-16T13:11:42.972369+0000","last_became_active":"2023-10-16T13:11:40.979473+0000","last_became_peered":"2023-10-16T13:11:40.979473+0000","last_unstale":"2023-10-16T13:11:42.972369+0000","last_undegraded":"2023-10-16T13:11:42.972369+0000","last_fullsized":"2023-10-16T13:11:42.972369+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:37:46.976128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.938394+0000","last_change":"2023-10-16T13:11:40.974791+0000","last_active":"2023-10-16T13:11:42.938394+0000","last_peered":"2023-10-16T13:11:42.938394+0000","last_clean":"2023-10-16T13:11:42.938394+0000","last_became_active":"2023-10-16T13:11:40.973353+0000","last_became_peered":"2023-10-16T13:11:40.973353+0000","last_unstale":"2023-10-16T13:11:42.938394+0000","last_undegraded":"2023-10-16T13:11:42.938394+0000","last_fullsized":"2023-10-16T13:11:42.938394+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:35:40.649071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228607+0000","last_change":"2023-10-16T13:11:40.971681+0000","last_active":"2023-10-16T13:11:43.228607+0000","last_peered":"2023-10-16T13:11:43.228607+0000","last_clean":"2023-10-16T13:11:43.228607+0000","last_became_active":"2023-10-16T13:11:40.971349+0000","last_became_peered":"2023-10-16T13:11:40.971349+0000","last_unstale":"2023-10-16T13:11:43.228607+0000","last_undegraded":"2023-10-16T13:11:43.228607+0000","last_fullsized":"2023-10-16T13:11:43.228607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:50:38.285478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717591+0000","last_change":"2023-10-16T13:11:40.971859+0000","last_active":"2023-10-16T13:11:42.717591+0000","last_peered":"2023-10-16T13:11:42.717591+0000","last_clean":"2023-10-16T13:11:42.717591+0000","last_became_active":"2023-10-16T13:11:40.971107+0000","last_became_peered":"2023-10-16T13:11:40.971107+0000","last_unstale":"2023-10-16T13:11:42.717591+0000","last_undegraded":"2023-10-16T13:11:42.717591+0000","last_fullsized":"2023-10-16T13:11:42.717591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:57:52.655130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717282+0000","last_change":"2023-10-16T13:11:40.976604+0000","last_active":"2023-10-16T13:11:42.717282+0000","last_peered":"2023-10-16T13:11:42.717282+0000","last_clean":"2023-10-16T13:11:42.717282+0000","last_became_active":"2023-10-16T13:11:40.976262+0000","last_became_peered":"2023-10-16T13:11:40.976262+0000","last_unstale":"2023-10-16T13:11:42.717282+0000","last_undegraded":"2023-10-16T13:11:42.717282+0000","last_fullsized":"2023-10-16T13:11:42.717282+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:18:55.867316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961792+0000","last_change":"2023-10-16T13:11:40.975785+0000","last_active":"2023-10-16T13:11:41.961792+0000","last_peered":"2023-10-16T13:11:41.961792+0000","last_clean":"2023-10-16T13:11:41.961792+0000","last_became_active":"2023-10-16T13:11:40.975463+0000","last_became_peered":"2023-10-16T13:11:40.975463+0000","last_unstale":"2023-10-16T13:11:41.961792+0000","last_undegraded":"2023-10-16T13:11:41.961792+0000","last_fullsized":"2023-10-16T13:11:41.961792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:37:29.337596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228897+0000","last_change":"2023-10-16T13:11:40.980784+0000","last_active":"2023-10-16T13:11:43.228897+0000","last_peered":"2023-10-16T13:11:43.228897+0000","last_clean":"2023-10-16T13:11:43.228897+0000","last_became_active":"2023-10-16T13:11:40.980374+0000","last_became_peered":"2023-10-16T13:11:40.980374+0000","last_unstale":"2023-10-16T13:11:43.228897+0000","last_undegraded":"2023-10-16T13:11:43.228897+0000","last_fullsized":"2023-10-16T13:11:43.228897+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:38:12.236358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228219+0000","last_change":"2023-10-16T13:11:40.980775+0000","last_active":"2023-10-16T13:11:43.228219+0000","last_peered":"2023-10-16T13:11:43.228219+0000","last_clean":"2023-10-16T13:11:43.228219+0000","last_became_active":"2023-10-16T13:11:40.980261+0000","last_became_peered":"2023-10-16T13:11:40.980261+0000","last_unstale":"2023-10-16T13:11:43.228219+0000","last_undegraded":"2023-10-16T13:11:43.228219+0000","last_fullsized":"2023-10-16T13:11:43.228219+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:36:57.112989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.986406+0000","last_change":"2023-10-16T13:11:40.970030+0000","last_active":"2023-10-16T13:11:42.986406+0000","last_peered":"2023-10-16T13:11:42.986406+0000","last_clean":"2023-10-16T13:11:42.986406+0000","last_became_active":"2023-10-16T13:11:40.969698+0000","last_became_peered":"2023-10-16T13:11:40.969698+0000","last_unstale":"2023-10-16T13:11:42.986406+0000","last_undegraded":"2023-10-16T13:11:42.986406+0000","last_fullsized":"2023-10-16T13:11:42.986406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:42:00.520386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":69,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:12:28.407103+0000","last_change":"2023-10-16T13:11:39.957688+0000","last_active":"2023-10-16T13:12:28.407103+0000","last_peered":"2023-10-16T13:12:28.407103+0000","last_clean":"2023-10-16T13:12:28.407103+0000","last_became_active":"2023-10-16T13:11:39.957391+0000","last_became_peered":"2023-10-16T13:11:39.957391+0000","last_unstale":"2023-10-16T13:12:28.407103+0000","last_undegraded":"2023-10-16T13:12:28.407103+0000","last_fullsized":"2023-10-16T13:12:28.407103+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:42:17.875770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961607+0000","last_change":"2023-10-16T13:11:40.968984+0000","last_active":"2023-10-16T13:11:41.961607+0000","last_peered":"2023-10-16T13:11:41.961607+0000","last_clean":"2023-10-16T13:11:41.961607+0000","last_became_active":"2023-10-16T13:11:40.968338+0000","last_became_peered":"2023-10-16T13:11:40.968338+0000","last_unstale":"2023-10-16T13:11:41.961607+0000","last_undegraded":"2023-10-16T13:11:41.961607+0000","last_fullsized":"2023-10-16T13:11:41.961607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:49:21.643029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961716+0000","last_change":"2023-10-16T13:11:39.959458+0000","last_active":"2023-10-16T13:11:41.961716+0000","last_peered":"2023-10-16T13:11:41.961716+0000","last_clean":"2023-10-16T13:11:41.961716+0000","last_became_active":"2023-10-16T13:11:39.959155+0000","last_became_peered":"2023-10-16T13:11:39.959155+0000","last_unstale":"2023-10-16T13:11:41.961716+0000","last_undegraded":"2023-10-16T13:11:41.961716+0000","last_fullsized":"2023-10-16T13:11:41.961716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:18:30.725604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717655+0000","last_change":"2023-10-16T13:11:40.980168+0000","last_active":"2023-10-16T13:11:42.717655+0000","last_peered":"2023-10-16T13:11:42.717655+0000","last_clean":"2023-10-16T13:11:42.717655+0000","last_became_active":"2023-10-16T13:11:40.979839+0000","last_became_peered":"2023-10-16T13:11:40.979839+0000","last_unstale":"2023-10-16T13:11:42.717655+0000","last_undegraded":"2023-10-16T13:11:42.717655+0000","last_fullsized":"2023-10-16T13:11:42.717655+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:25:31.374291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:48.352370+0000","last_change":"2023-10-16T13:11:39.957065+0000","last_active":"2023-10-16T13:11:48.352370+0000","last_peered":"2023-10-16T13:11:48.352370+0000","last_clean":"2023-10-16T13:11:48.352370+0000","last_became_active":"2023-10-16T13:11:39.956759+0000","last_became_peered":"2023-10-16T13:11:39.956759+0000","last_unstale":"2023-10-16T13:11:48.352370+0000","last_undegraded":"2023-10-16T13:11:48.352370+0000","last_fullsized":"2023-10-16T13:11:48.352370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:06:39.862025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961875+0000","last_change":"2023-10-16T13:11:40.978989+0000","last_active":"2023-10-16T13:11:41.961875+0000","last_peered":"2023-10-16T13:11:41.961875+0000","last_clean":"2023-10-16T13:11:41.961875+0000","last_became_active":"2023-10-16T13:11:40.978582+0000","last_became_peered":"2023-10-16T13:11:40.978582+0000","last_unstale":"2023-10-16T13:11:41.961875+0000","last_undegraded":"2023-10-16T13:11:41.961875+0000","last_fullsized":"2023-10-16T13:11:41.961875+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:29:54.733058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.353465+0000","last_change":"2023-10-16T13:11:39.955340+0000","last_active":"2023-10-16T13:11:47.353465+0000","last_peered":"2023-10-16T13:11:47.353465+0000","last_clean":"2023-10-16T13:11:47.353465+0000","last_became_active":"2023-10-16T13:11:39.955032+0000","last_became_peered":"2023-10-16T13:11:39.955032+0000","last_unstale":"2023-10-16T13:11:47.353465+0000","last_undegraded":"2023-10-16T13:11:47.353465+0000","last_fullsized":"2023-10-16T13:11:47.353465+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:01:11.518823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962697+0000","last_change":"2023-10-16T13:11:40.974458+0000","last_active":"2023-10-16T13:11:41.962697+0000","last_peered":"2023-10-16T13:11:41.962697+0000","last_clean":"2023-10-16T13:11:41.962697+0000","last_became_active":"2023-10-16T13:11:40.974146+0000","last_became_peered":"2023-10-16T13:11:40.974146+0000","last_unstale":"2023-10-16T13:11:41.962697+0000","last_undegraded":"2023-10-16T13:11:41.962697+0000","last_fullsized":"2023-10-16T13:11:41.962697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:57:58.851273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":66,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:12:27.370523+0000","last_change":"2023-10-16T13:11:39.958561+0000","last_active":"2023-10-16T13:12:27.370523+0000","last_peered":"2023-10-16T13:12:27.370523+0000","last_clean":"2023-10-16T13:12:27.370523+0000","last_became_active":"2023-10-16T13:11:39.958272+0000","last_became_peered":"2023-10-16T13:11:39.958272+0000","last_unstale":"2023-10-16T13:12:27.370523+0000","last_undegraded":"2023-10-16T13:12:27.370523+0000","last_fullsized":"2023-10-16T13:12:27.370523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:46.162288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228649+0000","last_change":"2023-10-16T13:11:40.970345+0000","last_active":"2023-10-16T13:11:43.228649+0000","last_peered":"2023-10-16T13:11:43.228649+0000","last_clean":"2023-10-16T13:11:43.228649+0000","last_became_active":"2023-10-16T13:11:40.970024+0000","last_became_peered":"2023-10-16T13:11:40.970024+0000","last_unstale":"2023-10-16T13:11:43.228649+0000","last_undegraded":"2023-10-16T13:11:43.228649+0000","last_fullsized":"2023-10-16T13:11:43.228649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:41.703074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:46.336335+0000","last_change":"2023-10-16T13:11:39.951194+0000","last_active":"2023-10-16T13:11:46.336335+0000","last_peered":"2023-10-16T13:11:46.336335+0000","last_clean":"2023-10-16T13:11:46.336335+0000","last_became_active":"2023-10-16T13:11:39.950837+0000","last_became_peered":"2023-10-16T13:11:39.950837+0000","last_unstale":"2023-10-16T13:11:46.336335+0000","last_undegraded":"2023-10-16T13:11:46.336335+0000","last_fullsized":"2023-10-16T13:11:46.336335+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:59:17.756924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962589+0000","last_change":"2023-10-16T13:11:40.959602+0000","last_active":"2023-10-16T13:11:41.962589+0000","last_peered":"2023-10-16T13:11:41.962589+0000","last_clean":"2023-10-16T13:11:41.962589+0000","last_became_active":"2023-10-16T13:11:40.959231+0000","last_became_peered":"2023-10-16T13:11:40.959231+0000","last_unstale":"2023-10-16T13:11:41.962589+0000","last_undegraded":"2023-10-16T13:11:41.962589+0000","last_fullsized":"2023-10-16T13:11:41.962589+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:59:54.623471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:45.311296+0000","last_change":"2023-10-16T13:11:39.952655+0000","last_active":"2023-10-16T13:11:45.311296+0000","last_peered":"2023-10-16T13:11:45.311296+0000","last_clean":"2023-10-16T13:11:45.311296+0000","last_became_active":"2023-10-16T13:11:39.952324+0000","last_became_peered":"2023-10-16T13:11:39.952324+0000","last_unstale":"2023-10-16T13:11:45.311296+0000","last_undegraded":"2023-10-16T13:11:45.311296+0000","last_fullsized":"2023-10-16T13:11:45.311296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:09:14.077837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961022+0000","last_change":"2023-10-16T13:11:40.969019+0000","last_active":"2023-10-16T13:11:41.961022+0000","last_peered":"2023-10-16T13:11:41.961022+0000","last_clean":"2023-10-16T13:11:41.961022+0000","last_became_active":"2023-10-16T13:11:40.968645+0000","last_became_peered":"2023-10-16T13:11:40.968645+0000","last_unstale":"2023-10-16T13:11:41.961022+0000","last_undegraded":"2023-10-16T13:11:41.961022+0000","last_fullsized":"2023-10-16T13:11:41.961022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:23:18.700377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.353278+0000","last_change":"2023-10-16T13:11:39.959826+0000","last_active":"2023-10-16T13:11:47.353278+0000","last_peered":"2023-10-16T13:11:47.353278+0000","last_clean":"2023-10-16T13:11:47.353278+0000","last_became_active":"2023-10-16T13:11:39.959490+0000","last_became_peered":"2023-10-16T13:11:39.959490+0000","last_unstale":"2023-10-16T13:11:47.353278+0000","last_undegraded":"2023-10-16T13:11:47.353278+0000","last_fullsized":"2023-10-16T13:11:47.353278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:52:01.865005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228193+0000","last_change":"2023-10-16T13:11:40.977941+0000","last_active":"2023-10-16T13:11:43.228193+0000","last_peered":"2023-10-16T13:11:43.228193+0000","last_clean":"2023-10-16T13:11:43.228193+0000","last_became_active":"2023-10-16T13:11:40.977558+0000","last_became_peered":"2023-10-16T13:11:40.977558+0000","last_unstale":"2023-10-16T13:11:43.228193+0000","last_undegraded":"2023-10-16T13:11:43.228193+0000","last_fullsized":"2023-10-16T13:11:43.228193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:29:16.932234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":106,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:12:30.374592+0000","last_change":"2023-10-16T13:11:39.953728+0000","last_active":"2023-10-16T13:12:30.374592+0000","last_peered":"2023-10-16T13:12:30.374592+0000","last_clean":"2023-10-16T13:12:30.374592+0000","last_became_active":"2023-10-16T13:11:39.953421+0000","last_became_peered":"2023-10-16T13:11:39.953421+0000","last_unstale":"2023-10-16T13:12:30.374592+0000","last_undegraded":"2023-10-16T13:12:30.374592+0000","last_fullsized":"2023-10-16T13:12:30.374592+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:22:14.537974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":89,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962178+0000","last_change":"2023-10-16T13:11:40.978214+0000","last_active":"2023-10-16T13:11:41.962178+0000","last_peered":"2023-10-16T13:11:41.962178+0000","last_clean":"2023-10-16T13:11:41.962178+0000","last_became_active":"2023-10-16T13:11:40.977786+0000","last_became_peered":"2023-10-16T13:11:40.977786+0000","last_unstale":"2023-10-16T13:11:41.962178+0000","last_undegraded":"2023-10-16T13:11:41.962178+0000","last_fullsized":"2023-10-16T13:11:41.962178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:43:51.218758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.352714+0000","last_change":"2023-10-16T13:11:39.959589+0000","last_active":"2023-10-16T13:11:47.352714+0000","last_peered":"2023-10-16T13:11:47.352714+0000","last_clean":"2023-10-16T13:11:47.352714+0000","last_became_active":"2023-10-16T13:11:39.959242+0000","last_became_peered":"2023-10-16T13:11:39.959242+0000","last_unstale":"2023-10-16T13:11:47.352714+0000","last_undegraded":"2023-10-16T13:11:47.352714+0000","last_fullsized":"2023-10-16T13:11:47.352714+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:54.955605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717681+0000","last_change":"2023-10-16T13:11:40.975814+0000","last_active":"2023-10-16T13:11:42.717681+0000","last_peered":"2023-10-16T13:11:42.717681+0000","last_clean":"2023-10-16T13:11:42.717681+0000","last_became_active":"2023-10-16T13:11:40.975485+0000","last_became_peered":"2023-10-16T13:11:40.975485+0000","last_unstale":"2023-10-16T13:11:42.717681+0000","last_undegraded":"2023-10-16T13:11:42.717681+0000","last_fullsized":"2023-10-16T13:11:42.717681+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:25.661616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:45.303902+0000","last_change":"2023-10-16T13:11:39.956586+0000","last_active":"2023-10-16T13:11:45.303902+0000","last_peered":"2023-10-16T13:11:45.303902+0000","last_clean":"2023-10-16T13:11:45.303902+0000","last_became_active":"2023-10-16T13:11:39.956270+0000","last_became_peered":"2023-10-16T13:11:39.956270+0000","last_unstale":"2023-10-16T13:11:45.303902+0000","last_undegraded":"2023-10-16T13:11:45.303902+0000","last_fullsized":"2023-10-16T13:11:45.303902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:11:12.435377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962008+0000","last_change":"2023-10-16T13:11:40.978918+0000","last_active":"2023-10-16T13:11:41.962008+0000","last_peered":"2023-10-16T13:11:41.962008+0000","last_clean":"2023-10-16T13:11:41.962008+0000","last_became_active":"2023-10-16T13:11:40.978520+0000","last_became_peered":"2023-10-16T13:11:40.978520+0000","last_unstale":"2023-10-16T13:11:41.962008+0000","last_undegraded":"2023-10-16T13:11:41.962008+0000","last_fullsized":"2023-10-16T13:11:41.962008+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:09:57.269111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'31","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:12:30.388351+0000","last_change":"2023-10-16T13:11:39.956692+0000","last_active":"2023-10-16T13:12:30.388351+0000","last_peered":"2023-10-16T13:12:30.388351+0000","last_clean":"2023-10-16T13:12:30.388351+0000","last_became_active":"2023-10-16T13:11:39.956340+0000","last_became_peered":"2023-10-16T13:11:39.956340+0000","last_unstale":"2023-10-16T13:12:30.388351+0000","last_undegraded":"2023-10-16T13:12:30.388351+0000","last_fullsized":"2023-10-16T13:12:30.388351+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:48:23.320743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57546,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":101,"num_read_kb":106,"num_write":33,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228483+0000","last_change":"2023-10-16T13:11:40.969423+0000","last_active":"2023-10-16T13:11:43.228483+0000","last_peered":"2023-10-16T13:11:43.228483+0000","last_clean":"2023-10-16T13:11:43.228483+0000","last_became_active":"2023-10-16T13:11:40.969022+0000","last_became_peered":"2023-10-16T13:11:40.969022+0000","last_unstale":"2023-10-16T13:11:43.228483+0000","last_undegraded":"2023-10-16T13:11:43.228483+0000","last_fullsized":"2023-10-16T13:11:43.228483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:51:26.911443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.352081+0000","last_change":"2023-10-16T13:11:39.962364+0000","last_active":"2023-10-16T13:11:47.352081+0000","last_peered":"2023-10-16T13:11:47.352081+0000","last_clean":"2023-10-16T13:11:47.352081+0000","last_became_active":"2023-10-16T13:11:39.962077+0000","last_became_peered":"2023-10-16T13:11:39.962077+0000","last_unstale":"2023-10-16T13:11:47.352081+0000","last_undegraded":"2023-10-16T13:11:47.352081+0000","last_fullsized":"2023-10-16T13:11:47.352081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:50:58.478054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228556+0000","last_change":"2023-10-16T13:11:40.970958+0000","last_active":"2023-10-16T13:11:43.228556+0000","last_peered":"2023-10-16T13:11:43.228556+0000","last_clean":"2023-10-16T13:11:43.228556+0000","last_became_active":"2023-10-16T13:11:40.970670+0000","last_became_peered":"2023-10-16T13:11:40.970670+0000","last_unstale":"2023-10-16T13:11:43.228556+0000","last_undegraded":"2023-10-16T13:11:43.228556+0000","last_fullsized":"2023-10-16T13:11:43.228556+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:47:30.594558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.353161+0000","last_change":"2023-10-16T13:11:39.957334+0000","last_active":"2023-10-16T13:11:47.353161+0000","last_peered":"2023-10-16T13:11:47.353161+0000","last_clean":"2023-10-16T13:11:47.353161+0000","last_became_active":"2023-10-16T13:11:39.957027+0000","last_became_peered":"2023-10-16T13:11:39.957027+0000","last_unstale":"2023-10-16T13:11:47.353161+0000","last_undegraded":"2023-10-16T13:11:47.353161+0000","last_fullsized":"2023-10-16T13:11:47.353161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:27:37.164359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972218+0000","last_change":"2023-10-16T13:11:40.977201+0000","last_active":"2023-10-16T13:11:42.972218+0000","last_peered":"2023-10-16T13:11:42.972218+0000","last_clean":"2023-10-16T13:11:42.972218+0000","last_became_active":"2023-10-16T13:11:40.976860+0000","last_became_peered":"2023-10-16T13:11:40.976860+0000","last_unstale":"2023-10-16T13:11:42.972218+0000","last_undegraded":"2023-10-16T13:11:42.972218+0000","last_fullsized":"2023-10-16T13:11:42.972218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:57.867339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":61,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:12:26.405349+0000","last_change":"2023-10-16T13:11:39.958627+0000","last_active":"2023-10-16T13:12:26.405349+0000","last_peered":"2023-10-16T13:12:26.405349+0000","last_clean":"2023-10-16T13:12:26.405349+0000","last_became_active":"2023-10-16T13:11:39.958230+0000","last_became_peered":"2023-10-16T13:11:39.958230+0000","last_unstale":"2023-10-16T13:12:26.405349+0000","last_undegraded":"2023-10-16T13:12:26.405349+0000","last_fullsized":"2023-10-16T13:12:26.405349+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:47:47.534392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.971981+0000","last_change":"2023-10-16T13:11:40.972841+0000","last_active":"2023-10-16T13:11:42.971981+0000","last_peered":"2023-10-16T13:11:42.971981+0000","last_clean":"2023-10-16T13:11:42.971981+0000","last_became_active":"2023-10-16T13:11:40.972406+0000","last_became_peered":"2023-10-16T13:11:40.972406+0000","last_unstale":"2023-10-16T13:11:42.971981+0000","last_undegraded":"2023-10-16T13:11:42.971981+0000","last_fullsized":"2023-10-16T13:11:42.971981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:04.134000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.352411+0000","last_change":"2023-10-16T13:11:39.955064+0000","last_active":"2023-10-16T13:11:47.352411+0000","last_peered":"2023-10-16T13:11:47.352411+0000","last_clean":"2023-10-16T13:11:47.352411+0000","last_became_active":"2023-10-16T13:11:39.954690+0000","last_became_peered":"2023-10-16T13:11:39.954690+0000","last_unstale":"2023-10-16T13:11:47.352411+0000","last_undegraded":"2023-10-16T13:11:47.352411+0000","last_fullsized":"2023-10-16T13:11:47.352411+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:30.341233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962429+0000","last_change":"2023-10-16T13:11:40.978373+0000","last_active":"2023-10-16T13:11:41.962429+0000","last_peered":"2023-10-16T13:11:41.962429+0000","last_clean":"2023-10-16T13:11:41.962429+0000","last_became_active":"2023-10-16T13:11:40.977890+0000","last_became_peered":"2023-10-16T13:11:40.977890+0000","last_unstale":"2023-10-16T13:11:41.962429+0000","last_undegraded":"2023-10-16T13:11:41.962429+0000","last_fullsized":"2023-10-16T13:11:41.962429+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:33:21.566200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:45.302083+0000","last_change":"2023-10-16T13:11:39.952698+0000","last_active":"2023-10-16T13:11:45.302083+0000","last_peered":"2023-10-16T13:11:45.302083+0000","last_clean":"2023-10-16T13:11:45.302083+0000","last_became_active":"2023-10-16T13:11:39.952383+0000","last_became_peered":"2023-10-16T13:11:39.952383+0000","last_unstale":"2023-10-16T13:11:45.302083+0000","last_undegraded":"2023-10-16T13:11:45.302083+0000","last_fullsized":"2023-10-16T13:11:45.302083+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:06:57.841990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228686+0000","last_change":"2023-10-16T13:11:40.977579+0000","last_active":"2023-10-16T13:11:43.228686+0000","last_peered":"2023-10-16T13:11:43.228686+0000","last_clean":"2023-10-16T13:11:43.228686+0000","last_became_active":"2023-10-16T13:11:40.977117+0000","last_became_peered":"2023-10-16T13:11:40.977117+0000","last_unstale":"2023-10-16T13:11:43.228686+0000","last_undegraded":"2023-10-16T13:11:43.228686+0000","last_fullsized":"2023-10-16T13:11:43.228686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:18.859388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228274+0000","last_change":"2023-10-16T13:11:39.957430+0000","last_active":"2023-10-16T13:11:43.228274+0000","last_peered":"2023-10-16T13:11:43.228274+0000","last_clean":"2023-10-16T13:11:43.228274+0000","last_became_active":"2023-10-16T13:11:39.957088+0000","last_became_peered":"2023-10-16T13:11:39.957088+0000","last_unstale":"2023-10-16T13:11:43.228274+0000","last_undegraded":"2023-10-16T13:11:43.228274+0000","last_fullsized":"2023-10-16T13:11:43.228274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:21:57.307718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228260+0000","last_change":"2023-10-16T13:11:40.970009+0000","last_active":"2023-10-16T13:11:43.228260+0000","last_peered":"2023-10-16T13:11:43.228260+0000","last_clean":"2023-10-16T13:11:43.228260+0000","last_became_active":"2023-10-16T13:11:40.969668+0000","last_became_peered":"2023-10-16T13:11:40.969668+0000","last_unstale":"2023-10-16T13:11:43.228260+0000","last_undegraded":"2023-10-16T13:11:43.228260+0000","last_fullsized":"2023-10-16T13:11:43.228260+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:48:35.556712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":62,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:12:29.408856+0000","last_change":"2023-10-16T13:11:39.958168+0000","last_active":"2023-10-16T13:12:29.408856+0000","last_peered":"2023-10-16T13:12:29.408856+0000","last_clean":"2023-10-16T13:12:29.408856+0000","last_became_active":"2023-10-16T13:11:39.957628+0000","last_became_peered":"2023-10-16T13:11:39.957628+0000","last_unstale":"2023-10-16T13:12:29.408856+0000","last_undegraded":"2023-10-16T13:12:29.408856+0000","last_fullsized":"2023-10-16T13:12:29.408856+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:55:52.658523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228154+0000","last_change":"2023-10-16T13:11:40.977161+0000","last_active":"2023-10-16T13:11:43.228154+0000","last_peered":"2023-10-16T13:11:43.228154+0000","last_clean":"2023-10-16T13:11:43.228154+0000","last_became_active":"2023-10-16T13:11:40.976821+0000","last_became_peered":"2023-10-16T13:11:40.976821+0000","last_unstale":"2023-10-16T13:11:43.228154+0000","last_undegraded":"2023-10-16T13:11:43.228154+0000","last_fullsized":"2023-10-16T13:11:43.228154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:42:26.712826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962502+0000","last_change":"2023-10-16T13:11:40.966680+0000","last_active":"2023-10-16T13:11:41.962502+0000","last_peered":"2023-10-16T13:11:41.962502+0000","last_clean":"2023-10-16T13:11:41.962502+0000","last_became_active":"2023-10-16T13:11:40.966332+0000","last_became_peered":"2023-10-16T13:11:40.966332+0000","last_unstale":"2023-10-16T13:11:41.962502+0000","last_undegraded":"2023-10-16T13:11:41.962502+0000","last_fullsized":"2023-10-16T13:11:41.962502+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:06:42.963312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":61,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:12:28.407270+0000","last_change":"2023-10-16T13:11:39.960180+0000","last_active":"2023-10-16T13:12:28.407270+0000","last_peered":"2023-10-16T13:12:28.407270+0000","last_clean":"2023-10-16T13:12:28.407270+0000","last_became_active":"2023-10-16T13:11:39.959816+0000","last_became_peered":"2023-10-16T13:11:39.959816+0000","last_unstale":"2023-10-16T13:12:28.407270+0000","last_undegraded":"2023-10-16T13:12:28.407270+0000","last_fullsized":"2023-10-16T13:12:28.407270+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:14:08.890449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961527+0000","last_change":"2023-10-16T13:11:40.975271+0000","last_active":"2023-10-16T13:11:41.961527+0000","last_peered":"2023-10-16T13:11:41.961527+0000","last_clean":"2023-10-16T13:11:41.961527+0000","last_became_active":"2023-10-16T13:11:40.974960+0000","last_became_peered":"2023-10-16T13:11:40.974960+0000","last_unstale":"2023-10-16T13:11:41.961527+0000","last_undegraded":"2023-10-16T13:11:41.961527+0000","last_fullsized":"2023-10-16T13:11:41.961527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:09.467960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:48.352169+0000","last_change":"2023-10-16T13:11:39.951187+0000","last_active":"2023-10-16T13:11:48.352169+0000","last_peered":"2023-10-16T13:11:48.352169+0000","last_clean":"2023-10-16T13:11:48.352169+0000","last_became_active":"2023-10-16T13:11:39.950843+0000","last_became_peered":"2023-10-16T13:11:39.950843+0000","last_unstale":"2023-10-16T13:11:48.352169+0000","last_undegraded":"2023-10-16T13:11:48.352169+0000","last_fullsized":"2023-10-16T13:11:48.352169+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:48.930247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":308,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.963466+0000","last_change":"2023-10-16T13:10:38.800469+0000","last_active":"2023-10-16T13:11:40.963466+0000","last_peered":"2023-10-16T13:11:40.963466+0000","last_clean":"2023-10-16T13:11:40.963466+0000","last_became_active":"2023-10-16T13:10:38.799911+0000","last_became_peered":"2023-10-16T13:10:38.799911+0000","last_unstale":"2023-10-16T13:11:40.963466+0000","last_undegraded":"2023-10-16T13:11:40.963466+0000","last_fullsized":"2023-10-16T13:11:40.963466+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:07:46.238647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:07:46.238647+0000","last_clean_scrub_stamp":"2023-10-16T13:07:46.238647+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:43:42.258738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228225+0000","last_change":"2023-10-16T13:11:40.974984+0000","last_active":"2023-10-16T13:11:43.228225+0000","last_peered":"2023-10-16T13:11:43.228225+0000","last_clean":"2023-10-16T13:11:43.228225+0000","last_became_active":"2023-10-16T13:11:40.974689+0000","last_became_peered":"2023-10-16T13:11:40.974689+0000","last_unstale":"2023-10-16T13:11:43.228225+0000","last_undegraded":"2023-10-16T13:11:43.228225+0000","last_fullsized":"2023-10-16T13:11:43.228225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:04.119797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:45.313312+0000","last_change":"2023-10-16T13:11:39.957999+0000","last_active":"2023-10-16T13:11:45.313312+0000","last_peered":"2023-10-16T13:11:45.313312+0000","last_clean":"2023-10-16T13:11:45.313312+0000","last_became_active":"2023-10-16T13:11:39.957043+0000","last_became_peered":"2023-10-16T13:11:39.957043+0000","last_unstale":"2023-10-16T13:11:45.313312+0000","last_undegraded":"2023-10-16T13:11:45.313312+0000","last_fullsized":"2023-10-16T13:11:45.313312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:12:27.150065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:46.335581+0000","last_change":"2023-10-16T13:11:39.953082+0000","last_active":"2023-10-16T13:11:46.335581+0000","last_peered":"2023-10-16T13:11:46.335581+0000","last_clean":"2023-10-16T13:11:46.335581+0000","last_became_active":"2023-10-16T13:11:39.952785+0000","last_became_peered":"2023-10-16T13:11:39.952785+0000","last_unstale":"2023-10-16T13:11:46.335581+0000","last_undegraded":"2023-10-16T13:11:46.335581+0000","last_fullsized":"2023-10-16T13:11:46.335581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:06:34.427841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228109+0000","last_change":"2023-10-16T13:11:40.968761+0000","last_active":"2023-10-16T13:11:43.228109+0000","last_peered":"2023-10-16T13:11:43.228109+0000","last_clean":"2023-10-16T13:11:43.228109+0000","last_became_active":"2023-10-16T13:11:40.968466+0000","last_became_peered":"2023-10-16T13:11:40.968466+0000","last_unstale":"2023-10-16T13:11:43.228109+0000","last_undegraded":"2023-10-16T13:11:43.228109+0000","last_fullsized":"2023-10-16T13:11:43.228109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:22:15.577411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'10","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:53.477141+0000","last_change":"2023-10-16T13:11:39.957019+0000","last_active":"2023-10-16T13:11:53.477141+0000","last_peered":"2023-10-16T13:11:53.477141+0000","last_clean":"2023-10-16T13:11:53.477141+0000","last_became_active":"2023-10-16T13:11:39.956687+0000","last_became_peered":"2023-10-16T13:11:39.956687+0000","last_unstale":"2023-10-16T13:11:53.477141+0000","last_undegraded":"2023-10-16T13:11:53.477141+0000","last_fullsized":"2023-10-16T13:11:53.477141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:17.049740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961461+0000","last_change":"2023-10-16T13:11:40.973938+0000","last_active":"2023-10-16T13:11:41.961461+0000","last_peered":"2023-10-16T13:11:41.961461+0000","last_clean":"2023-10-16T13:11:41.961461+0000","last_became_active":"2023-10-16T13:11:40.973579+0000","last_became_peered":"2023-10-16T13:11:40.973579+0000","last_unstale":"2023-10-16T13:11:41.961461+0000","last_undegraded":"2023-10-16T13:11:41.961461+0000","last_fullsized":"2023-10-16T13:11:41.961461+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:49:29.153231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.351827+0000","last_change":"2023-10-16T13:11:39.954368+0000","last_active":"2023-10-16T13:11:47.351827+0000","last_peered":"2023-10-16T13:11:47.351827+0000","last_clean":"2023-10-16T13:11:47.351827+0000","last_became_active":"2023-10-16T13:11:39.953967+0000","last_became_peered":"2023-10-16T13:11:39.953967+0000","last_unstale":"2023-10-16T13:11:47.351827+0000","last_undegraded":"2023-10-16T13:11:47.351827+0000","last_fullsized":"2023-10-16T13:11:47.351827+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:43:49.278655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717616+0000","last_change":"2023-10-16T13:11:40.975917+0000","last_active":"2023-10-16T13:11:42.717616+0000","last_peered":"2023-10-16T13:11:42.717616+0000","last_clean":"2023-10-16T13:11:42.717616+0000","last_became_active":"2023-10-16T13:11:40.975610+0000","last_became_peered":"2023-10-16T13:11:40.975610+0000","last_unstale":"2023-10-16T13:11:42.717616+0000","last_undegraded":"2023-10-16T13:11:42.717616+0000","last_fullsized":"2023-10-16T13:11:42.717616+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:41.006584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:44.324104+0000","last_change":"2023-10-16T13:11:39.960169+0000","last_active":"2023-10-16T13:11:44.324104+0000","last_peered":"2023-10-16T13:11:44.324104+0000","last_clean":"2023-10-16T13:11:44.324104+0000","last_became_active":"2023-10-16T13:11:39.959385+0000","last_became_peered":"2023-10-16T13:11:39.959385+0000","last_unstale":"2023-10-16T13:11:44.324104+0000","last_undegraded":"2023-10-16T13:11:44.324104+0000","last_fullsized":"2023-10-16T13:11:44.324104+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:50:12.442686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228128+0000","last_change":"2023-10-16T13:11:40.971165+0000","last_active":"2023-10-16T13:11:43.228128+0000","last_peered":"2023-10-16T13:11:43.228128+0000","last_clean":"2023-10-16T13:11:43.228128+0000","last_became_active":"2023-10-16T13:11:40.970341+0000","last_became_peered":"2023-10-16T13:11:40.970341+0000","last_unstale":"2023-10-16T13:11:43.228128+0000","last_undegraded":"2023-10-16T13:11:43.228128+0000","last_fullsized":"2023-10-16T13:11:43.228128+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:39:48.393642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.350655+0000","last_change":"2023-10-16T13:11:39.953044+0000","last_active":"2023-10-16T13:11:47.350655+0000","last_peered":"2023-10-16T13:11:47.350655+0000","last_clean":"2023-10-16T13:11:47.350655+0000","last_became_active":"2023-10-16T13:11:39.952752+0000","last_became_peered":"2023-10-16T13:11:39.952752+0000","last_unstale":"2023-10-16T13:11:47.350655+0000","last_undegraded":"2023-10-16T13:11:47.350655+0000","last_fullsized":"2023-10-16T13:11:47.350655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:33:12.277430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228221+0000","last_change":"2023-10-16T13:11:40.974739+0000","last_active":"2023-10-16T13:11:43.228221+0000","last_peered":"2023-10-16T13:11:43.228221+0000","last_clean":"2023-10-16T13:11:43.228221+0000","last_became_active":"2023-10-16T13:11:40.974387+0000","last_became_peered":"2023-10-16T13:11:40.974387+0000","last_unstale":"2023-10-16T13:11:43.228221+0000","last_undegraded":"2023-10-16T13:11:43.228221+0000","last_fullsized":"2023-10-16T13:11:43.228221+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:28:16.384359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:46.452788+0000","last_change":"2023-10-16T13:11:39.960427+0000","last_active":"2023-10-16T13:11:46.452788+0000","last_peered":"2023-10-16T13:11:46.452788+0000","last_clean":"2023-10-16T13:11:46.452788+0000","last_became_active":"2023-10-16T13:11:39.959928+0000","last_became_peered":"2023-10-16T13:11:39.959928+0000","last_unstale":"2023-10-16T13:11:46.452788+0000","last_undegraded":"2023-10-16T13:11:46.452788+0000","last_fullsized":"2023-10-16T13:11:46.452788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:38:37.073782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961407+0000","last_change":"2023-10-16T13:11:40.971153+0000","last_active":"2023-10-16T13:11:41.961407+0000","last_peered":"2023-10-16T13:11:41.961407+0000","last_clean":"2023-10-16T13:11:41.961407+0000","last_became_active":"2023-10-16T13:11:40.970772+0000","last_became_peered":"2023-10-16T13:11:40.970772+0000","last_unstale":"2023-10-16T13:11:41.961407+0000","last_undegraded":"2023-10-16T13:11:41.961407+0000","last_fullsized":"2023-10-16T13:11:41.961407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:34.450600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:44.324888+0000","last_change":"2023-10-16T13:11:39.957589+0000","last_active":"2023-10-16T13:11:44.324888+0000","last_peered":"2023-10-16T13:11:44.324888+0000","last_clean":"2023-10-16T13:11:44.324888+0000","last_became_active":"2023-10-16T13:11:39.957334+0000","last_became_peered":"2023-10-16T13:11:39.957334+0000","last_unstale":"2023-10-16T13:11:44.324888+0000","last_undegraded":"2023-10-16T13:11:44.324888+0000","last_fullsized":"2023-10-16T13:11:44.324888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:42:58.126279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972160+0000","last_change":"2023-10-16T13:11:40.979906+0000","last_active":"2023-10-16T13:11:42.972160+0000","last_peered":"2023-10-16T13:11:42.972160+0000","last_clean":"2023-10-16T13:11:42.972160+0000","last_became_active":"2023-10-16T13:11:40.979506+0000","last_became_peered":"2023-10-16T13:11:40.979506+0000","last_unstale":"2023-10-16T13:11:42.972160+0000","last_undegraded":"2023-10-16T13:11:42.972160+0000","last_fullsized":"2023-10-16T13:11:42.972160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:06:33.566642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":61,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:12:27.407677+0000","last_change":"2023-10-16T13:11:39.961062+0000","last_active":"2023-10-16T13:12:27.407677+0000","last_peered":"2023-10-16T13:12:27.407677+0000","last_clean":"2023-10-16T13:12:27.407677+0000","last_became_active":"2023-10-16T13:11:39.960615+0000","last_became_peered":"2023-10-16T13:11:39.960615+0000","last_unstale":"2023-10-16T13:12:27.407677+0000","last_undegraded":"2023-10-16T13:12:27.407677+0000","last_fullsized":"2023-10-16T13:12:27.407677+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:59:52.598863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972447+0000","last_change":"2023-10-16T13:11:40.979874+0000","last_active":"2023-10-16T13:11:42.972447+0000","last_peered":"2023-10-16T13:11:42.972447+0000","last_clean":"2023-10-16T13:11:42.972447+0000","last_became_active":"2023-10-16T13:11:40.979444+0000","last_became_peered":"2023-10-16T13:11:40.979444+0000","last_unstale":"2023-10-16T13:11:42.972447+0000","last_undegraded":"2023-10-16T13:11:42.972447+0000","last_fullsized":"2023-10-16T13:11:42.972447+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:27:38.533986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:46.335169+0000","last_change":"2023-10-16T13:11:39.962428+0000","last_active":"2023-10-16T13:11:46.335169+0000","last_peered":"2023-10-16T13:11:46.335169+0000","last_clean":"2023-10-16T13:11:46.335169+0000","last_became_active":"2023-10-16T13:11:39.962028+0000","last_became_peered":"2023-10-16T13:11:39.962028+0000","last_unstale":"2023-10-16T13:11:46.335169+0000","last_undegraded":"2023-10-16T13:11:46.335169+0000","last_fullsized":"2023-10-16T13:11:46.335169+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:43:25.415571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972287+0000","last_change":"2023-10-16T13:11:40.969804+0000","last_active":"2023-10-16T13:11:42.972287+0000","last_peered":"2023-10-16T13:11:42.972287+0000","last_clean":"2023-10-16T13:11:42.972287+0000","last_became_active":"2023-10-16T13:11:40.969339+0000","last_became_peered":"2023-10-16T13:11:40.969339+0000","last_unstale":"2023-10-16T13:11:42.972287+0000","last_undegraded":"2023-10-16T13:11:42.972287+0000","last_fullsized":"2023-10-16T13:11:42.972287+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:14:15.533029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.352788+0000","last_change":"2023-10-16T13:11:39.960173+0000","last_active":"2023-10-16T13:11:47.352788+0000","last_peered":"2023-10-16T13:11:47.352788+0000","last_clean":"2023-10-16T13:11:47.352788+0000","last_became_active":"2023-10-16T13:11:39.959839+0000","last_became_peered":"2023-10-16T13:11:39.959839+0000","last_unstale":"2023-10-16T13:11:47.352788+0000","last_undegraded":"2023-10-16T13:11:47.352788+0000","last_fullsized":"2023-10-16T13:11:47.352788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:31:16.379341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972451+0000","last_change":"2023-10-16T13:11:40.974349+0000","last_active":"2023-10-16T13:11:42.972451+0000","last_peered":"2023-10-16T13:11:42.972451+0000","last_clean":"2023-10-16T13:11:42.972451+0000","last_became_active":"2023-10-16T13:11:40.973189+0000","last_became_peered":"2023-10-16T13:11:40.973189+0000","last_unstale":"2023-10-16T13:11:42.972451+0000","last_undegraded":"2023-10-16T13:11:42.972451+0000","last_fullsized":"2023-10-16T13:11:42.972451+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:45:05.177277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228644+0000","last_change":"2023-10-16T13:11:40.972862+0000","last_active":"2023-10-16T13:11:43.228644+0000","last_peered":"2023-10-16T13:11:43.228644+0000","last_clean":"2023-10-16T13:11:43.228644+0000","last_became_active":"2023-10-16T13:11:40.972558+0000","last_became_peered":"2023-10-16T13:11:40.972558+0000","last_unstale":"2023-10-16T13:11:43.228644+0000","last_undegraded":"2023-10-16T13:11:43.228644+0000","last_fullsized":"2023-10-16T13:11:43.228644+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:09:36.149610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.985989+0000","last_change":"2023-10-16T13:11:40.973449+0000","last_active":"2023-10-16T13:11:42.985989+0000","last_peered":"2023-10-16T13:11:42.985989+0000","last_clean":"2023-10-16T13:11:42.985989+0000","last_became_active":"2023-10-16T13:11:40.973044+0000","last_became_peered":"2023-10-16T13:11:40.973044+0000","last_unstale":"2023-10-16T13:11:42.985989+0000","last_undegraded":"2023-10-16T13:11:42.985989+0000","last_fullsized":"2023-10-16T13:11:42.985989+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:22.883943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.986056+0000","last_change":"2023-10-16T13:11:40.970871+0000","last_active":"2023-10-16T13:11:42.986056+0000","last_peered":"2023-10-16T13:11:42.986056+0000","last_clean":"2023-10-16T13:11:42.986056+0000","last_became_active":"2023-10-16T13:11:40.970554+0000","last_became_peered":"2023-10-16T13:11:40.970554+0000","last_unstale":"2023-10-16T13:11:42.986056+0000","last_undegraded":"2023-10-16T13:11:42.986056+0000","last_fullsized":"2023-10-16T13:11:42.986056+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:46:34.449007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717476+0000","last_change":"2023-10-16T13:11:40.975827+0000","last_active":"2023-10-16T13:11:42.717476+0000","last_peered":"2023-10-16T13:11:42.717476+0000","last_clean":"2023-10-16T13:11:42.717476+0000","last_became_active":"2023-10-16T13:11:40.975514+0000","last_became_peered":"2023-10-16T13:11:40.975514+0000","last_unstale":"2023-10-16T13:11:42.717476+0000","last_undegraded":"2023-10-16T13:11:42.717476+0000","last_fullsized":"2023-10-16T13:11:42.717476+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:34:47.901390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228201+0000","last_change":"2023-10-16T13:11:40.975088+0000","last_active":"2023-10-16T13:11:43.228201+0000","last_peered":"2023-10-16T13:11:43.228201+0000","last_clean":"2023-10-16T13:11:43.228201+0000","last_became_active":"2023-10-16T13:11:40.974286+0000","last_became_peered":"2023-10-16T13:11:40.974286+0000","last_unstale":"2023-10-16T13:11:43.228201+0000","last_undegraded":"2023-10-16T13:11:43.228201+0000","last_fullsized":"2023-10-16T13:11:43.228201+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:15:50.270651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228527+0000","last_change":"2023-10-16T13:11:40.973111+0000","last_active":"2023-10-16T13:11:43.228527+0000","last_peered":"2023-10-16T13:11:43.228527+0000","last_clean":"2023-10-16T13:11:43.228527+0000","last_became_active":"2023-10-16T13:11:40.972826+0000","last_became_peered":"2023-10-16T13:11:40.972826+0000","last_unstale":"2023-10-16T13:11:43.228527+0000","last_undegraded":"2023-10-16T13:11:43.228527+0000","last_fullsized":"2023-10-16T13:11:43.228527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:43.523165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.986501+0000","last_change":"2023-10-16T13:11:40.980303+0000","last_active":"2023-10-16T13:11:42.986501+0000","last_peered":"2023-10-16T13:11:42.986501+0000","last_clean":"2023-10-16T13:11:42.986501+0000","last_became_active":"2023-10-16T13:11:40.979987+0000","last_became_peered":"2023-10-16T13:11:40.979987+0000","last_unstale":"2023-10-16T13:11:42.986501+0000","last_undegraded":"2023-10-16T13:11:42.986501+0000","last_fullsized":"2023-10-16T13:11:42.986501+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:38:16.402231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961388+0000","last_change":"2023-10-16T13:11:40.966547+0000","last_active":"2023-10-16T13:11:41.961388+0000","last_peered":"2023-10-16T13:11:41.961388+0000","last_clean":"2023-10-16T13:11:41.961388+0000","last_became_active":"2023-10-16T13:11:40.966149+0000","last_became_peered":"2023-10-16T13:11:40.966149+0000","last_unstale":"2023-10-16T13:11:41.961388+0000","last_undegraded":"2023-10-16T13:11:41.961388+0000","last_fullsized":"2023-10-16T13:11:41.961388+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:27:47.007356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962374+0000","last_change":"2023-10-16T13:11:40.968511+0000","last_active":"2023-10-16T13:11:41.962374+0000","last_peered":"2023-10-16T13:11:41.962374+0000","last_clean":"2023-10-16T13:11:41.962374+0000","last_became_active":"2023-10-16T13:11:40.968185+0000","last_became_peered":"2023-10-16T13:11:40.968185+0000","last_unstale":"2023-10-16T13:11:41.962374+0000","last_undegraded":"2023-10-16T13:11:41.962374+0000","last_fullsized":"2023-10-16T13:11:41.962374+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:31:43.779875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961188+0000","last_change":"2023-10-16T13:11:40.974616+0000","last_active":"2023-10-16T13:11:41.961188+0000","last_peered":"2023-10-16T13:11:41.961188+0000","last_clean":"2023-10-16T13:11:41.961188+0000","last_became_active":"2023-10-16T13:11:40.974295+0000","last_became_peered":"2023-10-16T13:11:40.974295+0000","last_unstale":"2023-10-16T13:11:41.961188+0000","last_undegraded":"2023-10-16T13:11:41.961188+0000","last_fullsized":"2023-10-16T13:11:41.961188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:47.838853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961878+0000","last_change":"2023-10-16T13:11:40.974927+0000","last_active":"2023-10-16T13:11:41.961878+0000","last_peered":"2023-10-16T13:11:41.961878+0000","last_clean":"2023-10-16T13:11:41.961878+0000","last_became_active":"2023-10-16T13:11:40.974332+0000","last_became_peered":"2023-10-16T13:11:40.974332+0000","last_unstale":"2023-10-16T13:11:41.961878+0000","last_undegraded":"2023-10-16T13:11:41.961878+0000","last_fullsized":"2023-10-16T13:11:41.961878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:07:24.974440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228631+0000","last_change":"2023-10-16T13:11:40.972793+0000","last_active":"2023-10-16T13:11:43.228631+0000","last_peered":"2023-10-16T13:11:43.228631+0000","last_clean":"2023-10-16T13:11:43.228631+0000","last_became_active":"2023-10-16T13:11:40.972008+0000","last_became_peered":"2023-10-16T13:11:40.972008+0000","last_unstale":"2023-10-16T13:11:43.228631+0000","last_undegraded":"2023-10-16T13:11:43.228631+0000","last_fullsized":"2023-10-16T13:11:43.228631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:53.487238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228280+0000","last_change":"2023-10-16T13:11:40.977282+0000","last_active":"2023-10-16T13:11:43.228280+0000","last_peered":"2023-10-16T13:11:43.228280+0000","last_clean":"2023-10-16T13:11:43.228280+0000","last_became_active":"2023-10-16T13:11:40.976872+0000","last_became_peered":"2023-10-16T13:11:40.976872+0000","last_unstale":"2023-10-16T13:11:43.228280+0000","last_undegraded":"2023-10-16T13:11:43.228280+0000","last_fullsized":"2023-10-16T13:11:43.228280+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:43:48.735584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64748,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":473,"num_read_kb":310,"num_write":235,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":194244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449109,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":426192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.44800000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.40500000000000003}]},{"osd":2,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":4,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51000000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66600000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68400000000000005}]},{"osd":7,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.623},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64300000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":9,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.73099999999999998}]},{"osd":10,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.81100000000000005}]}]},{"osd":10,"up_from":71,"seq":304942678042,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28576,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716576,"statfs":{"total":95995035648,"available":95965773824,"internally_reserved":0,"allocated":1597440,"data_stored":1075163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.42899999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.54300000000000004}]},{"osd":3,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.55700000000000005}]},{"osd":4,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.76600000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.629},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.73999999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.504}]},{"osd":8,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.874}]},{"osd":9,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.83999999999999997}]},{"osd":11,"last update":"Mon Oct 16 13:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.85299999999999998}]}]},{"osd":9,"up_from":66,"seq":283467841567,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":426122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.39000000000000001,"15min":0.39500000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.318}]},{"osd":1,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.58199999999999996,"15min":0.59199999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.85299999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79600000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.45500000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.38800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76000000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.755,"5min":0.88,"15min":0.88},"last":0.59499999999999997}]},{"osd":3,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.50800000000000001,"15min":0.51600000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.5,"15min":0.50600000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.70799999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.34100000000000003}]},{"osd":4,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.625,"15min":0.63700000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.879,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63200000000000001,"15min":0.63800000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91100000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.505}]},{"osd":5,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79800000000000004,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84299999999999997,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.51500000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83299999999999996,"5min":1.109,"15min":1.109},"last":0.435},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80900000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.48999999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70299999999999996,"15min":0.71299999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86099999999999999,"5min":0.996,"15min":0.996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92800000000000005,"5min":1.222,"15min":1.222},"last":0.55800000000000005}]},{"osd":8,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72499999999999998,"15min":0.73499999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84799999999999998,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.628},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.746,"15min":0.755},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86499999999999999,"5min":1.153,"15min":1.153},"last":0.57399999999999995}]},{"osd":10,"last update":"Mon Oct 16 13:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.58399999999999996}]}]},{"osd":8,"up_from":59,"seq":253403070498,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":426500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.38200000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53700000000000003,"15min":0.53600000000000003},"min":{"1min":0.40899999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63600000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.871},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.85899999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.45100000000000001,"15min":0.44700000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65900000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.48299999999999998,"15min":0.47599999999999998},"min":{"1min":0.315,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.749,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60499999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.58399999999999996,"15min":0.57599999999999996},"min":{"1min":0.42599999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.70599999999999996}]},{"osd":4,"last update":"Mon Oct 16 13:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.627,"15min":0.63},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91500000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63900000000000001,"15min":0.63400000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.81200000000000006}]},{"osd":5,"last update":"Mon Oct 16 13:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.58299999999999996,"15min":0.57099999999999995},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.998,"5min":1.042,"15min":1.042},"last":0.79700000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.69699999999999995,"15min":0.66300000000000003},"min":{"1min":0.48899999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":3.6659999999999999,"5min":3.6659999999999999,"15min":3.6659999999999999},"last":0.755},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.70999999999999996,"15min":0.70499999999999996},"min":{"1min":0.5,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0309999999999999,"5min":1.073,"15min":1.073},"last":0.77800000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71999999999999997,"15min":0.71099999999999997},"min":{"1min":0.55200000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0189999999999999,"5min":1.036,"15min":1.036},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.71799999999999997,"15min":0.71299999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0629999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.89100000000000001}]},{"osd":9,"last update":"Mon Oct 16 13:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.74199999999999999,"15min":0.71699999999999997},"min":{"1min":0.61099999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.415,"5min":2.415,"15min":2.415},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.71599999999999997,"15min":0.69999999999999996},"min":{"1min":0.54600000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.97099999999999997}]},{"osd":10,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.694,"5min":3.694,"15min":3.694},"last":1}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]}]},{"osd":7,"up_from":51,"seq":219043332135,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1519616,"data_stored":1019413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.38},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.34699999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41199999999999998,"15min":0.40799999999999997},"min":{"1min":0.29999999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.60199999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.40999999999999998,"15min":0.40600000000000003},"min":{"1min":0.29899999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.58499999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.57499999999999996}]},{"osd":2,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.42899999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.40500000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.71799999999999997}]},{"osd":3,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.442,"5min":0.37,"15min":0.37},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.754,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.53000000000000003}]},{"osd":4,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.49299999999999999,"15min":0.48599999999999999},"min":{"1min":0.35699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46800000000000003,"15min":0.46100000000000002},"min":{"1min":0.36499999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.69099999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.45000000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.66300000000000003,"15min":0.65400000000000003},"min":{"1min":0.56899999999999995,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.86499999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65900000000000003,"15min":0.65500000000000003},"min":{"1min":0.436,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.626},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.54100000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.81699999999999995}]},{"osd":8,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69499999999999995,"15min":0.68500000000000005},"min":{"1min":0.50800000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.65800000000000003,"15min":0.64900000000000002},"min":{"1min":0.48099999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.73399999999999999}]},{"osd":9,"last update":"Mon Oct 16 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.72599999999999998,"15min":0.71999999999999997},"min":{"1min":0.623,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.56899999999999995,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.79500000000000004}]},{"osd":10,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.874},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.88500000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]}]},{"osd":6,"up_from":46,"seq":197568495660,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":425845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.376,"15min":0.374},"min":{"1min":0.255,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":0.621,"15min":0.621},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.39400000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54300000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.34599999999999997}]},{"osd":1,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.36599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73199999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":1,"15min":1},"last":0.47199999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.45100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70799999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60799999999999998,"15min":0.60899999999999999},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.76200000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54800000000000004}]},{"osd":3,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.441,"15min":0.443},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.629,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65000000000000002,"5min":0.748,"15min":0.748},"last":0.41699999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.629,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84799999999999998,"5min":1.014,"15min":1.014},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76300000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.45800000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77500000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77200000000000002,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.68400000000000005,"15min":0.67500000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.45500000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.5}]},{"osd":8,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.67800000000000005},"min":{"1min":0.46899999999999997,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.48599999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.84799999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.68100000000000005}]},{"osd":9,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.61299999999999999,"15min":0.63100000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.71099999999999997,"15min":0.73499999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82599999999999996,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.58799999999999997}]},{"osd":10,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":484298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48299999999999998,"15min":0.45600000000000002},"min":{"1min":0.30099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73899999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.51600000000000001,"15min":0.47599999999999998},"min":{"1min":0.42699999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.83299999999999996,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.57999999999999996}]},{"osd":2,"last update":"Mon Oct 16 13:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.53000000000000003,"15min":0.51400000000000001},"min":{"1min":0.36599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.53900000000000003,"15min":0.52100000000000002},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85699999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.625}]},{"osd":3,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.50800000000000001},"min":{"1min":0.38200000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83999999999999997,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56899999999999995,"15min":0.52100000000000002},"min":{"1min":0.39700000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85199999999999998,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.60199999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.40400000000000003,"15min":0.39500000000000002},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.434,"15min":0.42599999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.42199999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.62,"15min":0.59599999999999997},"min":{"1min":0.502,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89700000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.69699999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63300000000000001,"15min":0.64100000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84899999999999998,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.63100000000000001},"min":{"1min":0.45900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.876,"5min":1.429,"15min":1.429},"last":0.67700000000000005}]},{"osd":7,"last update":"Mon Oct 16 13:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.71099999999999997}]},{"osd":8,"last update":"Mon Oct 16 13:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68799999999999994,"15min":0.68200000000000005},"min":{"1min":0.53400000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.81200000000000006}]},{"osd":9,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.71699999999999997,"15min":0.70799999999999996},"min":{"1min":0.55100000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.98999999999999999,"5min":1.022,"15min":1.022},"last":0.754},{"interface":"front","average":{"1min":0.752,"5min":0.71999999999999997,"15min":0.71499999999999997},"min":{"1min":0.53500000000000003,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91600000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.88700000000000001}]},{"osd":10,"last update":"Mon Oct 16 13:11:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.77900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":427178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.51900000000000002,"15min":0.503},"min":{"1min":0.33400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.52900000000000003,"15min":0.501},"min":{"1min":0.35199999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.88900000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.42799999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55900000000000005,"15min":0.53600000000000003},"min":{"1min":0.44600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.873,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54700000000000004,"15min":0.52800000000000002},"min":{"1min":0.40600000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.85999999999999999,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.495}]},{"osd":3,"last update":"Mon Oct 16 13:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41999999999999998,"15min":0.42199999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.55800000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.38500000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.53800000000000003,"15min":0.50600000000000001},"min":{"1min":0.36199999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.57099999999999995,"15min":0.55000000000000004},"min":{"1min":0.39200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.44400000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59399999999999997,"15min":0.59999999999999998},"min":{"1min":0.42199999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82299999999999995,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.66500000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:12:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.48099999999999998,"15min":0.48899999999999999},"min":{"1min":0.317,"5min":0.315,"15min":0.315},"max":{"1min":0.59499999999999997,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48599999999999999,"15min":0.47499999999999998},"min":{"1min":0.36399999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67300000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.52100000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.42099999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0169999999999999,"5min":1.51,"15min":1.51},"last":0.61199999999999999}]},{"osd":8,"last update":"Mon Oct 16 13:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.69999999999999996,"15min":0.71399999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.79700000000000004,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.68100000000000005,"15min":0.69199999999999995},"min":{"1min":0.45600000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80200000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.747}]},{"osd":9,"last update":"Mon Oct 16 13:12:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.40600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.67000000000000004,"15min":0.68400000000000005},"min":{"1min":0.375,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.91700000000000004,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.68799999999999994}]},{"osd":10,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.75600000000000001}]},{"osd":11,"last update":"Mon Oct 16 13:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.71799999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":484908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47999999999999998,"15min":0.47799999999999998},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67400000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.38100000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.68799999999999994}]},{"osd":1,"last update":"Mon Oct 16 13:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.54700000000000004,"15min":0.5},"min":{"1min":0.51300000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.54600000000000004,"15min":0.504},"min":{"1min":0.41299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.72599999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.436,"5min":0.318,"15min":0.318},"max":{"1min":0.71899999999999997,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.44600000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72899999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.60299999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58199999999999996,"15min":0.57099999999999995},"min":{"1min":0.39700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.80400000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.56000000000000005,"15min":0.53100000000000003},"min":{"1min":0.52400000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85499999999999998,"5min":0.879,"15min":0.879},"last":0.70999999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:11:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.33200000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.49399999999999999,"15min":0.46999999999999997},"min":{"1min":0.33800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.53200000000000003}]},{"osd":6,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63600000000000001,"15min":0.629},"min":{"1min":0.45800000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.63300000000000001,"15min":0.62},"min":{"1min":0.50900000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56799999999999995}]},{"osd":7,"last update":"Mon Oct 16 13:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.49099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.58599999999999997}]},{"osd":8,"last update":"Mon Oct 16 13:11:58 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66100000000000003,"15min":0.65500000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.623}]},{"osd":9,"last update":"Mon Oct 16 13:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.55200000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93899999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70299999999999996,"15min":0.69299999999999995},"min":{"1min":0.57199999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.64700000000000002}]},{"osd":10,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.752},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.78100000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":425395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.33300000000000002},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.36899999999999999,"15min":0.34499999999999997},"min":{"1min":0.25600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.35399999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.50700000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53700000000000003,"15min":0.5},"min":{"1min":0.38100000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.52800000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.53300000000000003},"min":{"1min":0.41099999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.5},{"interface":"front","average":{"1min":0.622,"5min":0.57499999999999996,"15min":0.54200000000000004},"min":{"1min":0.48599999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.57099999999999995}]},{"osd":4,"last update":"Mon Oct 16 13:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58799999999999997,"15min":0.54100000000000004},"min":{"1min":0.38600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.76700000000000002,"5min":6.032,"15min":6.032},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.47999999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60899999999999999,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44800000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.59399999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.501,"15min":0.5},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89200000000000002,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.62}]},{"osd":7,"last update":"Mon Oct 16 13:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65900000000000003,"15min":0.64800000000000002},"min":{"1min":0.40500000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.63500000000000001,"15min":0.625},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.65900000000000003}]},{"osd":8,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.55500000000000005}]},{"osd":9,"last update":"Mon Oct 16 13:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.65800000000000003,"15min":0.66700000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.85699999999999998,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.443}]},{"osd":10,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.69199999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":4,"up_from":33,"seq":141733920819,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":426090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.497,"15min":0.48799999999999999},"min":{"1min":0.377,"5min":0.318,"15min":0.318},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.51100000000000001,"15min":0.495},"min":{"1min":0.41899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.41899999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.36599999999999999},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.41399999999999998,"15min":0.39600000000000002},"min":{"1min":0.27900000000000003,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54200000000000004}]},{"osd":2,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77700000000000002,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.57399999999999995,"15min":0.54900000000000004},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.66900000000000004}]},{"osd":3,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.56000000000000005,"15min":0.54000000000000004},"min":{"1min":0.44900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78300000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.374,"5min":0.312,"15min":0.312},"max":{"1min":0.83499999999999996,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.68300000000000005}]},{"osd":5,"last update":"Mon Oct 16 13:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.626,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.81399999999999995,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.61399999999999999,"15min":0.58799999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.754}]},{"osd":6,"last update":"Mon Oct 16 13:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60999999999999999,"15min":0.59599999999999997},"min":{"1min":0.42999999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77500000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.44500000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77400000000000002,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.57699999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.55000000000000004,"15min":0.52900000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.63},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.82099999999999995}]},{"osd":8,"last update":"Mon Oct 16 13:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85699999999999998,"5min":0.999,"15min":0.999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.83599999999999997}]},{"osd":9,"last update":"Mon Oct 16 13:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.75,"15min":0.754},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.84699999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.753,"15min":0.76300000000000001},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88,"5min":1.595,"15min":1.595},"last":0.79800000000000004}]},{"osd":10,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.90100000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]}]},{"osd":5,"up_from":38,"seq":163208757296,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1527808,"data_stored":1018370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66300000000000003,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76700000000000002,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:11:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.54500000000000004,"15min":0.51900000000000002},"min":{"1min":0.35899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52600000000000002,"15min":0.50800000000000001},"min":{"1min":0.42099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77700000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.57899999999999996}]},{"osd":2,"last update":"Mon Oct 16 13:11:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.40400000000000003},"min":{"1min":0.29599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.505},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.434,"15min":0.41299999999999998},"min":{"1min":0.30299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48499999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:11:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.38900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71699999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.59199999999999997}]},{"osd":4,"last update":"Mon Oct 16 13:11:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59399999999999997,"15min":0.57799999999999996},"min":{"1min":0.42099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.78600000000000003,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.58199999999999996,"15min":0.56000000000000005},"min":{"1min":0.38600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81899999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.67900000000000005}]},{"osd":6,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.626,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83099999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.627,"15min":0.621},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.39100000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.876,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64900000000000002,"15min":0.65000000000000002},"min":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.85199999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.61899999999999999}]},{"osd":8,"last update":"Mon Oct 16 13:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.91900000000000004,"5min":1.016,"15min":1.016},"last":0.71099999999999997}]},{"osd":9,"last update":"Mon Oct 16 13:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.71099999999999997,"15min":0.70299999999999996},"min":{"1min":0.55900000000000005,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68999999999999995,"15min":0.68200000000000005},"min":{"1min":0.56699999999999995,"5min":0.435,"15min":0.435},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64100000000000001}]},{"osd":10,"last update":"Mon Oct 16 13:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":4.4859999999999998,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":59298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:12:32.751 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph pg dump --format=json 2023-10-16T13:12:32.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:32 smithi118 ceph-mon[103969]: pgmap v281: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-10-16T13:12:33.307 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:33.583 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:33 smithi092 ceph-mon[99542]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:12:33.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:33 smithi152 ceph-mon[104423]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:12:33.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:33 smithi118 ceph-mon[103969]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:12:34.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.622+0000 7fdc115ed700 1 -- 172.21.15.92:0/3529741437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc0c0ffe60 msgr2=0x7fdc0c1002e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:34.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.622+0000 7fdc115ed700 1 --2- 172.21.15.92:0/3529741437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc0c0ffe60 0x7fdc0c1002e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0099c0 tx=0x7fdbfc009cd0 comp rx=0 tx=0).stop 2023-10-16T13:12:34.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.622+0000 7fdc115ed700 1 -- 172.21.15.92:0/3529741437 shutdown_connections 2023-10-16T13:12:34.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.622+0000 7fdc115ed700 1 --2- 172.21.15.92:0/3529741437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc0c100820 0x7fdc0c10cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:34.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.622+0000 7fdc115ed700 1 --2- 172.21.15.92:0/3529741437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc0c105e70 0x7fdc0c106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:34.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.622+0000 7fdc115ed700 1 --2- 172.21.15.92:0/3529741437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc0c0ffe60 0x7fdc0c1002e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:34.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.622+0000 7fdc115ed700 1 -- 172.21.15.92:0/3529741437 >> 172.21.15.92:0/3529741437 conn(0x7fdc0c075e00 msgr2=0x7fdc0c076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:34.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.622+0000 7fdc115ed700 1 -- 172.21.15.92:0/3529741437 shutdown_connections 2023-10-16T13:12:34.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.622+0000 7fdc115ed700 1 -- 172.21.15.92:0/3529741437 wait complete. 2023-10-16T13:12:34.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.623+0000 7fdc115ed700 1 Processor -- start 2023-10-16T13:12:34.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.623+0000 7fdc115ed700 1 -- start start 2023-10-16T13:12:34.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.623+0000 7fdc115ed700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc0c0ffe60 0x7fdc0c196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:34.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.623+0000 7fdc115ed700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc0c100820 0x7fdc0c1974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:34.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.623+0000 7fdc115ed700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc0c105e70 0x7fdc0c19b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:34.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.623+0000 7fdc115ed700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c19bf50 con 0x7fdc0c105e70 2023-10-16T13:12:34.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.623+0000 7fdc115ed700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c19c0c0 con 0x7fdc0c100820 2023-10-16T13:12:34.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.623+0000 7fdc115ed700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c19c280 con 0x7fdc0c0ffe60 2023-10-16T13:12:34.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.624+0000 7fdc0b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc0c105e70 0x7fdc0c19b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:34.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.624+0000 7fdc0b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc0c105e70 0x7fdc0c19b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35858/0 (socket says 172.21.15.92:35858) 2023-10-16T13:12:34.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.624+0000 7fdc0b7fe700 1 -- 172.21.15.92:0/2371285530 learned_addr learned my addr 172.21.15.92:0/2371285530 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:34.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.624+0000 7fdc0a7fc700 1 --2- 172.21.15.92:0/2371285530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc0c100820 0x7fdc0c1974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:34.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.624+0000 7fdc0affd700 1 --2- 172.21.15.92:0/2371285530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc0c0ffe60 0x7fdc0c196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:34.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.624+0000 7fdc0b7fe700 1 -- 172.21.15.92:0/2371285530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc0c0ffe60 msgr2=0x7fdc0c196f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:34.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.624+0000 7fdc0b7fe700 1 --2- 172.21.15.92:0/2371285530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc0c0ffe60 0x7fdc0c196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:34.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.624+0000 7fdc0b7fe700 1 -- 172.21.15.92:0/2371285530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc0c100820 msgr2=0x7fdc0c1974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:34.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.624+0000 7fdc0b7fe700 1 --2- 172.21.15.92:0/2371285530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc0c100820 0x7fdc0c1974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:34.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.624+0000 7fdc0b7fe700 1 -- 172.21.15.92:0/2371285530 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc0095f0 con 0x7fdc0c105e70 2023-10-16T13:12:34.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.624+0000 7fdc0b7fe700 1 --2- 172.21.15.92:0/2371285530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc0c105e70 0x7fdc0c19b940 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdc04007ee0 tx=0x7fdc0400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:34.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.624+0000 7fdc03fff700 1 -- 172.21.15.92:0/2371285530 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04017070 con 0x7fdc0c105e70 2023-10-16T13:12:34.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.624+0000 7fdc115ed700 1 -- 172.21.15.92:0/2371285530 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0c19c560 con 0x7fdc0c105e70 2023-10-16T13:12:34.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.624+0000 7fdc115ed700 1 -- 172.21.15.92:0/2371285530 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0c1a3dc0 con 0x7fdc0c105e70 2023-10-16T13:12:34.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.624+0000 7fdc03fff700 1 -- 172.21.15.92:0/2371285530 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdc0400f040 con 0x7fdc0c105e70 2023-10-16T13:12:34.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.624+0000 7fdc03fff700 1 -- 172.21.15.92:0/2371285530 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04005760 con 0x7fdc0c105e70 2023-10-16T13:12:34.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.625+0000 7fdc115ed700 1 -- 172.21.15.92:0/2371285530 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbec005320 con 0x7fdc0c105e70 2023-10-16T13:12:34.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.626+0000 7fdc03fff700 1 -- 172.21.15.92:0/2371285530 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fdc040058c0 con 0x7fdc0c105e70 2023-10-16T13:12:34.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.627+0000 7fdc03fff700 1 --2- 172.21.15.92:0/2371285530 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdbf80a1590 0x7fdbf80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:34.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.627+0000 7fdc0affd700 1 --2- 172.21.15.92:0/2371285530 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdbf80a1590 0x7fdbf80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:34.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.627+0000 7fdc03fff700 1 -- 172.21.15.92:0/2371285530 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdc040cc920 con 0x7fdc0c105e70 2023-10-16T13:12:34.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.627+0000 7fdc0affd700 1 --2- 172.21.15.92:0/2371285530 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdbf80a1590 0x7fdbf80a3a50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400ba60 tx=0x7fdbf4005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:34.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.630+0000 7fdc03fff700 1 -- 172.21.15.92:0/2371285530 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdc04095fd0 con 0x7fdc0c105e70 2023-10-16T13:12:34.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:34 smithi152 ceph-mon[104423]: pgmap v282: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-16T13:12:34.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:34 smithi092 ceph-mon[99542]: pgmap v282: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-16T13:12:34.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:34 smithi118 ceph-mon[103969]: pgmap v282: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-16T13:12:34.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.816+0000 7fdc115ed700 1 -- 172.21.15.92:0/2371285530 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdbec000bf0 con 0x7fdbf80a1590 2023-10-16T13:12:34.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.826+0000 7fdc03fff700 1 -- 172.21.15.92:0/2371285530 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+341200 (secure 0 0 0) 0x7fdbec000bf0 con 0x7fdbf80a1590 2023-10-16T13:12:34.833 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:12:34.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.829+0000 7fdc115ed700 1 -- 172.21.15.92:0/2371285530 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdbf80a1590 msgr2=0x7fdbf80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:34.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.829+0000 7fdc115ed700 1 --2- 172.21.15.92:0/2371285530 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdbf80a1590 0x7fdbf80a3a50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400ba60 tx=0x7fdbf4005d50 comp rx=0 tx=0).stop 2023-10-16T13:12:34.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.829+0000 7fdc115ed700 1 -- 172.21.15.92:0/2371285530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc0c105e70 msgr2=0x7fdc0c19b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:34.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.829+0000 7fdc115ed700 1 --2- 172.21.15.92:0/2371285530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc0c105e70 0x7fdc0c19b940 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdc04007ee0 tx=0x7fdc0400d3b0 comp rx=0 tx=0).stop 2023-10-16T13:12:34.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.829+0000 7fdc115ed700 1 -- 172.21.15.92:0/2371285530 shutdown_connections 2023-10-16T13:12:34.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.829+0000 7fdc115ed700 1 --2- 172.21.15.92:0/2371285530 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdbf80a1590 0x7fdbf80a3a50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:34.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.829+0000 7fdc115ed700 1 --2- 172.21.15.92:0/2371285530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc0c105e70 0x7fdc0c19b940 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:34.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.829+0000 7fdc115ed700 1 --2- 172.21.15.92:0/2371285530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc0c0ffe60 0x7fdc0c196f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:34.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.829+0000 7fdc115ed700 1 --2- 172.21.15.92:0/2371285530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc0c100820 0x7fdc0c1974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:34.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.829+0000 7fdc115ed700 1 -- 172.21.15.92:0/2371285530 >> 172.21.15.92:0/2371285530 conn(0x7fdc0c075e00 msgr2=0x7fdc0c103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:34.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.829+0000 7fdc115ed700 1 -- 172.21.15.92:0/2371285530 shutdown_connections 2023-10-16T13:12:34.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:34.829+0000 7fdc115ed700 1 -- 172.21.15.92:0/2371285530 wait complete. 2023-10-16T13:12:34.837 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-10-16T13:12:35.254 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2023-10-16T13:12:33.272193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655362,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":604,"num_read_kb":419,"num_write":418,"num_write_kb":3070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":344,"ondisk_log_size":344,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336904,"kb_used_data":12712,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604920,"statfs":{"total":1151940427776,"available":1151595438080,"internally_reserved":0,"allocated":13017088,"data_stored":7065474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19128,"internal_metadata":331855176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002732"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228907+0000","last_change":"2023-10-16T13:11:40.980978+0000","last_active":"2023-10-16T13:11:43.228907+0000","last_peered":"2023-10-16T13:11:43.228907+0000","last_clean":"2023-10-16T13:11:43.228907+0000","last_became_active":"2023-10-16T13:11:40.980468+0000","last_became_peered":"2023-10-16T13:11:40.980468+0000","last_unstale":"2023-10-16T13:11:43.228907+0000","last_undegraded":"2023-10-16T13:11:43.228907+0000","last_fullsized":"2023-10-16T13:11:43.228907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.261864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717598+0000","last_change":"2023-10-16T13:11:40.971625+0000","last_active":"2023-10-16T13:11:42.717598+0000","last_peered":"2023-10-16T13:11:42.717598+0000","last_clean":"2023-10-16T13:11:42.717598+0000","last_became_active":"2023-10-16T13:11:40.971028+0000","last_became_peered":"2023-10-16T13:11:40.971028+0000","last_unstale":"2023-10-16T13:11:42.717598+0000","last_undegraded":"2023-10-16T13:11:42.717598+0000","last_fullsized":"2023-10-16T13:11:42.717598+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:08.974553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717498+0000","last_change":"2023-10-16T13:11:40.973705+0000","last_active":"2023-10-16T13:11:42.717498+0000","last_peered":"2023-10-16T13:11:42.717498+0000","last_clean":"2023-10-16T13:11:42.717498+0000","last_became_active":"2023-10-16T13:11:40.973347+0000","last_became_peered":"2023-10-16T13:11:40.973347+0000","last_unstale":"2023-10-16T13:11:42.717498+0000","last_undegraded":"2023-10-16T13:11:42.717498+0000","last_fullsized":"2023-10-16T13:11:42.717498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:46.628383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.938443+0000","last_change":"2023-10-16T13:11:40.974996+0000","last_active":"2023-10-16T13:11:42.938443+0000","last_peered":"2023-10-16T13:11:42.938443+0000","last_clean":"2023-10-16T13:11:42.938443+0000","last_became_active":"2023-10-16T13:11:40.973807+0000","last_became_peered":"2023-10-16T13:11:40.973807+0000","last_unstale":"2023-10-16T13:11:42.938443+0000","last_undegraded":"2023-10-16T13:11:42.938443+0000","last_fullsized":"2023-10-16T13:11:42.938443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:02:14.901036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228247+0000","last_change":"2023-10-16T13:11:40.976558+0000","last_active":"2023-10-16T13:11:43.228247+0000","last_peered":"2023-10-16T13:11:43.228247+0000","last_clean":"2023-10-16T13:11:43.228247+0000","last_became_active":"2023-10-16T13:11:40.976159+0000","last_became_peered":"2023-10-16T13:11:40.976159+0000","last_unstale":"2023-10-16T13:11:43.228247+0000","last_undegraded":"2023-10-16T13:11:43.228247+0000","last_fullsized":"2023-10-16T13:11:43.228247+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:58:16.532294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.227919+0000","last_change":"2023-10-16T13:11:40.977510+0000","last_active":"2023-10-16T13:11:43.227919+0000","last_peered":"2023-10-16T13:11:43.227919+0000","last_clean":"2023-10-16T13:11:43.227919+0000","last_became_active":"2023-10-16T13:11:40.977184+0000","last_became_peered":"2023-10-16T13:11:40.977184+0000","last_unstale":"2023-10-16T13:11:43.227919+0000","last_undegraded":"2023-10-16T13:11:43.227919+0000","last_fullsized":"2023-10-16T13:11:43.227919+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:24:33.215430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972030+0000","last_change":"2023-10-16T13:11:40.969982+0000","last_active":"2023-10-16T13:11:42.972030+0000","last_peered":"2023-10-16T13:11:42.972030+0000","last_clean":"2023-10-16T13:11:42.972030+0000","last_became_active":"2023-10-16T13:11:40.969651+0000","last_became_peered":"2023-10-16T13:11:40.969651+0000","last_unstale":"2023-10-16T13:11:42.972030+0000","last_undegraded":"2023-10-16T13:11:42.972030+0000","last_fullsized":"2023-10-16T13:11:42.972030+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:37:01.702748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961091+0000","last_change":"2023-10-16T13:11:40.967952+0000","last_active":"2023-10-16T13:11:41.961091+0000","last_peered":"2023-10-16T13:11:41.961091+0000","last_clean":"2023-10-16T13:11:41.961091+0000","last_became_active":"2023-10-16T13:11:40.967621+0000","last_became_peered":"2023-10-16T13:11:40.967621+0000","last_unstale":"2023-10-16T13:11:41.961091+0000","last_undegraded":"2023-10-16T13:11:41.961091+0000","last_fullsized":"2023-10-16T13:11:41.961091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:04:09.243563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962240+0000","last_change":"2023-10-16T13:11:40.978172+0000","last_active":"2023-10-16T13:11:41.962240+0000","last_peered":"2023-10-16T13:11:41.962240+0000","last_clean":"2023-10-16T13:11:41.962240+0000","last_became_active":"2023-10-16T13:11:40.977727+0000","last_became_peered":"2023-10-16T13:11:40.977727+0000","last_unstale":"2023-10-16T13:11:41.962240+0000","last_undegraded":"2023-10-16T13:11:41.962240+0000","last_fullsized":"2023-10-16T13:11:41.962240+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:06:16.469370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228227+0000","last_change":"2023-10-16T13:11:40.973343+0000","last_active":"2023-10-16T13:11:43.228227+0000","last_peered":"2023-10-16T13:11:43.228227+0000","last_clean":"2023-10-16T13:11:43.228227+0000","last_became_active":"2023-10-16T13:11:40.972997+0000","last_became_peered":"2023-10-16T13:11:40.972997+0000","last_unstale":"2023-10-16T13:11:43.228227+0000","last_undegraded":"2023-10-16T13:11:43.228227+0000","last_fullsized":"2023-10-16T13:11:43.228227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:23:21.235742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972369+0000","last_change":"2023-10-16T13:11:40.980253+0000","last_active":"2023-10-16T13:11:42.972369+0000","last_peered":"2023-10-16T13:11:42.972369+0000","last_clean":"2023-10-16T13:11:42.972369+0000","last_became_active":"2023-10-16T13:11:40.979473+0000","last_became_peered":"2023-10-16T13:11:40.979473+0000","last_unstale":"2023-10-16T13:11:42.972369+0000","last_undegraded":"2023-10-16T13:11:42.972369+0000","last_fullsized":"2023-10-16T13:11:42.972369+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:37:46.976128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.938394+0000","last_change":"2023-10-16T13:11:40.974791+0000","last_active":"2023-10-16T13:11:42.938394+0000","last_peered":"2023-10-16T13:11:42.938394+0000","last_clean":"2023-10-16T13:11:42.938394+0000","last_became_active":"2023-10-16T13:11:40.973353+0000","last_became_peered":"2023-10-16T13:11:40.973353+0000","last_unstale":"2023-10-16T13:11:42.938394+0000","last_undegraded":"2023-10-16T13:11:42.938394+0000","last_fullsized":"2023-10-16T13:11:42.938394+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:35:40.649071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228607+0000","last_change":"2023-10-16T13:11:40.971681+0000","last_active":"2023-10-16T13:11:43.228607+0000","last_peered":"2023-10-16T13:11:43.228607+0000","last_clean":"2023-10-16T13:11:43.228607+0000","last_became_active":"2023-10-16T13:11:40.971349+0000","last_became_peered":"2023-10-16T13:11:40.971349+0000","last_unstale":"2023-10-16T13:11:43.228607+0000","last_undegraded":"2023-10-16T13:11:43.228607+0000","last_fullsized":"2023-10-16T13:11:43.228607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:50:38.285478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717591+0000","last_change":"2023-10-16T13:11:40.971859+0000","last_active":"2023-10-16T13:11:42.717591+0000","last_peered":"2023-10-16T13:11:42.717591+0000","last_clean":"2023-10-16T13:11:42.717591+0000","last_became_active":"2023-10-16T13:11:40.971107+0000","last_became_peered":"2023-10-16T13:11:40.971107+0000","last_unstale":"2023-10-16T13:11:42.717591+0000","last_undegraded":"2023-10-16T13:11:42.717591+0000","last_fullsized":"2023-10-16T13:11:42.717591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:57:52.655130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717282+0000","last_change":"2023-10-16T13:11:40.976604+0000","last_active":"2023-10-16T13:11:42.717282+0000","last_peered":"2023-10-16T13:11:42.717282+0000","last_clean":"2023-10-16T13:11:42.717282+0000","last_became_active":"2023-10-16T13:11:40.976262+0000","last_became_peered":"2023-10-16T13:11:40.976262+0000","last_unstale":"2023-10-16T13:11:42.717282+0000","last_undegraded":"2023-10-16T13:11:42.717282+0000","last_fullsized":"2023-10-16T13:11:42.717282+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:18:55.867316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961792+0000","last_change":"2023-10-16T13:11:40.975785+0000","last_active":"2023-10-16T13:11:41.961792+0000","last_peered":"2023-10-16T13:11:41.961792+0000","last_clean":"2023-10-16T13:11:41.961792+0000","last_became_active":"2023-10-16T13:11:40.975463+0000","last_became_peered":"2023-10-16T13:11:40.975463+0000","last_unstale":"2023-10-16T13:11:41.961792+0000","last_undegraded":"2023-10-16T13:11:41.961792+0000","last_fullsized":"2023-10-16T13:11:41.961792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:37:29.337596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228897+0000","last_change":"2023-10-16T13:11:40.980784+0000","last_active":"2023-10-16T13:11:43.228897+0000","last_peered":"2023-10-16T13:11:43.228897+0000","last_clean":"2023-10-16T13:11:43.228897+0000","last_became_active":"2023-10-16T13:11:40.980374+0000","last_became_peered":"2023-10-16T13:11:40.980374+0000","last_unstale":"2023-10-16T13:11:43.228897+0000","last_undegraded":"2023-10-16T13:11:43.228897+0000","last_fullsized":"2023-10-16T13:11:43.228897+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:38:12.236358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228219+0000","last_change":"2023-10-16T13:11:40.980775+0000","last_active":"2023-10-16T13:11:43.228219+0000","last_peered":"2023-10-16T13:11:43.228219+0000","last_clean":"2023-10-16T13:11:43.228219+0000","last_became_active":"2023-10-16T13:11:40.980261+0000","last_became_peered":"2023-10-16T13:11:40.980261+0000","last_unstale":"2023-10-16T13:11:43.228219+0000","last_undegraded":"2023-10-16T13:11:43.228219+0000","last_fullsized":"2023-10-16T13:11:43.228219+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:36:57.112989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.986406+0000","last_change":"2023-10-16T13:11:40.970030+0000","last_active":"2023-10-16T13:11:42.986406+0000","last_peered":"2023-10-16T13:11:42.986406+0000","last_clean":"2023-10-16T13:11:42.986406+0000","last_became_active":"2023-10-16T13:11:40.969698+0000","last_became_peered":"2023-10-16T13:11:40.969698+0000","last_unstale":"2023-10-16T13:11:42.986406+0000","last_undegraded":"2023-10-16T13:11:42.986406+0000","last_fullsized":"2023-10-16T13:11:42.986406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:42:00.520386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":69,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:12:28.407103+0000","last_change":"2023-10-16T13:11:39.957688+0000","last_active":"2023-10-16T13:12:28.407103+0000","last_peered":"2023-10-16T13:12:28.407103+0000","last_clean":"2023-10-16T13:12:28.407103+0000","last_became_active":"2023-10-16T13:11:39.957391+0000","last_became_peered":"2023-10-16T13:11:39.957391+0000","last_unstale":"2023-10-16T13:12:28.407103+0000","last_undegraded":"2023-10-16T13:12:28.407103+0000","last_fullsized":"2023-10-16T13:12:28.407103+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:42:17.875770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961607+0000","last_change":"2023-10-16T13:11:40.968984+0000","last_active":"2023-10-16T13:11:41.961607+0000","last_peered":"2023-10-16T13:11:41.961607+0000","last_clean":"2023-10-16T13:11:41.961607+0000","last_became_active":"2023-10-16T13:11:40.968338+0000","last_became_peered":"2023-10-16T13:11:40.968338+0000","last_unstale":"2023-10-16T13:11:41.961607+0000","last_undegraded":"2023-10-16T13:11:41.961607+0000","last_fullsized":"2023-10-16T13:11:41.961607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:49:21.643029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961716+0000","last_change":"2023-10-16T13:11:39.959458+0000","last_active":"2023-10-16T13:11:41.961716+0000","last_peered":"2023-10-16T13:11:41.961716+0000","last_clean":"2023-10-16T13:11:41.961716+0000","last_became_active":"2023-10-16T13:11:39.959155+0000","last_became_peered":"2023-10-16T13:11:39.959155+0000","last_unstale":"2023-10-16T13:11:41.961716+0000","last_undegraded":"2023-10-16T13:11:41.961716+0000","last_fullsized":"2023-10-16T13:11:41.961716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:18:30.725604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717655+0000","last_change":"2023-10-16T13:11:40.980168+0000","last_active":"2023-10-16T13:11:42.717655+0000","last_peered":"2023-10-16T13:11:42.717655+0000","last_clean":"2023-10-16T13:11:42.717655+0000","last_became_active":"2023-10-16T13:11:40.979839+0000","last_became_peered":"2023-10-16T13:11:40.979839+0000","last_unstale":"2023-10-16T13:11:42.717655+0000","last_undegraded":"2023-10-16T13:11:42.717655+0000","last_fullsized":"2023-10-16T13:11:42.717655+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:25:31.374291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:48.352370+0000","last_change":"2023-10-16T13:11:39.957065+0000","last_active":"2023-10-16T13:11:48.352370+0000","last_peered":"2023-10-16T13:11:48.352370+0000","last_clean":"2023-10-16T13:11:48.352370+0000","last_became_active":"2023-10-16T13:11:39.956759+0000","last_became_peered":"2023-10-16T13:11:39.956759+0000","last_unstale":"2023-10-16T13:11:48.352370+0000","last_undegraded":"2023-10-16T13:11:48.352370+0000","last_fullsized":"2023-10-16T13:11:48.352370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:06:39.862025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961875+0000","last_change":"2023-10-16T13:11:40.978989+0000","last_active":"2023-10-16T13:11:41.961875+0000","last_peered":"2023-10-16T13:11:41.961875+0000","last_clean":"2023-10-16T13:11:41.961875+0000","last_became_active":"2023-10-16T13:11:40.978582+0000","last_became_peered":"2023-10-16T13:11:40.978582+0000","last_unstale":"2023-10-16T13:11:41.961875+0000","last_undegraded":"2023-10-16T13:11:41.961875+0000","last_fullsized":"2023-10-16T13:11:41.961875+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:29:54.733058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.353465+0000","last_change":"2023-10-16T13:11:39.955340+0000","last_active":"2023-10-16T13:11:47.353465+0000","last_peered":"2023-10-16T13:11:47.353465+0000","last_clean":"2023-10-16T13:11:47.353465+0000","last_became_active":"2023-10-16T13:11:39.955032+0000","last_became_peered":"2023-10-16T13:11:39.955032+0000","last_unstale":"2023-10-16T13:11:47.353465+0000","last_undegraded":"2023-10-16T13:11:47.353465+0000","last_fullsized":"2023-10-16T13:11:47.353465+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:01:11.518823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962697+0000","last_change":"2023-10-16T13:11:40.974458+0000","last_active":"2023-10-16T13:11:41.962697+0000","last_peered":"2023-10-16T13:11:41.962697+0000","last_clean":"2023-10-16T13:11:41.962697+0000","last_became_active":"2023-10-16T13:11:40.974146+0000","last_became_peered":"2023-10-16T13:11:40.974146+0000","last_unstale":"2023-10-16T13:11:41.962697+0000","last_undegraded":"2023-10-16T13:11:41.962697+0000","last_fullsized":"2023-10-16T13:11:41.962697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:57:58.851273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":66,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:12:27.370523+0000","last_change":"2023-10-16T13:11:39.958561+0000","last_active":"2023-10-16T13:12:27.370523+0000","last_peered":"2023-10-16T13:12:27.370523+0000","last_clean":"2023-10-16T13:12:27.370523+0000","last_became_active":"2023-10-16T13:11:39.958272+0000","last_became_peered":"2023-10-16T13:11:39.958272+0000","last_unstale":"2023-10-16T13:12:27.370523+0000","last_undegraded":"2023-10-16T13:12:27.370523+0000","last_fullsized":"2023-10-16T13:12:27.370523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:46.162288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228649+0000","last_change":"2023-10-16T13:11:40.970345+0000","last_active":"2023-10-16T13:11:43.228649+0000","last_peered":"2023-10-16T13:11:43.228649+0000","last_clean":"2023-10-16T13:11:43.228649+0000","last_became_active":"2023-10-16T13:11:40.970024+0000","last_became_peered":"2023-10-16T13:11:40.970024+0000","last_unstale":"2023-10-16T13:11:43.228649+0000","last_undegraded":"2023-10-16T13:11:43.228649+0000","last_fullsized":"2023-10-16T13:11:43.228649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:41.703074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:46.336335+0000","last_change":"2023-10-16T13:11:39.951194+0000","last_active":"2023-10-16T13:11:46.336335+0000","last_peered":"2023-10-16T13:11:46.336335+0000","last_clean":"2023-10-16T13:11:46.336335+0000","last_became_active":"2023-10-16T13:11:39.950837+0000","last_became_peered":"2023-10-16T13:11:39.950837+0000","last_unstale":"2023-10-16T13:11:46.336335+0000","last_undegraded":"2023-10-16T13:11:46.336335+0000","last_fullsized":"2023-10-16T13:11:46.336335+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:59:17.756924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962589+0000","last_change":"2023-10-16T13:11:40.959602+0000","last_active":"2023-10-16T13:11:41.962589+0000","last_peered":"2023-10-16T13:11:41.962589+0000","last_clean":"2023-10-16T13:11:41.962589+0000","last_became_active":"2023-10-16T13:11:40.959231+0000","last_became_peered":"2023-10-16T13:11:40.959231+0000","last_unstale":"2023-10-16T13:11:41.962589+0000","last_undegraded":"2023-10-16T13:11:41.962589+0000","last_fullsized":"2023-10-16T13:11:41.962589+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:59:54.623471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:45.311296+0000","last_change":"2023-10-16T13:11:39.952655+0000","last_active":"2023-10-16T13:11:45.311296+0000","last_peered":"2023-10-16T13:11:45.311296+0000","last_clean":"2023-10-16T13:11:45.311296+0000","last_became_active":"2023-10-16T13:11:39.952324+0000","last_became_peered":"2023-10-16T13:11:39.952324+0000","last_unstale":"2023-10-16T13:11:45.311296+0000","last_undegraded":"2023-10-16T13:11:45.311296+0000","last_fullsized":"2023-10-16T13:11:45.311296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:09:14.077837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961022+0000","last_change":"2023-10-16T13:11:40.969019+0000","last_active":"2023-10-16T13:11:41.961022+0000","last_peered":"2023-10-16T13:11:41.961022+0000","last_clean":"2023-10-16T13:11:41.961022+0000","last_became_active":"2023-10-16T13:11:40.968645+0000","last_became_peered":"2023-10-16T13:11:40.968645+0000","last_unstale":"2023-10-16T13:11:41.961022+0000","last_undegraded":"2023-10-16T13:11:41.961022+0000","last_fullsized":"2023-10-16T13:11:41.961022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:23:18.700377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.353278+0000","last_change":"2023-10-16T13:11:39.959826+0000","last_active":"2023-10-16T13:11:47.353278+0000","last_peered":"2023-10-16T13:11:47.353278+0000","last_clean":"2023-10-16T13:11:47.353278+0000","last_became_active":"2023-10-16T13:11:39.959490+0000","last_became_peered":"2023-10-16T13:11:39.959490+0000","last_unstale":"2023-10-16T13:11:47.353278+0000","last_undegraded":"2023-10-16T13:11:47.353278+0000","last_fullsized":"2023-10-16T13:11:47.353278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:52:01.865005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228193+0000","last_change":"2023-10-16T13:11:40.977941+0000","last_active":"2023-10-16T13:11:43.228193+0000","last_peered":"2023-10-16T13:11:43.228193+0000","last_clean":"2023-10-16T13:11:43.228193+0000","last_became_active":"2023-10-16T13:11:40.977558+0000","last_became_peered":"2023-10-16T13:11:40.977558+0000","last_unstale":"2023-10-16T13:11:43.228193+0000","last_undegraded":"2023-10-16T13:11:43.228193+0000","last_fullsized":"2023-10-16T13:11:43.228193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:29:16.932234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":106,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:12:30.374592+0000","last_change":"2023-10-16T13:11:39.953728+0000","last_active":"2023-10-16T13:12:30.374592+0000","last_peered":"2023-10-16T13:12:30.374592+0000","last_clean":"2023-10-16T13:12:30.374592+0000","last_became_active":"2023-10-16T13:11:39.953421+0000","last_became_peered":"2023-10-16T13:11:39.953421+0000","last_unstale":"2023-10-16T13:12:30.374592+0000","last_undegraded":"2023-10-16T13:12:30.374592+0000","last_fullsized":"2023-10-16T13:12:30.374592+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:22:14.537974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":89,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962178+0000","last_change":"2023-10-16T13:11:40.978214+0000","last_active":"2023-10-16T13:11:41.962178+0000","last_peered":"2023-10-16T13:11:41.962178+0000","last_clean":"2023-10-16T13:11:41.962178+0000","last_became_active":"2023-10-16T13:11:40.977786+0000","last_became_peered":"2023-10-16T13:11:40.977786+0000","last_unstale":"2023-10-16T13:11:41.962178+0000","last_undegraded":"2023-10-16T13:11:41.962178+0000","last_fullsized":"2023-10-16T13:11:41.962178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:43:51.218758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.352714+0000","last_change":"2023-10-16T13:11:39.959589+0000","last_active":"2023-10-16T13:11:47.352714+0000","last_peered":"2023-10-16T13:11:47.352714+0000","last_clean":"2023-10-16T13:11:47.352714+0000","last_became_active":"2023-10-16T13:11:39.959242+0000","last_became_peered":"2023-10-16T13:11:39.959242+0000","last_unstale":"2023-10-16T13:11:47.352714+0000","last_undegraded":"2023-10-16T13:11:47.352714+0000","last_fullsized":"2023-10-16T13:11:47.352714+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:54.955605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717681+0000","last_change":"2023-10-16T13:11:40.975814+0000","last_active":"2023-10-16T13:11:42.717681+0000","last_peered":"2023-10-16T13:11:42.717681+0000","last_clean":"2023-10-16T13:11:42.717681+0000","last_became_active":"2023-10-16T13:11:40.975485+0000","last_became_peered":"2023-10-16T13:11:40.975485+0000","last_unstale":"2023-10-16T13:11:42.717681+0000","last_undegraded":"2023-10-16T13:11:42.717681+0000","last_fullsized":"2023-10-16T13:11:42.717681+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:25.661616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:45.303902+0000","last_change":"2023-10-16T13:11:39.956586+0000","last_active":"2023-10-16T13:11:45.303902+0000","last_peered":"2023-10-16T13:11:45.303902+0000","last_clean":"2023-10-16T13:11:45.303902+0000","last_became_active":"2023-10-16T13:11:39.956270+0000","last_became_peered":"2023-10-16T13:11:39.956270+0000","last_unstale":"2023-10-16T13:11:45.303902+0000","last_undegraded":"2023-10-16T13:11:45.303902+0000","last_fullsized":"2023-10-16T13:11:45.303902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:11:12.435377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962008+0000","last_change":"2023-10-16T13:11:40.978918+0000","last_active":"2023-10-16T13:11:41.962008+0000","last_peered":"2023-10-16T13:11:41.962008+0000","last_clean":"2023-10-16T13:11:41.962008+0000","last_became_active":"2023-10-16T13:11:40.978520+0000","last_became_peered":"2023-10-16T13:11:40.978520+0000","last_unstale":"2023-10-16T13:11:41.962008+0000","last_undegraded":"2023-10-16T13:11:41.962008+0000","last_fullsized":"2023-10-16T13:11:41.962008+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:09:57.269111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'31","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:12:30.388351+0000","last_change":"2023-10-16T13:11:39.956692+0000","last_active":"2023-10-16T13:12:30.388351+0000","last_peered":"2023-10-16T13:12:30.388351+0000","last_clean":"2023-10-16T13:12:30.388351+0000","last_became_active":"2023-10-16T13:11:39.956340+0000","last_became_peered":"2023-10-16T13:11:39.956340+0000","last_unstale":"2023-10-16T13:12:30.388351+0000","last_undegraded":"2023-10-16T13:12:30.388351+0000","last_fullsized":"2023-10-16T13:12:30.388351+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:48:23.320743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57546,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":101,"num_read_kb":106,"num_write":33,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228483+0000","last_change":"2023-10-16T13:11:40.969423+0000","last_active":"2023-10-16T13:11:43.228483+0000","last_peered":"2023-10-16T13:11:43.228483+0000","last_clean":"2023-10-16T13:11:43.228483+0000","last_became_active":"2023-10-16T13:11:40.969022+0000","last_became_peered":"2023-10-16T13:11:40.969022+0000","last_unstale":"2023-10-16T13:11:43.228483+0000","last_undegraded":"2023-10-16T13:11:43.228483+0000","last_fullsized":"2023-10-16T13:11:43.228483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:51:26.911443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.352081+0000","last_change":"2023-10-16T13:11:39.962364+0000","last_active":"2023-10-16T13:11:47.352081+0000","last_peered":"2023-10-16T13:11:47.352081+0000","last_clean":"2023-10-16T13:11:47.352081+0000","last_became_active":"2023-10-16T13:11:39.962077+0000","last_became_peered":"2023-10-16T13:11:39.962077+0000","last_unstale":"2023-10-16T13:11:47.352081+0000","last_undegraded":"2023-10-16T13:11:47.352081+0000","last_fullsized":"2023-10-16T13:11:47.352081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:50:58.478054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228556+0000","last_change":"2023-10-16T13:11:40.970958+0000","last_active":"2023-10-16T13:11:43.228556+0000","last_peered":"2023-10-16T13:11:43.228556+0000","last_clean":"2023-10-16T13:11:43.228556+0000","last_became_active":"2023-10-16T13:11:40.970670+0000","last_became_peered":"2023-10-16T13:11:40.970670+0000","last_unstale":"2023-10-16T13:11:43.228556+0000","last_undegraded":"2023-10-16T13:11:43.228556+0000","last_fullsized":"2023-10-16T13:11:43.228556+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:47:30.594558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.353161+0000","last_change":"2023-10-16T13:11:39.957334+0000","last_active":"2023-10-16T13:11:47.353161+0000","last_peered":"2023-10-16T13:11:47.353161+0000","last_clean":"2023-10-16T13:11:47.353161+0000","last_became_active":"2023-10-16T13:11:39.957027+0000","last_became_peered":"2023-10-16T13:11:39.957027+0000","last_unstale":"2023-10-16T13:11:47.353161+0000","last_undegraded":"2023-10-16T13:11:47.353161+0000","last_fullsized":"2023-10-16T13:11:47.353161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:27:37.164359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972218+0000","last_change":"2023-10-16T13:11:40.977201+0000","last_active":"2023-10-16T13:11:42.972218+0000","last_peered":"2023-10-16T13:11:42.972218+0000","last_clean":"2023-10-16T13:11:42.972218+0000","last_became_active":"2023-10-16T13:11:40.976860+0000","last_became_peered":"2023-10-16T13:11:40.976860+0000","last_unstale":"2023-10-16T13:11:42.972218+0000","last_undegraded":"2023-10-16T13:11:42.972218+0000","last_fullsized":"2023-10-16T13:11:42.972218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:57.867339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":66,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:12:31.411666+0000","last_change":"2023-10-16T13:11:39.958627+0000","last_active":"2023-10-16T13:12:31.411666+0000","last_peered":"2023-10-16T13:12:31.411666+0000","last_clean":"2023-10-16T13:12:31.411666+0000","last_became_active":"2023-10-16T13:11:39.958230+0000","last_became_peered":"2023-10-16T13:11:39.958230+0000","last_unstale":"2023-10-16T13:12:31.411666+0000","last_undegraded":"2023-10-16T13:12:31.411666+0000","last_fullsized":"2023-10-16T13:12:31.411666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:47:47.534392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":48,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.971981+0000","last_change":"2023-10-16T13:11:40.972841+0000","last_active":"2023-10-16T13:11:42.971981+0000","last_peered":"2023-10-16T13:11:42.971981+0000","last_clean":"2023-10-16T13:11:42.971981+0000","last_became_active":"2023-10-16T13:11:40.972406+0000","last_became_peered":"2023-10-16T13:11:40.972406+0000","last_unstale":"2023-10-16T13:11:42.971981+0000","last_undegraded":"2023-10-16T13:11:42.971981+0000","last_fullsized":"2023-10-16T13:11:42.971981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:04.134000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.352411+0000","last_change":"2023-10-16T13:11:39.955064+0000","last_active":"2023-10-16T13:11:47.352411+0000","last_peered":"2023-10-16T13:11:47.352411+0000","last_clean":"2023-10-16T13:11:47.352411+0000","last_became_active":"2023-10-16T13:11:39.954690+0000","last_became_peered":"2023-10-16T13:11:39.954690+0000","last_unstale":"2023-10-16T13:11:47.352411+0000","last_undegraded":"2023-10-16T13:11:47.352411+0000","last_fullsized":"2023-10-16T13:11:47.352411+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:30.341233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962429+0000","last_change":"2023-10-16T13:11:40.978373+0000","last_active":"2023-10-16T13:11:41.962429+0000","last_peered":"2023-10-16T13:11:41.962429+0000","last_clean":"2023-10-16T13:11:41.962429+0000","last_became_active":"2023-10-16T13:11:40.977890+0000","last_became_peered":"2023-10-16T13:11:40.977890+0000","last_unstale":"2023-10-16T13:11:41.962429+0000","last_undegraded":"2023-10-16T13:11:41.962429+0000","last_fullsized":"2023-10-16T13:11:41.962429+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:33:21.566200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:45.302083+0000","last_change":"2023-10-16T13:11:39.952698+0000","last_active":"2023-10-16T13:11:45.302083+0000","last_peered":"2023-10-16T13:11:45.302083+0000","last_clean":"2023-10-16T13:11:45.302083+0000","last_became_active":"2023-10-16T13:11:39.952383+0000","last_became_peered":"2023-10-16T13:11:39.952383+0000","last_unstale":"2023-10-16T13:11:45.302083+0000","last_undegraded":"2023-10-16T13:11:45.302083+0000","last_fullsized":"2023-10-16T13:11:45.302083+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:06:57.841990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228686+0000","last_change":"2023-10-16T13:11:40.977579+0000","last_active":"2023-10-16T13:11:43.228686+0000","last_peered":"2023-10-16T13:11:43.228686+0000","last_clean":"2023-10-16T13:11:43.228686+0000","last_became_active":"2023-10-16T13:11:40.977117+0000","last_became_peered":"2023-10-16T13:11:40.977117+0000","last_unstale":"2023-10-16T13:11:43.228686+0000","last_undegraded":"2023-10-16T13:11:43.228686+0000","last_fullsized":"2023-10-16T13:11:43.228686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:18.859388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228274+0000","last_change":"2023-10-16T13:11:39.957430+0000","last_active":"2023-10-16T13:11:43.228274+0000","last_peered":"2023-10-16T13:11:43.228274+0000","last_clean":"2023-10-16T13:11:43.228274+0000","last_became_active":"2023-10-16T13:11:39.957088+0000","last_became_peered":"2023-10-16T13:11:39.957088+0000","last_unstale":"2023-10-16T13:11:43.228274+0000","last_undegraded":"2023-10-16T13:11:43.228274+0000","last_fullsized":"2023-10-16T13:11:43.228274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:21:57.307718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228260+0000","last_change":"2023-10-16T13:11:40.970009+0000","last_active":"2023-10-16T13:11:43.228260+0000","last_peered":"2023-10-16T13:11:43.228260+0000","last_clean":"2023-10-16T13:11:43.228260+0000","last_became_active":"2023-10-16T13:11:40.969668+0000","last_became_peered":"2023-10-16T13:11:40.969668+0000","last_unstale":"2023-10-16T13:11:43.228260+0000","last_undegraded":"2023-10-16T13:11:43.228260+0000","last_fullsized":"2023-10-16T13:11:43.228260+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:48:35.556712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":62,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:12:29.408856+0000","last_change":"2023-10-16T13:11:39.958168+0000","last_active":"2023-10-16T13:12:29.408856+0000","last_peered":"2023-10-16T13:12:29.408856+0000","last_clean":"2023-10-16T13:12:29.408856+0000","last_became_active":"2023-10-16T13:11:39.957628+0000","last_became_peered":"2023-10-16T13:11:39.957628+0000","last_unstale":"2023-10-16T13:12:29.408856+0000","last_undegraded":"2023-10-16T13:12:29.408856+0000","last_fullsized":"2023-10-16T13:12:29.408856+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:55:52.658523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228154+0000","last_change":"2023-10-16T13:11:40.977161+0000","last_active":"2023-10-16T13:11:43.228154+0000","last_peered":"2023-10-16T13:11:43.228154+0000","last_clean":"2023-10-16T13:11:43.228154+0000","last_became_active":"2023-10-16T13:11:40.976821+0000","last_became_peered":"2023-10-16T13:11:40.976821+0000","last_unstale":"2023-10-16T13:11:43.228154+0000","last_undegraded":"2023-10-16T13:11:43.228154+0000","last_fullsized":"2023-10-16T13:11:43.228154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:42:26.712826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962502+0000","last_change":"2023-10-16T13:11:40.966680+0000","last_active":"2023-10-16T13:11:41.962502+0000","last_peered":"2023-10-16T13:11:41.962502+0000","last_clean":"2023-10-16T13:11:41.962502+0000","last_became_active":"2023-10-16T13:11:40.966332+0000","last_became_peered":"2023-10-16T13:11:40.966332+0000","last_unstale":"2023-10-16T13:11:41.962502+0000","last_undegraded":"2023-10-16T13:11:41.962502+0000","last_fullsized":"2023-10-16T13:11:41.962502+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:06:42.963312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":61,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:12:28.407270+0000","last_change":"2023-10-16T13:11:39.960180+0000","last_active":"2023-10-16T13:12:28.407270+0000","last_peered":"2023-10-16T13:12:28.407270+0000","last_clean":"2023-10-16T13:12:28.407270+0000","last_became_active":"2023-10-16T13:11:39.959816+0000","last_became_peered":"2023-10-16T13:11:39.959816+0000","last_unstale":"2023-10-16T13:12:28.407270+0000","last_undegraded":"2023-10-16T13:12:28.407270+0000","last_fullsized":"2023-10-16T13:12:28.407270+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:14:08.890449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961527+0000","last_change":"2023-10-16T13:11:40.975271+0000","last_active":"2023-10-16T13:11:41.961527+0000","last_peered":"2023-10-16T13:11:41.961527+0000","last_clean":"2023-10-16T13:11:41.961527+0000","last_became_active":"2023-10-16T13:11:40.974960+0000","last_became_peered":"2023-10-16T13:11:40.974960+0000","last_unstale":"2023-10-16T13:11:41.961527+0000","last_undegraded":"2023-10-16T13:11:41.961527+0000","last_fullsized":"2023-10-16T13:11:41.961527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:09.467960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:48.352169+0000","last_change":"2023-10-16T13:11:39.951187+0000","last_active":"2023-10-16T13:11:48.352169+0000","last_peered":"2023-10-16T13:11:48.352169+0000","last_clean":"2023-10-16T13:11:48.352169+0000","last_became_active":"2023-10-16T13:11:39.950843+0000","last_became_peered":"2023-10-16T13:11:39.950843+0000","last_unstale":"2023-10-16T13:11:48.352169+0000","last_undegraded":"2023-10-16T13:11:48.352169+0000","last_fullsized":"2023-10-16T13:11:48.352169+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:48.930247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":308,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-16T13:11:40.963466+0000","last_change":"2023-10-16T13:10:38.800469+0000","last_active":"2023-10-16T13:11:40.963466+0000","last_peered":"2023-10-16T13:11:40.963466+0000","last_clean":"2023-10-16T13:11:40.963466+0000","last_became_active":"2023-10-16T13:10:38.799911+0000","last_became_peered":"2023-10-16T13:10:38.799911+0000","last_unstale":"2023-10-16T13:11:40.963466+0000","last_undegraded":"2023-10-16T13:11:40.963466+0000","last_fullsized":"2023-10-16T13:11:40.963466+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:07:46.238647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:07:46.238647+0000","last_clean_scrub_stamp":"2023-10-16T13:07:46.238647+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:43:42.258738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228225+0000","last_change":"2023-10-16T13:11:40.974984+0000","last_active":"2023-10-16T13:11:43.228225+0000","last_peered":"2023-10-16T13:11:43.228225+0000","last_clean":"2023-10-16T13:11:43.228225+0000","last_became_active":"2023-10-16T13:11:40.974689+0000","last_became_peered":"2023-10-16T13:11:40.974689+0000","last_unstale":"2023-10-16T13:11:43.228225+0000","last_undegraded":"2023-10-16T13:11:43.228225+0000","last_fullsized":"2023-10-16T13:11:43.228225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:04.119797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:45.313312+0000","last_change":"2023-10-16T13:11:39.957999+0000","last_active":"2023-10-16T13:11:45.313312+0000","last_peered":"2023-10-16T13:11:45.313312+0000","last_clean":"2023-10-16T13:11:45.313312+0000","last_became_active":"2023-10-16T13:11:39.957043+0000","last_became_peered":"2023-10-16T13:11:39.957043+0000","last_unstale":"2023-10-16T13:11:45.313312+0000","last_undegraded":"2023-10-16T13:11:45.313312+0000","last_fullsized":"2023-10-16T13:11:45.313312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:12:27.150065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:46.335581+0000","last_change":"2023-10-16T13:11:39.953082+0000","last_active":"2023-10-16T13:11:46.335581+0000","last_peered":"2023-10-16T13:11:46.335581+0000","last_clean":"2023-10-16T13:11:46.335581+0000","last_became_active":"2023-10-16T13:11:39.952785+0000","last_became_peered":"2023-10-16T13:11:39.952785+0000","last_unstale":"2023-10-16T13:11:46.335581+0000","last_undegraded":"2023-10-16T13:11:46.335581+0000","last_fullsized":"2023-10-16T13:11:46.335581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:06:34.427841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228109+0000","last_change":"2023-10-16T13:11:40.968761+0000","last_active":"2023-10-16T13:11:43.228109+0000","last_peered":"2023-10-16T13:11:43.228109+0000","last_clean":"2023-10-16T13:11:43.228109+0000","last_became_active":"2023-10-16T13:11:40.968466+0000","last_became_peered":"2023-10-16T13:11:40.968466+0000","last_unstale":"2023-10-16T13:11:43.228109+0000","last_undegraded":"2023-10-16T13:11:43.228109+0000","last_fullsized":"2023-10-16T13:11:43.228109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:22:15.577411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'10","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:53.477141+0000","last_change":"2023-10-16T13:11:39.957019+0000","last_active":"2023-10-16T13:11:53.477141+0000","last_peered":"2023-10-16T13:11:53.477141+0000","last_clean":"2023-10-16T13:11:53.477141+0000","last_became_active":"2023-10-16T13:11:39.956687+0000","last_became_peered":"2023-10-16T13:11:39.956687+0000","last_unstale":"2023-10-16T13:11:53.477141+0000","last_undegraded":"2023-10-16T13:11:53.477141+0000","last_fullsized":"2023-10-16T13:11:53.477141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:17.049740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961461+0000","last_change":"2023-10-16T13:11:40.973938+0000","last_active":"2023-10-16T13:11:41.961461+0000","last_peered":"2023-10-16T13:11:41.961461+0000","last_clean":"2023-10-16T13:11:41.961461+0000","last_became_active":"2023-10-16T13:11:40.973579+0000","last_became_peered":"2023-10-16T13:11:40.973579+0000","last_unstale":"2023-10-16T13:11:41.961461+0000","last_undegraded":"2023-10-16T13:11:41.961461+0000","last_fullsized":"2023-10-16T13:11:41.961461+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:49:29.153231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.351827+0000","last_change":"2023-10-16T13:11:39.954368+0000","last_active":"2023-10-16T13:11:47.351827+0000","last_peered":"2023-10-16T13:11:47.351827+0000","last_clean":"2023-10-16T13:11:47.351827+0000","last_became_active":"2023-10-16T13:11:39.953967+0000","last_became_peered":"2023-10-16T13:11:39.953967+0000","last_unstale":"2023-10-16T13:11:47.351827+0000","last_undegraded":"2023-10-16T13:11:47.351827+0000","last_fullsized":"2023-10-16T13:11:47.351827+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:43:49.278655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717616+0000","last_change":"2023-10-16T13:11:40.975917+0000","last_active":"2023-10-16T13:11:42.717616+0000","last_peered":"2023-10-16T13:11:42.717616+0000","last_clean":"2023-10-16T13:11:42.717616+0000","last_became_active":"2023-10-16T13:11:40.975610+0000","last_became_peered":"2023-10-16T13:11:40.975610+0000","last_unstale":"2023-10-16T13:11:42.717616+0000","last_undegraded":"2023-10-16T13:11:42.717616+0000","last_fullsized":"2023-10-16T13:11:42.717616+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:41.006584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:44.324104+0000","last_change":"2023-10-16T13:11:39.960169+0000","last_active":"2023-10-16T13:11:44.324104+0000","last_peered":"2023-10-16T13:11:44.324104+0000","last_clean":"2023-10-16T13:11:44.324104+0000","last_became_active":"2023-10-16T13:11:39.959385+0000","last_became_peered":"2023-10-16T13:11:39.959385+0000","last_unstale":"2023-10-16T13:11:44.324104+0000","last_undegraded":"2023-10-16T13:11:44.324104+0000","last_fullsized":"2023-10-16T13:11:44.324104+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:50:12.442686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228128+0000","last_change":"2023-10-16T13:11:40.971165+0000","last_active":"2023-10-16T13:11:43.228128+0000","last_peered":"2023-10-16T13:11:43.228128+0000","last_clean":"2023-10-16T13:11:43.228128+0000","last_became_active":"2023-10-16T13:11:40.970341+0000","last_became_peered":"2023-10-16T13:11:40.970341+0000","last_unstale":"2023-10-16T13:11:43.228128+0000","last_undegraded":"2023-10-16T13:11:43.228128+0000","last_fullsized":"2023-10-16T13:11:43.228128+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:39:48.393642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.350655+0000","last_change":"2023-10-16T13:11:39.953044+0000","last_active":"2023-10-16T13:11:47.350655+0000","last_peered":"2023-10-16T13:11:47.350655+0000","last_clean":"2023-10-16T13:11:47.350655+0000","last_became_active":"2023-10-16T13:11:39.952752+0000","last_became_peered":"2023-10-16T13:11:39.952752+0000","last_unstale":"2023-10-16T13:11:47.350655+0000","last_undegraded":"2023-10-16T13:11:47.350655+0000","last_fullsized":"2023-10-16T13:11:47.350655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:33:12.277430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228221+0000","last_change":"2023-10-16T13:11:40.974739+0000","last_active":"2023-10-16T13:11:43.228221+0000","last_peered":"2023-10-16T13:11:43.228221+0000","last_clean":"2023-10-16T13:11:43.228221+0000","last_became_active":"2023-10-16T13:11:40.974387+0000","last_became_peered":"2023-10-16T13:11:40.974387+0000","last_unstale":"2023-10-16T13:11:43.228221+0000","last_undegraded":"2023-10-16T13:11:43.228221+0000","last_fullsized":"2023-10-16T13:11:43.228221+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:28:16.384359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:46.452788+0000","last_change":"2023-10-16T13:11:39.960427+0000","last_active":"2023-10-16T13:11:46.452788+0000","last_peered":"2023-10-16T13:11:46.452788+0000","last_clean":"2023-10-16T13:11:46.452788+0000","last_became_active":"2023-10-16T13:11:39.959928+0000","last_became_peered":"2023-10-16T13:11:39.959928+0000","last_unstale":"2023-10-16T13:11:46.452788+0000","last_undegraded":"2023-10-16T13:11:46.452788+0000","last_fullsized":"2023-10-16T13:11:46.452788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:38:37.073782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961407+0000","last_change":"2023-10-16T13:11:40.971153+0000","last_active":"2023-10-16T13:11:41.961407+0000","last_peered":"2023-10-16T13:11:41.961407+0000","last_clean":"2023-10-16T13:11:41.961407+0000","last_became_active":"2023-10-16T13:11:40.970772+0000","last_became_peered":"2023-10-16T13:11:40.970772+0000","last_unstale":"2023-10-16T13:11:41.961407+0000","last_undegraded":"2023-10-16T13:11:41.961407+0000","last_fullsized":"2023-10-16T13:11:41.961407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:34.450600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:44.324888+0000","last_change":"2023-10-16T13:11:39.957589+0000","last_active":"2023-10-16T13:11:44.324888+0000","last_peered":"2023-10-16T13:11:44.324888+0000","last_clean":"2023-10-16T13:11:44.324888+0000","last_became_active":"2023-10-16T13:11:39.957334+0000","last_became_peered":"2023-10-16T13:11:39.957334+0000","last_unstale":"2023-10-16T13:11:44.324888+0000","last_undegraded":"2023-10-16T13:11:44.324888+0000","last_fullsized":"2023-10-16T13:11:44.324888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:42:58.126279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972160+0000","last_change":"2023-10-16T13:11:40.979906+0000","last_active":"2023-10-16T13:11:42.972160+0000","last_peered":"2023-10-16T13:11:42.972160+0000","last_clean":"2023-10-16T13:11:42.972160+0000","last_became_active":"2023-10-16T13:11:40.979506+0000","last_became_peered":"2023-10-16T13:11:40.979506+0000","last_unstale":"2023-10-16T13:11:42.972160+0000","last_undegraded":"2023-10-16T13:11:42.972160+0000","last_fullsized":"2023-10-16T13:11:42.972160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:06:33.566642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":61,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:12:27.407677+0000","last_change":"2023-10-16T13:11:39.961062+0000","last_active":"2023-10-16T13:12:27.407677+0000","last_peered":"2023-10-16T13:12:27.407677+0000","last_clean":"2023-10-16T13:12:27.407677+0000","last_became_active":"2023-10-16T13:11:39.960615+0000","last_became_peered":"2023-10-16T13:11:39.960615+0000","last_unstale":"2023-10-16T13:12:27.407677+0000","last_undegraded":"2023-10-16T13:12:27.407677+0000","last_fullsized":"2023-10-16T13:12:27.407677+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:59:52.598863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972447+0000","last_change":"2023-10-16T13:11:40.979874+0000","last_active":"2023-10-16T13:11:42.972447+0000","last_peered":"2023-10-16T13:11:42.972447+0000","last_clean":"2023-10-16T13:11:42.972447+0000","last_became_active":"2023-10-16T13:11:40.979444+0000","last_became_peered":"2023-10-16T13:11:40.979444+0000","last_unstale":"2023-10-16T13:11:42.972447+0000","last_undegraded":"2023-10-16T13:11:42.972447+0000","last_fullsized":"2023-10-16T13:11:42.972447+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:27:38.533986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:46.335169+0000","last_change":"2023-10-16T13:11:39.962428+0000","last_active":"2023-10-16T13:11:46.335169+0000","last_peered":"2023-10-16T13:11:46.335169+0000","last_clean":"2023-10-16T13:11:46.335169+0000","last_became_active":"2023-10-16T13:11:39.962028+0000","last_became_peered":"2023-10-16T13:11:39.962028+0000","last_unstale":"2023-10-16T13:11:46.335169+0000","last_undegraded":"2023-10-16T13:11:46.335169+0000","last_fullsized":"2023-10-16T13:11:46.335169+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:43:25.415571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972287+0000","last_change":"2023-10-16T13:11:40.969804+0000","last_active":"2023-10-16T13:11:42.972287+0000","last_peered":"2023-10-16T13:11:42.972287+0000","last_clean":"2023-10-16T13:11:42.972287+0000","last_became_active":"2023-10-16T13:11:40.969339+0000","last_became_peered":"2023-10-16T13:11:40.969339+0000","last_unstale":"2023-10-16T13:11:42.972287+0000","last_undegraded":"2023-10-16T13:11:42.972287+0000","last_fullsized":"2023-10-16T13:11:42.972287+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:14:15.533029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:47.352788+0000","last_change":"2023-10-16T13:11:39.960173+0000","last_active":"2023-10-16T13:11:47.352788+0000","last_peered":"2023-10-16T13:11:47.352788+0000","last_clean":"2023-10-16T13:11:47.352788+0000","last_became_active":"2023-10-16T13:11:39.959839+0000","last_became_peered":"2023-10-16T13:11:39.959839+0000","last_unstale":"2023-10-16T13:11:47.352788+0000","last_undegraded":"2023-10-16T13:11:47.352788+0000","last_fullsized":"2023-10-16T13:11:47.352788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:31:16.379341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.972451+0000","last_change":"2023-10-16T13:11:40.974349+0000","last_active":"2023-10-16T13:11:42.972451+0000","last_peered":"2023-10-16T13:11:42.972451+0000","last_clean":"2023-10-16T13:11:42.972451+0000","last_became_active":"2023-10-16T13:11:40.973189+0000","last_became_peered":"2023-10-16T13:11:40.973189+0000","last_unstale":"2023-10-16T13:11:42.972451+0000","last_undegraded":"2023-10-16T13:11:42.972451+0000","last_fullsized":"2023-10-16T13:11:42.972451+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:45:05.177277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228644+0000","last_change":"2023-10-16T13:11:40.972862+0000","last_active":"2023-10-16T13:11:43.228644+0000","last_peered":"2023-10-16T13:11:43.228644+0000","last_clean":"2023-10-16T13:11:43.228644+0000","last_became_active":"2023-10-16T13:11:40.972558+0000","last_became_peered":"2023-10-16T13:11:40.972558+0000","last_unstale":"2023-10-16T13:11:43.228644+0000","last_undegraded":"2023-10-16T13:11:43.228644+0000","last_fullsized":"2023-10-16T13:11:43.228644+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:09:36.149610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.985989+0000","last_change":"2023-10-16T13:11:40.973449+0000","last_active":"2023-10-16T13:11:42.985989+0000","last_peered":"2023-10-16T13:11:42.985989+0000","last_clean":"2023-10-16T13:11:42.985989+0000","last_became_active":"2023-10-16T13:11:40.973044+0000","last_became_peered":"2023-10-16T13:11:40.973044+0000","last_unstale":"2023-10-16T13:11:42.985989+0000","last_undegraded":"2023-10-16T13:11:42.985989+0000","last_fullsized":"2023-10-16T13:11:42.985989+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:22.883943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.986056+0000","last_change":"2023-10-16T13:11:40.970871+0000","last_active":"2023-10-16T13:11:42.986056+0000","last_peered":"2023-10-16T13:11:42.986056+0000","last_clean":"2023-10-16T13:11:42.986056+0000","last_became_active":"2023-10-16T13:11:40.970554+0000","last_became_peered":"2023-10-16T13:11:40.970554+0000","last_unstale":"2023-10-16T13:11:42.986056+0000","last_undegraded":"2023-10-16T13:11:42.986056+0000","last_fullsized":"2023-10-16T13:11:42.986056+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:46:34.449007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.717476+0000","last_change":"2023-10-16T13:11:40.975827+0000","last_active":"2023-10-16T13:11:42.717476+0000","last_peered":"2023-10-16T13:11:42.717476+0000","last_clean":"2023-10-16T13:11:42.717476+0000","last_became_active":"2023-10-16T13:11:40.975514+0000","last_became_peered":"2023-10-16T13:11:40.975514+0000","last_unstale":"2023-10-16T13:11:42.717476+0000","last_undegraded":"2023-10-16T13:11:42.717476+0000","last_fullsized":"2023-10-16T13:11:42.717476+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:34:47.901390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228201+0000","last_change":"2023-10-16T13:11:40.975088+0000","last_active":"2023-10-16T13:11:43.228201+0000","last_peered":"2023-10-16T13:11:43.228201+0000","last_clean":"2023-10-16T13:11:43.228201+0000","last_became_active":"2023-10-16T13:11:40.974286+0000","last_became_peered":"2023-10-16T13:11:40.974286+0000","last_unstale":"2023-10-16T13:11:43.228201+0000","last_undegraded":"2023-10-16T13:11:43.228201+0000","last_fullsized":"2023-10-16T13:11:43.228201+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:15:50.270651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228527+0000","last_change":"2023-10-16T13:11:40.973111+0000","last_active":"2023-10-16T13:11:43.228527+0000","last_peered":"2023-10-16T13:11:43.228527+0000","last_clean":"2023-10-16T13:11:43.228527+0000","last_became_active":"2023-10-16T13:11:40.972826+0000","last_became_peered":"2023-10-16T13:11:40.972826+0000","last_unstale":"2023-10-16T13:11:43.228527+0000","last_undegraded":"2023-10-16T13:11:43.228527+0000","last_fullsized":"2023-10-16T13:11:43.228527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:43.523165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:42.986501+0000","last_change":"2023-10-16T13:11:40.980303+0000","last_active":"2023-10-16T13:11:42.986501+0000","last_peered":"2023-10-16T13:11:42.986501+0000","last_clean":"2023-10-16T13:11:42.986501+0000","last_became_active":"2023-10-16T13:11:40.979987+0000","last_became_peered":"2023-10-16T13:11:40.979987+0000","last_unstale":"2023-10-16T13:11:42.986501+0000","last_undegraded":"2023-10-16T13:11:42.986501+0000","last_fullsized":"2023-10-16T13:11:42.986501+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:38:16.402231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961388+0000","last_change":"2023-10-16T13:11:40.966547+0000","last_active":"2023-10-16T13:11:41.961388+0000","last_peered":"2023-10-16T13:11:41.961388+0000","last_clean":"2023-10-16T13:11:41.961388+0000","last_became_active":"2023-10-16T13:11:40.966149+0000","last_became_peered":"2023-10-16T13:11:40.966149+0000","last_unstale":"2023-10-16T13:11:41.961388+0000","last_undegraded":"2023-10-16T13:11:41.961388+0000","last_fullsized":"2023-10-16T13:11:41.961388+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:27:47.007356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.962374+0000","last_change":"2023-10-16T13:11:40.968511+0000","last_active":"2023-10-16T13:11:41.962374+0000","last_peered":"2023-10-16T13:11:41.962374+0000","last_clean":"2023-10-16T13:11:41.962374+0000","last_became_active":"2023-10-16T13:11:40.968185+0000","last_became_peered":"2023-10-16T13:11:40.968185+0000","last_unstale":"2023-10-16T13:11:41.962374+0000","last_undegraded":"2023-10-16T13:11:41.962374+0000","last_fullsized":"2023-10-16T13:11:41.962374+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:31:43.779875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961188+0000","last_change":"2023-10-16T13:11:40.974616+0000","last_active":"2023-10-16T13:11:41.961188+0000","last_peered":"2023-10-16T13:11:41.961188+0000","last_clean":"2023-10-16T13:11:41.961188+0000","last_became_active":"2023-10-16T13:11:40.974295+0000","last_became_peered":"2023-10-16T13:11:40.974295+0000","last_unstale":"2023-10-16T13:11:41.961188+0000","last_undegraded":"2023-10-16T13:11:41.961188+0000","last_fullsized":"2023-10-16T13:11:41.961188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:47.838853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:41.961878+0000","last_change":"2023-10-16T13:11:40.974927+0000","last_active":"2023-10-16T13:11:41.961878+0000","last_peered":"2023-10-16T13:11:41.961878+0000","last_clean":"2023-10-16T13:11:41.961878+0000","last_became_active":"2023-10-16T13:11:40.974332+0000","last_became_peered":"2023-10-16T13:11:40.974332+0000","last_unstale":"2023-10-16T13:11:41.961878+0000","last_undegraded":"2023-10-16T13:11:41.961878+0000","last_fullsized":"2023-10-16T13:11:41.961878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:07:24.974440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228631+0000","last_change":"2023-10-16T13:11:40.972793+0000","last_active":"2023-10-16T13:11:43.228631+0000","last_peered":"2023-10-16T13:11:43.228631+0000","last_clean":"2023-10-16T13:11:43.228631+0000","last_became_active":"2023-10-16T13:11:40.972008+0000","last_became_peered":"2023-10-16T13:11:40.972008+0000","last_unstale":"2023-10-16T13:11:43.228631+0000","last_undegraded":"2023-10-16T13:11:43.228631+0000","last_fullsized":"2023-10-16T13:11:43.228631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:53.487238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-16T13:11:43.228280+0000","last_change":"2023-10-16T13:11:40.977282+0000","last_active":"2023-10-16T13:11:43.228280+0000","last_peered":"2023-10-16T13:11:43.228280+0000","last_clean":"2023-10-16T13:11:43.228280+0000","last_became_active":"2023-10-16T13:11:40.976872+0000","last_became_peered":"2023-10-16T13:11:40.976872+0000","last_unstale":"2023-10-16T13:11:43.228280+0000","last_undegraded":"2023-10-16T13:11:43.228280+0000","last_fullsized":"2023-10-16T13:11:43.228280+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:43:48.735584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64748,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":478,"num_read_kb":310,"num_write":235,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":194244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449110,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":426192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.70299999999999996}]},{"osd":1,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.64900000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.438}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":4,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.751}]},{"osd":5,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59299999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.80400000000000005}]},{"osd":7,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.86499999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":9,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.73399999999999999}]},{"osd":10,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.88400000000000001}]}]},{"osd":10,"up_from":71,"seq":304942678042,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28576,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716576,"statfs":{"total":95995035648,"available":95965773824,"internally_reserved":0,"allocated":1597440,"data_stored":1075163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.42899999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.54300000000000004}]},{"osd":3,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.55700000000000005}]},{"osd":4,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.76600000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.629},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.73999999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.504}]},{"osd":8,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.874}]},{"osd":9,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.83999999999999997}]},{"osd":11,"last update":"Mon Oct 16 13:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.85299999999999998}]}]},{"osd":9,"up_from":66,"seq":283467841567,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":426122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.39000000000000001,"15min":0.39500000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.318}]},{"osd":1,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.58199999999999996,"15min":0.59199999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.85299999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79600000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.45500000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.38800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76000000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.755,"5min":0.88,"15min":0.88},"last":0.59499999999999997}]},{"osd":3,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.50800000000000001,"15min":0.51600000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.5,"15min":0.50600000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.70799999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.34100000000000003}]},{"osd":4,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.625,"15min":0.63700000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.879,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63200000000000001,"15min":0.63800000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91100000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.505}]},{"osd":5,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79800000000000004,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84299999999999997,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.51500000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83299999999999996,"5min":1.109,"15min":1.109},"last":0.435},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80900000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.48999999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70299999999999996,"15min":0.71299999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86099999999999999,"5min":0.996,"15min":0.996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92800000000000005,"5min":1.222,"15min":1.222},"last":0.55800000000000005}]},{"osd":8,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72499999999999998,"15min":0.73499999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84799999999999998,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.628},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.746,"15min":0.755},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86499999999999999,"5min":1.153,"15min":1.153},"last":0.57399999999999995}]},{"osd":10,"last update":"Mon Oct 16 13:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.58399999999999996}]}]},{"osd":8,"up_from":59,"seq":253403070499,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":426500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.38200000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53700000000000003,"15min":0.53600000000000003},"min":{"1min":0.40899999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.40500000000000003}]},{"osd":1,"last update":"Mon Oct 16 13:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.623}]},{"osd":2,"last update":"Mon Oct 16 13:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.45100000000000001,"15min":0.44700000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65900000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.48299999999999998,"15min":0.47599999999999998},"min":{"1min":0.315,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.749,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55400000000000005}]},{"osd":3,"last update":"Mon Oct 16 13:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.58399999999999996,"15min":0.57599999999999996},"min":{"1min":0.42599999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57499999999999996}]},{"osd":4,"last update":"Mon Oct 16 13:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.627,"15min":0.63},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91500000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63900000000000001,"15min":0.63400000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.72599999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.58299999999999996,"15min":0.57099999999999995},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.998,"5min":1.042,"15min":1.042},"last":0.60199999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.69699999999999995,"15min":0.66300000000000003},"min":{"1min":0.48899999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":3.6659999999999999,"5min":3.6659999999999999,"15min":3.6659999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.70999999999999996,"15min":0.70499999999999996},"min":{"1min":0.5,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0309999999999999,"5min":1.073,"15min":1.073},"last":0.71199999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71999999999999997,"15min":0.71099999999999997},"min":{"1min":0.55200000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0189999999999999,"5min":1.036,"15min":1.036},"last":0.755},{"interface":"front","average":{"1min":0.749,"5min":0.71799999999999997,"15min":0.71299999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0629999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.83799999999999997}]},{"osd":9,"last update":"Mon Oct 16 13:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.74199999999999999,"15min":0.71699999999999997},"min":{"1min":0.61099999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.415,"5min":2.415,"15min":2.415},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.71599999999999997,"15min":0.69999999999999996},"min":{"1min":0.54600000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.79200000000000004}]},{"osd":10,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.694,"5min":3.694,"15min":3.694},"last":0.82399999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":7,"up_from":51,"seq":219043332135,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1519616,"data_stored":1019413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.38},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.34699999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41199999999999998,"15min":0.40799999999999997},"min":{"1min":0.29999999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.60199999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.40999999999999998,"15min":0.40600000000000003},"min":{"1min":0.29899999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.58499999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.57499999999999996}]},{"osd":2,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.42899999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.40500000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.71799999999999997}]},{"osd":3,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.442,"5min":0.37,"15min":0.37},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.754,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.53000000000000003}]},{"osd":4,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.49299999999999999,"15min":0.48599999999999999},"min":{"1min":0.35699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46800000000000003,"15min":0.46100000000000002},"min":{"1min":0.36499999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.69099999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.45000000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.66300000000000003,"15min":0.65400000000000003},"min":{"1min":0.56899999999999995,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.86499999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65900000000000003,"15min":0.65500000000000003},"min":{"1min":0.436,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.626},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.54100000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.81699999999999995}]},{"osd":8,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69499999999999995,"15min":0.68500000000000005},"min":{"1min":0.50800000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.65800000000000003,"15min":0.64900000000000002},"min":{"1min":0.48099999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.73399999999999999}]},{"osd":9,"last update":"Mon Oct 16 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.72599999999999998,"15min":0.71999999999999997},"min":{"1min":0.623,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.56899999999999995,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.79500000000000004}]},{"osd":10,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.874},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.88500000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]}]},{"osd":6,"up_from":46,"seq":197568495660,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":425845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.376,"15min":0.374},"min":{"1min":0.255,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":0.621,"15min":0.621},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.39400000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54300000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.34599999999999997}]},{"osd":1,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.36599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73199999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":1,"15min":1},"last":0.47199999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.45100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70799999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60799999999999998,"15min":0.60899999999999999},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.76200000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54800000000000004}]},{"osd":3,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.441,"15min":0.443},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.629,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65000000000000002,"5min":0.748,"15min":0.748},"last":0.41699999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.629,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84799999999999998,"5min":1.014,"15min":1.014},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76300000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.45800000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77500000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77200000000000002,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.68400000000000005,"15min":0.67500000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.45500000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.5}]},{"osd":8,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.67800000000000005},"min":{"1min":0.46899999999999997,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.48599999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.84799999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.68100000000000005}]},{"osd":9,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.61299999999999999,"15min":0.63100000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.71099999999999997,"15min":0.73499999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82599999999999996,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.58799999999999997}]},{"osd":10,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":484298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.502,"15min":0.46200000000000002},"min":{"1min":0.32700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53500000000000003,"15min":0.48199999999999998},"min":{"1min":0.35099999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.78700000000000003,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.67000000000000004}]},{"osd":2,"last update":"Mon Oct 16 13:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.53000000000000003,"15min":0.51400000000000001},"min":{"1min":0.36599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":1.024},{"interface":"front","average":{"1min":0.62,"5min":0.53900000000000003,"15min":0.52100000000000002},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85699999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.98599999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.50800000000000001},"min":{"1min":0.38200000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83999999999999997,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.754},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56899999999999995,"15min":0.52100000000000002},"min":{"1min":0.39700000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85199999999999998,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.69899999999999995}]},{"osd":4,"last update":"Mon Oct 16 13:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.40400000000000003,"15min":0.39500000000000002},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.434,"15min":0.42599999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.81999999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.62,"15min":0.59599999999999997},"min":{"1min":0.502,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89700000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":1.0409999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63300000000000001,"15min":0.64100000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84899999999999998,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.63100000000000001},"min":{"1min":0.45900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.876,"5min":1.429,"15min":1.429},"last":0.91100000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.94499999999999995}]},{"osd":8,"last update":"Mon Oct 16 13:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68799999999999994,"15min":0.68200000000000005},"min":{"1min":0.53400000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":1.054}]},{"osd":9,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.71699999999999997,"15min":0.70799999999999996},"min":{"1min":0.55100000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.98999999999999999,"5min":1.022,"15min":1.022},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.71999999999999997,"15min":0.71499999999999997},"min":{"1min":0.53500000000000003,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91600000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":1.006}]},{"osd":10,"last update":"Mon Oct 16 13:11:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":1.103},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":1.171}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":427178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53500000000000003,"15min":0.50900000000000001},"min":{"1min":0.40799999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69499999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54200000000000004,"15min":0.50600000000000001},"min":{"1min":0.41899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.77400000000000002,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.50600000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55900000000000005,"15min":0.53600000000000003},"min":{"1min":0.44600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.873,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54700000000000004,"15min":0.52800000000000002},"min":{"1min":0.40600000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.85999999999999999,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.52700000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41999999999999998,"15min":0.42199999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.55800000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.307}]},{"osd":4,"last update":"Mon Oct 16 13:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.53800000000000003,"15min":0.50600000000000001},"min":{"1min":0.36199999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.57099999999999995,"15min":0.55000000000000004},"min":{"1min":0.39200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.68799999999999994}]},{"osd":5,"last update":"Mon Oct 16 13:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.44400000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59399999999999997,"15min":0.59999999999999998},"min":{"1min":0.42199999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82299999999999995,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.59199999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:12:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.48099999999999998,"15min":0.48899999999999999},"min":{"1min":0.317,"5min":0.315,"15min":0.315},"max":{"1min":0.59499999999999997,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48599999999999999,"15min":0.47499999999999998},"min":{"1min":0.36399999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67300000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.33700000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.42099999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0169999999999999,"5min":1.51,"15min":1.51},"last":0.61199999999999999}]},{"osd":8,"last update":"Mon Oct 16 13:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.69999999999999996,"15min":0.71399999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.79700000000000004,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.68100000000000005,"15min":0.69199999999999995},"min":{"1min":0.45600000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80200000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.64300000000000002}]},{"osd":9,"last update":"Mon Oct 16 13:12:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.40600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.67000000000000004,"15min":0.68400000000000005},"min":{"1min":0.375,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.91700000000000004,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.48499999999999999}]},{"osd":10,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.56599999999999995}]},{"osd":11,"last update":"Mon Oct 16 13:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.65500000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":484908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47999999999999998,"15min":0.47799999999999998},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67400000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.38100000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.68799999999999994}]},{"osd":1,"last update":"Mon Oct 16 13:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.54700000000000004,"15min":0.5},"min":{"1min":0.51300000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.54600000000000004,"15min":0.504},"min":{"1min":0.41299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.72599999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.436,"5min":0.318,"15min":0.318},"max":{"1min":0.71899999999999997,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.44600000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72899999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.60299999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58199999999999996,"15min":0.57099999999999995},"min":{"1min":0.39700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.80400000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.56000000000000005,"15min":0.53100000000000003},"min":{"1min":0.52400000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85499999999999998,"5min":0.879,"15min":0.879},"last":0.70999999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:11:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.33200000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.49399999999999999,"15min":0.46999999999999997},"min":{"1min":0.33800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.53200000000000003}]},{"osd":6,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63600000000000001,"15min":0.629},"min":{"1min":0.45800000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.63300000000000001,"15min":0.62},"min":{"1min":0.50900000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56799999999999995}]},{"osd":7,"last update":"Mon Oct 16 13:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.49099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.58599999999999997}]},{"osd":8,"last update":"Mon Oct 16 13:11:58 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66100000000000003,"15min":0.65500000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.623}]},{"osd":9,"last update":"Mon Oct 16 13:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.55200000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93899999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70299999999999996,"15min":0.69299999999999995},"min":{"1min":0.57199999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.64700000000000002}]},{"osd":10,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.752},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.78100000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":425395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.33300000000000002},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.36899999999999999,"15min":0.34499999999999997},"min":{"1min":0.25600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.35399999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.50700000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53700000000000003,"15min":0.5},"min":{"1min":0.38100000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.52800000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.53300000000000003},"min":{"1min":0.41099999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.5},{"interface":"front","average":{"1min":0.622,"5min":0.57499999999999996,"15min":0.54200000000000004},"min":{"1min":0.48599999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.57099999999999995}]},{"osd":4,"last update":"Mon Oct 16 13:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58799999999999997,"15min":0.54100000000000004},"min":{"1min":0.38600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.76700000000000002,"5min":6.032,"15min":6.032},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.47999999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60899999999999999,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44800000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.59399999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.501,"15min":0.5},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89200000000000002,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.62}]},{"osd":7,"last update":"Mon Oct 16 13:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65900000000000003,"15min":0.64800000000000002},"min":{"1min":0.40500000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.63500000000000001,"15min":0.625},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.65900000000000003}]},{"osd":8,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.55500000000000005}]},{"osd":9,"last update":"Mon Oct 16 13:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.65800000000000003,"15min":0.66700000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.85699999999999998,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.443}]},{"osd":10,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.69199999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":4,"up_from":33,"seq":141733920820,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":426090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.497,"15min":0.48799999999999999},"min":{"1min":0.377,"5min":0.318,"15min":0.318},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.51100000000000001,"15min":0.495},"min":{"1min":0.41899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.41899999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.36599999999999999},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.41399999999999998,"15min":0.39600000000000002},"min":{"1min":0.27900000000000003,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.38700000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77700000000000002,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.57399999999999995,"15min":0.54900000000000004},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.53500000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.56000000000000005,"15min":0.54000000000000004},"min":{"1min":0.44900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78300000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.374,"5min":0.312,"15min":0.312},"max":{"1min":0.83499999999999996,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.76000000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.626,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.81399999999999995,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.61399999999999999,"15min":0.58799999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.621}]},{"osd":6,"last update":"Mon Oct 16 13:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60999999999999999,"15min":0.59599999999999997},"min":{"1min":0.42999999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77500000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.44500000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77400000000000002,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.78800000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.55000000000000004,"15min":0.52900000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.50600000000000001}]},{"osd":8,"last update":"Mon Oct 16 13:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85699999999999998,"5min":0.999,"15min":0.999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.68700000000000006}]},{"osd":9,"last update":"Mon Oct 16 13:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.75,"15min":0.754},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.84699999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.753,"15min":0.76300000000000001},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88,"5min":1.595,"15min":1.595},"last":0.74399999999999999}]},{"osd":10,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.64000000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":5,"up_from":38,"seq":163208757296,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1527808,"data_stored":1018370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66300000000000003,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76700000000000002,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:11:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.54500000000000004,"15min":0.51900000000000002},"min":{"1min":0.35899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52600000000000002,"15min":0.50800000000000001},"min":{"1min":0.42099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77700000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.57899999999999996}]},{"osd":2,"last update":"Mon Oct 16 13:11:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.40400000000000003},"min":{"1min":0.29599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.505},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.434,"15min":0.41299999999999998},"min":{"1min":0.30299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48499999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:11:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.38900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71699999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.59199999999999997}]},{"osd":4,"last update":"Mon Oct 16 13:11:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59399999999999997,"15min":0.57799999999999996},"min":{"1min":0.42099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.78600000000000003,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.58199999999999996,"15min":0.56000000000000005},"min":{"1min":0.38600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81899999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.67900000000000005}]},{"osd":6,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.626,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83099999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.627,"15min":0.621},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.39100000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.876,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64900000000000002,"15min":0.65000000000000002},"min":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.85199999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.61899999999999999}]},{"osd":8,"last update":"Mon Oct 16 13:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.91900000000000004,"5min":1.016,"15min":1.016},"last":0.71099999999999997}]},{"osd":9,"last update":"Mon Oct 16 13:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.71099999999999997,"15min":0.70299999999999996},"min":{"1min":0.55900000000000005,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68999999999999995,"15min":0.68200000000000005},"min":{"1min":0.56699999999999995,"5min":0.435,"15min":0.435},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64100000000000001}]},{"osd":10,"last update":"Mon Oct 16 13:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":4.4859999999999998,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":59298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:12:35.262 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-10-16T13:12:35.262 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-16T13:12:35.263 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-10-16T13:12:35.263 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph health --format=json 2023-10-16T13:12:35.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-10-16T13:12:35.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2023-10-16T13:12:35.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2023-10-16T13:12:35.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2023-10-16T13:12:35.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2023-10-16T13:12:35.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2023-10-16T13:12:35.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2023-10-16T13:12:35.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2023-10-16T13:12:35.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:35 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2023-10-16T13:12:35.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-10-16T13:12:35.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2023-10-16T13:12:35.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2023-10-16T13:12:35.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2023-10-16T13:12:35.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2023-10-16T13:12:35.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2023-10-16T13:12:35.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2023-10-16T13:12:35.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2023-10-16T13:12:35.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:35 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2023-10-16T13:12:35.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-10-16T13:12:35.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2023-10-16T13:12:35.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2023-10-16T13:12:35.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2023-10-16T13:12:35.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2023-10-16T13:12:35.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2023-10-16T13:12:35.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2023-10-16T13:12:35.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2023-10-16T13:12:35.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:35 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2023-10-16T13:12:35.827 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:36.348 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:36 smithi092 ceph-mon[99542]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:12:36.348 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:36 smithi092 ceph-mon[99542]: pgmap v283: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-16T13:12:36.349 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-10-16T13:12:36.349 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2023-10-16T13:12:36.349 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2023-10-16T13:12:36.349 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2023-10-16T13:12:36.350 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2023-10-16T13:12:36.350 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2023-10-16T13:12:36.350 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2023-10-16T13:12:36.350 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2023-10-16T13:12:36.350 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:36 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2023-10-16T13:12:36.351 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:36 smithi092 ceph-mon[99542]: osdmap e84: 12 total, 12 up, 12 in 2023-10-16T13:12:36.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:36 smithi152 ceph-mon[104423]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:12:36.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:36 smithi152 ceph-mon[104423]: pgmap v283: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-16T13:12:36.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-10-16T13:12:36.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2023-10-16T13:12:36.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2023-10-16T13:12:36.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2023-10-16T13:12:36.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2023-10-16T13:12:36.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2023-10-16T13:12:36.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2023-10-16T13:12:36.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2023-10-16T13:12:36.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:36 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2023-10-16T13:12:36.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:36 smithi152 ceph-mon[104423]: osdmap e84: 12 total, 12 up, 12 in 2023-10-16T13:12:36.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:36 smithi118 ceph-mon[103969]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:12:36.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:36 smithi118 ceph-mon[103969]: pgmap v283: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-16T13:12:36.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-10-16T13:12:36.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2023-10-16T13:12:36.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2023-10-16T13:12:36.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2023-10-16T13:12:36.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2023-10-16T13:12:36.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2023-10-16T13:12:36.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2023-10-16T13:12:36.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2023-10-16T13:12:36.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:36 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2023-10-16T13:12:36.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:36 smithi118 ceph-mon[103969]: osdmap e84: 12 total, 12 up, 12 in 2023-10-16T13:12:37.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.162+0000 7f6652314700 1 -- 172.21.15.92:0/3475191484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f664c105ec0 msgr2=0x7f664c1062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:37.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.162+0000 7f6652314700 1 --2- 172.21.15.92:0/3475191484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f664c105ec0 0x7f664c1062a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f663c009990 tx=0x7f663c009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:37.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.162+0000 7f6652314700 1 -- 172.21.15.92:0/3475191484 shutdown_connections 2023-10-16T13:12:37.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.162+0000 7f6652314700 1 --2- 172.21.15.92:0/3475191484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f664c105ec0 0x7f664c1062a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:37.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.162+0000 7f6652314700 1 --2- 172.21.15.92:0/3475191484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f664c1007d0 0x7f664c10cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:37.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.162+0000 7f6652314700 1 --2- 172.21.15.92:0/3475191484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f664c0ffe10 0x7f664c100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:37.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.162+0000 7f6652314700 1 -- 172.21.15.92:0/3475191484 >> 172.21.15.92:0/3475191484 conn(0x7f664c076dc0 msgr2=0x7f664c0771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:37.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.162+0000 7f6652314700 1 -- 172.21.15.92:0/3475191484 shutdown_connections 2023-10-16T13:12:37.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.162+0000 7f6652314700 1 -- 172.21.15.92:0/3475191484 wait complete. 2023-10-16T13:12:37.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.163+0000 7f6652314700 1 Processor -- start 2023-10-16T13:12:37.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.163+0000 7f6652314700 1 -- start start 2023-10-16T13:12:37.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.163+0000 7f6652314700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f664c0ffe10 0x7f664c195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:37.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.163+0000 7f6652314700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f664c1007d0 0x7f664c196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:37.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.163+0000 7f6652314700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f664c105ec0 0x7f664c19a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:37.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.163+0000 7f6652314700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664c19aef0 con 0x7f664c105ec0 2023-10-16T13:12:37.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.163+0000 7f6652314700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664c19b060 con 0x7f664c0ffe10 2023-10-16T13:12:37.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.163+0000 7f6652314700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664c19b220 con 0x7f664c1007d0 2023-10-16T13:12:37.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.164+0000 7f66508b1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f664c105ec0 0x7f664c19a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:37.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.164+0000 7f66508b1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f664c105ec0 0x7f664c19a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35872/0 (socket says 172.21.15.92:35872) 2023-10-16T13:12:37.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.164+0000 7f66508b1700 1 -- 172.21.15.92:0/1434558610 learned_addr learned my addr 172.21.15.92:0/1434558610 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:37.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.164+0000 7f664bfff700 1 --2- 172.21.15.92:0/1434558610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f664c0ffe10 0x7f664c195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:37.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.164+0000 7f664b7fe700 1 --2- 172.21.15.92:0/1434558610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f664c1007d0 0x7f664c196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:37.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.164+0000 7f66508b1700 1 -- 172.21.15.92:0/1434558610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f664c1007d0 msgr2=0x7f664c196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:37.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.164+0000 7f66508b1700 1 --2- 172.21.15.92:0/1434558610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f664c1007d0 0x7f664c196470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:37.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.164+0000 7f66508b1700 1 -- 172.21.15.92:0/1434558610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f664c0ffe10 msgr2=0x7f664c195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:37.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.164+0000 7f66508b1700 1 --2- 172.21.15.92:0/1434558610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f664c0ffe10 0x7f664c195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:37.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.164+0000 7f66508b1700 1 -- 172.21.15.92:0/1434558610 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c0095f0 con 0x7f664c105ec0 2023-10-16T13:12:37.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.164+0000 7f66508b1700 1 --2- 172.21.15.92:0/1434558610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f664c105ec0 0x7f664c19a8e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f664400ada0 tx=0x7f664400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:37.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.164+0000 7f66497fa700 1 -- 172.21.15.92:0/1434558610 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664400f070 con 0x7f664c105ec0 2023-10-16T13:12:37.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.164+0000 7f66497fa700 1 -- 172.21.15.92:0/1434558610 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6644007b30 con 0x7f664c105ec0 2023-10-16T13:12:37.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.164+0000 7f6652314700 1 -- 172.21.15.92:0/1434558610 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f664c19b500 con 0x7f664c105ec0 2023-10-16T13:12:37.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.164+0000 7f66497fa700 1 -- 172.21.15.92:0/1434558610 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66440053c0 con 0x7f664c105ec0 2023-10-16T13:12:37.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.164+0000 7f6652314700 1 -- 172.21.15.92:0/1434558610 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f664c1a2d60 con 0x7f664c105ec0 2023-10-16T13:12:37.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.165+0000 7f6652314700 1 -- 172.21.15.92:0/1434558610 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f664c04ebb0 con 0x7f664c105ec0 2023-10-16T13:12:37.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.166+0000 7f66497fa700 1 -- 172.21.15.92:0/1434558610 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f664400c980 con 0x7f664c105ec0 2023-10-16T13:12:37.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.167+0000 7f66497fa700 1 --2- 172.21.15.92:0/1434558610 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f66340a1510 0x7f66340a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:37.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.167+0000 7f664bfff700 1 --2- 172.21.15.92:0/1434558610 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f66340a1510 0x7f66340a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:37.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.167+0000 7f66497fa700 1 -- 172.21.15.92:0/1434558610 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f66440cc4a0 con 0x7f664c105ec0 2023-10-16T13:12:37.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.167+0000 7f664bfff700 1 --2- 172.21.15.92:0/1434558610 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f66340a1510 0x7f66340a39d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f663c003800 tx=0x7f663c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:37.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.171+0000 7f66497fa700 1 -- 172.21.15.92:0/1434558610 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6644095a30 con 0x7f664c105ec0 2023-10-16T13:12:37.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.406+0000 7f6652314700 1 -- 172.21.15.92:0/1434558610 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f664c197290 con 0x7f664c105ec0 2023-10-16T13:12:37.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.407+0000 7f66497fa700 1 -- 172.21.15.92:0/1434558610 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6644099050 con 0x7f664c105ec0 2023-10-16T13:12:37.411 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:12:37.412 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-16T13:12:37.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.409+0000 7f6652314700 1 -- 172.21.15.92:0/1434558610 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f66340a1510 msgr2=0x7f66340a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:37.412 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.409+0000 7f6652314700 1 --2- 172.21.15.92:0/1434558610 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f66340a1510 0x7f66340a39d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f663c003800 tx=0x7f663c005fd0 comp rx=0 tx=0).stop 2023-10-16T13:12:37.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.409+0000 7f6652314700 1 -- 172.21.15.92:0/1434558610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f664c105ec0 msgr2=0x7f664c19a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:37.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.409+0000 7f6652314700 1 --2- 172.21.15.92:0/1434558610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f664c105ec0 0x7f664c19a8e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f664400ada0 tx=0x7f664400c330 comp rx=0 tx=0).stop 2023-10-16T13:12:37.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.409+0000 7f6652314700 1 -- 172.21.15.92:0/1434558610 shutdown_connections 2023-10-16T13:12:37.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.409+0000 7f6652314700 1 --2- 172.21.15.92:0/1434558610 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f66340a1510 0x7f66340a39d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:37.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.409+0000 7f6652314700 1 --2- 172.21.15.92:0/1434558610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f664c105ec0 0x7f664c19a8e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:37.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.409+0000 7f6652314700 1 --2- 172.21.15.92:0/1434558610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f664c0ffe10 0x7f664c195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:37.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.409+0000 7f6652314700 1 --2- 172.21.15.92:0/1434558610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f664c1007d0 0x7f664c196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:37.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.409+0000 7f6652314700 1 -- 172.21.15.92:0/1434558610 >> 172.21.15.92:0/1434558610 conn(0x7f664c076dc0 msgr2=0x7f664c0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:37.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.409+0000 7f6652314700 1 -- 172.21.15.92:0/1434558610 shutdown_connections 2023-10-16T13:12:37.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:37.409+0000 7f6652314700 1 -- 172.21.15.92:0/1434558610 wait complete. 2023-10-16T13:12:37.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:37 smithi152 ceph-mon[104423]: osdmap e85: 12 total, 12 up, 12 in 2023-10-16T13:12:37.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:37 smithi092 ceph-mon[99542]: osdmap e85: 12 total, 12 up, 12 in 2023-10-16T13:12:37.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:37 smithi118 ceph-mon[103969]: osdmap e85: 12 total, 12 up, 12 in 2023-10-16T13:12:37.884 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-10-16T13:12:37.884 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:12:38.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.008+0000 7f32e21d9700 1 -- 172.21.15.92:0/1431898667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc100e90 msgr2=0x7f32dc1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:38.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.008+0000 7f32e21d9700 1 --2- 172.21.15.92:0/1431898667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc100e90 0x7f32dc1012b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009990 tx=0x7f32d0009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.008+0000 7f32e21d9700 1 -- 172.21.15.92:0/1431898667 shutdown_connections 2023-10-16T13:12:38.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.008+0000 7f32e21d9700 1 --2- 172.21.15.92:0/1431898667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc100e90 0x7f32dc1012b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.008+0000 7f32e21d9700 1 --2- 172.21.15.92:0/1431898667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32dc102a30 0x7f32dc109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.008+0000 7f32e21d9700 1 --2- 172.21.15.92:0/1431898667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32dc102070 0x7f32dc1024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.008+0000 7f32e21d9700 1 -- 172.21.15.92:0/1431898667 >> 172.21.15.92:0/1431898667 conn(0x7f32dc0fc430 msgr2=0x7f32dc0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:38.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.008+0000 7f32e21d9700 1 -- 172.21.15.92:0/1431898667 shutdown_connections 2023-10-16T13:12:38.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.008+0000 7f32e21d9700 1 -- 172.21.15.92:0/1431898667 wait complete. 2023-10-16T13:12:38.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.009+0000 7f32e21d9700 1 Processor -- start 2023-10-16T13:12:38.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.009+0000 7f32e21d9700 1 -- start start 2023-10-16T13:12:38.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32e21d9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32dc100e90 0x7f32dc196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:38.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32e21d9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc102070 0x7f32dc197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:38.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32e21d9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32dc102a30 0x7f32dc19e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:38.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32e21d9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc19e830 con 0x7f32dc102070 2023-10-16T13:12:38.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32e21d9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc19e9a0 con 0x7f32dc100e90 2023-10-16T13:12:38.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32e21d9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc19eb60 con 0x7f32dc102a30 2023-10-16T13:12:38.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32daffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc102070 0x7f32dc197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:38.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32daffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc102070 0x7f32dc197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35880/0 (socket says 172.21.15.92:35880) 2023-10-16T13:12:38.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32daffd700 1 -- 172.21.15.92:0/108875450 learned_addr learned my addr 172.21.15.92:0/108875450 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:38.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32db7fe700 1 --2- 172.21.15.92:0/108875450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32dc100e90 0x7f32dc196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:38.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32daffd700 1 -- 172.21.15.92:0/108875450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32dc102a30 msgr2=0x7f32dc19e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:38.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32daffd700 1 --2- 172.21.15.92:0/108875450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32dc102a30 0x7f32dc19e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32daffd700 1 -- 172.21.15.92:0/108875450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32dc100e90 msgr2=0x7f32dc196cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:38.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32daffd700 1 --2- 172.21.15.92:0/108875450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32dc100e90 0x7f32dc196cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32daffd700 1 -- 172.21.15.92:0/108875450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d00095f0 con 0x7f32dc102070 2023-10-16T13:12:38.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32db7fe700 1 --2- 172.21.15.92:0/108875450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32dc100e90 0x7f32dc196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:12:38.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32daffd700 1 --2- 172.21.15.92:0/108875450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc102070 0x7f32dc197200 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00b500 tx=0x7f32cc00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:38.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32d8ff9700 1 -- 172.21.15.92:0/108875450 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc011830 con 0x7f32dc102070 2023-10-16T13:12:38.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32e21d9700 1 -- 172.21.15.92:0/108875450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32dc19ee40 con 0x7f32dc102070 2023-10-16T13:12:38.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32d8ff9700 1 -- 172.21.15.92:0/108875450 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f32cc011e70 con 0x7f32dc102070 2023-10-16T13:12:38.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32d8ff9700 1 -- 172.21.15.92:0/108875450 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc00f2e0 con 0x7f32dc102070 2023-10-16T13:12:38.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.010+0000 7f32e21d9700 1 -- 172.21.15.92:0/108875450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32dc19f330 con 0x7f32dc102070 2023-10-16T13:12:38.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.011+0000 7f32e21d9700 1 -- 172.21.15.92:0/108875450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32dc10c960 con 0x7f32dc102070 2023-10-16T13:12:38.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.012+0000 7f32d8ff9700 1 -- 172.21.15.92:0/108875450 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f32cc0105f0 con 0x7f32dc102070 2023-10-16T13:12:38.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.013+0000 7f32d8ff9700 1 --2- 172.21.15.92:0/108875450 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f32c40a15c0 0x7f32c40a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:38.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.013+0000 7f32db7fe700 1 --2- 172.21.15.92:0/108875450 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f32c40a15c0 0x7f32c40a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:38.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.013+0000 7f32d8ff9700 1 -- 172.21.15.92:0/108875450 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f32cc0ccd10 con 0x7f32dc102070 2023-10-16T13:12:38.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.013+0000 7f32db7fe700 1 --2- 172.21.15.92:0/108875450 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f32c40a15c0 0x7f32c40a3a80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f32d0000c00 tx=0x7f32d0003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:38.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.016+0000 7f32d8ff9700 1 -- 172.21.15.92:0/108875450 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f32cc096320 con 0x7f32dc102070 2023-10-16T13:12:38.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.211+0000 7f32e21d9700 1 -- 172.21.15.92:0/108875450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32dc107d00 con 0x7f32dc102070 2023-10-16T13:12:38.215 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.212+0000 7f32d8ff9700 1 -- 172.21.15.92:0/108875450 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22598 (secure 0 0 0) 0x7f32cc010380 con 0x7f32dc102070 2023-10-16T13:12:38.216 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:12:38.216 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":85,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:12:36.335213+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:11:38.345035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:11:39.549912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:12:38.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.214+0000 7f32e21d9700 1 -- 172.21.15.92:0/108875450 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f32c40a15c0 msgr2=0x7f32c40a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:38.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.214+0000 7f32e21d9700 1 --2- 172.21.15.92:0/108875450 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f32c40a15c0 0x7f32c40a3a80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f32d0000c00 tx=0x7f32d0003680 comp rx=0 tx=0).stop 2023-10-16T13:12:38.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.214+0000 7f32e21d9700 1 -- 172.21.15.92:0/108875450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc102070 msgr2=0x7f32dc197200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:38.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.214+0000 7f32e21d9700 1 --2- 172.21.15.92:0/108875450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc102070 0x7f32dc197200 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00b500 tx=0x7f32cc00b8c0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.214+0000 7f32e21d9700 1 -- 172.21.15.92:0/108875450 shutdown_connections 2023-10-16T13:12:38.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.215+0000 7f32e21d9700 1 --2- 172.21.15.92:0/108875450 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f32c40a15c0 0x7f32c40a3a80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.215+0000 7f32e21d9700 1 --2- 172.21.15.92:0/108875450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32dc102a30 0x7f32dc19e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.215+0000 7f32e21d9700 1 --2- 172.21.15.92:0/108875450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32dc100e90 0x7f32dc196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.215+0000 7f32e21d9700 1 --2- 172.21.15.92:0/108875450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc102070 0x7f32dc197200 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.215+0000 7f32e21d9700 1 -- 172.21.15.92:0/108875450 >> 172.21.15.92:0/108875450 conn(0x7f32dc0fc430 msgr2=0x7f32dc0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:38.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.215+0000 7f32e21d9700 1 -- 172.21.15.92:0/108875450 shutdown_connections 2023-10-16T13:12:38.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.215+0000 7f32e21d9700 1 -- 172.21.15.92:0/108875450 wait complete. 2023-10-16T13:12:38.230 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:07:45.516334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:11:38.345035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:11:39.549912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:12:38.231 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:12:38.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.354+0000 7f0dce004700 1 -- 172.21.15.92:0/1758972968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc8102bb0 msgr2=0x7f0dc8109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:38.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.354+0000 7f0dce004700 1 --2- 172.21.15.92:0/1758972968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc8102bb0 0x7f0dc8109460 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000b0a0 tx=0x7f0dc000b3b0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.354+0000 7f0dce004700 1 -- 172.21.15.92:0/1758972968 shutdown_connections 2023-10-16T13:12:38.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.354+0000 7f0dce004700 1 --2- 172.21.15.92:0/1758972968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc8102bb0 0x7f0dc8109460 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.354+0000 7f0dce004700 1 --2- 172.21.15.92:0/1758972968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dc80ff1a0 0x7f0dc80ff5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.354+0000 7f0dce004700 1 --2- 172.21.15.92:0/1758972968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dc8102210 0x7f0dc8102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.354+0000 7f0dce004700 1 -- 172.21.15.92:0/1758972968 >> 172.21.15.92:0/1758972968 conn(0x7f0dc80faa90 msgr2=0x7f0dc80fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:38.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.354+0000 7f0dce004700 1 -- 172.21.15.92:0/1758972968 shutdown_connections 2023-10-16T13:12:38.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.354+0000 7f0dce004700 1 -- 172.21.15.92:0/1758972968 wait complete. 2023-10-16T13:12:38.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.354+0000 7f0dce004700 1 Processor -- start 2023-10-16T13:12:38.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dce004700 1 -- start start 2023-10-16T13:12:38.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dce004700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dc80ff1a0 0x7f0dc8196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:38.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dce004700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc8102210 0x7f0dc81972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:38.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dce004700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dc8102bb0 0x7f0dc819e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:38.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dce004700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc819e8f0 con 0x7f0dc8102210 2023-10-16T13:12:38.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dce004700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc819ea30 con 0x7f0dc80ff1a0 2023-10-16T13:12:38.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dce004700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc819ebc0 con 0x7f0dc8102bb0 2023-10-16T13:12:38.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dc6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc8102210 0x7f0dc81972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:38.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dc6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc8102210 0x7f0dc81972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35894/0 (socket says 172.21.15.92:35894) 2023-10-16T13:12:38.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dc6ffd700 1 -- 172.21.15.92:0/4093823942 learned_addr learned my addr 172.21.15.92:0/4093823942 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:38.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dc77fe700 1 --2- 172.21.15.92:0/4093823942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dc80ff1a0 0x7f0dc8196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:38.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dc7fff700 1 --2- 172.21.15.92:0/4093823942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dc8102bb0 0x7f0dc819e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:38.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dc6ffd700 1 -- 172.21.15.92:0/4093823942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dc8102bb0 msgr2=0x7f0dc819e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:38.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dc6ffd700 1 --2- 172.21.15.92:0/4093823942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dc8102bb0 0x7f0dc819e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dc6ffd700 1 -- 172.21.15.92:0/4093823942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dc80ff1a0 msgr2=0x7f0dc8196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:38.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dc6ffd700 1 --2- 172.21.15.92:0/4093823942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dc80ff1a0 0x7f0dc8196d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dc6ffd700 1 -- 172.21.15.92:0/4093823942 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc0009d00 con 0x7f0dc8102210 2023-10-16T13:12:38.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dc6ffd700 1 --2- 172.21.15.92:0/4093823942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc8102210 0x7f0dc81972b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00d950 tx=0x7f0dbc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:38.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dc4ff9700 1 -- 172.21.15.92:0/4093823942 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00f890 con 0x7f0dc8102210 2023-10-16T13:12:38.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dc4ff9700 1 -- 172.21.15.92:0/4093823942 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0dbc010460 con 0x7f0dc8102210 2023-10-16T13:12:38.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dce004700 1 -- 172.21.15.92:0/4093823942 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc819eea0 con 0x7f0dc8102210 2023-10-16T13:12:38.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.355+0000 7f0dc4ff9700 1 -- 172.21.15.92:0/4093823942 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00e610 con 0x7f0dc8102210 2023-10-16T13:12:38.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.356+0000 7f0dce004700 1 -- 172.21.15.92:0/4093823942 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc819f320 con 0x7f0dc8102210 2023-10-16T13:12:38.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.356+0000 7f0dce004700 1 -- 172.21.15.92:0/4093823942 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc8108540 con 0x7f0dc8102210 2023-10-16T13:12:38.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.357+0000 7f0dc4ff9700 1 -- 172.21.15.92:0/4093823942 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f0dbc010960 con 0x7f0dc8102210 2023-10-16T13:12:38.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.358+0000 7f0dc4ff9700 1 --2- 172.21.15.92:0/4093823942 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0db00a1510 0x7f0db00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:38.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.358+0000 7f0dc77fe700 1 --2- 172.21.15.92:0/4093823942 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0db00a1510 0x7f0db00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:38.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.358+0000 7f0dc4ff9700 1 -- 172.21.15.92:0/4093823942 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f0dbc0ccbc0 con 0x7f0dc8102210 2023-10-16T13:12:38.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.358+0000 7f0dc77fe700 1 --2- 172.21.15.92:0/4093823942 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0db00a1510 0x7f0db00a39d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8067d80 tx=0x7f0db8007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:38.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.361+0000 7f0dc4ff9700 1 -- 172.21.15.92:0/4093823942 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0dbc0960c0 con 0x7f0dc8102210 2023-10-16T13:12:38.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:38 smithi092 ceph-mon[99542]: pgmap v286: 97 pgs: 2 peering, 95 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2023-10-16T13:12:38.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:38 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1434558610' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-16T13:12:38.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:38 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/108875450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:12:38.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.554+0000 7f0dce004700 1 -- 172.21.15.92:0/4093823942 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0dc810c990 con 0x7f0dc8102210 2023-10-16T13:12:38.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.554+0000 7f0dc4ff9700 1 -- 172.21.15.92:0/4093823942 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0dbc0200a0 con 0x7f0dc8102210 2023-10-16T13:12:38.557 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-10-16T13:12:38.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.556+0000 7f0dce004700 1 -- 172.21.15.92:0/4093823942 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0db00a1510 msgr2=0x7f0db00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:38.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.556+0000 7f0dce004700 1 --2- 172.21.15.92:0/4093823942 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0db00a1510 0x7f0db00a39d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8067d80 tx=0x7f0db8007400 comp rx=0 tx=0).stop 2023-10-16T13:12:38.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.556+0000 7f0dce004700 1 -- 172.21.15.92:0/4093823942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc8102210 msgr2=0x7f0dc81972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:38.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.556+0000 7f0dce004700 1 --2- 172.21.15.92:0/4093823942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc8102210 0x7f0dc81972b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00d950 tx=0x7f0dbc00dc60 comp rx=0 tx=0).stop 2023-10-16T13:12:38.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.556+0000 7f0dce004700 1 -- 172.21.15.92:0/4093823942 shutdown_connections 2023-10-16T13:12:38.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.556+0000 7f0dce004700 1 --2- 172.21.15.92:0/4093823942 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0db00a1510 0x7f0db00a39d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.556+0000 7f0dce004700 1 --2- 172.21.15.92:0/4093823942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dc8102bb0 0x7f0dc819e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.556+0000 7f0dce004700 1 --2- 172.21.15.92:0/4093823942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dc80ff1a0 0x7f0dc8196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.556+0000 7f0dce004700 1 --2- 172.21.15.92:0/4093823942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc8102210 0x7f0dc81972b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.556+0000 7f0dce004700 1 -- 172.21.15.92:0/4093823942 >> 172.21.15.92:0/4093823942 conn(0x7f0dc80faa90 msgr2=0x7f0dc8105680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:38.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.556+0000 7f0dce004700 1 -- 172.21.15.92:0/4093823942 shutdown_connections 2023-10-16T13:12:38.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.556+0000 7f0dce004700 1 -- 172.21.15.92:0/4093823942 wait complete. 2023-10-16T13:12:38.571 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:12:38.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:38 smithi152 ceph-mon[104423]: pgmap v286: 97 pgs: 2 peering, 95 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2023-10-16T13:12:38.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:38 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1434558610' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-16T13:12:38.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:38 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/108875450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:12:38.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.693+0000 7fb04a124700 1 -- 172.21.15.92:0/1124489924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0440fffc0 msgr2=0x7fb044100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:38.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.693+0000 7fb04a124700 1 --2- 172.21.15.92:0/1124489924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0440fffc0 0x7fb044100440 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb034009990 tx=0x7fb034009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.693+0000 7fb04a124700 1 -- 172.21.15.92:0/1124489924 shutdown_connections 2023-10-16T13:12:38.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.693+0000 7fb04a124700 1 --2- 172.21.15.92:0/1124489924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb044100980 0x7fb044108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.693+0000 7fb04a124700 1 --2- 172.21.15.92:0/1124489924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb044101370 0x7fb044101790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.693+0000 7fb04a124700 1 --2- 172.21.15.92:0/1124489924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0440fffc0 0x7fb044100440 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.693+0000 7fb04a124700 1 -- 172.21.15.92:0/1124489924 >> 172.21.15.92:0/1124489924 conn(0x7fb0440faa90 msgr2=0x7fb0440fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:38.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.693+0000 7fb04a124700 1 -- 172.21.15.92:0/1124489924 shutdown_connections 2023-10-16T13:12:38.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.693+0000 7fb04a124700 1 -- 172.21.15.92:0/1124489924 wait complete. 2023-10-16T13:12:38.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.693+0000 7fb04a124700 1 Processor -- start 2023-10-16T13:12:38.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.693+0000 7fb04a124700 1 -- start start 2023-10-16T13:12:38.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb04a124700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0440fffc0 0x7fb044195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:38.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb04a124700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb044100980 0x7fb0441960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:38.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb04a124700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb044101370 0x7fb04419d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:38.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb04a124700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04419d710 con 0x7fb044101370 2023-10-16T13:12:38.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb04a124700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04419d850 con 0x7fb0440fffc0 2023-10-16T13:12:38.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb04a124700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04419d9e0 con 0x7fb044100980 2023-10-16T13:12:38.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb043fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb044101370 0x7fb04419d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:38.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb043fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb044101370 0x7fb04419d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35910/0 (socket says 172.21.15.92:35910) 2023-10-16T13:12:38.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb043fff700 1 -- 172.21.15.92:0/2136764699 learned_addr learned my addr 172.21.15.92:0/2136764699 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:38.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb042ffd700 1 --2- 172.21.15.92:0/2136764699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb044100980 0x7fb0441960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:38.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb0437fe700 1 --2- 172.21.15.92:0/2136764699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0440fffc0 0x7fb044195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:38.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb043fff700 1 -- 172.21.15.92:0/2136764699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb044100980 msgr2=0x7fb0441960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:38.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb043fff700 1 --2- 172.21.15.92:0/2136764699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb044100980 0x7fb0441960d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb043fff700 1 -- 172.21.15.92:0/2136764699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0440fffc0 msgr2=0x7fb044195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:38.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb043fff700 1 --2- 172.21.15.92:0/2136764699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0440fffc0 0x7fb044195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb043fff700 1 -- 172.21.15.92:0/2136764699 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0340095f0 con 0x7fb044101370 2023-10-16T13:12:38.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb0437fe700 1 --2- 172.21.15.92:0/2136764699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0440fffc0 0x7fb044195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:12:38.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb043fff700 1 --2- 172.21.15.92:0/2136764699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb044101370 0x7fb04419d140 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb03c007ee0 tx=0x7fb03c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:38.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb040ff9700 1 -- 172.21.15.92:0/2136764699 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c017070 con 0x7fb044101370 2023-10-16T13:12:38.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb040ff9700 1 -- 172.21.15.92:0/2136764699 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb03c00f040 con 0x7fb044101370 2023-10-16T13:12:38.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb04a124700 1 -- 172.21.15.92:0/2136764699 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04419dcc0 con 0x7fb044101370 2023-10-16T13:12:38.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb040ff9700 1 -- 172.21.15.92:0/2136764699 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c005760 con 0x7fb044101370 2023-10-16T13:12:38.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.694+0000 7fb04a124700 1 -- 172.21.15.92:0/2136764699 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04419e180 con 0x7fb044101370 2023-10-16T13:12:38.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.695+0000 7fb04a124700 1 -- 172.21.15.92:0/2136764699 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb044107350 con 0x7fb044101370 2023-10-16T13:12:38.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.697+0000 7fb040ff9700 1 -- 172.21.15.92:0/2136764699 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fb03c0058c0 con 0x7fb044101370 2023-10-16T13:12:38.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.697+0000 7fb040ff9700 1 --2- 172.21.15.92:0/2136764699 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb02c0a1510 0x7fb02c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:38.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.697+0000 7fb040ff9700 1 -- 172.21.15.92:0/2136764699 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb03c0cccc0 con 0x7fb044101370 2023-10-16T13:12:38.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.697+0000 7fb0437fe700 1 --2- 172.21.15.92:0/2136764699 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb02c0a1510 0x7fb02c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:38.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.698+0000 7fb0437fe700 1 --2- 172.21.15.92:0/2136764699 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb02c0a1510 0x7fb02c0a39d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb038005950 tx=0x7fb0380058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:38.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.700+0000 7fb040ff9700 1 -- 172.21.15.92:0/2136764699 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb03c0961c0 con 0x7fb044101370 2023-10-16T13:12:38.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:38 smithi118 ceph-mon[103969]: pgmap v286: 97 pgs: 2 peering, 95 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2023-10-16T13:12:38.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:38 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1434558610' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-16T13:12:38.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:38 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/108875450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:12:38.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.891+0000 7fb04a124700 1 -- 172.21.15.92:0/2136764699 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb04402d020 con 0x7fb044101370 2023-10-16T13:12:38.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.891+0000 7fb040ff9700 1 -- 172.21.15.92:0/2136764699 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb03c009390 con 0x7fb044101370 2023-10-16T13:12:38.895 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-10-16T13:12:38.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.893+0000 7fb04a124700 1 -- 172.21.15.92:0/2136764699 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb02c0a1510 msgr2=0x7fb02c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:38.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.893+0000 7fb04a124700 1 --2- 172.21.15.92:0/2136764699 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb02c0a1510 0x7fb02c0a39d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb038005950 tx=0x7fb0380058e0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.893+0000 7fb04a124700 1 -- 172.21.15.92:0/2136764699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb044101370 msgr2=0x7fb04419d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:38.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.893+0000 7fb04a124700 1 --2- 172.21.15.92:0/2136764699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb044101370 0x7fb04419d140 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb03c007ee0 tx=0x7fb03c00d3b0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.893+0000 7fb04a124700 1 -- 172.21.15.92:0/2136764699 shutdown_connections 2023-10-16T13:12:38.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.893+0000 7fb04a124700 1 --2- 172.21.15.92:0/2136764699 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb02c0a1510 0x7fb02c0a39d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.893+0000 7fb04a124700 1 --2- 172.21.15.92:0/2136764699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb044101370 0x7fb04419d140 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.893+0000 7fb04a124700 1 --2- 172.21.15.92:0/2136764699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0440fffc0 0x7fb044195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.893+0000 7fb04a124700 1 --2- 172.21.15.92:0/2136764699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb044100980 0x7fb0441960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:38.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.893+0000 7fb04a124700 1 -- 172.21.15.92:0/2136764699 >> 172.21.15.92:0/2136764699 conn(0x7fb0440faa90 msgr2=0x7fb044104490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:38.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.894+0000 7fb04a124700 1 -- 172.21.15.92:0/2136764699 shutdown_connections 2023-10-16T13:12:38.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:38.894+0000 7fb04a124700 1 -- 172.21.15.92:0/2136764699 wait complete. 2023-10-16T13:12:38.908 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:12:39.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.029+0000 7fecc82f6700 1 -- 172.21.15.92:0/2250154709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecc0102af0 msgr2=0x7fecc01093a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:39.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.029+0000 7fecc82f6700 1 --2- 172.21.15.92:0/2250154709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecc0102af0 0x7fecc01093a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fecb800b0a0 tx=0x7fecb800b3b0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc82f6700 1 -- 172.21.15.92:0/2250154709 shutdown_connections 2023-10-16T13:12:39.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc82f6700 1 --2- 172.21.15.92:0/2250154709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecc0102af0 0x7fecc01093a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc82f6700 1 --2- 172.21.15.92:0/2250154709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecc00ff180 0x7fecc00ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc82f6700 1 --2- 172.21.15.92:0/2250154709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecc0102150 0x7fecc01025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc82f6700 1 -- 172.21.15.92:0/2250154709 >> 172.21.15.92:0/2250154709 conn(0x7fecc00faa90 msgr2=0x7fecc00fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:39.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc82f6700 1 -- 172.21.15.92:0/2250154709 shutdown_connections 2023-10-16T13:12:39.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc82f6700 1 -- 172.21.15.92:0/2250154709 wait complete. 2023-10-16T13:12:39.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc82f6700 1 Processor -- start 2023-10-16T13:12:39.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc82f6700 1 -- start start 2023-10-16T13:12:39.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc82f6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecc00ff180 0x7fecc0196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:39.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc82f6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecc0102150 0x7fecc01972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:39.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc82f6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecc0102af0 0x7fecc019e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:39.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc82f6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc019e8f0 con 0x7fecc0102150 2023-10-16T13:12:39.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc82f6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc019ea60 con 0x7fecc0102af0 2023-10-16T13:12:39.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc82f6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc019ec20 con 0x7fecc00ff180 2023-10-16T13:12:39.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc5891700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecc0102150 0x7fecc01972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:39.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc5891700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecc0102150 0x7fecc01972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35922/0 (socket says 172.21.15.92:35922) 2023-10-16T13:12:39.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc5891700 1 -- 172.21.15.92:0/2865909026 learned_addr learned my addr 172.21.15.92:0/2865909026 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:39.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc6893700 1 --2- 172.21.15.92:0/2865909026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecc0102af0 0x7fecc019e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:39.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.030+0000 7fecc6092700 1 --2- 172.21.15.92:0/2865909026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecc00ff180 0x7fecc0196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:39.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.031+0000 7fecc5891700 1 -- 172.21.15.92:0/2865909026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecc00ff180 msgr2=0x7fecc0196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:39.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.031+0000 7fecc5891700 1 --2- 172.21.15.92:0/2865909026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecc00ff180 0x7fecc0196db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.031+0000 7fecc5891700 1 -- 172.21.15.92:0/2865909026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecc0102af0 msgr2=0x7fecc019e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:39.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.031+0000 7fecc5891700 1 --2- 172.21.15.92:0/2865909026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecc0102af0 0x7fecc019e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.031+0000 7fecc5891700 1 -- 172.21.15.92:0/2865909026 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb8009d00 con 0x7fecc0102150 2023-10-16T13:12:39.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.031+0000 7fecc5891700 1 --2- 172.21.15.92:0/2865909026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecc0102150 0x7fecc01972f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fecb000c920 tx=0x7fecb000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:39.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.031+0000 7fecb77fe700 1 -- 172.21.15.92:0/2865909026 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0004a30 con 0x7fecc0102150 2023-10-16T13:12:39.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.031+0000 7fecb77fe700 1 -- 172.21.15.92:0/2865909026 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fecb0005500 con 0x7fecc0102150 2023-10-16T13:12:39.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.031+0000 7fecc82f6700 1 -- 172.21.15.92:0/2865909026 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc019ef00 con 0x7fecc0102150 2023-10-16T13:12:39.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.031+0000 7fecb77fe700 1 -- 172.21.15.92:0/2865909026 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0007cd0 con 0x7fecc0102150 2023-10-16T13:12:39.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.031+0000 7fecc82f6700 1 -- 172.21.15.92:0/2865909026 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc019f320 con 0x7fecc0102150 2023-10-16T13:12:39.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.032+0000 7fecc82f6700 1 -- 172.21.15.92:0/2865909026 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc01084b0 con 0x7fecc0102150 2023-10-16T13:12:39.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.033+0000 7fecb77fe700 1 -- 172.21.15.92:0/2865909026 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fecb0005000 con 0x7fecc0102150 2023-10-16T13:12:39.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.034+0000 7fecb77fe700 1 --2- 172.21.15.92:0/2865909026 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fecac0a1510 0x7fecac0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:39.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.034+0000 7fecc6092700 1 --2- 172.21.15.92:0/2865909026 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fecac0a1510 0x7fecac0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:39.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.034+0000 7fecb77fe700 1 -- 172.21.15.92:0/2865909026 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fecb00ccde0 con 0x7fecc0102150 2023-10-16T13:12:39.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.034+0000 7fecc6092700 1 --2- 172.21.15.92:0/2865909026 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fecac0a1510 0x7fecac0a39d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fecc0198280 tx=0x7fecbc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:39.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.037+0000 7fecb77fe700 1 -- 172.21.15.92:0/2865909026 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fecb00962a0 con 0x7fecc0102150 2023-10-16T13:12:39.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.230+0000 7fecc82f6700 1 -- 172.21.15.92:0/2865909026 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fecc002d020 con 0x7fecc0102150 2023-10-16T13:12:39.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.230+0000 7fecb77fe700 1 -- 172.21.15.92:0/2865909026 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7fecb001d020 con 0x7fecc0102150 2023-10-16T13:12:39.233 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-10-16T13:12:39.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.232+0000 7fecc82f6700 1 -- 172.21.15.92:0/2865909026 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fecac0a1510 msgr2=0x7fecac0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:39.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.232+0000 7fecc82f6700 1 --2- 172.21.15.92:0/2865909026 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fecac0a1510 0x7fecac0a39d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fecc0198280 tx=0x7fecbc00b410 comp rx=0 tx=0).stop 2023-10-16T13:12:39.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.232+0000 7fecc82f6700 1 -- 172.21.15.92:0/2865909026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecc0102150 msgr2=0x7fecc01972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:39.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.232+0000 7fecc82f6700 1 --2- 172.21.15.92:0/2865909026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecc0102150 0x7fecc01972f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fecb000c920 tx=0x7fecb000cc30 comp rx=0 tx=0).stop 2023-10-16T13:12:39.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.232+0000 7fecc82f6700 1 -- 172.21.15.92:0/2865909026 shutdown_connections 2023-10-16T13:12:39.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.232+0000 7fecc82f6700 1 --2- 172.21.15.92:0/2865909026 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fecac0a1510 0x7fecac0a39d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.232+0000 7fecc82f6700 1 --2- 172.21.15.92:0/2865909026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecc0102af0 0x7fecc019e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.232+0000 7fecc82f6700 1 --2- 172.21.15.92:0/2865909026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecc00ff180 0x7fecc0196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.232+0000 7fecc82f6700 1 --2- 172.21.15.92:0/2865909026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecc0102150 0x7fecc01972f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.232+0000 7fecc82f6700 1 -- 172.21.15.92:0/2865909026 >> 172.21.15.92:0/2865909026 conn(0x7fecc00faa90 msgr2=0x7fecc01055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:39.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.232+0000 7fecc82f6700 1 -- 172.21.15.92:0/2865909026 shutdown_connections 2023-10-16T13:12:39.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.232+0000 7fecc82f6700 1 -- 172.21.15.92:0/2865909026 wait complete. 2023-10-16T13:12:39.247 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:12:39.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.367+0000 7f47a6cf3700 1 -- 172.21.15.92:0/3836280684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47a00ffe30 msgr2=0x7f47a0100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:39.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.367+0000 7f47a6cf3700 1 --2- 172.21.15.92:0/3836280684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47a00ffe30 0x7f47a0100250 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4794009990 tx=0x7f4794009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.367+0000 7f47a6cf3700 1 -- 172.21.15.92:0/3836280684 shutdown_connections 2023-10-16T13:12:39.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.367+0000 7f47a6cf3700 1 --2- 172.21.15.92:0/3836280684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47a00ffe30 0x7f47a0100250 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.367+0000 7f47a6cf3700 1 --2- 172.21.15.92:0/3836280684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47a0101940 0x7f47a0108260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.367+0000 7f47a6cf3700 1 --2- 172.21.15.92:0/3836280684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47a0100f80 0x7f47a0101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.367+0000 7f47a6cf3700 1 -- 172.21.15.92:0/3836280684 >> 172.21.15.92:0/3836280684 conn(0x7f47a00fb380 msgr2=0x7f47a00fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:39.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.367+0000 7f47a6cf3700 1 -- 172.21.15.92:0/3836280684 shutdown_connections 2023-10-16T13:12:39.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.367+0000 7f47a6cf3700 1 -- 172.21.15.92:0/3836280684 wait complete. 2023-10-16T13:12:39.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f47a6cf3700 1 Processor -- start 2023-10-16T13:12:39.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f47a6cf3700 1 -- start start 2023-10-16T13:12:39.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f47a6cf3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47a00ffe30 0x7f47a0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:39.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f47a6cf3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47a0100f80 0x7f47a019b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:39.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f47a6cf3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47a0101940 0x7f47a019dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:39.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f47a6cf3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a019e770 con 0x7f47a00ffe30 2023-10-16T13:12:39.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f47a6cf3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a019e8e0 con 0x7f47a0101940 2023-10-16T13:12:39.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f47a6cf3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a019eaa0 con 0x7f47a0100f80 2023-10-16T13:12:39.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f47a4a8f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47a00ffe30 0x7f47a0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:39.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f47a4a8f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47a00ffe30 0x7f47a0069dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35932/0 (socket says 172.21.15.92:35932) 2023-10-16T13:12:39.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f47a4a8f700 1 -- 172.21.15.92:0/3911164689 learned_addr learned my addr 172.21.15.92:0/3911164689 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:39.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f479ffff700 1 --2- 172.21.15.92:0/3911164689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47a0100f80 0x7f47a019b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:39.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f47a4a8f700 1 -- 172.21.15.92:0/3911164689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47a0100f80 msgr2=0x7f47a019b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:39.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f47a4a8f700 1 --2- 172.21.15.92:0/3911164689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47a0100f80 0x7f47a019b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f47a4a8f700 1 -- 172.21.15.92:0/3911164689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47a0101940 msgr2=0x7f47a019dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:39.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f47a4a8f700 1 --2- 172.21.15.92:0/3911164689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47a0101940 0x7f47a019dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f47a4a8f700 1 -- 172.21.15.92:0/3911164689 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47940095f0 con 0x7f47a00ffe30 2023-10-16T13:12:39.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f47a4a8f700 1 --2- 172.21.15.92:0/3911164689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47a00ffe30 0x7f47a0069dd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4794000c00 tx=0x7f47940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:39.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f479dffb700 1 -- 172.21.15.92:0/3911164689 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479401d070 con 0x7f47a00ffe30 2023-10-16T13:12:39.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f479dffb700 1 -- 172.21.15.92:0/3911164689 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4794022470 con 0x7f47a00ffe30 2023-10-16T13:12:39.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f47a6cf3700 1 -- 172.21.15.92:0/3911164689 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a019ed20 con 0x7f47a00ffe30 2023-10-16T13:12:39.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.368+0000 7f479dffb700 1 -- 172.21.15.92:0/3911164689 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479400f6a0 con 0x7f47a00ffe30 2023-10-16T13:12:39.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.369+0000 7f47a6cf3700 1 -- 172.21.15.92:0/3911164689 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a019f140 con 0x7f47a00ffe30 2023-10-16T13:12:39.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.369+0000 7f47a6cf3700 1 -- 172.21.15.92:0/3911164689 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a010b790 con 0x7f47a00ffe30 2023-10-16T13:12:39.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.371+0000 7f479dffb700 1 -- 172.21.15.92:0/3911164689 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f4794022950 con 0x7f47a00ffe30 2023-10-16T13:12:39.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.371+0000 7f479dffb700 1 --2- 172.21.15.92:0/3911164689 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f47900a15c0 0x7f47900a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:39.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.371+0000 7f479ffff700 1 --2- 172.21.15.92:0/3911164689 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f47900a15c0 0x7f47900a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:39.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.371+0000 7f479dffb700 1 -- 172.21.15.92:0/3911164689 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f47940ce4f0 con 0x7f47a00ffe30 2023-10-16T13:12:39.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.372+0000 7f479ffff700 1 --2- 172.21.15.92:0/3911164689 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f47900a15c0 0x7f47900a3a80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f478c005fd0 tx=0x7f478c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:39.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.375+0000 7f479dffb700 1 -- 172.21.15.92:0/3911164689 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4794097a80 con 0x7f47a00ffe30 2023-10-16T13:12:39.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:39 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/4093823942' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:12:39.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:39 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2136764699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:12:39.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:39 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2865909026' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:12:39.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.610+0000 7f47a6cf3700 1 -- 172.21.15.92:0/3911164689 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47a010ba10 con 0x7f47a00ffe30 2023-10-16T13:12:39.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.611+0000 7f479dffb700 1 -- 172.21.15.92:0/3911164689 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11379 (secure 0 0 0) 0x7f479409b0a0 con 0x7f47a00ffe30 2023-10-16T13:12:39.614 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:12:39.614 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-16T13:11:40.343309+0000","modified":"2023-10-16T13:11:48.346678+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24460,"mds_3":24428,"mds_4":24412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1790514945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1790514945},{"type":"v1","addr":"172.21.15.92:6839","nonce":1790514945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/1016260236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1016260236},{"type":"v1","addr":"172.21.15.92:6841","nonce":1016260236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24410":{"gid":24410,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/2133613540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":2133613540},{"type":"v1","addr":"172.21.15.118:6837","nonce":2133613540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6837/2403096460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":2403096460},{"type":"v1","addr":"172.21.15.152:6837","nonce":2403096460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1821921588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1821921588},{"type":"v1","addr":"172.21.15.152:6839","nonce":1821921588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6839/1577355936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":1577355936},{"type":"v1","addr":"172.21.15.118:6839","nonce":1577355936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:12:39.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.613+0000 7f47a6cf3700 1 -- 172.21.15.92:0/3911164689 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f47900a15c0 msgr2=0x7f47900a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:39.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.613+0000 7f47a6cf3700 1 --2- 172.21.15.92:0/3911164689 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f47900a15c0 0x7f47900a3a80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f478c005fd0 tx=0x7f478c00a560 comp rx=0 tx=0).stop 2023-10-16T13:12:39.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.613+0000 7f47a6cf3700 1 -- 172.21.15.92:0/3911164689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47a00ffe30 msgr2=0x7f47a0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:39.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.613+0000 7f47a6cf3700 1 --2- 172.21.15.92:0/3911164689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47a00ffe30 0x7f47a0069dd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4794000c00 tx=0x7f47940047c0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.613+0000 7f47a6cf3700 1 -- 172.21.15.92:0/3911164689 shutdown_connections 2023-10-16T13:12:39.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.613+0000 7f47a6cf3700 1 --2- 172.21.15.92:0/3911164689 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f47900a15c0 0x7f47900a3a80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.613+0000 7f47a6cf3700 1 --2- 172.21.15.92:0/3911164689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47a00ffe30 0x7f47a0069dd0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.613+0000 7f47a6cf3700 1 --2- 172.21.15.92:0/3911164689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47a0101940 0x7f47a019dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.613+0000 7f47a6cf3700 1 --2- 172.21.15.92:0/3911164689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47a0100f80 0x7f47a019b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.613+0000 7f47a6cf3700 1 -- 172.21.15.92:0/3911164689 >> 172.21.15.92:0/3911164689 conn(0x7f47a00fb380 msgr2=0x7f47a00fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:39.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.613+0000 7f47a6cf3700 1 -- 172.21.15.92:0/3911164689 shutdown_connections 2023-10-16T13:12:39.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.613+0000 7f47a6cf3700 1 -- 172.21.15.92:0/3911164689 wait complete. 2023-10-16T13:12:39.618 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 27 2023-10-16T13:12:39.628 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:12:39.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:39 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/4093823942' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:12:39.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:39 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2136764699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:12:39.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:39 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2865909026' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:12:39.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.748+0000 7f3b7cd8a700 1 -- 172.21.15.92:0/3430911912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78100fc0 msgr2=0x7f3b78101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:39.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.748+0000 7f3b7cd8a700 1 --2- 172.21.15.92:0/3430911912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78100fc0 0x7f3b78101420 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0099c0 tx=0x7f3b6c009cd0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.748+0000 7f3b7cd8a700 1 -- 172.21.15.92:0/3430911912 shutdown_connections 2023-10-16T13:12:39.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.748+0000 7f3b7cd8a700 1 --2- 172.21.15.92:0/3430911912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b78101960 0x7f3b78108210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.748+0000 7f3b7cd8a700 1 --2- 172.21.15.92:0/3430911912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b780ffdd0 0x7f3b781001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.748+0000 7f3b7cd8a700 1 --2- 172.21.15.92:0/3430911912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78100fc0 0x7f3b78101420 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.748+0000 7f3b7cd8a700 1 -- 172.21.15.92:0/3430911912 >> 172.21.15.92:0/3430911912 conn(0x7f3b780fb320 msgr2=0x7f3b780fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:39.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.748+0000 7f3b7cd8a700 1 -- 172.21.15.92:0/3430911912 shutdown_connections 2023-10-16T13:12:39.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.748+0000 7f3b7cd8a700 1 -- 172.21.15.92:0/3430911912 wait complete. 2023-10-16T13:12:39.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.748+0000 7f3b7cd8a700 1 Processor -- start 2023-10-16T13:12:39.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.748+0000 7f3b7cd8a700 1 -- start start 2023-10-16T13:12:39.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b7cd8a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b780ffdd0 0x7f3b78103d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:39.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b7cd8a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b78100fc0 0x7f3b781023a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:39.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b7cd8a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78101960 0x7f3b781028e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:39.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b7cd8a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b78103080 con 0x7f3b78101960 2023-10-16T13:12:39.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b7cd8a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b781031f0 con 0x7f3b78100fc0 2023-10-16T13:12:39.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b7cd8a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b781a0c40 con 0x7f3b780ffdd0 2023-10-16T13:12:39.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b76d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78101960 0x7f3b781028e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:39.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b76d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78101960 0x7f3b781028e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35950/0 (socket says 172.21.15.92:35950) 2023-10-16T13:12:39.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b76d9d700 1 -- 172.21.15.92:0/3483806084 learned_addr learned my addr 172.21.15.92:0/3483806084 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:39.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b75d9b700 1 --2- 172.21.15.92:0/3483806084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b78100fc0 0x7f3b781023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:39.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b7659c700 1 --2- 172.21.15.92:0/3483806084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b780ffdd0 0x7f3b78103d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:39.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b76d9d700 1 -- 172.21.15.92:0/3483806084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b780ffdd0 msgr2=0x7f3b78103d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:39.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b76d9d700 1 --2- 172.21.15.92:0/3483806084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b780ffdd0 0x7f3b78103d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b76d9d700 1 -- 172.21.15.92:0/3483806084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b78100fc0 msgr2=0x7f3b781023a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:39.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b76d9d700 1 --2- 172.21.15.92:0/3483806084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b78100fc0 0x7f3b781023a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b76d9d700 1 -- 172.21.15.92:0/3483806084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c0095f0 con 0x7f3b78101960 2023-10-16T13:12:39.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b76d9d700 1 --2- 172.21.15.92:0/3483806084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78101960 0x7f3b781028e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000ef30 tx=0x7f3b7000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:39.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b677fe700 1 -- 172.21.15.92:0/3483806084 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b70018070 con 0x7f3b78101960 2023-10-16T13:12:39.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b7cd8a700 1 -- 172.21.15.92:0/3483806084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b781a0ec0 con 0x7f3b78101960 2023-10-16T13:12:39.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b677fe700 1 -- 172.21.15.92:0/3483806084 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3b7000f040 con 0x7f3b78101960 2023-10-16T13:12:39.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b677fe700 1 -- 172.21.15.92:0/3483806084 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7000cd00 con 0x7f3b78101960 2023-10-16T13:12:39.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.749+0000 7f3b7cd8a700 1 -- 172.21.15.92:0/3483806084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b781a1340 con 0x7f3b78101960 2023-10-16T13:12:39.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.750+0000 7f3b7cd8a700 1 -- 172.21.15.92:0/3483806084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7810b770 con 0x7f3b78101960 2023-10-16T13:12:39.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.751+0000 7f3b677fe700 1 -- 172.21.15.92:0/3483806084 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f3b70003a00 con 0x7f3b78101960 2023-10-16T13:12:39.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.752+0000 7f3b677fe700 1 --2- 172.21.15.92:0/3483806084 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3b600a15c0 0x7f3b600a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:39.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.752+0000 7f3b7659c700 1 --2- 172.21.15.92:0/3483806084 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3b600a15c0 0x7f3b600a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:39.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.752+0000 7f3b677fe700 1 -- 172.21.15.92:0/3483806084 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3b700cd2e0 con 0x7f3b78101960 2023-10-16T13:12:39.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.752+0000 7f3b7659c700 1 --2- 172.21.15.92:0/3483806084 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3b600a15c0 0x7f3b600a3a80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3b78100e20 tx=0x7f3b6800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:39.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.755+0000 7f3b677fe700 1 -- 172.21.15.92:0/3483806084 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3b70096870 con 0x7f3b78101960 2023-10-16T13:12:39.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:39 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/4093823942' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:12:39.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:39 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2136764699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:12:39.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:39 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2865909026' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:12:39.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.952+0000 7f3b7cd8a700 1 -- 172.21.15.92:0/3483806084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b781a1530 con 0x7f3b78101960 2023-10-16T13:12:39.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.954+0000 7f3b677fe700 1 -- 172.21.15.92:0/3483806084 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22598 (secure 0 0 0) 0x7f3b70099e90 con 0x7f3b78101960 2023-10-16T13:12:39.957 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:12:39.957 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":85,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:12:36.335213+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:11:38.345035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:11:39.549912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:12:39.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.956+0000 7f3b7cd8a700 1 -- 172.21.15.92:0/3483806084 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3b600a15c0 msgr2=0x7f3b600a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:39.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.956+0000 7f3b7cd8a700 1 --2- 172.21.15.92:0/3483806084 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3b600a15c0 0x7f3b600a3a80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3b78100e20 tx=0x7f3b6800b410 comp rx=0 tx=0).stop 2023-10-16T13:12:39.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.956+0000 7f3b7cd8a700 1 -- 172.21.15.92:0/3483806084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78101960 msgr2=0x7f3b781028e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:39.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.956+0000 7f3b7cd8a700 1 --2- 172.21.15.92:0/3483806084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78101960 0x7f3b781028e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000ef30 tx=0x7f3b7000c3a0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.956+0000 7f3b7cd8a700 1 -- 172.21.15.92:0/3483806084 shutdown_connections 2023-10-16T13:12:39.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.956+0000 7f3b7cd8a700 1 --2- 172.21.15.92:0/3483806084 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f3b600a15c0 0x7f3b600a3a80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.956+0000 7f3b7cd8a700 1 --2- 172.21.15.92:0/3483806084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78101960 0x7f3b781028e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.956+0000 7f3b7cd8a700 1 --2- 172.21.15.92:0/3483806084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b780ffdd0 0x7f3b78103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.956+0000 7f3b7cd8a700 1 --2- 172.21.15.92:0/3483806084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b78100fc0 0x7f3b781023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:39.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.956+0000 7f3b7cd8a700 1 -- 172.21.15.92:0/3483806084 >> 172.21.15.92:0/3483806084 conn(0x7f3b780fb320 msgr2=0x7f3b78068040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:39.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.956+0000 7f3b7cd8a700 1 -- 172.21.15.92:0/3483806084 shutdown_connections 2023-10-16T13:12:39.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:39.956+0000 7f3b7cd8a700 1 -- 172.21.15.92:0/3483806084 wait complete. 2023-10-16T13:12:39.973 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:07:45.516334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:11:38.345035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:11:39.549912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:12:39.973 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:12:40.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.111+0000 7f6f89a92700 1 -- 172.21.15.92:0/3712998870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f840ffe20 msgr2=0x7f6f84100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:40.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.111+0000 7f6f89a92700 1 --2- 172.21.15.92:0/3712998870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f840ffe20 0x7f6f84100240 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6f74009990 tx=0x7f6f74009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.111+0000 7f6f89a92700 1 -- 172.21.15.92:0/3712998870 shutdown_connections 2023-10-16T13:12:40.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.111+0000 7f6f89a92700 1 --2- 172.21.15.92:0/3712998870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f840ffe20 0x7f6f84100240 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.111+0000 7f6f89a92700 1 --2- 172.21.15.92:0/3712998870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f84101930 0x7f6f84108250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.111+0000 7f6f89a92700 1 --2- 172.21.15.92:0/3712998870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f84100f70 0x7f6f841013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.111+0000 7f6f89a92700 1 -- 172.21.15.92:0/3712998870 >> 172.21.15.92:0/3712998870 conn(0x7f6f840fb3b0 msgr2=0x7f6f840fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:40.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.111+0000 7f6f89a92700 1 -- 172.21.15.92:0/3712998870 shutdown_connections 2023-10-16T13:12:40.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.111+0000 7f6f89a92700 1 -- 172.21.15.92:0/3712998870 wait complete. 2023-10-16T13:12:40.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.112+0000 7f6f89a92700 1 Processor -- start 2023-10-16T13:12:40.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.112+0000 7f6f89a92700 1 -- start start 2023-10-16T13:12:40.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f89a92700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f840ffe20 0x7f6f84195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:40.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f89a92700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f84100f70 0x7f6f841960c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:40.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f89a92700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f84101930 0x7f6f8419d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:40.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f89a92700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8419d700 con 0x7f6f84101930 2023-10-16T13:12:40.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f89a92700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8419d840 con 0x7f6f840ffe20 2023-10-16T13:12:40.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f89a92700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8419d9d0 con 0x7f6f84100f70 2023-10-16T13:12:40.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f83fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f84101930 0x7f6f8419d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:40.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f82ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f84100f70 0x7f6f841960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:40.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f83fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f84101930 0x7f6f8419d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35964/0 (socket says 172.21.15.92:35964) 2023-10-16T13:12:40.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f83fff700 1 -- 172.21.15.92:0/3205972927 learned_addr learned my addr 172.21.15.92:0/3205972927 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:40.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f837fe700 1 --2- 172.21.15.92:0/3205972927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f840ffe20 0x7f6f84195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:40.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f83fff700 1 -- 172.21.15.92:0/3205972927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f84100f70 msgr2=0x7f6f841960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:40.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f83fff700 1 --2- 172.21.15.92:0/3205972927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f84100f70 0x7f6f841960c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f83fff700 1 -- 172.21.15.92:0/3205972927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f840ffe20 msgr2=0x7f6f84195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:40.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f83fff700 1 --2- 172.21.15.92:0/3205972927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f840ffe20 0x7f6f84195b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f83fff700 1 -- 172.21.15.92:0/3205972927 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f78009520 con 0x7f6f84101930 2023-10-16T13:12:40.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f837fe700 1 --2- 172.21.15.92:0/3205972927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f840ffe20 0x7f6f84195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:12:40.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f83fff700 1 --2- 172.21.15.92:0/3205972927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f84101930 0x7f6f8419d130 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c007d70 tx=0x7f6f7c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:40.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f80ff9700 1 -- 172.21.15.92:0/3205972927 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c00ac90 con 0x7f6f84101930 2023-10-16T13:12:40.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f89a92700 1 -- 172.21.15.92:0/3205972927 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f740095f0 con 0x7f6f84101930 2023-10-16T13:12:40.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f80ff9700 1 -- 172.21.15.92:0/3205972927 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6f7c00adf0 con 0x7f6f84101930 2023-10-16T13:12:40.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.113+0000 7f6f80ff9700 1 -- 172.21.15.92:0/3205972927 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c0116b0 con 0x7f6f84101930 2023-10-16T13:12:40.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.114+0000 7f6f89a92700 1 -- 172.21.15.92:0/3205972927 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f840692f0 con 0x7f6f84101930 2023-10-16T13:12:40.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.115+0000 7f6f80ff9700 1 -- 172.21.15.92:0/3205972927 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f6f7c012420 con 0x7f6f84101930 2023-10-16T13:12:40.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.116+0000 7f6f89a92700 1 -- 172.21.15.92:0/3205972927 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8410b7c0 con 0x7f6f84101930 2023-10-16T13:12:40.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.116+0000 7f6f80ff9700 1 --2- 172.21.15.92:0/3205972927 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6f6c0a1510 0x7f6f6c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:40.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.116+0000 7f6f837fe700 1 --2- 172.21.15.92:0/3205972927 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6f6c0a1510 0x7f6f6c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:40.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.116+0000 7f6f80ff9700 1 -- 172.21.15.92:0/3205972927 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6f7c0ccf80 con 0x7f6f84101930 2023-10-16T13:12:40.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.117+0000 7f6f837fe700 1 --2- 172.21.15.92:0/3205972927 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6f6c0a1510 0x7f6f6c0a39d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400b2e0 tx=0x7f6f74005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:40.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.121+0000 7f6f80ff9700 1 -- 172.21.15.92:0/3205972927 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6f7c096590 con 0x7f6f84101930 2023-10-16T13:12:40.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.319+0000 7f6f89a92700 1 -- 172.21.15.92:0/3205972927 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f84106c60 con 0x7f6f84101930 2023-10-16T13:12:40.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.320+0000 7f6f80ff9700 1 -- 172.21.15.92:0/3205972927 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f7c094e60 con 0x7f6f84101930 2023-10-16T13:12:40.323 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-10-16T13:12:40.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.322+0000 7f6f89a92700 1 -- 172.21.15.92:0/3205972927 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6f6c0a1510 msgr2=0x7f6f6c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:40.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.322+0000 7f6f89a92700 1 --2- 172.21.15.92:0/3205972927 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6f6c0a1510 0x7f6f6c0a39d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400b2e0 tx=0x7f6f74005fb0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.322+0000 7f6f89a92700 1 -- 172.21.15.92:0/3205972927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f84101930 msgr2=0x7f6f8419d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:40.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.322+0000 7f6f89a92700 1 --2- 172.21.15.92:0/3205972927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f84101930 0x7f6f8419d130 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c007d70 tx=0x7f6f7c00a340 comp rx=0 tx=0).stop 2023-10-16T13:12:40.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.322+0000 7f6f89a92700 1 -- 172.21.15.92:0/3205972927 shutdown_connections 2023-10-16T13:12:40.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.322+0000 7f6f89a92700 1 --2- 172.21.15.92:0/3205972927 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6f6c0a1510 0x7f6f6c0a39d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.322+0000 7f6f89a92700 1 --2- 172.21.15.92:0/3205972927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f84101930 0x7f6f8419d130 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.322+0000 7f6f89a92700 1 --2- 172.21.15.92:0/3205972927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f840ffe20 0x7f6f84195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.322+0000 7f6f89a92700 1 --2- 172.21.15.92:0/3205972927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f84100f70 0x7f6f841960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.322+0000 7f6f89a92700 1 -- 172.21.15.92:0/3205972927 >> 172.21.15.92:0/3205972927 conn(0x7f6f840fb3b0 msgr2=0x7f6f840fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:40.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.322+0000 7f6f89a92700 1 -- 172.21.15.92:0/3205972927 shutdown_connections 2023-10-16T13:12:40.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.322+0000 7f6f89a92700 1 -- 172.21.15.92:0/3205972927 wait complete. 2023-10-16T13:12:40.337 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:12:40.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.465+0000 7f7e53aa9700 1 -- 172.21.15.92:0/727242481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e4c102a10 msgr2=0x7f7e4c109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:40.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.465+0000 7f7e53aa9700 1 --2- 172.21.15.92:0/727242481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e4c102a10 0x7f7e4c109330 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009990 tx=0x7f7e44009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.465+0000 7f7e53aa9700 1 -- 172.21.15.92:0/727242481 shutdown_connections 2023-10-16T13:12:40.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.465+0000 7f7e53aa9700 1 --2- 172.21.15.92:0/727242481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e4c102a10 0x7f7e4c109330 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.465+0000 7f7e53aa9700 1 --2- 172.21.15.92:0/727242481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e4c100e70 0x7f7e4c101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.465+0000 7f7e53aa9700 1 --2- 172.21.15.92:0/727242481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e4c102050 0x7f7e4c1024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.465+0000 7f7e53aa9700 1 -- 172.21.15.92:0/727242481 >> 172.21.15.92:0/727242481 conn(0x7f7e4c0fc430 msgr2=0x7f7e4c0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:40.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.465+0000 7f7e53aa9700 1 -- 172.21.15.92:0/727242481 shutdown_connections 2023-10-16T13:12:40.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.465+0000 7f7e53aa9700 1 -- 172.21.15.92:0/727242481 wait complete. 2023-10-16T13:12:40.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.466+0000 7f7e53aa9700 1 Processor -- start 2023-10-16T13:12:40.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.466+0000 7f7e53aa9700 1 -- start start 2023-10-16T13:12:40.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.466+0000 7f7e53aa9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e4c100e70 0x7f7e4c196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:40.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.466+0000 7f7e53aa9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e4c102050 0x7f7e4c197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:40.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.466+0000 7f7e53aa9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e4c102a10 0x7f7e4c19e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:40.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.466+0000 7f7e53aa9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c19e830 con 0x7f7e4c102a10 2023-10-16T13:12:40.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.466+0000 7f7e53aa9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c19e9a0 con 0x7f7e4c100e70 2023-10-16T13:12:40.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.466+0000 7f7e53aa9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c19eb60 con 0x7f7e4c102050 2023-10-16T13:12:40.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.466+0000 7f7e52046700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e4c102a10 0x7f7e4c19e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:40.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.466+0000 7f7e52046700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e4c102a10 0x7f7e4c19e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35978/0 (socket says 172.21.15.92:35978) 2023-10-16T13:12:40.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.466+0000 7f7e52046700 1 -- 172.21.15.92:0/793436004 learned_addr learned my addr 172.21.15.92:0/793436004 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:40.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.466+0000 7f7e51044700 1 --2- 172.21.15.92:0/793436004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e4c102050 0x7f7e4c197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:40.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.466+0000 7f7e51845700 1 --2- 172.21.15.92:0/793436004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e4c100e70 0x7f7e4c196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:40.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.466+0000 7f7e52046700 1 -- 172.21.15.92:0/793436004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e4c102050 msgr2=0x7f7e4c197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:40.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.466+0000 7f7e52046700 1 --2- 172.21.15.92:0/793436004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e4c102050 0x7f7e4c197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.466+0000 7f7e52046700 1 -- 172.21.15.92:0/793436004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e4c100e70 msgr2=0x7f7e4c196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:40.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.466+0000 7f7e52046700 1 --2- 172.21.15.92:0/793436004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e4c100e70 0x7f7e4c196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.466+0000 7f7e52046700 1 -- 172.21.15.92:0/793436004 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e440095f0 con 0x7f7e4c102a10 2023-10-16T13:12:40.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.467+0000 7f7e52046700 1 --2- 172.21.15.92:0/793436004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e4c102a10 0x7f7e4c19e260 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7e44004800 tx=0x7f7e44009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:40.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.467+0000 7f7e4affd700 1 -- 172.21.15.92:0/793436004 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4401d070 con 0x7f7e4c102a10 2023-10-16T13:12:40.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.467+0000 7f7e53aa9700 1 -- 172.21.15.92:0/793436004 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4c19ede0 con 0x7f7e4c102a10 2023-10-16T13:12:40.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.467+0000 7f7e4affd700 1 -- 172.21.15.92:0/793436004 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7e44004d10 con 0x7f7e4c102a10 2023-10-16T13:12:40.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.467+0000 7f7e4affd700 1 -- 172.21.15.92:0/793436004 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e44005450 con 0x7f7e4c102a10 2023-10-16T13:12:40.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.467+0000 7f7e53aa9700 1 -- 172.21.15.92:0/793436004 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4c19f1b0 con 0x7f7e4c102a10 2023-10-16T13:12:40.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.468+0000 7f7e53aa9700 1 -- 172.21.15.92:0/793436004 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4c107da0 con 0x7f7e4c102a10 2023-10-16T13:12:40.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.469+0000 7f7e4affd700 1 -- 172.21.15.92:0/793436004 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f7e44004830 con 0x7f7e4c102a10 2023-10-16T13:12:40.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.469+0000 7f7e4affd700 1 --2- 172.21.15.92:0/793436004 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7e340a1510 0x7f7e340a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:40.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.469+0000 7f7e51845700 1 --2- 172.21.15.92:0/793436004 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7e340a1510 0x7f7e340a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:40.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.469+0000 7f7e4affd700 1 -- 172.21.15.92:0/793436004 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f7e440ce640 con 0x7f7e4c102a10 2023-10-16T13:12:40.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.470+0000 7f7e51845700 1 --2- 172.21.15.92:0/793436004 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7e340a1510 0x7f7e340a39d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c1981c0 tx=0x7f7e3c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:40.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.473+0000 7f7e4affd700 1 -- 172.21.15.92:0/793436004 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7e44097bd0 con 0x7f7e4c102a10 2023-10-16T13:12:40.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.680+0000 7f7e53aa9700 1 -- 172.21.15.92:0/793436004 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e4c10caa0 con 0x7f7e4c102a10 2023-10-16T13:12:40.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.680+0000 7f7e4affd700 1 -- 172.21.15.92:0/793436004 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7e44004e80 con 0x7f7e4c102a10 2023-10-16T13:12:40.683 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-10-16T13:12:40.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.682+0000 7f7e53aa9700 1 -- 172.21.15.92:0/793436004 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7e340a1510 msgr2=0x7f7e340a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:40.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.682+0000 7f7e53aa9700 1 --2- 172.21.15.92:0/793436004 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7e340a1510 0x7f7e340a39d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c1981c0 tx=0x7f7e3c00b040 comp rx=0 tx=0).stop 2023-10-16T13:12:40.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.682+0000 7f7e53aa9700 1 -- 172.21.15.92:0/793436004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e4c102a10 msgr2=0x7f7e4c19e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:40.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.682+0000 7f7e53aa9700 1 --2- 172.21.15.92:0/793436004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e4c102a10 0x7f7e4c19e260 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7e44004800 tx=0x7f7e44009580 comp rx=0 tx=0).stop 2023-10-16T13:12:40.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.682+0000 7f7e53aa9700 1 -- 172.21.15.92:0/793436004 shutdown_connections 2023-10-16T13:12:40.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.682+0000 7f7e53aa9700 1 --2- 172.21.15.92:0/793436004 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7e340a1510 0x7f7e340a39d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.682+0000 7f7e53aa9700 1 --2- 172.21.15.92:0/793436004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e4c102a10 0x7f7e4c19e260 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.682+0000 7f7e53aa9700 1 --2- 172.21.15.92:0/793436004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e4c100e70 0x7f7e4c196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.682+0000 7f7e53aa9700 1 --2- 172.21.15.92:0/793436004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e4c102050 0x7f7e4c197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.682+0000 7f7e53aa9700 1 -- 172.21.15.92:0/793436004 >> 172.21.15.92:0/793436004 conn(0x7f7e4c0fc430 msgr2=0x7f7e4c0fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:40.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.682+0000 7f7e53aa9700 1 -- 172.21.15.92:0/793436004 shutdown_connections 2023-10-16T13:12:40.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.682+0000 7f7e53aa9700 1 -- 172.21.15.92:0/793436004 wait complete. 2023-10-16T13:12:40.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:40 smithi152 ceph-mon[104423]: pgmap v287: 97 pgs: 2 peering, 95 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s; 126 B/s, 1 keys/s, 1 objects/s recovering 2023-10-16T13:12:40.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:40 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3911164689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:12:40.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:40 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:12:40.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:40 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3483806084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:12:40.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:40 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3205972927' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:12:40.697 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:40 smithi092 ceph-mon[99542]: pgmap v287: 97 pgs: 2 peering, 95 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s; 126 B/s, 1 keys/s, 1 objects/s recovering 2023-10-16T13:12:40.697 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:40 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3911164689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:12:40.697 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:40 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:12:40.697 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:40 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3483806084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:12:40.697 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:40 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3205972927' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:12:40.699 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:12:40.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:40 smithi118 ceph-mon[103969]: pgmap v287: 97 pgs: 2 peering, 95 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s; 126 B/s, 1 keys/s, 1 objects/s recovering 2023-10-16T13:12:40.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:40 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3911164689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:12:40.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:40 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:12:40.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:40 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3483806084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:12:40.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:40 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3205972927' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:12:40.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.822+0000 7fbe26a05700 1 -- 172.21.15.92:0/1739677894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe20102a10 msgr2=0x7fbe20109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:40.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.822+0000 7fbe26a05700 1 --2- 172.21.15.92:0/1739677894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe20102a10 0x7fbe20109330 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800b0a0 tx=0x7fbe1800b3b0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.822+0000 7fbe26a05700 1 -- 172.21.15.92:0/1739677894 shutdown_connections 2023-10-16T13:12:40.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.822+0000 7fbe26a05700 1 --2- 172.21.15.92:0/1739677894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe20102a10 0x7fbe20109330 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.822+0000 7fbe26a05700 1 --2- 172.21.15.92:0/1739677894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe20100e70 0x7fbe20101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.822+0000 7fbe26a05700 1 --2- 172.21.15.92:0/1739677894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe20102050 0x7fbe201024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.822+0000 7fbe26a05700 1 -- 172.21.15.92:0/1739677894 >> 172.21.15.92:0/1739677894 conn(0x7fbe200fc3f0 msgr2=0x7fbe200fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:40.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.822+0000 7fbe26a05700 1 -- 172.21.15.92:0/1739677894 shutdown_connections 2023-10-16T13:12:40.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.822+0000 7fbe26a05700 1 -- 172.21.15.92:0/1739677894 wait complete. 2023-10-16T13:12:40.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe26a05700 1 Processor -- start 2023-10-16T13:12:40.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe26a05700 1 -- start start 2023-10-16T13:12:40.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe26a05700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe20100e70 0x7fbe20074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:40.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe26a05700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe20102050 0x7fbe200732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:40.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe26a05700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe20102a10 0x7fbe200737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:40.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe26a05700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe20073f80 con 0x7fbe20102050 2023-10-16T13:12:40.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe26a05700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe200740f0 con 0x7fbe20100e70 2023-10-16T13:12:40.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe26a05700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe201a0e50 con 0x7fbe20102a10 2023-10-16T13:12:40.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe17fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe20102050 0x7fbe200732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:40.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe17fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe20102050 0x7fbe200732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35990/0 (socket says 172.21.15.92:35990) 2023-10-16T13:12:40.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe17fff700 1 -- 172.21.15.92:0/118956950 learned_addr learned my addr 172.21.15.92:0/118956950 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:40.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe1ffff700 1 --2- 172.21.15.92:0/118956950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe20100e70 0x7fbe20074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:40.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe24fa2700 1 --2- 172.21.15.92:0/118956950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe20102a10 0x7fbe200737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:40.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe17fff700 1 -- 172.21.15.92:0/118956950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe20102a10 msgr2=0x7fbe200737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:40.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe17fff700 1 --2- 172.21.15.92:0/118956950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe20102a10 0x7fbe200737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe17fff700 1 -- 172.21.15.92:0/118956950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe20100e70 msgr2=0x7fbe20074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:40.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe17fff700 1 --2- 172.21.15.92:0/118956950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe20100e70 0x7fbe20074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:40.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe17fff700 1 -- 172.21.15.92:0/118956950 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe18009d00 con 0x7fbe20102050 2023-10-16T13:12:40.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe24fa2700 1 --2- 172.21.15.92:0/118956950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe20102a10 0x7fbe200737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:12:40.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.823+0000 7fbe17fff700 1 --2- 172.21.15.92:0/118956950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe20102050 0x7fbe200732a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbe0800d980 tx=0x7fbe0800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:40.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.824+0000 7fbe1dffb700 1 -- 172.21.15.92:0/118956950 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0800b950 con 0x7fbe20102050 2023-10-16T13:12:40.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.824+0000 7fbe26a05700 1 -- 172.21.15.92:0/118956950 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe201a1130 con 0x7fbe20102050 2023-10-16T13:12:40.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.824+0000 7fbe1dffb700 1 -- 172.21.15.92:0/118956950 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbe08007620 con 0x7fbe20102050 2023-10-16T13:12:40.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.824+0000 7fbe1dffb700 1 -- 172.21.15.92:0/118956950 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0800f620 con 0x7fbe20102050 2023-10-16T13:12:40.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.824+0000 7fbe26a05700 1 -- 172.21.15.92:0/118956950 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe201a1640 con 0x7fbe20102050 2023-10-16T13:12:40.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.825+0000 7fbe26a05700 1 -- 172.21.15.92:0/118956950 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe201083e0 con 0x7fbe20102050 2023-10-16T13:12:40.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.826+0000 7fbe1dffb700 1 -- 172.21.15.92:0/118956950 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fbe080106f0 con 0x7fbe20102050 2023-10-16T13:12:40.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.826+0000 7fbe1dffb700 1 --2- 172.21.15.92:0/118956950 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fbe0c0a1510 0x7fbe0c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:40.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.827+0000 7fbe1ffff700 1 --2- 172.21.15.92:0/118956950 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fbe0c0a1510 0x7fbe0c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:40.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.827+0000 7fbe1dffb700 1 -- 172.21.15.92:0/118956950 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fbe080ccc80 con 0x7fbe20102050 2023-10-16T13:12:40.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.827+0000 7fbe1ffff700 1 --2- 172.21.15.92:0/118956950 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fbe0c0a1510 0x7fbe0c0a39d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbe20101bc0 tx=0x7fbe10009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:40.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:40.831+0000 7fbe1dffb700 1 -- 172.21.15.92:0/118956950 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbe08096180 con 0x7fbe20102050 2023-10-16T13:12:41.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.035+0000 7fbe26a05700 1 -- 172.21.15.92:0/118956950 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbe2002cf70 con 0x7fbe20102050 2023-10-16T13:12:41.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.035+0000 7fbe1dffb700 1 -- 172.21.15.92:0/118956950 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbe080997a0 con 0x7fbe20102050 2023-10-16T13:12:41.039 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-10-16T13:12:41.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.038+0000 7fbe26a05700 1 -- 172.21.15.92:0/118956950 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fbe0c0a1510 msgr2=0x7fbe0c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:41.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.038+0000 7fbe26a05700 1 --2- 172.21.15.92:0/118956950 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fbe0c0a1510 0x7fbe0c0a39d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbe20101bc0 tx=0x7fbe10009260 comp rx=0 tx=0).stop 2023-10-16T13:12:41.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.038+0000 7fbe26a05700 1 -- 172.21.15.92:0/118956950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe20102050 msgr2=0x7fbe200732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:41.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.038+0000 7fbe26a05700 1 --2- 172.21.15.92:0/118956950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe20102050 0x7fbe200732a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbe0800d980 tx=0x7fbe0800dc90 comp rx=0 tx=0).stop 2023-10-16T13:12:41.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.038+0000 7fbe26a05700 1 -- 172.21.15.92:0/118956950 shutdown_connections 2023-10-16T13:12:41.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.038+0000 7fbe26a05700 1 --2- 172.21.15.92:0/118956950 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fbe0c0a1510 0x7fbe0c0a39d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.038+0000 7fbe26a05700 1 --2- 172.21.15.92:0/118956950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe20102a10 0x7fbe200737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.038+0000 7fbe26a05700 1 --2- 172.21.15.92:0/118956950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe20100e70 0x7fbe20074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.038+0000 7fbe26a05700 1 --2- 172.21.15.92:0/118956950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe20102050 0x7fbe200732a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.038+0000 7fbe26a05700 1 -- 172.21.15.92:0/118956950 >> 172.21.15.92:0/118956950 conn(0x7fbe200fc3f0 msgr2=0x7fbe20105520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:41.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.038+0000 7fbe26a05700 1 -- 172.21.15.92:0/118956950 shutdown_connections 2023-10-16T13:12:41.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.038+0000 7fbe26a05700 1 -- 172.21.15.92:0/118956950 wait complete. 2023-10-16T13:12:41.054 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:12:41.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.179+0000 7f46ac5f4700 1 -- 172.21.15.92:0/1466336434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a41009e0 msgr2=0x7f46a4108280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:41.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.179+0000 7f46ac5f4700 1 --2- 172.21.15.92:0/1466336434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a41009e0 0x7f46a4108280 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f469c00b0a0 tx=0x7f469c00b3b0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.179+0000 7f46ac5f4700 1 -- 172.21.15.92:0/1466336434 shutdown_connections 2023-10-16T13:12:41.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.179+0000 7f46ac5f4700 1 --2- 172.21.15.92:0/1466336434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a41009e0 0x7f46a4108280 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.179+0000 7f46ac5f4700 1 --2- 172.21.15.92:0/1466336434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46a4101460 0x7f46a4101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.179+0000 7f46ac5f4700 1 --2- 172.21.15.92:0/1466336434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46a4100020 0x7f46a41004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.179+0000 7f46ac5f4700 1 -- 172.21.15.92:0/1466336434 >> 172.21.15.92:0/1466336434 conn(0x7f46a40faab0 msgr2=0x7f46a40fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:41.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.179+0000 7f46ac5f4700 1 -- 172.21.15.92:0/1466336434 shutdown_connections 2023-10-16T13:12:41.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.179+0000 7f46ac5f4700 1 -- 172.21.15.92:0/1466336434 wait complete. 2023-10-16T13:12:41.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.180+0000 7f46ac5f4700 1 Processor -- start 2023-10-16T13:12:41.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.180+0000 7f46ac5f4700 1 -- start start 2023-10-16T13:12:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.180+0000 7f46ac5f4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46a4100020 0x7f46a40ffaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.180+0000 7f46ac5f4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46a41009e0 0x7f46a419b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.180+0000 7f46ac5f4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a4101460 0x7f46a419e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.180+0000 7f46ac5f4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a419e800 con 0x7f46a4101460 2023-10-16T13:12:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.180+0000 7f46ac5f4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a419e970 con 0x7f46a4100020 2023-10-16T13:12:41.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.180+0000 7f46ac5f4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a419eb30 con 0x7f46a41009e0 2023-10-16T13:12:41.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.180+0000 7f46aab91700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a4101460 0x7f46a419e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:41.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.180+0000 7f46aab91700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a4101460 0x7f46a419e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36004/0 (socket says 172.21.15.92:36004) 2023-10-16T13:12:41.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.180+0000 7f46aab91700 1 -- 172.21.15.92:0/2989447795 learned_addr learned my addr 172.21.15.92:0/2989447795 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:41.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.180+0000 7f46aa390700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46a4100020 0x7f46a40ffaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:41.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.180+0000 7f46a9b8f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46a41009e0 0x7f46a419b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:41.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.180+0000 7f46aab91700 1 -- 172.21.15.92:0/2989447795 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46a41009e0 msgr2=0x7f46a419b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:41.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.180+0000 7f46aab91700 1 --2- 172.21.15.92:0/2989447795 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46a41009e0 0x7f46a419b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.180+0000 7f46aab91700 1 -- 172.21.15.92:0/2989447795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46a4100020 msgr2=0x7f46a40ffaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:41.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.180+0000 7f46aab91700 1 --2- 172.21.15.92:0/2989447795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46a4100020 0x7f46a40ffaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.180+0000 7f46aab91700 1 -- 172.21.15.92:0/2989447795 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c009d00 con 0x7f46a4101460 2023-10-16T13:12:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.180+0000 7f46aab91700 1 --2- 172.21.15.92:0/2989447795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a4101460 0x7f46a419e030 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f469c0062a0 tx=0x7f469c0094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.181+0000 7f469b7fe700 1 -- 172.21.15.92:0/2989447795 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c00e040 con 0x7f46a4101460 2023-10-16T13:12:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.181+0000 7f469b7fe700 1 -- 172.21.15.92:0/2989447795 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f469c01d960 con 0x7f46a4101460 2023-10-16T13:12:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.181+0000 7f46ac5f4700 1 -- 172.21.15.92:0/2989447795 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a419edb0 con 0x7f46a4101460 2023-10-16T13:12:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.181+0000 7f469b7fe700 1 -- 172.21.15.92:0/2989447795 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c01bb70 con 0x7f46a4101460 2023-10-16T13:12:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.181+0000 7f46ac5f4700 1 -- 172.21.15.92:0/2989447795 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a419f1d0 con 0x7f46a4101460 2023-10-16T13:12:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.182+0000 7f46ac5f4700 1 -- 172.21.15.92:0/2989447795 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a410b770 con 0x7f46a4101460 2023-10-16T13:12:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.183+0000 7f469b7fe700 1 -- 172.21.15.92:0/2989447795 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f469c01bcd0 con 0x7f46a4101460 2023-10-16T13:12:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.183+0000 7f469b7fe700 1 --2- 172.21.15.92:0/2989447795 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f46900a15c0 0x7f46900a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:41.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.183+0000 7f46aa390700 1 --2- 172.21.15.92:0/2989447795 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f46900a15c0 0x7f46900a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:41.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.183+0000 7f469b7fe700 1 -- 172.21.15.92:0/2989447795 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f469c0cef90 con 0x7f46a4101460 2023-10-16T13:12:41.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.184+0000 7f46aa390700 1 --2- 172.21.15.92:0/2989447795 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f46900a15c0 0x7f46900a3a80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4694005950 tx=0x7f469400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:41.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.187+0000 7f469b7fe700 1 -- 172.21.15.92:0/2989447795 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f469c098520 con 0x7f46a4101460 2023-10-16T13:12:41.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.434+0000 7f46ac5f4700 1 -- 172.21.15.92:0/2989447795 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46a4106c10 con 0x7f46a4101460 2023-10-16T13:12:41.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.435+0000 7f469b7fe700 1 -- 172.21.15.92:0/2989447795 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11379 (secure 0 0 0) 0x7f469c01de60 con 0x7f46a4101460 2023-10-16T13:12:41.439 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:12:41.439 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-16T13:11:40.343309+0000","modified":"2023-10-16T13:11:48.346678+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24460,"mds_3":24428,"mds_4":24412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1790514945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1790514945},{"type":"v1","addr":"172.21.15.92:6839","nonce":1790514945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/1016260236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1016260236},{"type":"v1","addr":"172.21.15.92:6841","nonce":1016260236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24410":{"gid":24410,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/2133613540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":2133613540},{"type":"v1","addr":"172.21.15.118:6837","nonce":2133613540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6837/2403096460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":2403096460},{"type":"v1","addr":"172.21.15.152:6837","nonce":2403096460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1821921588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1821921588},{"type":"v1","addr":"172.21.15.152:6839","nonce":1821921588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6839/1577355936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":1577355936},{"type":"v1","addr":"172.21.15.118:6839","nonce":1577355936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:12:41.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.438+0000 7f46ac5f4700 1 -- 172.21.15.92:0/2989447795 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f46900a15c0 msgr2=0x7f46900a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:41.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.438+0000 7f46ac5f4700 1 --2- 172.21.15.92:0/2989447795 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f46900a15c0 0x7f46900a3a80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4694005950 tx=0x7f469400b410 comp rx=0 tx=0).stop 2023-10-16T13:12:41.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.438+0000 7f46ac5f4700 1 -- 172.21.15.92:0/2989447795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a4101460 msgr2=0x7f46a419e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:41.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.438+0000 7f46ac5f4700 1 --2- 172.21.15.92:0/2989447795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a4101460 0x7f46a419e030 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f469c0062a0 tx=0x7f469c0094c0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.438+0000 7f46ac5f4700 1 -- 172.21.15.92:0/2989447795 shutdown_connections 2023-10-16T13:12:41.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.438+0000 7f46ac5f4700 1 --2- 172.21.15.92:0/2989447795 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f46900a15c0 0x7f46900a3a80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.438+0000 7f46ac5f4700 1 --2- 172.21.15.92:0/2989447795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a4101460 0x7f46a419e030 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.438+0000 7f46ac5f4700 1 --2- 172.21.15.92:0/2989447795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46a4100020 0x7f46a40ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.438+0000 7f46ac5f4700 1 --2- 172.21.15.92:0/2989447795 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46a41009e0 0x7f46a419b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.438+0000 7f46ac5f4700 1 -- 172.21.15.92:0/2989447795 >> 172.21.15.92:0/2989447795 conn(0x7f46a40faab0 msgr2=0x7f46a40fcc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:41.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.438+0000 7f46ac5f4700 1 -- 172.21.15.92:0/2989447795 shutdown_connections 2023-10-16T13:12:41.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.438+0000 7f46ac5f4700 1 -- 172.21.15.92:0/2989447795 wait complete. 2023-10-16T13:12:41.443 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 27 2023-10-16T13:12:41.456 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:12:41.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.579+0000 7fb4c3c35700 1 -- 172.21.15.92:0/131769461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4bc100fe0 msgr2=0x7fb4bc101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:41.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.579+0000 7fb4c3c35700 1 --2- 172.21.15.92:0/131769461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4bc100fe0 0x7fb4bc101440 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0099c0 tx=0x7fb4ac009cd0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.579+0000 7fb4c3c35700 1 -- 172.21.15.92:0/131769461 shutdown_connections 2023-10-16T13:12:41.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.579+0000 7fb4c3c35700 1 --2- 172.21.15.92:0/131769461 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4bc101980 0x7fb4bc108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.579+0000 7fb4c3c35700 1 --2- 172.21.15.92:0/131769461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4bc0ffdf0 0x7fb4bc100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.579+0000 7fb4c3c35700 1 --2- 172.21.15.92:0/131769461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4bc100fe0 0x7fb4bc101440 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.579+0000 7fb4c3c35700 1 -- 172.21.15.92:0/131769461 >> 172.21.15.92:0/131769461 conn(0x7fb4bc0fb320 msgr2=0x7fb4bc0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:41.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.579+0000 7fb4c3c35700 1 -- 172.21.15.92:0/131769461 shutdown_connections 2023-10-16T13:12:41.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.579+0000 7fb4c3c35700 1 -- 172.21.15.92:0/131769461 wait complete. 2023-10-16T13:12:41.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.580+0000 7fb4c3c35700 1 Processor -- start 2023-10-16T13:12:41.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.580+0000 7fb4c3c35700 1 -- start start 2023-10-16T13:12:41.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.580+0000 7fb4c3c35700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4bc0ffdf0 0x7fb4bc196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:41.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.580+0000 7fb4c3c35700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4bc100fe0 0x7fb4bc1970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:41.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.580+0000 7fb4c3c35700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4bc101980 0x7fb4bc19e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:41.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.580+0000 7fb4c3c35700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc19e700 con 0x7fb4bc101980 2023-10-16T13:12:41.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.580+0000 7fb4c3c35700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc19e840 con 0x7fb4bc100fe0 2023-10-16T13:12:41.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.580+0000 7fb4c3c35700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc19e9d0 con 0x7fb4bc0ffdf0 2023-10-16T13:12:41.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.580+0000 7fb4c21d2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4bc101980 0x7fb4bc19e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:41.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.580+0000 7fb4c21d2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4bc101980 0x7fb4bc19e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36018/0 (socket says 172.21.15.92:36018) 2023-10-16T13:12:41.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.580+0000 7fb4c21d2700 1 -- 172.21.15.92:0/3536317382 learned_addr learned my addr 172.21.15.92:0/3536317382 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:41.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.580+0000 7fb4c11d0700 1 --2- 172.21.15.92:0/3536317382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4bc100fe0 0x7fb4bc1970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:41.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.580+0000 7fb4c21d2700 1 -- 172.21.15.92:0/3536317382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4bc0ffdf0 msgr2=0x7fb4bc196b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:41.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.580+0000 7fb4c21d2700 1 --2- 172.21.15.92:0/3536317382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4bc0ffdf0 0x7fb4bc196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.580+0000 7fb4c21d2700 1 -- 172.21.15.92:0/3536317382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4bc100fe0 msgr2=0x7fb4bc1970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:41.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.580+0000 7fb4c21d2700 1 --2- 172.21.15.92:0/3536317382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4bc100fe0 0x7fb4bc1970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.580+0000 7fb4c21d2700 1 -- 172.21.15.92:0/3536317382 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac0095f0 con 0x7fb4bc101980 2023-10-16T13:12:41.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.581+0000 7fb4c21d2700 1 --2- 172.21.15.92:0/3536317382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4bc101980 0x7fb4bc19e130 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400ef30 tx=0x7fb4b400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:41.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.581+0000 7fb4b2ffd700 1 -- 172.21.15.92:0/3536317382 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4018070 con 0x7fb4bc101980 2023-10-16T13:12:41.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.581+0000 7fb4b2ffd700 1 -- 172.21.15.92:0/3536317382 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb4b400f040 con 0x7fb4bc101980 2023-10-16T13:12:41.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.581+0000 7fb4c3c35700 1 -- 172.21.15.92:0/3536317382 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4bc19ec50 con 0x7fb4bc101980 2023-10-16T13:12:41.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.581+0000 7fb4b2ffd700 1 -- 172.21.15.92:0/3536317382 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4004020 con 0x7fb4bc101980 2023-10-16T13:12:41.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.581+0000 7fb4c3c35700 1 -- 172.21.15.92:0/3536317382 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4bc19f160 con 0x7fb4bc101980 2023-10-16T13:12:41.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.582+0000 7fb4c3c35700 1 -- 172.21.15.92:0/3536317382 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4bc10b740 con 0x7fb4bc101980 2023-10-16T13:12:41.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.584+0000 7fb4b2ffd700 1 -- 172.21.15.92:0/3536317382 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fb4b4004ad0 con 0x7fb4bc101980 2023-10-16T13:12:41.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.584+0000 7fb4b2ffd700 1 --2- 172.21.15.92:0/3536317382 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb4a80a1640 0x7fb4a80a3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:41.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.584+0000 7fb4c19d1700 1 --2- 172.21.15.92:0/3536317382 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb4a80a1640 0x7fb4a80a3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:41.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.584+0000 7fb4b2ffd700 1 -- 172.21.15.92:0/3536317382 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb4b40cca10 con 0x7fb4bc101980 2023-10-16T13:12:41.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.585+0000 7fb4c19d1700 1 --2- 172.21.15.92:0/3536317382 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb4a80a1640 0x7fb4a80a3b00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc100e40 tx=0x7fb4b8009470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:41.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.589+0000 7fb4b2ffd700 1 -- 172.21.15.92:0/3536317382 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb4b4095fa0 con 0x7fb4bc101980 2023-10-16T13:12:41.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:41 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/793436004' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:12:41.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:41 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/118956950' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:12:41.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:41 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/793436004' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:12:41.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:41 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/118956950' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:12:41.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:41 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/793436004' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:12:41.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:41 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/118956950' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:12:41.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.791+0000 7fb4c3c35700 1 -- 172.21.15.92:0/3536317382 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4bc19f2f0 con 0x7fb4bc101980 2023-10-16T13:12:41.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.792+0000 7fb4b2ffd700 1 -- 172.21.15.92:0/3536317382 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22598 (secure 0 0 0) 0x7fb4b40995c0 con 0x7fb4bc101980 2023-10-16T13:12:41.796 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:12:41.796 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":85,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:12:36.335213+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:11:38.345035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:11:39.549912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:12:41.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.794+0000 7fb4c3c35700 1 -- 172.21.15.92:0/3536317382 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb4a80a1640 msgr2=0x7fb4a80a3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:41.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.794+0000 7fb4c3c35700 1 --2- 172.21.15.92:0/3536317382 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb4a80a1640 0x7fb4a80a3b00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc100e40 tx=0x7fb4b8009470 comp rx=0 tx=0).stop 2023-10-16T13:12:41.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.794+0000 7fb4c3c35700 1 -- 172.21.15.92:0/3536317382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4bc101980 msgr2=0x7fb4bc19e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:41.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.794+0000 7fb4c3c35700 1 --2- 172.21.15.92:0/3536317382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4bc101980 0x7fb4bc19e130 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400ef30 tx=0x7fb4b400c3a0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.794+0000 7fb4c3c35700 1 -- 172.21.15.92:0/3536317382 shutdown_connections 2023-10-16T13:12:41.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.794+0000 7fb4c3c35700 1 --2- 172.21.15.92:0/3536317382 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb4a80a1640 0x7fb4a80a3b00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.794+0000 7fb4c3c35700 1 --2- 172.21.15.92:0/3536317382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4bc101980 0x7fb4bc19e130 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.794+0000 7fb4c3c35700 1 --2- 172.21.15.92:0/3536317382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4bc0ffdf0 0x7fb4bc196b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.794+0000 7fb4c3c35700 1 --2- 172.21.15.92:0/3536317382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4bc100fe0 0x7fb4bc1970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.794+0000 7fb4c3c35700 1 -- 172.21.15.92:0/3536317382 >> 172.21.15.92:0/3536317382 conn(0x7fb4bc0fb320 msgr2=0x7fb4bc069050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:41.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.794+0000 7fb4c3c35700 1 -- 172.21.15.92:0/3536317382 shutdown_connections 2023-10-16T13:12:41.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.794+0000 7fb4c3c35700 1 -- 172.21.15.92:0/3536317382 wait complete. 2023-10-16T13:12:41.809 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:12:41.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.940+0000 7f7da4e28700 1 -- 172.21.15.92:0/2735396009 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7da0101950 msgr2=0x7f7da0103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:41.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.940+0000 7f7da4e28700 1 --2- 172.21.15.92:0/2735396009 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7da0101950 0x7f7da0103d40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009990 tx=0x7f7d94009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.941+0000 7f7da4e28700 1 -- 172.21.15.92:0/2735396009 shutdown_connections 2023-10-16T13:12:41.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.941+0000 7f7da4e28700 1 --2- 172.21.15.92:0/2735396009 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7da0101950 0x7f7da0103d40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.941+0000 7f7da4e28700 1 --2- 172.21.15.92:0/2735396009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7da0106bb0 0x7f7da0109020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.941+0000 7f7da4e28700 1 --2- 172.21.15.92:0/2735396009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7da0104280 0x7f7da0106670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.941+0000 7f7da4e28700 1 -- 172.21.15.92:0/2735396009 >> 172.21.15.92:0/2735396009 conn(0x7f7da00fb320 msgr2=0x7f7da00fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:41.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.941+0000 7f7da4e28700 1 -- 172.21.15.92:0/2735396009 shutdown_connections 2023-10-16T13:12:41.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.941+0000 7f7da4e28700 1 -- 172.21.15.92:0/2735396009 wait complete. 2023-10-16T13:12:41.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.941+0000 7f7da4e28700 1 Processor -- start 2023-10-16T13:12:41.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.941+0000 7f7da4e28700 1 -- start start 2023-10-16T13:12:41.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7da4e28700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7da0101950 0x7f7da0196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:41.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7da4e28700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7da0104280 0x7f7da01970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:41.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7da4e28700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7da0106bb0 0x7f7da019e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:41.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7da4e28700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da019e720 con 0x7f7da0101950 2023-10-16T13:12:41.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7da4e28700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da019e860 con 0x7f7da0104280 2023-10-16T13:12:41.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7da4e28700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da019e9f0 con 0x7f7da0106bb0 2023-10-16T13:12:41.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7d9e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7da0101950 0x7f7da0196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:41.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7d9e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7da0101950 0x7f7da0196ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36026/0 (socket says 172.21.15.92:36026) 2023-10-16T13:12:41.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7d9e59c700 1 -- 172.21.15.92:0/3006035730 learned_addr learned my addr 172.21.15.92:0/3006035730 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:41.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7d9dd9b700 1 --2- 172.21.15.92:0/3006035730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7da0104280 0x7f7da01970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:41.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7d9ed9d700 1 --2- 172.21.15.92:0/3006035730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7da0106bb0 0x7f7da019e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:41.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7d9e59c700 1 -- 172.21.15.92:0/3006035730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7da0106bb0 msgr2=0x7f7da019e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:41.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7d9e59c700 1 --2- 172.21.15.92:0/3006035730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7da0106bb0 0x7f7da019e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7d9e59c700 1 -- 172.21.15.92:0/3006035730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7da0104280 msgr2=0x7f7da01970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:41.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7d9e59c700 1 --2- 172.21.15.92:0/3006035730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7da0104280 0x7f7da01970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:41.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7d9e59c700 1 -- 172.21.15.92:0/3006035730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d940095f0 con 0x7f7da0101950 2023-10-16T13:12:41.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7d9e59c700 1 --2- 172.21.15.92:0/3006035730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7da0101950 0x7f7da0196ba0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7d940059d0 tx=0x7f7d9400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:41.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7d8f7fe700 1 -- 172.21.15.92:0/3006035730 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9401d070 con 0x7f7da0101950 2023-10-16T13:12:41.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7d8f7fe700 1 -- 172.21.15.92:0/3006035730 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7d9400fe20 con 0x7f7da0101950 2023-10-16T13:12:41.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7d8f7fe700 1 -- 172.21.15.92:0/3006035730 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d94017650 con 0x7f7da0101950 2023-10-16T13:12:41.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7da4e28700 1 -- 172.21.15.92:0/3006035730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da019ec70 con 0x7f7da0101950 2023-10-16T13:12:41.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.942+0000 7f7da4e28700 1 -- 172.21.15.92:0/3006035730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da019f040 con 0x7f7da0101950 2023-10-16T13:12:41.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.943+0000 7f7da4e28700 1 -- 172.21.15.92:0/3006035730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da00fcea0 con 0x7f7da0101950 2023-10-16T13:12:41.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.944+0000 7f7d8f7fe700 1 -- 172.21.15.92:0/3006035730 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f7d940229e0 con 0x7f7da0101950 2023-10-16T13:12:41.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.945+0000 7f7d8f7fe700 1 --2- 172.21.15.92:0/3006035730 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7d880a15c0 0x7f7d880a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:41.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.945+0000 7f7d9dd9b700 1 --2- 172.21.15.92:0/3006035730 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7d880a15c0 0x7f7d880a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:41.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.945+0000 7f7d8f7fe700 1 -- 172.21.15.92:0/3006035730 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f7d940ce370 con 0x7f7da0101950 2023-10-16T13:12:41.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.945+0000 7f7d9dd9b700 1 --2- 172.21.15.92:0/3006035730 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7d880a15c0 0x7f7d880a3a80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7d90007c60 tx=0x7f7d900073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:41.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:41.950+0000 7f7d8f7fe700 1 -- 172.21.15.92:0/3006035730 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7d9405d100 con 0x7f7da0101950 2023-10-16T13:12:42.203 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.202+0000 7f7da4e28700 1 -- 172.21.15.92:0/3006035730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7da002d020 con 0x7f7da0101950 2023-10-16T13:12:42.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.202+0000 7f7d8f7fe700 1 -- 172.21.15.92:0/3006035730 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11379 (secure 0 0 0) 0x7f7d94097900 con 0x7f7da0101950 2023-10-16T13:12:42.204 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:12:42.205 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-16T13:11:40.343309+0000","modified":"2023-10-16T13:11:48.346678+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24460,"mds_3":24428,"mds_4":24412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1790514945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1790514945},{"type":"v1","addr":"172.21.15.92:6839","nonce":1790514945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/1016260236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1016260236},{"type":"v1","addr":"172.21.15.92:6841","nonce":1016260236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24410":{"gid":24410,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/2133613540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":2133613540},{"type":"v1","addr":"172.21.15.118:6837","nonce":2133613540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6837/2403096460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":2403096460},{"type":"v1","addr":"172.21.15.152:6837","nonce":2403096460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1821921588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1821921588},{"type":"v1","addr":"172.21.15.152:6839","nonce":1821921588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6839/1577355936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":1577355936},{"type":"v1","addr":"172.21.15.118:6839","nonce":1577355936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:12:42.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.204+0000 7f7da4e28700 1 -- 172.21.15.92:0/3006035730 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7d880a15c0 msgr2=0x7f7d880a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.204+0000 7f7da4e28700 1 --2- 172.21.15.92:0/3006035730 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7d880a15c0 0x7f7d880a3a80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7d90007c60 tx=0x7f7d900073d0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.204+0000 7f7da4e28700 1 -- 172.21.15.92:0/3006035730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7da0101950 msgr2=0x7f7da0196ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.204+0000 7f7da4e28700 1 --2- 172.21.15.92:0/3006035730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7da0101950 0x7f7da0196ba0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7d940059d0 tx=0x7f7d9400f690 comp rx=0 tx=0).stop 2023-10-16T13:12:42.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.205+0000 7f7da4e28700 1 -- 172.21.15.92:0/3006035730 shutdown_connections 2023-10-16T13:12:42.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.205+0000 7f7da4e28700 1 --2- 172.21.15.92:0/3006035730 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7d880a15c0 0x7f7d880a3a80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.205+0000 7f7da4e28700 1 --2- 172.21.15.92:0/3006035730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7da0101950 0x7f7da0196ba0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.205+0000 7f7da4e28700 1 --2- 172.21.15.92:0/3006035730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7da0106bb0 0x7f7da019e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.205+0000 7f7da4e28700 1 --2- 172.21.15.92:0/3006035730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7da0104280 0x7f7da01970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.205+0000 7f7da4e28700 1 -- 172.21.15.92:0/3006035730 >> 172.21.15.92:0/3006035730 conn(0x7f7da00fb320 msgr2=0x7f7da01025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:42.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.205+0000 7f7da4e28700 1 -- 172.21.15.92:0/3006035730 shutdown_connections 2023-10-16T13:12:42.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.205+0000 7f7da4e28700 1 -- 172.21.15.92:0/3006035730 wait complete. 2023-10-16T13:12:42.209 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 27 2023-10-16T13:12:42.219 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-16T13:11:40.343309+0000', 'modified': '2023-10-16T13:11:48.346678+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24491, 'mds_1': 24490, 'mds_2': 24460, 'mds_3': 24428, 'mds_4': 24412}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14613': {'gid': 14613, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6839/1790514945', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6838', 'nonce': 1790514945}, {'type': 'v1', 'addr': '172.21.15.92:6839', 'nonce': 1790514945}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14625': {'gid': 14625, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6841/1016260236', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6840', 'nonce': 1016260236}, {'type': 'v1', 'addr': '172.21.15.92:6841', 'nonce': 1016260236}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24410': {'gid': 24410, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.118:6833/1243983806', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6832', 'nonce': 1243983806}, {'type': 'v1', 'addr': '172.21.15.118:6833', 'nonce': 1243983806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24412': {'gid': 24412, 'name': 'l', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.152:6833/1273074399', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 1273074399}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 1273074399}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24428': {'gid': 24428, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.118:6835/2381374755', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6834', 'nonce': 2381374755}, {'type': 'v1', 'addr': '172.21.15.118:6835', 'nonce': 2381374755}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24460': {'gid': 24460, 'name': 'f', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.152:6835/1393840132', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6834', 'nonce': 1393840132}, {'type': 'v1', 'addr': '172.21.15.152:6835', 'nonce': 1393840132}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.118:6837/2133613540', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6836', 'nonce': 2133613540}, {'type': 'v1', 'addr': '172.21.15.118:6837', 'nonce': 2133613540}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24472': {'gid': 24472, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.152:6837/2403096460', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6836', 'nonce': 2403096460}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 2403096460}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.152:6839/1821921588', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6838', 'nonce': 1821921588}, {'type': 'v1', 'addr': '172.21.15.152:6839', 'nonce': 1821921588}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24491': {'gid': 24491, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6839/1577355936', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6838', 'nonce': 1577355936}, {'type': 'v1', 'addr': '172.21.15.118:6839', 'nonce': 1577355936}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T13:12:42.219 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-16T13:12:42.220 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2023-10-16T13:12:42.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.346+0000 7f0b9895a700 1 -- 172.21.15.92:0/580335705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b94106bb0 msgr2=0x7f0b94109020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.346+0000 7f0b9895a700 1 --2- 172.21.15.92:0/580335705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b94106bb0 0x7f0b94109020 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00b0a0 tx=0x7f0b8c00b3b0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.346+0000 7f0b9895a700 1 -- 172.21.15.92:0/580335705 shutdown_connections 2023-10-16T13:12:42.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.346+0000 7f0b9895a700 1 --2- 172.21.15.92:0/580335705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b94106bb0 0x7f0b94109020 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.346+0000 7f0b9895a700 1 --2- 172.21.15.92:0/580335705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b94101950 0x7f0b94103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.346+0000 7f0b9895a700 1 --2- 172.21.15.92:0/580335705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b94104280 0x7f0b94106670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.346+0000 7f0b9895a700 1 -- 172.21.15.92:0/580335705 >> 172.21.15.92:0/580335705 conn(0x7f0b940fb300 msgr2=0x7f0b940fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:42.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.346+0000 7f0b9895a700 1 -- 172.21.15.92:0/580335705 shutdown_connections 2023-10-16T13:12:42.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.346+0000 7f0b9895a700 1 -- 172.21.15.92:0/580335705 wait complete. 2023-10-16T13:12:42.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.347+0000 7f0b9895a700 1 Processor -- start 2023-10-16T13:12:42.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.347+0000 7f0b9895a700 1 -- start start 2023-10-16T13:12:42.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.347+0000 7f0b9895a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b94101950 0x7f0b94196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.347+0000 7f0b9895a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b94104280 0x7f0b941971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.347+0000 7f0b9895a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b94106bb0 0x7f0b9419e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.347+0000 7f0b9895a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9419e810 con 0x7f0b94106bb0 2023-10-16T13:12:42.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.347+0000 7f0b9895a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9419e980 con 0x7f0b94104280 2023-10-16T13:12:42.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.347+0000 7f0b9895a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9419eb40 con 0x7f0b94101950 2023-10-16T13:12:42.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.347+0000 7f0b92d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b94106bb0 0x7f0b9419e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.348+0000 7f0b91d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b94104280 0x7f0b941971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.348+0000 7f0b92d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b94106bb0 0x7f0b9419e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36044/0 (socket says 172.21.15.92:36044) 2023-10-16T13:12:42.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.348+0000 7f0b92d9d700 1 -- 172.21.15.92:0/1293217731 learned_addr learned my addr 172.21.15.92:0/1293217731 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:42.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.348+0000 7f0b9259c700 1 --2- 172.21.15.92:0/1293217731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b94101950 0x7f0b94196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.348+0000 7f0b92d9d700 1 -- 172.21.15.92:0/1293217731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b94101950 msgr2=0x7f0b94196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.348+0000 7f0b92d9d700 1 --2- 172.21.15.92:0/1293217731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b94101950 0x7f0b94196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.348+0000 7f0b92d9d700 1 -- 172.21.15.92:0/1293217731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b94104280 msgr2=0x7f0b941971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.348+0000 7f0b92d9d700 1 --2- 172.21.15.92:0/1293217731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b94104280 0x7f0b941971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.348+0000 7f0b92d9d700 1 -- 172.21.15.92:0/1293217731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c009d00 con 0x7f0b94106bb0 2023-10-16T13:12:42.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.348+0000 7f0b91d9b700 1 --2- 172.21.15.92:0/1293217731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b94104280 0x7f0b941971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:12:42.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.348+0000 7f0b92d9d700 1 --2- 172.21.15.92:0/1293217731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b94106bb0 0x7f0b9419e240 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00b780 tx=0x7f0b8c00bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:42.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.348+0000 7f0b837fe700 1 -- 172.21.15.92:0/1293217731 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c00e040 con 0x7f0b94106bb0 2023-10-16T13:12:42.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.348+0000 7f0b837fe700 1 -- 172.21.15.92:0/1293217731 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0b8c004e60 con 0x7f0b94106bb0 2023-10-16T13:12:42.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.348+0000 7f0b9895a700 1 -- 172.21.15.92:0/1293217731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b940ff740 con 0x7f0b94106bb0 2023-10-16T13:12:42.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.348+0000 7f0b837fe700 1 -- 172.21.15.92:0/1293217731 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c0053b0 con 0x7f0b94106bb0 2023-10-16T13:12:42.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.348+0000 7f0b9895a700 1 -- 172.21.15.92:0/1293217731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b940ffc00 con 0x7f0b94106bb0 2023-10-16T13:12:42.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.350+0000 7f0b837fe700 1 -- 172.21.15.92:0/1293217731 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f0b8c01d470 con 0x7f0b94106bb0 2023-10-16T13:12:42.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.351+0000 7f0b837fe700 1 --2- 172.21.15.92:0/1293217731 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0b7c0a1550 0x7f0b7c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.351+0000 7f0b9259c700 1 --2- 172.21.15.92:0/1293217731 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0b7c0a1550 0x7f0b7c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.351+0000 7f0b837fe700 1 -- 172.21.15.92:0/1293217731 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f0b8c0ce5a0 con 0x7f0b94106bb0 2023-10-16T13:12:42.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.352+0000 7f0b9259c700 1 --2- 172.21.15.92:0/1293217731 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0b7c0a1550 0x7f0b7c0a3a10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0b94197b70 tx=0x7f0b8400f820 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:42.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.352+0000 7f0ba4b44b80 1 Processor -- start 2023-10-16T13:12:42.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.352+0000 7f0ba4b44b80 1 -- start start 2023-10-16T13:12:42.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.352+0000 7f0ba4b44b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c703838dd0 0x55c7038391f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.352+0000 7f0ba4b44b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c703839730 0x55c703839ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.352+0000 7f0ba4b44b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c70383a5d0 0x55c70383aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.352+0000 7f0ba4b44b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7037adc20 con 0x55c703839730 2023-10-16T13:12:42.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.352+0000 7f0ba4b44b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c703792c10 con 0x55c70383a5d0 2023-10-16T13:12:42.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.352+0000 7f0ba4b44b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c703790530 con 0x55c703838dd0 2023-10-16T13:12:42.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.352+0000 7f0b91d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c703839730 0x55c703839ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.353+0000 7f0b91d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c703839730 0x55c703839ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36050/0 (socket says 172.21.15.92:36050) 2023-10-16T13:12:42.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.353+0000 7f0b91d9b700 1 -- 172.21.15.92:0/597145857 learned_addr learned my addr 172.21.15.92:0/597145857 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:42.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.353+0000 7f0b9259c700 1 --2- 172.21.15.92:0/597145857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c703838dd0 0x55c7038391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.353+0000 7f0b92d9d700 1 --2- 172.21.15.92:0/597145857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c70383a5d0 0x55c70383aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.353+0000 7f0b9259c700 1 -- 172.21.15.92:0/597145857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c70383a5d0 msgr2=0x55c70383aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.353+0000 7f0b9259c700 1 --2- 172.21.15.92:0/597145857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c70383a5d0 0x55c70383aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.353+0000 7f0b9259c700 1 -- 172.21.15.92:0/597145857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c703839730 msgr2=0x55c703839ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.353+0000 7f0b9259c700 1 --2- 172.21.15.92:0/597145857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c703839730 0x55c703839ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.353+0000 7f0b9259c700 1 -- 172.21.15.92:0/597145857 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7037493a0 con 0x55c703838dd0 2023-10-16T13:12:42.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.353+0000 7f0b91d9b700 1 --2- 172.21.15.92:0/597145857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c703839730 0x55c703839ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:12:42.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.353+0000 7f0b9259c700 1 --2- 172.21.15.92:0/597145857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c703838dd0 0x55c7038391f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0b84005950 tx=0x7f0b84017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96c084951780f83f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:42.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.353+0000 7f0b80ff9700 1 -- 172.21.15.92:0/597145857 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8401bd80 con 0x55c703838dd0 2023-10-16T13:12:42.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.353+0000 7f0b80ff9700 1 -- 172.21.15.92:0/597145857 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0b84015040 con 0x55c703838dd0 2023-10-16T13:12:42.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.353+0000 7f0b80ff9700 1 -- 172.21.15.92:0/597145857 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b84019700 con 0x55c703838dd0 2023-10-16T13:12:42.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.354+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/597145857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c703838dd0 msgr2=0x55c7038391f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.354+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/597145857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c703838dd0 0x55c7038391f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0b84005950 tx=0x7f0b84017000 comp rx=0 tx=0).stop 2023-10-16T13:12:42.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.354+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/597145857 shutdown_connections 2023-10-16T13:12:42.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.354+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/597145857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c70383a5d0 0x55c70383aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.354+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/597145857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c703838dd0 0x55c7038391f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.354+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/597145857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c703839730 0x55c703839ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.354+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/597145857 >> 172.21.15.92:0/597145857 conn(0x55c703766d80 msgr2=0x55c703833f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:42.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.356+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/597145857 shutdown_connections 2023-10-16T13:12:42.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.356+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/597145857 wait complete. 2023-10-16T13:12:42.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.357+0000 7f0ba4b44b80 1 -- start start 2023-10-16T13:12:42.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.357+0000 7f0ba4b44b80 1 Processor -- start 2023-10-16T13:12:42.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.357+0000 7f0ba4b44b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c703838dd0 0x55c703842c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.357+0000 7f0ba4b44b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c703839730 0x55c703843180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.357+0000 7f0ba4b44b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c70383a5d0 0x55c70384a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.357+0000 7f0ba4b44b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c70378be20 con 0x55c70383a5d0 2023-10-16T13:12:42.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.357+0000 7f0ba4b44b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7037286c0 con 0x55c703839730 2023-10-16T13:12:42.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.357+0000 7f0ba4b44b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c703728360 con 0x55c703838dd0 2023-10-16T13:12:42.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.357+0000 7f0ba4b44b80 10 client.0 _ll_register_callbacks cb 0x55c7035857b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:12:42.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.357+0000 7f0b92d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c70383a5d0 0x55c70384a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.357+0000 7f0b9259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c703838dd0 0x55c703842c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.357+0000 7f0b91d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c703839730 0x55c703843180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.357+0000 7f0b92d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c70383a5d0 0x55c70384a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36058/0 (socket says 172.21.15.92:36058) 2023-10-16T13:12:42.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.357+0000 7f0b9259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c703838dd0 0x55c703842c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.92:42884/0 (socket says 172.21.15.92:42884) 2023-10-16T13:12:42.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.357+0000 7f0b92d9d700 1 -- 172.21.15.92:0/4123831996 learned_addr learned my addr 172.21.15.92:0/4123831996 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:42.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0b92d9d700 1 -- 172.21.15.92:0/4123831996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c703838dd0 msgr2=0x55c703842c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0b92d9d700 1 --2- 172.21.15.92:0/4123831996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c703838dd0 0x55c703842c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0b92d9d700 1 -- 172.21.15.92:0/4123831996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c703839730 msgr2=0x55c703843180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0b92d9d700 1 --2- 172.21.15.92:0/4123831996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c703839730 0x55c703843180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0b92d9d700 1 -- 172.21.15.92:0/4123831996 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b88009d50 con 0x55c70383a5d0 2023-10-16T13:12:42.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0b9259c700 1 --2- 172.21.15.92:0/4123831996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c703838dd0 0x55c703842c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:12:42.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0b92d9d700 1 --2- 172.21.15.92:0/4123831996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c70383a5d0 0x55c70384a1c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c009fd0 tx=0x7f0b8c09b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8405820cfb2691b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:42.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0b79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:12:42.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0b79ffb700 1 -- 172.21.15.92:0/4123831996 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c09bef0 con 0x55c70383a5d0 2023-10-16T13:12:42.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0b79ffb700 1 -- 172.21.15.92:0/4123831996 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f0b8c09b7f0 con 0x55c70383a5d0 2023-10-16T13:12:42.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/4123831996 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c703790ea0 con 0x55c70383a5d0 2023-10-16T13:12:42.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0b79ffb700 1 -- 172.21.15.92:0/4123831996 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b8c09f940 con 0x55c70383a5d0 2023-10-16T13:12:42.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0ba4b44b80 10 client.15045 fetch_fsmap learned FSMap version 27 2023-10-16T13:12:42.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/4123831996 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f0b84009d10 con 0x55c70383a5d0 2023-10-16T13:12:42.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0b79ffb700 1 -- 172.21.15.92:0/4123831996 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55c703790ea0 con 0x55c70383a5d0 2023-10-16T13:12:42.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0b79ffb700 1 -- 172.21.15.92:0/4123831996 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0b8c09ba50 con 0x55c70383a5d0 2023-10-16T13:12:42.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0ba4b44b80 10 client.15045 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:12:42.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0ba4b44b80 10 client.15045 resolve_mds: resolved name 'l' to daemon mds.l 2023-10-16T13:12:42.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0ba4b44b80 20 client.15045 populate_metadata read hostname 'smithi092' 2023-10-16T13:12:42.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/4123831996 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c70384e590 0x55c70384d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0ba4b44b80 4 client.15045 mds_command: new command op to 24412 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:12:42.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.358+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/4123831996 --> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c703808bc0 con 0x55c70384e590 2023-10-16T13:12:42.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.359+0000 7f0b9259c700 1 --2- 172.21.15.92:0/4123831996 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c70384e590 0x55c70384d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.359+0000 7f0b9259c700 1 --2- 172.21.15.92:0/4123831996 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c70384e590 0x55c70384d0f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d56e8511400dd6fa server_cookie=54e472b3f0bca1b5 in_seq=0 out_seq=0 2023-10-16T13:12:42.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.359+0000 7f0b79ffb700 10 client.15045 ms_handle_connect on v2:172.21.15.152:6832/1273074399 2023-10-16T13:12:42.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.360+0000 7f0b79ffb700 1 -- 172.21.15.92:0/4123831996 <== mds.4 v2:172.21.15.152:6832/1273074399 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c703808bc0 con 0x55c70384e590 2023-10-16T13:12:42.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.360+0000 7f0b79ffb700 10 client.15045 handle_command_reply: tid=0 2023-10-16T13:12:42.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.360+0000 7f0ba4b44b80 1 client.15045 shutdown 2023-10-16T13:12:42.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.360+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/4123831996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c70383a5d0 msgr2=0x55c70384a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.360+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/4123831996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c70383a5d0 0x55c70384a1c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c009fd0 tx=0x7f0b8c09b690 comp rx=0 tx=0).stop 2023-10-16T13:12:42.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.360+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/4123831996 shutdown_connections 2023-10-16T13:12:42.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.360+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/4123831996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c70383a5d0 0x55c70384a1c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.360+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/4123831996 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c70384e590 0x55c70384d0f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.360+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/4123831996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c703838dd0 0x55c703842c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.360+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/4123831996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c703839730 0x55c703843180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.360+0000 7f0b79ffb700 0 client.15045 ms_handle_reset on v2:172.21.15.152:6832/1273074399 2023-10-16T13:12:42.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.360+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/4123831996 >> 172.21.15.92:0/4123831996 conn(0x55c703766d80 msgr2=0x55c703833ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:42.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.360+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/4123831996 shutdown_connections 2023-10-16T13:12:42.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.360+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/4123831996 wait complete. 2023-10-16T13:12:42.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.360+0000 7f0ba4b44b80 20 client.15045 trim_cache size 0 max 16384 2023-10-16T13:12:42.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0ba4b44b80 1 Processor -- start 2023-10-16T13:12:42.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0ba4b44b80 1 -- start start 2023-10-16T13:12:42.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0ba4b44b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c703838dd0 0x55c703832750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0ba4b44b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c703839730 0x55c70384a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0ba4b44b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c70383a5d0 0x55c70384a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0ba4b44b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c70360c8d0 con 0x55c70383a5d0 2023-10-16T13:12:42.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0ba4b44b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c703838aa0 con 0x55c703839730 2023-10-16T13:12:42.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0ba4b44b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c703843b40 con 0x55c703838dd0 2023-10-16T13:12:42.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0b92d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c70383a5d0 0x55c70384a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0b92d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c70383a5d0 0x55c70384a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36066/0 (socket says 172.21.15.92:36066) 2023-10-16T13:12:42.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0b92d9d700 1 -- 172.21.15.92:0/3755843697 learned_addr learned my addr 172.21.15.92:0/3755843697 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:42.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0b9259c700 1 --2- 172.21.15.92:0/3755843697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c703838dd0 0x55c703832750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0b91d9b700 1 --2- 172.21.15.92:0/3755843697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c703839730 0x55c70384a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0b92d9d700 1 -- 172.21.15.92:0/3755843697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c703838dd0 msgr2=0x55c703832750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0b92d9d700 1 --2- 172.21.15.92:0/3755843697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c703838dd0 0x55c703832750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0b92d9d700 1 -- 172.21.15.92:0/3755843697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c703839730 msgr2=0x55c70384a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0b92d9d700 1 --2- 172.21.15.92:0/3755843697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c703839730 0x55c70384a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0b92d9d700 1 -- 172.21.15.92:0/3755843697 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7035b6d90 con 0x55c70383a5d0 2023-10-16T13:12:42.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0b92d9d700 1 --2- 172.21.15.92:0/3755843697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c70383a5d0 0x55c70384a990 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c007ad0 tx=0x7f0b8c01ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5af0411b3b041d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:42.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0b817fa700 1 -- 172.21.15.92:0/3755843697 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c01d720 con 0x55c70383a5d0 2023-10-16T13:12:42.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0b817fa700 1 -- 172.21.15.92:0/3755843697 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0b8c0b4050 con 0x55c70383a5d0 2023-10-16T13:12:42.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.378+0000 7f0b817fa700 1 -- 172.21.15.92:0/3755843697 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c0cc1a0 con 0x55c70383a5d0 2023-10-16T13:12:42.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.379+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/3755843697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c70383a5d0 msgr2=0x55c70384a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.379+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/3755843697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c70383a5d0 0x55c70384a990 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c007ad0 tx=0x7f0b8c01ddc0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.379+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/3755843697 shutdown_connections 2023-10-16T13:12:42.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.379+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/3755843697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c70383a5d0 0x55c70384a990 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.379+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/3755843697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c703838dd0 0x55c703832750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.379+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/3755843697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c703839730 0x55c70384a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.379+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/3755843697 >> 172.21.15.92:0/3755843697 conn(0x55c703766d80 msgr2=0x55c7038418d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:42.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.379+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/3755843697 shutdown_connections 2023-10-16T13:12:42.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.379+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/3755843697 wait complete. 2023-10-16T13:12:42.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.379+0000 7f0ba4b44b80 1 -- start start 2023-10-16T13:12:42.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0ba4b44b80 1 Processor -- start 2023-10-16T13:12:42.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0ba4b44b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c703838dd0 0x55c703849e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0ba4b44b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c703839730 0x55c703846a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0ba4b44b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c70383a5d0 0x55c703846f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0ba4b44b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c703847490 con 0x55c703839730 2023-10-16T13:12:42.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0ba4b44b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c703847600 con 0x55c703838dd0 2023-10-16T13:12:42.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0ba4b44b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7038a1f80 con 0x55c70383a5d0 2023-10-16T13:12:42.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0ba4b44b80 10 client.0 _ll_register_callbacks cb 0x7f0b8c097b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:12:42.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0b91d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c703839730 0x55c703846a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0b91d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c703839730 0x55c703846a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36070/0 (socket says 172.21.15.92:36070) 2023-10-16T13:12:42.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0b9259c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c703838dd0 0x55c703849e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0b91d9b700 1 -- 172.21.15.92:0/2878616918 learned_addr learned my addr 172.21.15.92:0/2878616918 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:42.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0b92d9d700 1 --2- 172.21.15.92:0/2878616918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c70383a5d0 0x55c703846f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0b91d9b700 1 -- 172.21.15.92:0/2878616918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c70383a5d0 msgr2=0x55c703846f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0b91d9b700 1 --2- 172.21.15.92:0/2878616918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c70383a5d0 0x55c703846f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0b91d9b700 1 -- 172.21.15.92:0/2878616918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c703838dd0 msgr2=0x55c703849e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0b91d9b700 1 --2- 172.21.15.92:0/2878616918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c703838dd0 0x55c703849e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0b91d9b700 1 -- 172.21.15.92:0/2878616918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b84009d10 con 0x55c703839730 2023-10-16T13:12:42.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0b91d9b700 1 --2- 172.21.15.92:0/2878616918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c703839730 0x55c703846a10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800fd50 tx=0x7f0b88010710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58578867541bc5a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:42.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.380+0000 7f0b79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:12:42.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.381+0000 7f0b79ffb700 1 -- 172.21.15.92:0/2878616918 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88017040 con 0x55c703839730 2023-10-16T13:12:42.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.381+0000 7f0b79ffb700 1 -- 172.21.15.92:0/2878616918 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f0b88004460 con 0x55c703839730 2023-10-16T13:12:42.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.381+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/2878616918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b84015040 con 0x55c703839730 2023-10-16T13:12:42.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.381+0000 7f0b79ffb700 1 -- 172.21.15.92:0/2878616918 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b88003680 con 0x55c703839730 2023-10-16T13:12:42.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.381+0000 7f0ba4b44b80 10 client.15051 fetch_fsmap learned FSMap version 27 2023-10-16T13:12:42.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.381+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/2878616918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c70359fc10 con 0x55c703839730 2023-10-16T13:12:42.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.381+0000 7f0b79ffb700 1 -- 172.21.15.92:0/2878616918 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0b84015040 con 0x55c703839730 2023-10-16T13:12:42.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.381+0000 7f0b79ffb700 1 -- 172.21.15.92:0/2878616918 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0b880124e0 con 0x55c703839730 2023-10-16T13:12:42.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.381+0000 7f0ba4b44b80 10 client.15051 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:12:42.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.381+0000 7f0ba4b44b80 10 client.15051 resolve_mds: resolved name 'l' to daemon mds.l 2023-10-16T13:12:42.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.381+0000 7f0ba4b44b80 20 client.15051 populate_metadata read hostname 'smithi092' 2023-10-16T13:12:42.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.381+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/2878616918 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c7038a72e0 0x55c7038a3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.381+0000 7f0ba4b44b80 4 client.15051 mds_command: new command op to 24412 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:12:42.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.381+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/2878616918 --> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c703784e00 con 0x55c7038a72e0 2023-10-16T13:12:42.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.381+0000 7f0b9259c700 1 --2- 172.21.15.92:0/2878616918 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c7038a72e0 0x55c7038a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.382+0000 7f0b79ffb700 10 client.15051 ms_handle_connect on v2:172.21.15.152:6832/1273074399 2023-10-16T13:12:42.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.382+0000 7f0b9259c700 1 --2- 172.21.15.92:0/2878616918 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c7038a72e0 0x55c7038a3740 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e8ed5db7cb95be9a server_cookie=a412b0807dbb7c22 in_seq=0 out_seq=0 2023-10-16T13:12:42.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.382+0000 7f0b79ffb700 1 -- 172.21.15.92:0/2878616918 <== mds.4 v2:172.21.15.152:6832/1273074399 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55c703784e00 con 0x55c7038a72e0 2023-10-16T13:12:42.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.382+0000 7f0b79ffb700 10 client.15051 handle_command_reply: tid=0 2023-10-16T13:12:42.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.382+0000 7f0ba4b44b80 1 client.15051 shutdown 2023-10-16T13:12:42.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.382+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/2878616918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c703839730 msgr2=0x55c703846a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.382+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/2878616918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c703839730 0x55c703846a10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800fd50 tx=0x7f0b88010710 comp rx=0 tx=0).stop 2023-10-16T13:12:42.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.382+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/2878616918 shutdown_connections 2023-10-16T13:12:42.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.382+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/2878616918 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c7038a72e0 0x55c7038a3740 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.382+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/2878616918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c70383a5d0 0x55c703846f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.382+0000 7f0b79ffb700 0 client.15051 ms_handle_reset on v2:172.21.15.152:6832/1273074399 2023-10-16T13:12:42.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.382+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/2878616918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c703838dd0 0x55c703849e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.382+0000 7f0ba4b44b80 1 --2- 172.21.15.92:0/2878616918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c703839730 0x55c703846a10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.382+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/2878616918 >> 172.21.15.92:0/2878616918 conn(0x55c703766d80 msgr2=0x55c703832750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:42.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.382+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/2878616918 shutdown_connections 2023-10-16T13:12:42.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.382+0000 7f0ba4b44b80 1 -- 172.21.15.92:0/2878616918 wait complete. 2023-10-16T13:12:42.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.382+0000 7f0ba4b44b80 20 client.15051 trim_cache size 0 max 16384 2023-10-16T13:12:42.486 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:12:42.487 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "6c276d7e-6c24-11ee-8db6-212e2dc638e7", 2023-10-16T13:12:42.487 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 4, 2023-10-16T13:12:42.487 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24412, 2023-10-16T13:12:42.487 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2023-10-16T13:12:42.487 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2023-10-16T13:12:42.488 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2023-10-16T13:12:42.488 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 55.038780488999997, 2023-10-16T13:12:42.488 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2023-10-16T13:12:42.488 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 85, 2023-10-16T13:12:42.488 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2023-10-16T13:12:42.488 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 94.138563106999996 2023-10-16T13:12:42.489 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:12:42.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.383+0000 7f0b9895a700 1 -- 172.21.15.92:0/1293217731 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0b7c0a1550 msgr2=0x7f0b7c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.383+0000 7f0b9895a700 1 --2- 172.21.15.92:0/1293217731 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0b7c0a1550 0x7f0b7c0a3a10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0b94197b70 tx=0x7f0b8400f820 comp rx=0 tx=0).stop 2023-10-16T13:12:42.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.383+0000 7f0b9895a700 1 -- 172.21.15.92:0/1293217731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b94106bb0 msgr2=0x7f0b9419e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.383+0000 7f0b9895a700 1 --2- 172.21.15.92:0/1293217731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b94106bb0 0x7f0b9419e240 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00b780 tx=0x7f0b8c00bd60 comp rx=0 tx=0).stop 2023-10-16T13:12:42.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.383+0000 7f0b9895a700 1 -- 172.21.15.92:0/1293217731 shutdown_connections 2023-10-16T13:12:42.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.383+0000 7f0b9895a700 1 --2- 172.21.15.92:0/1293217731 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0b7c0a1550 0x7f0b7c0a3a10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.383+0000 7f0b9895a700 1 --2- 172.21.15.92:0/1293217731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b94106bb0 0x7f0b9419e240 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.383+0000 7f0b9895a700 1 --2- 172.21.15.92:0/1293217731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b94101950 0x7f0b94196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.383+0000 7f0b9895a700 1 --2- 172.21.15.92:0/1293217731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b94104280 0x7f0b941971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.383+0000 7f0b9895a700 1 -- 172.21.15.92:0/1293217731 >> 172.21.15.92:0/1293217731 conn(0x7f0b940fb300 msgr2=0x7f0b941025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:42.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.383+0000 7f0b9895a700 1 -- 172.21.15.92:0/1293217731 shutdown_connections 2023-10-16T13:12:42.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.383+0000 7f0b9895a700 1 -- 172.21.15.92:0/1293217731 wait complete. 2023-10-16T13:12:42.492 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-10-16T13:12:42.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:42 smithi092 ceph-mon[99542]: pgmap v288: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s; 7.2 KiB/s, 1 keys/s, 2 objects/s recovering 2023-10-16T13:12:42.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:42 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2989447795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:12:42.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:42 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3536317382' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:12:42.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:42 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3006035730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:12:42.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.632+0000 7fdb517fc700 1 -- 172.21.15.92:0/22423444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb4c102a20 msgr2=0x7fdb4c109340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.632+0000 7fdb517fc700 1 --2- 172.21.15.92:0/22423444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb4c102a20 0x7fdb4c109340 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400b0a0 tx=0x7fdb4400b3b0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.632+0000 7fdb517fc700 1 -- 172.21.15.92:0/22423444 shutdown_connections 2023-10-16T13:12:42.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.632+0000 7fdb517fc700 1 --2- 172.21.15.92:0/22423444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb4c102a20 0x7fdb4c109340 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.632+0000 7fdb517fc700 1 --2- 172.21.15.92:0/22423444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb4c100e80 0x7fdb4c1012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.632+0000 7fdb517fc700 1 --2- 172.21.15.92:0/22423444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb4c102060 0x7fdb4c1024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.632+0000 7fdb517fc700 1 -- 172.21.15.92:0/22423444 >> 172.21.15.92:0/22423444 conn(0x7fdb4c0fc420 msgr2=0x7fdb4c0fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:42.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.632+0000 7fdb517fc700 1 -- 172.21.15.92:0/22423444 shutdown_connections 2023-10-16T13:12:42.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.632+0000 7fdb517fc700 1 -- 172.21.15.92:0/22423444 wait complete. 2023-10-16T13:12:42.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.632+0000 7fdb517fc700 1 Processor -- start 2023-10-16T13:12:42.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.633+0000 7fdb517fc700 1 -- start start 2023-10-16T13:12:42.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.633+0000 7fdb517fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb4c100e80 0x7fdb4c196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.633+0000 7fdb517fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb4c102060 0x7fdb4c197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.633+0000 7fdb517fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb4c102a20 0x7fdb4c19e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.633+0000 7fdb517fc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c19e840 con 0x7fdb4c100e80 2023-10-16T13:12:42.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.633+0000 7fdb517fc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c19e9b0 con 0x7fdb4c102a20 2023-10-16T13:12:42.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.633+0000 7fdb517fc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c19eb70 con 0x7fdb4c102060 2023-10-16T13:12:42.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.633+0000 7fdb4affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb4c100e80 0x7fdb4c196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.633+0000 7fdb4affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb4c100e80 0x7fdb4c196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36084/0 (socket says 172.21.15.92:36084) 2023-10-16T13:12:42.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.633+0000 7fdb4affd700 1 -- 172.21.15.92:0/107090234 learned_addr learned my addr 172.21.15.92:0/107090234 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:42.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.633+0000 7fdb4a7fc700 1 --2- 172.21.15.92:0/107090234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb4c102060 0x7fdb4c197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.633+0000 7fdb4b7fe700 1 --2- 172.21.15.92:0/107090234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb4c102a20 0x7fdb4c19e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.633+0000 7fdb4affd700 1 -- 172.21.15.92:0/107090234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb4c102060 msgr2=0x7fdb4c197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.633+0000 7fdb4affd700 1 --2- 172.21.15.92:0/107090234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb4c102060 0x7fdb4c197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.633+0000 7fdb4affd700 1 -- 172.21.15.92:0/107090234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb4c102a20 msgr2=0x7fdb4c19e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.633+0000 7fdb4affd700 1 --2- 172.21.15.92:0/107090234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb4c102a20 0x7fdb4c19e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.633+0000 7fdb4affd700 1 -- 172.21.15.92:0/107090234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb44009d00 con 0x7fdb4c100e80 2023-10-16T13:12:42.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.633+0000 7fdb4affd700 1 --2- 172.21.15.92:0/107090234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb4c100e80 0x7fdb4c196d00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00e970 tx=0x7fdb3c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:42.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.633+0000 7fdb33fff700 1 -- 172.21.15.92:0/107090234 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c009790 con 0x7fdb4c100e80 2023-10-16T13:12:42.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.634+0000 7fdb517fc700 1 -- 172.21.15.92:0/107090234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4c19ee50 con 0x7fdb4c100e80 2023-10-16T13:12:42.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.634+0000 7fdb517fc700 1 -- 172.21.15.92:0/107090234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4c19f280 con 0x7fdb4c100e80 2023-10-16T13:12:42.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.638+0000 7fdb33fff700 1 -- 172.21.15.92:0/107090234 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdb3c00c7e0 con 0x7fdb4c100e80 2023-10-16T13:12:42.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.638+0000 7fdb33fff700 1 -- 172.21.15.92:0/107090234 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c003c70 con 0x7fdb4c100e80 2023-10-16T13:12:42.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.639+0000 7fdb5d9e6b80 1 Processor -- start 2023-10-16T13:12:42.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.639+0000 7fdb5d9e6b80 1 -- start start 2023-10-16T13:12:42.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.639+0000 7fdb5d9e6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa2fdd0 0x5575cfa301f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.639+0000 7fdb5d9e6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa30730 0x5575cfa30ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.639+0000 7fdb5d9e6b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa315d0 0x5575cfa31a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.639+0000 7fdb5d9e6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cf9a4c20 con 0x5575cfa30730 2023-10-16T13:12:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.639+0000 7fdb5d9e6b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cf989c10 con 0x5575cfa315d0 2023-10-16T13:12:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.639+0000 7fdb5d9e6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cf987530 con 0x5575cfa2fdd0 2023-10-16T13:12:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.639+0000 7fdb4b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa2fdd0 0x5575cfa301f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.639+0000 7fdb4b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa2fdd0 0x5575cfa301f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.92:42918/0 (socket says 172.21.15.92:42918) 2023-10-16T13:12:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.639+0000 7fdb4a7fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa315d0 0x5575cfa31a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.639+0000 7fdb4b7fe700 1 -- 172.21.15.92:0/1361926215 learned_addr learned my addr 172.21.15.92:0/1361926215 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.639+0000 7fdb4b7fe700 1 -- 172.21.15.92:0/1361926215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa315d0 msgr2=0x5575cfa31a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.639+0000 7fdb4b7fe700 1 --2- 172.21.15.92:0/1361926215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa315d0 0x5575cfa31a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.639+0000 7fdb4b7fe700 1 -- 172.21.15.92:0/1361926215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa30730 msgr2=0x5575cfa30ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T13:12:42.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.639+0000 7fdb4b7fe700 1 --2- 172.21.15.92:0/1361926215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa30730 0x5575cfa30ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.639+0000 7fdb4b7fe700 1 -- 172.21.15.92:0/1361926215 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575cf9403a0 con 0x5575cfa2fdd0 2023-10-16T13:12:42.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.639+0000 7fdb4a7fc700 1 --2- 172.21.15.92:0/1361926215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa315d0 0x5575cfa31a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:12:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.640+0000 7fdb4b7fe700 1 --2- 172.21.15.92:0/1361926215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa2fdd0 0x5575cfa301f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009c40 tx=0x7fdb44009c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0f3f105dadc2e60 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.640+0000 7fdb317fa700 1 -- 172.21.15.92:0/1361926215 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4400e040 con 0x5575cfa2fdd0 2023-10-16T13:12:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.640+0000 7fdb317fa700 1 -- 172.21.15.92:0/1361926215 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdb440074e0 con 0x5575cfa2fdd0 2023-10-16T13:12:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.640+0000 7fdb317fa700 1 -- 172.21.15.92:0/1361926215 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4401c6a0 con 0x5575cfa2fdd0 2023-10-16T13:12:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.640+0000 7fdb33fff700 1 -- 172.21.15.92:0/107090234 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fdb3c00c950 con 0x7fdb4c100e80 2023-10-16T13:12:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.640+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/1361926215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa2fdd0 msgr2=0x5575cfa301f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.640+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/1361926215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa2fdd0 0x5575cfa301f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009c40 tx=0x7fdb44009c70 comp rx=0 tx=0).stop 2023-10-16T13:12:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.640+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/1361926215 shutdown_connections 2023-10-16T13:12:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/1361926215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa315d0 0x5575cfa31a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/1361926215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa2fdd0 0x5575cfa301f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/1361926215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa30730 0x5575cfa30ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/1361926215 >> 172.21.15.92:0/1361926215 conn(0x5575cf95dd80 msgr2=0x5575cfa2af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:42.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/1361926215 shutdown_connections 2023-10-16T13:12:42.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/1361926215 wait complete. 2023-10-16T13:12:42.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb33fff700 1 --2- 172.21.15.92:0/107090234 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdb340a1460 0x7fdb340a3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb4a7fc700 1 --2- 172.21.15.92:0/107090234 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdb340a1460 0x7fdb340a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb33fff700 1 -- 172.21.15.92:0/107090234 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fdb3c014070 con 0x7fdb4c100e80 2023-10-16T13:12:42.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb5d9e6b80 1 -- start start 2023-10-16T13:12:42.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb5d9e6b80 1 Processor -- start 2023-10-16T13:12:42.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb4a7fc700 1 --2- 172.21.15.92:0/107090234 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdb340a1460 0x7fdb340a3920 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5575cfa2bf20 tx=0x7fdb40009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:42.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb5d9e6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa2fdd0 0x5575cfa39be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb5d9e6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa30730 0x5575cfa3a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb5d9e6b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa315d0 0x5575cfa41160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb5d9e6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cf982e20 con 0x5575cfa2fdd0 2023-10-16T13:12:42.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb5d9e6b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cf91f6c0 con 0x5575cfa315d0 2023-10-16T13:12:42.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb5d9e6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cf91f360 con 0x5575cfa30730 2023-10-16T13:12:42.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb5d9e6b80 10 client.0 _ll_register_callbacks cb 0x5575cf77c7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:12:42.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb4b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa315d0 0x5575cfa41160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb4a7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa30730 0x5575cfa3a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb4b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa315d0 0x5575cfa41160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:36906/0 (socket says 172.21.15.92:36906) 2023-10-16T13:12:42.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.641+0000 7fdb4b7fe700 1 -- 172.21.15.92:0/4203280835 learned_addr learned my addr 172.21.15.92:0/4203280835 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:42.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.642+0000 7fdb4a7fc700 1 -- 172.21.15.92:0/4203280835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa315d0 msgr2=0x5575cfa41160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.642+0000 7fdb4a7fc700 1 --2- 172.21.15.92:0/4203280835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa315d0 0x5575cfa41160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.642+0000 7fdb4a7fc700 1 -- 172.21.15.92:0/4203280835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa2fdd0 msgr2=0x5575cfa39be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.642+0000 7fdb4a7fc700 1 --2- 172.21.15.92:0/4203280835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa2fdd0 0x5575cfa39be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.642+0000 7fdb4a7fc700 1 -- 172.21.15.92:0/4203280835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb400098e0 con 0x5575cfa30730 2023-10-16T13:12:42.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.642+0000 7fdb4b7fe700 1 --2- 172.21.15.92:0/4203280835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa315d0 0x5575cfa41160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:12:42.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.642+0000 7fdb4a7fc700 1 --2- 172.21.15.92:0/4203280835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa30730 0x5575cfa3a120 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5575cfa30db0 tx=0x7fdb400047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=882f7cd6aa9e30bd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:42.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.642+0000 7fdb2eff5700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-10-16T13:12:42.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.642+0000 7fdb2eff5700 1 -- 172.21.15.92:0/4203280835 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40017070 con 0x5575cfa30730 2023-10-16T13:12:42.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.642+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/4203280835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575cf987ea0 con 0x5575cfa30730 2023-10-16T13:12:42.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.642+0000 7fdb2eff5700 1 -- 172.21.15.92:0/4203280835 <== mon.1 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fdb40003cf0 con 0x5575cfa30730 2023-10-16T13:12:42.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.642+0000 7fdb2eff5700 1 -- 172.21.15.92:0/4203280835 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb40029440 con 0x5575cfa30730 2023-10-16T13:12:42.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.642+0000 7fdb5d9e6b80 10 client.24772 fetch_fsmap learned FSMap version 27 2023-10-16T13:12:42.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.642+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/4203280835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fdb4c109c70 con 0x5575cfa30730 2023-10-16T13:12:42.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.643+0000 7fdb2eff5700 1 -- 172.21.15.92:0/4203280835 <== mon.1 v2:172.21.15.152:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5575cf987ea0 con 0x5575cfa30730 2023-10-16T13:12:42.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.643+0000 7fdb2eff5700 1 -- 172.21.15.92:0/4203280835 <== mon.1 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdb4001f730 con 0x5575cfa30730 2023-10-16T13:12:42.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.643+0000 7fdb5d9e6b80 10 client.24772 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:12:42.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.643+0000 7fdb5d9e6b80 10 client.24772 resolve_mds: resolved name 'e' to daemon mds.e 2023-10-16T13:12:42.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.643+0000 7fdb5d9e6b80 20 client.24772 populate_metadata read hostname 'smithi092' 2023-10-16T13:12:42.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.643+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/4203280835 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x5575cfa458e0 0x5575cfa442f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.643+0000 7fdb5d9e6b80 4 client.24772 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:12:42.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.643+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/4203280835 --> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5575cf9ffbc0 con 0x5575cfa458e0 2023-10-16T13:12:42.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.643+0000 7fdb4affd700 1 --2- 172.21.15.92:0/4203280835 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x5575cfa458e0 0x5575cfa442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.643+0000 7fdb2eff5700 10 client.24772 ms_handle_connect on v2:172.21.15.118:6834/2381374755 2023-10-16T13:12:42.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.643+0000 7fdb4affd700 1 --2- 172.21.15.92:0/4203280835 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x5575cfa458e0 0x5575cfa442f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a24890388ac94d7c server_cookie=95f9d4f43233118f in_seq=0 out_seq=0 2023-10-16T13:12:42.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.644+0000 7fdb2eff5700 1 -- 172.21.15.92:0/4203280835 <== mds.3 v2:172.21.15.118:6834/2381374755 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5575cf9ffbc0 con 0x5575cfa458e0 2023-10-16T13:12:42.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.644+0000 7fdb2eff5700 10 client.24772 handle_command_reply: tid=0 2023-10-16T13:12:42.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.644+0000 7fdb5d9e6b80 1 client.24772 shutdown 2023-10-16T13:12:42.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.644+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/4203280835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa30730 msgr2=0x5575cfa3a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.644+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/4203280835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa30730 0x5575cfa3a120 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5575cfa30db0 tx=0x7fdb400047c0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.644+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/4203280835 shutdown_connections 2023-10-16T13:12:42.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.644+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/4203280835 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x5575cfa458e0 0x5575cfa442f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.644+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/4203280835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa2fdd0 0x5575cfa39be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.644+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/4203280835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa315d0 0x5575cfa41160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.644+0000 7fdb2eff5700 0 client.24772 ms_handle_reset on v2:172.21.15.118:6834/2381374755 2023-10-16T13:12:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.644+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/4203280835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa30730 0x5575cfa3a120 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.644+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/4203280835 >> 172.21.15.92:0/4203280835 conn(0x5575cf95dd80 msgr2=0x5575cfa2aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:42.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.644+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/4203280835 shutdown_connections 2023-10-16T13:12:42.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.644+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/4203280835 wait complete. 2023-10-16T13:12:42.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.644+0000 7fdb5d9e6b80 20 client.24772 trim_cache size 0 max 16384 2023-10-16T13:12:42.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.661+0000 7fdb5d9e6b80 1 Processor -- start 2023-10-16T13:12:42.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.661+0000 7fdb5d9e6b80 1 -- start start 2023-10-16T13:12:42.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb5d9e6b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa2fdd0 0x5575cfa34540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb5d9e6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa30730 0x5575cfa34a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb5d9e6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa315d0 0x5575cfa41080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb5d9e6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cf8038d0 con 0x5575cfa30730 2023-10-16T13:12:42.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb5d9e6b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cf97ef10 con 0x5575cfa2fdd0 2023-10-16T13:12:42.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb5d9e6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cf941590 con 0x5575cfa315d0 2023-10-16T13:12:42.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb4a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa30730 0x5575cfa34a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb4a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa30730 0x5575cfa34a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36104/0 (socket says 172.21.15.92:36104) 2023-10-16T13:12:42.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb4a7fc700 1 -- 172.21.15.92:0/3353383172 learned_addr learned my addr 172.21.15.92:0/3353383172 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:42.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb4affd700 1 --2- 172.21.15.92:0/3353383172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa2fdd0 0x5575cfa34540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb4b7fe700 1 --2- 172.21.15.92:0/3353383172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa315d0 0x5575cfa41080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb4a7fc700 1 -- 172.21.15.92:0/3353383172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa315d0 msgr2=0x5575cfa41080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb4a7fc700 1 --2- 172.21.15.92:0/3353383172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa315d0 0x5575cfa41080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb4a7fc700 1 -- 172.21.15.92:0/3353383172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa2fdd0 msgr2=0x5575cfa34540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb4a7fc700 1 --2- 172.21.15.92:0/3353383172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa2fdd0 0x5575cfa34540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb4a7fc700 1 -- 172.21.15.92:0/3353383172 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575cf7add90 con 0x5575cfa30730 2023-10-16T13:12:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb4a7fc700 1 --2- 172.21.15.92:0/3353383172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa30730 0x5575cfa34a80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdb40005b30 tx=0x7fdb400039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f858dc97c2955cd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb31ffb700 1 -- 172.21.15.92:0/3353383172 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4001f430 con 0x5575cfa30730 2023-10-16T13:12:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb31ffb700 1 -- 172.21.15.92:0/3353383172 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdb40029440 con 0x5575cfa30730 2023-10-16T13:12:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.662+0000 7fdb31ffb700 1 -- 172.21.15.92:0/3353383172 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4001d660 con 0x5575cfa30730 2023-10-16T13:12:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.663+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/3353383172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa30730 msgr2=0x5575cfa34a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.663+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/3353383172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa30730 0x5575cfa34a80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdb40005b30 tx=0x7fdb400039e0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.663+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/3353383172 shutdown_connections 2023-10-16T13:12:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.663+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/3353383172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa315d0 0x5575cfa41080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.663+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/3353383172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa2fdd0 0x5575cfa34540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.663+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/3353383172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa30730 0x5575cfa34a80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.663+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/3353383172 >> 172.21.15.92:0/3353383172 conn(0x5575cf95dd80 msgr2=0x5575cfa29750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:42.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.663+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/3353383172 shutdown_connections 2023-10-16T13:12:42.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.663+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/3353383172 wait complete. 2023-10-16T13:12:42.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.663+0000 7fdb5d9e6b80 1 -- start start 2023-10-16T13:12:42.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.663+0000 7fdb5d9e6b80 1 Processor -- start 2023-10-16T13:12:42.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.663+0000 7fdb5d9e6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa2fdd0 0x5575cfa3dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.663+0000 7fdb5d9e6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa30730 0x5575cfa3e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.663+0000 7fdb5d9e6b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa315d0 0x5575cfa992d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.663+0000 7fdb5d9e6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cfa3eaf0 con 0x5575cfa2fdd0 2023-10-16T13:12:42.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.663+0000 7fdb5d9e6b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cfa99810 con 0x5575cfa315d0 2023-10-16T13:12:42.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.663+0000 7fdb5d9e6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cfa99950 con 0x5575cfa30730 2023-10-16T13:12:42.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb5d9e6b80 10 client.0 _ll_register_callbacks cb 0x7fdb40004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:12:42.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb4affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa2fdd0 0x5575cfa3dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb4affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa2fdd0 0x5575cfa3dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36108/0 (socket says 172.21.15.92:36108) 2023-10-16T13:12:42.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb4affd700 1 -- 172.21.15.92:0/1693038943 learned_addr learned my addr 172.21.15.92:0/1693038943 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:42.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb4a7fc700 1 --2- 172.21.15.92:0/1693038943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa30730 0x5575cfa3e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb4b7fe700 1 --2- 172.21.15.92:0/1693038943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa315d0 0x5575cfa992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb4affd700 1 -- 172.21.15.92:0/1693038943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa30730 msgr2=0x5575cfa3e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb4affd700 1 --2- 172.21.15.92:0/1693038943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa30730 0x5575cfa3e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb4affd700 1 -- 172.21.15.92:0/1693038943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa315d0 msgr2=0x5575cfa992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb4affd700 1 --2- 172.21.15.92:0/1693038943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa315d0 0x5575cfa992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb4affd700 1 -- 172.21.15.92:0/1693038943 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4c109c70 con 0x5575cfa2fdd0 2023-10-16T13:12:42.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb4affd700 1 --2- 172.21.15.92:0/1693038943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa2fdd0 0x5575cfa3dfd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c09a130 tx=0x7fdb3c09a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76236de8c77dc1c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:42.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb2eff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:12:42.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb2eff5700 1 -- 172.21.15.92:0/1693038943 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c09e2f0 con 0x5575cfa2fdd0 2023-10-16T13:12:42.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb2eff5700 1 -- 172.21.15.92:0/1693038943 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fdb3c0a2530 con 0x5575cfa2fdd0 2023-10-16T13:12:42.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/1693038943 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb440074e0 con 0x5575cfa2fdd0 2023-10-16T13:12:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb2eff5700 1 -- 172.21.15.92:0/1693038943 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb3c00cca0 con 0x5575cfa2fdd0 2023-10-16T13:12:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb5d9e6b80 10 client.15063 fetch_fsmap learned FSMap version 27 2023-10-16T13:12:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/1693038943 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5575cf796c10 con 0x5575cfa2fdd0 2023-10-16T13:12:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.664+0000 7fdb2eff5700 1 -- 172.21.15.92:0/1693038943 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdb440074e0 con 0x5575cfa2fdd0 2023-10-16T13:12:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.665+0000 7fdb2eff5700 1 -- 172.21.15.92:0/1693038943 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdb3c09a400 con 0x5575cfa2fdd0 2023-10-16T13:12:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.665+0000 7fdb5d9e6b80 10 client.15063 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:12:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.665+0000 7fdb5d9e6b80 10 client.15063 resolve_mds: resolved name 'e' to daemon mds.e 2023-10-16T13:12:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.665+0000 7fdb5d9e6b80 20 client.15063 populate_metadata read hostname 'smithi092' 2023-10-16T13:12:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.665+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/1693038943 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x5575cfa9ebd0 0x5575cfa9b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.665+0000 7fdb5d9e6b80 4 client.15063 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:12:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.665+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/1693038943 --> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5575cf97be00 con 0x5575cfa9ebd0 2023-10-16T13:12:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.665+0000 7fdb4a7fc700 1 --2- 172.21.15.92:0/1693038943 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x5575cfa9ebd0 0x5575cfa9b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.665+0000 7fdb2eff5700 10 client.15063 ms_handle_connect on v2:172.21.15.118:6834/2381374755 2023-10-16T13:12:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.665+0000 7fdb4a7fc700 1 --2- 172.21.15.92:0/1693038943 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x5575cfa9ebd0 0x5575cfa9b050 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b26804584c4d4f46 server_cookie=aa76bba20858dedf in_seq=0 out_seq=0 2023-10-16T13:12:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.665+0000 7fdb2eff5700 1 -- 172.21.15.92:0/1693038943 <== mds.3 v2:172.21.15.118:6834/2381374755 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5575cf97be00 con 0x5575cfa9ebd0 2023-10-16T13:12:42.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.665+0000 7fdb2eff5700 10 client.15063 handle_command_reply: tid=0 2023-10-16T13:12:42.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.665+0000 7fdb5d9e6b80 1 client.15063 shutdown 2023-10-16T13:12:42.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.665+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/1693038943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa2fdd0 msgr2=0x5575cfa3dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.665+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/1693038943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa2fdd0 0x5575cfa3dfd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c09a130 tx=0x7fdb3c09a8a0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/1693038943 shutdown_connections 2023-10-16T13:12:42.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/1693038943 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x5575cfa9ebd0 0x5575cfa9b050 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/1693038943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575cfa2fdd0 0x5575cfa3dfd0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb2eff5700 0 client.15063 ms_handle_reset on v2:172.21.15.118:6834/2381374755 2023-10-16T13:12:42.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/1693038943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575cfa315d0 0x5575cfa992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb5d9e6b80 1 --2- 172.21.15.92:0/1693038943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575cfa30730 0x5575cfa3e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/1693038943 >> 172.21.15.92:0/1693038943 conn(0x5575cf95dd80 msgr2=0x5575cfa34540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:42.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/1693038943 shutdown_connections 2023-10-16T13:12:42.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb5d9e6b80 1 -- 172.21.15.92:0/1693038943 wait complete. 2023-10-16T13:12:42.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb5d9e6b80 20 client.15063 trim_cache size 0 max 16384 2023-10-16T13:12:42.687 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:12:42.687 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "6c276d7e-6c24-11ee-8db6-212e2dc638e7", 2023-10-16T13:12:42.687 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 3, 2023-10-16T13:12:42.687 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24428, 2023-10-16T13:12:42.687 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2023-10-16T13:12:42.688 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2023-10-16T13:12:42.688 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2023-10-16T13:12:42.688 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 56.339498753999997, 2023-10-16T13:12:42.688 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2023-10-16T13:12:42.688 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 85, 2023-10-16T13:12:42.689 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2023-10-16T13:12:42.689 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 85.565178309999993 2023-10-16T13:12:42.689 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:12:42.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb517fc700 1 -- 172.21.15.92:0/107090234 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdb340a1460 msgr2=0x7fdb340a3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb517fc700 1 --2- 172.21.15.92:0/107090234 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdb340a1460 0x7fdb340a3920 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5575cfa2bf20 tx=0x7fdb40009260 comp rx=0 tx=0).stop 2023-10-16T13:12:42.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb517fc700 1 -- 172.21.15.92:0/107090234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb4c100e80 msgr2=0x7fdb4c196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb517fc700 1 --2- 172.21.15.92:0/107090234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb4c100e80 0x7fdb4c196d00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00e970 tx=0x7fdb3c00ec80 comp rx=0 tx=0).stop 2023-10-16T13:12:42.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb517fc700 1 -- 172.21.15.92:0/107090234 shutdown_connections 2023-10-16T13:12:42.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb517fc700 1 --2- 172.21.15.92:0/107090234 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fdb340a1460 0x7fdb340a3920 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb517fc700 1 --2- 172.21.15.92:0/107090234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb4c100e80 0x7fdb4c196d00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb517fc700 1 --2- 172.21.15.92:0/107090234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb4c102a20 0x7fdb4c19e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb517fc700 1 --2- 172.21.15.92:0/107090234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb4c102060 0x7fdb4c197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb517fc700 1 -- 172.21.15.92:0/107090234 >> 172.21.15.92:0/107090234 conn(0x7fdb4c0fc420 msgr2=0x7fdb4c1054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:42.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb517fc700 1 -- 172.21.15.92:0/107090234 shutdown_connections 2023-10-16T13:12:42.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.666+0000 7fdb517fc700 1 -- 172.21.15.92:0/107090234 wait complete. 2023-10-16T13:12:42.693 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-10-16T13:12:42.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:42 smithi152 ceph-mon[104423]: pgmap v288: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s; 7.2 KiB/s, 1 keys/s, 2 objects/s recovering 2023-10-16T13:12:42.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:42 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2989447795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:12:42.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:42 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3536317382' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:12:42.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:42 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3006035730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:12:42.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:42 smithi118 ceph-mon[103969]: pgmap v288: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s; 7.2 KiB/s, 1 keys/s, 2 objects/s recovering 2023-10-16T13:12:42.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:42 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2989447795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:12:42.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:42 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3536317382' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:12:42.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:42 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3006035730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:12:42.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.827+0000 7f31e3f8e700 1 -- 172.21.15.92:0/3997795780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31dc102220 msgr2=0x7f31dc102680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.827+0000 7f31e3f8e700 1 --2- 172.21.15.92:0/3997795780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31dc102220 0x7f31dc102680 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009990 tx=0x7f31cc009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.827+0000 7f31e3f8e700 1 -- 172.21.15.92:0/3997795780 shutdown_connections 2023-10-16T13:12:42.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.827+0000 7f31e3f8e700 1 --2- 172.21.15.92:0/3997795780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31dc102bc0 0x7f31dc109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.827+0000 7f31e3f8e700 1 --2- 172.21.15.92:0/3997795780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31dc0ff1b0 0x7f31dc0ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.827+0000 7f31e3f8e700 1 --2- 172.21.15.92:0/3997795780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31dc102220 0x7f31dc102680 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.827+0000 7f31e3f8e700 1 -- 172.21.15.92:0/3997795780 >> 172.21.15.92:0/3997795780 conn(0x7f31dc0faac0 msgr2=0x7f31dc0fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:42.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.828+0000 7f31e3f8e700 1 -- 172.21.15.92:0/3997795780 shutdown_connections 2023-10-16T13:12:42.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.828+0000 7f31e3f8e700 1 -- 172.21.15.92:0/3997795780 wait complete. 2023-10-16T13:12:42.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.828+0000 7f31e3f8e700 1 Processor -- start 2023-10-16T13:12:42.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.828+0000 7f31e3f8e700 1 -- start start 2023-10-16T13:12:42.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.828+0000 7f31e3f8e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31dc0ff1b0 0x7f31dc101b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.828+0000 7f31e3f8e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31dc102220 0x7f31dc1001d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.828+0000 7f31e3f8e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31dc102bc0 0x7f31dc100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.828+0000 7f31e3f8e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc100eb0 con 0x7f31dc102bc0 2023-10-16T13:12:42.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.828+0000 7f31e3f8e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc101020 con 0x7f31dc102220 2023-10-16T13:12:42.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.828+0000 7f31e3f8e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc1a0c70 con 0x7f31dc0ff1b0 2023-10-16T13:12:42.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.828+0000 7f31e252b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31dc102bc0 0x7f31dc100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.828+0000 7f31e252b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31dc102bc0 0x7f31dc100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36126/0 (socket says 172.21.15.92:36126) 2023-10-16T13:12:42.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.828+0000 7f31e252b700 1 -- 172.21.15.92:0/1826062308 learned_addr learned my addr 172.21.15.92:0/1826062308 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:42.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.828+0000 7f31e1d2a700 1 --2- 172.21.15.92:0/1826062308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31dc0ff1b0 0x7f31dc101b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.828+0000 7f31e1529700 1 --2- 172.21.15.92:0/1826062308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31dc102220 0x7f31dc1001d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.829+0000 7f31e252b700 1 -- 172.21.15.92:0/1826062308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31dc0ff1b0 msgr2=0x7f31dc101b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.829+0000 7f31e252b700 1 --2- 172.21.15.92:0/1826062308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31dc0ff1b0 0x7f31dc101b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.829+0000 7f31e252b700 1 -- 172.21.15.92:0/1826062308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31dc102220 msgr2=0x7f31dc1001d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.829+0000 7f31e252b700 1 --2- 172.21.15.92:0/1826062308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31dc102220 0x7f31dc1001d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.829+0000 7f31e252b700 1 -- 172.21.15.92:0/1826062308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc0095f0 con 0x7f31dc102bc0 2023-10-16T13:12:42.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.829+0000 7f31e252b700 1 --2- 172.21.15.92:0/1826062308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31dc102bc0 0x7f31dc100710 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f31d400ef30 tx=0x7f31d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:42.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.829+0000 7f31d2ffd700 1 -- 172.21.15.92:0/1826062308 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d4018070 con 0x7f31dc102bc0 2023-10-16T13:12:42.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.829+0000 7f31d2ffd700 1 -- 172.21.15.92:0/1826062308 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f31d400f040 con 0x7f31dc102bc0 2023-10-16T13:12:42.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.829+0000 7f31e3f8e700 1 -- 172.21.15.92:0/1826062308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31dc1a0ef0 con 0x7f31dc102bc0 2023-10-16T13:12:42.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.829+0000 7f31d2ffd700 1 -- 172.21.15.92:0/1826062308 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d400cd50 con 0x7f31dc102bc0 2023-10-16T13:12:42.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.829+0000 7f31e3f8e700 1 -- 172.21.15.92:0/1826062308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31dc1a1320 con 0x7f31dc102bc0 2023-10-16T13:12:42.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.832+0000 7f31d2ffd700 1 -- 172.21.15.92:0/1826062308 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f31d4003a00 con 0x7f31dc102bc0 2023-10-16T13:12:42.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.832+0000 7f31f0178b80 1 Processor -- start 2023-10-16T13:12:42.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31d2ffd700 1 --2- 172.21.15.92:0/1826062308 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f31c80a1550 0x7f31c80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31e1529700 1 --2- 172.21.15.92:0/1826062308 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f31c80a1550 0x7f31c80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31d2ffd700 1 -- 172.21.15.92:0/1826062308 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f31d40cc9c0 con 0x7f31dc102bc0 2023-10-16T13:12:42.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31f0178b80 1 -- start start 2023-10-16T13:12:42.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31f0178b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdbfdd0 0x55a23fdc01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31f0178b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdc0730 0x55a23fdc0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31f0178b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdc15d0 0x55a23fdc1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31f0178b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23fd34c20 con 0x55a23fdc0730 2023-10-16T13:12:42.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31f0178b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23fd19c10 con 0x55a23fdbfdd0 2023-10-16T13:12:42.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31f0178b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23fd17530 con 0x55a23fdc15d0 2023-10-16T13:12:42.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31e1529700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdc0730 0x55a23fdc0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31e1529700 1 --2- 172.21.15.92:0/1826062308 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f31c80a1550 0x7f31c80a3a10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00b2e0 tx=0x7f31cc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:42.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31e1529700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdc0730 0x55a23fdc0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36132/0 (socket says 172.21.15.92:36132) 2023-10-16T13:12:42.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31e1529700 1 -- 172.21.15.92:0/3552927150 learned_addr learned my addr 172.21.15.92:0/3552927150 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:42.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31e252b700 1 --2- 172.21.15.92:0/3552927150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdc15d0 0x55a23fdc1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31e1d2a700 1 --2- 172.21.15.92:0/3552927150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdbfdd0 0x55a23fdc01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31e1529700 1 -- 172.21.15.92:0/3552927150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdc15d0 msgr2=0x55a23fdc1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31e1529700 1 --2- 172.21.15.92:0/3552927150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdc15d0 0x55a23fdc1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31e1529700 1 -- 172.21.15.92:0/3552927150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdbfdd0 msgr2=0x55a23fdc01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31e1529700 1 --2- 172.21.15.92:0/3552927150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdbfdd0 0x55a23fdc01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31e1529700 1 -- 172.21.15.92:0/3552927150 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a23fcd03a0 con 0x55a23fdc0730 2023-10-16T13:12:42.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.833+0000 7f31e252b700 1 --2- 172.21.15.92:0/3552927150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdc15d0 0x55a23fdc1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:12:42.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.834+0000 7f31e1529700 1 --2- 172.21.15.92:0/3552927150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdc0730 0x55a23fdc0ff0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00b2b0 tx=0x7f31cc020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc2a543c0d80d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:42.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.834+0000 7f31c7fff700 1 -- 172.21.15.92:0/3552927150 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc004700 con 0x55a23fdc0730 2023-10-16T13:12:42.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.834+0000 7f31c7fff700 1 -- 172.21.15.92:0/3552927150 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f31cc01e040 con 0x55a23fdc0730 2023-10-16T13:12:42.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.834+0000 7f31c7fff700 1 -- 172.21.15.92:0/3552927150 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc00fc90 con 0x55a23fdc0730 2023-10-16T13:12:42.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.834+0000 7f31f0178b80 1 -- 172.21.15.92:0/3552927150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdc0730 msgr2=0x55a23fdc0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.834+0000 7f31f0178b80 1 --2- 172.21.15.92:0/3552927150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdc0730 0x55a23fdc0ff0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00b2b0 tx=0x7f31cc020000 comp rx=0 tx=0).stop 2023-10-16T13:12:42.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.835+0000 7f31f0178b80 1 -- 172.21.15.92:0/3552927150 shutdown_connections 2023-10-16T13:12:42.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.835+0000 7f31f0178b80 1 --2- 172.21.15.92:0/3552927150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdc15d0 0x55a23fdc1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.835+0000 7f31f0178b80 1 --2- 172.21.15.92:0/3552927150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdbfdd0 0x55a23fdc01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.835+0000 7f31f0178b80 1 --2- 172.21.15.92:0/3552927150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdc0730 0x55a23fdc0ff0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.835+0000 7f31f0178b80 1 -- 172.21.15.92:0/3552927150 >> 172.21.15.92:0/3552927150 conn(0x55a23fcedd80 msgr2=0x55a23fdbaf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:42.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.835+0000 7f31f0178b80 1 -- 172.21.15.92:0/3552927150 shutdown_connections 2023-10-16T13:12:42.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.835+0000 7f31f0178b80 1 -- 172.21.15.92:0/3552927150 wait complete. 2023-10-16T13:12:42.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.835+0000 7f31f0178b80 1 -- start start 2023-10-16T13:12:42.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.835+0000 7f31f0178b80 1 Processor -- start 2023-10-16T13:12:42.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.835+0000 7f31f0178b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdbfdd0 0x55a23fdc9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.835+0000 7f31f0178b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdc0730 0x55a23fdca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.835+0000 7f31f0178b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdc15d0 0x55a23fdd1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.835+0000 7f31f0178b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23fd12e20 con 0x55a23fdc15d0 2023-10-16T13:12:42.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.835+0000 7f31f0178b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23fcaf6c0 con 0x55a23fdbfdd0 2023-10-16T13:12:42.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.835+0000 7f31f0178b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23fcaf360 con 0x55a23fdc0730 2023-10-16T13:12:42.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.835+0000 7f31f0178b80 10 client.0 _ll_register_callbacks cb 0x55a23fb0c7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:12:42.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.836+0000 7f31e1d2a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdbfdd0 0x55a23fdc9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.864 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.836+0000 7f31e252b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdc15d0 0x55a23fdd1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.864 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.836+0000 7f31e1d2a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdbfdd0 0x55a23fdc9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:36944/0 (socket says 172.21.15.92:36944) 2023-10-16T13:12:42.864 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.836+0000 7f31e1d2a700 1 -- 172.21.15.92:0/3959889586 learned_addr learned my addr 172.21.15.92:0/3959889586 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:42.864 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.836+0000 7f31e1529700 1 --2- 172.21.15.92:0/3959889586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdc0730 0x55a23fdca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.864 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.836+0000 7f31e1d2a700 1 -- 172.21.15.92:0/3959889586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdc0730 msgr2=0x55a23fdca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.836+0000 7f31e1d2a700 1 --2- 172.21.15.92:0/3959889586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdc0730 0x55a23fdca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.836+0000 7f31e1d2a700 1 -- 172.21.15.92:0/3959889586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdc15d0 msgr2=0x55a23fdd1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.836+0000 7f31e1d2a700 1 --2- 172.21.15.92:0/3959889586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdc15d0 0x55a23fdd1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.836+0000 7f31e1d2a700 1 -- 172.21.15.92:0/3959889586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31dc109c60 con 0x55a23fdbfdd0 2023-10-16T13:12:42.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.836+0000 7f31e1d2a700 1 --2- 172.21.15.92:0/3959889586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdbfdd0 0x55a23fdc9bb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f31d800ba90 tx=0x7f31d800bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f56a3e1e4ea7450 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:42.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.836+0000 7f31c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-16T13:12:42.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.836+0000 7f31c57fa700 1 -- 172.21.15.92:0/3959889586 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d8004210 con 0x55a23fdbfdd0 2023-10-16T13:12:42.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.836+0000 7f31f0178b80 1 -- 172.21.15.92:0/3959889586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a23fd17ea0 con 0x55a23fdbfdd0 2023-10-16T13:12:42.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.836+0000 7f31c57fa700 1 -- 172.21.15.92:0/3959889586 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f31d8011440 con 0x55a23fdbfdd0 2023-10-16T13:12:42.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.836+0000 7f31c57fa700 1 -- 172.21.15.92:0/3959889586 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31d8011600 con 0x55a23fdbfdd0 2023-10-16T13:12:42.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.836+0000 7f31f0178b80 10 client.24791 fetch_fsmap learned FSMap version 27 2023-10-16T13:12:42.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.836+0000 7f31f0178b80 1 -- 172.21.15.92:0/3959889586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a23fb3dd90 con 0x55a23fdbfdd0 2023-10-16T13:12:42.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.837+0000 7f31c57fa700 1 -- 172.21.15.92:0/3959889586 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55a23fd17ea0 con 0x55a23fdbfdd0 2023-10-16T13:12:42.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.837+0000 7f31c57fa700 1 -- 172.21.15.92:0/3959889586 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f31d801b9d0 con 0x55a23fdbfdd0 2023-10-16T13:12:42.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.837+0000 7f31f0178b80 10 client.24791 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:12:42.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.837+0000 7f31f0178b80 10 client.24791 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-16T13:12:42.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.837+0000 7f31f0178b80 20 client.24791 populate_metadata read hostname 'smithi092' 2023-10-16T13:12:42.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.837+0000 7f31f0178b80 1 --2- 172.21.15.92:0/3959889586 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x55a23fdd5880 0x55a23fdd42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.837+0000 7f31f0178b80 4 client.24791 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:12:42.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.837+0000 7f31f0178b80 1 -- 172.21.15.92:0/3959889586 --> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a23fd8fbc0 con 0x55a23fdd5880 2023-10-16T13:12:42.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.837+0000 7f31e1529700 1 --2- 172.21.15.92:0/3959889586 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x55a23fdd5880 0x55a23fdd42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.837+0000 7f31c57fa700 10 client.24791 ms_handle_connect on v2:172.21.15.152:6834/1393840132 2023-10-16T13:12:42.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.837+0000 7f31e1529700 1 --2- 172.21.15.92:0/3959889586 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x55a23fdd5880 0x55a23fdd42e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9157f1ed843ad7c8 server_cookie=75aae2c4f5721ce3 in_seq=0 out_seq=0 2023-10-16T13:12:42.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.838+0000 7f31c57fa700 1 -- 172.21.15.92:0/3959889586 <== mds.2 v2:172.21.15.152:6834/1393840132 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a23fd8fbc0 con 0x55a23fdd5880 2023-10-16T13:12:42.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.838+0000 7f31c57fa700 10 client.24791 handle_command_reply: tid=0 2023-10-16T13:12:42.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.838+0000 7f31f0178b80 1 client.24791 shutdown 2023-10-16T13:12:42.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.838+0000 7f31f0178b80 1 -- 172.21.15.92:0/3959889586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdbfdd0 msgr2=0x55a23fdc9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.838+0000 7f31f0178b80 1 --2- 172.21.15.92:0/3959889586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdbfdd0 0x55a23fdc9bb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f31d800ba90 tx=0x7f31d800bda0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.838+0000 7f31f0178b80 1 -- 172.21.15.92:0/3959889586 shutdown_connections 2023-10-16T13:12:42.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.838+0000 7f31f0178b80 1 --2- 172.21.15.92:0/3959889586 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x55a23fdd5880 0x55a23fdd42e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.839+0000 7f31c57fa700 0 client.24791 ms_handle_reset on v2:172.21.15.152:6834/1393840132 2023-10-16T13:12:42.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.838+0000 7f31f0178b80 1 --2- 172.21.15.92:0/3959889586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdc15d0 0x55a23fdd1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.839+0000 7f31f0178b80 1 --2- 172.21.15.92:0/3959889586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdbfdd0 0x55a23fdc9bb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.839+0000 7f31f0178b80 1 --2- 172.21.15.92:0/3959889586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdc0730 0x55a23fdca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.839+0000 7f31f0178b80 1 -- 172.21.15.92:0/3959889586 >> 172.21.15.92:0/3959889586 conn(0x55a23fcedd80 msgr2=0x55a23fdbaba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:42.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.839+0000 7f31f0178b80 1 -- 172.21.15.92:0/3959889586 shutdown_connections 2023-10-16T13:12:42.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.839+0000 7f31f0178b80 1 -- 172.21.15.92:0/3959889586 wait complete. 2023-10-16T13:12:42.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.839+0000 7f31f0178b80 20 client.24791 trim_cache size 0 max 16384 2023-10-16T13:12:42.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.856+0000 7f31f0178b80 1 Processor -- start 2023-10-16T13:12:42.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.856+0000 7f31f0178b80 1 -- start start 2023-10-16T13:12:42.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31f0178b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdbfdd0 0x55a23fdc4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31f0178b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdc0730 0x55a23fdc4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31f0178b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdc15d0 0x55a23fdd1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31f0178b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23fb938d0 con 0x55a23fdc15d0 2023-10-16T13:12:42.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31f0178b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23fd17ea0 con 0x55a23fdc0730 2023-10-16T13:12:42.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31f0178b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23fdbfa70 con 0x55a23fdbfdd0 2023-10-16T13:12:42.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31e252b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdc15d0 0x55a23fdd1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31e252b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdc15d0 0x55a23fdd1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36146/0 (socket says 172.21.15.92:36146) 2023-10-16T13:12:42.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31e252b700 1 -- 172.21.15.92:0/471309900 learned_addr learned my addr 172.21.15.92:0/471309900 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:42.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31e1529700 1 --2- 172.21.15.92:0/471309900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdc0730 0x55a23fdc4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31e1d2a700 1 --2- 172.21.15.92:0/471309900 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdbfdd0 0x55a23fdc4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31e252b700 1 -- 172.21.15.92:0/471309900 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdbfdd0 msgr2=0x55a23fdc4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31e252b700 1 --2- 172.21.15.92:0/471309900 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdbfdd0 0x55a23fdc4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31e252b700 1 -- 172.21.15.92:0/471309900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdc0730 msgr2=0x55a23fdc4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31e252b700 1 --2- 172.21.15.92:0/471309900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdc0730 0x55a23fdc4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31e252b700 1 -- 172.21.15.92:0/471309900 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a23fb26c10 con 0x55a23fdc15d0 2023-10-16T13:12:42.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31e1d2a700 1 --2- 172.21.15.92:0/471309900 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdbfdd0 0x55a23fdc4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:12:42.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31e1529700 1 --2- 172.21.15.92:0/471309900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdc0730 0x55a23fdc4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:12:42.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31e252b700 1 --2- 172.21.15.92:0/471309900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdc15d0 0x55a23fdd1050 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f31d4099910 tx=0x7f31d4099820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a2e4515bec6e60 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:42.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31d0ff9700 1 -- 172.21.15.92:0/471309900 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d409a310 con 0x55a23fdc15d0 2023-10-16T13:12:42.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31d0ff9700 1 -- 172.21.15.92:0/471309900 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f31d4099c10 con 0x55a23fdc15d0 2023-10-16T13:12:42.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.857+0000 7f31d0ff9700 1 -- 172.21.15.92:0/471309900 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d4099e70 con 0x55a23fdc15d0 2023-10-16T13:12:42.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.858+0000 7f31f0178b80 1 -- 172.21.15.92:0/471309900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdc15d0 msgr2=0x55a23fdd1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.858+0000 7f31f0178b80 1 --2- 172.21.15.92:0/471309900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdc15d0 0x55a23fdd1050 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f31d4099910 tx=0x7f31d4099820 comp rx=0 tx=0).stop 2023-10-16T13:12:42.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.858+0000 7f31f0178b80 1 -- 172.21.15.92:0/471309900 shutdown_connections 2023-10-16T13:12:42.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.858+0000 7f31f0178b80 1 --2- 172.21.15.92:0/471309900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdc15d0 0x55a23fdd1050 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.858+0000 7f31f0178b80 1 --2- 172.21.15.92:0/471309900 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdbfdd0 0x55a23fdc4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.858+0000 7f31f0178b80 1 --2- 172.21.15.92:0/471309900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdc0730 0x55a23fdc4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.858+0000 7f31f0178b80 1 -- 172.21.15.92:0/471309900 >> 172.21.15.92:0/471309900 conn(0x55a23fcedd80 msgr2=0x55a23fdb9750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:42.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.858+0000 7f31f0178b80 1 -- 172.21.15.92:0/471309900 shutdown_connections 2023-10-16T13:12:42.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.858+0000 7f31f0178b80 1 -- 172.21.15.92:0/471309900 wait complete. 2023-10-16T13:12:42.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.858+0000 7f31f0178b80 1 -- start start 2023-10-16T13:12:42.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.859+0000 7f31f0178b80 1 Processor -- start 2023-10-16T13:12:42.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.859+0000 7f31f0178b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdbfdd0 0x55a23fdcdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.859+0000 7f31f0178b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdc0730 0x55a23fdce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.859+0000 7f31f0178b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdc15d0 0x55a23fe29270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.859+0000 7f31f0178b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23fdcebd0 con 0x55a23fdbfdd0 2023-10-16T13:12:42.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.859+0000 7f31f0178b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23fe297b0 con 0x55a23fdc15d0 2023-10-16T13:12:42.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.859+0000 7f31f0178b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23fe29970 con 0x55a23fdc0730 2023-10-16T13:12:42.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.859+0000 7f31f0178b80 10 client.0 _ll_register_callbacks cb 0x7f31d8004400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:12:42.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.859+0000 7f31e1d2a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdbfdd0 0x55a23fdcdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.859+0000 7f31e1d2a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdbfdd0 0x55a23fdcdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36148/0 (socket says 172.21.15.92:36148) 2023-10-16T13:12:42.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.859+0000 7f31e1d2a700 1 -- 172.21.15.92:0/91828543 learned_addr learned my addr 172.21.15.92:0/91828543 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:42.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.859+0000 7f31e252b700 1 --2- 172.21.15.92:0/91828543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdc15d0 0x55a23fe29270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.859+0000 7f31e1d2a700 1 -- 172.21.15.92:0/91828543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdc0730 msgr2=0x55a23fdce4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T13:12:42.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.859+0000 7f31e1d2a700 1 --2- 172.21.15.92:0/91828543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdc0730 0x55a23fdce4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.859+0000 7f31e1d2a700 1 -- 172.21.15.92:0/91828543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdc15d0 msgr2=0x55a23fe29270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:42.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.859+0000 7f31e1d2a700 1 --2- 172.21.15.92:0/91828543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdc15d0 0x55a23fe29270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.859+0000 7f31e1d2a700 1 -- 172.21.15.92:0/91828543 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a23fcd03a0 con 0x55a23fdbfdd0 2023-10-16T13:12:42.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.860+0000 7f31e1d2a700 1 --2- 172.21.15.92:0/91828543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdbfdd0 0x55a23fdcdf80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f31d8005a80 tx=0x7f31d8005560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1785f68dd9e448d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:42.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.860+0000 7f31c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:12:42.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.860+0000 7f31c57fa700 1 -- 172.21.15.92:0/91828543 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d802b070 con 0x55a23fdbfdd0 2023-10-16T13:12:42.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.860+0000 7f31c57fa700 1 -- 172.21.15.92:0/91828543 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f31d8000e40 con 0x55a23fdbfdd0 2023-10-16T13:12:42.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.860+0000 7f31f0178b80 1 -- 172.21.15.92:0/91828543 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f31cc01e040 con 0x55a23fdbfdd0 2023-10-16T13:12:42.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.860+0000 7f31c57fa700 1 -- 172.21.15.92:0/91828543 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31d800bed0 con 0x55a23fdbfdd0 2023-10-16T13:12:42.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.860+0000 7f31f0178b80 10 client.15081 fetch_fsmap learned FSMap version 27 2023-10-16T13:12:42.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.860+0000 7f31f0178b80 1 -- 172.21.15.92:0/91828543 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f31dc1a1320 con 0x55a23fdbfdd0 2023-10-16T13:12:42.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.860+0000 7f31c57fa700 1 -- 172.21.15.92:0/91828543 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f31cc01e040 con 0x55a23fdbfdd0 2023-10-16T13:12:42.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.860+0000 7f31c57fa700 1 -- 172.21.15.92:0/91828543 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f31d8010880 con 0x55a23fdbfdd0 2023-10-16T13:12:42.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.860+0000 7f31f0178b80 10 client.15081 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:12:42.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.860+0000 7f31f0178b80 10 client.15081 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-16T13:12:42.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.860+0000 7f31f0178b80 20 client.15081 populate_metadata read hostname 'smithi092' 2023-10-16T13:12:42.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.860+0000 7f31f0178b80 1 --2- 172.21.15.92:0/91828543 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x55a23fdd5880 0x55a23fe2b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:42.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.860+0000 7f31f0178b80 4 client.15081 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:12:42.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.860+0000 7f31f0178b80 1 -- 172.21.15.92:0/91828543 --> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a23fd0be00 con 0x55a23fdd5880 2023-10-16T13:12:42.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.861+0000 7f31e1529700 1 --2- 172.21.15.92:0/91828543 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x55a23fdd5880 0x55a23fe2b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:42.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.861+0000 7f31c57fa700 10 client.15081 ms_handle_connect on v2:172.21.15.152:6834/1393840132 2023-10-16T13:12:42.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.861+0000 7f31e1529700 1 --2- 172.21.15.92:0/91828543 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x55a23fdd5880 0x55a23fe2b060 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=583543be411171a5 server_cookie=53bdc8645268b70c in_seq=0 out_seq=0 2023-10-16T13:12:42.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.861+0000 7f31c57fa700 1 -- 172.21.15.92:0/91828543 <== mds.2 v2:172.21.15.152:6834/1393840132 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55a23fd0be00 con 0x55a23fdd5880 2023-10-16T13:12:42.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.861+0000 7f31c57fa700 10 client.15081 handle_command_reply: tid=0 2023-10-16T13:12:42.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.861+0000 7f31f0178b80 1 client.15081 shutdown 2023-10-16T13:12:42.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.861+0000 7f31f0178b80 1 -- 172.21.15.92:0/91828543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdbfdd0 msgr2=0x55a23fdcdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.861+0000 7f31f0178b80 1 --2- 172.21.15.92:0/91828543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdbfdd0 0x55a23fdcdf80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f31d8005a80 tx=0x7f31d8005560 comp rx=0 tx=0).stop 2023-10-16T13:12:42.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.861+0000 7f31f0178b80 1 -- 172.21.15.92:0/91828543 shutdown_connections 2023-10-16T13:12:42.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.861+0000 7f31f0178b80 1 --2- 172.21.15.92:0/91828543 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x55a23fdd5880 0x55a23fe2b060 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.861+0000 7f31f0178b80 1 --2- 172.21.15.92:0/91828543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a23fdbfdd0 0x55a23fdcdf80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.861+0000 7f31f0178b80 1 --2- 172.21.15.92:0/91828543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a23fdc15d0 0x55a23fe29270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.861+0000 7f31c57fa700 0 client.15081 ms_handle_reset on v2:172.21.15.152:6834/1393840132 2023-10-16T13:12:42.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.861+0000 7f31f0178b80 1 --2- 172.21.15.92:0/91828543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a23fdc0730 0x55a23fdce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.861+0000 7f31f0178b80 1 -- 172.21.15.92:0/91828543 >> 172.21.15.92:0/91828543 conn(0x55a23fcedd80 msgr2=0x55a23fdc79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:42.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.862+0000 7f31f0178b80 1 -- 172.21.15.92:0/91828543 shutdown_connections 2023-10-16T13:12:42.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.862+0000 7f31f0178b80 1 -- 172.21.15.92:0/91828543 wait complete. 2023-10-16T13:12:42.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.862+0000 7f31f0178b80 20 client.15081 trim_cache size 0 max 16384 2023-10-16T13:12:42.895 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:12:42.895 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "6c276d7e-6c24-11ee-8db6-212e2dc638e7", 2023-10-16T13:12:42.896 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 2, 2023-10-16T13:12:42.896 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24460, 2023-10-16T13:12:42.896 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2023-10-16T13:12:42.896 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2023-10-16T13:12:42.896 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2023-10-16T13:12:42.897 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 57.560578849999999, 2023-10-16T13:12:42.897 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2023-10-16T13:12:42.897 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 85, 2023-10-16T13:12:42.897 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2023-10-16T13:12:42.897 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 83.452851531999997 2023-10-16T13:12:42.898 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:12:42.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.862+0000 7f31e3f8e700 1 -- 172.21.15.92:0/1826062308 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f31c80a1550 msgr2=0x7f31c80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.862+0000 7f31e3f8e700 1 --2- 172.21.15.92:0/1826062308 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f31c80a1550 0x7f31c80a3a10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00b2e0 tx=0x7f31cc005fb0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.862+0000 7f31e3f8e700 1 -- 172.21.15.92:0/1826062308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31dc102bc0 msgr2=0x7f31dc100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:42.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.862+0000 7f31e3f8e700 1 --2- 172.21.15.92:0/1826062308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31dc102bc0 0x7f31dc100710 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f31d400ef30 tx=0x7f31d400c3a0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.862+0000 7f31e3f8e700 1 -- 172.21.15.92:0/1826062308 shutdown_connections 2023-10-16T13:12:42.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.862+0000 7f31e3f8e700 1 --2- 172.21.15.92:0/1826062308 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f31c80a1550 0x7f31c80a3a10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.862+0000 7f31e3f8e700 1 --2- 172.21.15.92:0/1826062308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31dc102bc0 0x7f31dc100710 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.862+0000 7f31e3f8e700 1 --2- 172.21.15.92:0/1826062308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31dc0ff1b0 0x7f31dc101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.862+0000 7f31e3f8e700 1 --2- 172.21.15.92:0/1826062308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31dc102220 0x7f31dc1001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:42.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.862+0000 7f31e3f8e700 1 -- 172.21.15.92:0/1826062308 >> 172.21.15.92:0/1826062308 conn(0x7f31dc0faac0 msgr2=0x7f31dc105660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:42.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.862+0000 7f31e3f8e700 1 -- 172.21.15.92:0/1826062308 shutdown_connections 2023-10-16T13:12:42.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:42.862+0000 7f31e3f8e700 1 -- 172.21.15.92:0/1826062308 wait complete. 2023-10-16T13:12:42.902 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-16T13:12:43.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.027+0000 7ff88f764700 1 -- 172.21.15.92:0/440602415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888102160 msgr2=0x7ff8881025c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:43.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.027+0000 7ff88f764700 1 --2- 172.21.15.92:0/440602415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888102160 0x7ff8881025c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff878009990 tx=0x7ff878009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.027+0000 7ff88f764700 1 -- 172.21.15.92:0/440602415 shutdown_connections 2023-10-16T13:12:43.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.027+0000 7ff88f764700 1 --2- 172.21.15.92:0/440602415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff888102b00 0x7ff8881093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.027+0000 7ff88f764700 1 --2- 172.21.15.92:0/440602415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8880ff190 0x7ff8880ff5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.027+0000 7ff88f764700 1 --2- 172.21.15.92:0/440602415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888102160 0x7ff8881025c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.027+0000 7ff88f764700 1 -- 172.21.15.92:0/440602415 >> 172.21.15.92:0/440602415 conn(0x7ff8880faac0 msgr2=0x7ff8880fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:43.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.027+0000 7ff88f764700 1 -- 172.21.15.92:0/440602415 shutdown_connections 2023-10-16T13:12:43.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.027+0000 7ff88f764700 1 -- 172.21.15.92:0/440602415 wait complete. 2023-10-16T13:12:43.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88f764700 1 Processor -- start 2023-10-16T13:12:43.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88f764700 1 -- start start 2023-10-16T13:12:43.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88f764700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8880ff190 0x7ff888196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88f764700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff888102160 0x7ff888197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88f764700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888102b00 0x7ff88819e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88f764700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88819e760 con 0x7ff888102b00 2023-10-16T13:12:43.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88f764700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88819e8d0 con 0x7ff888102160 2023-10-16T13:12:43.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88f764700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88819ea90 con 0x7ff8880ff190 2023-10-16T13:12:43.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88dd01700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888102b00 0x7ff88819e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88d500700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8880ff190 0x7ff888196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88d500700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8880ff190 0x7ff888196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.92:42992/0 (socket says 172.21.15.92:42992) 2023-10-16T13:12:43.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88dd01700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888102b00 0x7ff88819e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36166/0 (socket says 172.21.15.92:36166) 2023-10-16T13:12:43.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88d500700 1 -- 172.21.15.92:0/2507209142 learned_addr learned my addr 172.21.15.92:0/2507209142 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:43.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88ccff700 1 --2- 172.21.15.92:0/2507209142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff888102160 0x7ff888197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88dd01700 1 -- 172.21.15.92:0/2507209142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8880ff190 msgr2=0x7ff888196c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:43.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88dd01700 1 --2- 172.21.15.92:0/2507209142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8880ff190 0x7ff888196c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88dd01700 1 -- 172.21.15.92:0/2507209142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff888102160 msgr2=0x7ff888197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:43.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88dd01700 1 --2- 172.21.15.92:0/2507209142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff888102160 0x7ff888197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88dd01700 1 -- 172.21.15.92:0/2507209142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8780095f0 con 0x7ff888102b00 2023-10-16T13:12:43.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.028+0000 7ff88d500700 1 --2- 172.21.15.92:0/2507209142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8880ff190 0x7ff888196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:12:43.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.029+0000 7ff88dd01700 1 --2- 172.21.15.92:0/2507209142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888102b00 0x7ff88819e190 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff88000be20 tx=0x7ff880009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:43.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.029+0000 7ff87e7fc700 1 -- 172.21.15.92:0/2507209142 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88000cb90 con 0x7ff888102b00 2023-10-16T13:12:43.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.029+0000 7ff88f764700 1 -- 172.21.15.92:0/2507209142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8880fffb0 con 0x7ff888102b00 2023-10-16T13:12:43.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.029+0000 7ff87e7fc700 1 -- 172.21.15.92:0/2507209142 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff88000ccf0 con 0x7ff888102b00 2023-10-16T13:12:43.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.029+0000 7ff87e7fc700 1 -- 172.21.15.92:0/2507209142 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880012700 con 0x7ff888102b00 2023-10-16T13:12:43.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.029+0000 7ff88f764700 1 -- 172.21.15.92:0/2507209142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff888100540 con 0x7ff888102b00 2023-10-16T13:12:43.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.031+0000 7ff87e7fc700 1 -- 172.21.15.92:0/2507209142 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7ff880014440 con 0x7ff888102b00 2023-10-16T13:12:43.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.032+0000 7ff87e7fc700 1 --2- 172.21.15.92:0/2507209142 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff8740a1550 0x7ff8740a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.032+0000 7ff88d500700 1 --2- 172.21.15.92:0/2507209142 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff8740a1550 0x7ff8740a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.032+0000 7ff87e7fc700 1 -- 172.21.15.92:0/2507209142 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff880006e40 con 0x7ff888102b00 2023-10-16T13:12:43.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.033+0000 7ff88d500700 1 --2- 172.21.15.92:0/2507209142 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff8740a1550 0x7ff8740a3a10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff8881980f0 tx=0x7ff884009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:43.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.033+0000 7ff89b94eb80 1 Processor -- start 2023-10-16T13:12:43.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.033+0000 7ff89b94eb80 1 -- start start 2023-10-16T13:12:43.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.033+0000 7ff89b94eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436cdd0 0x55e8e436d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.033+0000 7ff89b94eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436d730 0x55e8e436dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.033+0000 7ff89b94eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436e5d0 0x55e8e436ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.033+0000 7ff89b94eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e42e1c20 con 0x55e8e436cdd0 2023-10-16T13:12:43.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.033+0000 7ff89b94eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e42c6c10 con 0x55e8e436e5d0 2023-10-16T13:12:43.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.033+0000 7ff89b94eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e42c4530 con 0x55e8e436d730 2023-10-16T13:12:43.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.033+0000 7ff88d500700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436cdd0 0x55e8e436d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.033+0000 7ff88d500700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436cdd0 0x55e8e436d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36170/0 (socket says 172.21.15.92:36170) 2023-10-16T13:12:43.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.033+0000 7ff88d500700 1 -- 172.21.15.92:0/3732015167 learned_addr learned my addr 172.21.15.92:0/3732015167 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:43.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.033+0000 7ff88ccff700 1 --2- 172.21.15.92:0/3732015167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436d730 0x55e8e436dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.034+0000 7ff88dd01700 1 --2- 172.21.15.92:0/3732015167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436e5d0 0x55e8e436ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.034+0000 7ff88d500700 1 -- 172.21.15.92:0/3732015167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436d730 msgr2=0x55e8e436dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:43.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.034+0000 7ff88d500700 1 --2- 172.21.15.92:0/3732015167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436d730 0x55e8e436dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.034+0000 7ff88d500700 1 -- 172.21.15.92:0/3732015167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436e5d0 msgr2=0x55e8e436ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:43.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.034+0000 7ff88d500700 1 --2- 172.21.15.92:0/3732015167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436e5d0 0x55e8e436ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.034+0000 7ff88d500700 1 -- 172.21.15.92:0/3732015167 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8e427d3a0 con 0x55e8e436cdd0 2023-10-16T13:12:43.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.034+0000 7ff88dd01700 1 --2- 172.21.15.92:0/3732015167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436e5d0 0x55e8e436ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:12:43.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.034+0000 7ff88d500700 1 --2- 172.21.15.92:0/3732015167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436cdd0 0x55e8e436d1f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff8840043c0 tx=0x7ff884014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f63d0a2469f30fa server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:43.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.034+0000 7ff8737fe700 1 -- 172.21.15.92:0/3732015167 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff884003d10 con 0x55e8e436cdd0 2023-10-16T13:12:43.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.034+0000 7ff8737fe700 1 -- 172.21.15.92:0/3732015167 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff884003e70 con 0x55e8e436cdd0 2023-10-16T13:12:43.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.034+0000 7ff8737fe700 1 -- 172.21.15.92:0/3732015167 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88400e870 con 0x55e8e436cdd0 2023-10-16T13:12:43.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.035+0000 7ff89b94eb80 1 -- 172.21.15.92:0/3732015167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436cdd0 msgr2=0x55e8e436d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:43.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.035+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/3732015167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436cdd0 0x55e8e436d1f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff8840043c0 tx=0x7ff884014000 comp rx=0 tx=0).stop 2023-10-16T13:12:43.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.035+0000 7ff89b94eb80 1 -- 172.21.15.92:0/3732015167 shutdown_connections 2023-10-16T13:12:43.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.035+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/3732015167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436cdd0 0x55e8e436d1f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.035+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/3732015167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436e5d0 0x55e8e436ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.035+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/3732015167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436d730 0x55e8e436dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.035+0000 7ff89b94eb80 1 -- 172.21.15.92:0/3732015167 >> 172.21.15.92:0/3732015167 conn(0x55e8e429ad80 msgr2=0x55e8e4367f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:43.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.035+0000 7ff89b94eb80 1 -- 172.21.15.92:0/3732015167 shutdown_connections 2023-10-16T13:12:43.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.035+0000 7ff89b94eb80 1 -- 172.21.15.92:0/3732015167 wait complete. 2023-10-16T13:12:43.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.035+0000 7ff89b94eb80 1 -- start start 2023-10-16T13:12:43.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.035+0000 7ff89b94eb80 1 Processor -- start 2023-10-16T13:12:43.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.035+0000 7ff89b94eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436cdd0 0x55e8e4376c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff89b94eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436d730 0x55e8e43771a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff89b94eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436e5d0 0x55e8e437e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff89b94eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e42bfe20 con 0x55e8e436e5d0 2023-10-16T13:12:43.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff89b94eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e425c6c0 con 0x55e8e436d730 2023-10-16T13:12:43.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff89b94eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e425c360 con 0x55e8e436cdd0 2023-10-16T13:12:43.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff89b94eb80 10 client.0 _ll_register_callbacks cb 0x55e8e40b97b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:12:43.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff88dd01700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436e5d0 0x55e8e437e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff88dd01700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436e5d0 0x55e8e437e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36180/0 (socket says 172.21.15.92:36180) 2023-10-16T13:12:43.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff88dd01700 1 -- 172.21.15.92:0/2523793624 learned_addr learned my addr 172.21.15.92:0/2523793624 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:43.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff88ccff700 1 --2- 172.21.15.92:0/2523793624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436d730 0x55e8e43771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff88d500700 1 --2- 172.21.15.92:0/2523793624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436cdd0 0x55e8e4376c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff88dd01700 1 -- 172.21.15.92:0/2523793624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436cdd0 msgr2=0x55e8e4376c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:43.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff88dd01700 1 --2- 172.21.15.92:0/2523793624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436cdd0 0x55e8e4376c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff88dd01700 1 -- 172.21.15.92:0/2523793624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436d730 msgr2=0x55e8e43771a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:43.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff88dd01700 1 --2- 172.21.15.92:0/2523793624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436d730 0x55e8e43771a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff88dd01700 1 -- 172.21.15.92:0/2523793624 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff884017070 con 0x55e8e436e5d0 2023-10-16T13:12:43.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff88dd01700 1 --2- 172.21.15.92:0/2523793624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436e5d0 0x55e8e437e1e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff88000bfd0 tx=0x7ff88009a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928f7545c67d1a1d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:43.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff870ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:12:43.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff870ff9700 1 -- 172.21.15.92:0/2523793624 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88009da70 con 0x55e8e436e5d0 2023-10-16T13:12:43.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff870ff9700 1 -- 172.21.15.92:0/2523793624 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff8800a1cb0 con 0x55e8e436e5d0 2023-10-16T13:12:43.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff89b94eb80 1 -- 172.21.15.92:0/2523793624 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e8e42c4ea0 con 0x55e8e436e5d0 2023-10-16T13:12:43.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff870ff9700 1 -- 172.21.15.92:0/2523793624 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8800b90c0 con 0x55e8e436e5d0 2023-10-16T13:12:43.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff89b94eb80 10 client.15093 fetch_fsmap learned FSMap version 27 2023-10-16T13:12:43.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.036+0000 7ff89b94eb80 1 -- 172.21.15.92:0/2523793624 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e8e40ead90 con 0x55e8e436e5d0 2023-10-16T13:12:43.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.037+0000 7ff870ff9700 1 -- 172.21.15.92:0/2523793624 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55e8e42c4ea0 con 0x55e8e436e5d0 2023-10-16T13:12:43.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.037+0000 7ff870ff9700 1 -- 172.21.15.92:0/2523793624 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff8800a1820 con 0x55e8e436e5d0 2023-10-16T13:12:43.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.037+0000 7ff89b94eb80 10 client.15093 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:12:43.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.037+0000 7ff89b94eb80 10 client.15093 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-16T13:12:43.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.037+0000 7ff89b94eb80 20 client.15093 populate_metadata read hostname 'smithi092' 2023-10-16T13:12:43.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.037+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/2523793624 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55e8e4382720 0x55e8e4381250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.037+0000 7ff89b94eb80 4 client.15093 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:12:43.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.037+0000 7ff89b94eb80 1 -- 172.21.15.92:0/2523793624 --> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e8e433cbc0 con 0x55e8e4382720 2023-10-16T13:12:43.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.037+0000 7ff88d500700 1 --2- 172.21.15.92:0/2523793624 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55e8e4382720 0x55e8e4381250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.037+0000 7ff870ff9700 10 client.15093 ms_handle_connect on v2:172.21.15.152:6838/1821921588 2023-10-16T13:12:43.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.037+0000 7ff88d500700 1 --2- 172.21.15.92:0/2523793624 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55e8e4382720 0x55e8e4381250 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cde94f97692eebff server_cookie=8bfb1e69f72aac1 in_seq=0 out_seq=0 2023-10-16T13:12:43.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.038+0000 7ff870ff9700 1 -- 172.21.15.92:0/2523793624 <== mds.1 v2:172.21.15.152:6838/1821921588 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e8e433cbc0 con 0x55e8e4382720 2023-10-16T13:12:43.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.038+0000 7ff870ff9700 10 client.15093 handle_command_reply: tid=0 2023-10-16T13:12:43.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.038+0000 7ff89b94eb80 1 client.15093 shutdown 2023-10-16T13:12:43.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.038+0000 7ff89b94eb80 1 -- 172.21.15.92:0/2523793624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436e5d0 msgr2=0x55e8e437e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:43.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.038+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/2523793624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436e5d0 0x55e8e437e1e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff88000bfd0 tx=0x7ff88009a0a0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.038+0000 7ff89b94eb80 1 -- 172.21.15.92:0/2523793624 shutdown_connections 2023-10-16T13:12:43.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.038+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/2523793624 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55e8e4382720 0x55e8e4381250 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.038+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/2523793624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436e5d0 0x55e8e437e1e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.038+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/2523793624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436cdd0 0x55e8e4376c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.038+0000 7ff870ff9700 0 client.15093 ms_handle_reset on v2:172.21.15.152:6838/1821921588 2023-10-16T13:12:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.038+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/2523793624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436d730 0x55e8e43771a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.038+0000 7ff89b94eb80 1 -- 172.21.15.92:0/2523793624 >> 172.21.15.92:0/2523793624 conn(0x55e8e429ad80 msgr2=0x55e8e4367ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.038+0000 7ff89b94eb80 1 -- 172.21.15.92:0/2523793624 shutdown_connections 2023-10-16T13:12:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.038+0000 7ff89b94eb80 1 -- 172.21.15.92:0/2523793624 wait complete. 2023-10-16T13:12:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.038+0000 7ff89b94eb80 20 client.15093 trim_cache size 0 max 16384 2023-10-16T13:12:43.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff89b94eb80 1 Processor -- start 2023-10-16T13:12:43.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff89b94eb80 1 -- start start 2023-10-16T13:12:43.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff89b94eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436cdd0 0x55e8e43749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff89b94eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436d730 0x55e8e437e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff89b94eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436e5d0 0x55e8e4367ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff89b94eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e41408d0 con 0x55e8e436cdd0 2023-10-16T13:12:43.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff89b94eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e433cbc0 con 0x55e8e436d730 2023-10-16T13:12:43.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff89b94eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e42c4ea0 con 0x55e8e436e5d0 2023-10-16T13:12:43.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff88d500700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436cdd0 0x55e8e43749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff88d500700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436cdd0 0x55e8e43749b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36184/0 (socket says 172.21.15.92:36184) 2023-10-16T13:12:43.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff88d500700 1 -- 172.21.15.92:0/1699502381 learned_addr learned my addr 172.21.15.92:0/1699502381 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:43.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff88ccff700 1 --2- 172.21.15.92:0/1699502381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436d730 0x55e8e437e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff88dd01700 1 --2- 172.21.15.92:0/1699502381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436e5d0 0x55e8e4367ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff88d500700 1 -- 172.21.15.92:0/1699502381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436e5d0 msgr2=0x55e8e4367ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:43.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff88d500700 1 --2- 172.21.15.92:0/1699502381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436e5d0 0x55e8e4367ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff88d500700 1 -- 172.21.15.92:0/1699502381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436d730 msgr2=0x55e8e437e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:43.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff88d500700 1 --2- 172.21.15.92:0/1699502381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436d730 0x55e8e437e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff88d500700 1 -- 172.21.15.92:0/1699502381 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8e40d3c10 con 0x55e8e436cdd0 2023-10-16T13:12:43.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff88ccff700 1 --2- 172.21.15.92:0/1699502381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436d730 0x55e8e437e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:12:43.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.056+0000 7ff88d500700 1 --2- 172.21.15.92:0/1699502381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436cdd0 0x55e8e43749b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff884003960 tx=0x7ff884009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d2878e003a991f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:43.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.057+0000 7ff873fff700 1 -- 172.21.15.92:0/1699502381 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88402c050 con 0x55e8e436cdd0 2023-10-16T13:12:43.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.057+0000 7ff873fff700 1 -- 172.21.15.92:0/1699502381 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff88402d040 con 0x55e8e436cdd0 2023-10-16T13:12:43.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.057+0000 7ff873fff700 1 -- 172.21.15.92:0/1699502381 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff884005260 con 0x55e8e436cdd0 2023-10-16T13:12:43.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.057+0000 7ff89b94eb80 1 -- 172.21.15.92:0/1699502381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436cdd0 msgr2=0x55e8e43749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:43.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.057+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/1699502381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436cdd0 0x55e8e43749b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff884003960 tx=0x7ff884009810 comp rx=0 tx=0).stop 2023-10-16T13:12:43.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.057+0000 7ff89b94eb80 1 -- 172.21.15.92:0/1699502381 shutdown_connections 2023-10-16T13:12:43.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.057+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/1699502381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436cdd0 0x55e8e43749b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.057+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/1699502381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436e5d0 0x55e8e4367ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.057+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/1699502381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436d730 0x55e8e437e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.057+0000 7ff89b94eb80 1 -- 172.21.15.92:0/1699502381 >> 172.21.15.92:0/1699502381 conn(0x55e8e429ad80 msgr2=0x55e8e43671f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:43.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.057+0000 7ff89b94eb80 1 -- 172.21.15.92:0/1699502381 shutdown_connections 2023-10-16T13:12:43.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.057+0000 7ff89b94eb80 1 -- 172.21.15.92:0/1699502381 wait complete. 2023-10-16T13:12:43.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.058+0000 7ff89b94eb80 1 -- start start 2023-10-16T13:12:43.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.058+0000 7ff89b94eb80 1 Processor -- start 2023-10-16T13:12:43.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.058+0000 7ff89b94eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436cdd0 0x55e8e437ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.058+0000 7ff89b94eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436d730 0x55e8e437b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.058+0000 7ff89b94eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436e5d0 0x55e8e43d6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.058+0000 7ff89b94eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e437e240 con 0x55e8e436e5d0 2023-10-16T13:12:43.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.058+0000 7ff89b94eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e437e3b0 con 0x55e8e436cdd0 2023-10-16T13:12:43.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.058+0000 7ff89b94eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e437e570 con 0x55e8e436d730 2023-10-16T13:12:43.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.058+0000 7ff89b94eb80 10 client.0 _ll_register_callbacks cb 0x55e8e40b97b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:12:43.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.058+0000 7ff88dd01700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436e5d0 0x55e8e43d6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.058+0000 7ff88d500700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436cdd0 0x55e8e437ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.058+0000 7ff88dd01700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436e5d0 0x55e8e43d6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36194/0 (socket says 172.21.15.92:36194) 2023-10-16T13:12:43.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.058+0000 7ff88dd01700 1 -- 172.21.15.92:0/3507053800 learned_addr learned my addr 172.21.15.92:0/3507053800 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:43.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.058+0000 7ff88ccff700 1 --2- 172.21.15.92:0/3507053800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436d730 0x55e8e437b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.059+0000 7ff88dd01700 1 -- 172.21.15.92:0/3507053800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436d730 msgr2=0x55e8e437b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:43.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.059+0000 7ff88dd01700 1 --2- 172.21.15.92:0/3507053800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436d730 0x55e8e437b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.059+0000 7ff88dd01700 1 -- 172.21.15.92:0/3507053800 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436cdd0 msgr2=0x55e8e437ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:43.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.059+0000 7ff88dd01700 1 --2- 172.21.15.92:0/3507053800 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436cdd0 0x55e8e437ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.059+0000 7ff88dd01700 1 -- 172.21.15.92:0/3507053800 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e8e427d3a0 con 0x55e8e436e5d0 2023-10-16T13:12:43.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.059+0000 7ff88d500700 1 --2- 172.21.15.92:0/3507053800 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436cdd0 0x55e8e437ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:12:43.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.059+0000 7ff88dd01700 1 --2- 172.21.15.92:0/3507053800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436e5d0 0x55e8e43d6110 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff880014d10 tx=0x7ff8800ca480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c4734e3dcad61f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:43.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.059+0000 7ff870ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:12:43.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.059+0000 7ff870ff9700 1 -- 172.21.15.92:0/3507053800 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880099d80 con 0x55e8e436e5d0 2023-10-16T13:12:43.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.059+0000 7ff870ff9700 1 -- 172.21.15.92:0/3507053800 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff8800a1cb0 con 0x55e8e436e5d0 2023-10-16T13:12:43.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.059+0000 7ff89b94eb80 1 -- 172.21.15.92:0/3507053800 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff884003e70 con 0x55e8e436e5d0 2023-10-16T13:12:43.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.059+0000 7ff870ff9700 1 -- 172.21.15.92:0/3507053800 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff880098e10 con 0x55e8e436e5d0 2023-10-16T13:12:43.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.059+0000 7ff89b94eb80 10 client.15099 fetch_fsmap learned FSMap version 27 2023-10-16T13:12:43.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.059+0000 7ff89b94eb80 1 -- 172.21.15.92:0/3507053800 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e8e4111200 con 0x55e8e436e5d0 2023-10-16T13:12:43.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.059+0000 7ff870ff9700 1 -- 172.21.15.92:0/3507053800 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff88007c080 con 0x55e8e436e5d0 2023-10-16T13:12:43.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.060+0000 7ff870ff9700 1 -- 172.21.15.92:0/3507053800 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff8800840e0 con 0x55e8e436e5d0 2023-10-16T13:12:43.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.060+0000 7ff89b94eb80 10 client.15099 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:12:43.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.060+0000 7ff89b94eb80 10 client.15099 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-16T13:12:43.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.060+0000 7ff89b94eb80 20 client.15099 populate_metadata read hostname 'smithi092' 2023-10-16T13:12:43.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.060+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/3507053800 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55e8e43db260 0x55e8e43d7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.060+0000 7ff89b94eb80 4 client.15099 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:12:43.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.060+0000 7ff89b94eb80 1 -- 172.21.15.92:0/3507053800 --> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e8e42b8e00 con 0x55e8e43db260 2023-10-16T13:12:43.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.060+0000 7ff88d500700 1 --2- 172.21.15.92:0/3507053800 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55e8e43db260 0x55e8e43d7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.060+0000 7ff870ff9700 10 client.15099 ms_handle_connect on v2:172.21.15.152:6838/1821921588 2023-10-16T13:12:43.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.060+0000 7ff88d500700 1 --2- 172.21.15.92:0/3507053800 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55e8e43db260 0x55e8e43d7700 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a0e245124ac2df6b server_cookie=48c2541a79373064 in_seq=0 out_seq=0 2023-10-16T13:12:43.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.061+0000 7ff870ff9700 1 -- 172.21.15.92:0/3507053800 <== mds.1 v2:172.21.15.152:6838/1821921588 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55e8e42b8e00 con 0x55e8e43db260 2023-10-16T13:12:43.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.061+0000 7ff870ff9700 10 client.15099 handle_command_reply: tid=0 2023-10-16T13:12:43.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.061+0000 7ff89b94eb80 1 client.15099 shutdown 2023-10-16T13:12:43.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.062+0000 7ff89b94eb80 1 -- 172.21.15.92:0/3507053800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436e5d0 msgr2=0x55e8e43d6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:43.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.062+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/3507053800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436e5d0 0x55e8e43d6110 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff880014d10 tx=0x7ff8800ca480 comp rx=0 tx=0).stop 2023-10-16T13:12:43.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.062+0000 7ff89b94eb80 1 -- 172.21.15.92:0/3507053800 shutdown_connections 2023-10-16T13:12:43.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.062+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/3507053800 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55e8e43db260 0x55e8e43d7700 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.062+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/3507053800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e436e5d0 0x55e8e43d6110 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.062+0000 7ff870ff9700 0 client.15099 ms_handle_reset on v2:172.21.15.152:6838/1821921588 2023-10-16T13:12:43.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.062+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/3507053800 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e436cdd0 0x55e8e437ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.062+0000 7ff89b94eb80 1 --2- 172.21.15.92:0/3507053800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e436d730 0x55e8e437b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.062+0000 7ff89b94eb80 1 -- 172.21.15.92:0/3507053800 >> 172.21.15.92:0/3507053800 conn(0x55e8e429ad80 msgr2=0x55e8e4371540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:43.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.062+0000 7ff89b94eb80 1 -- 172.21.15.92:0/3507053800 shutdown_connections 2023-10-16T13:12:43.085 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.062+0000 7ff89b94eb80 1 -- 172.21.15.92:0/3507053800 wait complete. 2023-10-16T13:12:43.085 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.062+0000 7ff89b94eb80 20 client.15099 trim_cache size 0 max 16384 2023-10-16T13:12:43.085 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:12:43.086 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "6c276d7e-6c24-11ee-8db6-212e2dc638e7", 2023-10-16T13:12:43.086 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 1, 2023-10-16T13:12:43.086 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24490, 2023-10-16T13:12:43.086 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2023-10-16T13:12:43.086 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2023-10-16T13:12:43.087 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2023-10-16T13:12:43.087 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 58.746007595000002, 2023-10-16T13:12:43.087 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2023-10-16T13:12:43.087 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 85, 2023-10-16T13:12:43.087 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2023-10-16T13:12:43.087 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 76.612215296000002 2023-10-16T13:12:43.088 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:12:43.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.062+0000 7ff88f764700 1 -- 172.21.15.92:0/2507209142 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff8740a1550 msgr2=0x7ff8740a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:43.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.062+0000 7ff88f764700 1 --2- 172.21.15.92:0/2507209142 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff8740a1550 0x7ff8740a3a10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff8881980f0 tx=0x7ff884009260 comp rx=0 tx=0).stop 2023-10-16T13:12:43.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.062+0000 7ff88f764700 1 -- 172.21.15.92:0/2507209142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888102b00 msgr2=0x7ff88819e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:43.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.062+0000 7ff88f764700 1 --2- 172.21.15.92:0/2507209142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888102b00 0x7ff88819e190 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff88000be20 tx=0x7ff880009ed0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.063+0000 7ff88f764700 1 -- 172.21.15.92:0/2507209142 shutdown_connections 2023-10-16T13:12:43.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.063+0000 7ff88f764700 1 --2- 172.21.15.92:0/2507209142 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff8740a1550 0x7ff8740a3a10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.063+0000 7ff88f764700 1 --2- 172.21.15.92:0/2507209142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888102b00 0x7ff88819e190 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.063+0000 7ff88f764700 1 --2- 172.21.15.92:0/2507209142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8880ff190 0x7ff888196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.063+0000 7ff88f764700 1 --2- 172.21.15.92:0/2507209142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff888102160 0x7ff888197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.063+0000 7ff88f764700 1 -- 172.21.15.92:0/2507209142 >> 172.21.15.92:0/2507209142 conn(0x7ff8880faac0 msgr2=0x7ff8880fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:43.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.063+0000 7ff88f764700 1 -- 172.21.15.92:0/2507209142 shutdown_connections 2023-10-16T13:12:43.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.063+0000 7ff88f764700 1 -- 172.21.15.92:0/2507209142 wait complete. 2023-10-16T13:12:43.092 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-16T13:12:43.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.229+0000 7ff2ecb3c700 1 -- 172.21.15.92:0/2882985209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2e80ff200 msgr2=0x7ff2e80ff620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:43.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.229+0000 7ff2ecb3c700 1 --2- 172.21.15.92:0/2882985209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2e80ff200 0x7ff2e80ff620 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009990 tx=0x7ff2d8009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.229+0000 7ff2ecb3c700 1 -- 172.21.15.92:0/2882985209 shutdown_connections 2023-10-16T13:12:43.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.229+0000 7ff2ecb3c700 1 --2- 172.21.15.92:0/2882985209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2e80ff200 0x7ff2e80ff620 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.229+0000 7ff2ecb3c700 1 --2- 172.21.15.92:0/2882985209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2e8102c10 0x7ff2e81094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.229+0000 7ff2ecb3c700 1 --2- 172.21.15.92:0/2882985209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2e8102270 0x7ff2e81026d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.229+0000 7ff2ecb3c700 1 -- 172.21.15.92:0/2882985209 >> 172.21.15.92:0/2882985209 conn(0x7ff2e80faaf0 msgr2=0x7ff2e80fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:43.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.229+0000 7ff2ecb3c700 1 -- 172.21.15.92:0/2882985209 shutdown_connections 2023-10-16T13:12:43.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.229+0000 7ff2ecb3c700 1 -- 172.21.15.92:0/2882985209 wait complete. 2023-10-16T13:12:43.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.230+0000 7ff2ecb3c700 1 Processor -- start 2023-10-16T13:12:43.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.230+0000 7ff2ecb3c700 1 -- start start 2023-10-16T13:12:43.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.230+0000 7ff2ecb3c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2e80ff200 0x7ff2e8196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.230+0000 7ff2ecb3c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2e8102270 0x7ff2e8197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.230+0000 7ff2ecb3c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2e8102c10 0x7ff2e819e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.230+0000 7ff2ecb3c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e819e740 con 0x7ff2e80ff200 2023-10-16T13:12:43.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.230+0000 7ff2ecb3c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e819e880 con 0x7ff2e8102c10 2023-10-16T13:12:43.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.230+0000 7ff2ecb3c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e819ea10 con 0x7ff2e8102270 2023-10-16T13:12:43.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.230+0000 7ff2e659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2e80ff200 0x7ff2e8196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.230+0000 7ff2e659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2e80ff200 0x7ff2e8196bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36204/0 (socket says 172.21.15.92:36204) 2023-10-16T13:12:43.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.230+0000 7ff2e659c700 1 -- 172.21.15.92:0/501525112 learned_addr learned my addr 172.21.15.92:0/501525112 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:43.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.230+0000 7ff2e5d9b700 1 --2- 172.21.15.92:0/501525112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2e8102270 0x7ff2e8197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.230+0000 7ff2e6d9d700 1 --2- 172.21.15.92:0/501525112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2e8102c10 0x7ff2e819e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.230+0000 7ff2e659c700 1 -- 172.21.15.92:0/501525112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2e8102270 msgr2=0x7ff2e8197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:43.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.230+0000 7ff2e659c700 1 --2- 172.21.15.92:0/501525112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2e8102270 0x7ff2e8197100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.230+0000 7ff2e659c700 1 -- 172.21.15.92:0/501525112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2e8102c10 msgr2=0x7ff2e819e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:43.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.230+0000 7ff2e659c700 1 --2- 172.21.15.92:0/501525112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2e8102c10 0x7ff2e819e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.230+0000 7ff2e659c700 1 -- 172.21.15.92:0/501525112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d80095f0 con 0x7ff2e80ff200 2023-10-16T13:12:43.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.230+0000 7ff2e659c700 1 --2- 172.21.15.92:0/501525112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2e80ff200 0x7ff2e8196bc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80095c0 tx=0x7ff2d800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:43.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.231+0000 7ff2d77fe700 1 -- 172.21.15.92:0/501525112 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d801d070 con 0x7ff2e80ff200 2023-10-16T13:12:43.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.231+0000 7ff2d77fe700 1 -- 172.21.15.92:0/501525112 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff2d8005530 con 0x7ff2e80ff200 2023-10-16T13:12:43.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.231+0000 7ff2ecb3c700 1 -- 172.21.15.92:0/501525112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e819ec90 con 0x7ff2e80ff200 2023-10-16T13:12:43.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.231+0000 7ff2d77fe700 1 -- 172.21.15.92:0/501525112 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8004b40 con 0x7ff2e80ff200 2023-10-16T13:12:43.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.231+0000 7ff2ecb3c700 1 -- 172.21.15.92:0/501525112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e819f0b0 con 0x7ff2e80ff200 2023-10-16T13:12:43.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.233+0000 7ff2d77fe700 1 -- 172.21.15.92:0/501525112 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7ff2d8004d20 con 0x7ff2e80ff200 2023-10-16T13:12:43.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.234+0000 7ff2d77fe700 1 --2- 172.21.15.92:0/501525112 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff2d00a1550 0x7ff2d00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.234+0000 7ff2d77fe700 1 -- 172.21.15.92:0/501525112 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff2d80cdf60 con 0x7ff2e80ff200 2023-10-16T13:12:43.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.234+0000 7ff2e5d9b700 1 --2- 172.21.15.92:0/501525112 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff2d00a1550 0x7ff2d00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.235+0000 7ff2e5d9b700 1 --2- 172.21.15.92:0/501525112 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff2d00a1550 0x7ff2d00a3a10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc005950 tx=0x7ff2dc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:43.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.235+0000 7ff2f8d26b80 1 Processor -- start 2023-10-16T13:12:43.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.235+0000 7ff2f8d26b80 1 -- start start 2023-10-16T13:12:43.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.235+0000 7ff2f8d26b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 0x55a09577c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.235+0000 7ff2f8d26b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577cb40 0x55a09577d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.235+0000 7ff2f8d26b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577d9e0 0x55a09577de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.235+0000 7ff2f8d26b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0956ecc20 con 0x55a09577c1e0 2023-10-16T13:12:43.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.235+0000 7ff2f8d26b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0956d1c10 con 0x55a09577d9e0 2023-10-16T13:12:43.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.235+0000 7ff2f8d26b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0956cf530 con 0x55a09577cb40 2023-10-16T13:12:43.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.235+0000 7ff2e659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 0x55a09577c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.236+0000 7ff2e659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 0x55a09577c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36212/0 (socket says 172.21.15.92:36212) 2023-10-16T13:12:43.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.236+0000 7ff2e659c700 1 -- 172.21.15.92:0/3408354489 learned_addr learned my addr 172.21.15.92:0/3408354489 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:43.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.236+0000 7ff2e6d9d700 1 --2- 172.21.15.92:0/3408354489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577d9e0 0x55a09577de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.236+0000 7ff2e5d9b700 1 --2- 172.21.15.92:0/3408354489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577cb40 0x55a09577d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.236+0000 7ff2e659c700 1 -- 172.21.15.92:0/3408354489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577cb40 msgr2=0x55a09577d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:43.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.236+0000 7ff2e659c700 1 --2- 172.21.15.92:0/3408354489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577cb40 0x55a09577d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.236+0000 7ff2e659c700 1 -- 172.21.15.92:0/3408354489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577d9e0 msgr2=0x55a09577de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:43.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.236+0000 7ff2e659c700 1 --2- 172.21.15.92:0/3408354489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577d9e0 0x55a09577de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.236+0000 7ff2e659c700 1 -- 172.21.15.92:0/3408354489 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0956883a0 con 0x55a09577c1e0 2023-10-16T13:12:43.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.236+0000 7ff2e5d9b700 1 --2- 172.21.15.92:0/3408354489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577cb40 0x55a09577d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:12:43.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.236+0000 7ff2e659c700 1 --2- 172.21.15.92:0/3408354489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 0x55a09577c600 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80976b0 tx=0x7ff2d8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93fc98d08939411c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:43.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.236+0000 7ff2d4ff9700 1 -- 172.21.15.92:0/3408354489 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d809f120 con 0x55a09577c1e0 2023-10-16T13:12:43.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.236+0000 7ff2d4ff9700 1 -- 172.21.15.92:0/3408354489 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff2d809b8b0 con 0x55a09577c1e0 2023-10-16T13:12:43.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.236+0000 7ff2d4ff9700 1 -- 172.21.15.92:0/3408354489 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d809a8a0 con 0x55a09577c1e0 2023-10-16T13:12:43.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.237+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/3408354489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 msgr2=0x55a09577c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:43.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.237+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/3408354489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 0x55a09577c600 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80976b0 tx=0x7ff2d8009310 comp rx=0 tx=0).stop 2023-10-16T13:12:43.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.237+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/3408354489 shutdown_connections 2023-10-16T13:12:43.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.237+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/3408354489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 0x55a09577c600 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.237+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/3408354489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577d9e0 0x55a09577de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.237+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/3408354489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577cb40 0x55a09577d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.237+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/3408354489 >> 172.21.15.92:0/3408354489 conn(0x55a0956a5d80 msgr2=0x55a095772f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:43.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.237+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/3408354489 shutdown_connections 2023-10-16T13:12:43.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.237+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/3408354489 wait complete. 2023-10-16T13:12:43.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.237+0000 7ff2f8d26b80 1 -- start start 2023-10-16T13:12:43.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2f8d26b80 1 Processor -- start 2023-10-16T13:12:43.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2f8d26b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 0x55a095785de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2f8d26b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577cb40 0x55a095786320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2f8d26b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577d9e0 0x55a09578d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2f8d26b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0956cae20 con 0x55a09577c1e0 2023-10-16T13:12:43.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2f8d26b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0956676c0 con 0x55a09577cb40 2023-10-16T13:12:43.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2f8d26b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a095667360 con 0x55a09577d9e0 2023-10-16T13:12:43.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2f8d26b80 10 client.0 _ll_register_callbacks cb 0x55a0954c47b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:12:43.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2e659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 0x55a095785de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2e659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 0x55a095785de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36218/0 (socket says 172.21.15.92:36218) 2023-10-16T13:12:43.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2e659c700 1 -- 172.21.15.92:0/605807084 learned_addr learned my addr 172.21.15.92:0/605807084 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:43.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2e6d9d700 1 --2- 172.21.15.92:0/605807084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577d9e0 0x55a09578d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2e5d9b700 1 --2- 172.21.15.92:0/605807084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577cb40 0x55a095786320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2e659c700 1 -- 172.21.15.92:0/605807084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577d9e0 msgr2=0x55a09578d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:43.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2e659c700 1 --2- 172.21.15.92:0/605807084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577d9e0 0x55a09578d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2e659c700 1 -- 172.21.15.92:0/605807084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577cb40 msgr2=0x55a095786320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:43.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2e659c700 1 --2- 172.21.15.92:0/605807084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577cb40 0x55a095786320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2e659c700 1 -- 172.21.15.92:0/605807084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e819f0b0 con 0x55a09577c1e0 2023-10-16T13:12:43.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2e5d9b700 1 --2- 172.21.15.92:0/605807084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577cb40 0x55a095786320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:12:43.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2e659c700 1 --2- 172.21.15.92:0/605807084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 0x55a095785de0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8005f50 tx=0x7ff2d809ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cdb1bd476952ec5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:43.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:12:43.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.238+0000 7ff2cdffb700 1 -- 172.21.15.92:0/605807084 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80cb850 con 0x55a09577c1e0 2023-10-16T13:12:43.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.239+0000 7ff2cdffb700 1 -- 172.21.15.92:0/605807084 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff2d809b1b0 con 0x55a09577c1e0 2023-10-16T13:12:43.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.239+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/605807084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a0956cfea0 con 0x55a09577c1e0 2023-10-16T13:12:43.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.239+0000 7ff2cdffb700 1 -- 172.21.15.92:0/605807084 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2d809f120 con 0x55a09577c1e0 2023-10-16T13:12:43.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.239+0000 7ff2f8d26b80 10 client.15111 fetch_fsmap learned FSMap version 27 2023-10-16T13:12:43.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.239+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/605807084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a0954f5d90 con 0x55a09577c1e0 2023-10-16T13:12:43.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.239+0000 7ff2cdffb700 1 -- 172.21.15.92:0/605807084 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55a0956cfea0 con 0x55a09577c1e0 2023-10-16T13:12:43.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.239+0000 7ff2cdffb700 1 -- 172.21.15.92:0/605807084 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff2d809a110 con 0x55a09577c1e0 2023-10-16T13:12:43.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.239+0000 7ff2f8d26b80 10 client.15111 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:12:43.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.239+0000 7ff2f8d26b80 10 client.15111 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-16T13:12:43.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.239+0000 7ff2f8d26b80 20 client.15111 populate_metadata read hostname 'smithi092' 2023-10-16T13:12:43.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.239+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/605807084 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a0957913a0 0x55a095790200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.239+0000 7ff2f8d26b80 4 client.15111 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:12:43.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.239+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/605807084 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a095747bc0 con 0x55a0957913a0 2023-10-16T13:12:43.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.239+0000 7ff2e5d9b700 1 --2- 172.21.15.92:0/605807084 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a0957913a0 0x55a095790200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.240+0000 7ff2cdffb700 10 client.15111 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:12:43.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.240+0000 7ff2e5d9b700 1 --2- 172.21.15.92:0/605807084 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a0957913a0 0x55a095790200 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb5f952c92faf9fe server_cookie=141f42cfd03a166b in_seq=0 out_seq=0 2023-10-16T13:12:43.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.240+0000 7ff2cdffb700 1 -- 172.21.15.92:0/605807084 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a095747bc0 con 0x55a0957913a0 2023-10-16T13:12:43.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.240+0000 7ff2cdffb700 10 client.15111 handle_command_reply: tid=0 2023-10-16T13:12:43.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.240+0000 7ff2f8d26b80 1 client.15111 shutdown 2023-10-16T13:12:43.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.241+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/605807084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 msgr2=0x55a095785de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:43.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.241+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/605807084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 0x55a095785de0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8005f50 tx=0x7ff2d809ba20 comp rx=0 tx=0).stop 2023-10-16T13:12:43.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.241+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/605807084 shutdown_connections 2023-10-16T13:12:43.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.241+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/605807084 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a0957913a0 0x55a095790200 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.241+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/605807084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 0x55a095785de0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.241+0000 7ff2cdffb700 0 client.15111 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:12:43.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.241+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/605807084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577d9e0 0x55a09578d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.241+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/605807084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577cb40 0x55a095786320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.241+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/605807084 >> 172.21.15.92:0/605807084 conn(0x55a0956a5d80 msgr2=0x55a095772ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:43.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.241+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/605807084 shutdown_connections 2023-10-16T13:12:43.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.241+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/605807084 wait complete. 2023-10-16T13:12:43.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.241+0000 7ff2f8d26b80 20 client.15111 trim_cache size 0 max 16384 2023-10-16T13:12:43.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.259+0000 7ff2f8d26b80 1 Processor -- start 2023-10-16T13:12:43.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.259+0000 7ff2f8d26b80 1 -- start start 2023-10-16T13:12:43.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.259+0000 7ff2f8d26b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 0x55a095790200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.259+0000 7ff2f8d26b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577cb40 0x55a09578d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.259+0000 7ff2f8d26b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577d9e0 0x55a095784a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.259+0000 7ff2f8d26b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09554b8d0 con 0x55a09577c1e0 2023-10-16T13:12:43.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.259+0000 7ff2f8d26b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09578ef40 con 0x55a09577cb40 2023-10-16T13:12:43.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.259+0000 7ff2f8d26b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0956d1c10 con 0x55a09577d9e0 2023-10-16T13:12:43.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.259+0000 7ff2e659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 0x55a095790200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.259+0000 7ff2e659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 0x55a095790200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36226/0 (socket says 172.21.15.92:36226) 2023-10-16T13:12:43.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.259+0000 7ff2e659c700 1 -- 172.21.15.92:0/2337880889 learned_addr learned my addr 172.21.15.92:0/2337880889 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:43.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.259+0000 7ff2e6d9d700 1 --2- 172.21.15.92:0/2337880889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577d9e0 0x55a095784a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.259+0000 7ff2e5d9b700 1 --2- 172.21.15.92:0/2337880889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577cb40 0x55a09578d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.259+0000 7ff2e659c700 1 -- 172.21.15.92:0/2337880889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577d9e0 msgr2=0x55a095784a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:43.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.259+0000 7ff2e659c700 1 --2- 172.21.15.92:0/2337880889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577d9e0 0x55a095784a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.259+0000 7ff2e659c700 1 -- 172.21.15.92:0/2337880889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577cb40 msgr2=0x55a09578d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:43.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.259+0000 7ff2e659c700 1 --2- 172.21.15.92:0/2337880889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577cb40 0x55a09578d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.259+0000 7ff2e659c700 1 -- 172.21.15.92:0/2337880889 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a095799fd0 con 0x55a09577c1e0 2023-10-16T13:12:43.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.259+0000 7ff2e659c700 1 --2- 172.21.15.92:0/2337880889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 0x55a095790200 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8099500 tx=0x7ff2d8009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123e4fa628c54c59 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:43.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.260+0000 7ff2d57fa700 1 -- 172.21.15.92:0/2337880889 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d809f120 con 0x55a09577c1e0 2023-10-16T13:12:43.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.260+0000 7ff2d57fa700 1 -- 172.21.15.92:0/2337880889 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff2d809b1b0 con 0x55a09577c1e0 2023-10-16T13:12:43.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.260+0000 7ff2d57fa700 1 -- 172.21.15.92:0/2337880889 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80b92d0 con 0x55a09577c1e0 2023-10-16T13:12:43.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.260+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/2337880889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 msgr2=0x55a095790200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:43.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.260+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/2337880889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 0x55a095790200 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8099500 tx=0x7ff2d8009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.260+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/2337880889 shutdown_connections 2023-10-16T13:12:43.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.260+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/2337880889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577c1e0 0x55a095790200 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.260+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/2337880889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577d9e0 0x55a095784a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.260+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/2337880889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577cb40 0x55a09578d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.260+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/2337880889 >> 172.21.15.92:0/2337880889 conn(0x55a0956a5d80 msgr2=0x55a0957721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:43.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.260+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/2337880889 shutdown_connections 2023-10-16T13:12:43.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.260+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/2337880889 wait complete. 2023-10-16T13:12:43.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2f8d26b80 1 -- start start 2023-10-16T13:12:43.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2f8d26b80 1 Processor -- start 2023-10-16T13:12:43.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2f8d26b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577c1e0 0x55a09578d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2f8d26b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577cb40 0x55a095789ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2f8d26b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577d9e0 0x55a09578a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2f8d26b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a095784880 con 0x55a09577cb40 2023-10-16T13:12:43.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2f8d26b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a095786b70 con 0x55a09577c1e0 2023-10-16T13:12:43.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2f8d26b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09578ab20 con 0x55a09577d9e0 2023-10-16T13:12:43.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2f8d26b80 10 client.0 _ll_register_callbacks cb 0x7ff2e0007950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:12:43.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2e5d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577cb40 0x55a095789ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2e5d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577cb40 0x55a095789ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36234/0 (socket says 172.21.15.92:36234) 2023-10-16T13:12:43.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2e5d9b700 1 -- 172.21.15.92:0/2259960002 learned_addr learned my addr 172.21.15.92:0/2259960002 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:43.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2e6d9d700 1 --2- 172.21.15.92:0/2259960002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577d9e0 0x55a09578a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2e659c700 1 --2- 172.21.15.92:0/2259960002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577c1e0 0x55a09578d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2e5d9b700 1 -- 172.21.15.92:0/2259960002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577d9e0 msgr2=0x55a09578a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:43.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2e5d9b700 1 --2- 172.21.15.92:0/2259960002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577d9e0 0x55a09578a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2e5d9b700 1 -- 172.21.15.92:0/2259960002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577c1e0 msgr2=0x55a09578d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:12:43.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2e5d9b700 1 --2- 172.21.15.92:0/2259960002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577c1e0 0x55a09578d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2e5d9b700 1 -- 172.21.15.92:0/2259960002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0954f5d90 con 0x55a09577cb40 2023-10-16T13:12:43.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2e5d9b700 1 --2- 172.21.15.92:0/2259960002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577cb40 0x55a095789ea0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55a095786970 tx=0x7ff2dc013070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e948930d92522c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:43.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.261+0000 7ff2cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:12:43.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.262+0000 7ff2cdffb700 1 -- 172.21.15.92:0/2259960002 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc026040 con 0x55a09577cb40 2023-10-16T13:12:43.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.262+0000 7ff2cdffb700 1 -- 172.21.15.92:0/2259960002 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff2dc017070 con 0x55a09577cb40 2023-10-16T13:12:43.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.262+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/2259960002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff2d809b8b0 con 0x55a09577cb40 2023-10-16T13:12:43.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.262+0000 7ff2cdffb700 1 -- 172.21.15.92:0/2259960002 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2dc0261a0 con 0x55a09577cb40 2023-10-16T13:12:43.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.262+0000 7ff2f8d26b80 10 client.15117 fetch_fsmap learned FSMap version 27 2023-10-16T13:12:43.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.262+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/2259960002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a0954dec10 con 0x55a09577cb40 2023-10-16T13:12:43.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.262+0000 7ff2cdffb700 1 -- 172.21.15.92:0/2259960002 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff2d809b8b0 con 0x55a09577cb40 2023-10-16T13:12:43.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.262+0000 7ff2cdffb700 1 -- 172.21.15.92:0/2259960002 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff2dc01e5e0 con 0x55a09577cb40 2023-10-16T13:12:43.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.262+0000 7ff2f8d26b80 10 client.15117 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:12:43.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.262+0000 7ff2f8d26b80 10 client.15117 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-16T13:12:43.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.262+0000 7ff2f8d26b80 20 client.15117 populate_metadata read hostname 'smithi092' 2023-10-16T13:12:43.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.262+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/2259960002 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a0957ea000 0x55a0957e6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:43.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.262+0000 7ff2f8d26b80 4 client.15117 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:12:43.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.262+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/2259960002 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a0956c3e00 con 0x55a0957ea000 2023-10-16T13:12:43.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.262+0000 7ff2e659c700 1 --2- 172.21.15.92:0/2259960002 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a0957ea000 0x55a0957e6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:43.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2cdffb700 10 client.15117 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:12:43.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2e659c700 1 --2- 172.21.15.92:0/2259960002 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a0957ea000 0x55a0957e6460 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68679e97b41d11a1 server_cookie=d1a38aafc9418e67 in_seq=0 out_seq=0 2023-10-16T13:12:43.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2cdffb700 1 -- 172.21.15.92:0/2259960002 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55a0956c3e00 con 0x55a0957ea000 2023-10-16T13:12:43.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2cdffb700 10 client.15117 handle_command_reply: tid=0 2023-10-16T13:12:43.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2f8d26b80 1 client.15117 shutdown 2023-10-16T13:12:43.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/2259960002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577cb40 msgr2=0x55a095789ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:43.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/2259960002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577cb40 0x55a095789ea0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55a095786970 tx=0x7ff2dc013070 comp rx=0 tx=0).stop 2023-10-16T13:12:43.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/2259960002 shutdown_connections 2023-10-16T13:12:43.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/2259960002 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a0957ea000 0x55a0957e6460 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/2259960002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a09577d9e0 0x55a09578a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2cdffb700 0 client.15117 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:12:43.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/2259960002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a09577c1e0 0x55a09578d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2f8d26b80 1 --2- 172.21.15.92:0/2259960002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09577cb40 0x55a095789ea0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/2259960002 >> 172.21.15.92:0/2259960002 conn(0x55a0956a5d80 msgr2=0x55a095790200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:43.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/2259960002 shutdown_connections 2023-10-16T13:12:43.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2f8d26b80 1 -- 172.21.15.92:0/2259960002 wait complete. 2023-10-16T13:12:43.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2f8d26b80 20 client.15117 trim_cache size 0 max 16384 2023-10-16T13:12:43.286 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:12:43.286 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "6c276d7e-6c24-11ee-8db6-212e2dc638e7", 2023-10-16T13:12:43.287 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 0, 2023-10-16T13:12:43.287 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24491, 2023-10-16T13:12:43.287 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2023-10-16T13:12:43.287 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2023-10-16T13:12:43.287 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2023-10-16T13:12:43.288 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 61.965795288000002, 2023-10-16T13:12:43.288 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2023-10-16T13:12:43.288 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 85, 2023-10-16T13:12:43.288 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2023-10-16T13:12:43.288 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 69.790211337000002 2023-10-16T13:12:43.289 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:12:43.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2ecb3c700 1 -- 172.21.15.92:0/501525112 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff2d00a1550 msgr2=0x7ff2d00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:43.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2ecb3c700 1 --2- 172.21.15.92:0/501525112 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff2d00a1550 0x7ff2d00a3a10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc005950 tx=0x7ff2dc00b410 comp rx=0 tx=0).stop 2023-10-16T13:12:43.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2ecb3c700 1 -- 172.21.15.92:0/501525112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2e80ff200 msgr2=0x7ff2e8196bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:43.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.263+0000 7ff2ecb3c700 1 --2- 172.21.15.92:0/501525112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2e80ff200 0x7ff2e8196bc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80095c0 tx=0x7ff2d800f690 comp rx=0 tx=0).stop 2023-10-16T13:12:43.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.264+0000 7ff2ecb3c700 1 -- 172.21.15.92:0/501525112 shutdown_connections 2023-10-16T13:12:43.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.264+0000 7ff2ecb3c700 1 --2- 172.21.15.92:0/501525112 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff2d00a1550 0x7ff2d00a3a10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.264+0000 7ff2ecb3c700 1 --2- 172.21.15.92:0/501525112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2e80ff200 0x7ff2e8196bc0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.264+0000 7ff2ecb3c700 1 --2- 172.21.15.92:0/501525112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2e8102c10 0x7ff2e819e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.264+0000 7ff2ecb3c700 1 --2- 172.21.15.92:0/501525112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2e8102270 0x7ff2e8197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:43.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.264+0000 7ff2ecb3c700 1 -- 172.21.15.92:0/501525112 >> 172.21.15.92:0/501525112 conn(0x7ff2e80faaf0 msgr2=0x7ff2e8105660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:43.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.264+0000 7ff2ecb3c700 1 -- 172.21.15.92:0/501525112 shutdown_connections 2023-10-16T13:12:43.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:43.264+0000 7ff2ecb3c700 1 -- 172.21.15.92:0/501525112 wait complete. 2023-10-16T13:12:43.293 INFO:tasks.cephadm:Setup complete, yielding 2023-10-16T13:12:43.293 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-16T13:12:43.818 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2023-10-16T13:12:43.819 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch status' 2023-10-16T13:12:43.820 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.821 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.821 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.821 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.822 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.822 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.823 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:12:43.823 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:12:43.823 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.823 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.823 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.824 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.824 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.824 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.824 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.824 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:12:43.825 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:12:43.825 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:43.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:12:43.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:12:43.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:12:44.380 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:44.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:44 smithi118 ceph-mon[103969]: pgmap v289: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s; 7.2 KiB/s, 1 keys/s, 2 objects/s recovering 2023-10-16T13:12:44.814 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:44 smithi092 ceph-mon[99542]: pgmap v289: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s; 7.2 KiB/s, 1 keys/s, 2 objects/s recovering 2023-10-16T13:12:44.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:44 smithi152 ceph-mon[104423]: pgmap v289: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s; 7.2 KiB/s, 1 keys/s, 2 objects/s recovering 2023-10-16T13:12:45.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.662+0000 7f246b93d700 1 -- 172.21.15.92:0/2456032692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2464101190 msgr2=0x7f2464107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:45.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.662+0000 7f246b93d700 1 --2- 172.21.15.92:0/2456032692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2464101190 0x7f2464107a40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f245c00c240 tx=0x7f245c00c550 comp rx=0 tx=0).stop 2023-10-16T13:12:45.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.662+0000 7f246b93d700 1 -- 172.21.15.92:0/2456032692 shutdown_connections 2023-10-16T13:12:45.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.662+0000 7f246b93d700 1 --2- 172.21.15.92:0/2456032692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2464101190 0x7f2464107a40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:45.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.662+0000 7f246b93d700 1 --2- 172.21.15.92:0/2456032692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24640ff5f0 0x7f24640ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:45.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.662+0000 7f246b93d700 1 --2- 172.21.15.92:0/2456032692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24641007f0 0x7f2464100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:45.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.662+0000 7f246b93d700 1 -- 172.21.15.92:0/2456032692 >> 172.21.15.92:0/2456032692 conn(0x7f24640fab70 msgr2=0x7f24640fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:45.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.662+0000 7f246b93d700 1 -- 172.21.15.92:0/2456032692 shutdown_connections 2023-10-16T13:12:45.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.662+0000 7f246b93d700 1 -- 172.21.15.92:0/2456032692 wait complete. 2023-10-16T13:12:45.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.662+0000 7f246b93d700 1 Processor -- start 2023-10-16T13:12:45.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f246b93d700 1 -- start start 2023-10-16T13:12:45.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f246b93d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24640ff5f0 0x7f2464196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:45.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f246b93d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24641007f0 0x7f2464197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:45.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f246b93d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2464101190 0x7f246419e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:45.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f246b93d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246419e870 con 0x7f24641007f0 2023-10-16T13:12:45.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f246b93d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246419e9b0 con 0x7f24640ff5f0 2023-10-16T13:12:45.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f246b93d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246419eb70 con 0x7f2464101190 2023-10-16T13:12:45.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f2468ed8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24641007f0 0x7f2464197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:45.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f2468ed8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24641007f0 0x7f2464197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36246/0 (socket says 172.21.15.92:36246) 2023-10-16T13:12:45.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f2468ed8700 1 -- 172.21.15.92:0/2108228282 learned_addr learned my addr 172.21.15.92:0/2108228282 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:45.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f24696d9700 1 --2- 172.21.15.92:0/2108228282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24640ff5f0 0x7f2464196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:45.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f2469eda700 1 --2- 172.21.15.92:0/2108228282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2464101190 0x7f246419e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:45.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f2468ed8700 1 -- 172.21.15.92:0/2108228282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2464101190 msgr2=0x7f246419e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:45.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f2468ed8700 1 --2- 172.21.15.92:0/2108228282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2464101190 0x7f246419e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:45.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f2468ed8700 1 -- 172.21.15.92:0/2108228282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24640ff5f0 msgr2=0x7f2464196d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:45.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f2468ed8700 1 --2- 172.21.15.92:0/2108228282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24640ff5f0 0x7f2464196d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:45.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f2468ed8700 1 -- 172.21.15.92:0/2108228282 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c00ae10 con 0x7f24641007f0 2023-10-16T13:12:45.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f24696d9700 1 --2- 172.21.15.92:0/2108228282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24640ff5f0 0x7f2464196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:12:45.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f2468ed8700 1 --2- 172.21.15.92:0/2108228282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24641007f0 0x7f2464197260 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f245400d950 tx=0x7f245400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:45.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f245a7fc700 1 -- 172.21.15.92:0/2108228282 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454009b40 con 0x7f24641007f0 2023-10-16T13:12:45.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f246b93d700 1 -- 172.21.15.92:0/2108228282 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f246419ee50 con 0x7f24641007f0 2023-10-16T13:12:45.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f245a7fc700 1 -- 172.21.15.92:0/2108228282 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2454009ca0 con 0x7f24641007f0 2023-10-16T13:12:45.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f245a7fc700 1 -- 172.21.15.92:0/2108228282 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245400f6b0 con 0x7f24641007f0 2023-10-16T13:12:45.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.663+0000 7f246b93d700 1 -- 172.21.15.92:0/2108228282 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246419f270 con 0x7f24641007f0 2023-10-16T13:12:45.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.665+0000 7f246b93d700 1 -- 172.21.15.92:0/2108228282 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246410a700 con 0x7f24641007f0 2023-10-16T13:12:45.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.666+0000 7f245a7fc700 1 -- 172.21.15.92:0/2108228282 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f2454010460 con 0x7f24641007f0 2023-10-16T13:12:45.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.666+0000 7f245a7fc700 1 --2- 172.21.15.92:0/2108228282 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f24500a1510 0x7f24500a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:45.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.666+0000 7f24696d9700 1 --2- 172.21.15.92:0/2108228282 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f24500a1510 0x7f24500a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:45.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.666+0000 7f245a7fc700 1 -- 172.21.15.92:0/2108228282 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f24540cd1e0 con 0x7f24641007f0 2023-10-16T13:12:45.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.666+0000 7f24696d9700 1 --2- 172.21.15.92:0/2108228282 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f24500a1510 0x7f24500a39d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2464198200 tx=0x7f246000a2b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:45.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.670+0000 7f245a7fc700 1 -- 172.21.15.92:0/2108228282 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f24540966e0 con 0x7f24641007f0 2023-10-16T13:12:45.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.878+0000 7f246b93d700 1 -- 172.21.15.92:0/2108228282 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f24641074d0 con 0x7f24500a1510 2023-10-16T13:12:45.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.879+0000 7f245a7fc700 1 -- 172.21.15.92:0/2108228282 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f24641074d0 con 0x7f24500a1510 2023-10-16T13:12:45.881 INFO:teuthology.orchestra.run.smithi092.stdout:Backend: cephadm 2023-10-16T13:12:45.882 INFO:teuthology.orchestra.run.smithi092.stdout:Available: Yes 2023-10-16T13:12:45.882 INFO:teuthology.orchestra.run.smithi092.stdout:Paused: No 2023-10-16T13:12:45.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.881+0000 7f246b93d700 1 -- 172.21.15.92:0/2108228282 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f24500a1510 msgr2=0x7f24500a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:45.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.881+0000 7f246b93d700 1 --2- 172.21.15.92:0/2108228282 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f24500a1510 0x7f24500a39d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2464198200 tx=0x7f246000a2b0 comp rx=0 tx=0).stop 2023-10-16T13:12:45.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.881+0000 7f246b93d700 1 -- 172.21.15.92:0/2108228282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24641007f0 msgr2=0x7f2464197260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:45.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.881+0000 7f246b93d700 1 --2- 172.21.15.92:0/2108228282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24641007f0 0x7f2464197260 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f245400d950 tx=0x7f245400dd10 comp rx=0 tx=0).stop 2023-10-16T13:12:45.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.882+0000 7f246b93d700 1 -- 172.21.15.92:0/2108228282 shutdown_connections 2023-10-16T13:12:45.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.882+0000 7f246b93d700 1 --2- 172.21.15.92:0/2108228282 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f24500a1510 0x7f24500a39d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:45.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.882+0000 7f246b93d700 1 --2- 172.21.15.92:0/2108228282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2464101190 0x7f246419e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:45.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.882+0000 7f246b93d700 1 --2- 172.21.15.92:0/2108228282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24640ff5f0 0x7f2464196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:45.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.882+0000 7f246b93d700 1 --2- 172.21.15.92:0/2108228282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24641007f0 0x7f2464197260 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:45.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.882+0000 7f246b93d700 1 -- 172.21.15.92:0/2108228282 >> 172.21.15.92:0/2108228282 conn(0x7f24640fab70 msgr2=0x7f2464105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:45.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.882+0000 7f246b93d700 1 -- 172.21.15.92:0/2108228282 shutdown_connections 2023-10-16T13:12:45.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:45.882+0000 7f246b93d700 1 -- 172.21.15.92:0/2108228282 wait complete. 2023-10-16T13:12:46.338 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch ps' 2023-10-16T13:12:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:46 smithi092 ceph-mon[99542]: pgmap v290: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 5.8 KiB/s, 1 keys/s, 1 objects/s recovering 2023-10-16T13:12:46.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:46 smithi118 ceph-mon[103969]: pgmap v290: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 5.8 KiB/s, 1 keys/s, 1 objects/s recovering 2023-10-16T13:12:46.898 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:46.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:46 smithi152 ceph-mon[104423]: pgmap v290: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 5.8 KiB/s, 1 keys/s, 1 objects/s recovering 2023-10-16T13:12:47.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:47 smithi092 ceph-mon[99542]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:12:47.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:47 smithi152 ceph-mon[104423]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:12:48.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:47 smithi118 ceph-mon[103969]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:12:48.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.329+0000 7f226dfff700 1 -- 172.21.15.92:0/416740356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22681022d0 msgr2=0x7f2268102730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:48.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.329+0000 7f226dfff700 1 --2- 172.21.15.92:0/416740356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22681022d0 0x7f2268102730 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2250009990 tx=0x7f2250009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:48.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.329+0000 7f226dfff700 1 -- 172.21.15.92:0/416740356 shutdown_connections 2023-10-16T13:12:48.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.329+0000 7f226dfff700 1 --2- 172.21.15.92:0/416740356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2268102c70 0x7f2268109520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:48.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.329+0000 7f226dfff700 1 --2- 172.21.15.92:0/416740356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22680ff250 0x7f22680ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:48.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.329+0000 7f226dfff700 1 --2- 172.21.15.92:0/416740356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22681022d0 0x7f2268102730 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:48.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.329+0000 7f226dfff700 1 -- 172.21.15.92:0/416740356 >> 172.21.15.92:0/416740356 conn(0x7f22680fab70 msgr2=0x7f22680fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:48.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.329+0000 7f226dfff700 1 -- 172.21.15.92:0/416740356 shutdown_connections 2023-10-16T13:12:48.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.329+0000 7f226dfff700 1 -- 172.21.15.92:0/416740356 wait complete. 2023-10-16T13:12:48.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.330+0000 7f226dfff700 1 Processor -- start 2023-10-16T13:12:48.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.330+0000 7f226dfff700 1 -- start start 2023-10-16T13:12:48.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.330+0000 7f226dfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22680ff250 0x7f2268101c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:48.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.330+0000 7f226dfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22681022d0 0x7f2268100280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:48.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.330+0000 7f226dfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2268102c70 0x7f22681007c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:48.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.330+0000 7f226dfff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2268100f40 con 0x7f2268102c70 2023-10-16T13:12:48.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.330+0000 7f226dfff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22681010b0 con 0x7f22681022d0 2023-10-16T13:12:48.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.330+0000 7f226dfff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22681a0d90 con 0x7f22680ff250 2023-10-16T13:12:48.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.330+0000 7f2267fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2268102c70 0x7f22681007c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:48.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.331+0000 7f2267fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2268102c70 0x7f22681007c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36262/0 (socket says 172.21.15.92:36262) 2023-10-16T13:12:48.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.331+0000 7f2267fff700 1 -- 172.21.15.92:0/3705574514 learned_addr learned my addr 172.21.15.92:0/3705574514 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:48.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.331+0000 7f2266ffd700 1 --2- 172.21.15.92:0/3705574514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22681022d0 0x7f2268100280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:48.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.331+0000 7f22677fe700 1 --2- 172.21.15.92:0/3705574514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22680ff250 0x7f2268101c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:48.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.331+0000 7f2267fff700 1 -- 172.21.15.92:0/3705574514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22680ff250 msgr2=0x7f2268101c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:48.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.331+0000 7f2267fff700 1 --2- 172.21.15.92:0/3705574514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22680ff250 0x7f2268101c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:48.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.331+0000 7f2267fff700 1 -- 172.21.15.92:0/3705574514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22681022d0 msgr2=0x7f2268100280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:48.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.331+0000 7f2267fff700 1 --2- 172.21.15.92:0/3705574514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22681022d0 0x7f2268100280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:48.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.331+0000 7f2267fff700 1 -- 172.21.15.92:0/3705574514 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22500095f0 con 0x7f2268102c70 2023-10-16T13:12:48.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.331+0000 7f22677fe700 1 --2- 172.21.15.92:0/3705574514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22680ff250 0x7f2268101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:12:48.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.331+0000 7f2267fff700 1 --2- 172.21.15.92:0/3705574514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2268102c70 0x7f22681007c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f226000ada0 tx=0x7f226000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:48.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.331+0000 7f2264ff9700 1 -- 172.21.15.92:0/3705574514 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226000f070 con 0x7f2268102c70 2023-10-16T13:12:48.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.331+0000 7f2264ff9700 1 -- 172.21.15.92:0/3705574514 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2260007b30 con 0x7f2268102c70 2023-10-16T13:12:48.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.331+0000 7f226dfff700 1 -- 172.21.15.92:0/3705574514 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22681a1070 con 0x7f2268102c70 2023-10-16T13:12:48.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.331+0000 7f2264ff9700 1 -- 172.21.15.92:0/3705574514 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22600053c0 con 0x7f2268102c70 2023-10-16T13:12:48.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.331+0000 7f226dfff700 1 -- 172.21.15.92:0/3705574514 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22681a1520 con 0x7f2268102c70 2023-10-16T13:12:48.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.332+0000 7f226dfff700 1 -- 172.21.15.92:0/3705574514 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226810c8b0 con 0x7f2268102c70 2023-10-16T13:12:48.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.333+0000 7f2264ff9700 1 -- 172.21.15.92:0/3705574514 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f226000c980 con 0x7f2268102c70 2023-10-16T13:12:48.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.334+0000 7f2264ff9700 1 --2- 172.21.15.92:0/3705574514 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f22540a1510 0x7f22540a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:48.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.334+0000 7f22677fe700 1 --2- 172.21.15.92:0/3705574514 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f22540a1510 0x7f22540a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:48.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.334+0000 7f2264ff9700 1 -- 172.21.15.92:0/3705574514 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f22600cc4a0 con 0x7f2268102c70 2023-10-16T13:12:48.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.334+0000 7f22677fe700 1 --2- 172.21.15.92:0/3705574514 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f22540a1510 0x7f22540a39d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2258005fd0 tx=0x7f2258005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:48.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.338+0000 7f2264ff9700 1 -- 172.21.15.92:0/3705574514 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2260095a30 con 0x7f2268102c70 2023-10-16T13:12:48.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.538+0000 7f226dfff700 1 -- 172.21.15.92:0/3705574514 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f22680612f0 con 0x7f22540a1510 2023-10-16T13:12:48.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.552+0000 7f2264ff9700 1 -- 172.21.15.92:0/3705574514 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f22680612f0 con 0x7f22540a1510 2023-10-16T13:12:48.554 INFO:teuthology.orchestra.run.smithi092.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-16T13:12:48.555 INFO:teuthology.orchestra.run.smithi092.stdout:mds.a smithi092 running (77s) 5s ago 77s 19.2M - 18.0.0-6730-g4ba8a190 6c414e27a22d a06763ee0245 2023-10-16T13:12:48.555 INFO:teuthology.orchestra.run.smithi092.stdout:mds.b smithi118 running (75s) 6s ago 75s 30.3M - 18.0.0-6730-g4ba8a190 6c414e27a22d e8dde3f88208 2023-10-16T13:12:48.555 INFO:teuthology.orchestra.run.smithi092.stdout:mds.c smithi152 running (87s) 5s ago 86s 21.9M - 18.0.0-6730-g4ba8a190 6c414e27a22d 958dcc9b6c4e 2023-10-16T13:12:48.555 INFO:teuthology.orchestra.run.smithi092.stdout:mds.d smithi092 running (94s) 5s ago 93s 14.8M - 18.0.0-6730-g4ba8a190 6c414e27a22d 7bff708a2014 2023-10-16T13:12:48.556 INFO:teuthology.orchestra.run.smithi092.stdout:mds.e smithi118 running (91s) 6s ago 91s 21.1M - 18.0.0-6730-g4ba8a190 6c414e27a22d 7c60537431fe 2023-10-16T13:12:48.556 INFO:teuthology.orchestra.run.smithi092.stdout:mds.f smithi152 running (89s) 5s ago 89s 19.1M - 18.0.0-6730-g4ba8a190 6c414e27a22d 58680dcc1be8 2023-10-16T13:12:48.556 INFO:teuthology.orchestra.run.smithi092.stdout:mds.g smithi092 running (80s) 5s ago 79s 18.0M - 18.0.0-6730-g4ba8a190 6c414e27a22d 20201c7fe07e 2023-10-16T13:12:48.556 INFO:teuthology.orchestra.run.smithi092.stdout:mds.h smithi118 running (84s) 6s ago 84s 18.2M - 18.0.0-6730-g4ba8a190 6c414e27a22d b87e50408d90 2023-10-16T13:12:48.556 INFO:teuthology.orchestra.run.smithi092.stdout:mds.i smithi152 running (82s) 5s ago 82s 21.7M - 18.0.0-6730-g4ba8a190 6c414e27a22d 01b28e3a5fce 2023-10-16T13:12:48.556 INFO:teuthology.orchestra.run.smithi092.stdout:mds.j smithi092 running (96s) 5s ago 95s 16.5M - 18.0.0-6730-g4ba8a190 6c414e27a22d ccf9ecd8ad63 2023-10-16T13:12:48.557 INFO:teuthology.orchestra.run.smithi092.stdout:mds.k smithi118 running (98s) 6s ago 98s 20.4M - 18.0.0-6730-g4ba8a190 6c414e27a22d 1c555bd4281f 2023-10-16T13:12:48.557 INFO:teuthology.orchestra.run.smithi092.stdout:mds.l smithi152 running (100s) 5s ago 100s 19.3M - 18.0.0-6730-g4ba8a190 6c414e27a22d a7c483e826ef 2023-10-16T13:12:48.557 INFO:teuthology.orchestra.run.smithi092.stdout:mgr.x smithi092 *:9283,8765 running (7m) 5s ago 7m 522M - 18.0.0-6730-g4ba8a190 6c414e27a22d 55a02c55940e 2023-10-16T13:12:48.557 INFO:teuthology.orchestra.run.smithi092.stdout:mgr.y smithi118 *:8443,8765 running (6m) 6s ago 6m 451M - 18.0.0-6730-g4ba8a190 6c414e27a22d bbebe6765093 2023-10-16T13:12:48.557 INFO:teuthology.orchestra.run.smithi092.stdout:mgr.z smithi152 *:8443,8765 running (6m) 5s ago 6m 451M - 18.0.0-6730-g4ba8a190 6c414e27a22d 2cafabd79f92 2023-10-16T13:12:48.558 INFO:teuthology.orchestra.run.smithi092.stdout:mon.a smithi092 running (7m) 5s ago 8m 91.8M 2048M 18.0.0-6730-g4ba8a190 6c414e27a22d 3506140c9aa2 2023-10-16T13:12:48.558 INFO:teuthology.orchestra.run.smithi092.stdout:mon.b smithi118 running (6m) 6s ago 6m 60.0M 2048M 18.0.0-6730-g4ba8a190 6c414e27a22d 65f2a00cf278 2023-10-16T13:12:48.558 INFO:teuthology.orchestra.run.smithi092.stdout:mon.c smithi152 running (6m) 5s ago 6m 64.0M 2048M 18.0.0-6730-g4ba8a190 6c414e27a22d 18c53f396f6b 2023-10-16T13:12:48.558 INFO:teuthology.orchestra.run.smithi092.stdout:osd.0 smithi092 running (5m) 5s ago 5m 66.1M 4292M 18.0.0-6730-g4ba8a190 6c414e27a22d edb6ea1278c3 2023-10-16T13:12:48.558 INFO:teuthology.orchestra.run.smithi092.stdout:osd.1 smithi118 running (5m) 6s ago 5m 69.1M 4292M 18.0.0-6730-g4ba8a190 6c414e27a22d ea8632ee8c54 2023-10-16T13:12:48.558 INFO:teuthology.orchestra.run.smithi092.stdout:osd.2 smithi152 running (5m) 5s ago 5m 68.1M 4292M 18.0.0-6730-g4ba8a190 6c414e27a22d 92490a86d70d 2023-10-16T13:12:48.559 INFO:teuthology.orchestra.run.smithi092.stdout:osd.3 smithi092 running (4m) 5s ago 4m 59.6M 4292M 18.0.0-6730-g4ba8a190 6c414e27a22d ff406dc30404 2023-10-16T13:12:48.559 INFO:teuthology.orchestra.run.smithi092.stdout:osd.4 smithi118 running (4m) 6s ago 4m 58.0M 4292M 18.0.0-6730-g4ba8a190 6c414e27a22d eb36e497c208 2023-10-16T13:12:48.559 INFO:teuthology.orchestra.run.smithi092.stdout:osd.5 smithi152 running (4m) 5s ago 4m 62.8M 4292M 18.0.0-6730-g4ba8a190 6c414e27a22d e9c78717f6f1 2023-10-16T13:12:48.559 INFO:teuthology.orchestra.run.smithi092.stdout:osd.6 smithi092 running (3m) 5s ago 3m 57.7M 4292M 18.0.0-6730-g4ba8a190 6c414e27a22d b2e741078866 2023-10-16T13:12:48.559 INFO:teuthology.orchestra.run.smithi092.stdout:osd.7 smithi118 running (3m) 6s ago 3m 64.2M 4292M 18.0.0-6730-g4ba8a190 6c414e27a22d fc0958a6266e 2023-10-16T13:12:48.560 INFO:teuthology.orchestra.run.smithi092.stdout:osd.8 smithi152 running (3m) 5s ago 3m 60.1M 4292M 18.0.0-6730-g4ba8a190 6c414e27a22d 4f5992a8b36c 2023-10-16T13:12:48.560 INFO:teuthology.orchestra.run.smithi092.stdout:osd.9 smithi092 running (2m) 5s ago 2m 55.9M 4292M 18.0.0-6730-g4ba8a190 6c414e27a22d 347e100d79ff 2023-10-16T13:12:48.560 INFO:teuthology.orchestra.run.smithi092.stdout:osd.10 smithi118 running (2m) 6s ago 2m 62.1M 4292M 18.0.0-6730-g4ba8a190 6c414e27a22d 0c70823031aa 2023-10-16T13:12:48.561 INFO:teuthology.orchestra.run.smithi092.stdout:osd.11 smithi152 running (118s) 5s ago 118s 53.1M 4292M 18.0.0-6730-g4ba8a190 6c414e27a22d 90136478b312 2023-10-16T13:12:48.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.555+0000 7f226dfff700 1 -- 172.21.15.92:0/3705574514 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f22540a1510 msgr2=0x7f22540a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:48.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.555+0000 7f226dfff700 1 --2- 172.21.15.92:0/3705574514 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f22540a1510 0x7f22540a39d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2258005fd0 tx=0x7f2258005f00 comp rx=0 tx=0).stop 2023-10-16T13:12:48.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.555+0000 7f226dfff700 1 -- 172.21.15.92:0/3705574514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2268102c70 msgr2=0x7f22681007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:48.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.555+0000 7f226dfff700 1 --2- 172.21.15.92:0/3705574514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2268102c70 0x7f22681007c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f226000ada0 tx=0x7f226000c330 comp rx=0 tx=0).stop 2023-10-16T13:12:48.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.555+0000 7f226dfff700 1 -- 172.21.15.92:0/3705574514 shutdown_connections 2023-10-16T13:12:48.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.555+0000 7f226dfff700 1 --2- 172.21.15.92:0/3705574514 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f22540a1510 0x7f22540a39d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:48.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.555+0000 7f226dfff700 1 --2- 172.21.15.92:0/3705574514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2268102c70 0x7f22681007c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:48.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.555+0000 7f226dfff700 1 --2- 172.21.15.92:0/3705574514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22680ff250 0x7f2268101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:48.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.555+0000 7f226dfff700 1 --2- 172.21.15.92:0/3705574514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22681022d0 0x7f2268100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:48.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.555+0000 7f226dfff700 1 -- 172.21.15.92:0/3705574514 >> 172.21.15.92:0/3705574514 conn(0x7f22680fab70 msgr2=0x7f22680fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:48.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.555+0000 7f226dfff700 1 -- 172.21.15.92:0/3705574514 shutdown_connections 2023-10-16T13:12:48.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:48.555+0000 7f226dfff700 1 -- 172.21.15.92:0/3705574514 wait complete. 2023-10-16T13:12:48.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:48 smithi152 ceph-mon[104423]: pgmap v291: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 5.2 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-16T13:12:48.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:48 smithi092 ceph-mon[99542]: pgmap v291: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 5.2 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-16T13:12:49.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:48 smithi118 ceph-mon[103969]: pgmap v291: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 5.2 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-16T13:12:49.042 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch ls' 2023-10-16T13:12:49.599 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:49.838 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:49 smithi092 ceph-mon[99542]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:12:49.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:49 smithi152 ceph-mon[104423]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:12:50.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:49 smithi118 ceph-mon[103969]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:12:50.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:50 smithi092 ceph-mon[99542]: pgmap v292: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s; 4.8 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-16T13:12:50.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.925+0000 7f265ce27700 1 -- 172.21.15.92:0/723809765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26580ffe70 msgr2=0x7f2658100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:50.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.925+0000 7f265ce27700 1 --2- 172.21.15.92:0/723809765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26580ffe70 0x7f2658100290 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2648009990 tx=0x7f2648009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:50.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.925+0000 7f265ce27700 1 -- 172.21.15.92:0/723809765 shutdown_connections 2023-10-16T13:12:50.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.925+0000 7f265ce27700 1 --2- 172.21.15.92:0/723809765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26580ffe70 0x7f2658100290 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:50.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.925+0000 7f265ce27700 1 --2- 172.21.15.92:0/723809765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2658101990 0x7f26581082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:50.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.925+0000 7f265ce27700 1 --2- 172.21.15.92:0/723809765 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2658100fd0 0x7f2658101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:50.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.925+0000 7f265ce27700 1 -- 172.21.15.92:0/723809765 >> 172.21.15.92:0/723809765 conn(0x7f26580fb3f0 msgr2=0x7f26580fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:50.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.925+0000 7f265ce27700 1 -- 172.21.15.92:0/723809765 shutdown_connections 2023-10-16T13:12:50.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.925+0000 7f265ce27700 1 -- 172.21.15.92:0/723809765 wait complete. 2023-10-16T13:12:50.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.926+0000 7f265ce27700 1 Processor -- start 2023-10-16T13:12:50.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.926+0000 7f265ce27700 1 -- start start 2023-10-16T13:12:50.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.926+0000 7f265ce27700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26580ffe70 0x7f2658069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:50.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.926+0000 7f265ce27700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2658100fd0 0x7f265819bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:50.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.926+0000 7f265ce27700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2658101990 0x7f265819e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:50.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.926+0000 7f265ce27700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265819e8a0 con 0x7f26580ffe70 2023-10-16T13:12:50.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.926+0000 7f265ce27700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265819ea10 con 0x7f2658100fd0 2023-10-16T13:12:50.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.926+0000 7f265ce27700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265819ebd0 con 0x7f2658101990 2023-10-16T13:12:50.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.926+0000 7f265659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26580ffe70 0x7f2658069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:50.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.926+0000 7f265659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26580ffe70 0x7f2658069520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36270/0 (socket says 172.21.15.92:36270) 2023-10-16T13:12:50.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.926+0000 7f265659c700 1 -- 172.21.15.92:0/2484862688 learned_addr learned my addr 172.21.15.92:0/2484862688 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:50.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.926+0000 7f2656d9d700 1 --2- 172.21.15.92:0/2484862688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2658101990 0x7f265819e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:50.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.926+0000 7f2655d9b700 1 --2- 172.21.15.92:0/2484862688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2658100fd0 0x7f265819bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:50.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.926+0000 7f265659c700 1 -- 172.21.15.92:0/2484862688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2658101990 msgr2=0x7f265819e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:50.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.926+0000 7f265659c700 1 --2- 172.21.15.92:0/2484862688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2658101990 0x7f265819e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:50.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.926+0000 7f265659c700 1 -- 172.21.15.92:0/2484862688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2658100fd0 msgr2=0x7f265819bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:50.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.926+0000 7f265659c700 1 --2- 172.21.15.92:0/2484862688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2658100fd0 0x7f265819bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:50.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.926+0000 7f265659c700 1 -- 172.21.15.92:0/2484862688 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26480095f0 con 0x7f26580ffe70 2023-10-16T13:12:50.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.927+0000 7f265659c700 1 --2- 172.21.15.92:0/2484862688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26580ffe70 0x7f2658069520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2648000c00 tx=0x7f2648005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:50.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.927+0000 7f264f7fe700 1 -- 172.21.15.92:0/2484862688 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264801d070 con 0x7f26580ffe70 2023-10-16T13:12:50.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.927+0000 7f264f7fe700 1 -- 172.21.15.92:0/2484862688 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2648004180 con 0x7f26580ffe70 2023-10-16T13:12:50.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.927+0000 7f264f7fe700 1 -- 172.21.15.92:0/2484862688 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264800f460 con 0x7f26580ffe70 2023-10-16T13:12:50.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.927+0000 7f265ce27700 1 -- 172.21.15.92:0/2484862688 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265819ee50 con 0x7f26580ffe70 2023-10-16T13:12:50.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.927+0000 7f265ce27700 1 -- 172.21.15.92:0/2484862688 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265819f230 con 0x7f26580ffe70 2023-10-16T13:12:50.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.928+0000 7f265ce27700 1 -- 172.21.15.92:0/2484862688 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2658107400 con 0x7f26580ffe70 2023-10-16T13:12:50.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.929+0000 7f264f7fe700 1 -- 172.21.15.92:0/2484862688 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f2648022700 con 0x7f26580ffe70 2023-10-16T13:12:50.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.929+0000 7f264f7fe700 1 --2- 172.21.15.92:0/2484862688 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f26440a1590 0x7f26440a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:50.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.930+0000 7f2655d9b700 1 --2- 172.21.15.92:0/2484862688 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f26440a1590 0x7f26440a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:50.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.930+0000 7f264f7fe700 1 -- 172.21.15.92:0/2484862688 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f26480ce980 con 0x7f26580ffe70 2023-10-16T13:12:50.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.930+0000 7f2655d9b700 1 --2- 172.21.15.92:0/2484862688 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f26440a1590 0x7f26440a3a50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2640005950 tx=0x7f26400058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:50.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:50.933+0000 7f264f7fe700 1 -- 172.21.15.92:0/2484862688 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2648097f10 con 0x7f26580ffe70 2023-10-16T13:12:50.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:50 smithi152 ceph-mon[104423]: pgmap v292: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s; 4.8 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-16T13:12:51.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:50 smithi118 ceph-mon[103969]: pgmap v292: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s; 4.8 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-16T13:12:51.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:51.130+0000 7f265ce27700 1 -- 172.21.15.92:0/2484862688 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f265802d2b0 con 0x7f26440a1590 2023-10-16T13:12:51.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:51.136+0000 7f264f7fe700 1 -- 172.21.15.92:0/2484862688 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+985 (secure 0 0 0) 0x7f265802d2b0 con 0x7f26440a1590 2023-10-16T13:12:51.138 INFO:teuthology.orchestra.run.smithi092.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-10-16T13:12:51.138 INFO:teuthology.orchestra.run.smithi092.stdout:mds.all 12/12 8s ago 105s smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi118=b;smithi118=e;smithi118=h;smithi118=k;smithi152=c;smithi152=f;smithi152=i;smithi152=l;count:12 2023-10-16T13:12:51.138 INFO:teuthology.orchestra.run.smithi092.stdout:mgr 3/3 8s ago 6m smithi092=x;smithi118=y;smithi152=z;count:3 2023-10-16T13:12:51.139 INFO:teuthology.orchestra.run.smithi092.stdout:mon 3/3 8s ago 6m smithi092:172.21.15.92=a;smithi118:172.21.15.118=b;smithi152:172.21.15.152=c;count:3 2023-10-16T13:12:51.139 INFO:teuthology.orchestra.run.smithi092.stdout:osd 12 8s ago - 2023-10-16T13:12:51.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:51.138+0000 7f265ce27700 1 -- 172.21.15.92:0/2484862688 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f26440a1590 msgr2=0x7f26440a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:51.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:51.138+0000 7f265ce27700 1 --2- 172.21.15.92:0/2484862688 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f26440a1590 0x7f26440a3a50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2640005950 tx=0x7f26400058e0 comp rx=0 tx=0).stop 2023-10-16T13:12:51.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:51.138+0000 7f265ce27700 1 -- 172.21.15.92:0/2484862688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26580ffe70 msgr2=0x7f2658069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:51.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:51.138+0000 7f265ce27700 1 --2- 172.21.15.92:0/2484862688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26580ffe70 0x7f2658069520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2648000c00 tx=0x7f2648005ef0 comp rx=0 tx=0).stop 2023-10-16T13:12:51.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:51.138+0000 7f265ce27700 1 -- 172.21.15.92:0/2484862688 shutdown_connections 2023-10-16T13:12:51.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:51.138+0000 7f265ce27700 1 --2- 172.21.15.92:0/2484862688 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f26440a1590 0x7f26440a3a50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:51.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:51.138+0000 7f265ce27700 1 --2- 172.21.15.92:0/2484862688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26580ffe70 0x7f2658069520 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:51.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:51.138+0000 7f265ce27700 1 --2- 172.21.15.92:0/2484862688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2658101990 0x7f265819e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:51.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:51.138+0000 7f265ce27700 1 --2- 172.21.15.92:0/2484862688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2658100fd0 0x7f265819bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:51.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:51.138+0000 7f265ce27700 1 -- 172.21.15.92:0/2484862688 >> 172.21.15.92:0/2484862688 conn(0x7f26580fb3f0 msgr2=0x7f2658104540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:51.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:51.138+0000 7f265ce27700 1 -- 172.21.15.92:0/2484862688 shutdown_connections 2023-10-16T13:12:51.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:51.138+0000 7f265ce27700 1 -- 172.21.15.92:0/2484862688 wait complete. 2023-10-16T13:12:51.554 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch host ls' 2023-10-16T13:12:52.111 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:52.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:52 smithi092 ceph-mon[99542]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:12:52.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:52 smithi092 ceph-mon[99542]: pgmap v293: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 4.7 KiB/s, 0 objects/s recovering 2023-10-16T13:12:52.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:52 smithi152 ceph-mon[104423]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:12:52.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:52 smithi152 ceph-mon[104423]: pgmap v293: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 4.7 KiB/s, 0 objects/s recovering 2023-10-16T13:12:53.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:52 smithi118 ceph-mon[103969]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:12:53.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:52 smithi118 ceph-mon[103969]: pgmap v293: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 4.7 KiB/s, 0 objects/s recovering 2023-10-16T13:12:53.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.845+0000 7f6185f1b700 1 -- 172.21.15.92:0/3551504589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6180101050 msgr2=0x7f61801014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:53.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.845+0000 7f6185f1b700 1 --2- 172.21.15.92:0/3551504589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6180101050 0x7f61801014d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6170009990 tx=0x7f6170009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:53.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.845+0000 7f6185f1b700 1 -- 172.21.15.92:0/3551504589 shutdown_connections 2023-10-16T13:12:53.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.845+0000 7f6185f1b700 1 --2- 172.21.15.92:0/3551504589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6180101a10 0x7f6180108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:53.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.845+0000 7f6185f1b700 1 --2- 172.21.15.92:0/3551504589 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61800ffe60 0x7f6180100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:53.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.845+0000 7f6185f1b700 1 --2- 172.21.15.92:0/3551504589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6180101050 0x7f61801014d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:53.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.845+0000 7f6185f1b700 1 -- 172.21.15.92:0/3551504589 >> 172.21.15.92:0/3551504589 conn(0x7f61800fb450 msgr2=0x7f61800fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:53.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.845+0000 7f6185f1b700 1 -- 172.21.15.92:0/3551504589 shutdown_connections 2023-10-16T13:12:53.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.845+0000 7f6185f1b700 1 -- 172.21.15.92:0/3551504589 wait complete. 2023-10-16T13:12:53.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.846+0000 7f6185f1b700 1 Processor -- start 2023-10-16T13:12:53.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.846+0000 7f6185f1b700 1 -- start start 2023-10-16T13:12:53.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.846+0000 7f6185f1b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61800ffe60 0x7f6180195ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:53.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.846+0000 7f6185f1b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6180101050 0x7f61801961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:53.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.846+0000 7f6185f1b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6180101a10 0x7f618019d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:53.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.846+0000 7f6185f1b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618019d820 con 0x7f61800ffe60 2023-10-16T13:12:53.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.846+0000 7f6185f1b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618019d960 con 0x7f6180101050 2023-10-16T13:12:53.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.846+0000 7f6185f1b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618019db20 con 0x7f6180101a10 2023-10-16T13:12:53.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.846+0000 7f617f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61800ffe60 0x7f6180195ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:53.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.846+0000 7f617f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61800ffe60 0x7f6180195ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36282/0 (socket says 172.21.15.92:36282) 2023-10-16T13:12:53.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.846+0000 7f617f7fe700 1 -- 172.21.15.92:0/4111151774 learned_addr learned my addr 172.21.15.92:0/4111151774 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:53.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.846+0000 7f617f7fe700 1 -- 172.21.15.92:0/4111151774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6180101a10 msgr2=0x7f618019d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:53.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.846+0000 7f617f7fe700 1 --2- 172.21.15.92:0/4111151774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6180101a10 0x7f618019d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:53.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.846+0000 7f617f7fe700 1 -- 172.21.15.92:0/4111151774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6180101050 msgr2=0x7f61801961e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:53.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.846+0000 7f617effd700 1 --2- 172.21.15.92:0/4111151774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6180101050 0x7f61801961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:53.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.846+0000 7f617f7fe700 1 --2- 172.21.15.92:0/4111151774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6180101050 0x7f61801961e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:53.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.847+0000 7f617f7fe700 1 -- 172.21.15.92:0/4111151774 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61700095f0 con 0x7f61800ffe60 2023-10-16T13:12:53.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.847+0000 7f617f7fe700 1 --2- 172.21.15.92:0/4111151774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61800ffe60 0x7f6180195ca0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f617400b500 tx=0x7f617400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:53.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.847+0000 7f617cff9700 1 -- 172.21.15.92:0/4111151774 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174011830 con 0x7f61800ffe60 2023-10-16T13:12:53.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.847+0000 7f617cff9700 1 -- 172.21.15.92:0/4111151774 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6174011e70 con 0x7f61800ffe60 2023-10-16T13:12:53.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.847+0000 7f6185f1b700 1 -- 172.21.15.92:0/4111151774 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618019de00 con 0x7f61800ffe60 2023-10-16T13:12:53.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.847+0000 7f617cff9700 1 -- 172.21.15.92:0/4111151774 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617400f2e0 con 0x7f61800ffe60 2023-10-16T13:12:53.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.847+0000 7f6185f1b700 1 -- 172.21.15.92:0/4111151774 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618019e2f0 con 0x7f61800ffe60 2023-10-16T13:12:53.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.848+0000 7f6185f1b700 1 -- 172.21.15.92:0/4111151774 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f618010b8c0 con 0x7f61800ffe60 2023-10-16T13:12:53.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.849+0000 7f617cff9700 1 -- 172.21.15.92:0/4111151774 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f61740105f0 con 0x7f61800ffe60 2023-10-16T13:12:53.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.849+0000 7f617cff9700 1 --2- 172.21.15.92:0/4111151774 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f61680a1590 0x7f61680a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:53.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.850+0000 7f617effd700 1 --2- 172.21.15.92:0/4111151774 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f61680a1590 0x7f61680a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:53.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.850+0000 7f617cff9700 1 -- 172.21.15.92:0/4111151774 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f61740ccd90 con 0x7f61800ffe60 2023-10-16T13:12:53.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.850+0000 7f617effd700 1 --2- 172.21.15.92:0/4111151774 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f61680a1590 0x7f61680a3a50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6170006010 tx=0x7f6170009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:53.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:53.853+0000 7f617cff9700 1 -- 172.21.15.92:0/4111151774 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6174096360 con 0x7f61800ffe60 2023-10-16T13:12:54.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:54.046+0000 7f6185f1b700 1 -- 172.21.15.92:0/4111151774 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f61800612f0 con 0x7f61680a1590 2023-10-16T13:12:54.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:54.048+0000 7f617cff9700 1 -- 172.21.15.92:0/4111151774 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f61800612f0 con 0x7f61680a1590 2023-10-16T13:12:54.050 INFO:teuthology.orchestra.run.smithi092.stdout:HOST ADDR LABELS STATUS 2023-10-16T13:12:54.050 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092 172.21.15.92 2023-10-16T13:12:54.050 INFO:teuthology.orchestra.run.smithi092.stdout:smithi118 172.21.15.118 2023-10-16T13:12:54.050 INFO:teuthology.orchestra.run.smithi092.stdout:smithi152 172.21.15.152 2023-10-16T13:12:54.051 INFO:teuthology.orchestra.run.smithi092.stdout:3 hosts in cluster 2023-10-16T13:12:54.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:54.050+0000 7f6185f1b700 1 -- 172.21.15.92:0/4111151774 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f61680a1590 msgr2=0x7f61680a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:54.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:54.050+0000 7f6185f1b700 1 --2- 172.21.15.92:0/4111151774 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f61680a1590 0x7f61680a3a50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6170006010 tx=0x7f6170009550 comp rx=0 tx=0).stop 2023-10-16T13:12:54.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:54.050+0000 7f6185f1b700 1 -- 172.21.15.92:0/4111151774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61800ffe60 msgr2=0x7f6180195ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:54.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:54.050+0000 7f6185f1b700 1 --2- 172.21.15.92:0/4111151774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61800ffe60 0x7f6180195ca0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f617400b500 tx=0x7f617400b8c0 comp rx=0 tx=0).stop 2023-10-16T13:12:54.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:54.050+0000 7f6185f1b700 1 -- 172.21.15.92:0/4111151774 shutdown_connections 2023-10-16T13:12:54.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:54.050+0000 7f6185f1b700 1 --2- 172.21.15.92:0/4111151774 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f61680a1590 0x7f61680a3a50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:54.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:54.050+0000 7f6185f1b700 1 --2- 172.21.15.92:0/4111151774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61800ffe60 0x7f6180195ca0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:54.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:54.050+0000 7f6185f1b700 1 --2- 172.21.15.92:0/4111151774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6180101a10 0x7f618019d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:54.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:54.050+0000 7f6185f1b700 1 --2- 172.21.15.92:0/4111151774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6180101050 0x7f61801961e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:54.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:54.050+0000 7f6185f1b700 1 -- 172.21.15.92:0/4111151774 >> 172.21.15.92:0/4111151774 conn(0x7f61800fb450 msgr2=0x7f61800fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:54.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:54.050+0000 7f6185f1b700 1 -- 172.21.15.92:0/4111151774 shutdown_connections 2023-10-16T13:12:54.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:54.050+0000 7f6185f1b700 1 -- 172.21.15.92:0/4111151774 wait complete. 2023-10-16T13:12:54.569 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch device ls' 2023-10-16T13:12:54.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:54 smithi152 ceph-mon[104423]: pgmap v294: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-16T13:12:54.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:54 smithi092 ceph-mon[99542]: pgmap v294: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-16T13:12:55.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:54 smithi118 ceph-mon[103969]: pgmap v294: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-16T13:12:55.129 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:55.656 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:55 smithi092 ceph-mon[99542]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:12:55.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:55 smithi152 ceph-mon[104423]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:12:56.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:55 smithi118 ceph-mon[103969]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:12:56.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.316+0000 7fabac314700 1 -- 172.21.15.92:0/2375328868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faba4100100 msgr2=0x7faba4100580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:56.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.316+0000 7fabac314700 1 --2- 172.21.15.92:0/2375328868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faba4100100 0x7faba4100580 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7faba0009990 tx=0x7faba0009ca0 comp rx=0 tx=0).stop 2023-10-16T13:12:56.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.316+0000 7fabac314700 1 -- 172.21.15.92:0/2375328868 shutdown_connections 2023-10-16T13:12:56.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.316+0000 7fabac314700 1 --2- 172.21.15.92:0/2375328868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faba4100ac0 0x7faba4108360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:56.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.316+0000 7fabac314700 1 --2- 172.21.15.92:0/2375328868 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faba4101530 0x7faba4101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:56.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.316+0000 7fabac314700 1 --2- 172.21.15.92:0/2375328868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faba4100100 0x7faba4100580 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:56.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.316+0000 7fabac314700 1 -- 172.21.15.92:0/2375328868 >> 172.21.15.92:0/2375328868 conn(0x7faba40fabd0 msgr2=0x7faba40fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:56.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.316+0000 7fabac314700 1 -- 172.21.15.92:0/2375328868 shutdown_connections 2023-10-16T13:12:56.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.316+0000 7fabac314700 1 -- 172.21.15.92:0/2375328868 wait complete. 2023-10-16T13:12:56.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.317+0000 7fabac314700 1 Processor -- start 2023-10-16T13:12:56.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.317+0000 7fabac314700 1 -- start start 2023-10-16T13:12:56.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.317+0000 7fabac314700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faba4100100 0x7faba4195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:56.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.317+0000 7fabac314700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faba4100ac0 0x7faba4196160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:56.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.317+0000 7fabac314700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faba4101530 0x7faba419d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:56.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.317+0000 7fabac314700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba419d770 con 0x7faba4100100 2023-10-16T13:12:56.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.317+0000 7fabac314700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba419d8b0 con 0x7faba4100ac0 2023-10-16T13:12:56.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.317+0000 7fabac314700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba419da70 con 0x7faba4101530 2023-10-16T13:12:56.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.318+0000 7faba98af700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faba4100ac0 0x7faba4196160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:56.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.318+0000 7faba98af700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faba4100ac0 0x7faba4196160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:37104/0 (socket says 172.21.15.92:37104) 2023-10-16T13:12:56.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.318+0000 7faba98af700 1 -- 172.21.15.92:0/4205259622 learned_addr learned my addr 172.21.15.92:0/4205259622 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:56.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.318+0000 7fabaa8b1700 1 --2- 172.21.15.92:0/4205259622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faba4101530 0x7faba419d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:56.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.318+0000 7fabaa0b0700 1 --2- 172.21.15.92:0/4205259622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faba4100100 0x7faba4195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:56.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.318+0000 7faba98af700 1 -- 172.21.15.92:0/4205259622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faba4101530 msgr2=0x7faba419d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:56.325 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.318+0000 7faba98af700 1 --2- 172.21.15.92:0/4205259622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faba4101530 0x7faba419d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:56.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.318+0000 7faba98af700 1 -- 172.21.15.92:0/4205259622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faba4100100 msgr2=0x7faba4195c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:56.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.318+0000 7faba98af700 1 --2- 172.21.15.92:0/4205259622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faba4100100 0x7faba4195c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:56.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.318+0000 7faba98af700 1 -- 172.21.15.92:0/4205259622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba00095f0 con 0x7faba4100ac0 2023-10-16T13:12:56.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.318+0000 7faba98af700 1 --2- 172.21.15.92:0/4205259622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faba4100ac0 0x7faba4196160 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faba00036f0 tx=0x7faba000f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:56.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.318+0000 7fab9b7fe700 1 -- 172.21.15.92:0/4205259622 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba001d070 con 0x7faba4100ac0 2023-10-16T13:12:56.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.318+0000 7fabac314700 1 -- 172.21.15.92:0/4205259622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba419dcf0 con 0x7faba4100ac0 2023-10-16T13:12:56.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.318+0000 7fabac314700 1 -- 172.21.15.92:0/4205259622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba419e160 con 0x7faba4100ac0 2023-10-16T13:12:56.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.318+0000 7fab9b7fe700 1 -- 172.21.15.92:0/4205259622 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faba0005030 con 0x7faba4100ac0 2023-10-16T13:12:56.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.318+0000 7fab9b7fe700 1 -- 172.21.15.92:0/4205259622 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba0004ba0 con 0x7faba4100ac0 2023-10-16T13:12:56.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.319+0000 7fabac314700 1 -- 172.21.15.92:0/4205259622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba4107490 con 0x7faba4100ac0 2023-10-16T13:12:56.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.321+0000 7fab9b7fe700 1 -- 172.21.15.92:0/4205259622 <== mon.2 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7faba0004d00 con 0x7faba4100ac0 2023-10-16T13:12:56.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.321+0000 7fab9b7fe700 1 --2- 172.21.15.92:0/4205259622 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fab900a1510 0x7fab900a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:56.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.321+0000 7fabaa0b0700 1 --2- 172.21.15.92:0/4205259622 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fab900a1510 0x7fab900a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:56.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.321+0000 7fab9b7fe700 1 -- 172.21.15.92:0/4205259622 <== mon.2 v2:172.21.15.118:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7faba00cdf20 con 0x7faba4100ac0 2023-10-16T13:12:56.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.322+0000 7fabaa0b0700 1 --2- 172.21.15.92:0/4205259622 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fab900a1510 0x7fab900a39d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faba4197100 tx=0x7fab9400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:56.329 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.325+0000 7fab9b7fe700 1 -- 172.21.15.92:0/4205259622 <== mon.2 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faba00974b0 con 0x7faba4100ac0 2023-10-16T13:12:56.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.525+0000 7fabac314700 1 -- 172.21.15.92:0/4205259622 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7faba410b8c0 con 0x7fab900a1510 2023-10-16T13:12:56.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.526+0000 7fab9b7fe700 1 -- 172.21.15.92:0/4205259622 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7faba410b8c0 con 0x7fab900a1510 2023-10-16T13:12:56.529 INFO:teuthology.orchestra.run.smithi092.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-10-16T13:12:56.529 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400QM400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-16T13:12:56.530 INFO:teuthology.orchestra.run.smithi092.stdout:smithi118 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747500JS480DGN 447G No 2m ago Has a FileSystem, LVM detected 2023-10-16T13:12:56.530 INFO:teuthology.orchestra.run.smithi092.stdout:smithi152 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JT400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-16T13:12:56.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.528+0000 7fabac314700 1 -- 172.21.15.92:0/4205259622 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fab900a1510 msgr2=0x7fab900a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:56.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.528+0000 7fabac314700 1 --2- 172.21.15.92:0/4205259622 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fab900a1510 0x7fab900a39d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faba4197100 tx=0x7fab9400b410 comp rx=0 tx=0).stop 2023-10-16T13:12:56.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.529+0000 7fabac314700 1 -- 172.21.15.92:0/4205259622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faba4100ac0 msgr2=0x7faba4196160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:56.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.529+0000 7fabac314700 1 --2- 172.21.15.92:0/4205259622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faba4100ac0 0x7faba4196160 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faba00036f0 tx=0x7faba000f690 comp rx=0 tx=0).stop 2023-10-16T13:12:56.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.529+0000 7fabac314700 1 -- 172.21.15.92:0/4205259622 shutdown_connections 2023-10-16T13:12:56.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.529+0000 7fabac314700 1 --2- 172.21.15.92:0/4205259622 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fab900a1510 0x7fab900a39d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:56.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.529+0000 7fabac314700 1 --2- 172.21.15.92:0/4205259622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faba4100100 0x7faba4195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:56.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.529+0000 7fabac314700 1 --2- 172.21.15.92:0/4205259622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faba4101530 0x7faba419d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:56.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.529+0000 7fabac314700 1 --2- 172.21.15.92:0/4205259622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faba4100ac0 0x7faba4196160 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:56.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.529+0000 7fabac314700 1 -- 172.21.15.92:0/4205259622 >> 172.21.15.92:0/4205259622 conn(0x7faba40fabd0 msgr2=0x7faba41045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:56.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.529+0000 7fabac314700 1 -- 172.21.15.92:0/4205259622 shutdown_connections 2023-10-16T13:12:56.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:56.529+0000 7fabac314700 1 -- 172.21.15.92:0/4205259622 wait complete. 2023-10-16T13:12:56.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:56 smithi152 ceph-mon[104423]: pgmap v295: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-16T13:12:56.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:56 smithi092 ceph-mon[99542]: pgmap v295: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-16T13:12:56.985 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-16T13:12:56.994 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2023-10-16T13:12:56.994 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- bash -c 'ceph fs dump' 2023-10-16T13:12:57.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:56 smithi118 ceph-mon[103969]: pgmap v295: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-16T13:12:57.552 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:12:57.820 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:57 smithi092 ceph-mon[99542]: from='client.24851 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:12:57.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:57 smithi152 ceph-mon[104423]: from='client.24851 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:12:58.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:57 smithi118 ceph-mon[103969]: from='client.24851 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-16T13:12:58.681 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:58 smithi092 ceph-mon[99542]: pgmap v296: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-16T13:12:58.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.881+0000 7f396ce35700 1 -- 172.21.15.92:0/1587902168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39681021a0 msgr2=0x7f3968102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:58.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.881+0000 7f396ce35700 1 --2- 172.21.15.92:0/1587902168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39681021a0 0x7f3968102600 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f39580099c0 tx=0x7f3958009cd0 comp rx=0 tx=0).stop 2023-10-16T13:12:58.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.882+0000 7f396ce35700 1 -- 172.21.15.92:0/1587902168 shutdown_connections 2023-10-16T13:12:58.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.882+0000 7f396ce35700 1 --2- 172.21.15.92:0/1587902168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3968102b40 0x7f39681093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:58.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.882+0000 7f396ce35700 1 --2- 172.21.15.92:0/1587902168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3968100fa0 0x7f39681013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:58.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.882+0000 7f396ce35700 1 --2- 172.21.15.92:0/1587902168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39681021a0 0x7f3968102600 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:58.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.882+0000 7f396ce35700 1 -- 172.21.15.92:0/1587902168 >> 172.21.15.92:0/1587902168 conn(0x7f39680fc540 msgr2=0x7f39680fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:58.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.882+0000 7f396ce35700 1 -- 172.21.15.92:0/1587902168 shutdown_connections 2023-10-16T13:12:58.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.882+0000 7f396ce35700 1 -- 172.21.15.92:0/1587902168 wait complete. 2023-10-16T13:12:58.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.882+0000 7f396ce35700 1 Processor -- start 2023-10-16T13:12:58.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.882+0000 7f396ce35700 1 -- start start 2023-10-16T13:12:58.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f396ce35700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3968100fa0 0x7f3968074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:58.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f396ce35700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39681021a0 0x7f39680732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:58.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f396ce35700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3968102b40 0x7f39680737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:58.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f396ce35700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3968073f60 con 0x7f39681021a0 2023-10-16T13:12:58.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f396ce35700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39680740d0 con 0x7f3968102b40 2023-10-16T13:12:58.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f396ce35700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39681a0d80 con 0x7f3968100fa0 2023-10-16T13:12:58.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f3965d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39681021a0 0x7f39680732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:58.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f3965d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39681021a0 0x7f39680732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36308/0 (socket says 172.21.15.92:36308) 2023-10-16T13:12:58.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f3965d9b700 1 -- 172.21.15.92:0/1047553631 learned_addr learned my addr 172.21.15.92:0/1047553631 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:12:58.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f3966d9d700 1 --2- 172.21.15.92:0/1047553631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3968102b40 0x7f39680737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:58.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f3965d9b700 1 -- 172.21.15.92:0/1047553631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3968100fa0 msgr2=0x7f3968074c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:58.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f396659c700 1 --2- 172.21.15.92:0/1047553631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3968100fa0 0x7f3968074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:58.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f3965d9b700 1 --2- 172.21.15.92:0/1047553631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3968100fa0 0x7f3968074c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:58.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f3965d9b700 1 -- 172.21.15.92:0/1047553631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3968102b40 msgr2=0x7f39680737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:58.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f3965d9b700 1 --2- 172.21.15.92:0/1047553631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3968102b40 0x7f39680737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:58.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f3965d9b700 1 -- 172.21.15.92:0/1047553631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39580095f0 con 0x7f39681021a0 2023-10-16T13:12:58.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f3965d9b700 1 --2- 172.21.15.92:0/1047553631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39681021a0 0x7f39680732a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3958003800 tx=0x7f3958009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:58.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f39577fe700 1 -- 172.21.15.92:0/1047553631 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395801d070 con 0x7f39681021a0 2023-10-16T13:12:58.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f39577fe700 1 -- 172.21.15.92:0/1047553631 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f39580040a0 con 0x7f39681021a0 2023-10-16T13:12:58.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f396ce35700 1 -- 172.21.15.92:0/1047553631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39681a1000 con 0x7f39681021a0 2023-10-16T13:12:58.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f39577fe700 1 -- 172.21.15.92:0/1047553631 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395800f460 con 0x7f39681021a0 2023-10-16T13:12:58.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.883+0000 7f396ce35700 1 -- 172.21.15.92:0/1047553631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39681a1410 con 0x7f39681021a0 2023-10-16T13:12:58.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.884+0000 7f396ce35700 1 -- 172.21.15.92:0/1047553631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3968108520 con 0x7f39681021a0 2023-10-16T13:12:58.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.885+0000 7f39577fe700 1 -- 172.21.15.92:0/1047553631 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f3958022600 con 0x7f39681021a0 2023-10-16T13:12:58.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.886+0000 7f39577fe700 1 --2- 172.21.15.92:0/1047553631 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f39500a1510 0x7f39500a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:12:58.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.886+0000 7f396659c700 1 --2- 172.21.15.92:0/1047553631 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f39500a1510 0x7f39500a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:12:58.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.886+0000 7f39577fe700 1 -- 172.21.15.92:0/1047553631 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f39580ce9e0 con 0x7f39681021a0 2023-10-16T13:12:58.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.887+0000 7f396659c700 1 --2- 172.21.15.92:0/1047553631 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f39500a1510 0x7f39500a39d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3968102000 tx=0x7f395c005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:12:58.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:58.890+0000 7f39577fe700 1 -- 172.21.15.92:0/1047553631 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3958098040 con 0x7f39681021a0 2023-10-16T13:12:58.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:58 smithi152 ceph-mon[104423]: pgmap v296: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-16T13:12:59.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:58 smithi118 ceph-mon[103969]: pgmap v296: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-16T13:12:59.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:59.121+0000 7f396ce35700 1 -- 172.21.15.92:0/1047553631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f396810c8f0 con 0x7f39681021a0 2023-10-16T13:12:59.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:59.121+0000 7f39577fe700 1 -- 172.21.15.92:0/1047553631 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+2978 (secure 0 0 0) 0x7f39580bb020 con 0x7f39681021a0 2023-10-16T13:12:59.124 INFO:teuthology.orchestra.run.smithi092.stdout:e27 2023-10-16T13:12:59.125 INFO:teuthology.orchestra.run.smithi092.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-16T13:12:59.125 INFO:teuthology.orchestra.run.smithi092.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-16T13:12:59.125 INFO:teuthology.orchestra.run.smithi092.stdout:legacy client fscid: 1 2023-10-16T13:12:59.125 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:12:59.125 INFO:teuthology.orchestra.run.smithi092.stdout:Filesystem 'cephfs' (1) 2023-10-16T13:12:59.126 INFO:teuthology.orchestra.run.smithi092.stdout:fs_name cephfs 2023-10-16T13:12:59.126 INFO:teuthology.orchestra.run.smithi092.stdout:epoch 27 2023-10-16T13:12:59.126 INFO:teuthology.orchestra.run.smithi092.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-10-16T13:12:59.126 INFO:teuthology.orchestra.run.smithi092.stdout:created 2023-10-16T13:11:40.343309+0000 2023-10-16T13:12:59.126 INFO:teuthology.orchestra.run.smithi092.stdout:modified 2023-10-16T13:11:48.346678+0000 2023-10-16T13:12:59.127 INFO:teuthology.orchestra.run.smithi092.stdout:tableserver 0 2023-10-16T13:12:59.127 INFO:teuthology.orchestra.run.smithi092.stdout:root 0 2023-10-16T13:12:59.127 INFO:teuthology.orchestra.run.smithi092.stdout:session_timeout 300 2023-10-16T13:12:59.127 INFO:teuthology.orchestra.run.smithi092.stdout:session_autoclose 300 2023-10-16T13:12:59.127 INFO:teuthology.orchestra.run.smithi092.stdout:max_file_size 1099511627776 2023-10-16T13:12:59.128 INFO:teuthology.orchestra.run.smithi092.stdout:max_xattr_size 65536 2023-10-16T13:12:59.128 INFO:teuthology.orchestra.run.smithi092.stdout:required_client_features {} 2023-10-16T13:12:59.128 INFO:teuthology.orchestra.run.smithi092.stdout:last_failure 0 2023-10-16T13:12:59.128 INFO:teuthology.orchestra.run.smithi092.stdout:last_failure_osd_epoch 0 2023-10-16T13:12:59.128 INFO:teuthology.orchestra.run.smithi092.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-16T13:12:59.128 INFO:teuthology.orchestra.run.smithi092.stdout:max_mds 5 2023-10-16T13:12:59.129 INFO:teuthology.orchestra.run.smithi092.stdout:in 0,1,2,3,4 2023-10-16T13:12:59.129 INFO:teuthology.orchestra.run.smithi092.stdout:up {0=24491,1=24490,2=24460,3=24428,4=24412} 2023-10-16T13:12:59.129 INFO:teuthology.orchestra.run.smithi092.stdout:failed 2023-10-16T13:12:59.129 INFO:teuthology.orchestra.run.smithi092.stdout:damaged 2023-10-16T13:12:59.129 INFO:teuthology.orchestra.run.smithi092.stdout:stopped 2023-10-16T13:12:59.130 INFO:teuthology.orchestra.run.smithi092.stdout:data_pools [3] 2023-10-16T13:12:59.130 INFO:teuthology.orchestra.run.smithi092.stdout:metadata_pool 2 2023-10-16T13:12:59.130 INFO:teuthology.orchestra.run.smithi092.stdout:inline_data disabled 2023-10-16T13:12:59.130 INFO:teuthology.orchestra.run.smithi092.stdout:balancer 2023-10-16T13:12:59.130 INFO:teuthology.orchestra.run.smithi092.stdout:bal_rank_mask -1 2023-10-16T13:12:59.131 INFO:teuthology.orchestra.run.smithi092.stdout:standby_count_wanted 0 2023-10-16T13:12:59.131 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.b{0:24491} state up:active seq 3 addr [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] compat {c=[1],r=[1],i=[fff]}] 2023-10-16T13:12:59.131 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.c{0:24472} state up:standby-replay seq 1 addr [v2:172.21.15.152:6836/2403096460,v1:172.21.15.152:6837/2403096460] compat {c=[1],r=[1],i=[fff]}] 2023-10-16T13:12:59.131 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.i{1:24490} state up:active seq 6 addr [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] compat {c=[1],r=[1],i=[fff]}] 2023-10-16T13:12:59.131 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.h{1:24461} state up:standby-replay seq 1 addr [v2:172.21.15.118:6836/2133613540,v1:172.21.15.118:6837/2133613540] compat {c=[1],r=[1],i=[fff]}] 2023-10-16T13:12:59.131 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.f{2:24460} state up:active seq 8 addr [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] compat {c=[1],r=[1],i=[fff]}] 2023-10-16T13:12:59.132 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.k{2:24410} state up:standby-replay seq 1 addr [v2:172.21.15.118:6832/1243983806,v1:172.21.15.118:6833/1243983806] compat {c=[1],r=[1],i=[fff]}] 2023-10-16T13:12:59.132 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.e{3:24428} state up:active seq 9 addr [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] compat {c=[1],r=[1],i=[fff]}] 2023-10-16T13:12:59.132 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a{3:14625} state up:standby-replay seq 1 addr [v2:172.21.15.92:6840/1016260236,v1:172.21.15.92:6841/1016260236] compat {c=[1],r=[1],i=[fff]}] 2023-10-16T13:12:59.132 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.l{4:24412} state up:active seq 11 addr [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] compat {c=[1],r=[1],i=[fff]}] 2023-10-16T13:12:59.132 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.g{4:14613} state up:standby-replay seq 1 addr [v2:172.21.15.92:6838/1790514945,v1:172.21.15.92:6839/1790514945] compat {c=[1],r=[1],i=[fff]}] 2023-10-16T13:12:59.133 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:12:59.133 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:12:59.133 INFO:teuthology.orchestra.run.smithi092.stdout:Standby daemons: 2023-10-16T13:12:59.133 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:12:59.133 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.j{-1:14550} state up:standby seq 1 addr [v2:172.21.15.92:6834/1011037392,v1:172.21.15.92:6835/1011037392] compat {c=[1],r=[1],i=[fff]}] 2023-10-16T13:12:59.133 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.d{-1:14562} state up:standby seq 1 addr [v2:172.21.15.92:6836/4269964747,v1:172.21.15.92:6837/4269964747] compat {c=[1],r=[1],i=[fff]}] 2023-10-16T13:12:59.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:59.123+0000 7f396ce35700 1 -- 172.21.15.92:0/1047553631 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f39500a1510 msgr2=0x7f39500a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:59.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:59.123+0000 7f396ce35700 1 --2- 172.21.15.92:0/1047553631 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f39500a1510 0x7f39500a39d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3968102000 tx=0x7f395c005cf0 comp rx=0 tx=0).stop 2023-10-16T13:12:59.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:59.123+0000 7f396ce35700 1 -- 172.21.15.92:0/1047553631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39681021a0 msgr2=0x7f39680732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:12:59.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:59.123+0000 7f396ce35700 1 --2- 172.21.15.92:0/1047553631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39681021a0 0x7f39680732a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3958003800 tx=0x7f3958009580 comp rx=0 tx=0).stop 2023-10-16T13:12:59.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:59.123+0000 7f396ce35700 1 -- 172.21.15.92:0/1047553631 shutdown_connections 2023-10-16T13:12:59.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:59.123+0000 7f396ce35700 1 --2- 172.21.15.92:0/1047553631 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f39500a1510 0x7f39500a39d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:59.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:59.123+0000 7f396ce35700 1 --2- 172.21.15.92:0/1047553631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3968102b40 0x7f39680737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:59.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:59.123+0000 7f396ce35700 1 --2- 172.21.15.92:0/1047553631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3968100fa0 0x7f3968074c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:59.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:59.123+0000 7f396ce35700 1 --2- 172.21.15.92:0/1047553631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39681021a0 0x7f39680732a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:12:59.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:59.123+0000 7f396ce35700 1 -- 172.21.15.92:0/1047553631 >> 172.21.15.92:0/1047553631 conn(0x7f39680fc540 msgr2=0x7f3968105660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:12:59.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:59.123+0000 7f396ce35700 1 -- 172.21.15.92:0/1047553631 shutdown_connections 2023-10-16T13:12:59.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:12:59.123+0000 7f396ce35700 1 -- 172.21.15.92:0/1047553631 wait complete. 2023-10-16T13:12:59.137 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 27 2023-10-16T13:12:59.612 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- bash -c 'ceph osd dump' 2023-10-16T13:12:59.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:12:59 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1047553631' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-16T13:12:59.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:12:59 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1047553631' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-16T13:13:00.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:12:59 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1047553631' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-16T13:13:00.169 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:13:00.697 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:00 smithi092 ceph-mon[99542]: pgmap v297: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-16T13:13:00.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:00 smithi152 ceph-mon[104423]: pgmap v297: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-16T13:13:01.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:00 smithi118 ceph-mon[103969]: pgmap v297: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-16T13:13:01.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.538+0000 7efeac2ed700 1 -- 172.21.15.92:0/2286375166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea4101990 msgr2=0x7efea41082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:01.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.538+0000 7efeac2ed700 1 --2- 172.21.15.92:0/2286375166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea4101990 0x7efea41082b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00b0a0 tx=0x7efe9c00b3b0 comp rx=0 tx=0).stop 2023-10-16T13:13:01.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.538+0000 7efeac2ed700 1 -- 172.21.15.92:0/2286375166 shutdown_connections 2023-10-16T13:13:01.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.538+0000 7efeac2ed700 1 --2- 172.21.15.92:0/2286375166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea4101990 0x7efea41082b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:01.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.538+0000 7efeac2ed700 1 --2- 172.21.15.92:0/2286375166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efea40ffe70 0x7efea4100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:01.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.538+0000 7efeac2ed700 1 --2- 172.21.15.92:0/2286375166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efea4100fd0 0x7efea4101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:01.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.538+0000 7efeac2ed700 1 -- 172.21.15.92:0/2286375166 >> 172.21.15.92:0/2286375166 conn(0x7efea40fb3f0 msgr2=0x7efea40fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:01.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.538+0000 7efeac2ed700 1 -- 172.21.15.92:0/2286375166 shutdown_connections 2023-10-16T13:13:01.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.538+0000 7efeac2ed700 1 -- 172.21.15.92:0/2286375166 wait complete. 2023-10-16T13:13:01.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efeac2ed700 1 Processor -- start 2023-10-16T13:13:01.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efeac2ed700 1 -- start start 2023-10-16T13:13:01.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efeac2ed700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea40ffe70 0x7efea4195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:01.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efeac2ed700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efea4100fd0 0x7efea41961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:01.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efeac2ed700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efea4101990 0x7efea419d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:01.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efeac2ed700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea419d7c0 con 0x7efea40ffe70 2023-10-16T13:13:01.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efeac2ed700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea419d900 con 0x7efea4101990 2023-10-16T13:13:01.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efeac2ed700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea419dac0 con 0x7efea4100fd0 2023-10-16T13:13:01.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efeaa089700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea40ffe70 0x7efea4195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:01.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efeaa089700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea40ffe70 0x7efea4195c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36320/0 (socket says 172.21.15.92:36320) 2023-10-16T13:13:01.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efeaa089700 1 -- 172.21.15.92:0/1401220273 learned_addr learned my addr 172.21.15.92:0/1401220273 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:01.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efeaa88a700 1 --2- 172.21.15.92:0/1401220273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efea4101990 0x7efea419d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:01.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efea9888700 1 --2- 172.21.15.92:0/1401220273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efea4100fd0 0x7efea41961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:01.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efeaa089700 1 -- 172.21.15.92:0/1401220273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efea4100fd0 msgr2=0x7efea41961b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:01.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efeaa089700 1 --2- 172.21.15.92:0/1401220273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efea4100fd0 0x7efea41961b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:01.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efeaa089700 1 -- 172.21.15.92:0/1401220273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efea4101990 msgr2=0x7efea419d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:01.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efeaa089700 1 --2- 172.21.15.92:0/1401220273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efea4101990 0x7efea419d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:01.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efeaa089700 1 -- 172.21.15.92:0/1401220273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c009d00 con 0x7efea40ffe70 2023-10-16T13:13:01.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efeaa88a700 1 --2- 172.21.15.92:0/1401220273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efea4101990 0x7efea419d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:01.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efea9888700 1 --2- 172.21.15.92:0/1401220273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efea4100fd0 0x7efea41961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:01.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efeaa089700 1 --2- 172.21.15.92:0/1401220273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea40ffe70 0x7efea4195c70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7efe9800c9b0 tx=0x7efe9800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:01.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.539+0000 7efe977fe700 1 -- 172.21.15.92:0/1401220273 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98007b00 con 0x7efea40ffe70 2023-10-16T13:13:01.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.540+0000 7efe977fe700 1 -- 172.21.15.92:0/1401220273 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efe98007c60 con 0x7efea40ffe70 2023-10-16T13:13:01.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.540+0000 7efeac2ed700 1 -- 172.21.15.92:0/1401220273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea419dda0 con 0x7efea40ffe70 2023-10-16T13:13:01.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.540+0000 7efe977fe700 1 -- 172.21.15.92:0/1401220273 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98018730 con 0x7efea40ffe70 2023-10-16T13:13:01.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.540+0000 7efeac2ed700 1 -- 172.21.15.92:0/1401220273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea419e1e0 con 0x7efea40ffe70 2023-10-16T13:13:01.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.541+0000 7efeac2ed700 1 -- 172.21.15.92:0/1401220273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea410b7d0 con 0x7efea40ffe70 2023-10-16T13:13:01.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.542+0000 7efe977fe700 1 -- 172.21.15.92:0/1401220273 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7efe98018890 con 0x7efea40ffe70 2023-10-16T13:13:01.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.542+0000 7efe977fe700 1 --2- 172.21.15.92:0/1401220273 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7efe900a1510 0x7efe900a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:01.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.542+0000 7efea9888700 1 --2- 172.21.15.92:0/1401220273 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7efe900a1510 0x7efe900a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:01.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.542+0000 7efe977fe700 1 -- 172.21.15.92:0/1401220273 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7efe980ccf70 con 0x7efea40ffe70 2023-10-16T13:13:01.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.543+0000 7efea9888700 1 --2- 172.21.15.92:0/1401220273 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7efe900a1510 0x7efe900a39d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efea0009be0 tx=0x7efea0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:01.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.546+0000 7efe977fe700 1 -- 172.21.15.92:0/1401220273 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efe98096470 con 0x7efea40ffe70 2023-10-16T13:13:01.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.737+0000 7efeac2ed700 1 -- 172.21.15.92:0/1401220273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7efea4106c10 con 0x7efea40ffe70 2023-10-16T13:13:01.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.738+0000 7efe977fe700 1 -- 172.21.15.92:0/1401220273 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v85) v1 ==== 56+0+5307 (secure 0 0 0) 0x7efe98099a90 con 0x7efea40ffe70 2023-10-16T13:13:01.741 INFO:teuthology.orchestra.run.smithi092.stdout:epoch 85 2023-10-16T13:13:01.741 INFO:teuthology.orchestra.run.smithi092.stdout:fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:13:01.741 INFO:teuthology.orchestra.run.smithi092.stdout:created 2023-10-16T13:04:39.975522+0000 2023-10-16T13:13:01.741 INFO:teuthology.orchestra.run.smithi092.stdout:modified 2023-10-16T13:12:36.335213+0000 2023-10-16T13:13:01.741 INFO:teuthology.orchestra.run.smithi092.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-10-16T13:13:01.742 INFO:teuthology.orchestra.run.smithi092.stdout:crush_version 26 2023-10-16T13:13:01.742 INFO:teuthology.orchestra.run.smithi092.stdout:full_ratio 0.95 2023-10-16T13:13:01.742 INFO:teuthology.orchestra.run.smithi092.stdout:backfillfull_ratio 0.9 2023-10-16T13:13:01.742 INFO:teuthology.orchestra.run.smithi092.stdout:nearfull_ratio 0.85 2023-10-16T13:13:01.742 INFO:teuthology.orchestra.run.smithi092.stdout:require_min_compat_client luminous 2023-10-16T13:13:01.743 INFO:teuthology.orchestra.run.smithi092.stdout:min_compat_client luminous 2023-10-16T13:13:01.743 INFO:teuthology.orchestra.run.smithi092.stdout:require_osd_release reef 2023-10-16T13:13:01.743 INFO:teuthology.orchestra.run.smithi092.stdout:stretch_mode_enabled false 2023-10-16T13:13:01.743 INFO:teuthology.orchestra.run.smithi092.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-10-16T13:13:01.743 INFO:teuthology.orchestra.run.smithi092.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-10-16T13:13:01.744 INFO:teuthology.orchestra.run.smithi092.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-10-16T13:13:01.744 INFO:teuthology.orchestra.run.smithi092.stdout:max_osd 12 2023-10-16T13:13:01.744 INFO:teuthology.orchestra.run.smithi092.stdout:osd.0 up in weight 1 up_from 8 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6802/209585261,v1:172.21.15.92:6803/209585261] [v2:172.21.15.92:6804/209585261,v1:172.21.15.92:6805/209585261] exists,up 6aa1b3b6-7395-4c31-84e7-9a68dbed218e 2023-10-16T13:13:01.744 INFO:teuthology.orchestra.run.smithi092.stdout:osd.1 up in weight 1 up_from 13 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.118:6800/106427465,v1:172.21.15.118:6801/106427465] [v2:172.21.15.118:6802/106427465,v1:172.21.15.118:6803/106427465] exists,up ee68f65f-99c2-4bb9-9a7d-a6239cf9660e 2023-10-16T13:13:01.744 INFO:teuthology.orchestra.run.smithi092.stdout:osd.2 up in weight 1 up_from 18 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6800/304464027,v1:172.21.15.152:6801/304464027] [v2:172.21.15.152:6802/304464027,v1:172.21.15.152:6803/304464027] exists,up 094dbf98-7978-4174-a403-1df4105a77e5 2023-10-16T13:13:01.744 INFO:teuthology.orchestra.run.smithi092.stdout:osd.3 up in weight 1 up_from 25 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6810/1274183450,v1:172.21.15.92:6811/1274183450] [v2:172.21.15.92:6812/1274183450,v1:172.21.15.92:6813/1274183450] exists,up 7e6002e4-6baa-435a-90e2-34092f9548e8 2023-10-16T13:13:01.745 INFO:teuthology.orchestra.run.smithi092.stdout:osd.4 up in weight 1 up_from 33 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.118:6808/3903514094,v1:172.21.15.118:6809/3903514094] [v2:172.21.15.118:6810/3903514094,v1:172.21.15.118:6811/3903514094] exists,up ea9862ef-7323-44e2-bed6-191f1a01b94a 2023-10-16T13:13:01.745 INFO:teuthology.orchestra.run.smithi092.stdout:osd.5 up in weight 1 up_from 38 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6808/3958877515,v1:172.21.15.152:6809/3958877515] [v2:172.21.15.152:6810/3958877515,v1:172.21.15.152:6811/3958877515] exists,up cb550e84-333c-4c46-b1c8-5bc29237fd34 2023-10-16T13:13:01.745 INFO:teuthology.orchestra.run.smithi092.stdout:osd.6 up in weight 1 up_from 46 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6818/3198015740,v1:172.21.15.92:6819/3198015740] [v2:172.21.15.92:6820/3198015740,v1:172.21.15.92:6821/3198015740] exists,up 9f93ad94-3117-44cc-ab85-5fbee3f68f56 2023-10-16T13:13:01.745 INFO:teuthology.orchestra.run.smithi092.stdout:osd.7 up in weight 1 up_from 51 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.118:6816/3103702893,v1:172.21.15.118:6817/3103702893] [v2:172.21.15.118:6818/3103702893,v1:172.21.15.118:6819/3103702893] exists,up 5b32e20e-f395-41b8-aafe-7455c630490c 2023-10-16T13:13:01.745 INFO:teuthology.orchestra.run.smithi092.stdout:osd.8 up in weight 1 up_from 59 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6816/3968044260,v1:172.21.15.152:6817/3968044260] [v2:172.21.15.152:6818/3968044260,v1:172.21.15.152:6819/3968044260] exists,up 0ee11b20-7519-44ad-aa47-53df8dea3a75 2023-10-16T13:13:01.746 INFO:teuthology.orchestra.run.smithi092.stdout:osd.9 up in weight 1 up_from 66 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6826/3153036271,v1:172.21.15.92:6827/3153036271] [v2:172.21.15.92:6828/3153036271,v1:172.21.15.92:6829/3153036271] exists,up bf985086-cb42-4def-9d17-317345e66f85 2023-10-16T13:13:01.746 INFO:teuthology.orchestra.run.smithi092.stdout:osd.10 up in weight 1 up_from 71 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.118:6824/3622143535,v1:172.21.15.118:6825/3622143535] [v2:172.21.15.118:6826/3622143535,v1:172.21.15.118:6827/3622143535] exists,up 835ac2f9-3615-42f3-bb6d-037f3c1fc192 2023-10-16T13:13:01.746 INFO:teuthology.orchestra.run.smithi092.stdout:osd.11 up in weight 1 up_from 78 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6824/3082644763,v1:172.21.15.152:6825/3082644763] [v2:172.21.15.152:6826/3082644763,v1:172.21.15.152:6827/3082644763] exists,up 30d2e40e-290f-48a0-bf74-f6f7b5ff659c 2023-10-16T13:13:01.746 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 2.a [2,11] 2023-10-16T13:13:01.746 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 2.14 [2,4] 2023-10-16T13:13:01.747 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 2.1b [2,1] 2023-10-16T13:13:01.747 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 2.1d [8,11] 2023-10-16T13:13:01.747 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.0 [4,6] 2023-10-16T13:13:01.747 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.c [3,9] 2023-10-16T13:13:01.747 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.e [4,8] 2023-10-16T13:13:01.747 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.1d [5,9] 2023-10-16T13:13:01.748 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.3c [4,9] 2023-10-16T13:13:01.748 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/1517475646 expires 2023-10-17T13:05:35.186467+0000 2023-10-16T13:13:01.748 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6801/1487044137 expires 2023-10-17T13:05:35.186467+0000 2023-10-16T13:13:01.748 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/1407513743 expires 2023-10-17T13:05:35.186467+0000 2023-10-16T13:13:01.748 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/1513871374 expires 2023-10-17T13:05:11.104167+0000 2023-10-16T13:13:01.748 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6800/184191966 expires 2023-10-17T13:05:11.104167+0000 2023-10-16T13:13:01.749 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/1527476864 expires 2023-10-17T13:05:11.104167+0000 2023-10-16T13:13:01.749 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/1790054192 expires 2023-10-17T13:05:35.186467+0000 2023-10-16T13:13:01.749 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/3362128136 expires 2023-10-17T13:05:11.104167+0000 2023-10-16T13:13:01.749 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6801/184191966 expires 2023-10-17T13:05:11.104167+0000 2023-10-16T13:13:01.749 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6800/1487044137 expires 2023-10-17T13:05:35.186467+0000 2023-10-16T13:13:01.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.740+0000 7efeac2ed700 1 -- 172.21.15.92:0/1401220273 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7efe900a1510 msgr2=0x7efe900a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:01.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.740+0000 7efeac2ed700 1 --2- 172.21.15.92:0/1401220273 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7efe900a1510 0x7efe900a39d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efea0009be0 tx=0x7efea0009260 comp rx=0 tx=0).stop 2023-10-16T13:13:01.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.740+0000 7efeac2ed700 1 -- 172.21.15.92:0/1401220273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea40ffe70 msgr2=0x7efea4195c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:01.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.740+0000 7efeac2ed700 1 --2- 172.21.15.92:0/1401220273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea40ffe70 0x7efea4195c70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7efe9800c9b0 tx=0x7efe9800cd70 comp rx=0 tx=0).stop 2023-10-16T13:13:01.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.740+0000 7efeac2ed700 1 -- 172.21.15.92:0/1401220273 shutdown_connections 2023-10-16T13:13:01.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.740+0000 7efeac2ed700 1 --2- 172.21.15.92:0/1401220273 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7efe900a1510 0x7efe900a39d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:01.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.740+0000 7efeac2ed700 1 --2- 172.21.15.92:0/1401220273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea40ffe70 0x7efea4195c70 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:01.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.740+0000 7efeac2ed700 1 --2- 172.21.15.92:0/1401220273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efea4101990 0x7efea419d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:01.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.740+0000 7efeac2ed700 1 --2- 172.21.15.92:0/1401220273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efea4100fd0 0x7efea41961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:01.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.740+0000 7efeac2ed700 1 -- 172.21.15.92:0/1401220273 >> 172.21.15.92:0/1401220273 conn(0x7efea40fb3f0 msgr2=0x7efea40fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:01.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.740+0000 7efeac2ed700 1 -- 172.21.15.92:0/1401220273 shutdown_connections 2023-10-16T13:13:01.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:01.740+0000 7efeac2ed700 1 -- 172.21.15.92:0/1401220273 wait complete. 2023-10-16T13:13:02.228 INFO:teuthology.run_tasks:Running task fs.ready... 2023-10-16T13:13:02.238 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:13:02.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.361+0000 7fa76e309700 1 -- 172.21.15.92:0/939638845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa768101970 msgr2=0x7fa768108220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:02.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.361+0000 7fa76e309700 1 --2- 172.21.15.92:0/939638845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa768101970 0x7fa768108220 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa76000b0d0 tx=0x7fa76000b3e0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.361+0000 7fa76e309700 1 -- 172.21.15.92:0/939638845 shutdown_connections 2023-10-16T13:13:02.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.361+0000 7fa76e309700 1 --2- 172.21.15.92:0/939638845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa768101970 0x7fa768108220 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.361+0000 7fa76e309700 1 --2- 172.21.15.92:0/939638845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7680ffde0 0x7fa768100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.361+0000 7fa76e309700 1 --2- 172.21.15.92:0/939638845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa768100fd0 0x7fa768101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.361+0000 7fa76e309700 1 -- 172.21.15.92:0/939638845 >> 172.21.15.92:0/939638845 conn(0x7fa7680fb310 msgr2=0x7fa7680fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:02.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.362+0000 7fa76e309700 1 -- 172.21.15.92:0/939638845 shutdown_connections 2023-10-16T13:13:02.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.362+0000 7fa76e309700 1 -- 172.21.15.92:0/939638845 wait complete. 2023-10-16T13:13:02.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.362+0000 7fa76e309700 1 Processor -- start 2023-10-16T13:13:02.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.362+0000 7fa76e309700 1 -- start start 2023-10-16T13:13:02.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.362+0000 7fa76e309700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7680ffde0 0x7fa768196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:02.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.362+0000 7fa76e309700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa768100fd0 0x7fa7681972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:02.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.362+0000 7fa76e309700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa768101970 0x7fa76819e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:02.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.362+0000 7fa76e309700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76819e8e0 con 0x7fa768100fd0 2023-10-16T13:13:02.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.362+0000 7fa76e309700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76819ea50 con 0x7fa768101970 2023-10-16T13:13:02.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.362+0000 7fa76e309700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76819ec10 con 0x7fa7680ffde0 2023-10-16T13:13:02.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.363+0000 7fa7677fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa768100fd0 0x7fa7681972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:02.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.363+0000 7fa7677fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa768100fd0 0x7fa7681972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36332/0 (socket says 172.21.15.92:36332) 2023-10-16T13:13:02.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.363+0000 7fa7677fe700 1 -- 172.21.15.92:0/3580157317 learned_addr learned my addr 172.21.15.92:0/3580157317 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:02.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.363+0000 7fa767fff700 1 --2- 172.21.15.92:0/3580157317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7680ffde0 0x7fa768196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:02.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.363+0000 7fa76c8a6700 1 --2- 172.21.15.92:0/3580157317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa768101970 0x7fa76819e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:02.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.363+0000 7fa7677fe700 1 -- 172.21.15.92:0/3580157317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7680ffde0 msgr2=0x7fa768196da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:02.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.363+0000 7fa7677fe700 1 --2- 172.21.15.92:0/3580157317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7680ffde0 0x7fa768196da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.363+0000 7fa7677fe700 1 -- 172.21.15.92:0/3580157317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa768101970 msgr2=0x7fa76819e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:02.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.363+0000 7fa7677fe700 1 --2- 172.21.15.92:0/3580157317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa768101970 0x7fa76819e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.363+0000 7fa7677fe700 1 -- 172.21.15.92:0/3580157317 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa760009d00 con 0x7fa768100fd0 2023-10-16T13:13:02.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.363+0000 7fa76c8a6700 1 --2- 172.21.15.92:0/3580157317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa768101970 0x7fa76819e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:02.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.363+0000 7fa7677fe700 1 --2- 172.21.15.92:0/3580157317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa768100fd0 0x7fa7681972e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00d950 tx=0x7fa75c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:02.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.363+0000 7fa7657fa700 1 -- 172.21.15.92:0/3580157317 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c009b40 con 0x7fa768100fd0 2023-10-16T13:13:02.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.363+0000 7fa7657fa700 1 -- 172.21.15.92:0/3580157317 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa75c009ca0 con 0x7fa768100fd0 2023-10-16T13:13:02.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.363+0000 7fa7657fa700 1 -- 172.21.15.92:0/3580157317 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00f6b0 con 0x7fa768100fd0 2023-10-16T13:13:02.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.363+0000 7fa76e309700 1 -- 172.21.15.92:0/3580157317 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76819eef0 con 0x7fa768100fd0 2023-10-16T13:13:02.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.363+0000 7fa76e309700 1 -- 172.21.15.92:0/3580157317 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76819f340 con 0x7fa768100fd0 2023-10-16T13:13:02.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.364+0000 7fa76e309700 1 -- 172.21.15.92:0/3580157317 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76810b820 con 0x7fa768100fd0 2023-10-16T13:13:02.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.365+0000 7fa7657fa700 1 -- 172.21.15.92:0/3580157317 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fa75c010460 con 0x7fa768100fd0 2023-10-16T13:13:02.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.366+0000 7fa7657fa700 1 --2- 172.21.15.92:0/3580157317 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa7500a15c0 0x7fa7500a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:02.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.366+0000 7fa767fff700 1 --2- 172.21.15.92:0/3580157317 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa7500a15c0 0x7fa7500a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:02.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.366+0000 7fa7657fa700 1 -- 172.21.15.92:0/3580157317 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa75c0cd230 con 0x7fa768100fd0 2023-10-16T13:13:02.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.366+0000 7fa767fff700 1 --2- 172.21.15.92:0/3580157317 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa7500a15c0 0x7fa7500a3a80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa758006fd0 tx=0x7fa758008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:02.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.369+0000 7fa7657fa700 1 -- 172.21.15.92:0/3580157317 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa75c0966f0 con 0x7fa768100fd0 2023-10-16T13:13:02.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.562+0000 7fa76e309700 1 -- 172.21.15.92:0/3580157317 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa76819f650 con 0x7fa768100fd0 2023-10-16T13:13:02.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.564+0000 7fa7657fa700 1 -- 172.21.15.92:0/3580157317 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22598 (secure 0 0 0) 0x7fa75c099d10 con 0x7fa768100fd0 2023-10-16T13:13:02.567 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:13:02.567 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":85,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:12:36.335213+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:11:38.345035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:11:39.549912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:13:02.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.566+0000 7fa76e309700 1 -- 172.21.15.92:0/3580157317 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa7500a15c0 msgr2=0x7fa7500a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:02.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.566+0000 7fa76e309700 1 --2- 172.21.15.92:0/3580157317 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa7500a15c0 0x7fa7500a3a80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa758006fd0 tx=0x7fa758008040 comp rx=0 tx=0).stop 2023-10-16T13:13:02.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.566+0000 7fa76e309700 1 -- 172.21.15.92:0/3580157317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa768100fd0 msgr2=0x7fa7681972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:02.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.566+0000 7fa76e309700 1 --2- 172.21.15.92:0/3580157317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa768100fd0 0x7fa7681972e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00d950 tx=0x7fa75c00dd10 comp rx=0 tx=0).stop 2023-10-16T13:13:02.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.566+0000 7fa76e309700 1 -- 172.21.15.92:0/3580157317 shutdown_connections 2023-10-16T13:13:02.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.566+0000 7fa76e309700 1 --2- 172.21.15.92:0/3580157317 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa7500a15c0 0x7fa7500a3a80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.566+0000 7fa76e309700 1 --2- 172.21.15.92:0/3580157317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa768101970 0x7fa76819e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.566+0000 7fa76e309700 1 --2- 172.21.15.92:0/3580157317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7680ffde0 0x7fa768196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.566+0000 7fa76e309700 1 --2- 172.21.15.92:0/3580157317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa768100fd0 0x7fa7681972e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.566+0000 7fa76e309700 1 -- 172.21.15.92:0/3580157317 >> 172.21.15.92:0/3580157317 conn(0x7fa7680fb310 msgr2=0x7fa768069050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:02.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.566+0000 7fa76e309700 1 -- 172.21.15.92:0/3580157317 shutdown_connections 2023-10-16T13:13:02.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.566+0000 7fa76e309700 1 -- 172.21.15.92:0/3580157317 wait complete. 2023-10-16T13:13:02.582 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:07:45.516334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:11:38.345035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:11:39.549912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:13:02.583 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:13:02.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.706+0000 7f0c4b1f0700 1 -- 172.21.15.92:0/3481241474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c44106c30 msgr2=0x7f0c44109020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:02.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.706+0000 7f0c4b1f0700 1 --2- 172.21.15.92:0/3481241474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c44106c30 0x7f0c44109020 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00b0a0 tx=0x7f0c3c00b3b0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.706+0000 7f0c4b1f0700 1 -- 172.21.15.92:0/3481241474 shutdown_connections 2023-10-16T13:13:02.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.706+0000 7f0c4b1f0700 1 --2- 172.21.15.92:0/3481241474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c44106c30 0x7f0c44109020 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.706+0000 7f0c4b1f0700 1 --2- 172.21.15.92:0/3481241474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c441019d0 0x7f0c44103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.706+0000 7f0c4b1f0700 1 --2- 172.21.15.92:0/3481241474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c44104300 0x7f0c441066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.706+0000 7f0c4b1f0700 1 -- 172.21.15.92:0/3481241474 >> 172.21.15.92:0/3481241474 conn(0x7f0c440fb320 msgr2=0x7f0c440fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:02.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.706+0000 7f0c4b1f0700 1 -- 172.21.15.92:0/3481241474 shutdown_connections 2023-10-16T13:13:02.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.706+0000 7f0c4b1f0700 1 -- 172.21.15.92:0/3481241474 wait complete. 2023-10-16T13:13:02.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.706+0000 7f0c4b1f0700 1 Processor -- start 2023-10-16T13:13:02.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.706+0000 7f0c4b1f0700 1 -- start start 2023-10-16T13:13:02.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.706+0000 7f0c4b1f0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c441019d0 0x7f0c44196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:02.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.706+0000 7f0c4b1f0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c44104300 0x7f0c44197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:02.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.706+0000 7f0c4b1f0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c44106c30 0x7f0c4419e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:02.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.706+0000 7f0c4b1f0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4419e880 con 0x7f0c44106c30 2023-10-16T13:13:02.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.706+0000 7f0c4b1f0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4419e9f0 con 0x7f0c44104300 2023-10-16T13:13:02.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.706+0000 7f0c4b1f0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4419ebb0 con 0x7f0c441019d0 2023-10-16T13:13:02.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.707+0000 7f0c4978d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c44106c30 0x7f0c4419e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:02.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.707+0000 7f0c4978d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c44106c30 0x7f0c4419e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36348/0 (socket says 172.21.15.92:36348) 2023-10-16T13:13:02.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.707+0000 7f0c4978d700 1 -- 172.21.15.92:0/572095134 learned_addr learned my addr 172.21.15.92:0/572095134 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:02.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.707+0000 7f0c43fff700 1 --2- 172.21.15.92:0/572095134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c44104300 0x7f0c44197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:02.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.707+0000 7f0c48f8c700 1 --2- 172.21.15.92:0/572095134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c441019d0 0x7f0c44196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:02.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.707+0000 7f0c4978d700 1 -- 172.21.15.92:0/572095134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c441019d0 msgr2=0x7f0c44196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:02.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.707+0000 7f0c4978d700 1 --2- 172.21.15.92:0/572095134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c441019d0 0x7f0c44196d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.707+0000 7f0c4978d700 1 -- 172.21.15.92:0/572095134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c44104300 msgr2=0x7f0c44197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:02.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.707+0000 7f0c4978d700 1 --2- 172.21.15.92:0/572095134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c44104300 0x7f0c44197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.707+0000 7f0c4978d700 1 -- 172.21.15.92:0/572095134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c009d00 con 0x7f0c44106c30 2023-10-16T13:13:02.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.707+0000 7f0c43fff700 1 --2- 172.21.15.92:0/572095134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c44104300 0x7f0c44197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:02.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.707+0000 7f0c4978d700 1 --2- 172.21.15.92:0/572095134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c44106c30 0x7f0c4419e2b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00b780 tx=0x7f0c3c00be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:02.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.707+0000 7f0c41ffb700 1 -- 172.21.15.92:0/572095134 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c00e040 con 0x7f0c44106c30 2023-10-16T13:13:02.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.707+0000 7f0c41ffb700 1 -- 172.21.15.92:0/572095134 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0c3c004e60 con 0x7f0c44106c30 2023-10-16T13:13:02.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.707+0000 7f0c4b1f0700 1 -- 172.21.15.92:0/572095134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4419ee30 con 0x7f0c44106c30 2023-10-16T13:13:02.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.707+0000 7f0c41ffb700 1 -- 172.21.15.92:0/572095134 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c005440 con 0x7f0c44106c30 2023-10-16T13:13:02.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.707+0000 7f0c4b1f0700 1 -- 172.21.15.92:0/572095134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4419f250 con 0x7f0c44106c30 2023-10-16T13:13:02.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.708+0000 7f0c4b1f0700 1 -- 172.21.15.92:0/572095134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c440fcea0 con 0x7f0c44106c30 2023-10-16T13:13:02.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.709+0000 7f0c41ffb700 1 -- 172.21.15.92:0/572095134 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f0c3c01d470 con 0x7f0c44106c30 2023-10-16T13:13:02.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.710+0000 7f0c41ffb700 1 --2- 172.21.15.92:0/572095134 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0c340a1590 0x7f0c340a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:02.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.710+0000 7f0c48f8c700 1 --2- 172.21.15.92:0/572095134 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0c340a1590 0x7f0c340a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:02.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.710+0000 7f0c41ffb700 1 -- 172.21.15.92:0/572095134 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f0c3c0ce8c0 con 0x7f0c44106c30 2023-10-16T13:13:02.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.710+0000 7f0c48f8c700 1 --2- 172.21.15.92:0/572095134 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0c340a1590 0x7f0c340a3a50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0c44198210 tx=0x7f0c38009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:02.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.713+0000 7f0c41ffb700 1 -- 172.21.15.92:0/572095134 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0c3c097e10 con 0x7f0c44106c30 2023-10-16T13:13:02.907 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.904+0000 7f0c4b1f0700 1 -- 172.21.15.92:0/572095134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c4410c9c0 con 0x7f0c44106c30 2023-10-16T13:13:02.907 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.904+0000 7f0c41ffb700 1 -- 172.21.15.92:0/572095134 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c3c09b430 con 0x7f0c44106c30 2023-10-16T13:13:02.907 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-10-16T13:13:02.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.906+0000 7f0c4b1f0700 1 -- 172.21.15.92:0/572095134 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0c340a1590 msgr2=0x7f0c340a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:02.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.906+0000 7f0c4b1f0700 1 --2- 172.21.15.92:0/572095134 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0c340a1590 0x7f0c340a3a50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0c44198210 tx=0x7f0c38009260 comp rx=0 tx=0).stop 2023-10-16T13:13:02.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.906+0000 7f0c4b1f0700 1 -- 172.21.15.92:0/572095134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c44106c30 msgr2=0x7f0c4419e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:02.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.906+0000 7f0c4b1f0700 1 --2- 172.21.15.92:0/572095134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c44106c30 0x7f0c4419e2b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00b780 tx=0x7f0c3c00be10 comp rx=0 tx=0).stop 2023-10-16T13:13:02.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.906+0000 7f0c4b1f0700 1 -- 172.21.15.92:0/572095134 shutdown_connections 2023-10-16T13:13:02.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.906+0000 7f0c4b1f0700 1 --2- 172.21.15.92:0/572095134 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0c340a1590 0x7f0c340a3a50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.906+0000 7f0c4b1f0700 1 --2- 172.21.15.92:0/572095134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c44106c30 0x7f0c4419e2b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.906+0000 7f0c4b1f0700 1 --2- 172.21.15.92:0/572095134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c441019d0 0x7f0c44196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.906+0000 7f0c4b1f0700 1 --2- 172.21.15.92:0/572095134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c44104300 0x7f0c44197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:02.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.906+0000 7f0c4b1f0700 1 -- 172.21.15.92:0/572095134 >> 172.21.15.92:0/572095134 conn(0x7f0c440fb320 msgr2=0x7f0c44102640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:02.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.906+0000 7f0c4b1f0700 1 -- 172.21.15.92:0/572095134 shutdown_connections 2023-10-16T13:13:02.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:02.907+0000 7f0c4b1f0700 1 -- 172.21.15.92:0/572095134 wait complete. 2023-10-16T13:13:02.920 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:02 smithi092 ceph-mon[99542]: pgmap v298: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-10-16T13:13:02.920 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:02 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1401220273' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-16T13:13:02.921 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:02 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3580157317' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:02.922 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:13:02.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:02 smithi152 ceph-mon[104423]: pgmap v298: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-10-16T13:13:02.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:02 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1401220273' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-16T13:13:02.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:02 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3580157317' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:03.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:02 smithi118 ceph-mon[103969]: pgmap v298: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-10-16T13:13:03.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:02 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1401220273' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-16T13:13:03.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:02 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3580157317' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:03.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.043+0000 7f9392646700 1 -- 172.21.15.92:0/2375293264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f938c1002e0 msgr2=0x7f938c100700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:03.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.043+0000 7f9392646700 1 --2- 172.21.15.92:0/2375293264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f938c1002e0 0x7f938c100700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f937c009990 tx=0x7f937c009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.044+0000 7f9392646700 1 -- 172.21.15.92:0/2375293264 shutdown_connections 2023-10-16T13:13:03.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.044+0000 7f9392646700 1 --2- 172.21.15.92:0/2375293264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f938c1002e0 0x7f938c100700 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.044+0000 7f9392646700 1 --2- 172.21.15.92:0/2375293264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f938c1019b0 0x7f938c108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.044+0000 7f9392646700 1 --2- 172.21.15.92:0/2375293264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f938c100ff0 0x7f938c101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.044+0000 7f9392646700 1 -- 172.21.15.92:0/2375293264 >> 172.21.15.92:0/2375293264 conn(0x7f938c0faa90 msgr2=0x7f938c0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:03.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.044+0000 7f9392646700 1 -- 172.21.15.92:0/2375293264 shutdown_connections 2023-10-16T13:13:03.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.044+0000 7f9392646700 1 -- 172.21.15.92:0/2375293264 wait complete. 2023-10-16T13:13:03.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.044+0000 7f9392646700 1 Processor -- start 2023-10-16T13:13:03.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.044+0000 7f9392646700 1 -- start start 2023-10-16T13:13:03.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f9392646700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f938c1002e0 0x7f938c195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:03.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f9392646700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f938c100ff0 0x7f938c196080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:03.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f9392646700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f938c1019b0 0x7f938c19d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:03.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f9392646700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c19d6c0 con 0x7f938c100ff0 2023-10-16T13:13:03.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f9392646700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c19d800 con 0x7f938c1002e0 2023-10-16T13:13:03.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f9392646700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c19d990 con 0x7f938c1019b0 2023-10-16T13:13:03.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f938b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f938c100ff0 0x7f938c196080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:03.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f938b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f938c100ff0 0x7f938c196080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36362/0 (socket says 172.21.15.92:36362) 2023-10-16T13:13:03.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f938b7fe700 1 -- 172.21.15.92:0/1114071975 learned_addr learned my addr 172.21.15.92:0/1114071975 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:03.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f938bfff700 1 --2- 172.21.15.92:0/1114071975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f938c1002e0 0x7f938c195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:03.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f9390be3700 1 --2- 172.21.15.92:0/1114071975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f938c1019b0 0x7f938c19d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:03.053 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f938b7fe700 1 -- 172.21.15.92:0/1114071975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f938c1019b0 msgr2=0x7f938c19d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:03.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f938b7fe700 1 --2- 172.21.15.92:0/1114071975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f938c1019b0 0x7f938c19d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f938b7fe700 1 -- 172.21.15.92:0/1114071975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f938c1002e0 msgr2=0x7f938c195b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:03.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f938b7fe700 1 --2- 172.21.15.92:0/1114071975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f938c1002e0 0x7f938c195b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f938b7fe700 1 -- 172.21.15.92:0/1114071975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c0095f0 con 0x7f938c100ff0 2023-10-16T13:13:03.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f938bfff700 1 --2- 172.21.15.92:0/1114071975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f938c1002e0 0x7f938c195b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:03.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f938b7fe700 1 --2- 172.21.15.92:0/1114071975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f938c100ff0 0x7f938c196080 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f938000c990 tx=0x7f938000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:03.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f93897fa700 1 -- 172.21.15.92:0/1114071975 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9380007b00 con 0x7f938c100ff0 2023-10-16T13:13:03.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f9392646700 1 -- 172.21.15.92:0/1114071975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c19dc70 con 0x7f938c100ff0 2023-10-16T13:13:03.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.045+0000 7f93897fa700 1 -- 172.21.15.92:0/1114071975 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9380007c60 con 0x7f938c100ff0 2023-10-16T13:13:03.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.046+0000 7f93897fa700 1 -- 172.21.15.92:0/1114071975 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9380018680 con 0x7f938c100ff0 2023-10-16T13:13:03.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.046+0000 7f9392646700 1 -- 172.21.15.92:0/1114071975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c19e180 con 0x7f938c100ff0 2023-10-16T13:13:03.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.047+0000 7f9392646700 1 -- 172.21.15.92:0/1114071975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938c106cb0 con 0x7f938c100ff0 2023-10-16T13:13:03.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.048+0000 7f93897fa700 1 -- 172.21.15.92:0/1114071975 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f9380004020 con 0x7f938c100ff0 2023-10-16T13:13:03.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.048+0000 7f93897fa700 1 --2- 172.21.15.92:0/1114071975 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f93740a1510 0x7f93740a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:03.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.048+0000 7f938bfff700 1 --2- 172.21.15.92:0/1114071975 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f93740a1510 0x7f93740a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:03.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.048+0000 7f93897fa700 1 -- 172.21.15.92:0/1114071975 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f93800ccf80 con 0x7f938c100ff0 2023-10-16T13:13:03.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.049+0000 7f938bfff700 1 --2- 172.21.15.92:0/1114071975 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f93740a1510 0x7f93740a39d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f937c006010 tx=0x7f937c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:03.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.052+0000 7f93897fa700 1 -- 172.21.15.92:0/1114071975 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f93800965d0 con 0x7f938c100ff0 2023-10-16T13:13:03.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.245+0000 7f9392646700 1 -- 172.21.15.92:0/1114071975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f938c02d020 con 0x7f938c100ff0 2023-10-16T13:13:03.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.245+0000 7f93897fa700 1 -- 172.21.15.92:0/1114071975 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9380099bf0 con 0x7f938c100ff0 2023-10-16T13:13:03.249 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-10-16T13:13:03.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.248+0000 7f9392646700 1 -- 172.21.15.92:0/1114071975 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f93740a1510 msgr2=0x7f93740a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:03.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.248+0000 7f9392646700 1 --2- 172.21.15.92:0/1114071975 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f93740a1510 0x7f93740a39d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f937c006010 tx=0x7f937c00b540 comp rx=0 tx=0).stop 2023-10-16T13:13:03.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.248+0000 7f9392646700 1 -- 172.21.15.92:0/1114071975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f938c100ff0 msgr2=0x7f938c196080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:03.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.248+0000 7f9392646700 1 --2- 172.21.15.92:0/1114071975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f938c100ff0 0x7f938c196080 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f938000c990 tx=0x7f938000cd50 comp rx=0 tx=0).stop 2023-10-16T13:13:03.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.248+0000 7f9392646700 1 -- 172.21.15.92:0/1114071975 shutdown_connections 2023-10-16T13:13:03.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.248+0000 7f9392646700 1 --2- 172.21.15.92:0/1114071975 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f93740a1510 0x7f93740a39d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.248+0000 7f9392646700 1 --2- 172.21.15.92:0/1114071975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f938c1019b0 0x7f938c19d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.248+0000 7f9392646700 1 --2- 172.21.15.92:0/1114071975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f938c1002e0 0x7f938c195b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.248+0000 7f9392646700 1 --2- 172.21.15.92:0/1114071975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f938c100ff0 0x7f938c196080 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.248+0000 7f9392646700 1 -- 172.21.15.92:0/1114071975 >> 172.21.15.92:0/1114071975 conn(0x7f938c0faa90 msgr2=0x7f938c0fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:03.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.248+0000 7f9392646700 1 -- 172.21.15.92:0/1114071975 shutdown_connections 2023-10-16T13:13:03.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.248+0000 7f9392646700 1 -- 172.21.15.92:0/1114071975 wait complete. 2023-10-16T13:13:03.263 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:13:03.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.385+0000 7f8204639700 1 -- 172.21.15.92:0/3607094819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc100fb0 msgr2=0x7f81fc101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:03.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.385+0000 7f8204639700 1 --2- 172.21.15.92:0/3607094819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc100fb0 0x7f81fc101410 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0099c0 tx=0x7f81ec009cd0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.386+0000 7f8204639700 1 -- 172.21.15.92:0/3607094819 shutdown_connections 2023-10-16T13:13:03.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.386+0000 7f8204639700 1 --2- 172.21.15.92:0/3607094819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81fc101950 0x7f81fc108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.386+0000 7f8204639700 1 --2- 172.21.15.92:0/3607094819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81fc0ffdc0 0x7f81fc1001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.386+0000 7f8204639700 1 --2- 172.21.15.92:0/3607094819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc100fb0 0x7f81fc101410 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.386+0000 7f8204639700 1 -- 172.21.15.92:0/3607094819 >> 172.21.15.92:0/3607094819 conn(0x7f81fc0fb2f0 msgr2=0x7f81fc0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:03.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.386+0000 7f8204639700 1 -- 172.21.15.92:0/3607094819 shutdown_connections 2023-10-16T13:13:03.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.386+0000 7f8204639700 1 -- 172.21.15.92:0/3607094819 wait complete. 2023-10-16T13:13:03.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.386+0000 7f8204639700 1 Processor -- start 2023-10-16T13:13:03.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.386+0000 7f8204639700 1 -- start start 2023-10-16T13:13:03.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f8204639700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81fc0ffdc0 0x7f81fc195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:03.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f8204639700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc100fb0 0x7f81fc195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:03.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f8204639700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81fc101950 0x7f81fc19d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:03.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f8204639700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc19d630 con 0x7f81fc100fb0 2023-10-16T13:13:03.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f8204639700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc19d770 con 0x7f81fc101950 2023-10-16T13:13:03.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f8204639700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc19d900 con 0x7f81fc0ffdc0 2023-10-16T13:13:03.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f8201bd4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc100fb0 0x7f81fc195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:03.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f8201bd4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc100fb0 0x7f81fc195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36374/0 (socket says 172.21.15.92:36374) 2023-10-16T13:13:03.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f8201bd4700 1 -- 172.21.15.92:0/2744704796 learned_addr learned my addr 172.21.15.92:0/2744704796 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:03.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f8202bd6700 1 --2- 172.21.15.92:0/2744704796 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81fc101950 0x7f81fc19d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:03.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f82023d5700 1 --2- 172.21.15.92:0/2744704796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81fc0ffdc0 0x7f81fc195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:03.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f8201bd4700 1 -- 172.21.15.92:0/2744704796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81fc0ffdc0 msgr2=0x7f81fc195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:03.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f8201bd4700 1 --2- 172.21.15.92:0/2744704796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81fc0ffdc0 0x7f81fc195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f8201bd4700 1 -- 172.21.15.92:0/2744704796 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81fc101950 msgr2=0x7f81fc19d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:03.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f8201bd4700 1 --2- 172.21.15.92:0/2744704796 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81fc101950 0x7f81fc19d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f8201bd4700 1 -- 172.21.15.92:0/2744704796 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec0095f0 con 0x7f81fc100fb0 2023-10-16T13:13:03.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f8201bd4700 1 --2- 172.21.15.92:0/2744704796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc100fb0 0x7f81fc195ff0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00c010 tx=0x7f81ec009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:03.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f81f37fe700 1 -- 172.21.15.92:0/2744704796 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec01d070 con 0x7f81fc100fb0 2023-10-16T13:13:03.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f81f37fe700 1 -- 172.21.15.92:0/2744704796 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f81ec022470 con 0x7f81fc100fb0 2023-10-16T13:13:03.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f8204639700 1 -- 172.21.15.92:0/2744704796 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81fc19db80 con 0x7f81fc100fb0 2023-10-16T13:13:03.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.387+0000 7f81f37fe700 1 -- 172.21.15.92:0/2744704796 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec017630 con 0x7f81fc100fb0 2023-10-16T13:13:03.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.388+0000 7f8204639700 1 -- 172.21.15.92:0/2744704796 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81fc19dfa0 con 0x7f81fc100fb0 2023-10-16T13:13:03.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.389+0000 7f8204639700 1 -- 172.21.15.92:0/2744704796 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81fc106ca0 con 0x7f81fc100fb0 2023-10-16T13:13:03.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.390+0000 7f81f37fe700 1 -- 172.21.15.92:0/2744704796 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f81ec022950 con 0x7f81fc100fb0 2023-10-16T13:13:03.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.391+0000 7f81f37fe700 1 --2- 172.21.15.92:0/2744704796 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f81e80a1510 0x7f81e80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:03.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.391+0000 7f82023d5700 1 --2- 172.21.15.92:0/2744704796 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f81e80a1510 0x7f81e80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:03.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.391+0000 7f81f37fe700 1 -- 172.21.15.92:0/2744704796 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f81ec0ce1c0 con 0x7f81fc100fb0 2023-10-16T13:13:03.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.391+0000 7f82023d5700 1 --2- 172.21.15.92:0/2744704796 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f81e80a1510 0x7f81e80a39d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f81fc100e10 tx=0x7f81f800a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:03.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.394+0000 7f81f37fe700 1 -- 172.21.15.92:0/2744704796 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f81ec097750 con 0x7f81fc100fb0 2023-10-16T13:13:03.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.589+0000 7f8204639700 1 -- 172.21.15.92:0/2744704796 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f81fc10b710 con 0x7f81fc100fb0 2023-10-16T13:13:03.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.589+0000 7f81f37fe700 1 -- 172.21.15.92:0/2744704796 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f81ec0270a0 con 0x7f81fc100fb0 2023-10-16T13:13:03.592 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-10-16T13:13:03.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.591+0000 7f8204639700 1 -- 172.21.15.92:0/2744704796 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f81e80a1510 msgr2=0x7f81e80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:03.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.591+0000 7f8204639700 1 --2- 172.21.15.92:0/2744704796 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f81e80a1510 0x7f81e80a39d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f81fc100e10 tx=0x7f81f800a3b0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.591+0000 7f8204639700 1 -- 172.21.15.92:0/2744704796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc100fb0 msgr2=0x7f81fc195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:03.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.591+0000 7f8204639700 1 --2- 172.21.15.92:0/2744704796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc100fb0 0x7f81fc195ff0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00c010 tx=0x7f81ec009580 comp rx=0 tx=0).stop 2023-10-16T13:13:03.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.591+0000 7f8204639700 1 -- 172.21.15.92:0/2744704796 shutdown_connections 2023-10-16T13:13:03.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.591+0000 7f8204639700 1 --2- 172.21.15.92:0/2744704796 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f81e80a1510 0x7f81e80a39d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.591+0000 7f8204639700 1 --2- 172.21.15.92:0/2744704796 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81fc101950 0x7f81fc19d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.591+0000 7f8204639700 1 --2- 172.21.15.92:0/2744704796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81fc0ffdc0 0x7f81fc195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.591+0000 7f8204639700 1 --2- 172.21.15.92:0/2744704796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc100fb0 0x7f81fc195ff0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.591+0000 7f8204639700 1 -- 172.21.15.92:0/2744704796 >> 172.21.15.92:0/2744704796 conn(0x7f81fc0fb2f0 msgr2=0x7f81fc0fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:03.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.591+0000 7f8204639700 1 -- 172.21.15.92:0/2744704796 shutdown_connections 2023-10-16T13:13:03.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.592+0000 7f8204639700 1 -- 172.21.15.92:0/2744704796 wait complete. 2023-10-16T13:13:03.607 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:13:03.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.725+0000 7f86fccf4700 1 -- 172.21.15.92:0/2751147608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86f80ffe30 msgr2=0x7f86f8100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:03.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.725+0000 7f86fccf4700 1 --2- 172.21.15.92:0/2751147608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86f80ffe30 0x7f86f8100250 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009990 tx=0x7f86ec009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.725+0000 7f86fccf4700 1 -- 172.21.15.92:0/2751147608 shutdown_connections 2023-10-16T13:13:03.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.725+0000 7f86fccf4700 1 --2- 172.21.15.92:0/2751147608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86f80ffe30 0x7f86f8100250 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.725+0000 7f86fccf4700 1 --2- 172.21.15.92:0/2751147608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86f8101940 0x7f86f8108260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.725+0000 7f86fccf4700 1 --2- 172.21.15.92:0/2751147608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86f8100f80 0x7f86f8101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.725+0000 7f86fccf4700 1 -- 172.21.15.92:0/2751147608 >> 172.21.15.92:0/2751147608 conn(0x7f86f80fb380 msgr2=0x7f86f80fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:03.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.725+0000 7f86fccf4700 1 -- 172.21.15.92:0/2751147608 shutdown_connections 2023-10-16T13:13:03.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.725+0000 7f86fccf4700 1 -- 172.21.15.92:0/2751147608 wait complete. 2023-10-16T13:13:03.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.726+0000 7f86fccf4700 1 Processor -- start 2023-10-16T13:13:03.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.726+0000 7f86fccf4700 1 -- start start 2023-10-16T13:13:03.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.726+0000 7f86fccf4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86f80ffe30 0x7f86f8195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:03.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.726+0000 7f86fccf4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86f8100f80 0x7f86f8196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:03.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.726+0000 7f86fccf4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86f8101940 0x7f86f819d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:03.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.726+0000 7f86fccf4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f819d6b0 con 0x7f86f80ffe30 2023-10-16T13:13:03.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.726+0000 7f86fccf4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f819d7f0 con 0x7f86f8101940 2023-10-16T13:13:03.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.726+0000 7f86fccf4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f819d980 con 0x7f86f8100f80 2023-10-16T13:13:03.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.726+0000 7f86f659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86f80ffe30 0x7f86f8195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:03.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.726+0000 7f86f659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86f80ffe30 0x7f86f8195b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36386/0 (socket says 172.21.15.92:36386) 2023-10-16T13:13:03.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.726+0000 7f86f659c700 1 -- 172.21.15.92:0/2609843414 learned_addr learned my addr 172.21.15.92:0/2609843414 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:03.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.726+0000 7f86f6d9d700 1 --2- 172.21.15.92:0/2609843414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86f8101940 0x7f86f819d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:03.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.727+0000 7f86f659c700 1 -- 172.21.15.92:0/2609843414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86f8100f80 msgr2=0x7f86f8196070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:03.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.727+0000 7f86f659c700 1 --2- 172.21.15.92:0/2609843414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86f8100f80 0x7f86f8196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.727+0000 7f86f659c700 1 -- 172.21.15.92:0/2609843414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86f8101940 msgr2=0x7f86f819d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:03.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.727+0000 7f86f659c700 1 --2- 172.21.15.92:0/2609843414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86f8101940 0x7f86f819d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.727+0000 7f86f659c700 1 -- 172.21.15.92:0/2609843414 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec0095f0 con 0x7f86f80ffe30 2023-10-16T13:13:03.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.727+0000 7f86f6d9d700 1 --2- 172.21.15.92:0/2609843414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86f8101940 0x7f86f819d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:03.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.727+0000 7f86f659c700 1 --2- 172.21.15.92:0/2609843414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86f80ffe30 0x7f86f8195b30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f86ec000c00 tx=0x7f86ec005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:03.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.727+0000 7f86e77fe700 1 -- 172.21.15.92:0/2609843414 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec01d070 con 0x7f86f80ffe30 2023-10-16T13:13:03.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.727+0000 7f86fccf4700 1 -- 172.21.15.92:0/2609843414 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f819dc00 con 0x7f86f80ffe30 2023-10-16T13:13:03.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.727+0000 7f86e77fe700 1 -- 172.21.15.92:0/2609843414 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f86ec004180 con 0x7f86f80ffe30 2023-10-16T13:13:03.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.727+0000 7f86e77fe700 1 -- 172.21.15.92:0/2609843414 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec00f460 con 0x7f86f80ffe30 2023-10-16T13:13:03.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.727+0000 7f86fccf4700 1 -- 172.21.15.92:0/2609843414 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f819e080 con 0x7f86f80ffe30 2023-10-16T13:13:03.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.728+0000 7f86fccf4700 1 -- 172.21.15.92:0/2609843414 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f810b7f0 con 0x7f86f80ffe30 2023-10-16T13:13:03.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.729+0000 7f86e77fe700 1 -- 172.21.15.92:0/2609843414 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f86ec022700 con 0x7f86f80ffe30 2023-10-16T13:13:03.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.729+0000 7f86e77fe700 1 --2- 172.21.15.92:0/2609843414 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f86e00a15c0 0x7f86e00a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:03.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.730+0000 7f86f5d9b700 1 --2- 172.21.15.92:0/2609843414 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f86e00a15c0 0x7f86e00a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:03.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.730+0000 7f86e77fe700 1 -- 172.21.15.92:0/2609843414 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f86ec0ceab0 con 0x7f86f80ffe30 2023-10-16T13:13:03.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.730+0000 7f86f5d9b700 1 --2- 172.21.15.92:0/2609843414 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f86e00a15c0 0x7f86e00a3a80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f86e8005950 tx=0x7f86e80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:03.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.733+0000 7f86e77fe700 1 -- 172.21.15.92:0/2609843414 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f86ec098000 con 0x7f86f80ffe30 2023-10-16T13:13:03.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:03 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/572095134' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:13:03.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:03 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1114071975' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:13:03.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.966+0000 7f86fccf4700 1 -- 172.21.15.92:0/2609843414 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86f8106c00 con 0x7f86f80ffe30 2023-10-16T13:13:03.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.966+0000 7f86e77fe700 1 -- 172.21.15.92:0/2609843414 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11379 (secure 0 0 0) 0x7f86ec09b620 con 0x7f86f80ffe30 2023-10-16T13:13:03.969 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:13:03.970 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-16T13:11:40.343309+0000","modified":"2023-10-16T13:11:48.346678+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24460,"mds_3":24428,"mds_4":24412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1790514945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1790514945},{"type":"v1","addr":"172.21.15.92:6839","nonce":1790514945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/1016260236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1016260236},{"type":"v1","addr":"172.21.15.92:6841","nonce":1016260236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24410":{"gid":24410,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/2133613540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":2133613540},{"type":"v1","addr":"172.21.15.118:6837","nonce":2133613540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6837/2403096460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":2403096460},{"type":"v1","addr":"172.21.15.152:6837","nonce":2403096460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1821921588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1821921588},{"type":"v1","addr":"172.21.15.152:6839","nonce":1821921588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6839/1577355936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":1577355936},{"type":"v1","addr":"172.21.15.118:6839","nonce":1577355936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:13:03.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.969+0000 7f86fccf4700 1 -- 172.21.15.92:0/2609843414 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f86e00a15c0 msgr2=0x7f86e00a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:03.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.969+0000 7f86fccf4700 1 --2- 172.21.15.92:0/2609843414 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f86e00a15c0 0x7f86e00a3a80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f86e8005950 tx=0x7f86e80058e0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.969+0000 7f86fccf4700 1 -- 172.21.15.92:0/2609843414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86f80ffe30 msgr2=0x7f86f8195b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:03.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.969+0000 7f86fccf4700 1 --2- 172.21.15.92:0/2609843414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86f80ffe30 0x7f86f8195b30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f86ec000c00 tx=0x7f86ec005ef0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.969+0000 7f86fccf4700 1 -- 172.21.15.92:0/2609843414 shutdown_connections 2023-10-16T13:13:03.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.969+0000 7f86fccf4700 1 --2- 172.21.15.92:0/2609843414 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f86e00a15c0 0x7f86e00a3a80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.969+0000 7f86fccf4700 1 --2- 172.21.15.92:0/2609843414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86f80ffe30 0x7f86f8195b30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.969+0000 7f86fccf4700 1 --2- 172.21.15.92:0/2609843414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86f8101940 0x7f86f819d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.969+0000 7f86fccf4700 1 --2- 172.21.15.92:0/2609843414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86f8100f80 0x7f86f8196070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:03.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.969+0000 7f86fccf4700 1 -- 172.21.15.92:0/2609843414 >> 172.21.15.92:0/2609843414 conn(0x7f86f80fb380 msgr2=0x7f86f80fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:03.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.969+0000 7f86fccf4700 1 -- 172.21.15.92:0/2609843414 shutdown_connections 2023-10-16T13:13:03.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:03.969+0000 7f86fccf4700 1 -- 172.21.15.92:0/2609843414 wait complete. 2023-10-16T13:13:03.974 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 27 2023-10-16T13:13:03.983 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:03 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/572095134' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:13:03.983 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:03 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1114071975' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:13:03.984 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:13:04.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:03 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/572095134' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:13:04.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:03 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1114071975' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:13:04.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.103+0000 7f4658442700 1 -- 172.21.15.92:0/2933605856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4650101960 msgr2=0x7f4650108210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:04.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.103+0000 7f4658442700 1 --2- 172.21.15.92:0/2933605856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4650101960 0x7f4650108210 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f464800b0d0 tx=0x7f464800b3e0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.103+0000 7f4658442700 1 -- 172.21.15.92:0/2933605856 shutdown_connections 2023-10-16T13:13:04.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.103+0000 7f4658442700 1 --2- 172.21.15.92:0/2933605856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4650101960 0x7f4650108210 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.103+0000 7f4658442700 1 --2- 172.21.15.92:0/2933605856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46500ffdd0 0x7f46501001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.103+0000 7f4658442700 1 --2- 172.21.15.92:0/2933605856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4650100fc0 0x7f4650101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.103+0000 7f4658442700 1 -- 172.21.15.92:0/2933605856 >> 172.21.15.92:0/2933605856 conn(0x7f46500fb320 msgr2=0x7f46500fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:04.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.103+0000 7f4658442700 1 -- 172.21.15.92:0/2933605856 shutdown_connections 2023-10-16T13:13:04.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.103+0000 7f4658442700 1 -- 172.21.15.92:0/2933605856 wait complete. 2023-10-16T13:13:04.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.103+0000 7f4658442700 1 Processor -- start 2023-10-16T13:13:04.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.103+0000 7f4658442700 1 -- start start 2023-10-16T13:13:04.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.103+0000 7f4658442700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46500ffdd0 0x7f4650196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:04.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.103+0000 7f4658442700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4650100fc0 0x7f46501970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:04.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.103+0000 7f4658442700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4650101960 0x7f465019e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:04.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.103+0000 7f4658442700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465019e6e0 con 0x7f4650101960 2023-10-16T13:13:04.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.103+0000 7f4658442700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465019e820 con 0x7f46500ffdd0 2023-10-16T13:13:04.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.103+0000 7f4658442700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465019e9b0 con 0x7f4650100fc0 2023-10-16T13:13:04.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.104+0000 7f46569df700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4650101960 0x7f465019e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:04.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.104+0000 7f46569df700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4650101960 0x7f465019e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36404/0 (socket says 172.21.15.92:36404) 2023-10-16T13:13:04.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.104+0000 7f46569df700 1 -- 172.21.15.92:0/939828487 learned_addr learned my addr 172.21.15.92:0/939828487 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:04.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.104+0000 7f46561de700 1 --2- 172.21.15.92:0/939828487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46500ffdd0 0x7f4650196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:04.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.104+0000 7f46559dd700 1 --2- 172.21.15.92:0/939828487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4650100fc0 0x7f46501970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:04.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.104+0000 7f46569df700 1 -- 172.21.15.92:0/939828487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4650100fc0 msgr2=0x7f46501970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:04.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.104+0000 7f46569df700 1 --2- 172.21.15.92:0/939828487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4650100fc0 0x7f46501970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.104+0000 7f46569df700 1 -- 172.21.15.92:0/939828487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46500ffdd0 msgr2=0x7f4650196b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:04.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.104+0000 7f46569df700 1 --2- 172.21.15.92:0/939828487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46500ffdd0 0x7f4650196b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.104+0000 7f46569df700 1 -- 172.21.15.92:0/939828487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4648009d00 con 0x7f4650101960 2023-10-16T13:13:04.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.104+0000 7f46559dd700 1 --2- 172.21.15.92:0/939828487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4650100fc0 0x7f46501970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:04.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.104+0000 7f46569df700 1 --2- 172.21.15.92:0/939828487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4650101960 0x7f465019e110 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4648007b60 tx=0x7f4648009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:04.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.104+0000 7f46477fe700 1 -- 172.21.15.92:0/939828487 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464800e040 con 0x7f4650101960 2023-10-16T13:13:04.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.104+0000 7f4658442700 1 -- 172.21.15.92:0/939828487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465019ec30 con 0x7f4650101960 2023-10-16T13:13:04.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.104+0000 7f46477fe700 1 -- 172.21.15.92:0/939828487 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4648003e10 con 0x7f4650101960 2023-10-16T13:13:04.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.104+0000 7f46477fe700 1 -- 172.21.15.92:0/939828487 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46480055b0 con 0x7f4650101960 2023-10-16T13:13:04.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.104+0000 7f4658442700 1 -- 172.21.15.92:0/939828487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465019f0b0 con 0x7f4650101960 2023-10-16T13:13:04.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.105+0000 7f4658442700 1 -- 172.21.15.92:0/939828487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f465010c8c0 con 0x7f4650101960 2023-10-16T13:13:04.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.106+0000 7f46477fe700 1 -- 172.21.15.92:0/939828487 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f464801bc30 con 0x7f4650101960 2023-10-16T13:13:04.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.107+0000 7f46477fe700 1 --2- 172.21.15.92:0/939828487 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f463c0a15c0 0x7f463c0a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:04.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.107+0000 7f46561de700 1 --2- 172.21.15.92:0/939828487 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f463c0a15c0 0x7f463c0a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:04.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.107+0000 7f46477fe700 1 -- 172.21.15.92:0/939828487 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f46480ced30 con 0x7f4650101960 2023-10-16T13:13:04.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.107+0000 7f46561de700 1 --2- 172.21.15.92:0/939828487 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f463c0a15c0 0x7f463c0a3a80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4650100e20 tx=0x7f464c00a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:04.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.110+0000 7f46477fe700 1 -- 172.21.15.92:0/939828487 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4648098280 con 0x7f4650101960 2023-10-16T13:13:04.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.307+0000 7f4658442700 1 -- 172.21.15.92:0/939828487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4650106a00 con 0x7f4650101960 2023-10-16T13:13:04.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.309+0000 7f46477fe700 1 -- 172.21.15.92:0/939828487 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22598 (secure 0 0 0) 0x7f464809b8a0 con 0x7f4650101960 2023-10-16T13:13:04.312 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:13:04.312 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":85,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:12:36.335213+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:11:38.345035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:11:39.549912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:13:04.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.311+0000 7f4658442700 1 -- 172.21.15.92:0/939828487 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f463c0a15c0 msgr2=0x7f463c0a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:04.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.311+0000 7f4658442700 1 --2- 172.21.15.92:0/939828487 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f463c0a15c0 0x7f463c0a3a80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4650100e20 tx=0x7f464c00a3b0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.311+0000 7f4658442700 1 -- 172.21.15.92:0/939828487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4650101960 msgr2=0x7f465019e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:04.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.311+0000 7f4658442700 1 --2- 172.21.15.92:0/939828487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4650101960 0x7f465019e110 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4648007b60 tx=0x7f4648009380 comp rx=0 tx=0).stop 2023-10-16T13:13:04.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.311+0000 7f4658442700 1 -- 172.21.15.92:0/939828487 shutdown_connections 2023-10-16T13:13:04.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.311+0000 7f4658442700 1 --2- 172.21.15.92:0/939828487 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f463c0a15c0 0x7f463c0a3a80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.311+0000 7f4658442700 1 --2- 172.21.15.92:0/939828487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4650101960 0x7f465019e110 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.311+0000 7f4658442700 1 --2- 172.21.15.92:0/939828487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46500ffdd0 0x7f4650196b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.311+0000 7f4658442700 1 --2- 172.21.15.92:0/939828487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4650100fc0 0x7f46501970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.311+0000 7f4658442700 1 -- 172.21.15.92:0/939828487 >> 172.21.15.92:0/939828487 conn(0x7f46500fb320 msgr2=0x7f46500fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:04.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.311+0000 7f4658442700 1 -- 172.21.15.92:0/939828487 shutdown_connections 2023-10-16T13:13:04.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.311+0000 7f4658442700 1 -- 172.21.15.92:0/939828487 wait complete. 2023-10-16T13:13:04.327 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:07:45.516334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:11:38.345035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:11:39.549912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:13:04.327 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:13:04.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.449+0000 7f424759d700 1 -- 172.21.15.92:0/292737489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42401019c0 msgr2=0x7f4240103db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:04.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.449+0000 7f424759d700 1 --2- 172.21.15.92:0/292737489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42401019c0 0x7f4240103db0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4230009990 tx=0x7f4230009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.449+0000 7f424759d700 1 -- 172.21.15.92:0/292737489 shutdown_connections 2023-10-16T13:13:04.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.449+0000 7f424759d700 1 --2- 172.21.15.92:0/292737489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42401019c0 0x7f4240103db0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.449+0000 7f424759d700 1 --2- 172.21.15.92:0/292737489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4240106c20 0x7f4240109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.449+0000 7f424759d700 1 --2- 172.21.15.92:0/292737489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42401042f0 0x7f42401066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.449+0000 7f424759d700 1 -- 172.21.15.92:0/292737489 >> 172.21.15.92:0/292737489 conn(0x7f42400fb350 msgr2=0x7f42400fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:04.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.449+0000 7f424759d700 1 -- 172.21.15.92:0/292737489 shutdown_connections 2023-10-16T13:13:04.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.449+0000 7f424759d700 1 -- 172.21.15.92:0/292737489 wait complete. 2023-10-16T13:13:04.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.449+0000 7f424759d700 1 Processor -- start 2023-10-16T13:13:04.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.449+0000 7f424759d700 1 -- start start 2023-10-16T13:13:04.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f424759d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42401019c0 0x7f4240196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:04.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f424759d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42401042f0 0x7f42401971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:04.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f424759d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4240106c20 0x7f424019e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:04.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f424759d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424019e7c0 con 0x7f4240106c20 2023-10-16T13:13:04.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f424759d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424019e930 con 0x7f42401042f0 2023-10-16T13:13:04.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f424759d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424019eaf0 con 0x7f42401019c0 2023-10-16T13:13:04.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f4245b3a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4240106c20 0x7f424019e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:04.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f4245b3a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4240106c20 0x7f424019e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36416/0 (socket says 172.21.15.92:36416) 2023-10-16T13:13:04.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f4245b3a700 1 -- 172.21.15.92:0/297118922 learned_addr learned my addr 172.21.15.92:0/297118922 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:04.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f4245339700 1 --2- 172.21.15.92:0/297118922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42401019c0 0x7f4240196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:04.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f4244b38700 1 --2- 172.21.15.92:0/297118922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42401042f0 0x7f42401971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:04.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f4245b3a700 1 -- 172.21.15.92:0/297118922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42401019c0 msgr2=0x7f4240196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:04.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f4245b3a700 1 --2- 172.21.15.92:0/297118922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42401019c0 0x7f4240196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f4245b3a700 1 -- 172.21.15.92:0/297118922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42401042f0 msgr2=0x7f42401971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:04.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f4245b3a700 1 --2- 172.21.15.92:0/297118922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42401042f0 0x7f42401971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f4245b3a700 1 -- 172.21.15.92:0/297118922 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42300095f0 con 0x7f4240106c20 2023-10-16T13:13:04.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f4245b3a700 1 --2- 172.21.15.92:0/297118922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4240106c20 0x7f424019e1f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f423800ada0 tx=0x7f423800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:04.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f42367fc700 1 -- 172.21.15.92:0/297118922 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423800f070 con 0x7f4240106c20 2023-10-16T13:13:04.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f424759d700 1 -- 172.21.15.92:0/297118922 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f424019edd0 con 0x7f4240106c20 2023-10-16T13:13:04.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f42367fc700 1 -- 172.21.15.92:0/297118922 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4238007b30 con 0x7f4240106c20 2023-10-16T13:13:04.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.450+0000 7f42367fc700 1 -- 172.21.15.92:0/297118922 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42380053c0 con 0x7f4240106c20 2023-10-16T13:13:04.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.451+0000 7f424759d700 1 -- 172.21.15.92:0/297118922 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f424019f1d0 con 0x7f4240106c20 2023-10-16T13:13:04.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.452+0000 7f424759d700 1 -- 172.21.15.92:0/297118922 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42400fced0 con 0x7f4240106c20 2023-10-16T13:13:04.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.453+0000 7f42367fc700 1 -- 172.21.15.92:0/297118922 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f423800c980 con 0x7f4240106c20 2023-10-16T13:13:04.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.453+0000 7f42367fc700 1 --2- 172.21.15.92:0/297118922 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f422c0a1510 0x7f422c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:04.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.453+0000 7f4245339700 1 --2- 172.21.15.92:0/297118922 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f422c0a1510 0x7f422c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:04.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.454+0000 7f42367fc700 1 -- 172.21.15.92:0/297118922 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f42380cca10 con 0x7f4240106c20 2023-10-16T13:13:04.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.454+0000 7f4245339700 1 --2- 172.21.15.92:0/297118922 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f422c0a1510 0x7f422c0a39d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4230000c00 tx=0x7f4230005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:04.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.457+0000 7f42367fc700 1 -- 172.21.15.92:0/297118922 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4238095f60 con 0x7f4240106c20 2023-10-16T13:13:04.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.647+0000 7f424759d700 1 -- 172.21.15.92:0/297118922 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f424002d020 con 0x7f4240106c20 2023-10-16T13:13:04.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.647+0000 7f42367fc700 1 -- 172.21.15.92:0/297118922 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4238099580 con 0x7f4240106c20 2023-10-16T13:13:04.651 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-10-16T13:13:04.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.649+0000 7f424759d700 1 -- 172.21.15.92:0/297118922 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f422c0a1510 msgr2=0x7f422c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.649+0000 7f424759d700 1 --2- 172.21.15.92:0/297118922 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f422c0a1510 0x7f422c0a39d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4230000c00 tx=0x7f4230005fb0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.649+0000 7f424759d700 1 -- 172.21.15.92:0/297118922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4240106c20 msgr2=0x7f424019e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.649+0000 7f424759d700 1 --2- 172.21.15.92:0/297118922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4240106c20 0x7f424019e1f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f423800ada0 tx=0x7f423800c330 comp rx=0 tx=0).stop 2023-10-16T13:13:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.649+0000 7f424759d700 1 -- 172.21.15.92:0/297118922 shutdown_connections 2023-10-16T13:13:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.649+0000 7f424759d700 1 --2- 172.21.15.92:0/297118922 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f422c0a1510 0x7f422c0a39d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.649+0000 7f424759d700 1 --2- 172.21.15.92:0/297118922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4240106c20 0x7f424019e1f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.649+0000 7f424759d700 1 --2- 172.21.15.92:0/297118922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42401019c0 0x7f4240196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.649+0000 7f424759d700 1 --2- 172.21.15.92:0/297118922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42401042f0 0x7f42401971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.649+0000 7f424759d700 1 -- 172.21.15.92:0/297118922 >> 172.21.15.92:0/297118922 conn(0x7f42400fb350 msgr2=0x7f4240102630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:04.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.649+0000 7f424759d700 1 -- 172.21.15.92:0/297118922 shutdown_connections 2023-10-16T13:13:04.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.649+0000 7f424759d700 1 -- 172.21.15.92:0/297118922 wait complete. 2023-10-16T13:13:04.666 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:13:04.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.787+0000 7f546cc5b700 1 -- 172.21.15.92:0/1963781416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5468101940 msgr2=0x7f54681081f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:04.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.787+0000 7f546cc5b700 1 --2- 172.21.15.92:0/1963781416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5468101940 0x7f54681081f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f546000b0d0 tx=0x7f546000b3e0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.788+0000 7f546cc5b700 1 -- 172.21.15.92:0/1963781416 shutdown_connections 2023-10-16T13:13:04.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.788+0000 7f546cc5b700 1 --2- 172.21.15.92:0/1963781416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5468101940 0x7f54681081f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.788+0000 7f546cc5b700 1 --2- 172.21.15.92:0/1963781416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54680ffdb0 0x7f54681001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.788+0000 7f546cc5b700 1 --2- 172.21.15.92:0/1963781416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5468100fa0 0x7f5468101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.788+0000 7f546cc5b700 1 -- 172.21.15.92:0/1963781416 >> 172.21.15.92:0/1963781416 conn(0x7f54680fb320 msgr2=0x7f54680fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:04.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.788+0000 7f546cc5b700 1 -- 172.21.15.92:0/1963781416 shutdown_connections 2023-10-16T13:13:04.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.788+0000 7f546cc5b700 1 -- 172.21.15.92:0/1963781416 wait complete. 2023-10-16T13:13:04.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.788+0000 7f546cc5b700 1 Processor -- start 2023-10-16T13:13:04.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.788+0000 7f546cc5b700 1 -- start start 2023-10-16T13:13:04.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f546cc5b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54680ffdb0 0x7f5468196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:04.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f546cc5b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5468100fa0 0x7f54681972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:04.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f546cc5b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5468101940 0x7f546819e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:04.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f546cc5b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546819e8e0 con 0x7f54680ffdb0 2023-10-16T13:13:04.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f546cc5b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546819ea20 con 0x7f5468100fa0 2023-10-16T13:13:04.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f546cc5b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546819ebb0 con 0x7f5468101940 2023-10-16T13:13:04.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f546659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54680ffdb0 0x7f5468196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:04.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f546659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54680ffdb0 0x7f5468196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36426/0 (socket says 172.21.15.92:36426) 2023-10-16T13:13:04.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f546659c700 1 -- 172.21.15.92:0/2198307389 learned_addr learned my addr 172.21.15.92:0/2198307389 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:04.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f546659c700 1 -- 172.21.15.92:0/2198307389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5468101940 msgr2=0x7f546819e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:04.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f546659c700 1 --2- 172.21.15.92:0/2198307389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5468101940 0x7f546819e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f546659c700 1 -- 172.21.15.92:0/2198307389 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5468100fa0 msgr2=0x7f54681972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:04.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f5465d9b700 1 --2- 172.21.15.92:0/2198307389 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5468100fa0 0x7f54681972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:04.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f546659c700 1 --2- 172.21.15.92:0/2198307389 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5468100fa0 0x7f54681972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f546659c700 1 -- 172.21.15.92:0/2198307389 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5460009d00 con 0x7f54680ffdb0 2023-10-16T13:13:04.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f546659c700 1 --2- 172.21.15.92:0/2198307389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54680ffdb0 0x7f5468196d60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f545800e970 tx=0x7f545800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:04.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f54577fe700 1 -- 172.21.15.92:0/2198307389 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458009790 con 0x7f54680ffdb0 2023-10-16T13:13:04.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f54577fe700 1 -- 172.21.15.92:0/2198307389 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5458004500 con 0x7f54680ffdb0 2023-10-16T13:13:04.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f546cc5b700 1 -- 172.21.15.92:0/2198307389 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546819ee90 con 0x7f54680ffdb0 2023-10-16T13:13:04.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f54577fe700 1 -- 172.21.15.92:0/2198307389 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458010430 con 0x7f54680ffdb0 2023-10-16T13:13:04.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.789+0000 7f546cc5b700 1 -- 172.21.15.92:0/2198307389 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546819f2b0 con 0x7f54680ffdb0 2023-10-16T13:13:04.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.790+0000 7f546cc5b700 1 -- 172.21.15.92:0/2198307389 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546810b780 con 0x7f54680ffdb0 2023-10-16T13:13:04.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.791+0000 7f54577fe700 1 -- 172.21.15.92:0/2198307389 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f545800cbd0 con 0x7f54680ffdb0 2023-10-16T13:13:04.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.792+0000 7f54577fe700 1 --2- 172.21.15.92:0/2198307389 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f54500a1510 0x7f54500a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:04.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.792+0000 7f5465d9b700 1 --2- 172.21.15.92:0/2198307389 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f54500a1510 0x7f54500a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:04.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.792+0000 7f54577fe700 1 -- 172.21.15.92:0/2198307389 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5458014070 con 0x7f54680ffdb0 2023-10-16T13:13:04.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.792+0000 7f5465d9b700 1 --2- 172.21.15.92:0/2198307389 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f54500a1510 0x7f54500a39d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f545c005950 tx=0x7f545c005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:04.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.795+0000 7f54577fe700 1 -- 172.21.15.92:0/2198307389 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f54580967a0 con 0x7f54680ffdb0 2023-10-16T13:13:04.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:04 smithi152 ceph-mon[104423]: pgmap v299: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-16T13:13:04.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:04 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2744704796' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:13:04.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:04 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2609843414' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:13:04.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:04 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/939828487' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:04.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.988+0000 7f546cc5b700 1 -- 172.21.15.92:0/2198307389 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f546819f530 con 0x7f54680ffdb0 2023-10-16T13:13:04.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.989+0000 7f54577fe700 1 -- 172.21.15.92:0/2198307389 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5458099dc0 con 0x7f54680ffdb0 2023-10-16T13:13:04.992 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-10-16T13:13:04.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.991+0000 7f546cc5b700 1 -- 172.21.15.92:0/2198307389 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f54500a1510 msgr2=0x7f54500a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:04.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.991+0000 7f546cc5b700 1 --2- 172.21.15.92:0/2198307389 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f54500a1510 0x7f54500a39d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f545c005950 tx=0x7f545c005cf0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.991+0000 7f546cc5b700 1 -- 172.21.15.92:0/2198307389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54680ffdb0 msgr2=0x7f5468196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:04.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.991+0000 7f546cc5b700 1 --2- 172.21.15.92:0/2198307389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54680ffdb0 0x7f5468196d60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f545800e970 tx=0x7f545800ed30 comp rx=0 tx=0).stop 2023-10-16T13:13:04.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.991+0000 7f546cc5b700 1 -- 172.21.15.92:0/2198307389 shutdown_connections 2023-10-16T13:13:04.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.991+0000 7f546cc5b700 1 --2- 172.21.15.92:0/2198307389 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f54500a1510 0x7f54500a39d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.991+0000 7f546cc5b700 1 --2- 172.21.15.92:0/2198307389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54680ffdb0 0x7f5468196d60 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.991+0000 7f546cc5b700 1 --2- 172.21.15.92:0/2198307389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5468101940 0x7f546819e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.991+0000 7f546cc5b700 1 --2- 172.21.15.92:0/2198307389 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5468100fa0 0x7f54681972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:04.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.991+0000 7f546cc5b700 1 -- 172.21.15.92:0/2198307389 >> 172.21.15.92:0/2198307389 conn(0x7f54680fb320 msgr2=0x7f5468068040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:04.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.991+0000 7f546cc5b700 1 -- 172.21.15.92:0/2198307389 shutdown_connections 2023-10-16T13:13:04.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:04.991+0000 7f546cc5b700 1 -- 172.21.15.92:0/2198307389 wait complete. 2023-10-16T13:13:04.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:04 smithi092 ceph-mon[99542]: pgmap v299: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-16T13:13:04.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:04 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2744704796' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:13:04.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:04 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2609843414' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:13:04.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:04 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/939828487' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:05.006 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:13:05.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:04 smithi118 ceph-mon[103969]: pgmap v299: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-16T13:13:05.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:04 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2744704796' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:13:05.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:04 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2609843414' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:13:05.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:04 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/939828487' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:05.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.128+0000 7f12a951a700 1 -- 172.21.15.92:0/681378278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12a41019c0 msgr2=0x7f12a4103db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:05.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.128+0000 7f12a951a700 1 --2- 172.21.15.92:0/681378278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12a41019c0 0x7f12a4103db0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1298009990 tx=0x7f1298009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.128+0000 7f12a951a700 1 -- 172.21.15.92:0/681378278 shutdown_connections 2023-10-16T13:13:05.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.128+0000 7f12a951a700 1 --2- 172.21.15.92:0/681378278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12a41019c0 0x7f12a4103db0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.128+0000 7f12a951a700 1 --2- 172.21.15.92:0/681378278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12a4106c20 0x7f12a4109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.128+0000 7f12a951a700 1 --2- 172.21.15.92:0/681378278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12a41042f0 0x7f12a41066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.128+0000 7f12a951a700 1 -- 172.21.15.92:0/681378278 >> 172.21.15.92:0/681378278 conn(0x7f12a40fb350 msgr2=0x7f12a40fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:05.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.128+0000 7f12a951a700 1 -- 172.21.15.92:0/681378278 shutdown_connections 2023-10-16T13:13:05.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.128+0000 7f12a951a700 1 -- 172.21.15.92:0/681378278 wait complete. 2023-10-16T13:13:05.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.129+0000 7f12a951a700 1 Processor -- start 2023-10-16T13:13:05.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.129+0000 7f12a951a700 1 -- start start 2023-10-16T13:13:05.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.129+0000 7f12a951a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12a41019c0 0x7f12a4196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:05.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.129+0000 7f12a951a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12a41042f0 0x7f12a41971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:05.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.129+0000 7f12a951a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12a4106c20 0x7f12a419e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:05.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.129+0000 7f12a951a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a419e810 con 0x7f12a41019c0 2023-10-16T13:13:05.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.129+0000 7f12a951a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a419e980 con 0x7f12a41042f0 2023-10-16T13:13:05.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.129+0000 7f12a951a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a419eb40 con 0x7f12a4106c20 2023-10-16T13:13:05.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.130+0000 7f12a2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12a41019c0 0x7f12a4196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:05.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.130+0000 7f12a2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12a41019c0 0x7f12a4196ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36440/0 (socket says 172.21.15.92:36440) 2023-10-16T13:13:05.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.130+0000 7f12a2ffd700 1 -- 172.21.15.92:0/2186290740 learned_addr learned my addr 172.21.15.92:0/2186290740 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:05.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.130+0000 7f12a27fc700 1 --2- 172.21.15.92:0/2186290740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12a41042f0 0x7f12a41971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:05.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.130+0000 7f12a37fe700 1 --2- 172.21.15.92:0/2186290740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12a4106c20 0x7f12a419e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:05.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.130+0000 7f12a2ffd700 1 -- 172.21.15.92:0/2186290740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12a4106c20 msgr2=0x7f12a419e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:05.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.130+0000 7f12a2ffd700 1 --2- 172.21.15.92:0/2186290740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12a4106c20 0x7f12a419e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.130+0000 7f12a2ffd700 1 -- 172.21.15.92:0/2186290740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12a41042f0 msgr2=0x7f12a41971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:05.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.130+0000 7f12a2ffd700 1 --2- 172.21.15.92:0/2186290740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12a41042f0 0x7f12a41971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.130+0000 7f12a2ffd700 1 -- 172.21.15.92:0/2186290740 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12980095f0 con 0x7f12a41019c0 2023-10-16T13:13:05.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.130+0000 7f12a2ffd700 1 --2- 172.21.15.92:0/2186290740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12a41019c0 0x7f12a4196ca0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f129800f690 tx=0x7f1298009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:05.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.130+0000 7f128bfff700 1 -- 172.21.15.92:0/2186290740 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129801d070 con 0x7f12a41019c0 2023-10-16T13:13:05.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.130+0000 7f12a951a700 1 -- 172.21.15.92:0/2186290740 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a40ff7b0 con 0x7f12a41019c0 2023-10-16T13:13:05.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.130+0000 7f128bfff700 1 -- 172.21.15.92:0/2186290740 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f129800bed0 con 0x7f12a41019c0 2023-10-16T13:13:05.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.130+0000 7f128bfff700 1 -- 172.21.15.92:0/2186290740 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12980054f0 con 0x7f12a41019c0 2023-10-16T13:13:05.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.130+0000 7f12a951a700 1 -- 172.21.15.92:0/2186290740 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a40ffc50 con 0x7f12a41019c0 2023-10-16T13:13:05.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.131+0000 7f12a951a700 1 -- 172.21.15.92:0/2186290740 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a40fced0 con 0x7f12a41019c0 2023-10-16T13:13:05.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.132+0000 7f128bfff700 1 -- 172.21.15.92:0/2186290740 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f1298004800 con 0x7f12a41019c0 2023-10-16T13:13:05.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.133+0000 7f128bfff700 1 --2- 172.21.15.92:0/2186290740 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f128c0a1510 0x7f128c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:05.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.133+0000 7f12a27fc700 1 --2- 172.21.15.92:0/2186290740 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f128c0a1510 0x7f128c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:05.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.133+0000 7f128bfff700 1 -- 172.21.15.92:0/2186290740 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f12980ce510 con 0x7f12a41019c0 2023-10-16T13:13:05.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.134+0000 7f12a27fc700 1 --2- 172.21.15.92:0/2186290740 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f128c0a1510 0x7f128c0a39d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f12a41981a0 tx=0x7f129400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:05.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.137+0000 7f128bfff700 1 -- 172.21.15.92:0/2186290740 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1298097aa0 con 0x7f12a41019c0 2023-10-16T13:13:05.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.354+0000 7f12a951a700 1 -- 172.21.15.92:0/2186290740 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12a410c9f0 con 0x7f12a41019c0 2023-10-16T13:13:05.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.355+0000 7f128bfff700 1 -- 172.21.15.92:0/2186290740 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f129809b0c0 con 0x7f12a41019c0 2023-10-16T13:13:05.358 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-10-16T13:13:05.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.357+0000 7f12a951a700 1 -- 172.21.15.92:0/2186290740 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f128c0a1510 msgr2=0x7f128c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:05.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.357+0000 7f12a951a700 1 --2- 172.21.15.92:0/2186290740 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f128c0a1510 0x7f128c0a39d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f12a41981a0 tx=0x7f129400a300 comp rx=0 tx=0).stop 2023-10-16T13:13:05.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.357+0000 7f12a951a700 1 -- 172.21.15.92:0/2186290740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12a41019c0 msgr2=0x7f12a4196ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:05.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.357+0000 7f12a951a700 1 --2- 172.21.15.92:0/2186290740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12a41019c0 0x7f12a4196ca0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f129800f690 tx=0x7f1298009580 comp rx=0 tx=0).stop 2023-10-16T13:13:05.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.357+0000 7f12a951a700 1 -- 172.21.15.92:0/2186290740 shutdown_connections 2023-10-16T13:13:05.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.357+0000 7f12a951a700 1 --2- 172.21.15.92:0/2186290740 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f128c0a1510 0x7f128c0a39d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.357+0000 7f12a951a700 1 --2- 172.21.15.92:0/2186290740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12a41019c0 0x7f12a4196ca0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.357+0000 7f12a951a700 1 --2- 172.21.15.92:0/2186290740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12a4106c20 0x7f12a419e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.357+0000 7f12a951a700 1 --2- 172.21.15.92:0/2186290740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12a41042f0 0x7f12a41971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.357+0000 7f12a951a700 1 -- 172.21.15.92:0/2186290740 >> 172.21.15.92:0/2186290740 conn(0x7f12a40fb350 msgr2=0x7f12a4102630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:05.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.357+0000 7f12a951a700 1 -- 172.21.15.92:0/2186290740 shutdown_connections 2023-10-16T13:13:05.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.357+0000 7f12a951a700 1 -- 172.21.15.92:0/2186290740 wait complete. 2023-10-16T13:13:05.372 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:13:05.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.491+0000 7f4c8d289700 1 -- 172.21.15.92:0/3811109397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c881013d0 msgr2=0x7f4c881017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:05.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.491+0000 7f4c8d289700 1 --2- 172.21.15.92:0/3811109397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c881013d0 0x7f4c881017f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009990 tx=0x7f4c78009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.491+0000 7f4c8d289700 1 -- 172.21.15.92:0/3811109397 shutdown_connections 2023-10-16T13:13:05.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.491+0000 7f4c8d289700 1 --2- 172.21.15.92:0/3811109397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c881013d0 0x7f4c881017f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.491+0000 7f4c8d289700 1 --2- 172.21.15.92:0/3811109397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c88100aa0 0x7f4c88108360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.491+0000 7f4c8d289700 1 --2- 172.21.15.92:0/3811109397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c88100100 0x7f4c88100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.491+0000 7f4c8d289700 1 -- 172.21.15.92:0/3811109397 >> 172.21.15.92:0/3811109397 conn(0x7f4c880fab30 msgr2=0x7f4c880fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:05.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.491+0000 7f4c8d289700 1 -- 172.21.15.92:0/3811109397 shutdown_connections 2023-10-16T13:13:05.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.491+0000 7f4c8d289700 1 -- 172.21.15.92:0/3811109397 wait complete. 2023-10-16T13:13:05.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.492+0000 7f4c8d289700 1 Processor -- start 2023-10-16T13:13:05.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.492+0000 7f4c8d289700 1 -- start start 2023-10-16T13:13:05.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.492+0000 7f4c8d289700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c88100100 0x7f4c88198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:05.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.492+0000 7f4c8d289700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c88100aa0 0x7f4c88199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:05.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.492+0000 7f4c8d289700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c881013d0 0x7f4c881a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:05.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.492+0000 7f4c8d289700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c881a0980 con 0x7f4c88100aa0 2023-10-16T13:13:05.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.492+0000 7f4c8d289700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c881a0ac0 con 0x7f4c881013d0 2023-10-16T13:13:05.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.492+0000 7f4c8d289700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c881a0c50 con 0x7f4c88100100 2023-10-16T13:13:05.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.492+0000 7f4c867fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c88100aa0 0x7f4c88199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:05.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.492+0000 7f4c867fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c88100aa0 0x7f4c88199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36456/0 (socket says 172.21.15.92:36456) 2023-10-16T13:13:05.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.492+0000 7f4c867fc700 1 -- 172.21.15.92:0/1709098973 learned_addr learned my addr 172.21.15.92:0/1709098973 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.493+0000 7f4c86ffd700 1 --2- 172.21.15.92:0/1709098973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c88100100 0x7f4c88198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.493+0000 7f4c877fe700 1 --2- 172.21.15.92:0/1709098973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c881013d0 0x7f4c881a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.493+0000 7f4c867fc700 1 -- 172.21.15.92:0/1709098973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c88100100 msgr2=0x7f4c88198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.493+0000 7f4c867fc700 1 --2- 172.21.15.92:0/1709098973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c88100100 0x7f4c88198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.493+0000 7f4c867fc700 1 -- 172.21.15.92:0/1709098973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c881013d0 msgr2=0x7f4c881a03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.493+0000 7f4c867fc700 1 --2- 172.21.15.92:0/1709098973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c881013d0 0x7f4c881a03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.493+0000 7f4c867fc700 1 -- 172.21.15.92:0/1709098973 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c780095f0 con 0x7f4c88100aa0 2023-10-16T13:13:05.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.493+0000 7f4c877fe700 1 --2- 172.21.15.92:0/1709098973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c881013d0 0x7f4c881a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:05.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.493+0000 7f4c867fc700 1 --2- 172.21.15.92:0/1709098973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c88100aa0 0x7f4c88199340 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00b530 tx=0x7f4c7c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:05.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.493+0000 7f4c6ffff700 1 -- 172.21.15.92:0/1709098973 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c011830 con 0x7f4c88100aa0 2023-10-16T13:13:05.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.493+0000 7f4c8d289700 1 -- 172.21.15.92:0/1709098973 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c881a0f30 con 0x7f4c88100aa0 2023-10-16T13:13:05.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.493+0000 7f4c6ffff700 1 -- 172.21.15.92:0/1709098973 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4c7c011e70 con 0x7f4c88100aa0 2023-10-16T13:13:05.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.493+0000 7f4c6ffff700 1 -- 172.21.15.92:0/1709098973 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c00f340 con 0x7f4c88100aa0 2023-10-16T13:13:05.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.493+0000 7f4c8d289700 1 -- 172.21.15.92:0/1709098973 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c881a13b0 con 0x7f4c88100aa0 2023-10-16T13:13:05.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.494+0000 7f4c8d289700 1 -- 172.21.15.92:0/1709098973 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c8810b7f0 con 0x7f4c88100aa0 2023-10-16T13:13:05.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.495+0000 7f4c6ffff700 1 -- 172.21.15.92:0/1709098973 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f4c7c0106d0 con 0x7f4c88100aa0 2023-10-16T13:13:05.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.496+0000 7f4c6ffff700 1 --2- 172.21.15.92:0/1709098973 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4c700a15c0 0x7f4c700a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:05.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.496+0000 7f4c86ffd700 1 --2- 172.21.15.92:0/1709098973 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4c700a15c0 0x7f4c700a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:05.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.496+0000 7f4c6ffff700 1 -- 172.21.15.92:0/1709098973 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4c7c0ccd30 con 0x7f4c88100aa0 2023-10-16T13:13:05.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.496+0000 7f4c86ffd700 1 --2- 172.21.15.92:0/1709098973 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4c700a15c0 0x7f4c700a3a80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4c78000c00 tx=0x7f4c78005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:05.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.500+0000 7f4c6ffff700 1 -- 172.21.15.92:0/1709098973 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4c7c096340 con 0x7f4c88100aa0 2023-10-16T13:13:05.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.735+0000 7f4c8d289700 1 -- 172.21.15.92:0/1709098973 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c8810b9d0 con 0x7f4c88100aa0 2023-10-16T13:13:05.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.736+0000 7f4c6ffff700 1 -- 172.21.15.92:0/1709098973 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11379 (secure 0 0 0) 0x7f4c7c015090 con 0x7f4c88100aa0 2023-10-16T13:13:05.739 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:13:05.739 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-16T13:11:40.343309+0000","modified":"2023-10-16T13:11:48.346678+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24460,"mds_3":24428,"mds_4":24412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1790514945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1790514945},{"type":"v1","addr":"172.21.15.92:6839","nonce":1790514945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/1016260236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1016260236},{"type":"v1","addr":"172.21.15.92:6841","nonce":1016260236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24410":{"gid":24410,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/2133613540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":2133613540},{"type":"v1","addr":"172.21.15.118:6837","nonce":2133613540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6837/2403096460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":2403096460},{"type":"v1","addr":"172.21.15.152:6837","nonce":2403096460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1821921588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1821921588},{"type":"v1","addr":"172.21.15.152:6839","nonce":1821921588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6839/1577355936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":1577355936},{"type":"v1","addr":"172.21.15.118:6839","nonce":1577355936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:13:05.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.738+0000 7f4c8d289700 1 -- 172.21.15.92:0/1709098973 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4c700a15c0 msgr2=0x7f4c700a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:05.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.738+0000 7f4c8d289700 1 --2- 172.21.15.92:0/1709098973 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4c700a15c0 0x7f4c700a3a80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4c78000c00 tx=0x7f4c78005fb0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.738+0000 7f4c8d289700 1 -- 172.21.15.92:0/1709098973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c88100aa0 msgr2=0x7f4c88199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:05.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.738+0000 7f4c8d289700 1 --2- 172.21.15.92:0/1709098973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c88100aa0 0x7f4c88199340 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00b530 tx=0x7f4c7c00b840 comp rx=0 tx=0).stop 2023-10-16T13:13:05.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.738+0000 7f4c8d289700 1 -- 172.21.15.92:0/1709098973 shutdown_connections 2023-10-16T13:13:05.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.738+0000 7f4c8d289700 1 --2- 172.21.15.92:0/1709098973 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f4c700a15c0 0x7f4c700a3a80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.738+0000 7f4c8d289700 1 --2- 172.21.15.92:0/1709098973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c881013d0 0x7f4c881a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.738+0000 7f4c8d289700 1 --2- 172.21.15.92:0/1709098973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c88100100 0x7f4c88198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.738+0000 7f4c8d289700 1 --2- 172.21.15.92:0/1709098973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c88100aa0 0x7f4c88199340 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.738+0000 7f4c8d289700 1 -- 172.21.15.92:0/1709098973 >> 172.21.15.92:0/1709098973 conn(0x7f4c880fab30 msgr2=0x7f4c880ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:05.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.739+0000 7f4c8d289700 1 -- 172.21.15.92:0/1709098973 shutdown_connections 2023-10-16T13:13:05.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.739+0000 7f4c8d289700 1 -- 172.21.15.92:0/1709098973 wait complete. 2023-10-16T13:13:05.744 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 27 2023-10-16T13:13:05.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:05 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/297118922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:13:05.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:05 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2198307389' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:13:05.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:05 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2186290740' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:13:05.754 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:13:05.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.881+0000 7fd731bba700 1 -- 172.21.15.92:0/2721944639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72c0fffe0 msgr2=0x7fd72c100460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:05.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.881+0000 7fd731bba700 1 --2- 172.21.15.92:0/2721944639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72c0fffe0 0x7fd72c100460 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009990 tx=0x7fd71c009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.881+0000 7fd731bba700 1 -- 172.21.15.92:0/2721944639 shutdown_connections 2023-10-16T13:13:05.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.881+0000 7fd731bba700 1 --2- 172.21.15.92:0/2721944639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd72c1009a0 0x7fd72c108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.881+0000 7fd731bba700 1 --2- 172.21.15.92:0/2721944639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd72c101390 0x7fd72c1017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.881+0000 7fd731bba700 1 --2- 172.21.15.92:0/2721944639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72c0fffe0 0x7fd72c100460 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.881+0000 7fd731bba700 1 -- 172.21.15.92:0/2721944639 >> 172.21.15.92:0/2721944639 conn(0x7fd72c0faab0 msgr2=0x7fd72c0fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:05.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.881+0000 7fd731bba700 1 -- 172.21.15.92:0/2721944639 shutdown_connections 2023-10-16T13:13:05.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.881+0000 7fd731bba700 1 -- 172.21.15.92:0/2721944639 wait complete. 2023-10-16T13:13:05.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.882+0000 7fd731bba700 1 Processor -- start 2023-10-16T13:13:05.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.882+0000 7fd731bba700 1 -- start start 2023-10-16T13:13:05.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.882+0000 7fd731bba700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd72c0fffe0 0x7fd72c196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:05.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.882+0000 7fd731bba700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72c1009a0 0x7fd72c196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:05.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.882+0000 7fd731bba700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd72c101390 0x7fd72c19e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:05.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.882+0000 7fd731bba700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c19e600 con 0x7fd72c1009a0 2023-10-16T13:13:05.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.882+0000 7fd731bba700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c19e740 con 0x7fd72c101390 2023-10-16T13:13:05.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.882+0000 7fd731bba700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c19e8d0 con 0x7fd72c0fffe0 2023-10-16T13:13:05.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.882+0000 7fd72affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72c1009a0 0x7fd72c196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:05.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.882+0000 7fd72affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72c1009a0 0x7fd72c196fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36470/0 (socket says 172.21.15.92:36470) 2023-10-16T13:13:05.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.882+0000 7fd72affd700 1 -- 172.21.15.92:0/1381604583 learned_addr learned my addr 172.21.15.92:0/1381604583 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:05.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.882+0000 7fd72b7fe700 1 --2- 172.21.15.92:0/1381604583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd72c0fffe0 0x7fd72c196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:05.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.882+0000 7fd72bfff700 1 --2- 172.21.15.92:0/1381604583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd72c101390 0x7fd72c19e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:05.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.882+0000 7fd72affd700 1 -- 172.21.15.92:0/1381604583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd72c0fffe0 msgr2=0x7fd72c196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:05.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.882+0000 7fd72affd700 1 --2- 172.21.15.92:0/1381604583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd72c0fffe0 0x7fd72c196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.882+0000 7fd72affd700 1 -- 172.21.15.92:0/1381604583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd72c101390 msgr2=0x7fd72c19e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:05.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.882+0000 7fd72affd700 1 --2- 172.21.15.92:0/1381604583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd72c101390 0x7fd72c19e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:05.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.882+0000 7fd72affd700 1 -- 172.21.15.92:0/1381604583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c0095f0 con 0x7fd72c1009a0 2023-10-16T13:13:05.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.882+0000 7fd72affd700 1 --2- 172.21.15.92:0/1381604583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72c1009a0 0x7fd72c196fc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd71c000c00 tx=0x7fd71c004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:05.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.883+0000 7fd728ff9700 1 -- 172.21.15.92:0/1381604583 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c01d070 con 0x7fd72c1009a0 2023-10-16T13:13:05.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.883+0000 7fd731bba700 1 -- 172.21.15.92:0/1381604583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72c1022a0 con 0x7fd72c1009a0 2023-10-16T13:13:05.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.883+0000 7fd728ff9700 1 -- 172.21.15.92:0/1381604583 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd71c004200 con 0x7fd72c1009a0 2023-10-16T13:13:05.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.883+0000 7fd728ff9700 1 -- 172.21.15.92:0/1381604583 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c00f460 con 0x7fd72c1009a0 2023-10-16T13:13:05.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.883+0000 7fd731bba700 1 -- 172.21.15.92:0/1381604583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72c1027a0 con 0x7fd72c1009a0 2023-10-16T13:13:05.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.884+0000 7fd731bba700 1 -- 172.21.15.92:0/1381604583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72c10b710 con 0x7fd72c1009a0 2023-10-16T13:13:05.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.885+0000 7fd728ff9700 1 -- 172.21.15.92:0/1381604583 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fd71c022470 con 0x7fd72c1009a0 2023-10-16T13:13:05.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.885+0000 7fd728ff9700 1 --2- 172.21.15.92:0/1381604583 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd7140a15c0 0x7fd7140a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:05.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.885+0000 7fd72b7fe700 1 --2- 172.21.15.92:0/1381604583 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd7140a15c0 0x7fd7140a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:05.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.885+0000 7fd728ff9700 1 -- 172.21.15.92:0/1381604583 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd71c0ce4c0 con 0x7fd72c1009a0 2023-10-16T13:13:05.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.886+0000 7fd72b7fe700 1 --2- 172.21.15.92:0/1381604583 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd7140a15c0 0x7fd7140a3a80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd72000ac50 tx=0x7fd72000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:05.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:05.888+0000 7fd728ff9700 1 -- 172.21.15.92:0/1381604583 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd71c097a50 con 0x7fd72c1009a0 2023-10-16T13:13:05.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:05 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/297118922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:13:05.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:05 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2198307389' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:13:05.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:05 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2186290740' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:13:06.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:05 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/297118922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:13:06.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:05 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2198307389' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:13:06.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:05 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2186290740' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:13:06.085 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.083+0000 7fd731bba700 1 -- 172.21.15.92:0/1381604583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd72c1029c0 con 0x7fd72c1009a0 2023-10-16T13:13:06.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.084+0000 7fd728ff9700 1 -- 172.21.15.92:0/1381604583 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22598 (secure 0 0 0) 0x7fd71c09b070 con 0x7fd72c1009a0 2023-10-16T13:13:06.087 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:13:06.088 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":85,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:12:36.335213+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:11:38.345035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:11:39.549912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:13:06.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.086+0000 7fd731bba700 1 -- 172.21.15.92:0/1381604583 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd7140a15c0 msgr2=0x7fd7140a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.087+0000 7fd731bba700 1 --2- 172.21.15.92:0/1381604583 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd7140a15c0 0x7fd7140a3a80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd72000ac50 tx=0x7fd72000a380 comp rx=0 tx=0).stop 2023-10-16T13:13:06.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.087+0000 7fd731bba700 1 -- 172.21.15.92:0/1381604583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72c1009a0 msgr2=0x7fd72c196fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.087+0000 7fd731bba700 1 --2- 172.21.15.92:0/1381604583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72c1009a0 0x7fd72c196fc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd71c000c00 tx=0x7fd71c004710 comp rx=0 tx=0).stop 2023-10-16T13:13:06.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.087+0000 7fd731bba700 1 -- 172.21.15.92:0/1381604583 shutdown_connections 2023-10-16T13:13:06.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.087+0000 7fd731bba700 1 --2- 172.21.15.92:0/1381604583 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd7140a15c0 0x7fd7140a3a80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.087+0000 7fd731bba700 1 --2- 172.21.15.92:0/1381604583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd72c101390 0x7fd72c19e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.087+0000 7fd731bba700 1 --2- 172.21.15.92:0/1381604583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd72c0fffe0 0x7fd72c196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.087+0000 7fd731bba700 1 --2- 172.21.15.92:0/1381604583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72c1009a0 0x7fd72c196fc0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.087+0000 7fd731bba700 1 -- 172.21.15.92:0/1381604583 >> 172.21.15.92:0/1381604583 conn(0x7fd72c0faab0 msgr2=0x7fd72c0fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.087+0000 7fd731bba700 1 -- 172.21.15.92:0/1381604583 shutdown_connections 2023-10-16T13:13:06.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.087+0000 7fd731bba700 1 -- 172.21.15.92:0/1381604583 wait complete. 2023-10-16T13:13:06.103 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-16T13:11:40.343309+0000', 'modified': '2023-10-16T13:11:48.346678+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24491, 'mds_1': 24490, 'mds_2': 24460, 'mds_3': 24428, 'mds_4': 24412}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14613': {'gid': 14613, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6839/1790514945', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6838', 'nonce': 1790514945}, {'type': 'v1', 'addr': '172.21.15.92:6839', 'nonce': 1790514945}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14625': {'gid': 14625, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6841/1016260236', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6840', 'nonce': 1016260236}, {'type': 'v1', 'addr': '172.21.15.92:6841', 'nonce': 1016260236}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24410': {'gid': 24410, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.118:6833/1243983806', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6832', 'nonce': 1243983806}, {'type': 'v1', 'addr': '172.21.15.118:6833', 'nonce': 1243983806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24412': {'gid': 24412, 'name': 'l', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.152:6833/1273074399', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 1273074399}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 1273074399}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24428': {'gid': 24428, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.118:6835/2381374755', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6834', 'nonce': 2381374755}, {'type': 'v1', 'addr': '172.21.15.118:6835', 'nonce': 2381374755}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24460': {'gid': 24460, 'name': 'f', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.152:6835/1393840132', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6834', 'nonce': 1393840132}, {'type': 'v1', 'addr': '172.21.15.152:6835', 'nonce': 1393840132}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.118:6837/2133613540', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6836', 'nonce': 2133613540}, {'type': 'v1', 'addr': '172.21.15.118:6837', 'nonce': 2133613540}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24472': {'gid': 24472, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.152:6837/2403096460', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6836', 'nonce': 2403096460}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 2403096460}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.152:6839/1821921588', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6838', 'nonce': 1821921588}, {'type': 'v1', 'addr': '172.21.15.152:6839', 'nonce': 1821921588}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24491': {'gid': 24491, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6839/1577355936', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6838', 'nonce': 1577355936}, {'type': 'v1', 'addr': '172.21.15.118:6839', 'nonce': 1577355936}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T13:13:06.104 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-16T13:13:06.104 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2023-10-16T13:13:06.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.224+0000 7fc401d28700 1 -- 172.21.15.92:0/2287981803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3fc1010e0 msgr2=0x7fc3fc107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.224+0000 7fc401d28700 1 --2- 172.21.15.92:0/2287981803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3fc1010e0 0x7fc3fc107990 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400b0d0 tx=0x7fc3f400b3e0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.224+0000 7fc401d28700 1 -- 172.21.15.92:0/2287981803 shutdown_connections 2023-10-16T13:13:06.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.224+0000 7fc401d28700 1 --2- 172.21.15.92:0/2287981803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3fc1010e0 0x7fc3fc107990 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.224+0000 7fc401d28700 1 --2- 172.21.15.92:0/2287981803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3fc0ff550 0x7fc3fc0ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.224+0000 7fc401d28700 1 --2- 172.21.15.92:0/2287981803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc100740 0x7fc3fc100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.224+0000 7fc401d28700 1 -- 172.21.15.92:0/2287981803 >> 172.21.15.92:0/2287981803 conn(0x7fc3fc0faac0 msgr2=0x7fc3fc0fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.224+0000 7fc401d28700 1 -- 172.21.15.92:0/2287981803 shutdown_connections 2023-10-16T13:13:06.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.224+0000 7fc401d28700 1 -- 172.21.15.92:0/2287981803 wait complete. 2023-10-16T13:13:06.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.225+0000 7fc401d28700 1 Processor -- start 2023-10-16T13:13:06.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.225+0000 7fc401d28700 1 -- start start 2023-10-16T13:13:06.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.225+0000 7fc401d28700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3fc0ff550 0x7fc3fc10c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.225+0000 7fc401d28700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc100740 0x7fc3fc19b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.225+0000 7fc401d28700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3fc1010e0 0x7fc3fc19dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.225+0000 7fc401d28700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc19e790 con 0x7fc3fc0ff550 2023-10-16T13:13:06.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.225+0000 7fc401d28700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc19e900 con 0x7fc3fc1010e0 2023-10-16T13:13:06.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.225+0000 7fc401d28700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc19eac0 con 0x7fc3fc100740 2023-10-16T13:13:06.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.225+0000 7fc3fb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3fc0ff550 0x7fc3fc10c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.225+0000 7fc3fb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3fc0ff550 0x7fc3fc10c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36482/0 (socket says 172.21.15.92:36482) 2023-10-16T13:13:06.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.225+0000 7fc3fb7fe700 1 -- 172.21.15.92:0/2656481437 learned_addr learned my addr 172.21.15.92:0/2656481437 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.225+0000 7fc3fbfff700 1 --2- 172.21.15.92:0/2656481437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3fc1010e0 0x7fc3fc19dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.225+0000 7fc3faffd700 1 --2- 172.21.15.92:0/2656481437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc100740 0x7fc3fc19b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.226+0000 7fc3fb7fe700 1 -- 172.21.15.92:0/2656481437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc100740 msgr2=0x7fc3fc19b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.226+0000 7fc3fb7fe700 1 --2- 172.21.15.92:0/2656481437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc100740 0x7fc3fc19b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.226+0000 7fc3fb7fe700 1 -- 172.21.15.92:0/2656481437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3fc1010e0 msgr2=0x7fc3fc19dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.226+0000 7fc3fb7fe700 1 --2- 172.21.15.92:0/2656481437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3fc1010e0 0x7fc3fc19dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.226+0000 7fc3fb7fe700 1 -- 172.21.15.92:0/2656481437 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f4009d00 con 0x7fc3fc0ff550 2023-10-16T13:13:06.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.226+0000 7fc3faffd700 1 --2- 172.21.15.92:0/2656481437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc100740 0x7fc3fc19b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:06.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.226+0000 7fc3fb7fe700 1 --2- 172.21.15.92:0/2656481437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3fc0ff550 0x7fc3fc10c390 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00c970 tx=0x7fc3ec00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.226+0000 7fc3f8ff9700 1 -- 172.21.15.92:0/2656481437 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec004220 con 0x7fc3fc0ff550 2023-10-16T13:13:06.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.226+0000 7fc3f8ff9700 1 -- 172.21.15.92:0/2656481437 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc3ec007d80 con 0x7fc3fc0ff550 2023-10-16T13:13:06.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.226+0000 7fc401d28700 1 -- 172.21.15.92:0/2656481437 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3fc19eda0 con 0x7fc3fc0ff550 2023-10-16T13:13:06.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.226+0000 7fc3f8ff9700 1 -- 172.21.15.92:0/2656481437 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec003d70 con 0x7fc3fc0ff550 2023-10-16T13:13:06.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.226+0000 7fc401d28700 1 -- 172.21.15.92:0/2656481437 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3fc19f1f0 con 0x7fc3fc0ff550 2023-10-16T13:13:06.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.228+0000 7fc3f8ff9700 1 -- 172.21.15.92:0/2656481437 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fc3ec004380 con 0x7fc3fc0ff550 2023-10-16T13:13:06.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.229+0000 7fc3f8ff9700 1 --2- 172.21.15.92:0/2656481437 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc3e80a1550 0x7fc3e80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.229+0000 7fc3faffd700 1 --2- 172.21.15.92:0/2656481437 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc3e80a1550 0x7fc3e80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.229+0000 7fc3f8ff9700 1 -- 172.21.15.92:0/2656481437 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc3ec0ccb70 con 0x7fc3fc0ff550 2023-10-16T13:13:06.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.229+0000 7fc3faffd700 1 --2- 172.21.15.92:0/2656481437 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc3e80a1550 0x7fc3e80a3a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4005fd0 tx=0x7fc3e4005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.229+0000 7fc40df12b80 1 Processor -- start 2023-10-16T13:13:06.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc40df12b80 1 -- start start 2023-10-16T13:13:06.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc40df12b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d558dd0 0x55a53d5591f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc40df12b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d559730 0x55a53d559ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc40df12b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d55a5d0 0x55a53d55aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc40df12b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a53d4cdc20 con 0x55a53d559730 2023-10-16T13:13:06.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc40df12b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a53d4b2c10 con 0x55a53d55a5d0 2023-10-16T13:13:06.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc40df12b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a53d4b0530 con 0x55a53d558dd0 2023-10-16T13:13:06.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc3faffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d559730 0x55a53d559ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc3faffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d559730 0x55a53d559ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36492/0 (socket says 172.21.15.92:36492) 2023-10-16T13:13:06.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc3faffd700 1 -- 172.21.15.92:0/1174054765 learned_addr learned my addr 172.21.15.92:0/1174054765 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc3fb7fe700 1 --2- 172.21.15.92:0/1174054765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d558dd0 0x55a53d5591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc3fbfff700 1 --2- 172.21.15.92:0/1174054765 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d55a5d0 0x55a53d55aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc3faffd700 1 -- 172.21.15.92:0/1174054765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d558dd0 msgr2=0x55a53d5591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc3faffd700 1 --2- 172.21.15.92:0/1174054765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d558dd0 0x55a53d5591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc3faffd700 1 -- 172.21.15.92:0/1174054765 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d55a5d0 msgr2=0x55a53d55aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc3faffd700 1 --2- 172.21.15.92:0/1174054765 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d55a5d0 0x55a53d55aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc3faffd700 1 -- 172.21.15.92:0/1174054765 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a53d4693a0 con 0x55a53d559730 2023-10-16T13:13:06.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc3fbfff700 1 --2- 172.21.15.92:0/1174054765 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d55a5d0 0x55a53d55aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:06.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc3faffd700 1 --2- 172.21.15.92:0/1174054765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d559730 0x55a53d559ff0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400dc30 tx=0x7fc3e4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0f2f52979e982f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.230+0000 7fc3f1ffb700 1 -- 172.21.15.92:0/1174054765 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e400f930 con 0x55a53d559730 2023-10-16T13:13:06.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.231+0000 7fc3f1ffb700 1 -- 172.21.15.92:0/1174054765 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc3e401c450 con 0x55a53d559730 2023-10-16T13:13:06.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.231+0000 7fc3f1ffb700 1 -- 172.21.15.92:0/1174054765 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e401b5f0 con 0x55a53d559730 2023-10-16T13:13:06.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.231+0000 7fc40df12b80 1 -- 172.21.15.92:0/1174054765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d559730 msgr2=0x55a53d559ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.231+0000 7fc40df12b80 1 --2- 172.21.15.92:0/1174054765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d559730 0x55a53d559ff0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400dc30 tx=0x7fc3e4010000 comp rx=0 tx=0).stop 2023-10-16T13:13:06.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.231+0000 7fc40df12b80 1 -- 172.21.15.92:0/1174054765 shutdown_connections 2023-10-16T13:13:06.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.231+0000 7fc40df12b80 1 --2- 172.21.15.92:0/1174054765 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d55a5d0 0x55a53d55aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.231+0000 7fc40df12b80 1 --2- 172.21.15.92:0/1174054765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d558dd0 0x55a53d5591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.231+0000 7fc40df12b80 1 --2- 172.21.15.92:0/1174054765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d559730 0x55a53d559ff0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.231+0000 7fc40df12b80 1 -- 172.21.15.92:0/1174054765 >> 172.21.15.92:0/1174054765 conn(0x55a53d486d80 msgr2=0x55a53d553f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.231+0000 7fc40df12b80 1 -- 172.21.15.92:0/1174054765 shutdown_connections 2023-10-16T13:13:06.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.231+0000 7fc40df12b80 1 -- 172.21.15.92:0/1174054765 wait complete. 2023-10-16T13:13:06.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.232+0000 7fc40df12b80 1 -- start start 2023-10-16T13:13:06.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.232+0000 7fc40df12b80 1 Processor -- start 2023-10-16T13:13:06.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.232+0000 7fc40df12b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d558dd0 0x55a53d562c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.232+0000 7fc40df12b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d559730 0x55a53d563170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.232+0000 7fc40df12b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d55a5d0 0x55a53d56a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.232+0000 7fc40df12b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a53d4abe20 con 0x55a53d55a5d0 2023-10-16T13:13:06.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.232+0000 7fc40df12b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a53d4486c0 con 0x55a53d558dd0 2023-10-16T13:13:06.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.232+0000 7fc40df12b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a53d448360 con 0x55a53d559730 2023-10-16T13:13:06.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.232+0000 7fc40df12b80 10 client.0 _ll_register_callbacks cb 0x55a53d2a57b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:06.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.232+0000 7fc3fbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d55a5d0 0x55a53d56a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.232+0000 7fc3fbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d55a5d0 0x55a53d56a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36500/0 (socket says 172.21.15.92:36500) 2023-10-16T13:13:06.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.232+0000 7fc3fbfff700 1 -- 172.21.15.92:0/963805890 learned_addr learned my addr 172.21.15.92:0/963805890 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.232+0000 7fc3fb7fe700 1 --2- 172.21.15.92:0/963805890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d558dd0 0x55a53d562c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.232+0000 7fc3faffd700 1 --2- 172.21.15.92:0/963805890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d559730 0x55a53d563170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc3fbfff700 1 -- 172.21.15.92:0/963805890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d559730 msgr2=0x55a53d563170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc3fbfff700 1 --2- 172.21.15.92:0/963805890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d559730 0x55a53d563170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc3fbfff700 1 -- 172.21.15.92:0/963805890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d558dd0 msgr2=0x55a53d562c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc3fbfff700 1 --2- 172.21.15.92:0/963805890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d558dd0 0x55a53d562c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc3fbfff700 1 -- 172.21.15.92:0/963805890 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e400d8e0 con 0x55a53d55a5d0 2023-10-16T13:13:06.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc3fb7fe700 1 --2- 172.21.15.92:0/963805890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d558dd0 0x55a53d562c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:06.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc3fbfff700 1 --2- 172.21.15.92:0/963805890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d55a5d0 0x55a53d56a1b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4007fd0 tx=0x7fc3f4004b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de0c13d05dc6fb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc3daffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:06.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc3daffd700 1 -- 172.21.15.92:0/963805890 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f400e040 con 0x55a53d55a5d0 2023-10-16T13:13:06.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc3daffd700 1 -- 172.21.15.92:0/963805890 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc3f40076e0 con 0x55a53d55a5d0 2023-10-16T13:13:06.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc40df12b80 1 -- 172.21.15.92:0/963805890 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a53d4b0ea0 con 0x55a53d55a5d0 2023-10-16T13:13:06.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc3daffd700 1 -- 172.21.15.92:0/963805890 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3f40078a0 con 0x55a53d55a5d0 2023-10-16T13:13:06.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc40df12b80 10 client.15237 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:06.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc40df12b80 1 -- 172.21.15.92:0/963805890 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a53d2d6d90 con 0x55a53d55a5d0 2023-10-16T13:13:06.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc3daffd700 1 -- 172.21.15.92:0/963805890 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55a53d4b0ea0 con 0x55a53d55a5d0 2023-10-16T13:13:06.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc3daffd700 1 -- 172.21.15.92:0/963805890 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc3f4019050 con 0x55a53d55a5d0 2023-10-16T13:13:06.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc40df12b80 10 client.15237 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:06.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc40df12b80 10 client.15237 resolve_mds: resolved name 'l' to daemon mds.l 2023-10-16T13:13:06.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc40df12b80 20 client.15237 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:06.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc40df12b80 1 --2- 172.21.15.92:0/963805890 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55a53d56e760 0x55a53d56d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc40df12b80 4 client.15237 mds_command: new command op to 24412 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:13:06.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.233+0000 7fc40df12b80 1 -- 172.21.15.92:0/963805890 --> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a53d528bc0 con 0x55a53d56e760 2023-10-16T13:13:06.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.234+0000 7fc3fb7fe700 1 --2- 172.21.15.92:0/963805890 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55a53d56e760 0x55a53d56d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.234+0000 7fc3daffd700 10 client.15237 ms_handle_connect on v2:172.21.15.152:6832/1273074399 2023-10-16T13:13:06.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.234+0000 7fc3fb7fe700 1 --2- 172.21.15.92:0/963805890 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55a53d56e760 0x55a53d56d1d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ab1e6b4c07b5a4af server_cookie=bd219af6de05ff97 in_seq=0 out_seq=0 2023-10-16T13:13:06.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.235+0000 7fc3daffd700 1 -- 172.21.15.92:0/963805890 <== mds.4 v2:172.21.15.152:6832/1273074399 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a53d528bc0 con 0x55a53d56e760 2023-10-16T13:13:06.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.235+0000 7fc3daffd700 10 client.15237 handle_command_reply: tid=0 2023-10-16T13:13:06.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.235+0000 7fc40df12b80 1 client.15237 shutdown 2023-10-16T13:13:06.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.235+0000 7fc40df12b80 1 -- 172.21.15.92:0/963805890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d55a5d0 msgr2=0x55a53d56a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.235+0000 7fc40df12b80 1 --2- 172.21.15.92:0/963805890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d55a5d0 0x55a53d56a1b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4007fd0 tx=0x7fc3f4004b00 comp rx=0 tx=0).stop 2023-10-16T13:13:06.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.235+0000 7fc40df12b80 1 -- 172.21.15.92:0/963805890 shutdown_connections 2023-10-16T13:13:06.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.235+0000 7fc40df12b80 1 --2- 172.21.15.92:0/963805890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d55a5d0 0x55a53d56a1b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.235+0000 7fc40df12b80 1 --2- 172.21.15.92:0/963805890 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55a53d56e760 0x55a53d56d1d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.235+0000 7fc40df12b80 1 --2- 172.21.15.92:0/963805890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d558dd0 0x55a53d562c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.235+0000 7fc3daffd700 0 client.15237 ms_handle_reset on v2:172.21.15.152:6832/1273074399 2023-10-16T13:13:06.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.235+0000 7fc40df12b80 1 --2- 172.21.15.92:0/963805890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d559730 0x55a53d563170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.235+0000 7fc40df12b80 1 -- 172.21.15.92:0/963805890 >> 172.21.15.92:0/963805890 conn(0x55a53d486d80 msgr2=0x55a53d553ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.235+0000 7fc40df12b80 1 -- 172.21.15.92:0/963805890 shutdown_connections 2023-10-16T13:13:06.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.235+0000 7fc40df12b80 1 -- 172.21.15.92:0/963805890 wait complete. 2023-10-16T13:13:06.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.235+0000 7fc40df12b80 20 client.15237 trim_cache size 0 max 16384 2023-10-16T13:13:06.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.253+0000 7fc40df12b80 1 Processor -- start 2023-10-16T13:13:06.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.253+0000 7fc40df12b80 1 -- start start 2023-10-16T13:13:06.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.253+0000 7fc40df12b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d558dd0 0x55a53d562c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.253+0000 7fc40df12b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d559730 0x55a53d563170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.253+0000 7fc40df12b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d55a5d0 0x55a53d56d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.253+0000 7fc40df12b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a53d32c8d0 con 0x55a53d558dd0 2023-10-16T13:13:06.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.253+0000 7fc40df12b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a53d563b30 con 0x55a53d55a5d0 2023-10-16T13:13:06.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.253+0000 7fc40df12b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a53d561f50 con 0x55a53d559730 2023-10-16T13:13:06.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.253+0000 7fc3fb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d558dd0 0x55a53d562c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.253+0000 7fc3fb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d558dd0 0x55a53d562c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36504/0 (socket says 172.21.15.92:36504) 2023-10-16T13:13:06.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.253+0000 7fc3fb7fe700 1 -- 172.21.15.92:0/1194940308 learned_addr learned my addr 172.21.15.92:0/1194940308 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.253+0000 7fc3faffd700 1 --2- 172.21.15.92:0/1194940308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d559730 0x55a53d563170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.253+0000 7fc3fb7fe700 1 -- 172.21.15.92:0/1194940308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d559730 msgr2=0x55a53d563170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.253+0000 7fc3fb7fe700 1 --2- 172.21.15.92:0/1194940308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d559730 0x55a53d563170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.253+0000 7fc3fb7fe700 1 -- 172.21.15.92:0/1194940308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d55a5d0 msgr2=0x55a53d56d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.253+0000 7fc3fb7fe700 1 --2- 172.21.15.92:0/1194940308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d55a5d0 0x55a53d56d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.253+0000 7fc3fb7fe700 1 -- 172.21.15.92:0/1194940308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a53d577390 con 0x55a53d558dd0 2023-10-16T13:13:06.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.253+0000 7fc3fb7fe700 1 --2- 172.21.15.92:0/1194940308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d558dd0 0x55a53d562c30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0961f0 tx=0x7fc3ec0cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc7e181a46dd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.254+0000 7fc3f27fc700 1 -- 172.21.15.92:0/1194940308 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec0b6070 con 0x55a53d558dd0 2023-10-16T13:13:06.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.254+0000 7fc3f27fc700 1 -- 172.21.15.92:0/1194940308 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc3ec0a2080 con 0x55a53d558dd0 2023-10-16T13:13:06.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.254+0000 7fc3f27fc700 1 -- 172.21.15.92:0/1194940308 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec09a1b0 con 0x55a53d558dd0 2023-10-16T13:13:06.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.254+0000 7fc40df12b80 1 -- 172.21.15.92:0/1194940308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d558dd0 msgr2=0x55a53d562c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.254+0000 7fc40df12b80 1 --2- 172.21.15.92:0/1194940308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d558dd0 0x55a53d562c30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0961f0 tx=0x7fc3ec0cc040 comp rx=0 tx=0).stop 2023-10-16T13:13:06.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.254+0000 7fc40df12b80 1 -- 172.21.15.92:0/1194940308 shutdown_connections 2023-10-16T13:13:06.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.254+0000 7fc40df12b80 1 --2- 172.21.15.92:0/1194940308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d558dd0 0x55a53d562c30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.254+0000 7fc40df12b80 1 --2- 172.21.15.92:0/1194940308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d55a5d0 0x55a53d56d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.254+0000 7fc40df12b80 1 --2- 172.21.15.92:0/1194940308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d559730 0x55a53d563170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.254+0000 7fc40df12b80 1 -- 172.21.15.92:0/1194940308 >> 172.21.15.92:0/1194940308 conn(0x55a53d486d80 msgr2=0x55a53d560a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.254+0000 7fc40df12b80 1 -- 172.21.15.92:0/1194940308 shutdown_connections 2023-10-16T13:13:06.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.254+0000 7fc40df12b80 1 -- 172.21.15.92:0/1194940308 wait complete. 2023-10-16T13:13:06.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.254+0000 7fc40df12b80 1 -- start start 2023-10-16T13:13:06.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc40df12b80 1 Processor -- start 2023-10-16T13:13:06.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc40df12b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d558dd0 0x55a53d5bf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc40df12b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d559730 0x55a53d5bf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc40df12b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d55a5d0 0x55a53d5c6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc40df12b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a53d5c6cd0 con 0x55a53d559730 2023-10-16T13:13:06.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc40df12b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a53d5c6e10 con 0x55a53d55a5d0 2023-10-16T13:13:06.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc40df12b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a53d5c6fa0 con 0x55a53d558dd0 2023-10-16T13:13:06.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc40df12b80 10 client.0 _ll_register_callbacks cb 0x7fc3f4009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:06.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc3faffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d559730 0x55a53d5bf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc3faffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d559730 0x55a53d5bf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36512/0 (socket says 172.21.15.92:36512) 2023-10-16T13:13:06.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc3faffd700 1 -- 172.21.15.92:0/350804937 learned_addr learned my addr 172.21.15.92:0/350804937 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc3fb7fe700 1 --2- 172.21.15.92:0/350804937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d558dd0 0x55a53d5bf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc3fbfff700 1 --2- 172.21.15.92:0/350804937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d55a5d0 0x55a53d5c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc3faffd700 1 -- 172.21.15.92:0/350804937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d558dd0 msgr2=0x55a53d5bf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc3faffd700 1 --2- 172.21.15.92:0/350804937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d558dd0 0x55a53d5bf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc3faffd700 1 -- 172.21.15.92:0/350804937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d55a5d0 msgr2=0x55a53d5c6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc3faffd700 1 --2- 172.21.15.92:0/350804937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d55a5d0 0x55a53d5c6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc3faffd700 1 -- 172.21.15.92:0/350804937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3fc19f1f0 con 0x55a53d559730 2023-10-16T13:13:06.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc3faffd700 1 --2- 172.21.15.92:0/350804937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d559730 0x55a53d5bf750 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400dc00 tx=0x7fc3e400fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20293f63e75ce18c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.255+0000 7fc3daffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:06.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.256+0000 7fc3daffd700 1 -- 172.21.15.92:0/350804937 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e402d040 con 0x55a53d559730 2023-10-16T13:13:06.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.256+0000 7fc3daffd700 1 -- 172.21.15.92:0/350804937 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc3e401c9d0 con 0x55a53d559730 2023-10-16T13:13:06.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.256+0000 7fc40df12b80 1 -- 172.21.15.92:0/350804937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc3e401c450 con 0x55a53d559730 2023-10-16T13:13:06.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.256+0000 7fc3daffd700 1 -- 172.21.15.92:0/350804937 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3e401cb90 con 0x55a53d559730 2023-10-16T13:13:06.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.256+0000 7fc40df12b80 10 client.15243 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:06.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.256+0000 7fc40df12b80 1 -- 172.21.15.92:0/350804937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a53d2bfc10 con 0x55a53d559730 2023-10-16T13:13:06.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.256+0000 7fc3daffd700 1 -- 172.21.15.92:0/350804937 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc3e401c450 con 0x55a53d559730 2023-10-16T13:13:06.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.256+0000 7fc3daffd700 1 -- 172.21.15.92:0/350804937 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc3e403c3e0 con 0x55a53d559730 2023-10-16T13:13:06.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.256+0000 7fc40df12b80 10 client.15243 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:06.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.256+0000 7fc40df12b80 10 client.15243 resolve_mds: resolved name 'l' to daemon mds.l 2023-10-16T13:13:06.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.256+0000 7fc40df12b80 20 client.15243 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:06.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.256+0000 7fc40df12b80 1 --2- 172.21.15.92:0/350804937 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55a53d5cc1e0 0x55a53d5c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.256+0000 7fc40df12b80 4 client.15243 mds_command: new command op to 24412 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:13:06.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.256+0000 7fc40df12b80 1 -- 172.21.15.92:0/350804937 --> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a53d4a4e00 con 0x55a53d5cc1e0 2023-10-16T13:13:06.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.256+0000 7fc3fb7fe700 1 --2- 172.21.15.92:0/350804937 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55a53d5cc1e0 0x55a53d5c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.257+0000 7fc3daffd700 10 client.15243 ms_handle_connect on v2:172.21.15.152:6832/1273074399 2023-10-16T13:13:06.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.257+0000 7fc3fb7fe700 1 --2- 172.21.15.92:0/350804937 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55a53d5cc1e0 0x55a53d5c8660 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a252a79437a7e079 server_cookie=1df29c70ce2f6c09 in_seq=0 out_seq=0 2023-10-16T13:13:06.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.257+0000 7fc3daffd700 1 -- 172.21.15.92:0/350804937 <== mds.4 v2:172.21.15.152:6832/1273074399 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55a53d4a4e00 con 0x55a53d5cc1e0 2023-10-16T13:13:06.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.257+0000 7fc3daffd700 10 client.15243 handle_command_reply: tid=0 2023-10-16T13:13:06.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.257+0000 7fc40df12b80 1 client.15243 shutdown 2023-10-16T13:13:06.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.257+0000 7fc40df12b80 1 -- 172.21.15.92:0/350804937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d559730 msgr2=0x55a53d5bf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.257+0000 7fc40df12b80 1 --2- 172.21.15.92:0/350804937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d559730 0x55a53d5bf750 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400dc00 tx=0x7fc3e400fd20 comp rx=0 tx=0).stop 2023-10-16T13:13:06.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.257+0000 7fc40df12b80 1 -- 172.21.15.92:0/350804937 shutdown_connections 2023-10-16T13:13:06.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.257+0000 7fc40df12b80 1 --2- 172.21.15.92:0/350804937 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55a53d5cc1e0 0x55a53d5c8660 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.257+0000 7fc40df12b80 1 --2- 172.21.15.92:0/350804937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a53d55a5d0 0x55a53d5c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.257+0000 7fc40df12b80 1 --2- 172.21.15.92:0/350804937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a53d558dd0 0x55a53d5bf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.257+0000 7fc3daffd700 0 client.15243 ms_handle_reset on v2:172.21.15.152:6832/1273074399 2023-10-16T13:13:06.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.257+0000 7fc40df12b80 1 --2- 172.21.15.92:0/350804937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a53d559730 0x55a53d5bf750 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.257+0000 7fc40df12b80 1 -- 172.21.15.92:0/350804937 >> 172.21.15.92:0/350804937 conn(0x55a53d486d80 msgr2=0x55a53d55d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.257+0000 7fc40df12b80 1 -- 172.21.15.92:0/350804937 shutdown_connections 2023-10-16T13:13:06.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.257+0000 7fc40df12b80 1 -- 172.21.15.92:0/350804937 wait complete. 2023-10-16T13:13:06.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.257+0000 7fc40df12b80 20 client.15243 trim_cache size 0 max 16384 2023-10-16T13:13:06.295 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:13:06.295 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "6c276d7e-6c24-11ee-8db6-212e2dc638e7", 2023-10-16T13:13:06.295 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 4, 2023-10-16T13:13:06.295 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24412, 2023-10-16T13:13:06.295 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2023-10-16T13:13:06.296 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2023-10-16T13:13:06.296 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2023-10-16T13:13:06.296 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 78.914953003999997, 2023-10-16T13:13:06.296 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2023-10-16T13:13:06.296 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 85, 2023-10-16T13:13:06.297 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2023-10-16T13:13:06.297 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 118.014747423 2023-10-16T13:13:06.297 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:13:06.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.258+0000 7fc401d28700 1 -- 172.21.15.92:0/2656481437 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc3e80a1550 msgr2=0x7fc3e80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.258+0000 7fc401d28700 1 --2- 172.21.15.92:0/2656481437 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc3e80a1550 0x7fc3e80a3a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4005fd0 tx=0x7fc3e4005e20 comp rx=0 tx=0).stop 2023-10-16T13:13:06.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.258+0000 7fc401d28700 1 -- 172.21.15.92:0/2656481437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3fc0ff550 msgr2=0x7fc3fc10c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.258+0000 7fc401d28700 1 --2- 172.21.15.92:0/2656481437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3fc0ff550 0x7fc3fc10c390 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00c970 tx=0x7fc3ec00cd30 comp rx=0 tx=0).stop 2023-10-16T13:13:06.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.258+0000 7fc401d28700 1 -- 172.21.15.92:0/2656481437 shutdown_connections 2023-10-16T13:13:06.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.258+0000 7fc401d28700 1 --2- 172.21.15.92:0/2656481437 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc3e80a1550 0x7fc3e80a3a10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.258+0000 7fc401d28700 1 --2- 172.21.15.92:0/2656481437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3fc0ff550 0x7fc3fc10c390 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.258+0000 7fc401d28700 1 --2- 172.21.15.92:0/2656481437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3fc1010e0 0x7fc3fc19dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.258+0000 7fc401d28700 1 --2- 172.21.15.92:0/2656481437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc100740 0x7fc3fc19b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.258+0000 7fc401d28700 1 -- 172.21.15.92:0/2656481437 >> 172.21.15.92:0/2656481437 conn(0x7fc3fc0faac0 msgr2=0x7fc3fc0fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.258+0000 7fc401d28700 1 -- 172.21.15.92:0/2656481437 shutdown_connections 2023-10-16T13:13:06.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.258+0000 7fc401d28700 1 -- 172.21.15.92:0/2656481437 wait complete. 2023-10-16T13:13:06.301 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-10-16T13:13:06.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.426+0000 7fb5a70df700 1 -- 172.21.15.92:0/1969461813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a0100fe0 msgr2=0x7fb5a0101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.426+0000 7fb5a70df700 1 --2- 172.21.15.92:0/1969461813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a0100fe0 0x7fb5a0101440 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0099c0 tx=0x7fb58c009cd0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.426+0000 7fb5a70df700 1 -- 172.21.15.92:0/1969461813 shutdown_connections 2023-10-16T13:13:06.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.426+0000 7fb5a70df700 1 --2- 172.21.15.92:0/1969461813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5a0101980 0x7fb5a0108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.426+0000 7fb5a70df700 1 --2- 172.21.15.92:0/1969461813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5a00ffdf0 0x7fb5a0100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.426+0000 7fb5a70df700 1 --2- 172.21.15.92:0/1969461813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a0100fe0 0x7fb5a0101440 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.426+0000 7fb5a70df700 1 -- 172.21.15.92:0/1969461813 >> 172.21.15.92:0/1969461813 conn(0x7fb5a00fb340 msgr2=0x7fb5a00fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.426+0000 7fb5a70df700 1 -- 172.21.15.92:0/1969461813 shutdown_connections 2023-10-16T13:13:06.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.426+0000 7fb5a70df700 1 -- 172.21.15.92:0/1969461813 wait complete. 2023-10-16T13:13:06.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.427+0000 7fb5a70df700 1 Processor -- start 2023-10-16T13:13:06.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.427+0000 7fb5a70df700 1 -- start start 2023-10-16T13:13:06.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.427+0000 7fb5a70df700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5a00ffdf0 0x7fb5a0196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.427+0000 7fb5a70df700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a0100fe0 0x7fb5a01971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.427+0000 7fb5a70df700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5a0101980 0x7fb5a019e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.427+0000 7fb5a70df700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a019e810 con 0x7fb5a0100fe0 2023-10-16T13:13:06.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.427+0000 7fb5a70df700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a019e980 con 0x7fb5a0101980 2023-10-16T13:13:06.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.427+0000 7fb5a70df700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a019eb40 con 0x7fb5a00ffdf0 2023-10-16T13:13:06.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.427+0000 7fb59ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a0100fe0 0x7fb5a01971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.427+0000 7fb59ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a0100fe0 0x7fb5a01971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36526/0 (socket says 172.21.15.92:36526) 2023-10-16T13:13:06.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.427+0000 7fb59ffff700 1 -- 172.21.15.92:0/3067893960 learned_addr learned my addr 172.21.15.92:0/3067893960 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.427+0000 7fb5a4e7b700 1 --2- 172.21.15.92:0/3067893960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5a00ffdf0 0x7fb5a0196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.427+0000 7fb5a567c700 1 --2- 172.21.15.92:0/3067893960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5a0101980 0x7fb5a019e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.427+0000 7fb59ffff700 1 -- 172.21.15.92:0/3067893960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5a00ffdf0 msgr2=0x7fb5a0196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.427+0000 7fb59ffff700 1 --2- 172.21.15.92:0/3067893960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5a00ffdf0 0x7fb5a0196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.427+0000 7fb59ffff700 1 -- 172.21.15.92:0/3067893960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5a0101980 msgr2=0x7fb5a019e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.427+0000 7fb59ffff700 1 --2- 172.21.15.92:0/3067893960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5a0101980 0x7fb5a019e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.427+0000 7fb59ffff700 1 -- 172.21.15.92:0/3067893960 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c0095f0 con 0x7fb5a0100fe0 2023-10-16T13:13:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.427+0000 7fb5a567c700 1 --2- 172.21.15.92:0/3067893960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5a0101980 0x7fb5a019e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.428+0000 7fb59ffff700 1 --2- 172.21.15.92:0/3067893960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a0100fe0 0x7fb5a01971e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb58c003800 tx=0x7fb58c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.428+0000 7fb59dffb700 1 -- 172.21.15.92:0/3067893960 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c01d070 con 0x7fb5a0100fe0 2023-10-16T13:13:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.428+0000 7fb59dffb700 1 -- 172.21.15.92:0/3067893960 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb58c0040a0 con 0x7fb5a0100fe0 2023-10-16T13:13:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.428+0000 7fb59dffb700 1 -- 172.21.15.92:0/3067893960 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c00f460 con 0x7fb5a0100fe0 2023-10-16T13:13:06.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.428+0000 7fb5a70df700 1 -- 172.21.15.92:0/3067893960 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a019edc0 con 0x7fb5a0100fe0 2023-10-16T13:13:06.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.428+0000 7fb5a70df700 1 -- 172.21.15.92:0/3067893960 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a019f190 con 0x7fb5a0100fe0 2023-10-16T13:13:06.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.430+0000 7fb59dffb700 1 -- 172.21.15.92:0/3067893960 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb58c022600 con 0x7fb5a0100fe0 2023-10-16T13:13:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.431+0000 7fb59dffb700 1 --2- 172.21.15.92:0/3067893960 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb5900a15d0 0x7fb5900a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.431+0000 7fb5a4e7b700 1 --2- 172.21.15.92:0/3067893960 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb5900a15d0 0x7fb5900a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.431+0000 7fb59dffb700 1 -- 172.21.15.92:0/3067893960 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb58c0ce260 con 0x7fb5a0100fe0 2023-10-16T13:13:06.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.431+0000 7fb5a4e7b700 1 --2- 172.21.15.92:0/3067893960 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb5900a15d0 0x7fb5900a3a90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0197b70 tx=0x7fb594009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb5b32c9b80 1 Processor -- start 2023-10-16T13:13:06.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb5b32c9b80 1 -- start start 2023-10-16T13:13:06.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb5b32c9b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b8731e0 0x562a6b873600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb5b32c9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 0x562a6b874400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb5b32c9b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8749e0 0x562a6b874e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb5b32c9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6b7e3c20 con 0x562a6b873b40 2023-10-16T13:13:06.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb5b32c9b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6b7c8c10 con 0x562a6b8749e0 2023-10-16T13:13:06.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb5b32c9b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6b7c6530 con 0x562a6b8731e0 2023-10-16T13:13:06.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb59ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 0x562a6b874400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb59ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 0x562a6b874400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36534/0 (socket says 172.21.15.92:36534) 2023-10-16T13:13:06.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb59ffff700 1 -- 172.21.15.92:0/720631864 learned_addr learned my addr 172.21.15.92:0/720631864 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb5a4e7b700 1 --2- 172.21.15.92:0/720631864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b8731e0 0x562a6b873600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb59ffff700 1 -- 172.21.15.92:0/720631864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b8731e0 msgr2=0x562a6b873600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb59ffff700 1 --2- 172.21.15.92:0/720631864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b8731e0 0x562a6b873600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb5a567c700 1 --2- 172.21.15.92:0/720631864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8749e0 0x562a6b874e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb59ffff700 1 -- 172.21.15.92:0/720631864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8749e0 msgr2=0x562a6b874e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb59ffff700 1 --2- 172.21.15.92:0/720631864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8749e0 0x562a6b874e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb59ffff700 1 -- 172.21.15.92:0/720631864 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a6b77f3a0 con 0x562a6b873b40 2023-10-16T13:13:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb5a4e7b700 1 --2- 172.21.15.92:0/720631864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b8731e0 0x562a6b873600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:06.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb59ffff700 1 --2- 172.21.15.92:0/720631864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 0x562a6b874400 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb58c09b560 tx=0x7fb58c0229a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586c0ec8dad112f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb58affd700 1 -- 172.21.15.92:0/720631864 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c0860e0 con 0x562a6b873b40 2023-10-16T13:13:06.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.432+0000 7fb58affd700 1 -- 172.21.15.92:0/720631864 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb58c09af30 con 0x562a6b873b40 2023-10-16T13:13:06.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.433+0000 7fb58affd700 1 -- 172.21.15.92:0/720631864 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c09aac0 con 0x562a6b873b40 2023-10-16T13:13:06.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.433+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/720631864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 msgr2=0x562a6b874400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.433+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/720631864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 0x562a6b874400 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb58c09b560 tx=0x7fb58c0229a0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.433+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/720631864 shutdown_connections 2023-10-16T13:13:06.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.433+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/720631864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8749e0 0x562a6b874e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.433+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/720631864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b8731e0 0x562a6b873600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.433+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/720631864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 0x562a6b874400 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.433+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/720631864 >> 172.21.15.92:0/720631864 conn(0x562a6b79cd80 msgr2=0x562a6b869f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.433+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/720631864 shutdown_connections 2023-10-16T13:13:06.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.433+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/720631864 wait complete. 2023-10-16T13:13:06.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.434+0000 7fb5b32c9b80 1 -- start start 2023-10-16T13:13:06.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.434+0000 7fb5b32c9b80 1 Processor -- start 2023-10-16T13:13:06.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.434+0000 7fb5b32c9b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8731e0 0x562a6b87cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.434+0000 7fb5b32c9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 0x562a6b87d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.469 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.434+0000 7fb5b32c9b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b8749e0 0x562a6b8842e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.434+0000 7fb5b32c9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6b7c1e20 con 0x562a6b873b40 2023-10-16T13:13:06.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.434+0000 7fb5b32c9b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6b75e6c0 con 0x562a6b8731e0 2023-10-16T13:13:06.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.434+0000 7fb5b32c9b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6b75e360 con 0x562a6b8749e0 2023-10-16T13:13:06.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.434+0000 7fb5b32c9b80 10 client.0 _ll_register_callbacks cb 0x562a6b5bb7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:06.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.434+0000 7fb59ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 0x562a6b87d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.434+0000 7fb59ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 0x562a6b87d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36540/0 (socket says 172.21.15.92:36540) 2023-10-16T13:13:06.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.434+0000 7fb59ffff700 1 -- 172.21.15.92:0/484631543 learned_addr learned my addr 172.21.15.92:0/484631543 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.434+0000 7fb5a567c700 1 --2- 172.21.15.92:0/484631543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b8749e0 0x562a6b8842e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.434+0000 7fb5a4e7b700 1 --2- 172.21.15.92:0/484631543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8731e0 0x562a6b87cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.434+0000 7fb59ffff700 1 -- 172.21.15.92:0/484631543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b8749e0 msgr2=0x562a6b8842e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.434+0000 7fb59ffff700 1 --2- 172.21.15.92:0/484631543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b8749e0 0x562a6b8842e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.434+0000 7fb59ffff700 1 -- 172.21.15.92:0/484631543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8731e0 msgr2=0x562a6b87cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.434+0000 7fb59ffff700 1 --2- 172.21.15.92:0/484631543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8731e0 0x562a6b87cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.434+0000 7fb59ffff700 1 -- 172.21.15.92:0/484631543 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a019f190 con 0x562a6b873b40 2023-10-16T13:13:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.435+0000 7fb59ffff700 1 --2- 172.21.15.92:0/484631543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 0x562a6b87d2a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb58c004340 tx=0x7fb58c0a3950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454511ee5e25468 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.435+0000 7fb57ffff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.435+0000 7fb57ffff700 1 -- 172.21.15.92:0/484631543 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c0860b0 con 0x562a6b873b40 2023-10-16T13:13:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.435+0000 7fb57ffff700 1 -- 172.21.15.92:0/484631543 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb58c09f720 con 0x562a6b873b40 2023-10-16T13:13:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.435+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/484631543 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a6b7c6ea0 con 0x562a6b873b40 2023-10-16T13:13:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.435+0000 7fb57ffff700 1 -- 172.21.15.92:0/484631543 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb58c09bcd0 con 0x562a6b873b40 2023-10-16T13:13:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.435+0000 7fb5b32c9b80 10 client.15255 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.435+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/484631543 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562a6b5ecd90 con 0x562a6b873b40 2023-10-16T13:13:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.435+0000 7fb57ffff700 1 -- 172.21.15.92:0/484631543 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb58c080020 con 0x562a6b873b40 2023-10-16T13:13:06.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.435+0000 7fb57ffff700 1 -- 172.21.15.92:0/484631543 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb58c09f290 con 0x562a6b873b40 2023-10-16T13:13:06.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.435+0000 7fb5b32c9b80 10 client.15255 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:06.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.435+0000 7fb5b32c9b80 10 client.15255 resolve_mds: resolved name 'e' to daemon mds.e 2023-10-16T13:13:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.435+0000 7fb5b32c9b80 20 client.15255 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.435+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/484631543 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x562a6b888410 0x562a6b887180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.435+0000 7fb5b32c9b80 4 client.15255 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:13:06.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.435+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/484631543 --> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a6b83ebc0 con 0x562a6b888410 2023-10-16T13:13:06.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.436+0000 7fb5a4e7b700 1 --2- 172.21.15.92:0/484631543 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x562a6b888410 0x562a6b887180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.436+0000 7fb57ffff700 10 client.15255 ms_handle_connect on v2:172.21.15.118:6834/2381374755 2023-10-16T13:13:06.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.436+0000 7fb5a4e7b700 1 --2- 172.21.15.92:0/484631543 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x562a6b888410 0x562a6b887180 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4ff14e9796f996e4 server_cookie=8e063dcf3f71280f in_seq=0 out_seq=0 2023-10-16T13:13:06.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.437+0000 7fb57ffff700 1 -- 172.21.15.92:0/484631543 <== mds.3 v2:172.21.15.118:6834/2381374755 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562a6b83ebc0 con 0x562a6b888410 2023-10-16T13:13:06.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.437+0000 7fb57ffff700 10 client.15255 handle_command_reply: tid=0 2023-10-16T13:13:06.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.437+0000 7fb5b32c9b80 1 client.15255 shutdown 2023-10-16T13:13:06.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.437+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/484631543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 msgr2=0x562a6b87d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.437+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/484631543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 0x562a6b87d2a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb58c004340 tx=0x7fb58c0a3950 comp rx=0 tx=0).stop 2023-10-16T13:13:06.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.437+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/484631543 shutdown_connections 2023-10-16T13:13:06.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.437+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/484631543 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x562a6b888410 0x562a6b887180 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.437+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/484631543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b8749e0 0x562a6b8842e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.437+0000 7fb57ffff700 0 client.15255 ms_handle_reset on v2:172.21.15.118:6834/2381374755 2023-10-16T13:13:06.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.437+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/484631543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8731e0 0x562a6b87cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.437+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/484631543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 0x562a6b87d2a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.437+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/484631543 >> 172.21.15.92:0/484631543 conn(0x562a6b79cd80 msgr2=0x562a6b869ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.437+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/484631543 shutdown_connections 2023-10-16T13:13:06.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.437+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/484631543 wait complete. 2023-10-16T13:13:06.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.437+0000 7fb5b32c9b80 20 client.15255 trim_cache size 0 max 16384 2023-10-16T13:13:06.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb5b32c9b80 1 Processor -- start 2023-10-16T13:13:06.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb5b32c9b80 1 -- start start 2023-10-16T13:13:06.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb5b32c9b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b8731e0 0x562a6b887180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb5b32c9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 0x562a6b8876c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb5b32c9b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8749e0 0x562a6b8842a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb5b32c9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6b6428d0 con 0x562a6b873b40 2023-10-16T13:13:06.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb5b32c9b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6b83ebf0 con 0x562a6b8749e0 2023-10-16T13:13:06.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb5b32c9b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6b87b510 con 0x562a6b8731e0 2023-10-16T13:13:06.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb59ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 0x562a6b8876c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb59ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 0x562a6b8876c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36548/0 (socket says 172.21.15.92:36548) 2023-10-16T13:13:06.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb59ffff700 1 -- 172.21.15.92:0/2993470239 learned_addr learned my addr 172.21.15.92:0/2993470239 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb5a567c700 1 --2- 172.21.15.92:0/2993470239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8749e0 0x562a6b8842a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb5a4e7b700 1 --2- 172.21.15.92:0/2993470239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b8731e0 0x562a6b887180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb59ffff700 1 -- 172.21.15.92:0/2993470239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b8731e0 msgr2=0x562a6b887180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb59ffff700 1 --2- 172.21.15.92:0/2993470239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b8731e0 0x562a6b887180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb59ffff700 1 -- 172.21.15.92:0/2993470239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8749e0 msgr2=0x562a6b8842a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb59ffff700 1 --2- 172.21.15.92:0/2993470239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8749e0 0x562a6b8842a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb59ffff700 1 -- 172.21.15.92:0/2993470239 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a6b5d5c10 con 0x562a6b873b40 2023-10-16T13:13:06.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb5a567c700 1 --2- 172.21.15.92:0/2993470239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8749e0 0x562a6b8842a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:06.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.455+0000 7fb59ffff700 1 --2- 172.21.15.92:0/2993470239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 0x562a6b8876c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb58c09b0a0 tx=0x7fb58c009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388d1ea88f7f290 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.456+0000 7fb58b7fe700 1 -- 172.21.15.92:0/2993470239 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c0860b0 con 0x562a6b873b40 2023-10-16T13:13:06.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.456+0000 7fb58b7fe700 1 -- 172.21.15.92:0/2993470239 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb58c080070 con 0x562a6b873b40 2023-10-16T13:13:06.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.456+0000 7fb58b7fe700 1 -- 172.21.15.92:0/2993470239 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c099a40 con 0x562a6b873b40 2023-10-16T13:13:06.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.456+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/2993470239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 msgr2=0x562a6b8876c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.456+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/2993470239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 0x562a6b8876c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb58c09b0a0 tx=0x7fb58c009cd0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.456+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/2993470239 shutdown_connections 2023-10-16T13:13:06.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.456+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/2993470239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8749e0 0x562a6b8842a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.456+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/2993470239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b8731e0 0x562a6b887180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.456+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/2993470239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b873b40 0x562a6b8876c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.456+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/2993470239 >> 172.21.15.92:0/2993470239 conn(0x562a6b79cd80 msgr2=0x562a6b87b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.456+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/2993470239 shutdown_connections 2023-10-16T13:13:06.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.456+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/2993470239 wait complete. 2023-10-16T13:13:06.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.457+0000 7fb5b32c9b80 1 -- start start 2023-10-16T13:13:06.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.457+0000 7fb5b32c9b80 1 Processor -- start 2023-10-16T13:13:06.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.457+0000 7fb5b32c9b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8731e0 0x562a6b884240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.457+0000 7fb5b32c9b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b873b40 0x562a6b880ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.457+0000 7fb5b32c9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b8749e0 0x562a6b881310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.457+0000 7fb5b32c9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6b8dbe00 con 0x562a6b8749e0 2023-10-16T13:13:06.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.457+0000 7fb5b32c9b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6b8dbf40 con 0x562a6b8731e0 2023-10-16T13:13:06.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.457+0000 7fb5b32c9b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6b8dc080 con 0x562a6b873b40 2023-10-16T13:13:06.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.457+0000 7fb5b32c9b80 10 client.0 _ll_register_callbacks cb 0x7fb58c0979a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:06.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.457+0000 7fb5a567c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b8749e0 0x562a6b881310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.457+0000 7fb5a567c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b8749e0 0x562a6b881310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36556/0 (socket says 172.21.15.92:36556) 2023-10-16T13:13:06.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.457+0000 7fb5a567c700 1 -- 172.21.15.92:0/759294933 learned_addr learned my addr 172.21.15.92:0/759294933 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.457+0000 7fb5a4e7b700 1 --2- 172.21.15.92:0/759294933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8731e0 0x562a6b884240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.458+0000 7fb59ffff700 1 --2- 172.21.15.92:0/759294933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b873b40 0x562a6b880ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.458+0000 7fb5a567c700 1 -- 172.21.15.92:0/759294933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b873b40 msgr2=0x562a6b880ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.458+0000 7fb5a567c700 1 --2- 172.21.15.92:0/759294933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b873b40 0x562a6b880ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.458+0000 7fb5a567c700 1 -- 172.21.15.92:0/759294933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8731e0 msgr2=0x562a6b884240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.458+0000 7fb5a567c700 1 --2- 172.21.15.92:0/759294933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8731e0 0x562a6b884240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.458+0000 7fb5a567c700 1 -- 172.21.15.92:0/759294933 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a6b5ecd90 con 0x562a6b8749e0 2023-10-16T13:13:06.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.458+0000 7fb59ffff700 1 --2- 172.21.15.92:0/759294933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b873b40 0x562a6b880ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:06.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.458+0000 7fb5a567c700 1 --2- 172.21.15.92:0/759294933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b8749e0 0x562a6b881310 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb598007b20 tx=0x7fb598007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392cb16065b06557 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.458+0000 7fb57ffff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:06.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.458+0000 7fb57ffff700 1 -- 172.21.15.92:0/759294933 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59800e070 con 0x562a6b8749e0 2023-10-16T13:13:06.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.458+0000 7fb57ffff700 1 -- 172.21.15.92:0/759294933 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb5980159d0 con 0x562a6b8749e0 2023-10-16T13:13:06.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.458+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/759294933 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb58c09af30 con 0x562a6b8749e0 2023-10-16T13:13:06.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.458+0000 7fb57ffff700 1 -- 172.21.15.92:0/759294933 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb598015b90 con 0x562a6b8749e0 2023-10-16T13:13:06.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.458+0000 7fb5b32c9b80 10 client.15261 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:06.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.458+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/759294933 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562a6b613200 con 0x562a6b8749e0 2023-10-16T13:13:06.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.458+0000 7fb57ffff700 1 -- 172.21.15.92:0/759294933 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb58c09af30 con 0x562a6b8749e0 2023-10-16T13:13:06.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.458+0000 7fb57ffff700 1 -- 172.21.15.92:0/759294933 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb598021410 con 0x562a6b8749e0 2023-10-16T13:13:06.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.458+0000 7fb5b32c9b80 10 client.15261 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:06.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb5b32c9b80 10 client.15261 resolve_mds: resolved name 'e' to daemon mds.e 2023-10-16T13:13:06.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb5b32c9b80 20 client.15261 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:06.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/759294933 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x562a6b8e1490 0x562a6b8dd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb5b32c9b80 4 client.15261 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:13:06.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/759294933 --> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562a6b7bae00 con 0x562a6b8e1490 2023-10-16T13:13:06.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb5a4e7b700 1 --2- 172.21.15.92:0/759294933 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x562a6b8e1490 0x562a6b8dd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb57ffff700 10 client.15261 ms_handle_connect on v2:172.21.15.118:6834/2381374755 2023-10-16T13:13:06.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb5a4e7b700 1 --2- 172.21.15.92:0/759294933 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x562a6b8e1490 0x562a6b8dd910 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=648e300e53b2bd6f server_cookie=219dd081f9512fb6 in_seq=0 out_seq=0 2023-10-16T13:13:06.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb57ffff700 1 -- 172.21.15.92:0/759294933 <== mds.3 v2:172.21.15.118:6834/2381374755 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x562a6b7bae00 con 0x562a6b8e1490 2023-10-16T13:13:06.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb57ffff700 10 client.15261 handle_command_reply: tid=0 2023-10-16T13:13:06.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb5b32c9b80 1 client.15261 shutdown 2023-10-16T13:13:06.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/759294933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b8749e0 msgr2=0x562a6b881310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/759294933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b8749e0 0x562a6b881310 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb598007b20 tx=0x7fb598007e30 comp rx=0 tx=0).stop 2023-10-16T13:13:06.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/759294933 shutdown_connections 2023-10-16T13:13:06.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/759294933 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x562a6b8e1490 0x562a6b8dd910 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/759294933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a6b8749e0 0x562a6b881310 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/759294933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a6b8731e0 0x562a6b884240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb5b32c9b80 1 --2- 172.21.15.92:0/759294933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a6b873b40 0x562a6b880ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb57ffff700 0 client.15261 ms_handle_reset on v2:172.21.15.118:6834/2381374755 2023-10-16T13:13:06.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.459+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/759294933 >> 172.21.15.92:0/759294933 conn(0x562a6b79cd80 msgr2=0x562a6b887180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.460+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/759294933 shutdown_connections 2023-10-16T13:13:06.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.460+0000 7fb5b32c9b80 1 -- 172.21.15.92:0/759294933 wait complete. 2023-10-16T13:13:06.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.460+0000 7fb5b32c9b80 20 client.15261 trim_cache size 0 max 16384 2023-10-16T13:13:06.517 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:13:06.517 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "6c276d7e-6c24-11ee-8db6-212e2dc638e7", 2023-10-16T13:13:06.517 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 3, 2023-10-16T13:13:06.518 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24428, 2023-10-16T13:13:06.518 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2023-10-16T13:13:06.518 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2023-10-16T13:13:06.518 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2023-10-16T13:13:06.518 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 80.134448731000006, 2023-10-16T13:13:06.519 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2023-10-16T13:13:06.519 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 85, 2023-10-16T13:13:06.519 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2023-10-16T13:13:06.519 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 109.360126634 2023-10-16T13:13:06.519 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:13:06.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.460+0000 7fb5a70df700 1 -- 172.21.15.92:0/3067893960 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb5900a15d0 msgr2=0x7fb5900a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.460+0000 7fb5a70df700 1 --2- 172.21.15.92:0/3067893960 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb5900a15d0 0x7fb5900a3a90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0197b70 tx=0x7fb594009190 comp rx=0 tx=0).stop 2023-10-16T13:13:06.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.460+0000 7fb5a70df700 1 -- 172.21.15.92:0/3067893960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a0100fe0 msgr2=0x7fb5a01971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.460+0000 7fb5a70df700 1 --2- 172.21.15.92:0/3067893960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a0100fe0 0x7fb5a01971e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb58c003800 tx=0x7fb58c009580 comp rx=0 tx=0).stop 2023-10-16T13:13:06.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.460+0000 7fb5a70df700 1 -- 172.21.15.92:0/3067893960 shutdown_connections 2023-10-16T13:13:06.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.460+0000 7fb5a70df700 1 --2- 172.21.15.92:0/3067893960 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb5900a15d0 0x7fb5900a3a90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.460+0000 7fb5a70df700 1 --2- 172.21.15.92:0/3067893960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5a0101980 0x7fb5a019e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.460+0000 7fb5a70df700 1 --2- 172.21.15.92:0/3067893960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5a00ffdf0 0x7fb5a0196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.460+0000 7fb5a70df700 1 --2- 172.21.15.92:0/3067893960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a0100fe0 0x7fb5a01971e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.460+0000 7fb5a70df700 1 -- 172.21.15.92:0/3067893960 >> 172.21.15.92:0/3067893960 conn(0x7fb5a00fb340 msgr2=0x7fb5a00692a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.460+0000 7fb5a70df700 1 -- 172.21.15.92:0/3067893960 shutdown_connections 2023-10-16T13:13:06.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.460+0000 7fb5a70df700 1 -- 172.21.15.92:0/3067893960 wait complete. 2023-10-16T13:13:06.523 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-10-16T13:13:06.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.646+0000 7f09c70c4700 1 -- 172.21.15.92:0/2714625785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09c00ffdd0 msgr2=0x7f09c01001f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.646+0000 7f09c70c4700 1 --2- 172.21.15.92:0/2714625785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09c00ffdd0 0x7f09c01001f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f09b40099c0 tx=0x7f09b4009cd0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.646+0000 7f09c70c4700 1 -- 172.21.15.92:0/2714625785 shutdown_connections 2023-10-16T13:13:06.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.646+0000 7f09c70c4700 1 --2- 172.21.15.92:0/2714625785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09c00ffdd0 0x7f09c01001f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.646+0000 7f09c70c4700 1 --2- 172.21.15.92:0/2714625785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c0101960 0x7f09c0108210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.646+0000 7f09c70c4700 1 --2- 172.21.15.92:0/2714625785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09c0100fc0 0x7f09c0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.646+0000 7f09c70c4700 1 -- 172.21.15.92:0/2714625785 >> 172.21.15.92:0/2714625785 conn(0x7f09c00fb300 msgr2=0x7f09c00fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.646+0000 7f09c70c4700 1 -- 172.21.15.92:0/2714625785 shutdown_connections 2023-10-16T13:13:06.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.646+0000 7f09c70c4700 1 -- 172.21.15.92:0/2714625785 wait complete. 2023-10-16T13:13:06.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.646+0000 7f09c70c4700 1 Processor -- start 2023-10-16T13:13:06.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.646+0000 7f09c70c4700 1 -- start start 2023-10-16T13:13:06.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.646+0000 7f09c70c4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09c00ffdd0 0x7f09c0103d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.646+0000 7f09c70c4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09c0100fc0 0x7f09c01023a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.646+0000 7f09c70c4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c0101960 0x7f09c01028e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.646+0000 7f09c70c4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c0103080 con 0x7f09c0100fc0 2023-10-16T13:13:06.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.646+0000 7f09c70c4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c01031f0 con 0x7f09c0101960 2023-10-16T13:13:06.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.646+0000 7f09c70c4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c01a0bd0 con 0x7f09c00ffdd0 2023-10-16T13:13:06.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.646+0000 7f09bffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09c0100fc0 0x7f09c01023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.647+0000 7f09bffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09c0100fc0 0x7f09c01023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36568/0 (socket says 172.21.15.92:36568) 2023-10-16T13:13:06.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.647+0000 7f09bffff700 1 -- 172.21.15.92:0/2915889328 learned_addr learned my addr 172.21.15.92:0/2915889328 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.647+0000 7f09c5661700 1 --2- 172.21.15.92:0/2915889328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c0101960 0x7f09c01028e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.647+0000 7f09c4e60700 1 --2- 172.21.15.92:0/2915889328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09c00ffdd0 0x7f09c0103d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.647+0000 7f09bffff700 1 -- 172.21.15.92:0/2915889328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09c00ffdd0 msgr2=0x7f09c0103d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.647+0000 7f09bffff700 1 --2- 172.21.15.92:0/2915889328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09c00ffdd0 0x7f09c0103d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.647+0000 7f09bffff700 1 -- 172.21.15.92:0/2915889328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c0101960 msgr2=0x7f09c01028e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.647+0000 7f09bffff700 1 --2- 172.21.15.92:0/2915889328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c0101960 0x7f09c01028e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.647+0000 7f09bffff700 1 -- 172.21.15.92:0/2915889328 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b40095f0 con 0x7f09c0100fc0 2023-10-16T13:13:06.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.647+0000 7f09bffff700 1 --2- 172.21.15.92:0/2915889328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09c0100fc0 0x7f09c01023a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00c9b0 tx=0x7f09ac00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.647+0000 7f09bdffb700 1 -- 172.21.15.92:0/2915889328 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac007b00 con 0x7f09c0100fc0 2023-10-16T13:13:06.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.647+0000 7f09bdffb700 1 -- 172.21.15.92:0/2915889328 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f09ac007c60 con 0x7f09c0100fc0 2023-10-16T13:13:06.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.647+0000 7f09bdffb700 1 -- 172.21.15.92:0/2915889328 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac018660 con 0x7f09c0100fc0 2023-10-16T13:13:06.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.647+0000 7f09c70c4700 1 -- 172.21.15.92:0/2915889328 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c01a0eb0 con 0x7f09c0100fc0 2023-10-16T13:13:06.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.647+0000 7f09c70c4700 1 -- 172.21.15.92:0/2915889328 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c01a12e0 con 0x7f09c0100fc0 2023-10-16T13:13:06.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.649+0000 7f09bdffb700 1 -- 172.21.15.92:0/2915889328 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f09ac00f450 con 0x7f09c0100fc0 2023-10-16T13:13:06.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.649+0000 7f09bdffb700 1 --2- 172.21.15.92:0/2915889328 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f09b00a14d0 0x7f09b00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.650+0000 7f09c4e60700 1 --2- 172.21.15.92:0/2915889328 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f09b00a14d0 0x7f09b00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.650+0000 7f09bdffb700 1 -- 172.21.15.92:0/2915889328 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f09ac0cccf0 con 0x7f09c0100fc0 2023-10-16T13:13:06.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.650+0000 7f09c4e60700 1 --2- 172.21.15.92:0/2915889328 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f09b00a14d0 0x7f09b00a3990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f09b4003800 tx=0x7f09b4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09d32aeb80 1 Processor -- start 2023-10-16T13:13:06.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09d32aeb80 1 -- start start 2023-10-16T13:13:06.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09d32aeb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d58dd0 0x55d067d591f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09d32aeb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d067d59730 0x55d067d59ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09d32aeb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d5a5d0 0x55d067d5aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09d32aeb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d067ccdc20 con 0x55d067d5a5d0 2023-10-16T13:13:06.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09d32aeb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d067cb2c10 con 0x55d067d58dd0 2023-10-16T13:13:06.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09d32aeb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d067cb0530 con 0x55d067d59730 2023-10-16T13:13:06.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09c5661700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d5a5d0 0x55d067d5aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09c5661700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d5a5d0 0x55d067d5aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36578/0 (socket says 172.21.15.92:36578) 2023-10-16T13:13:06.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09c5661700 1 -- 172.21.15.92:0/2974383320 learned_addr learned my addr 172.21.15.92:0/2974383320 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09c4e60700 1 --2- 172.21.15.92:0/2974383320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d58dd0 0x55d067d591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09bffff700 1 --2- 172.21.15.92:0/2974383320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d067d59730 0x55d067d59ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09c5661700 1 -- 172.21.15.92:0/2974383320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d067d59730 msgr2=0x55d067d59ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09c5661700 1 --2- 172.21.15.92:0/2974383320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d067d59730 0x55d067d59ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09c5661700 1 -- 172.21.15.92:0/2974383320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d58dd0 msgr2=0x55d067d591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09c5661700 1 --2- 172.21.15.92:0/2974383320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d58dd0 0x55d067d591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09c5661700 1 -- 172.21.15.92:0/2974383320 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d067c693a0 con 0x55d067d5a5d0 2023-10-16T13:13:06.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09c4e60700 1 --2- 172.21.15.92:0/2974383320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d58dd0 0x55d067d591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:06.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09c5661700 1 --2- 172.21.15.92:0/2974383320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d5a5d0 0x55d067d5aa50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f09b8003fc0 tx=0x7f09b8009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e2bdd108ae7d0a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09aaffd700 1 -- 172.21.15.92:0/2974383320 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b8019070 con 0x55d067d5a5d0 2023-10-16T13:13:06.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09aaffd700 1 -- 172.21.15.92:0/2974383320 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f09b800f040 con 0x55d067d5a5d0 2023-10-16T13:13:06.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.651+0000 7f09aaffd700 1 -- 172.21.15.92:0/2974383320 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b8007c00 con 0x55d067d5a5d0 2023-10-16T13:13:06.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.652+0000 7f09d32aeb80 1 -- 172.21.15.92:0/2974383320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d5a5d0 msgr2=0x55d067d5aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.652+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/2974383320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d5a5d0 0x55d067d5aa50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f09b8003fc0 tx=0x7f09b8009ba0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.652+0000 7f09d32aeb80 1 -- 172.21.15.92:0/2974383320 shutdown_connections 2023-10-16T13:13:06.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.652+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/2974383320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d5a5d0 0x55d067d5aa50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.652+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/2974383320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d58dd0 0x55d067d591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.652+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/2974383320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d067d59730 0x55d067d59ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.652+0000 7f09d32aeb80 1 -- 172.21.15.92:0/2974383320 >> 172.21.15.92:0/2974383320 conn(0x55d067c86d80 msgr2=0x55d067d53f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.652+0000 7f09d32aeb80 1 -- 172.21.15.92:0/2974383320 shutdown_connections 2023-10-16T13:13:06.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.652+0000 7f09d32aeb80 1 -- 172.21.15.92:0/2974383320 wait complete. 2023-10-16T13:13:06.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.652+0000 7f09d32aeb80 1 -- start start 2023-10-16T13:13:06.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.653+0000 7f09d32aeb80 1 Processor -- start 2023-10-16T13:13:06.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.653+0000 7f09d32aeb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d58dd0 0x55d067d62c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.653+0000 7f09d32aeb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d59730 0x55d067d63160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.653+0000 7f09d32aeb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d067d5a5d0 0x55d067d6a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.653+0000 7f09d32aeb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d067cabe20 con 0x55d067d58dd0 2023-10-16T13:13:06.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.653+0000 7f09d32aeb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d067c486c0 con 0x55d067d59730 2023-10-16T13:13:06.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.653+0000 7f09d32aeb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d067c48360 con 0x55d067d5a5d0 2023-10-16T13:13:06.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.653+0000 7f09d32aeb80 10 client.0 _ll_register_callbacks cb 0x55d067aa57b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:06.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.653+0000 7f09c4e60700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d58dd0 0x55d067d62c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.653+0000 7f09c4e60700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d58dd0 0x55d067d62c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36580/0 (socket says 172.21.15.92:36580) 2023-10-16T13:13:06.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.653+0000 7f09c4e60700 1 -- 172.21.15.92:0/3903505358 learned_addr learned my addr 172.21.15.92:0/3903505358 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.653+0000 7f09bffff700 1 --2- 172.21.15.92:0/3903505358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d59730 0x55d067d63160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.653+0000 7f09c4e60700 1 -- 172.21.15.92:0/3903505358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d067d5a5d0 msgr2=0x55d067d6a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.653+0000 7f09c4e60700 1 --2- 172.21.15.92:0/3903505358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d067d5a5d0 0x55d067d6a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.653+0000 7f09c4e60700 1 -- 172.21.15.92:0/3903505358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d59730 msgr2=0x55d067d63160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.653+0000 7f09c4e60700 1 --2- 172.21.15.92:0/3903505358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d59730 0x55d067d63160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.653+0000 7f09c4e60700 1 -- 172.21.15.92:0/3903505358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b8003bf0 con 0x55d067d58dd0 2023-10-16T13:13:06.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.653+0000 7f09c4e60700 1 --2- 172.21.15.92:0/3903505358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d58dd0 0x55d067d62c20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f09b40099c0 tx=0x7f09b4009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa05b4a9b11d09bd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.654+0000 7f099ffff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:06.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.654+0000 7f099ffff700 1 -- 172.21.15.92:0/3903505358 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b4003dc0 con 0x55d067d58dd0 2023-10-16T13:13:06.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.654+0000 7f099ffff700 1 -- 172.21.15.92:0/3903505358 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f09b4003f20 con 0x55d067d58dd0 2023-10-16T13:13:06.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.654+0000 7f09d32aeb80 1 -- 172.21.15.92:0/3903505358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d067cb0ea0 con 0x55d067d58dd0 2023-10-16T13:13:06.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.654+0000 7f099ffff700 1 -- 172.21.15.92:0/3903505358 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09b40040e0 con 0x55d067d58dd0 2023-10-16T13:13:06.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.654+0000 7f09d32aeb80 10 client.15273 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:06.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.654+0000 7f09d32aeb80 1 -- 172.21.15.92:0/3903505358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55d067ad6d90 con 0x55d067d58dd0 2023-10-16T13:13:06.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.654+0000 7f099ffff700 1 -- 172.21.15.92:0/3903505358 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55d067cb0ea0 con 0x55d067d58dd0 2023-10-16T13:13:06.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.654+0000 7f099ffff700 1 -- 172.21.15.92:0/3903505358 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f09b400f580 con 0x55d067d58dd0 2023-10-16T13:13:06.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.654+0000 7f09d32aeb80 10 client.15273 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:06.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.654+0000 7f09d32aeb80 10 client.15273 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-16T13:13:06.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.654+0000 7f09d32aeb80 20 client.15273 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:06.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.654+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/3903505358 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x55d067d6e820 0x55d067d6d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.654+0000 7f09d32aeb80 4 client.15273 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:13:06.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.654+0000 7f09d32aeb80 1 -- 172.21.15.92:0/3903505358 --> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d067d28bc0 con 0x55d067d6e820 2023-10-16T13:13:06.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.655+0000 7f09bffff700 1 --2- 172.21.15.92:0/3903505358 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x55d067d6e820 0x55d067d6d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.655+0000 7f09bffff700 1 --2- 172.21.15.92:0/3903505358 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x55d067d6e820 0x55d067d6d2a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=30e6e03d477cffbd server_cookie=b309f60f59cdd3d2 in_seq=0 out_seq=0 2023-10-16T13:13:06.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.655+0000 7f099ffff700 10 client.15273 ms_handle_connect on v2:172.21.15.152:6834/1393840132 2023-10-16T13:13:06.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.656+0000 7f099ffff700 1 -- 172.21.15.92:0/3903505358 <== mds.2 v2:172.21.15.152:6834/1393840132 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d067d28bc0 con 0x55d067d6e820 2023-10-16T13:13:06.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.656+0000 7f099ffff700 10 client.15273 handle_command_reply: tid=0 2023-10-16T13:13:06.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.656+0000 7f09d32aeb80 1 client.15273 shutdown 2023-10-16T13:13:06.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.656+0000 7f09d32aeb80 1 -- 172.21.15.92:0/3903505358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d58dd0 msgr2=0x55d067d62c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.656+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/3903505358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d58dd0 0x55d067d62c20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f09b40099c0 tx=0x7f09b4009cd0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.656+0000 7f09d32aeb80 1 -- 172.21.15.92:0/3903505358 shutdown_connections 2023-10-16T13:13:06.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.656+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/3903505358 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x55d067d6e820 0x55d067d6d2a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.656+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/3903505358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d58dd0 0x55d067d62c20 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.656+0000 7f099ffff700 0 client.15273 ms_handle_reset on v2:172.21.15.152:6834/1393840132 2023-10-16T13:13:06.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.656+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/3903505358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d067d5a5d0 0x55d067d6a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.656+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/3903505358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d59730 0x55d067d63160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.656+0000 7f09d32aeb80 1 -- 172.21.15.92:0/3903505358 >> 172.21.15.92:0/3903505358 conn(0x55d067c86d80 msgr2=0x55d067d53ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.656+0000 7f09d32aeb80 1 -- 172.21.15.92:0/3903505358 shutdown_connections 2023-10-16T13:13:06.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.656+0000 7f09d32aeb80 1 -- 172.21.15.92:0/3903505358 wait complete. 2023-10-16T13:13:06.680 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.656+0000 7f09d32aeb80 20 client.15273 trim_cache size 0 max 16384 2023-10-16T13:13:06.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.673+0000 7f09d32aeb80 1 Processor -- start 2023-10-16T13:13:06.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.673+0000 7f09d32aeb80 1 -- start start 2023-10-16T13:13:06.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.673+0000 7f09d32aeb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d067d58dd0 0x55d067d5d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.673+0000 7f09d32aeb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d59730 0x55d067d5da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.673+0000 7f09d32aeb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d5a5d0 0x55d067d6a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.673+0000 7f09d32aeb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d067b2c8d0 con 0x55d067d59730 2023-10-16T13:13:06.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.673+0000 7f09d32aeb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d067d28bc0 con 0x55d067d5a5d0 2023-10-16T13:13:06.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.673+0000 7f09d32aeb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d067cb0ea0 con 0x55d067d58dd0 2023-10-16T13:13:06.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.674+0000 7f09bffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d59730 0x55d067d5da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.674+0000 7f09bffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d59730 0x55d067d5da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36590/0 (socket says 172.21.15.92:36590) 2023-10-16T13:13:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.674+0000 7f09bffff700 1 -- 172.21.15.92:0/2727565821 learned_addr learned my addr 172.21.15.92:0/2727565821 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.674+0000 7f09c4e60700 1 --2- 172.21.15.92:0/2727565821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d067d58dd0 0x55d067d5d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.674+0000 7f09bffff700 1 -- 172.21.15.92:0/2727565821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d067d58dd0 msgr2=0x55d067d5d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.674+0000 7f09bffff700 1 --2- 172.21.15.92:0/2727565821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d067d58dd0 0x55d067d5d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.674+0000 7f09bffff700 1 -- 172.21.15.92:0/2727565821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d5a5d0 msgr2=0x55d067d6a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.674+0000 7f09bffff700 1 --2- 172.21.15.92:0/2727565821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d5a5d0 0x55d067d6a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.674+0000 7f09bffff700 1 -- 172.21.15.92:0/2727565821 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d067d77450 con 0x55d067d59730 2023-10-16T13:13:06.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.674+0000 7f09bffff700 1 --2- 172.21.15.92:0/2727565821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d59730 0x55d067d5da40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0964c0 tx=0x7f09ac00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0fd004ea0821a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.674+0000 7f09ab7fe700 1 -- 172.21.15.92:0/2727565821 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac0b82c0 con 0x55d067d59730 2023-10-16T13:13:06.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.674+0000 7f09ab7fe700 1 -- 172.21.15.92:0/2727565821 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f09ac09e160 con 0x55d067d59730 2023-10-16T13:13:06.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.674+0000 7f09ab7fe700 1 -- 172.21.15.92:0/2727565821 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac0983b0 con 0x55d067d59730 2023-10-16T13:13:06.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09d32aeb80 1 -- 172.21.15.92:0/2727565821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d59730 msgr2=0x55d067d5da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/2727565821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d59730 0x55d067d5da40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0964c0 tx=0x7f09ac00cf90 comp rx=0 tx=0).stop 2023-10-16T13:13:06.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09d32aeb80 1 -- 172.21.15.92:0/2727565821 shutdown_connections 2023-10-16T13:13:06.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/2727565821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d5a5d0 0x55d067d6a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/2727565821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d067d58dd0 0x55d067d5d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/2727565821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d59730 0x55d067d5da40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09d32aeb80 1 -- 172.21.15.92:0/2727565821 >> 172.21.15.92:0/2727565821 conn(0x55d067c86d80 msgr2=0x55d067d609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09d32aeb80 1 -- 172.21.15.92:0/2727565821 shutdown_connections 2023-10-16T13:13:06.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09d32aeb80 1 -- 172.21.15.92:0/2727565821 wait complete. 2023-10-16T13:13:06.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09d32aeb80 1 -- start start 2023-10-16T13:13:06.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09d32aeb80 1 Processor -- start 2023-10-16T13:13:06.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09d32aeb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d067d58dd0 0x55d067d65180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09d32aeb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d59730 0x55d067d656c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09d32aeb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d5a5d0 0x55d067d686e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09d32aeb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d067d68c20 con 0x55d067d5a5d0 2023-10-16T13:13:06.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09d32aeb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d067d68d90 con 0x55d067d59730 2023-10-16T13:13:06.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09d32aeb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d067d68f50 con 0x55d067d58dd0 2023-10-16T13:13:06.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09d32aeb80 10 client.0 _ll_register_callbacks cb 0x7f09b40056a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:06.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09c5661700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d5a5d0 0x55d067d686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.675+0000 7f09c5661700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d5a5d0 0x55d067d686e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36598/0 (socket says 172.21.15.92:36598) 2023-10-16T13:13:06.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.676+0000 7f09c5661700 1 -- 172.21.15.92:0/1397551219 learned_addr learned my addr 172.21.15.92:0/1397551219 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.676+0000 7f09c4e60700 1 --2- 172.21.15.92:0/1397551219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d067d58dd0 0x55d067d65180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.676+0000 7f09bffff700 1 --2- 172.21.15.92:0/1397551219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d59730 0x55d067d656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.676+0000 7f09c5661700 1 -- 172.21.15.92:0/1397551219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d067d58dd0 msgr2=0x55d067d65180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.676+0000 7f09c5661700 1 --2- 172.21.15.92:0/1397551219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d067d58dd0 0x55d067d65180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.676+0000 7f09c5661700 1 -- 172.21.15.92:0/1397551219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d59730 msgr2=0x55d067d656c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.676+0000 7f09c5661700 1 --2- 172.21.15.92:0/1397551219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d59730 0x55d067d656c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.676+0000 7f09c5661700 1 -- 172.21.15.92:0/1397551219 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c01a12e0 con 0x55d067d5a5d0 2023-10-16T13:13:06.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.676+0000 7f09c5661700 1 --2- 172.21.15.92:0/1397551219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d5a5d0 0x55d067d686e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f09b8018000 tx=0x7f09b80091c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8b8c699f329b9d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.676+0000 7f099ffff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:06.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.676+0000 7f099ffff700 1 -- 172.21.15.92:0/1397551219 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b8019050 con 0x55d067d5a5d0 2023-10-16T13:13:06.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.676+0000 7f099ffff700 1 -- 172.21.15.92:0/1397551219 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f09b8015890 con 0x55d067d5a5d0 2023-10-16T13:13:06.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.676+0000 7f09d32aeb80 1 -- 172.21.15.92:0/1397551219 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f09b800f040 con 0x55d067d5a5d0 2023-10-16T13:13:06.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.676+0000 7f099ffff700 1 -- 172.21.15.92:0/1397551219 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09b8015a50 con 0x55d067d5a5d0 2023-10-16T13:13:06.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.676+0000 7f09d32aeb80 10 client.15279 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:06.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.676+0000 7f09d32aeb80 1 -- 172.21.15.92:0/1397551219 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55d067abfc10 con 0x55d067d5a5d0 2023-10-16T13:13:06.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.676+0000 7f099ffff700 1 -- 172.21.15.92:0/1397551219 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f09b800f040 con 0x55d067d5a5d0 2023-10-16T13:13:06.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.677+0000 7f099ffff700 1 -- 172.21.15.92:0/1397551219 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f09b801f410 con 0x55d067d5a5d0 2023-10-16T13:13:06.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.677+0000 7f09d32aeb80 10 client.15279 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:06.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.677+0000 7f09d32aeb80 10 client.15279 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-16T13:13:06.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.677+0000 7f09d32aeb80 20 client.15279 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:06.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.677+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/1397551219 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x55d067d6e820 0x55d067dc4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.677+0000 7f09d32aeb80 4 client.15279 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:13:06.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.677+0000 7f09d32aeb80 1 -- 172.21.15.92:0/1397551219 --> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d067ca4e00 con 0x55d067d6e820 2023-10-16T13:13:06.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.677+0000 7f09c4e60700 1 --2- 172.21.15.92:0/1397551219 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x55d067d6e820 0x55d067dc4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.677+0000 7f099ffff700 10 client.15279 ms_handle_connect on v2:172.21.15.152:6834/1393840132 2023-10-16T13:13:06.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.677+0000 7f09c4e60700 1 --2- 172.21.15.92:0/1397551219 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x55d067d6e820 0x55d067dc4220 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=152e3f3ec9bbdc97 server_cookie=73ff93165026c73c in_seq=0 out_seq=0 2023-10-16T13:13:06.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.677+0000 7f099ffff700 1 -- 172.21.15.92:0/1397551219 <== mds.2 v2:172.21.15.152:6834/1393840132 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55d067ca4e00 con 0x55d067d6e820 2023-10-16T13:13:06.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.677+0000 7f099ffff700 10 client.15279 handle_command_reply: tid=0 2023-10-16T13:13:06.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.677+0000 7f09d32aeb80 1 client.15279 shutdown 2023-10-16T13:13:06.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09d32aeb80 1 -- 172.21.15.92:0/1397551219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d5a5d0 msgr2=0x55d067d686e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/1397551219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d5a5d0 0x55d067d686e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f09b8018000 tx=0x7f09b80091c0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09d32aeb80 1 -- 172.21.15.92:0/1397551219 shutdown_connections 2023-10-16T13:13:06.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/1397551219 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x55d067d6e820 0x55d067dc4220 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/1397551219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d067d5a5d0 0x55d067d686e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f099ffff700 0 client.15279 ms_handle_reset on v2:172.21.15.152:6834/1393840132 2023-10-16T13:13:06.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/1397551219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d067d58dd0 0x55d067d65180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09d32aeb80 1 --2- 172.21.15.92:0/1397551219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d067d59730 0x55d067d656c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09d32aeb80 1 -- 172.21.15.92:0/1397551219 >> 172.21.15.92:0/1397551219 conn(0x55d067c86d80 msgr2=0x55d067d5d500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09d32aeb80 1 -- 172.21.15.92:0/1397551219 shutdown_connections 2023-10-16T13:13:06.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09d32aeb80 1 -- 172.21.15.92:0/1397551219 wait complete. 2023-10-16T13:13:06.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09d32aeb80 20 client.15279 trim_cache size 0 max 16384 2023-10-16T13:13:06.702 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:13:06.702 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "6c276d7e-6c24-11ee-8db6-212e2dc638e7", 2023-10-16T13:13:06.702 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 2, 2023-10-16T13:13:06.703 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24460, 2023-10-16T13:13:06.703 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2023-10-16T13:13:06.703 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2023-10-16T13:13:06.703 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2023-10-16T13:13:06.703 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 81.377774615999996, 2023-10-16T13:13:06.704 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2023-10-16T13:13:06.704 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 85, 2023-10-16T13:13:06.704 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2023-10-16T13:13:06.704 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 107.27004681699999 2023-10-16T13:13:06.704 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:13:06.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09c70c4700 1 -- 172.21.15.92:0/2915889328 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f09b00a14d0 msgr2=0x7f09b00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09c70c4700 1 --2- 172.21.15.92:0/2915889328 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f09b00a14d0 0x7f09b00a3990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f09b4003800 tx=0x7f09b4005fb0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09c70c4700 1 -- 172.21.15.92:0/2915889328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09c0100fc0 msgr2=0x7f09c01023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09c70c4700 1 --2- 172.21.15.92:0/2915889328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09c0100fc0 0x7f09c01023a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00c9b0 tx=0x7f09ac00ccc0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09c70c4700 1 -- 172.21.15.92:0/2915889328 shutdown_connections 2023-10-16T13:13:06.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09c70c4700 1 --2- 172.21.15.92:0/2915889328 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f09b00a14d0 0x7f09b00a3990 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09c70c4700 1 --2- 172.21.15.92:0/2915889328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c0101960 0x7f09c01028e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09c70c4700 1 --2- 172.21.15.92:0/2915889328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09c00ffdd0 0x7f09c0103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09c70c4700 1 --2- 172.21.15.92:0/2915889328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09c0100fc0 0x7f09c01023a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.678+0000 7f09c70c4700 1 -- 172.21.15.92:0/2915889328 >> 172.21.15.92:0/2915889328 conn(0x7f09c00fb300 msgr2=0x7f09c00690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.679+0000 7f09c70c4700 1 -- 172.21.15.92:0/2915889328 shutdown_connections 2023-10-16T13:13:06.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.679+0000 7f09c70c4700 1 -- 172.21.15.92:0/2915889328 wait complete. 2023-10-16T13:13:06.708 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-16T13:13:06.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:06 smithi092 ceph-mon[99542]: pgmap v300: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-16T13:13:06.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:06 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1709098973' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:13:06.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:06 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1381604583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:06.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:06 smithi092 ceph-mon[99542]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-10-16T13:13:06.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.828+0000 7fcc5d7d2700 1 -- 172.21.15.92:0/2783392105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc58101430 msgr2=0x7fcc58101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.828+0000 7fcc5d7d2700 1 --2- 172.21.15.92:0/2783392105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc58101430 0x7fcc58101850 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009990 tx=0x7fcc4c009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.828+0000 7fcc5d7d2700 1 -- 172.21.15.92:0/2783392105 shutdown_connections 2023-10-16T13:13:06.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.828+0000 7fcc5d7d2700 1 --2- 172.21.15.92:0/2783392105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc58101430 0x7fcc58101850 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.828+0000 7fcc5d7d2700 1 --2- 172.21.15.92:0/2783392105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc58100a40 0x7fcc581082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.828+0000 7fcc5d7d2700 1 --2- 172.21.15.92:0/2783392105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc58100080 0x7fcc58100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.828+0000 7fcc5d7d2700 1 -- 172.21.15.92:0/2783392105 >> 172.21.15.92:0/2783392105 conn(0x7fcc580fab30 msgr2=0x7fcc580fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.828+0000 7fcc5d7d2700 1 -- 172.21.15.92:0/2783392105 shutdown_connections 2023-10-16T13:13:06.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.828+0000 7fcc5d7d2700 1 -- 172.21.15.92:0/2783392105 wait complete. 2023-10-16T13:13:06.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.829+0000 7fcc5d7d2700 1 Processor -- start 2023-10-16T13:13:06.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.829+0000 7fcc5d7d2700 1 -- start start 2023-10-16T13:13:06.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.829+0000 7fcc5d7d2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc58100080 0x7fcc58198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.829+0000 7fcc5d7d2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc58100a40 0x7fcc58199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.829+0000 7fcc5d7d2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc58101430 0x7fcc581a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.829+0000 7fcc5d7d2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc581a0a80 con 0x7fcc58101430 2023-10-16T13:13:06.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.829+0000 7fcc5d7d2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc581a0bc0 con 0x7fcc58100a40 2023-10-16T13:13:06.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.829+0000 7fcc5d7d2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc581a0d50 con 0x7fcc58100080 2023-10-16T13:13:06.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.829+0000 7fcc577fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc58101430 0x7fcc581a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.829+0000 7fcc577fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc58101430 0x7fcc581a04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36612/0 (socket says 172.21.15.92:36612) 2023-10-16T13:13:06.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.829+0000 7fcc577fe700 1 -- 172.21.15.92:0/2617973740 learned_addr learned my addr 172.21.15.92:0/2617973740 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.829+0000 7fcc56ffd700 1 --2- 172.21.15.92:0/2617973740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc58100080 0x7fcc58198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.829+0000 7fcc567fc700 1 --2- 172.21.15.92:0/2617973740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc58100a40 0x7fcc58199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.829+0000 7fcc577fe700 1 -- 172.21.15.92:0/2617973740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc58100080 msgr2=0x7fcc58198f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.829+0000 7fcc577fe700 1 --2- 172.21.15.92:0/2617973740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc58100080 0x7fcc58198f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.829+0000 7fcc577fe700 1 -- 172.21.15.92:0/2617973740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc58100a40 msgr2=0x7fcc58199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.829+0000 7fcc577fe700 1 --2- 172.21.15.92:0/2617973740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc58100a40 0x7fcc58199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.829+0000 7fcc577fe700 1 -- 172.21.15.92:0/2617973740 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4c0095f0 con 0x7fcc58101430 2023-10-16T13:13:06.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.829+0000 7fcc567fc700 1 --2- 172.21.15.92:0/2617973740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc58100a40 0x7fcc58199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:06.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.830+0000 7fcc577fe700 1 --2- 172.21.15.92:0/2617973740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc58101430 0x7fcc581a04b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcc50007ee0 tx=0x7fcc5000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.830+0000 7fcc3ffff700 1 -- 172.21.15.92:0/2617973740 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc50017070 con 0x7fcc58101430 2023-10-16T13:13:06.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.830+0000 7fcc3ffff700 1 -- 172.21.15.92:0/2617973740 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcc5000f040 con 0x7fcc58101430 2023-10-16T13:13:06.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.830+0000 7fcc5d7d2700 1 -- 172.21.15.92:0/2617973740 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc581a0fd0 con 0x7fcc58101430 2023-10-16T13:13:06.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.830+0000 7fcc3ffff700 1 -- 172.21.15.92:0/2617973740 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc50005760 con 0x7fcc58101430 2023-10-16T13:13:06.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.830+0000 7fcc5d7d2700 1 -- 172.21.15.92:0/2617973740 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc581a1460 con 0x7fcc58101430 2023-10-16T13:13:06.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.832+0000 7fcc3ffff700 1 -- 172.21.15.92:0/2617973740 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fcc500058c0 con 0x7fcc58101430 2023-10-16T13:13:06.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.833+0000 7fcc3ffff700 1 --2- 172.21.15.92:0/2617973740 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fcc400a14d0 0x7fcc400a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.833+0000 7fcc56ffd700 1 --2- 172.21.15.92:0/2617973740 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fcc400a14d0 0x7fcc400a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.833+0000 7fcc3ffff700 1 -- 172.21.15.92:0/2617973740 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fcc500cc3d0 con 0x7fcc58101430 2023-10-16T13:13:06.847 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.833+0000 7fcc56ffd700 1 --2- 172.21.15.92:0/2617973740 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fcc400a14d0 0x7fcc400a3990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c000c00 tx=0x7fcc4c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.847 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.833+0000 7fcc699bcb80 1 Processor -- start 2023-10-16T13:13:06.847 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.833+0000 7fcc699bcb80 1 -- start start 2023-10-16T13:13:06.847 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc699bcb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b85281dd0 0x562b852821f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.847 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc699bcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85282730 0x562b85282ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc699bcb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b852835d0 0x562b85283a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc699bcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b851f6c20 con 0x562b85282730 2023-10-16T13:13:06.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc699bcb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b851dbc10 con 0x562b85281dd0 2023-10-16T13:13:06.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc699bcb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b851d9530 con 0x562b852835d0 2023-10-16T13:13:06.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc567fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85282730 0x562b85282ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc567fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85282730 0x562b85282ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36618/0 (socket says 172.21.15.92:36618) 2023-10-16T13:13:06.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc567fc700 1 -- 172.21.15.92:0/2754518067 learned_addr learned my addr 172.21.15.92:0/2754518067 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc56ffd700 1 --2- 172.21.15.92:0/2754518067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b85281dd0 0x562b852821f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc577fe700 1 --2- 172.21.15.92:0/2754518067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b852835d0 0x562b85283a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc567fc700 1 -- 172.21.15.92:0/2754518067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b852835d0 msgr2=0x562b85283a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc567fc700 1 --2- 172.21.15.92:0/2754518067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b852835d0 0x562b85283a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc567fc700 1 -- 172.21.15.92:0/2754518067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b85281dd0 msgr2=0x562b852821f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc567fc700 1 --2- 172.21.15.92:0/2754518067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b85281dd0 0x562b852821f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc567fc700 1 -- 172.21.15.92:0/2754518067 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b851923a0 con 0x562b85282730 2023-10-16T13:13:06.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc56ffd700 1 --2- 172.21.15.92:0/2754518067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b85281dd0 0x562b852821f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:06.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc567fc700 1 --2- 172.21.15.92:0/2754518067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85282730 0x562b85282ff0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800bc10 tx=0x7fcc4800bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73915a16c91f8e70 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc3d7fa700 1 -- 172.21.15.92:0/2754518067 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4800ddb0 con 0x562b85282730 2023-10-16T13:13:06.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc3d7fa700 1 -- 172.21.15.92:0/2754518067 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcc48017900 con 0x562b85282730 2023-10-16T13:13:06.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.834+0000 7fcc3d7fa700 1 -- 172.21.15.92:0/2754518067 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4800fa10 con 0x562b85282730 2023-10-16T13:13:06.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.835+0000 7fcc699bcb80 1 -- 172.21.15.92:0/2754518067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85282730 msgr2=0x562b85282ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.835+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/2754518067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85282730 0x562b85282ff0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800bc10 tx=0x7fcc4800bf20 comp rx=0 tx=0).stop 2023-10-16T13:13:06.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.835+0000 7fcc699bcb80 1 -- 172.21.15.92:0/2754518067 shutdown_connections 2023-10-16T13:13:06.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.835+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/2754518067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b852835d0 0x562b85283a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.835+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/2754518067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b85281dd0 0x562b852821f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.835+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/2754518067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85282730 0x562b85282ff0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.835+0000 7fcc699bcb80 1 -- 172.21.15.92:0/2754518067 >> 172.21.15.92:0/2754518067 conn(0x562b851afd80 msgr2=0x562b8527cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.835+0000 7fcc699bcb80 1 -- 172.21.15.92:0/2754518067 shutdown_connections 2023-10-16T13:13:06.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.835+0000 7fcc699bcb80 1 -- 172.21.15.92:0/2754518067 wait complete. 2023-10-16T13:13:06.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.835+0000 7fcc699bcb80 1 -- start start 2023-10-16T13:13:06.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.835+0000 7fcc699bcb80 1 Processor -- start 2023-10-16T13:13:06.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc699bcb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b85281dd0 0x562b8528bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc699bcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85282730 0x562b8528c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc699bcb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b852835d0 0x562b85293170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc699bcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b851d4e20 con 0x562b85282730 2023-10-16T13:13:06.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc699bcb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b851716c0 con 0x562b852835d0 2023-10-16T13:13:06.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc699bcb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b85171360 con 0x562b85281dd0 2023-10-16T13:13:06.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc699bcb80 10 client.0 _ll_register_callbacks cb 0x562b84fce7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:06.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc567fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85282730 0x562b8528c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc567fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85282730 0x562b8528c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36624/0 (socket says 172.21.15.92:36624) 2023-10-16T13:13:06.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc567fc700 1 -- 172.21.15.92:0/4239010733 learned_addr learned my addr 172.21.15.92:0/4239010733 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc56ffd700 1 --2- 172.21.15.92:0/4239010733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b85281dd0 0x562b8528bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc577fe700 1 --2- 172.21.15.92:0/4239010733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b852835d0 0x562b85293170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc567fc700 1 -- 172.21.15.92:0/4239010733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b85281dd0 msgr2=0x562b8528bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc567fc700 1 --2- 172.21.15.92:0/4239010733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b85281dd0 0x562b8528bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc567fc700 1 -- 172.21.15.92:0/4239010733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b852835d0 msgr2=0x562b85293170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc567fc700 1 --2- 172.21.15.92:0/4239010733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b852835d0 0x562b85293170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc567fc700 1 -- 172.21.15.92:0/4239010733 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4800b840 con 0x562b85282730 2023-10-16T13:13:06.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc567fc700 1 --2- 172.21.15.92:0/4239010733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85282730 0x562b8528c130 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800bbe0 tx=0x7fcc480176d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902f16f5465ea2e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc3aff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:06.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc3aff5700 1 -- 172.21.15.92:0/4239010733 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc48017c80 con 0x562b85282730 2023-10-16T13:13:06.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc699bcb80 1 -- 172.21.15.92:0/4239010733 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b851d9ea0 con 0x562b85282730 2023-10-16T13:13:06.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc3aff5700 1 -- 172.21.15.92:0/4239010733 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fcc48013070 con 0x562b85282730 2023-10-16T13:13:06.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc3aff5700 1 -- 172.21.15.92:0/4239010733 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc48017de0 con 0x562b85282730 2023-10-16T13:13:06.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc699bcb80 10 client.15291 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:06.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.836+0000 7fcc699bcb80 1 -- 172.21.15.92:0/4239010733 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562b84fffd90 con 0x562b85282730 2023-10-16T13:13:06.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.837+0000 7fcc3aff5700 1 -- 172.21.15.92:0/4239010733 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x562b851d9ea0 con 0x562b85282730 2023-10-16T13:13:06.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.837+0000 7fcc3aff5700 1 -- 172.21.15.92:0/4239010733 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcc4801f070 con 0x562b85282730 2023-10-16T13:13:06.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.837+0000 7fcc699bcb80 10 client.15291 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:06.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.837+0000 7fcc699bcb80 10 client.15291 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-16T13:13:06.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.837+0000 7fcc699bcb80 20 client.15291 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:06.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.837+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/4239010733 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x562b85297710 0x562b852961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.837+0000 7fcc699bcb80 4 client.15291 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:13:06.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.837+0000 7fcc699bcb80 1 -- 172.21.15.92:0/4239010733 --> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b85251bc0 con 0x562b85297710 2023-10-16T13:13:06.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.837+0000 7fcc56ffd700 1 --2- 172.21.15.92:0/4239010733 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x562b85297710 0x562b852961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.837+0000 7fcc3aff5700 10 client.15291 ms_handle_connect on v2:172.21.15.152:6838/1821921588 2023-10-16T13:13:06.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.837+0000 7fcc56ffd700 1 --2- 172.21.15.92:0/4239010733 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x562b85297710 0x562b852961c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dc15e8f5548e69b5 server_cookie=c496194ca258cfc0 in_seq=0 out_seq=0 2023-10-16T13:13:06.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.838+0000 7fcc3aff5700 1 -- 172.21.15.92:0/4239010733 <== mds.1 v2:172.21.15.152:6838/1821921588 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562b85251bc0 con 0x562b85297710 2023-10-16T13:13:06.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.838+0000 7fcc3aff5700 10 client.15291 handle_command_reply: tid=0 2023-10-16T13:13:06.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.838+0000 7fcc699bcb80 1 client.15291 shutdown 2023-10-16T13:13:06.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.838+0000 7fcc699bcb80 1 -- 172.21.15.92:0/4239010733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85282730 msgr2=0x562b8528c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.838+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/4239010733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85282730 0x562b8528c130 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800bbe0 tx=0x7fcc480176d0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.838+0000 7fcc699bcb80 1 -- 172.21.15.92:0/4239010733 shutdown_connections 2023-10-16T13:13:06.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.838+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/4239010733 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x562b85297710 0x562b852961c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.838+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/4239010733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b852835d0 0x562b85293170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.838+0000 7fcc3aff5700 0 client.15291 ms_handle_reset on v2:172.21.15.152:6838/1821921588 2023-10-16T13:13:06.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.838+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/4239010733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b85281dd0 0x562b8528bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.838+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/4239010733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85282730 0x562b8528c130 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.862 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.838+0000 7fcc699bcb80 1 -- 172.21.15.92:0/4239010733 >> 172.21.15.92:0/4239010733 conn(0x562b851afd80 msgr2=0x562b8527cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.838+0000 7fcc699bcb80 1 -- 172.21.15.92:0/4239010733 shutdown_connections 2023-10-16T13:13:06.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.838+0000 7fcc699bcb80 1 -- 172.21.15.92:0/4239010733 wait complete. 2023-10-16T13:13:06.863 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.838+0000 7fcc699bcb80 20 client.15291 trim_cache size 0 max 16384 2023-10-16T13:13:06.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc699bcb80 1 Processor -- start 2023-10-16T13:13:06.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc699bcb80 1 -- start start 2023-10-16T13:13:06.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc699bcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85281dd0 0x562b852864a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc699bcb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b85282730 0x562b852869e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc699bcb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b852835d0 0x562b85293130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc699bcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b850558d0 con 0x562b85281dd0 2023-10-16T13:13:06.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc699bcb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b851d0f10 con 0x562b852835d0 2023-10-16T13:13:06.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc699bcb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b85193590 con 0x562b85282730 2023-10-16T13:13:06.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc56ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85281dd0 0x562b852864a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc56ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85281dd0 0x562b852864a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36630/0 (socket says 172.21.15.92:36630) 2023-10-16T13:13:06.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc56ffd700 1 -- 172.21.15.92:0/778654251 learned_addr learned my addr 172.21.15.92:0/778654251 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc56ffd700 1 -- 172.21.15.92:0/778654251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b85282730 msgr2=0x562b852869e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc567fc700 1 --2- 172.21.15.92:0/778654251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b85282730 0x562b852869e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc56ffd700 1 --2- 172.21.15.92:0/778654251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b85282730 0x562b852869e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc577fe700 1 --2- 172.21.15.92:0/778654251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b852835d0 0x562b85293130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc56ffd700 1 -- 172.21.15.92:0/778654251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b852835d0 msgr2=0x562b85293130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc56ffd700 1 --2- 172.21.15.92:0/778654251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b852835d0 0x562b85293130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc56ffd700 1 -- 172.21.15.92:0/778654251 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b84fe8c10 con 0x562b85281dd0 2023-10-16T13:13:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc567fc700 1 --2- 172.21.15.92:0/778654251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b85282730 0x562b852869e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc577fe700 1 --2- 172.21.15.92:0/778654251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b852835d0 0x562b85293130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc56ffd700 1 --2- 172.21.15.92:0/778654251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85281dd0 0x562b852864a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009990 tx=0x7fcc4c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2592e8de09a19403 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc3dffb700 1 -- 172.21.15.92:0/778654251 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c00bb00 con 0x562b85281dd0 2023-10-16T13:13:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.856+0000 7fcc3dffb700 1 -- 172.21.15.92:0/778654251 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcc4c02c040 con 0x562b85281dd0 2023-10-16T13:13:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.857+0000 7fcc3dffb700 1 -- 172.21.15.92:0/778654251 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c024770 con 0x562b85281dd0 2023-10-16T13:13:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.857+0000 7fcc699bcb80 1 -- 172.21.15.92:0/778654251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85281dd0 msgr2=0x562b852864a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.857+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/778654251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85281dd0 0x562b852864a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009990 tx=0x7fcc4c020000 comp rx=0 tx=0).stop 2023-10-16T13:13:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.857+0000 7fcc699bcb80 1 -- 172.21.15.92:0/778654251 shutdown_connections 2023-10-16T13:13:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.857+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/778654251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b85281dd0 0x562b852864a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.857+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/778654251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b852835d0 0x562b85293130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.857+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/778654251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b85282730 0x562b852869e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.857+0000 7fcc699bcb80 1 -- 172.21.15.92:0/778654251 >> 172.21.15.92:0/778654251 conn(0x562b851afd80 msgr2=0x562b8528a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.857+0000 7fcc699bcb80 1 -- 172.21.15.92:0/778654251 shutdown_connections 2023-10-16T13:13:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.857+0000 7fcc699bcb80 1 -- 172.21.15.92:0/778654251 wait complete. 2023-10-16T13:13:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.857+0000 7fcc699bcb80 1 -- start start 2023-10-16T13:13:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.857+0000 7fcc699bcb80 1 Processor -- start 2023-10-16T13:13:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc699bcb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b85281dd0 0x562b8528dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc699bcb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b85282730 0x562b8528e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc699bcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b852835d0 0x562b852eb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc699bcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b85293250 con 0x562b852835d0 2023-10-16T13:13:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc699bcb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b852933c0 con 0x562b85282730 2023-10-16T13:13:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc699bcb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b852eb640 con 0x562b85281dd0 2023-10-16T13:13:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc699bcb80 10 client.0 _ll_register_callbacks cb 0x562b84fce7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc577fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b852835d0 0x562b852eb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc577fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b852835d0 0x562b852eb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36640/0 (socket says 172.21.15.92:36640) 2023-10-16T13:13:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc577fe700 1 -- 172.21.15.92:0/3541917920 learned_addr learned my addr 172.21.15.92:0/3541917920 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc56ffd700 1 --2- 172.21.15.92:0/3541917920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b85281dd0 0x562b8528dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc567fc700 1 --2- 172.21.15.92:0/3541917920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b85282730 0x562b8528e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc577fe700 1 -- 172.21.15.92:0/3541917920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b85281dd0 msgr2=0x562b8528dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc577fe700 1 --2- 172.21.15.92:0/3541917920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b85281dd0 0x562b8528dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc577fe700 1 -- 172.21.15.92:0/3541917920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b85282730 msgr2=0x562b8528e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc577fe700 1 --2- 172.21.15.92:0/3541917920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b85282730 0x562b8528e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc577fe700 1 -- 172.21.15.92:0/3541917920 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc58108be0 con 0x562b852835d0 2023-10-16T13:13:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc577fe700 1 --2- 172.21.15.92:0/3541917920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b852835d0 0x562b852eb100 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000d7b0 tx=0x7fcc5000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24c489eb339711b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc3aff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc3aff5700 1 -- 172.21.15.92:0/3541917920 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc50099df0 con 0x562b852835d0 2023-10-16T13:13:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc3aff5700 1 -- 172.21.15.92:0/3541917920 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fcc500996f0 con 0x562b852835d0 2023-10-16T13:13:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.858+0000 7fcc699bcb80 1 -- 172.21.15.92:0/3541917920 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcc48017900 con 0x562b852835d0 2023-10-16T13:13:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.859+0000 7fcc3aff5700 1 -- 172.21.15.92:0/3541917920 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc5009d840 con 0x562b852835d0 2023-10-16T13:13:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.859+0000 7fcc699bcb80 10 client.15297 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.859+0000 7fcc699bcb80 1 -- 172.21.15.92:0/3541917920 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562b85026200 con 0x562b852835d0 2023-10-16T13:13:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.859+0000 7fcc3aff5700 1 -- 172.21.15.92:0/3541917920 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcc48017900 con 0x562b852835d0 2023-10-16T13:13:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.859+0000 7fcc3aff5700 1 -- 172.21.15.92:0/3541917920 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcc500999e0 con 0x562b852835d0 2023-10-16T13:13:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.859+0000 7fcc699bcb80 10 client.15297 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.859+0000 7fcc699bcb80 10 client.15297 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-16T13:13:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.859+0000 7fcc699bcb80 20 client.15297 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.859+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/3541917920 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x562b852f0870 0x562b852eccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.859+0000 7fcc699bcb80 4 client.15297 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:13:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.859+0000 7fcc699bcb80 1 -- 172.21.15.92:0/3541917920 --> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562b851cde00 con 0x562b852f0870 2023-10-16T13:13:06.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.859+0000 7fcc56ffd700 1 --2- 172.21.15.92:0/3541917920 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x562b852f0870 0x562b852eccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:06.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.859+0000 7fcc3aff5700 10 client.15297 ms_handle_connect on v2:172.21.15.152:6838/1821921588 2023-10-16T13:13:06.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.859+0000 7fcc56ffd700 1 --2- 172.21.15.92:0/3541917920 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x562b852f0870 0x562b852eccf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=93ce410b44ea12fb server_cookie=fa0b631b1b058b12 in_seq=0 out_seq=0 2023-10-16T13:13:06.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc3aff5700 1 -- 172.21.15.92:0/3541917920 <== mds.1 v2:172.21.15.152:6838/1821921588 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x562b851cde00 con 0x562b852f0870 2023-10-16T13:13:06.884 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc3aff5700 10 client.15297 handle_command_reply: tid=0 2023-10-16T13:13:06.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc699bcb80 1 client.15297 shutdown 2023-10-16T13:13:06.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc699bcb80 1 -- 172.21.15.92:0/3541917920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b852835d0 msgr2=0x562b852eb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/3541917920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b852835d0 0x562b852eb100 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000d7b0 tx=0x7fcc5000b040 comp rx=0 tx=0).stop 2023-10-16T13:13:06.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc699bcb80 1 -- 172.21.15.92:0/3541917920 shutdown_connections 2023-10-16T13:13:06.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/3541917920 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x562b852f0870 0x562b852eccf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/3541917920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562b852835d0 0x562b852eb100 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc3aff5700 0 client.15297 ms_handle_reset on v2:172.21.15.152:6838/1821921588 2023-10-16T13:13:06.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/3541917920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b85281dd0 0x562b8528dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc699bcb80 1 --2- 172.21.15.92:0/3541917920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b85282730 0x562b8528e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc699bcb80 1 -- 172.21.15.92:0/3541917920 >> 172.21.15.92:0/3541917920 conn(0x562b851afd80 msgr2=0x562b85289940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc699bcb80 1 -- 172.21.15.92:0/3541917920 shutdown_connections 2023-10-16T13:13:06.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc699bcb80 1 -- 172.21.15.92:0/3541917920 wait complete. 2023-10-16T13:13:06.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc699bcb80 20 client.15297 trim_cache size 0 max 16384 2023-10-16T13:13:06.887 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:13:06.888 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "6c276d7e-6c24-11ee-8db6-212e2dc638e7", 2023-10-16T13:13:06.888 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 1, 2023-10-16T13:13:06.888 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24490, 2023-10-16T13:13:06.888 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2023-10-16T13:13:06.888 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2023-10-16T13:13:06.889 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2023-10-16T13:13:06.889 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 82.546121490000004, 2023-10-16T13:13:06.889 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2023-10-16T13:13:06.889 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 85, 2023-10-16T13:13:06.889 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2023-10-16T13:13:06.889 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 100.412327906 2023-10-16T13:13:06.890 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:13:06.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc5d7d2700 1 -- 172.21.15.92:0/2617973740 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fcc400a14d0 msgr2=0x7fcc400a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc5d7d2700 1 --2- 172.21.15.92:0/2617973740 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fcc400a14d0 0x7fcc400a3990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c000c00 tx=0x7fcc4c005fb0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc5d7d2700 1 -- 172.21.15.92:0/2617973740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc58101430 msgr2=0x7fcc581a04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:06.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc5d7d2700 1 --2- 172.21.15.92:0/2617973740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc58101430 0x7fcc581a04b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcc50007ee0 tx=0x7fcc5000d3b0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc5d7d2700 1 -- 172.21.15.92:0/2617973740 shutdown_connections 2023-10-16T13:13:06.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc5d7d2700 1 --2- 172.21.15.92:0/2617973740 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fcc400a14d0 0x7fcc400a3990 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc5d7d2700 1 --2- 172.21.15.92:0/2617973740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc58101430 0x7fcc581a04b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc5d7d2700 1 --2- 172.21.15.92:0/2617973740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc58100080 0x7fcc58198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc5d7d2700 1 --2- 172.21.15.92:0/2617973740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc58100a40 0x7fcc58199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:06.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.860+0000 7fcc5d7d2700 1 -- 172.21.15.92:0/2617973740 >> 172.21.15.92:0/2617973740 conn(0x7fcc580fab30 msgr2=0x7fcc580feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:06.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.861+0000 7fcc5d7d2700 1 -- 172.21.15.92:0/2617973740 shutdown_connections 2023-10-16T13:13:06.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:06.861+0000 7fcc5d7d2700 1 -- 172.21.15.92:0/2617973740 wait complete. 2023-10-16T13:13:06.894 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-16T13:13:06.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:06 smithi152 ceph-mon[104423]: pgmap v300: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-16T13:13:06.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:06 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1709098973' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:13:06.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:06 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1381604583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:06.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:06 smithi152 ceph-mon[104423]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-10-16T13:13:07.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:06 smithi118 ceph-mon[103969]: pgmap v300: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-16T13:13:07.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:06 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1709098973' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:13:07.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:06 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1381604583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:07.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:06 smithi118 ceph-mon[103969]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-10-16T13:13:07.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.050+0000 7f5899de4700 1 -- 172.21.15.92:0/1045582838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5894106bb0 msgr2=0x7f5894109020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:07.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.050+0000 7f5899de4700 1 --2- 172.21.15.92:0/1045582838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5894106bb0 0x7f5894109020 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f588c00b0a0 tx=0x7f588c00b3b0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.050+0000 7f5899de4700 1 -- 172.21.15.92:0/1045582838 shutdown_connections 2023-10-16T13:13:07.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.050+0000 7f5899de4700 1 --2- 172.21.15.92:0/1045582838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5894106bb0 0x7f5894109020 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.050+0000 7f5899de4700 1 --2- 172.21.15.92:0/1045582838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5894101950 0x7f5894103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.050+0000 7f5899de4700 1 --2- 172.21.15.92:0/1045582838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5894104280 0x7f5894106670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.050+0000 7f5899de4700 1 -- 172.21.15.92:0/1045582838 >> 172.21.15.92:0/1045582838 conn(0x7f58940fb340 msgr2=0x7f58940fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:07.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.050+0000 7f5899de4700 1 -- 172.21.15.92:0/1045582838 shutdown_connections 2023-10-16T13:13:07.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.050+0000 7f5899de4700 1 -- 172.21.15.92:0/1045582838 wait complete. 2023-10-16T13:13:07.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.051+0000 7f5899de4700 1 Processor -- start 2023-10-16T13:13:07.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.051+0000 7f5899de4700 1 -- start start 2023-10-16T13:13:07.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.051+0000 7f5899de4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5894101950 0x7f5894196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:07.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.051+0000 7f5899de4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5894104280 0x7f58941971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:07.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.051+0000 7f5899de4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5894106bb0 0x7f589419e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:07.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.051+0000 7f5899de4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589419e800 con 0x7f5894104280 2023-10-16T13:13:07.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.051+0000 7f5899de4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589419e970 con 0x7f5894106bb0 2023-10-16T13:13:07.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.051+0000 7f5899de4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589419eb30 con 0x7f5894101950 2023-10-16T13:13:07.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.051+0000 7f5892ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5894104280 0x7f58941971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:07.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.051+0000 7f5892ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5894104280 0x7f58941971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36652/0 (socket says 172.21.15.92:36652) 2023-10-16T13:13:07.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.051+0000 7f5892ffd700 1 -- 172.21.15.92:0/881672227 learned_addr learned my addr 172.21.15.92:0/881672227 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:07.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.051+0000 7f5893fff700 1 --2- 172.21.15.92:0/881672227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5894106bb0 0x7f589419e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:07.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.052+0000 7f58937fe700 1 --2- 172.21.15.92:0/881672227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5894101950 0x7f5894196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:07.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.052+0000 7f5892ffd700 1 -- 172.21.15.92:0/881672227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5894101950 msgr2=0x7f5894196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:07.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.052+0000 7f5892ffd700 1 --2- 172.21.15.92:0/881672227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5894101950 0x7f5894196c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.052+0000 7f5892ffd700 1 -- 172.21.15.92:0/881672227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5894106bb0 msgr2=0x7f589419e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:07.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.052+0000 7f5892ffd700 1 --2- 172.21.15.92:0/881672227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5894106bb0 0x7f589419e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.052+0000 7f5892ffd700 1 -- 172.21.15.92:0/881672227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c009d00 con 0x7f5894104280 2023-10-16T13:13:07.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.052+0000 7f5893fff700 1 --2- 172.21.15.92:0/881672227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5894106bb0 0x7f589419e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:07.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.052+0000 7f5892ffd700 1 --2- 172.21.15.92:0/881672227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5894104280 0x7f58941971d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f588800c9b0 tx=0x7f588800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:07.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.052+0000 7f5890ff9700 1 -- 172.21.15.92:0/881672227 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888007b00 con 0x7f5894104280 2023-10-16T13:13:07.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.052+0000 7f5890ff9700 1 -- 172.21.15.92:0/881672227 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5888007c60 con 0x7f5894104280 2023-10-16T13:13:07.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.052+0000 7f5899de4700 1 -- 172.21.15.92:0/881672227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589419ee10 con 0x7f5894104280 2023-10-16T13:13:07.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.052+0000 7f5890ff9700 1 -- 172.21.15.92:0/881672227 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888018730 con 0x7f5894104280 2023-10-16T13:13:07.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.052+0000 7f5899de4700 1 -- 172.21.15.92:0/881672227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589419f290 con 0x7f5894104280 2023-10-16T13:13:07.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.054+0000 7f5890ff9700 1 -- 172.21.15.92:0/881672227 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5888018890 con 0x7f5894104280 2023-10-16T13:13:07.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.054+0000 7f5890ff9700 1 --2- 172.21.15.92:0/881672227 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f587c0a14d0 0x7f587c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:07.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.055+0000 7f58937fe700 1 --2- 172.21.15.92:0/881672227 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f587c0a14d0 0x7f587c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:07.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.055+0000 7f5890ff9700 1 -- 172.21.15.92:0/881672227 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f58880ccd30 con 0x7f5894104280 2023-10-16T13:13:07.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.055+0000 7f58937fe700 1 --2- 172.21.15.92:0/881672227 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f587c0a14d0 0x7f587c0a3990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5884005fd0 tx=0x7f5884005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:07.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.055+0000 7f58a5fceb80 1 Processor -- start 2023-10-16T13:13:07.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.055+0000 7f58a5fceb80 1 -- start start 2023-10-16T13:13:07.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.055+0000 7f58a5fceb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f75dd0 0x563641f761f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:07.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.055+0000 7f58a5fceb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 0x563641f76ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:07.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.056+0000 7f58a5fceb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f775d0 0x563641f77a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:07.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.056+0000 7f58a5fceb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563641eeac20 con 0x563641f76730 2023-10-16T13:13:07.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.056+0000 7f58a5fceb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563641ecfc10 con 0x563641f775d0 2023-10-16T13:13:07.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.056+0000 7f58a5fceb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563641ecd530 con 0x563641f75dd0 2023-10-16T13:13:07.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.056+0000 7f5892ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 0x563641f76ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:07.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.056+0000 7f5892ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 0x563641f76ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36660/0 (socket says 172.21.15.92:36660) 2023-10-16T13:13:07.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.056+0000 7f5892ffd700 1 -- 172.21.15.92:0/1364414686 learned_addr learned my addr 172.21.15.92:0/1364414686 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:07.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.056+0000 7f58937fe700 1 --2- 172.21.15.92:0/1364414686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f75dd0 0x563641f761f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:07.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.056+0000 7f5893fff700 1 --2- 172.21.15.92:0/1364414686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f775d0 0x563641f77a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:07.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.056+0000 7f5892ffd700 1 -- 172.21.15.92:0/1364414686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f75dd0 msgr2=0x563641f761f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:07.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.056+0000 7f5892ffd700 1 --2- 172.21.15.92:0/1364414686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f75dd0 0x563641f761f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.056+0000 7f5892ffd700 1 -- 172.21.15.92:0/1364414686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f775d0 msgr2=0x563641f77a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:07.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.056+0000 7f5892ffd700 1 --2- 172.21.15.92:0/1364414686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f775d0 0x563641f77a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.056+0000 7f5892ffd700 1 -- 172.21.15.92:0/1364414686 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563641e863a0 con 0x563641f76730 2023-10-16T13:13:07.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.056+0000 7f5893fff700 1 --2- 172.21.15.92:0/1364414686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f775d0 0x563641f77a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:07.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.056+0000 7f5892ffd700 1 --2- 172.21.15.92:0/1364414686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 0x563641f76ff0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5888099fe0 tx=0x7f588809a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f34091805ed770 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:07.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.056+0000 7f5879ffb700 1 -- 172.21.15.92:0/1364414686 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58880a23e0 con 0x563641f76730 2023-10-16T13:13:07.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.056+0000 7f5879ffb700 1 -- 172.21.15.92:0/1364414686 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5888098190 con 0x563641f76730 2023-10-16T13:13:07.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.056+0000 7f5879ffb700 1 -- 172.21.15.92:0/1364414686 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888099760 con 0x563641f76730 2023-10-16T13:13:07.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.057+0000 7f58a5fceb80 1 -- 172.21.15.92:0/1364414686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 msgr2=0x563641f76ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:07.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.057+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/1364414686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 0x563641f76ff0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5888099fe0 tx=0x7f588809a750 comp rx=0 tx=0).stop 2023-10-16T13:13:07.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.057+0000 7f58a5fceb80 1 -- 172.21.15.92:0/1364414686 shutdown_connections 2023-10-16T13:13:07.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.057+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/1364414686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f775d0 0x563641f77a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.057+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/1364414686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f75dd0 0x563641f761f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.057+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/1364414686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 0x563641f76ff0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.057+0000 7f58a5fceb80 1 -- 172.21.15.92:0/1364414686 >> 172.21.15.92:0/1364414686 conn(0x563641ea3d80 msgr2=0x563641f70f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:07.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.057+0000 7f58a5fceb80 1 -- 172.21.15.92:0/1364414686 shutdown_connections 2023-10-16T13:13:07.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.057+0000 7f58a5fceb80 1 -- 172.21.15.92:0/1364414686 wait complete. 2023-10-16T13:13:07.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.057+0000 7f58a5fceb80 1 -- start start 2023-10-16T13:13:07.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.057+0000 7f58a5fceb80 1 Processor -- start 2023-10-16T13:13:07.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f58a5fceb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f75dd0 0x563641f7fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:07.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f58a5fceb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 0x563641f80170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:07.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f58a5fceb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f775d0 0x563641f871b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:07.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f58a5fceb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563641ec8e20 con 0x563641f76730 2023-10-16T13:13:07.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f58a5fceb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563641e656c0 con 0x563641f75dd0 2023-10-16T13:13:07.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f58a5fceb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563641e65360 con 0x563641f775d0 2023-10-16T13:13:07.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f58a5fceb80 10 client.0 _ll_register_callbacks cb 0x563641cc27b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:07.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f5892ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 0x563641f80170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:07.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f5892ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 0x563641f80170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36666/0 (socket says 172.21.15.92:36666) 2023-10-16T13:13:07.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f5892ffd700 1 -- 172.21.15.92:0/3960369126 learned_addr learned my addr 172.21.15.92:0/3960369126 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:07.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f58937fe700 1 --2- 172.21.15.92:0/3960369126 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f75dd0 0x563641f7fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:07.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f5893fff700 1 --2- 172.21.15.92:0/3960369126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f775d0 0x563641f871b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:07.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f5892ffd700 1 -- 172.21.15.92:0/3960369126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f775d0 msgr2=0x563641f871b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:07.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f5892ffd700 1 --2- 172.21.15.92:0/3960369126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f775d0 0x563641f871b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f5892ffd700 1 -- 172.21.15.92:0/3960369126 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f75dd0 msgr2=0x563641f7fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:07.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f5892ffd700 1 --2- 172.21.15.92:0/3960369126 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f75dd0 0x563641f7fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f5892ffd700 1 -- 172.21.15.92:0/3960369126 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589419f290 con 0x563641f76730 2023-10-16T13:13:07.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f5892ffd700 1 --2- 172.21.15.92:0/3960369126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 0x563641f80170 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5888098620 tx=0x7f588809a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd64dfb35dba200 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:07.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f5872ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:07.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f5872ffd700 1 -- 172.21.15.92:0/3960369126 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58880b8300 con 0x563641f76730 2023-10-16T13:13:07.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f5872ffd700 1 -- 172.21.15.92:0/3960369126 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5888099750 con 0x563641f76730 2023-10-16T13:13:07.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f58a5fceb80 1 -- 172.21.15.92:0/3960369126 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563641ecdea0 con 0x563641f76730 2023-10-16T13:13:07.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f5872ffd700 1 -- 172.21.15.92:0/3960369126 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58880a1f50 con 0x563641f76730 2023-10-16T13:13:07.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f58a5fceb80 10 client.15309 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:07.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.058+0000 7f58a5fceb80 1 -- 172.21.15.92:0/3960369126 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563641cf3d90 con 0x563641f76730 2023-10-16T13:13:07.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.059+0000 7f5872ffd700 1 -- 172.21.15.92:0/3960369126 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x563641ecdea0 con 0x563641f76730 2023-10-16T13:13:07.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.059+0000 7f5872ffd700 1 -- 172.21.15.92:0/3960369126 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5888081080 con 0x563641f76730 2023-10-16T13:13:07.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.059+0000 7f58a5fceb80 10 client.15309 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:07.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.059+0000 7f58a5fceb80 10 client.15309 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-16T13:13:07.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.059+0000 7f58a5fceb80 20 client.15309 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:07.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.059+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/3960369126 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563641f8b230 0x563641f8a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:07.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.059+0000 7f58a5fceb80 4 client.15309 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:13:07.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.059+0000 7f58a5fceb80 1 -- 172.21.15.92:0/3960369126 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563641f45bc0 con 0x563641f8b230 2023-10-16T13:13:07.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.059+0000 7f58937fe700 1 --2- 172.21.15.92:0/3960369126 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563641f8b230 0x563641f8a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:07.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.060+0000 7f5872ffd700 10 client.15309 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:07.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.060+0000 7f58937fe700 1 --2- 172.21.15.92:0/3960369126 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563641f8b230 0x563641f8a050 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=beab7be05df8812a server_cookie=5a49be26d5a04f7c in_seq=0 out_seq=0 2023-10-16T13:13:07.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.060+0000 7f5872ffd700 1 -- 172.21.15.92:0/3960369126 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563641f45bc0 con 0x563641f8b230 2023-10-16T13:13:07.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.060+0000 7f5872ffd700 10 client.15309 handle_command_reply: tid=0 2023-10-16T13:13:07.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.060+0000 7f58a5fceb80 1 client.15309 shutdown 2023-10-16T13:13:07.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.060+0000 7f58a5fceb80 1 -- 172.21.15.92:0/3960369126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 msgr2=0x563641f80170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:07.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.060+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/3960369126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 0x563641f80170 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5888098620 tx=0x7f588809a3f0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.060+0000 7f58a5fceb80 1 -- 172.21.15.92:0/3960369126 shutdown_connections 2023-10-16T13:13:07.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.060+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/3960369126 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563641f8b230 0x563641f8a050 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.060+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/3960369126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f775d0 0x563641f871b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.060+0000 7f5872ffd700 0 client.15309 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:07.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.060+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/3960369126 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f75dd0 0x563641f7fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.060+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/3960369126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 0x563641f80170 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.060+0000 7f58a5fceb80 1 -- 172.21.15.92:0/3960369126 >> 172.21.15.92:0/3960369126 conn(0x563641ea3d80 msgr2=0x563641f70ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:07.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.060+0000 7f58a5fceb80 1 -- 172.21.15.92:0/3960369126 shutdown_connections 2023-10-16T13:13:07.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.060+0000 7f58a5fceb80 1 -- 172.21.15.92:0/3960369126 wait complete. 2023-10-16T13:13:07.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.061+0000 7f58a5fceb80 20 client.15309 trim_cache size 0 max 16384 2023-10-16T13:13:07.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.078+0000 7f58a5fceb80 1 Processor -- start 2023-10-16T13:13:07.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.078+0000 7f58a5fceb80 1 -- start start 2023-10-16T13:13:07.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.078+0000 7f58a5fceb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f75dd0 0x563641f72b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:07.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.078+0000 7f58a5fceb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f76730 0x563641f8a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:07.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.078+0000 7f58a5fceb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f775d0 0x563641f7d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:07.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.078+0000 7f58a5fceb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563641d498d0 con 0x563641f75dd0 2023-10-16T13:13:07.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.078+0000 7f58a5fceb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563641f7e720 con 0x563641f775d0 2023-10-16T13:13:07.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.078+0000 7f58a5fceb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563641f45bf0 con 0x563641f76730 2023-10-16T13:13:07.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.078+0000 7f58937fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f75dd0 0x563641f72b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:07.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.078+0000 7f58937fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f75dd0 0x563641f72b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36672/0 (socket says 172.21.15.92:36672) 2023-10-16T13:13:07.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.078+0000 7f58937fe700 1 -- 172.21.15.92:0/2143747618 learned_addr learned my addr 172.21.15.92:0/2143747618 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:07.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.078+0000 7f5892ffd700 1 --2- 172.21.15.92:0/2143747618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f76730 0x563641f8a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:07.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.078+0000 7f5893fff700 1 --2- 172.21.15.92:0/2143747618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f775d0 0x563641f7d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:07.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.078+0000 7f58937fe700 1 -- 172.21.15.92:0/2143747618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f76730 msgr2=0x563641f8a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:07.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.078+0000 7f58937fe700 1 --2- 172.21.15.92:0/2143747618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f76730 0x563641f8a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.078+0000 7f58937fe700 1 -- 172.21.15.92:0/2143747618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f775d0 msgr2=0x563641f7d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:07.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.078+0000 7f58937fe700 1 --2- 172.21.15.92:0/2143747618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f775d0 0x563641f7d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.078+0000 7f58937fe700 1 -- 172.21.15.92:0/2143747618 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563641f93e60 con 0x563641f75dd0 2023-10-16T13:13:07.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.078+0000 7f58937fe700 1 --2- 172.21.15.92:0/2143747618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f75dd0 0x563641f72b90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f588400e720 tx=0x7f5884014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d56da20ccbb4678 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:07.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.079+0000 7f587a7fc700 1 -- 172.21.15.92:0/2143747618 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5884028520 con 0x563641f75dd0 2023-10-16T13:13:07.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.079+0000 7f587a7fc700 1 -- 172.21.15.92:0/2143747618 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5884028880 con 0x563641f75dd0 2023-10-16T13:13:07.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.079+0000 7f587a7fc700 1 -- 172.21.15.92:0/2143747618 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5884004c50 con 0x563641f75dd0 2023-10-16T13:13:07.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.079+0000 7f58a5fceb80 1 -- 172.21.15.92:0/2143747618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f75dd0 msgr2=0x563641f72b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:07.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.079+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/2143747618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f75dd0 0x563641f72b90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f588400e720 tx=0x7f5884014000 comp rx=0 tx=0).stop 2023-10-16T13:13:07.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.079+0000 7f58a5fceb80 1 -- 172.21.15.92:0/2143747618 shutdown_connections 2023-10-16T13:13:07.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.079+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/2143747618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f75dd0 0x563641f72b90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.079+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/2143747618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f775d0 0x563641f7d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.079+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/2143747618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f76730 0x563641f8a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.079+0000 7f58a5fceb80 1 -- 172.21.15.92:0/2143747618 >> 172.21.15.92:0/2143747618 conn(0x563641ea3d80 msgr2=0x563641f6f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:07.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.079+0000 7f58a5fceb80 1 -- 172.21.15.92:0/2143747618 shutdown_connections 2023-10-16T13:13:07.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.079+0000 7f58a5fceb80 1 -- 172.21.15.92:0/2143747618 wait complete. 2023-10-16T13:13:07.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.079+0000 7f58a5fceb80 1 -- start start 2023-10-16T13:13:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f58a5fceb80 1 Processor -- start 2023-10-16T13:13:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f58a5fceb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f75dd0 0x563641f7bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f58a5fceb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 0x563641f7c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f58a5fceb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f775d0 0x563641fe2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f58a5fceb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563641fe3180 con 0x563641f76730 2023-10-16T13:13:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f58a5fceb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563641fe32c0 con 0x563641f775d0 2023-10-16T13:13:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f58a5fceb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563641fe3450 con 0x563641f75dd0 2023-10-16T13:13:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f58a5fceb80 10 client.0 _ll_register_callbacks cb 0x7f58880999b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f5892ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 0x563641f7c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f5892ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 0x563641f7c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36680/0 (socket says 172.21.15.92:36680) 2023-10-16T13:13:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f5892ffd700 1 -- 172.21.15.92:0/579058614 learned_addr learned my addr 172.21.15.92:0/579058614 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f58937fe700 1 --2- 172.21.15.92:0/579058614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f75dd0 0x563641f7bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f5892ffd700 1 -- 172.21.15.92:0/579058614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f75dd0 msgr2=0x563641f7bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f5892ffd700 1 --2- 172.21.15.92:0/579058614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f75dd0 0x563641f7bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f5892ffd700 1 -- 172.21.15.92:0/579058614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f775d0 msgr2=0x563641fe2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f5893fff700 1 --2- 172.21.15.92:0/579058614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f775d0 0x563641fe2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f5892ffd700 1 --2- 172.21.15.92:0/579058614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f775d0 0x563641fe2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f5892ffd700 1 -- 172.21.15.92:0/579058614 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588400ecc0 con 0x563641f76730 2023-10-16T13:13:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f5893fff700 1 --2- 172.21.15.92:0/579058614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f775d0 0x563641fe2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f5892ffd700 1 --2- 172.21.15.92:0/579058614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 0x563641f7c410 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5888099fe0 tx=0x7f588809a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506aeafd7528fedd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.080+0000 7f5872ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.081+0000 7f5872ffd700 1 -- 172.21.15.92:0/579058614 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588800a5f0 con 0x563641f76730 2023-10-16T13:13:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.081+0000 7f5872ffd700 1 -- 172.21.15.92:0/579058614 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f588807e020 con 0x563641f76730 2023-10-16T13:13:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.081+0000 7f58a5fceb80 1 -- 172.21.15.92:0/579058614 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5888098190 con 0x563641f76730 2023-10-16T13:13:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.081+0000 7f5872ffd700 1 -- 172.21.15.92:0/579058614 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5888096200 con 0x563641f76730 2023-10-16T13:13:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.081+0000 7f58a5fceb80 10 client.15315 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.081+0000 7f58a5fceb80 1 -- 172.21.15.92:0/579058614 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563641cdcc10 con 0x563641f76730 2023-10-16T13:13:07.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.081+0000 7f5872ffd700 1 -- 172.21.15.92:0/579058614 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5888098190 con 0x563641f76730 2023-10-16T13:13:07.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.081+0000 7f5872ffd700 1 -- 172.21.15.92:0/579058614 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f58880ac080 con 0x563641f76730 2023-10-16T13:13:07.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.081+0000 7f58a5fceb80 10 client.15315 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:07.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.081+0000 7f58a5fceb80 10 client.15315 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-16T13:13:07.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.081+0000 7f58a5fceb80 20 client.15315 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:07.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.081+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/579058614 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563641fe81c0 0x563641fe46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:07.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.081+0000 7f58a5fceb80 4 client.15315 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:13:07.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.081+0000 7f58a5fceb80 1 -- 172.21.15.92:0/579058614 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563641ec1e00 con 0x563641fe81c0 2023-10-16T13:13:07.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.081+0000 7f58937fe700 1 --2- 172.21.15.92:0/579058614 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563641fe81c0 0x563641fe46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:07.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.082+0000 7f5872ffd700 10 client.15315 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:07.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.082+0000 7f58937fe700 1 --2- 172.21.15.92:0/579058614 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563641fe81c0 0x563641fe46a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=635d5d4f7fbe55a6 server_cookie=27cd9ab9379c109a in_seq=0 out_seq=0 2023-10-16T13:13:07.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.082+0000 7f5872ffd700 1 -- 172.21.15.92:0/579058614 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x563641ec1e00 con 0x563641fe81c0 2023-10-16T13:13:07.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.082+0000 7f5872ffd700 10 client.15315 handle_command_reply: tid=0 2023-10-16T13:13:07.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.082+0000 7f58a5fceb80 1 client.15315 shutdown 2023-10-16T13:13:07.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.082+0000 7f58a5fceb80 1 -- 172.21.15.92:0/579058614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 msgr2=0x563641f7c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:07.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.082+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/579058614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 0x563641f7c410 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5888099fe0 tx=0x7f588809a360 comp rx=0 tx=0).stop 2023-10-16T13:13:07.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.082+0000 7f58a5fceb80 1 -- 172.21.15.92:0/579058614 shutdown_connections 2023-10-16T13:13:07.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.082+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/579058614 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563641fe81c0 0x563641fe46a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.082+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/579058614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563641f775d0 0x563641fe2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.082+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/579058614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563641f75dd0 0x563641f7bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.082+0000 7f5872ffd700 0 client.15315 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:07.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.082+0000 7f58a5fceb80 1 --2- 172.21.15.92:0/579058614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563641f76730 0x563641f7c410 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.082+0000 7f58a5fceb80 1 -- 172.21.15.92:0/579058614 >> 172.21.15.92:0/579058614 conn(0x563641ea3d80 msgr2=0x563641f7d950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:07.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.083+0000 7f58a5fceb80 1 -- 172.21.15.92:0/579058614 shutdown_connections 2023-10-16T13:13:07.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.083+0000 7f58a5fceb80 1 -- 172.21.15.92:0/579058614 wait complete. 2023-10-16T13:13:07.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.083+0000 7f58a5fceb80 20 client.15315 trim_cache size 0 max 16384 2023-10-16T13:13:07.106 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:13:07.106 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "6c276d7e-6c24-11ee-8db6-212e2dc638e7", 2023-10-16T13:13:07.106 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 0, 2023-10-16T13:13:07.106 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24491, 2023-10-16T13:13:07.107 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2023-10-16T13:13:07.107 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2023-10-16T13:13:07.107 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2023-10-16T13:13:07.107 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 85.785897614000007, 2023-10-16T13:13:07.107 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2023-10-16T13:13:07.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 85, 2023-10-16T13:13:07.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2023-10-16T13:13:07.108 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 93.610314243999994 2023-10-16T13:13:07.108 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:13:07.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.083+0000 7f5899de4700 1 -- 172.21.15.92:0/881672227 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f587c0a14d0 msgr2=0x7f587c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:07.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.083+0000 7f5899de4700 1 --2- 172.21.15.92:0/881672227 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f587c0a14d0 0x7f587c0a3990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5884005fd0 tx=0x7f5884005f60 comp rx=0 tx=0).stop 2023-10-16T13:13:07.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.083+0000 7f5899de4700 1 -- 172.21.15.92:0/881672227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5894104280 msgr2=0x7f58941971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:07.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.083+0000 7f5899de4700 1 --2- 172.21.15.92:0/881672227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5894104280 0x7f58941971d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f588800c9b0 tx=0x7f588800cd70 comp rx=0 tx=0).stop 2023-10-16T13:13:07.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.083+0000 7f5899de4700 1 -- 172.21.15.92:0/881672227 shutdown_connections 2023-10-16T13:13:07.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.083+0000 7f5899de4700 1 --2- 172.21.15.92:0/881672227 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f587c0a14d0 0x7f587c0a3990 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.083+0000 7f5899de4700 1 --2- 172.21.15.92:0/881672227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5894106bb0 0x7f589419e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.083+0000 7f5899de4700 1 --2- 172.21.15.92:0/881672227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5894101950 0x7f5894196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.083+0000 7f5899de4700 1 --2- 172.21.15.92:0/881672227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5894104280 0x7f58941971d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:07.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.083+0000 7f5899de4700 1 -- 172.21.15.92:0/881672227 >> 172.21.15.92:0/881672227 conn(0x7f58940fb340 msgr2=0x7f58941025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:07.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.083+0000 7f5899de4700 1 -- 172.21.15.92:0/881672227 shutdown_connections 2023-10-16T13:13:07.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:07.083+0000 7f5899de4700 1 -- 172.21.15.92:0/881672227 wait complete. 2023-10-16T13:13:07.114 INFO:teuthology.run_tasks:Running task kclient... 2023-10-16T13:13:07.137 INFO:tasks.kclient:Mounting kernel clients... 2023-10-16T13:13:07.138 INFO:tasks.kclient:config is {'client.0': {}} 2023-10-16T13:13:07.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:13:07.139 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-10-16T13:13:07.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:13:07.157 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2023-10-16T13:13:07.225 INFO:teuthology.orchestra.run.smithi092.stderr:Cannot find device "ceph-brx" 2023-10-16T13:13:07.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:13:07.227 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync'], 'rbytes': False, 'syntax': 'v1', 'mount_subvol_num': 1} 2023-10-16T13:13:07.227 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T13:13:07.227 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T13:13:07.228 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph fs ls 2023-10-16T13:13:07.823 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:13:08.626 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:08 smithi092 ceph-mon[99542]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-16T13:13:08.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:08 smithi152 ceph-mon[104423]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-16T13:13:09.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:08 smithi118 ceph-mon[103969]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-16T13:13:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.178+0000 7f219c318700 1 -- 172.21.15.92:0/2433660300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2194105e70 msgr2=0x7f2194106250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.178+0000 7f219c318700 1 --2- 172.21.15.92:0/2433660300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2194105e70 0x7f2194106250 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f21840099c0 tx=0x7f2184009cd0 comp rx=0 tx=0).stop 2023-10-16T13:13:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.178+0000 7f219c318700 1 -- 172.21.15.92:0/2433660300 shutdown_connections 2023-10-16T13:13:09.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.178+0000 7f219c318700 1 --2- 172.21.15.92:0/2433660300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2194105e70 0x7f2194106250 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:09.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.178+0000 7f219c318700 1 --2- 172.21.15.92:0/2433660300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2194100820 0x7f219410cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:09.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.178+0000 7f219c318700 1 --2- 172.21.15.92:0/2433660300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21940ffe60 0x7f21941002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:09.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.178+0000 7f219c318700 1 -- 172.21.15.92:0/2433660300 >> 172.21.15.92:0/2433660300 conn(0x7f2194075e00 msgr2=0x7f2194076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:09.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.178+0000 7f219c318700 1 -- 172.21.15.92:0/2433660300 shutdown_connections 2023-10-16T13:13:09.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.178+0000 7f219c318700 1 -- 172.21.15.92:0/2433660300 wait complete. 2023-10-16T13:13:09.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.179+0000 7f219c318700 1 Processor -- start 2023-10-16T13:13:09.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.179+0000 7f219c318700 1 -- start start 2023-10-16T13:13:09.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.179+0000 7f219c318700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21940ffe60 0x7f2194197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:09.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.179+0000 7f219c318700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2194100820 0x7f2194198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:09.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.179+0000 7f219c318700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2194105e70 0x7f21941a2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:09.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.179+0000 7f219c318700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2194198d90 con 0x7f2194100820 2023-10-16T13:13:09.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.179+0000 7f219c318700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21941a3500 con 0x7f21940ffe60 2023-10-16T13:13:09.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.179+0000 7f219c318700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21941a3670 con 0x7f2194105e70 2023-10-16T13:13:09.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.179+0000 7f21998b3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2194100820 0x7f2194198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:09.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.179+0000 7f21998b3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2194100820 0x7f2194198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36694/0 (socket says 172.21.15.92:36694) 2023-10-16T13:13:09.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.179+0000 7f21998b3700 1 -- 172.21.15.92:0/217540755 learned_addr learned my addr 172.21.15.92:0/217540755 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:09.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.179+0000 7f219a0b4700 1 --2- 172.21.15.92:0/217540755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21940ffe60 0x7f2194197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:09.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.180+0000 7f219a8b5700 1 --2- 172.21.15.92:0/217540755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2194105e70 0x7f21941a2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:09.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.180+0000 7f21998b3700 1 -- 172.21.15.92:0/217540755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2194105e70 msgr2=0x7f21941a2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:09.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.180+0000 7f21998b3700 1 --2- 172.21.15.92:0/217540755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2194105e70 0x7f21941a2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:09.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.180+0000 7f21998b3700 1 -- 172.21.15.92:0/217540755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21940ffe60 msgr2=0x7f2194197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:09.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.180+0000 7f21998b3700 1 --2- 172.21.15.92:0/217540755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21940ffe60 0x7f2194197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:09.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.180+0000 7f21998b3700 1 -- 172.21.15.92:0/217540755 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21840095f0 con 0x7f2194100820 2023-10-16T13:13:09.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.180+0000 7f21998b3700 1 --2- 172.21.15.92:0/217540755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2194100820 0x7f2194198480 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f219000b530 tx=0x7f219000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:09.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.180+0000 7f218b7fe700 1 -- 172.21.15.92:0/217540755 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2190011830 con 0x7f2194100820 2023-10-16T13:13:09.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.180+0000 7f218b7fe700 1 -- 172.21.15.92:0/217540755 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2190011e70 con 0x7f2194100820 2023-10-16T13:13:09.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.180+0000 7f219c318700 1 -- 172.21.15.92:0/217540755 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21941a3950 con 0x7f2194100820 2023-10-16T13:13:09.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.180+0000 7f218b7fe700 1 -- 172.21.15.92:0/217540755 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219000f340 con 0x7f2194100820 2023-10-16T13:13:09.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.180+0000 7f219c318700 1 -- 172.21.15.92:0/217540755 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21941a3ed0 con 0x7f2194100820 2023-10-16T13:13:09.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.181+0000 7f219c318700 1 -- 172.21.15.92:0/217540755 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f219404ebb0 con 0x7f2194100820 2023-10-16T13:13:09.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.182+0000 7f218b7fe700 1 -- 172.21.15.92:0/217540755 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f21900106d0 con 0x7f2194100820 2023-10-16T13:13:09.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.182+0000 7f218b7fe700 1 --2- 172.21.15.92:0/217540755 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f21800a1480 0x7f21800a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:09.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.183+0000 7f219a0b4700 1 --2- 172.21.15.92:0/217540755 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f21800a1480 0x7f21800a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:09.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.183+0000 7f218b7fe700 1 -- 172.21.15.92:0/217540755 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f21900cc830 con 0x7f2194100820 2023-10-16T13:13:09.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.183+0000 7f219a0b4700 1 --2- 172.21.15.92:0/217540755 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f21800a1480 0x7f21800a3940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2184009990 tx=0x7f2184003760 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:09.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.187+0000 7f218b7fe700 1 -- 172.21.15.92:0/217540755 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2190095e90 con 0x7f2194100820 2023-10-16T13:13:09.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.419+0000 7f219c318700 1 -- 172.21.15.92:0/217540755 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2194068f90 con 0x7f2194100820 2023-10-16T13:13:09.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.420+0000 7f218b7fe700 1 -- 172.21.15.92:0/217540755 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7f21900994b0 con 0x7f2194100820 2023-10-16T13:13:09.423 INFO:teuthology.orchestra.run.smithi092.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:13:09.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.422+0000 7f219c318700 1 -- 172.21.15.92:0/217540755 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f21800a1480 msgr2=0x7f21800a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:09.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.422+0000 7f219c318700 1 --2- 172.21.15.92:0/217540755 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f21800a1480 0x7f21800a3940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2184009990 tx=0x7f2184003760 comp rx=0 tx=0).stop 2023-10-16T13:13:09.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.422+0000 7f219c318700 1 -- 172.21.15.92:0/217540755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2194100820 msgr2=0x7f2194198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:09.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.422+0000 7f219c318700 1 --2- 172.21.15.92:0/217540755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2194100820 0x7f2194198480 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f219000b530 tx=0x7f219000b840 comp rx=0 tx=0).stop 2023-10-16T13:13:09.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.422+0000 7f219c318700 1 -- 172.21.15.92:0/217540755 shutdown_connections 2023-10-16T13:13:09.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.422+0000 7f219c318700 1 --2- 172.21.15.92:0/217540755 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f21800a1480 0x7f21800a3940 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:09.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.422+0000 7f219c318700 1 --2- 172.21.15.92:0/217540755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2194105e70 0x7f21941a2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:09.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.422+0000 7f219c318700 1 --2- 172.21.15.92:0/217540755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21940ffe60 0x7f2194197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:09.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.422+0000 7f219c318700 1 --2- 172.21.15.92:0/217540755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2194100820 0x7f2194198480 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:09.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.422+0000 7f219c318700 1 -- 172.21.15.92:0/217540755 >> 172.21.15.92:0/217540755 conn(0x7f2194075e00 msgr2=0x7f2194103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:09.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.422+0000 7f219c318700 1 -- 172.21.15.92:0/217540755 shutdown_connections 2023-10-16T13:13:09.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:09.422+0000 7f219c318700 1 -- 172.21.15.92:0/217540755 wait complete. 2023-10-16T13:13:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:09 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/217540755' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-16T13:13:09.881 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T13:13:09.882 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:13:09.882 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2023-10-16T13:13:09.882 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T13:13:09.883 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T13:13:09.883 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T13:13:09.883 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T13:13:09.883 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:13:09.884 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:13:09.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:13:09.884 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2023-10-16T13:13:09.903 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:13:09.903 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:13:09.903 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:13:09.904 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:13:09.904 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2023-10-16T13:13:09.904 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:13:09.904 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:13:09.904 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:13:09.905 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:13:09.905 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:13:09.905 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:13:09.905 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:13:09.905 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:13:09.906 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:13:09.906 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T13:13:09.906 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 41785sec preferred_lft 41785sec 2023-10-16T13:13:09.906 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::1f37:ebd:1c03:1568/64 scope link noprefixroute 2023-10-16T13:13:09.906 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:13:09.907 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T13:13:09.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:13:09.908 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-16T13:13:09.908 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-16T13:13:09.908 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add name ceph-brx type bridge 2023-10-16T13:13:09.908 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr flush dev ceph-brx 2023-10-16T13:13:09.909 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set ceph-brx up 2023-10-16T13:13:09.909 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T13:13:09.909 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-16T13:13:09.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:09 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/217540755' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-16T13:13:10.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:09 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/217540755' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-16T13:13:10.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:13:10.102 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:13:10.130 INFO:teuthology.orchestra.run.smithi092.stdout:1 2023-10-16T13:13:10.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:13:10.131 DEBUG:teuthology.orchestra.run.smithi092:> route 2023-10-16T13:13:10.207 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2023-10-16T13:13:10.208 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:13:10.208 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T13:13:10.208 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T13:13:10.208 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:13:10.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:13:10.209 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-16T13:13:10.210 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-16T13:13:10.210 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T13:13:10.210 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T13:13:10.211 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T13:13:10.211 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-16T13:13:10.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:13:10.483 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-10-16T13:13:10.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:13:10.501 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list-id 2023-10-16T13:13:10.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:13:10.557 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-16T13:13:10.558 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-16T13:13:10.558 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T13:13:10.558 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-16T13:13:10.559 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-16T13:13:10.637 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:10 smithi092 ceph-mon[99542]: pgmap v302: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2023-10-16T13:13:10.652 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-16T13:13:10.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:13:10.653 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-16T13:13:10.654 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-16T13:13:10.654 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-16T13:13:10.654 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T13:13:10.655 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-16T13:13:10.655 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-16T13:13:10.655 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-16T13:13:10.655 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-16T13:13:10.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:13:10.892 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-16T13:13:10.893 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-16T13:13:10.893 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2023-10-16T13:13:10.893 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T13:13:10.894 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-16T13:13:10.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:10 smithi152 ceph-mon[104423]: pgmap v302: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2023-10-16T13:13:10.991 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:13:10.991 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T13:13:11.008 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:13:11.008 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:13:11.009 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:13:11.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:10 smithi118 ceph-mon[103969]: pgmap v302: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2023-10-16T13:13:11.066 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2023-10-16T13:13:11.066 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2023-10-16T13:13:11.067 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927 2023-10-16T13:13:11.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:13:11.067 DEBUG:teuthology.orchestra.run.smithi092:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2023-10-16T13:13:11.167 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2023-10-16T13:13:11.167 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2023-10-16T13:13:11.168 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-10-16T13:13:11.301 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2023-10-16T13:13:11.301 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2023-10-16T13:13:11.301 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-10-16T13:13:11.302 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.92:3300,172.21.15.118:3300,172.21.15.152:3300" 2023-10-16T13:13:11.302 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.92:3300,172.21.15.118:3300,172.21.15.152:3300:/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927 2023-10-16T13:13:11.302 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,key=0,fsid=6c276d7e-6c24-11ee-8db6-212e2dc638e7" will pass to kernel 2023-10-16T13:13:11.303 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:13:11.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:13:11.304 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:13:11.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:13:11.357 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:13:11.389 INFO:teuthology.orchestra.run.smithi092.stdout:client15324 2023-10-16T13:13:11.390 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T13:13:11.390 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:13:11.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:13:11.448 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:13:11.520 INFO:teuthology.orchestra.run.smithi092.stdout:client15324 2023-10-16T13:13:11.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:13:11.521 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:13:11.593 INFO:teuthology.orchestra.run.smithi092.stdout:client15324 2023-10-16T13:13:11.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:13:11.594 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7.client15324/status') 2023-10-16T13:13:11.675 INFO:teuthology.orchestra.run.smithi092.stdout:instance: client.15324 (3)192.168.0.1:0/2905261975 2023-10-16T13:13:11.675 INFO:teuthology.orchestra.run.smithi092.stdout:blocklisted: false 2023-10-16T13:13:11.676 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records in 2023-10-16T13:13:11.676 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records out 2023-10-16T13:13:11.676 INFO:teuthology.orchestra.run.smithi092.stderr:70 bytes copied, 2.3126e-05 s, 3.0 MB/s 2023-10-16T13:13:11.677 INFO:teuthology.run_tasks:Running task check-counter... 2023-10-16T13:13:11.688 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-10-16T13:13:11.698 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:13:11.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.835+0000 7faf5730f700 1 -- 172.21.15.92:0/2194263540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf50101930 msgr2=0x7faf50108250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:11.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.835+0000 7faf5730f700 1 --2- 172.21.15.92:0/2194263540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf50101930 0x7faf50108250 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7faf4800b0a0 tx=0x7faf4800b3b0 comp rx=0 tx=0).stop 2023-10-16T13:13:11.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.835+0000 7faf5730f700 1 -- 172.21.15.92:0/2194263540 shutdown_connections 2023-10-16T13:13:11.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.835+0000 7faf5730f700 1 --2- 172.21.15.92:0/2194263540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf50101930 0x7faf50108250 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:11.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.835+0000 7faf5730f700 1 --2- 172.21.15.92:0/2194263540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf500ffe20 0x7faf50100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:11.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.835+0000 7faf5730f700 1 --2- 172.21.15.92:0/2194263540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf50100f70 0x7faf501013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:11.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.835+0000 7faf5730f700 1 -- 172.21.15.92:0/2194263540 >> 172.21.15.92:0/2194263540 conn(0x7faf500fb370 msgr2=0x7faf500fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:11.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.836+0000 7faf5730f700 1 -- 172.21.15.92:0/2194263540 shutdown_connections 2023-10-16T13:13:11.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.836+0000 7faf5730f700 1 -- 172.21.15.92:0/2194263540 wait complete. 2023-10-16T13:13:11.843 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.836+0000 7faf5730f700 1 Processor -- start 2023-10-16T13:13:11.843 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.836+0000 7faf5730f700 1 -- start start 2023-10-16T13:13:11.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf5730f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf500ffe20 0x7faf50195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:11.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf5730f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf50100f70 0x7faf501960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:11.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf5730f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf50101930 0x7faf5019d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:11.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf5730f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5019d710 con 0x7faf500ffe20 2023-10-16T13:13:11.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf5730f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5019d850 con 0x7faf50101930 2023-10-16T13:13:11.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf5730f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5019d9e0 con 0x7faf50100f70 2023-10-16T13:13:11.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf550ab700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf500ffe20 0x7faf50195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:11.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf550ab700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf500ffe20 0x7faf50195b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36712/0 (socket says 172.21.15.92:36712) 2023-10-16T13:13:11.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf550ab700 1 -- 172.21.15.92:0/3501850507 learned_addr learned my addr 172.21.15.92:0/3501850507 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:11.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf558ac700 1 --2- 172.21.15.92:0/3501850507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf50101930 0x7faf5019d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:11.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf548aa700 1 --2- 172.21.15.92:0/3501850507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf50100f70 0x7faf501960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:11.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf550ab700 1 -- 172.21.15.92:0/3501850507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf50100f70 msgr2=0x7faf501960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:11.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf550ab700 1 --2- 172.21.15.92:0/3501850507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf50100f70 0x7faf501960d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:11.847 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf550ab700 1 -- 172.21.15.92:0/3501850507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf50101930 msgr2=0x7faf5019d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:11.847 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf550ab700 1 --2- 172.21.15.92:0/3501850507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf50101930 0x7faf5019d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:11.847 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf550ab700 1 -- 172.21.15.92:0/3501850507 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf48009d00 con 0x7faf500ffe20 2023-10-16T13:13:11.847 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf550ab700 1 --2- 172.21.15.92:0/3501850507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf500ffe20 0x7faf50195b90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7faf4000d950 tx=0x7faf4000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:11.847 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf467fc700 1 -- 172.21.15.92:0/3501850507 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4000f890 con 0x7faf500ffe20 2023-10-16T13:13:11.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf467fc700 1 -- 172.21.15.92:0/3501850507 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faf40010460 con 0x7faf500ffe20 2023-10-16T13:13:11.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf5730f700 1 -- 172.21.15.92:0/3501850507 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5019dcc0 con 0x7faf500ffe20 2023-10-16T13:13:11.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf467fc700 1 -- 172.21.15.92:0/3501850507 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4000e610 con 0x7faf500ffe20 2023-10-16T13:13:11.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.837+0000 7faf5730f700 1 -- 172.21.15.92:0/3501850507 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5019e1d0 con 0x7faf500ffe20 2023-10-16T13:13:11.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.838+0000 7faf5730f700 1 -- 172.21.15.92:0/3501850507 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5010b7c0 con 0x7faf500ffe20 2023-10-16T13:13:11.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.839+0000 7faf467fc700 1 -- 172.21.15.92:0/3501850507 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7faf40010960 con 0x7faf500ffe20 2023-10-16T13:13:11.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.840+0000 7faf467fc700 1 --2- 172.21.15.92:0/3501850507 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faf3c0a15a0 0x7faf3c0a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:11.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.840+0000 7faf548aa700 1 --2- 172.21.15.92:0/3501850507 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faf3c0a15a0 0x7faf3c0a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:11.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.840+0000 7faf467fc700 1 -- 172.21.15.92:0/3501850507 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7faf400cca00 con 0x7faf500ffe20 2023-10-16T13:13:11.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.840+0000 7faf548aa700 1 --2- 172.21.15.92:0/3501850507 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faf3c0a15a0 0x7faf3c0a3a60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf4c004630 tx=0x7faf4c00b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:11.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:11.843+0000 7faf467fc700 1 -- 172.21.15.92:0/3501850507 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faf40096060 con 0x7faf500ffe20 2023-10-16T13:13:12.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.037+0000 7faf5730f700 1 -- 172.21.15.92:0/3501850507 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf50106b00 con 0x7faf500ffe20 2023-10-16T13:13:12.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.039+0000 7faf467fc700 1 -- 172.21.15.92:0/3501850507 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22598 (secure 0 0 0) 0x7faf40020090 con 0x7faf500ffe20 2023-10-16T13:13:12.042 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:13:12.042 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":85,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:12:36.335213+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:11:38.345035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:11:39.549912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:13:12.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.041+0000 7faf5730f700 1 -- 172.21.15.92:0/3501850507 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faf3c0a15a0 msgr2=0x7faf3c0a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:12.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.041+0000 7faf5730f700 1 --2- 172.21.15.92:0/3501850507 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faf3c0a15a0 0x7faf3c0a3a60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf4c004630 tx=0x7faf4c00b3c0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.041+0000 7faf5730f700 1 -- 172.21.15.92:0/3501850507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf500ffe20 msgr2=0x7faf50195b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:12.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.041+0000 7faf5730f700 1 --2- 172.21.15.92:0/3501850507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf500ffe20 0x7faf50195b90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7faf4000d950 tx=0x7faf4000dc60 comp rx=0 tx=0).stop 2023-10-16T13:13:12.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.041+0000 7faf5730f700 1 -- 172.21.15.92:0/3501850507 shutdown_connections 2023-10-16T13:13:12.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.041+0000 7faf5730f700 1 --2- 172.21.15.92:0/3501850507 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faf3c0a15a0 0x7faf3c0a3a60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.041+0000 7faf5730f700 1 --2- 172.21.15.92:0/3501850507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf500ffe20 0x7faf50195b90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.041+0000 7faf5730f700 1 --2- 172.21.15.92:0/3501850507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf50101930 0x7faf5019d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.041+0000 7faf5730f700 1 --2- 172.21.15.92:0/3501850507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf50100f70 0x7faf501960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.041+0000 7faf5730f700 1 -- 172.21.15.92:0/3501850507 >> 172.21.15.92:0/3501850507 conn(0x7faf500fb370 msgr2=0x7faf500fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:12.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.041+0000 7faf5730f700 1 -- 172.21.15.92:0/3501850507 shutdown_connections 2023-10-16T13:13:12.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.041+0000 7faf5730f700 1 -- 172.21.15.92:0/3501850507 wait complete. 2023-10-16T13:13:12.056 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:07:45.516334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:11:38.345035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:11:39.549912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:13:12.057 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:13:12.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.180+0000 7f6e7ffff700 1 -- 172.21.15.92:0/1095325074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e780ffa10 msgr2=0x7f6e780ffe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:12.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.180+0000 7f6e7ffff700 1 --2- 172.21.15.92:0/1095325074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e780ffa10 0x7f6e780ffe70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009990 tx=0x7f6e74009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.180+0000 7f6e7ffff700 1 -- 172.21.15.92:0/1095325074 shutdown_connections 2023-10-16T13:13:12.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.180+0000 7f6e7ffff700 1 --2- 172.21.15.92:0/1095325074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e781003b0 0x7f6e78108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.180+0000 7f6e7ffff700 1 --2- 172.21.15.92:0/1095325074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e781014e0 0x7f6e78101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.180+0000 7f6e7ffff700 1 --2- 172.21.15.92:0/1095325074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e780ffa10 0x7f6e780ffe70 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.180+0000 7f6e7ffff700 1 -- 172.21.15.92:0/1095325074 >> 172.21.15.92:0/1095325074 conn(0x7f6e780fb330 msgr2=0x7f6e780fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:12.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.180+0000 7f6e7ffff700 1 -- 172.21.15.92:0/1095325074 shutdown_connections 2023-10-16T13:13:12.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.180+0000 7f6e7ffff700 1 -- 172.21.15.92:0/1095325074 wait complete. 2023-10-16T13:13:12.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7ffff700 1 Processor -- start 2023-10-16T13:13:12.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7ffff700 1 -- start start 2023-10-16T13:13:12.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e780ffa10 0x7f6e78195cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:12.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e781003b0 0x7f6e78196200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:12.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e781014e0 0x7f6e7819d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:12.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7ffff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7819d830 con 0x7f6e780ffa10 2023-10-16T13:13:12.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7ffff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7819d9a0 con 0x7f6e781014e0 2023-10-16T13:13:12.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7ffff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7819db60 con 0x7f6e781003b0 2023-10-16T13:13:12.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e780ffa10 0x7f6e78195cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:12.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e780ffa10 0x7f6e78195cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36728/0 (socket says 172.21.15.92:36728) 2023-10-16T13:13:12.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7dd9b700 1 -- 172.21.15.92:0/2536720754 learned_addr learned my addr 172.21.15.92:0/2536720754 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:12.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7e59c700 1 --2- 172.21.15.92:0/2536720754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e781014e0 0x7f6e7819d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:12.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7dd9b700 1 -- 172.21.15.92:0/2536720754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e781003b0 msgr2=0x7f6e78196200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:12.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7d59a700 1 --2- 172.21.15.92:0/2536720754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e781003b0 0x7f6e78196200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:12.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7dd9b700 1 --2- 172.21.15.92:0/2536720754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e781003b0 0x7f6e78196200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7dd9b700 1 -- 172.21.15.92:0/2536720754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e781014e0 msgr2=0x7f6e7819d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:12.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7dd9b700 1 --2- 172.21.15.92:0/2536720754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e781014e0 0x7f6e7819d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7dd9b700 1 -- 172.21.15.92:0/2536720754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e740095f0 con 0x7f6e780ffa10 2023-10-16T13:13:12.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7d59a700 1 --2- 172.21.15.92:0/2536720754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e781003b0 0x7f6e78196200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:12.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.181+0000 7f6e7dd9b700 1 --2- 172.21.15.92:0/2536720754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e780ffa10 0x7f6e78195cc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6e6800d980 tx=0x7f6e6800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:12.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.182+0000 7f6e6effd700 1 -- 172.21.15.92:0/2536720754 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6800de60 con 0x7f6e780ffa10 2023-10-16T13:13:12.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.182+0000 7f6e6effd700 1 -- 172.21.15.92:0/2536720754 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6e68004500 con 0x7f6e780ffa10 2023-10-16T13:13:12.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.182+0000 7f6e7ffff700 1 -- 172.21.15.92:0/2536720754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e78069160 con 0x7f6e780ffa10 2023-10-16T13:13:12.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.182+0000 7f6e6effd700 1 -- 172.21.15.92:0/2536720754 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e68003ce0 con 0x7f6e780ffa10 2023-10-16T13:13:12.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.182+0000 7f6e7ffff700 1 -- 172.21.15.92:0/2536720754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e780696c0 con 0x7f6e780ffa10 2023-10-16T13:13:12.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.183+0000 7f6e7ffff700 1 -- 172.21.15.92:0/2536720754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7810b860 con 0x7f6e780ffa10 2023-10-16T13:13:12.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.184+0000 7f6e6effd700 1 -- 172.21.15.92:0/2536720754 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6e68009cb0 con 0x7f6e780ffa10 2023-10-16T13:13:12.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.185+0000 7f6e6effd700 1 --2- 172.21.15.92:0/2536720754 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6e640a1500 0x7f6e640a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:12.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.185+0000 7f6e6effd700 1 -- 172.21.15.92:0/2536720754 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6e680ccd20 con 0x7f6e780ffa10 2023-10-16T13:13:12.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.185+0000 7f6e7d59a700 1 --2- 172.21.15.92:0/2536720754 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6e640a1500 0x7f6e640a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:12.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.185+0000 7f6e7d59a700 1 --2- 172.21.15.92:0/2536720754 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6e640a1500 0x7f6e640a39c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6e740095c0 tx=0x7f6e74009510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:12.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.188+0000 7f6e6effd700 1 -- 172.21.15.92:0/2536720754 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6e680963c0 con 0x7f6e780ffa10 2023-10-16T13:13:12.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.381+0000 7f6e7ffff700 1 -- 172.21.15.92:0/2536720754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e78069af0 con 0x7f6e780ffa10 2023-10-16T13:13:12.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.382+0000 7f6e6effd700 1 -- 172.21.15.92:0/2536720754 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e68009940 con 0x7f6e780ffa10 2023-10-16T13:13:12.385 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-10-16T13:13:12.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.384+0000 7f6e7ffff700 1 -- 172.21.15.92:0/2536720754 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6e640a1500 msgr2=0x7f6e640a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:12.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.384+0000 7f6e7ffff700 1 --2- 172.21.15.92:0/2536720754 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6e640a1500 0x7f6e640a39c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6e740095c0 tx=0x7f6e74009510 comp rx=0 tx=0).stop 2023-10-16T13:13:12.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.384+0000 7f6e7ffff700 1 -- 172.21.15.92:0/2536720754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e780ffa10 msgr2=0x7f6e78195cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:12.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.384+0000 7f6e7ffff700 1 --2- 172.21.15.92:0/2536720754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e780ffa10 0x7f6e78195cc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6e6800d980 tx=0x7f6e6800dd40 comp rx=0 tx=0).stop 2023-10-16T13:13:12.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.384+0000 7f6e7ffff700 1 -- 172.21.15.92:0/2536720754 shutdown_connections 2023-10-16T13:13:12.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.384+0000 7f6e7ffff700 1 --2- 172.21.15.92:0/2536720754 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6e640a1500 0x7f6e640a39c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.384+0000 7f6e7ffff700 1 --2- 172.21.15.92:0/2536720754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e780ffa10 0x7f6e78195cc0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.384+0000 7f6e7ffff700 1 --2- 172.21.15.92:0/2536720754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e781014e0 0x7f6e7819d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.384+0000 7f6e7ffff700 1 --2- 172.21.15.92:0/2536720754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e781003b0 0x7f6e78196200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.384+0000 7f6e7ffff700 1 -- 172.21.15.92:0/2536720754 >> 172.21.15.92:0/2536720754 conn(0x7f6e780fb330 msgr2=0x7f6e780fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:12.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.384+0000 7f6e7ffff700 1 -- 172.21.15.92:0/2536720754 shutdown_connections 2023-10-16T13:13:12.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.384+0000 7f6e7ffff700 1 -- 172.21.15.92:0/2536720754 wait complete. 2023-10-16T13:13:12.399 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:13:12.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.522+0000 7fe85814e700 1 -- 172.21.15.92:0/3167943966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe850100e90 msgr2=0x7fe8501012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:12.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.522+0000 7fe85814e700 1 --2- 172.21.15.92:0/3167943966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe850100e90 0x7fe8501012b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe84c009990 tx=0x7fe84c009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.522+0000 7fe85814e700 1 -- 172.21.15.92:0/3167943966 shutdown_connections 2023-10-16T13:13:12.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.522+0000 7fe85814e700 1 --2- 172.21.15.92:0/3167943966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe850100e90 0x7fe8501012b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.522+0000 7fe85814e700 1 --2- 172.21.15.92:0/3167943966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe850102a30 0x7fe850109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.522+0000 7fe85814e700 1 --2- 172.21.15.92:0/3167943966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe850102070 0x7fe8501024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.522+0000 7fe85814e700 1 -- 172.21.15.92:0/3167943966 >> 172.21.15.92:0/3167943966 conn(0x7fe8500fc490 msgr2=0x7fe8500fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:12.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.522+0000 7fe85814e700 1 -- 172.21.15.92:0/3167943966 shutdown_connections 2023-10-16T13:13:12.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.522+0000 7fe85814e700 1 -- 172.21.15.92:0/3167943966 wait complete. 2023-10-16T13:13:12.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.522+0000 7fe85814e700 1 Processor -- start 2023-10-16T13:13:12.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.522+0000 7fe85814e700 1 -- start start 2023-10-16T13:13:12.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.522+0000 7fe85814e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe850100e90 0x7fe850196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:12.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.522+0000 7fe85814e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe850102070 0x7fe850197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:12.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.522+0000 7fe85814e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe850102a30 0x7fe85019e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:12.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.522+0000 7fe85814e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85019e890 con 0x7fe850102a30 2023-10-16T13:13:12.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.522+0000 7fe85814e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85019ea00 con 0x7fe850102070 2023-10-16T13:13:12.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.522+0000 7fe85814e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85019ebc0 con 0x7fe850100e90 2023-10-16T13:13:12.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.523+0000 7fe8566eb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe850102a30 0x7fe85019e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:12.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.523+0000 7fe8566eb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe850102a30 0x7fe85019e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36746/0 (socket says 172.21.15.92:36746) 2023-10-16T13:13:12.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.523+0000 7fe8566eb700 1 -- 172.21.15.92:0/3466104641 learned_addr learned my addr 172.21.15.92:0/3466104641 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:12.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.523+0000 7fe855eea700 1 --2- 172.21.15.92:0/3466104641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe850100e90 0x7fe850196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:12.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.523+0000 7fe8556e9700 1 --2- 172.21.15.92:0/3466104641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe850102070 0x7fe850197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:12.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.523+0000 7fe8566eb700 1 -- 172.21.15.92:0/3466104641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe850100e90 msgr2=0x7fe850196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:12.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.523+0000 7fe8566eb700 1 --2- 172.21.15.92:0/3466104641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe850100e90 0x7fe850196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.523+0000 7fe8566eb700 1 -- 172.21.15.92:0/3466104641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe850102070 msgr2=0x7fe850197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:12.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.523+0000 7fe8566eb700 1 --2- 172.21.15.92:0/3466104641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe850102070 0x7fe850197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.523+0000 7fe8566eb700 1 -- 172.21.15.92:0/3466104641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c0095f0 con 0x7fe850102a30 2023-10-16T13:13:12.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.523+0000 7fe8556e9700 1 --2- 172.21.15.92:0/3466104641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe850102070 0x7fe850197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:12.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.523+0000 7fe8566eb700 1 --2- 172.21.15.92:0/3466104641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe850102a30 0x7fe85019e2c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe848007ee0 tx=0x7fe84800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:12.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.523+0000 7fe846ffd700 1 -- 172.21.15.92:0/3466104641 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848017070 con 0x7fe850102a30 2023-10-16T13:13:12.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.523+0000 7fe846ffd700 1 -- 172.21.15.92:0/3466104641 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe84800f040 con 0x7fe850102a30 2023-10-16T13:13:12.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.523+0000 7fe85814e700 1 -- 172.21.15.92:0/3466104641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85019eea0 con 0x7fe850102a30 2023-10-16T13:13:12.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.523+0000 7fe846ffd700 1 -- 172.21.15.92:0/3466104641 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848005760 con 0x7fe850102a30 2023-10-16T13:13:12.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.523+0000 7fe85814e700 1 -- 172.21.15.92:0/3466104641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85019f2c0 con 0x7fe850102a30 2023-10-16T13:13:12.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.524+0000 7fe85814e700 1 -- 172.21.15.92:0/3466104641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8501084a0 con 0x7fe850102a30 2023-10-16T13:13:12.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.525+0000 7fe846ffd700 1 -- 172.21.15.92:0/3466104641 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe8480058c0 con 0x7fe850102a30 2023-10-16T13:13:12.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.526+0000 7fe846ffd700 1 --2- 172.21.15.92:0/3466104641 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe83c0a1500 0x7fe83c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:12.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.526+0000 7fe846ffd700 1 -- 172.21.15.92:0/3466104641 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe8480cca40 con 0x7fe850102a30 2023-10-16T13:13:12.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.526+0000 7fe855eea700 1 --2- 172.21.15.92:0/3466104641 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe83c0a1500 0x7fe83c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:12.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.526+0000 7fe855eea700 1 --2- 172.21.15.92:0/3466104641 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe83c0a1500 0x7fe83c0a39c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe850198220 tx=0x7fe84c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:12.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.529+0000 7fe846ffd700 1 -- 172.21.15.92:0/3466104641 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe8480960a0 con 0x7fe850102a30 2023-10-16T13:13:12.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.721+0000 7fe85814e700 1 -- 172.21.15.92:0/3466104641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe8500008d0 con 0x7fe850102a30 2023-10-16T13:13:12.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.721+0000 7fe846ffd700 1 -- 172.21.15.92:0/3466104641 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe848009390 con 0x7fe850102a30 2023-10-16T13:13:12.724 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-10-16T13:13:12.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.723+0000 7fe85814e700 1 -- 172.21.15.92:0/3466104641 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe83c0a1500 msgr2=0x7fe83c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:12.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.723+0000 7fe85814e700 1 --2- 172.21.15.92:0/3466104641 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe83c0a1500 0x7fe83c0a39c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe850198220 tx=0x7fe84c005fb0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.723+0000 7fe85814e700 1 -- 172.21.15.92:0/3466104641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe850102a30 msgr2=0x7fe85019e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:12.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.723+0000 7fe85814e700 1 --2- 172.21.15.92:0/3466104641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe850102a30 0x7fe85019e2c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe848007ee0 tx=0x7fe84800d3b0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.723+0000 7fe85814e700 1 -- 172.21.15.92:0/3466104641 shutdown_connections 2023-10-16T13:13:12.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.723+0000 7fe85814e700 1 --2- 172.21.15.92:0/3466104641 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe83c0a1500 0x7fe83c0a39c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.723+0000 7fe85814e700 1 --2- 172.21.15.92:0/3466104641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe850102a30 0x7fe85019e2c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.723+0000 7fe85814e700 1 --2- 172.21.15.92:0/3466104641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe850100e90 0x7fe850196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.723+0000 7fe85814e700 1 --2- 172.21.15.92:0/3466104641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe850102070 0x7fe850197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.723+0000 7fe85814e700 1 -- 172.21.15.92:0/3466104641 >> 172.21.15.92:0/3466104641 conn(0x7fe8500fc490 msgr2=0x7fe8501055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.723+0000 7fe85814e700 1 -- 172.21.15.92:0/3466104641 shutdown_connections 2023-10-16T13:13:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.724+0000 7fe85814e700 1 -- 172.21.15.92:0/3466104641 wait complete. 2023-10-16T13:13:12.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:12 smithi092 ceph-mon[99542]: pgmap v303: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 12 op/s 2023-10-16T13:13:12.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:12 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3501850507' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:12.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:12 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2536720754' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:13:12.739 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:13:12.864 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.861+0000 7fb5ae2f9700 1 -- 172.21.15.92:0/125839656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a8106ba0 msgr2=0x7fb5a8109010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:12.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.861+0000 7fb5ae2f9700 1 --2- 172.21.15.92:0/125839656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a8106ba0 0x7fb5a8109010 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000b0a0 tx=0x7fb5a000b3b0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.861+0000 7fb5ae2f9700 1 -- 172.21.15.92:0/125839656 shutdown_connections 2023-10-16T13:13:12.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.861+0000 7fb5ae2f9700 1 --2- 172.21.15.92:0/125839656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a8106ba0 0x7fb5a8109010 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.861+0000 7fb5ae2f9700 1 --2- 172.21.15.92:0/125839656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5a8101940 0x7fb5a8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.861+0000 7fb5ae2f9700 1 --2- 172.21.15.92:0/125839656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5a8104270 0x7fb5a8106660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.861+0000 7fb5ae2f9700 1 -- 172.21.15.92:0/125839656 >> 172.21.15.92:0/125839656 conn(0x7fb5a80fb2f0 msgr2=0x7fb5a80fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:12.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.861+0000 7fb5ae2f9700 1 -- 172.21.15.92:0/125839656 shutdown_connections 2023-10-16T13:13:12.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.861+0000 7fb5ae2f9700 1 -- 172.21.15.92:0/125839656 wait complete. 2023-10-16T13:13:12.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.862+0000 7fb5ae2f9700 1 Processor -- start 2023-10-16T13:13:12.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.862+0000 7fb5ae2f9700 1 -- start start 2023-10-16T13:13:12.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.862+0000 7fb5ae2f9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a8101940 0x7fb5a8196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:12.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.862+0000 7fb5ae2f9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5a8104270 0x7fb5a81972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:12.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.862+0000 7fb5ae2f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5a8106ba0 0x7fb5a819e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:12.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.862+0000 7fb5ae2f9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a819e8f0 con 0x7fb5a8101940 2023-10-16T13:13:12.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.862+0000 7fb5ae2f9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a819ea30 con 0x7fb5a8106ba0 2023-10-16T13:13:12.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.862+0000 7fb5ae2f9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a819ebc0 con 0x7fb5a8104270 2023-10-16T13:13:12.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.862+0000 7fb5a7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a8101940 0x7fb5a8196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:12.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.862+0000 7fb5a7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a8101940 0x7fb5a8196d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36754/0 (socket says 172.21.15.92:36754) 2023-10-16T13:13:12.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.862+0000 7fb5a7fff700 1 -- 172.21.15.92:0/2134433304 learned_addr learned my addr 172.21.15.92:0/2134433304 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:12.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.862+0000 7fb5a77fe700 1 --2- 172.21.15.92:0/2134433304 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5a8104270 0x7fb5a81972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:12.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.862+0000 7fb5ac896700 1 --2- 172.21.15.92:0/2134433304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5a8106ba0 0x7fb5a819e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:12.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.862+0000 7fb5a7fff700 1 -- 172.21.15.92:0/2134433304 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5a8104270 msgr2=0x7fb5a81972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:12.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.862+0000 7fb5a7fff700 1 --2- 172.21.15.92:0/2134433304 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5a8104270 0x7fb5a81972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.862+0000 7fb5a7fff700 1 -- 172.21.15.92:0/2134433304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5a8106ba0 msgr2=0x7fb5a819e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:12.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.862+0000 7fb5a7fff700 1 --2- 172.21.15.92:0/2134433304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5a8106ba0 0x7fb5a819e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:12.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.862+0000 7fb5a7fff700 1 -- 172.21.15.92:0/2134433304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a0009d00 con 0x7fb5a8101940 2023-10-16T13:13:12.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.863+0000 7fb5a7fff700 1 --2- 172.21.15.92:0/2134433304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a8101940 0x7fb5a8196d70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb59800e9a0 tx=0x7fb59800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:12.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.863+0000 7fb5a57fa700 1 -- 172.21.15.92:0/2134433304 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb598009790 con 0x7fb5a8101940 2023-10-16T13:13:12.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.863+0000 7fb5a57fa700 1 -- 172.21.15.92:0/2134433304 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb598010430 con 0x7fb5a8101940 2023-10-16T13:13:12.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.863+0000 7fb5ae2f9700 1 -- 172.21.15.92:0/2134433304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a819eea0 con 0x7fb5a8101940 2023-10-16T13:13:12.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.863+0000 7fb5a57fa700 1 -- 172.21.15.92:0/2134433304 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb598018680 con 0x7fb5a8101940 2023-10-16T13:13:12.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.863+0000 7fb5ae2f9700 1 -- 172.21.15.92:0/2134433304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a819f2c0 con 0x7fb5a8101940 2023-10-16T13:13:12.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.864+0000 7fb5ae2f9700 1 -- 172.21.15.92:0/2134433304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a80fce70 con 0x7fb5a8101940 2023-10-16T13:13:12.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.865+0000 7fb5a57fa700 1 -- 172.21.15.92:0/2134433304 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb598010910 con 0x7fb5a8101940 2023-10-16T13:13:12.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.865+0000 7fb5a57fa700 1 --2- 172.21.15.92:0/2134433304 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb5900a1480 0x7fb5900a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:12.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.866+0000 7fb5a77fe700 1 --2- 172.21.15.92:0/2134433304 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb5900a1480 0x7fb5900a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:12.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.866+0000 7fb5a57fa700 1 -- 172.21.15.92:0/2134433304 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb598014070 con 0x7fb5a8101940 2023-10-16T13:13:12.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.866+0000 7fb5a77fe700 1 --2- 172.21.15.92:0/2134433304 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb5900a1480 0x7fb5900a3940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009c60 tx=0x7fb59c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:12.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:12.870+0000 7fb5a57fa700 1 -- 172.21.15.92:0/2134433304 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb598052100 con 0x7fb5a8101940 2023-10-16T13:13:12.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:12 smithi152 ceph-mon[104423]: pgmap v303: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 12 op/s 2023-10-16T13:13:12.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:12 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3501850507' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:12.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:12 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2536720754' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:13:13.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:12 smithi118 ceph-mon[103969]: pgmap v303: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 12 op/s 2023-10-16T13:13:13.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:12 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3501850507' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:13.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:12 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2536720754' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:13:13.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.061+0000 7fb5ae2f9700 1 -- 172.21.15.92:0/2134433304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb5a802d090 con 0x7fb5a8101940 2023-10-16T13:13:13.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.062+0000 7fb5a57fa700 1 -- 172.21.15.92:0/2134433304 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb598096570 con 0x7fb5a8101940 2023-10-16T13:13:13.065 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-10-16T13:13:13.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.064+0000 7fb5ae2f9700 1 -- 172.21.15.92:0/2134433304 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb5900a1480 msgr2=0x7fb5900a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:13.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.064+0000 7fb5ae2f9700 1 --2- 172.21.15.92:0/2134433304 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb5900a1480 0x7fb5900a3940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009c60 tx=0x7fb59c009260 comp rx=0 tx=0).stop 2023-10-16T13:13:13.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.064+0000 7fb5ae2f9700 1 -- 172.21.15.92:0/2134433304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a8101940 msgr2=0x7fb5a8196d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:13.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.064+0000 7fb5ae2f9700 1 --2- 172.21.15.92:0/2134433304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a8101940 0x7fb5a8196d70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb59800e9a0 tx=0x7fb59800ecb0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.064+0000 7fb5ae2f9700 1 -- 172.21.15.92:0/2134433304 shutdown_connections 2023-10-16T13:13:13.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.064+0000 7fb5ae2f9700 1 --2- 172.21.15.92:0/2134433304 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb5900a1480 0x7fb5900a3940 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.064+0000 7fb5ae2f9700 1 --2- 172.21.15.92:0/2134433304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5a8101940 0x7fb5a8196d70 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.064+0000 7fb5ae2f9700 1 --2- 172.21.15.92:0/2134433304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5a8106ba0 0x7fb5a819e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.064+0000 7fb5ae2f9700 1 --2- 172.21.15.92:0/2134433304 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5a8104270 0x7fb5a81972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.064+0000 7fb5ae2f9700 1 -- 172.21.15.92:0/2134433304 >> 172.21.15.92:0/2134433304 conn(0x7fb5a80fb2f0 msgr2=0x7fb5a81025d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:13.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.064+0000 7fb5ae2f9700 1 -- 172.21.15.92:0/2134433304 shutdown_connections 2023-10-16T13:13:13.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.064+0000 7fb5ae2f9700 1 -- 172.21.15.92:0/2134433304 wait complete. 2023-10-16T13:13:13.079 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:13:13.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.198+0000 7f2310ce3700 1 -- 172.21.15.92:0/1212001746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f230c1021c0 msgr2=0x7f230c102620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:13.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.198+0000 7f2310ce3700 1 --2- 172.21.15.92:0/1212001746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f230c1021c0 0x7f230c102620 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009990 tx=0x7f22f4009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.198+0000 7f2310ce3700 1 -- 172.21.15.92:0/1212001746 shutdown_connections 2023-10-16T13:13:13.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.198+0000 7f2310ce3700 1 --2- 172.21.15.92:0/1212001746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f230c102b60 0x7f230c109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.198+0000 7f2310ce3700 1 --2- 172.21.15.92:0/1212001746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f230c0ff1f0 0x7f230c0ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.198+0000 7f2310ce3700 1 --2- 172.21.15.92:0/1212001746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f230c1021c0 0x7f230c102620 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.198+0000 7f2310ce3700 1 -- 172.21.15.92:0/1212001746 >> 172.21.15.92:0/1212001746 conn(0x7f230c0fab40 msgr2=0x7f230c0fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:13.203 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.198+0000 7f2310ce3700 1 -- 172.21.15.92:0/1212001746 shutdown_connections 2023-10-16T13:13:13.203 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.198+0000 7f2310ce3700 1 -- 172.21.15.92:0/1212001746 wait complete. 2023-10-16T13:13:13.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.199+0000 7f2310ce3700 1 Processor -- start 2023-10-16T13:13:13.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.199+0000 7f2310ce3700 1 -- start start 2023-10-16T13:13:13.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.199+0000 7f2310ce3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f230c0ff1f0 0x7f230c101b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:13.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.199+0000 7f2310ce3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f230c1021c0 0x7f230c100170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:13.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.199+0000 7f2310ce3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f230c102b60 0x7f230c1006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:13.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.199+0000 7f2310ce3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c100e50 con 0x7f230c102b60 2023-10-16T13:13:13.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.199+0000 7f2310ce3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c100fc0 con 0x7f230c0ff1f0 2023-10-16T13:13:13.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.199+0000 7f2310ce3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c1a0c00 con 0x7f230c1021c0 2023-10-16T13:13:13.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.199+0000 7f230ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f230c102b60 0x7f230c1006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:13.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.199+0000 7f230ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f230c102b60 0x7f230c1006b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36772/0 (socket says 172.21.15.92:36772) 2023-10-16T13:13:13.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.199+0000 7f230ad9d700 1 -- 172.21.15.92:0/2644023967 learned_addr learned my addr 172.21.15.92:0/2644023967 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:13.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.199+0000 7f2309d9b700 1 --2- 172.21.15.92:0/2644023967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f230c1021c0 0x7f230c100170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:13.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.199+0000 7f230a59c700 1 --2- 172.21.15.92:0/2644023967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f230c0ff1f0 0x7f230c101b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:13.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.199+0000 7f230ad9d700 1 -- 172.21.15.92:0/2644023967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f230c1021c0 msgr2=0x7f230c100170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:13.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.199+0000 7f230ad9d700 1 --2- 172.21.15.92:0/2644023967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f230c1021c0 0x7f230c100170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.199+0000 7f230ad9d700 1 -- 172.21.15.92:0/2644023967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f230c0ff1f0 msgr2=0x7f230c101b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:13.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.199+0000 7f230ad9d700 1 --2- 172.21.15.92:0/2644023967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f230c0ff1f0 0x7f230c101b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.199+0000 7f230ad9d700 1 -- 172.21.15.92:0/2644023967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f40095f0 con 0x7f230c102b60 2023-10-16T13:13:13.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.200+0000 7f230ad9d700 1 --2- 172.21.15.92:0/2644023967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f230c102b60 0x7f230c1006b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2304007ee0 tx=0x7f230400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:13.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.200+0000 7f23037fe700 1 -- 172.21.15.92:0/2644023967 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304017070 con 0x7f230c102b60 2023-10-16T13:13:13.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.200+0000 7f23037fe700 1 -- 172.21.15.92:0/2644023967 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f230400f040 con 0x7f230c102b60 2023-10-16T13:13:13.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.200+0000 7f2310ce3700 1 -- 172.21.15.92:0/2644023967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230c1a0ee0 con 0x7f230c102b60 2023-10-16T13:13:13.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.200+0000 7f23037fe700 1 -- 172.21.15.92:0/2644023967 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304005760 con 0x7f230c102b60 2023-10-16T13:13:13.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.200+0000 7f2310ce3700 1 -- 172.21.15.92:0/2644023967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230c1a1310 con 0x7f230c102b60 2023-10-16T13:13:13.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.201+0000 7f2310ce3700 1 -- 172.21.15.92:0/2644023967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230c107dc0 con 0x7f230c102b60 2023-10-16T13:13:13.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.202+0000 7f23037fe700 1 -- 172.21.15.92:0/2644023967 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f23040058c0 con 0x7f230c102b60 2023-10-16T13:13:13.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.203+0000 7f23037fe700 1 --2- 172.21.15.92:0/2644023967 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f22f80a1520 0x7f22f80a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:13.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.203+0000 7f230a59c700 1 --2- 172.21.15.92:0/2644023967 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f22f80a1520 0x7f22f80a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:13.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.203+0000 7f23037fe700 1 -- 172.21.15.92:0/2644023967 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f23040ccae0 con 0x7f230c102b60 2023-10-16T13:13:13.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.203+0000 7f230a59c700 1 --2- 172.21.15.92:0/2644023967 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f22f80a1520 0x7f22f80a39e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f230c0690a0 tx=0x7f22fc005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:13.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.206+0000 7f23037fe700 1 -- 172.21.15.92:0/2644023967 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2304096140 con 0x7f230c102b60 2023-10-16T13:13:13.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.399+0000 7f2310ce3700 1 -- 172.21.15.92:0/2644023967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f230c10ca40 con 0x7f230c102b60 2023-10-16T13:13:13.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.401+0000 7f23037fe700 1 -- 172.21.15.92:0/2644023967 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22598 (secure 0 0 0) 0x7f2304009390 con 0x7f230c102b60 2023-10-16T13:13:13.406 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:13:13.406 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":85,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:12:36.335213+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:11:38.345035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:11:39.549912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:13:13.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.403+0000 7f2310ce3700 1 -- 172.21.15.92:0/2644023967 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f22f80a1520 msgr2=0x7f22f80a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:13.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.403+0000 7f2310ce3700 1 --2- 172.21.15.92:0/2644023967 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f22f80a1520 0x7f22f80a39e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f230c0690a0 tx=0x7f22fc005cf0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.403+0000 7f2310ce3700 1 -- 172.21.15.92:0/2644023967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f230c102b60 msgr2=0x7f230c1006b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:13.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.403+0000 7f2310ce3700 1 --2- 172.21.15.92:0/2644023967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f230c102b60 0x7f230c1006b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2304007ee0 tx=0x7f230400d3b0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.403+0000 7f2310ce3700 1 -- 172.21.15.92:0/2644023967 shutdown_connections 2023-10-16T13:13:13.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.403+0000 7f2310ce3700 1 --2- 172.21.15.92:0/2644023967 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f22f80a1520 0x7f22f80a39e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.403+0000 7f2310ce3700 1 --2- 172.21.15.92:0/2644023967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f230c102b60 0x7f230c1006b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.403+0000 7f2310ce3700 1 --2- 172.21.15.92:0/2644023967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f230c0ff1f0 0x7f230c101b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.403+0000 7f2310ce3700 1 --2- 172.21.15.92:0/2644023967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f230c1021c0 0x7f230c100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.403+0000 7f2310ce3700 1 -- 172.21.15.92:0/2644023967 >> 172.21.15.92:0/2644023967 conn(0x7f230c0fab40 msgr2=0x7f230c0fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:13.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.403+0000 7f2310ce3700 1 -- 172.21.15.92:0/2644023967 shutdown_connections 2023-10-16T13:13:13.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.403+0000 7f2310ce3700 1 -- 172.21.15.92:0/2644023967 wait complete. 2023-10-16T13:13:13.418 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:07:45.516334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:11:38.345035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:11:39.549912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:13:13.419 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:13:13.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.543+0000 7f77d8bd8700 1 -- 172.21.15.92:0/1705780770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77d40ffdc0 msgr2=0x7f77d41001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:13.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.543+0000 7f77d8bd8700 1 --2- 172.21.15.92:0/1705780770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77d40ffdc0 0x7f77d41001e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f77c80099c0 tx=0x7f77c8009cd0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.543+0000 7f77d8bd8700 1 -- 172.21.15.92:0/1705780770 shutdown_connections 2023-10-16T13:13:13.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.543+0000 7f77d8bd8700 1 --2- 172.21.15.92:0/1705780770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77d40ffdc0 0x7f77d41001e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.543+0000 7f77d8bd8700 1 --2- 172.21.15.92:0/1705780770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77d4101950 0x7f77d4108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.543+0000 7f77d8bd8700 1 --2- 172.21.15.92:0/1705780770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77d4100fb0 0x7f77d4101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.543+0000 7f77d8bd8700 1 -- 172.21.15.92:0/1705780770 >> 172.21.15.92:0/1705780770 conn(0x7f77d40fb2f0 msgr2=0x7f77d40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:13.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.543+0000 7f77d8bd8700 1 -- 172.21.15.92:0/1705780770 shutdown_connections 2023-10-16T13:13:13.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.543+0000 7f77d8bd8700 1 -- 172.21.15.92:0/1705780770 wait complete. 2023-10-16T13:13:13.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.544+0000 7f77d8bd8700 1 Processor -- start 2023-10-16T13:13:13.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.544+0000 7f77d8bd8700 1 -- start start 2023-10-16T13:13:13.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.544+0000 7f77d8bd8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77d40ffdc0 0x7f77d4195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:13.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.544+0000 7f77d8bd8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77d4100fb0 0x7f77d41960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:13.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.544+0000 7f77d8bd8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77d4101950 0x7f77d419d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:13.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.544+0000 7f77d8bd8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d419d6e0 con 0x7f77d4100fb0 2023-10-16T13:13:13.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.544+0000 7f77d8bd8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d419d820 con 0x7f77d40ffdc0 2023-10-16T13:13:13.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.544+0000 7f77d8bd8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d419d9b0 con 0x7f77d4101950 2023-10-16T13:13:13.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.544+0000 7f77d1d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77d4100fb0 0x7f77d41960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:13.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.544+0000 7f77d1d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77d4100fb0 0x7f77d41960a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36784/0 (socket says 172.21.15.92:36784) 2023-10-16T13:13:13.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.544+0000 7f77d1d9b700 1 -- 172.21.15.92:0/2191946471 learned_addr learned my addr 172.21.15.92:0/2191946471 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:13.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.544+0000 7f77d259c700 1 --2- 172.21.15.92:0/2191946471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77d40ffdc0 0x7f77d4195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:13.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.544+0000 7f77d2d9d700 1 --2- 172.21.15.92:0/2191946471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77d4101950 0x7f77d419d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:13.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.544+0000 7f77d1d9b700 1 -- 172.21.15.92:0/2191946471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77d4101950 msgr2=0x7f77d419d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:13.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.544+0000 7f77d1d9b700 1 --2- 172.21.15.92:0/2191946471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77d4101950 0x7f77d419d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.544+0000 7f77d1d9b700 1 -- 172.21.15.92:0/2191946471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77d40ffdc0 msgr2=0x7f77d4195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:13.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.544+0000 7f77d1d9b700 1 --2- 172.21.15.92:0/2191946471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77d40ffdc0 0x7f77d4195b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.544+0000 7f77d1d9b700 1 -- 172.21.15.92:0/2191946471 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c80095f0 con 0x7f77d4100fb0 2023-10-16T13:13:13.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.544+0000 7f77d2d9d700 1 --2- 172.21.15.92:0/2191946471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77d4101950 0x7f77d419d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:13.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.545+0000 7f77d1d9b700 1 --2- 172.21.15.92:0/2191946471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77d4100fb0 0x7f77d41960a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f77c400d950 tx=0x7f77c400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:13.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.545+0000 7f77c37fe700 1 -- 172.21.15.92:0/2191946471 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4009940 con 0x7f77d4100fb0 2023-10-16T13:13:13.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.545+0000 7f77d8bd8700 1 -- 172.21.15.92:0/2191946471 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d419dc90 con 0x7f77d4100fb0 2023-10-16T13:13:13.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.545+0000 7f77c37fe700 1 -- 172.21.15.92:0/2191946471 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f77c4010460 con 0x7f77d4100fb0 2023-10-16T13:13:13.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.545+0000 7f77c37fe700 1 -- 172.21.15.92:0/2191946471 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c400f620 con 0x7f77d4100fb0 2023-10-16T13:13:13.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.545+0000 7f77d8bd8700 1 -- 172.21.15.92:0/2191946471 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d419e1a0 con 0x7f77d4100fb0 2023-10-16T13:13:13.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.546+0000 7f77d8bd8700 1 -- 172.21.15.92:0/2191946471 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d410b710 con 0x7f77d4100fb0 2023-10-16T13:13:13.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.547+0000 7f77c37fe700 1 -- 172.21.15.92:0/2191946471 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f77c4010960 con 0x7f77d4100fb0 2023-10-16T13:13:13.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.548+0000 7f77c37fe700 1 --2- 172.21.15.92:0/2191946471 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77bc0a1500 0x7f77bc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:13.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.548+0000 7f77d259c700 1 --2- 172.21.15.92:0/2191946471 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77bc0a1500 0x7f77bc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:13.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.548+0000 7f77c37fe700 1 -- 172.21.15.92:0/2191946471 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f77c40ccbd0 con 0x7f77d4100fb0 2023-10-16T13:13:13.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.548+0000 7f77d259c700 1 --2- 172.21.15.92:0/2191946471 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77bc0a1500 0x7f77bc0a39c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f77c8009990 tx=0x7f77c8003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:13.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.552+0000 7f77c37fe700 1 -- 172.21.15.92:0/2191946471 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f77c40961f0 con 0x7f77d4100fb0 2023-10-16T13:13:13.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.743+0000 7f77d8bd8700 1 -- 172.21.15.92:0/2191946471 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f77d4106ca0 con 0x7f77d4100fb0 2023-10-16T13:13:13.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.743+0000 7f77c37fe700 1 -- 172.21.15.92:0/2191946471 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f77c40160a0 con 0x7f77d4100fb0 2023-10-16T13:13:13.746 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-10-16T13:13:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:13 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3466104641' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:13:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:13 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2134433304' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:13:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:13 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2644023967' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:13.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.745+0000 7f77d8bd8700 1 -- 172.21.15.92:0/2191946471 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77bc0a1500 msgr2=0x7f77bc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:13.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.745+0000 7f77d8bd8700 1 --2- 172.21.15.92:0/2191946471 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77bc0a1500 0x7f77bc0a39c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f77c8009990 tx=0x7f77c8003680 comp rx=0 tx=0).stop 2023-10-16T13:13:13.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.745+0000 7f77d8bd8700 1 -- 172.21.15.92:0/2191946471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77d4100fb0 msgr2=0x7f77d41960a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:13.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.745+0000 7f77d8bd8700 1 --2- 172.21.15.92:0/2191946471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77d4100fb0 0x7f77d41960a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f77c400d950 tx=0x7f77c400dc60 comp rx=0 tx=0).stop 2023-10-16T13:13:13.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.745+0000 7f77d8bd8700 1 -- 172.21.15.92:0/2191946471 shutdown_connections 2023-10-16T13:13:13.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.745+0000 7f77d8bd8700 1 --2- 172.21.15.92:0/2191946471 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77bc0a1500 0x7f77bc0a39c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.745+0000 7f77d8bd8700 1 --2- 172.21.15.92:0/2191946471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77d4101950 0x7f77d419d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.745+0000 7f77d8bd8700 1 --2- 172.21.15.92:0/2191946471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77d40ffdc0 0x7f77d4195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.745+0000 7f77d8bd8700 1 --2- 172.21.15.92:0/2191946471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77d4100fb0 0x7f77d41960a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.745+0000 7f77d8bd8700 1 -- 172.21.15.92:0/2191946471 >> 172.21.15.92:0/2191946471 conn(0x7f77d40fb2f0 msgr2=0x7f77d40fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:13.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.745+0000 7f77d8bd8700 1 -- 172.21.15.92:0/2191946471 shutdown_connections 2023-10-16T13:13:13.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.745+0000 7f77d8bd8700 1 -- 172.21.15.92:0/2191946471 wait complete. 2023-10-16T13:13:13.760 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:13:13.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.882+0000 7f9a07c52700 1 -- 172.21.15.92:0/861399907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a00101940 msgr2=0x7f9a001081f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:13.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.882+0000 7f9a07c52700 1 --2- 172.21.15.92:0/861399907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a00101940 0x7f9a001081f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f99f800b0d0 tx=0x7f99f800b3e0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.882+0000 7f9a07c52700 1 -- 172.21.15.92:0/861399907 shutdown_connections 2023-10-16T13:13:13.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.882+0000 7f9a07c52700 1 --2- 172.21.15.92:0/861399907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a00101940 0x7f9a001081f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.882+0000 7f9a07c52700 1 --2- 172.21.15.92:0/861399907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a000ffdb0 0x7f9a001001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.882+0000 7f9a07c52700 1 --2- 172.21.15.92:0/861399907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a00100fa0 0x7f9a00101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.882+0000 7f9a07c52700 1 -- 172.21.15.92:0/861399907 >> 172.21.15.92:0/861399907 conn(0x7f9a000fb320 msgr2=0x7f9a000fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:13.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.882+0000 7f9a07c52700 1 -- 172.21.15.92:0/861399907 shutdown_connections 2023-10-16T13:13:13.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.882+0000 7f9a07c52700 1 -- 172.21.15.92:0/861399907 wait complete. 2023-10-16T13:13:13.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.883+0000 7f9a07c52700 1 Processor -- start 2023-10-16T13:13:13.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.883+0000 7f9a07c52700 1 -- start start 2023-10-16T13:13:13.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.883+0000 7f9a07c52700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a000ffdb0 0x7f9a00068c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:13.890 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.883+0000 7f9a07c52700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a00100fa0 0x7f9a0019baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:13.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.883+0000 7f9a07c52700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a00101940 0x7f9a0019e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:13.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.883+0000 7f9a07c52700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0019e8d0 con 0x7f9a00101940 2023-10-16T13:13:13.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.883+0000 7f9a07c52700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0019ea40 con 0x7f9a000ffdb0 2023-10-16T13:13:13.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.883+0000 7f9a07c52700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0019ec00 con 0x7f9a00100fa0 2023-10-16T13:13:13.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.883+0000 7f9a061ef700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a00101940 0x7f9a0019e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:13.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.883+0000 7f9a061ef700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a00101940 0x7f9a0019e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36800/0 (socket says 172.21.15.92:36800) 2023-10-16T13:13:13.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.883+0000 7f9a061ef700 1 -- 172.21.15.92:0/3675318281 learned_addr learned my addr 172.21.15.92:0/3675318281 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:13.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.883+0000 7f9a051ed700 1 --2- 172.21.15.92:0/3675318281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a00100fa0 0x7f9a0019baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:13.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.883+0000 7f9a059ee700 1 --2- 172.21.15.92:0/3675318281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a000ffdb0 0x7f9a00068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:13.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.883+0000 7f9a061ef700 1 -- 172.21.15.92:0/3675318281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a00100fa0 msgr2=0x7f9a0019baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:13.892 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.883+0000 7f9a061ef700 1 --2- 172.21.15.92:0/3675318281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a00100fa0 0x7f9a0019baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.883+0000 7f9a061ef700 1 -- 172.21.15.92:0/3675318281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a000ffdb0 msgr2=0x7f9a00068c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:13.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.883+0000 7f9a061ef700 1 --2- 172.21.15.92:0/3675318281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a000ffdb0 0x7f9a00068c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:13.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.883+0000 7f9a061ef700 1 -- 172.21.15.92:0/3675318281 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f8009d00 con 0x7f9a00101940 2023-10-16T13:13:13.893 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.883+0000 7f9a059ee700 1 --2- 172.21.15.92:0/3675318281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a000ffdb0 0x7f9a00068c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:13.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.884+0000 7f9a061ef700 1 --2- 172.21.15.92:0/3675318281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a00101940 0x7f9a0019e130 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f99f800b770 tx=0x7f99f800bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:13.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.884+0000 7f99f6ffd700 1 -- 172.21.15.92:0/3675318281 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f800e040 con 0x7f9a00101940 2023-10-16T13:13:13.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.884+0000 7f99f6ffd700 1 -- 172.21.15.92:0/3675318281 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f99f8003e10 con 0x7f9a00101940 2023-10-16T13:13:13.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.884+0000 7f9a07c52700 1 -- 172.21.15.92:0/3675318281 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0019ee80 con 0x7f9a00101940 2023-10-16T13:13:13.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.884+0000 7f99f6ffd700 1 -- 172.21.15.92:0/3675318281 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8012c60 con 0x7f9a00101940 2023-10-16T13:13:13.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.884+0000 7f9a07c52700 1 -- 172.21.15.92:0/3675318281 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0019f240 con 0x7f9a00101940 2023-10-16T13:13:13.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.885+0000 7f9a07c52700 1 -- 172.21.15.92:0/3675318281 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a001072b0 con 0x7f9a00101940 2023-10-16T13:13:13.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.886+0000 7f99f6ffd700 1 -- 172.21.15.92:0/3675318281 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f99f8026400 con 0x7f9a00101940 2023-10-16T13:13:13.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.886+0000 7f99f6ffd700 1 --2- 172.21.15.92:0/3675318281 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f99ec0a1480 0x7f99ec0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:13.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.886+0000 7f9a059ee700 1 --2- 172.21.15.92:0/3675318281 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f99ec0a1480 0x7f99ec0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:13.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.886+0000 7f99f6ffd700 1 -- 172.21.15.92:0/3675318281 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f99f80cdfb0 con 0x7f9a00101940 2023-10-16T13:13:13.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.887+0000 7f9a059ee700 1 --2- 172.21.15.92:0/3675318281 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f99ec0a1480 0x7f99ec0a3940 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9a00100e00 tx=0x7f99fc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:13.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:13.890+0000 7f99f6ffd700 1 -- 172.21.15.92:0/3675318281 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f99f80977d0 con 0x7f9a00101940 2023-10-16T13:13:13.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:13 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3466104641' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:13:13.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:13 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2134433304' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:13:13.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:13 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2644023967' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:14.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:13 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3466104641' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:13:14.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:13 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2134433304' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:13:14.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:13 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2644023967' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:14.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.080+0000 7f9a07c52700 1 -- 172.21.15.92:0/3675318281 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9a0002d020 con 0x7f9a00101940 2023-10-16T13:13:14.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.080+0000 7f99f6ffd700 1 -- 172.21.15.92:0/3675318281 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f99f809adf0 con 0x7f9a00101940 2023-10-16T13:13:14.084 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-10-16T13:13:14.085 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.082+0000 7f9a07c52700 1 -- 172.21.15.92:0/3675318281 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f99ec0a1480 msgr2=0x7f99ec0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:14.086 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.082+0000 7f9a07c52700 1 --2- 172.21.15.92:0/3675318281 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f99ec0a1480 0x7f99ec0a3940 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9a00100e00 tx=0x7f99fc009260 comp rx=0 tx=0).stop 2023-10-16T13:13:14.086 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.082+0000 7f9a07c52700 1 -- 172.21.15.92:0/3675318281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a00101940 msgr2=0x7f9a0019e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:14.086 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.082+0000 7f9a07c52700 1 --2- 172.21.15.92:0/3675318281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a00101940 0x7f9a0019e130 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f99f800b770 tx=0x7f99f800bd40 comp rx=0 tx=0).stop 2023-10-16T13:13:14.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.082+0000 7f9a07c52700 1 -- 172.21.15.92:0/3675318281 shutdown_connections 2023-10-16T13:13:14.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.082+0000 7f9a07c52700 1 --2- 172.21.15.92:0/3675318281 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f99ec0a1480 0x7f99ec0a3940 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.082+0000 7f9a07c52700 1 --2- 172.21.15.92:0/3675318281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a00101940 0x7f9a0019e130 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.088 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.082+0000 7f9a07c52700 1 --2- 172.21.15.92:0/3675318281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a000ffdb0 0x7f9a00068c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.088 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.082+0000 7f9a07c52700 1 --2- 172.21.15.92:0/3675318281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a00100fa0 0x7f9a0019baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.088 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.082+0000 7f9a07c52700 1 -- 172.21.15.92:0/3675318281 >> 172.21.15.92:0/3675318281 conn(0x7f9a000fb320 msgr2=0x7f9a001043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:14.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.082+0000 7f9a07c52700 1 -- 172.21.15.92:0/3675318281 shutdown_connections 2023-10-16T13:13:14.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.082+0000 7f9a07c52700 1 -- 172.21.15.92:0/3675318281 wait complete. 2023-10-16T13:13:14.097 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:13:14.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.219+0000 7f299f55d700 1 -- 172.21.15.92:0/1505552277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2998102050 msgr2=0x7f29981024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:14.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.219+0000 7f299f55d700 1 --2- 172.21.15.92:0/1505552277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2998102050 0x7f29981024d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2994009990 tx=0x7f2994009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.219+0000 7f299f55d700 1 -- 172.21.15.92:0/1505552277 shutdown_connections 2023-10-16T13:13:14.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.219+0000 7f299f55d700 1 --2- 172.21.15.92:0/1505552277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2998102a10 0x7f2998109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.219+0000 7f299f55d700 1 --2- 172.21.15.92:0/1505552277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2998100e70 0x7f2998101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.219+0000 7f299f55d700 1 --2- 172.21.15.92:0/1505552277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2998102050 0x7f29981024d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.219+0000 7f299f55d700 1 -- 172.21.15.92:0/1505552277 >> 172.21.15.92:0/1505552277 conn(0x7f29980fc430 msgr2=0x7f29980fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:14.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.219+0000 7f299f55d700 1 -- 172.21.15.92:0/1505552277 shutdown_connections 2023-10-16T13:13:14.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.219+0000 7f299f55d700 1 -- 172.21.15.92:0/1505552277 wait complete. 2023-10-16T13:13:14.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.220+0000 7f299f55d700 1 Processor -- start 2023-10-16T13:13:14.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.220+0000 7f299f55d700 1 -- start start 2023-10-16T13:13:14.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.220+0000 7f299f55d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2998100e70 0x7f2998196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:14.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.220+0000 7f299f55d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2998102050 0x7f29981971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:14.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.220+0000 7f299f55d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2998102a10 0x7f299819e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:14.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.220+0000 7f299f55d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299819e7e0 con 0x7f2998102050 2023-10-16T13:13:14.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.220+0000 7f299f55d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299819e950 con 0x7f2998100e70 2023-10-16T13:13:14.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.220+0000 7f299f55d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299819eb10 con 0x7f2998102a10 2023-10-16T13:13:14.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.220+0000 7f299caf8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2998102050 0x7f29981971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:14.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.220+0000 7f299caf8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2998102050 0x7f29981971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36812/0 (socket says 172.21.15.92:36812) 2023-10-16T13:13:14.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.220+0000 7f299caf8700 1 -- 172.21.15.92:0/430114212 learned_addr learned my addr 172.21.15.92:0/430114212 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:14.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.220+0000 7f299d2f9700 1 --2- 172.21.15.92:0/430114212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2998100e70 0x7f2998196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:14.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.220+0000 7f299dafa700 1 --2- 172.21.15.92:0/430114212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2998102a10 0x7f299819e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:14.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.220+0000 7f299caf8700 1 -- 172.21.15.92:0/430114212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2998102a10 msgr2=0x7f299819e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:14.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.220+0000 7f299caf8700 1 --2- 172.21.15.92:0/430114212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2998102a10 0x7f299819e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.220+0000 7f299caf8700 1 -- 172.21.15.92:0/430114212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2998100e70 msgr2=0x7f2998196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:14.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.220+0000 7f299caf8700 1 --2- 172.21.15.92:0/430114212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2998100e70 0x7f2998196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.220+0000 7f299caf8700 1 -- 172.21.15.92:0/430114212 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29940095f0 con 0x7f2998102050 2023-10-16T13:13:14.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.220+0000 7f299caf8700 1 --2- 172.21.15.92:0/430114212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2998102050 0x7f29981971b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f299400b5c0 tx=0x7f299400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:14.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.221+0000 7f298e7fc700 1 -- 172.21.15.92:0/430114212 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299401d070 con 0x7f2998102050 2023-10-16T13:13:14.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.221+0000 7f298e7fc700 1 -- 172.21.15.92:0/430114212 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2994004cb0 con 0x7f2998102050 2023-10-16T13:13:14.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.221+0000 7f299f55d700 1 -- 172.21.15.92:0/430114212 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299819ed90 con 0x7f2998102050 2023-10-16T13:13:14.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.221+0000 7f298e7fc700 1 -- 172.21.15.92:0/430114212 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994005490 con 0x7f2998102050 2023-10-16T13:13:14.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.221+0000 7f299f55d700 1 -- 172.21.15.92:0/430114212 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299819f1b0 con 0x7f2998102050 2023-10-16T13:13:14.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.221+0000 7f299f55d700 1 -- 172.21.15.92:0/430114212 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2998107e70 con 0x7f2998102050 2023-10-16T13:13:14.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.223+0000 7f298e7fc700 1 -- 172.21.15.92:0/430114212 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f29940047d0 con 0x7f2998102050 2023-10-16T13:13:14.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.223+0000 7f298e7fc700 1 --2- 172.21.15.92:0/430114212 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f29840a1480 0x7f29840a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:14.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.223+0000 7f298e7fc700 1 -- 172.21.15.92:0/430114212 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f29940ce0d0 con 0x7f2998102050 2023-10-16T13:13:14.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.223+0000 7f299d2f9700 1 --2- 172.21.15.92:0/430114212 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f29840a1480 0x7f29840a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:14.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.224+0000 7f299d2f9700 1 --2- 172.21.15.92:0/430114212 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f29840a1480 0x7f29840a3940 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2998197b40 tx=0x7f298800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:14.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.226+0000 7f298e7fc700 1 -- 172.21.15.92:0/430114212 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f29940977c0 con 0x7f2998102050 2023-10-16T13:13:14.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.418+0000 7f299f55d700 1 -- 172.21.15.92:0/430114212 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f299810c9b0 con 0x7f2998102050 2023-10-16T13:13:14.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.419+0000 7f298e7fc700 1 -- 172.21.15.92:0/430114212 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f299409ade0 con 0x7f2998102050 2023-10-16T13:13:14.422 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-10-16T13:13:14.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.421+0000 7f299f55d700 1 -- 172.21.15.92:0/430114212 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f29840a1480 msgr2=0x7f29840a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:14.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.421+0000 7f299f55d700 1 --2- 172.21.15.92:0/430114212 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f29840a1480 0x7f29840a3940 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2998197b40 tx=0x7f298800b410 comp rx=0 tx=0).stop 2023-10-16T13:13:14.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.421+0000 7f299f55d700 1 -- 172.21.15.92:0/430114212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2998102050 msgr2=0x7f29981971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:14.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.421+0000 7f299f55d700 1 --2- 172.21.15.92:0/430114212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2998102050 0x7f29981971b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f299400b5c0 tx=0x7f299400f690 comp rx=0 tx=0).stop 2023-10-16T13:13:14.424 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.421+0000 7f299f55d700 1 -- 172.21.15.92:0/430114212 shutdown_connections 2023-10-16T13:13:14.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.421+0000 7f299f55d700 1 --2- 172.21.15.92:0/430114212 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f29840a1480 0x7f29840a3940 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.421+0000 7f299f55d700 1 --2- 172.21.15.92:0/430114212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2998102a10 0x7f299819e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.421+0000 7f299f55d700 1 --2- 172.21.15.92:0/430114212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2998100e70 0x7f2998196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.421+0000 7f299f55d700 1 --2- 172.21.15.92:0/430114212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2998102050 0x7f29981971b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.421+0000 7f299f55d700 1 -- 172.21.15.92:0/430114212 >> 172.21.15.92:0/430114212 conn(0x7f29980fc430 msgr2=0x7f29980fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:14.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.421+0000 7f299f55d700 1 -- 172.21.15.92:0/430114212 shutdown_connections 2023-10-16T13:13:14.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.421+0000 7f299f55d700 1 -- 172.21.15.92:0/430114212 wait complete. 2023-10-16T13:13:14.436 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-10-16T13:13:14.436 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:13:14.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.555+0000 7f839c7f2700 1 -- 172.21.15.92:0/3860961873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83941019f0 msgr2=0x7f8394103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:14.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.555+0000 7f839c7f2700 1 --2- 172.21.15.92:0/3860961873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83941019f0 0x7f8394103de0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8390009990 tx=0x7f8390009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.555+0000 7f839c7f2700 1 -- 172.21.15.92:0/3860961873 shutdown_connections 2023-10-16T13:13:14.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.555+0000 7f839c7f2700 1 --2- 172.21.15.92:0/3860961873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83941019f0 0x7f8394103de0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.555+0000 7f839c7f2700 1 --2- 172.21.15.92:0/3860961873 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8394106c50 0x7f8394109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.555+0000 7f839c7f2700 1 --2- 172.21.15.92:0/3860961873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8394104320 0x7f8394106710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.555+0000 7f839c7f2700 1 -- 172.21.15.92:0/3860961873 >> 172.21.15.92:0/3860961873 conn(0x7f83940fb320 msgr2=0x7f83940fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:14.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.555+0000 7f839c7f2700 1 -- 172.21.15.92:0/3860961873 shutdown_connections 2023-10-16T13:13:14.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.555+0000 7f839c7f2700 1 -- 172.21.15.92:0/3860961873 wait complete. 2023-10-16T13:13:14.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.555+0000 7f839c7f2700 1 Processor -- start 2023-10-16T13:13:14.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.555+0000 7f839c7f2700 1 -- start start 2023-10-16T13:13:14.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f839c7f2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83941019f0 0x7f8394198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:14.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f839c7f2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8394104320 0x7f8394199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:14.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f839c7f2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8394106c50 0x7f83941a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:14.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f839c7f2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83941a0850 con 0x7f8394104320 2023-10-16T13:13:14.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f839c7f2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83941a09c0 con 0x7f83941019f0 2023-10-16T13:13:14.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f839c7f2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83941a0b80 con 0x7f8394106c50 2023-10-16T13:13:14.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f8399d8d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8394104320 0x7f8394199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:14.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f8399d8d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8394104320 0x7f8394199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36824/0 (socket says 172.21.15.92:36824) 2023-10-16T13:13:14.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f8399d8d700 1 -- 172.21.15.92:0/1496418425 learned_addr learned my addr 172.21.15.92:0/1496418425 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:14.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f839a58e700 1 --2- 172.21.15.92:0/1496418425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83941019f0 0x7f8394198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:14.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f839ad8f700 1 --2- 172.21.15.92:0/1496418425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8394106c50 0x7f83941a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:14.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f8399d8d700 1 -- 172.21.15.92:0/1496418425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8394106c50 msgr2=0x7f83941a0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:14.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f8399d8d700 1 --2- 172.21.15.92:0/1496418425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8394106c50 0x7f83941a0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f8399d8d700 1 -- 172.21.15.92:0/1496418425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83941019f0 msgr2=0x7f8394198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:14.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f8399d8d700 1 --2- 172.21.15.92:0/1496418425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83941019f0 0x7f8394198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f8399d8d700 1 -- 172.21.15.92:0/1496418425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83900095f0 con 0x7f8394104320 2023-10-16T13:13:14.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f839a58e700 1 --2- 172.21.15.92:0/1496418425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83941019f0 0x7f8394198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:14.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f839ad8f700 1 --2- 172.21.15.92:0/1496418425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8394106c50 0x7f83941a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:14.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f8399d8d700 1 --2- 172.21.15.92:0/1496418425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8394104320 0x7f8394199250 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f838400c9b0 tx=0x7f838400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:14.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f838b7fe700 1 -- 172.21.15.92:0/1496418425 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8384007b00 con 0x7f8394104320 2023-10-16T13:13:14.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f838b7fe700 1 -- 172.21.15.92:0/1496418425 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8384007c60 con 0x7f8394104320 2023-10-16T13:13:14.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f839c7f2700 1 -- 172.21.15.92:0/1496418425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83941a0e60 con 0x7f8394104320 2023-10-16T13:13:14.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f838b7fe700 1 -- 172.21.15.92:0/1496418425 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8384018730 con 0x7f8394104320 2023-10-16T13:13:14.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.556+0000 7f839c7f2700 1 -- 172.21.15.92:0/1496418425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83941a1280 con 0x7f8394104320 2023-10-16T13:13:14.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.557+0000 7f839c7f2700 1 -- 172.21.15.92:0/1496418425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83941087d0 con 0x7f8394104320 2023-10-16T13:13:14.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.559+0000 7f838b7fe700 1 -- 172.21.15.92:0/1496418425 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8384018890 con 0x7f8394104320 2023-10-16T13:13:14.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.559+0000 7f838b7fe700 1 --2- 172.21.15.92:0/1496418425 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f83800a1520 0x7f83800a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:14.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.560+0000 7f839a58e700 1 --2- 172.21.15.92:0/1496418425 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f83800a1520 0x7f83800a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:14.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.560+0000 7f838b7fe700 1 -- 172.21.15.92:0/1496418425 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f83840cd0b0 con 0x7f8394104320 2023-10-16T13:13:14.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.560+0000 7f839a58e700 1 --2- 172.21.15.92:0/1496418425 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f83800a1520 0x7f83800a39e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f83900036f0 tx=0x7f8390003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:14.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.563+0000 7f838b7fe700 1 -- 172.21.15.92:0/1496418425 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f83840967a0 con 0x7f8394104320 2023-10-16T13:13:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:14 smithi092 ceph-mon[99542]: pgmap v304: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 9 op/s 2023-10-16T13:13:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:14 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2191946471' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:13:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:14 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3675318281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:13:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:14 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/430114212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:13:14.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.803+0000 7f839c7f2700 1 -- 172.21.15.92:0/1496418425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f839410c800 con 0x7f8394104320 2023-10-16T13:13:14.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.804+0000 7f838b7fe700 1 -- 172.21.15.92:0/1496418425 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11379 (secure 0 0 0) 0x7f8384099dc0 con 0x7f8394104320 2023-10-16T13:13:14.807 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:13:14.807 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-16T13:11:40.343309+0000","modified":"2023-10-16T13:11:48.346678+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24460,"mds_3":24428,"mds_4":24412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1790514945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1790514945},{"type":"v1","addr":"172.21.15.92:6839","nonce":1790514945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/1016260236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1016260236},{"type":"v1","addr":"172.21.15.92:6841","nonce":1016260236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24410":{"gid":24410,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/2133613540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":2133613540},{"type":"v1","addr":"172.21.15.118:6837","nonce":2133613540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6837/2403096460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":2403096460},{"type":"v1","addr":"172.21.15.152:6837","nonce":2403096460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1821921588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1821921588},{"type":"v1","addr":"172.21.15.152:6839","nonce":1821921588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6839/1577355936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":1577355936},{"type":"v1","addr":"172.21.15.118:6839","nonce":1577355936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:13:14.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.805+0000 7f839c7f2700 1 -- 172.21.15.92:0/1496418425 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f83800a1520 msgr2=0x7f83800a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:14.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.806+0000 7f839c7f2700 1 --2- 172.21.15.92:0/1496418425 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f83800a1520 0x7f83800a39e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f83900036f0 tx=0x7f8390003680 comp rx=0 tx=0).stop 2023-10-16T13:13:14.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.806+0000 7f839c7f2700 1 -- 172.21.15.92:0/1496418425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8394104320 msgr2=0x7f8394199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:14.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.806+0000 7f839c7f2700 1 --2- 172.21.15.92:0/1496418425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8394104320 0x7f8394199250 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f838400c9b0 tx=0x7f838400cd70 comp rx=0 tx=0).stop 2023-10-16T13:13:14.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.806+0000 7f839c7f2700 1 -- 172.21.15.92:0/1496418425 shutdown_connections 2023-10-16T13:13:14.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.806+0000 7f839c7f2700 1 --2- 172.21.15.92:0/1496418425 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f83800a1520 0x7f83800a39e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.806+0000 7f839c7f2700 1 --2- 172.21.15.92:0/1496418425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8394106c50 0x7f83941a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.806+0000 7f839c7f2700 1 --2- 172.21.15.92:0/1496418425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83941019f0 0x7f8394198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.806+0000 7f839c7f2700 1 --2- 172.21.15.92:0/1496418425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8394104320 0x7f8394199250 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.806+0000 7f839c7f2700 1 -- 172.21.15.92:0/1496418425 >> 172.21.15.92:0/1496418425 conn(0x7f83940fb320 msgr2=0x7f8394102660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:14.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.806+0000 7f839c7f2700 1 -- 172.21.15.92:0/1496418425 shutdown_connections 2023-10-16T13:13:14.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.806+0000 7f839c7f2700 1 -- 172.21.15.92:0/1496418425 wait complete. 2023-10-16T13:13:14.811 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 27 2023-10-16T13:13:14.821 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-10-16T13:13:14.821 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-10-16T13:13:14.821 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:13:14.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.940+0000 7f7dbdb66700 1 -- 172.21.15.92:0/481375199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8101390 msgr2=0x7f7db81017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:14.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.940+0000 7f7dbdb66700 1 --2- 172.21.15.92:0/481375199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8101390 0x7f7db81017b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009990 tx=0x7f7dac009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.940+0000 7f7dbdb66700 1 -- 172.21.15.92:0/481375199 shutdown_connections 2023-10-16T13:13:14.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.940+0000 7f7dbdb66700 1 --2- 172.21.15.92:0/481375199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8101390 0x7f7db81017b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.940+0000 7f7dbdb66700 1 --2- 172.21.15.92:0/481375199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7db81009a0 0x7f7db8108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.940+0000 7f7dbdb66700 1 --2- 172.21.15.92:0/481375199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7db80fffe0 0x7f7db8100460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.940+0000 7f7dbdb66700 1 -- 172.21.15.92:0/481375199 >> 172.21.15.92:0/481375199 conn(0x7f7db80faab0 msgr2=0x7f7db80fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:14.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.940+0000 7f7dbdb66700 1 -- 172.21.15.92:0/481375199 shutdown_connections 2023-10-16T13:13:14.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.940+0000 7f7dbdb66700 1 -- 172.21.15.92:0/481375199 wait complete. 2023-10-16T13:13:14.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.940+0000 7f7dbdb66700 1 Processor -- start 2023-10-16T13:13:14.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7dbdb66700 1 -- start start 2023-10-16T13:13:14.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7dbdb66700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7db80fffe0 0x7f7db80ffa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:14.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7dbdb66700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7db81009a0 0x7f7db819b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:14.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7dbdb66700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8101390 0x7f7db819df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:14.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7dbdb66700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db819e6e0 con 0x7f7db8101390 2023-10-16T13:13:14.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7dbdb66700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db819e850 con 0x7f7db80fffe0 2023-10-16T13:13:14.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7dbdb66700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db819ea10 con 0x7f7db81009a0 2023-10-16T13:13:14.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7db7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8101390 0x7f7db819df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:14.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7db7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8101390 0x7f7db819df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36840/0 (socket says 172.21.15.92:36840) 2023-10-16T13:13:14.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7db7fff700 1 -- 172.21.15.92:0/2156050226 learned_addr learned my addr 172.21.15.92:0/2156050226 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:14.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7db6ffd700 1 --2- 172.21.15.92:0/2156050226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7db81009a0 0x7f7db819b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:14.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7db77fe700 1 --2- 172.21.15.92:0/2156050226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7db80fffe0 0x7f7db80ffa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:14.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7db7fff700 1 -- 172.21.15.92:0/2156050226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7db81009a0 msgr2=0x7f7db819b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:14.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7db7fff700 1 --2- 172.21.15.92:0/2156050226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7db81009a0 0x7f7db819b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7db7fff700 1 -- 172.21.15.92:0/2156050226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7db80fffe0 msgr2=0x7f7db80ffa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:14.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7db7fff700 1 --2- 172.21.15.92:0/2156050226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7db80fffe0 0x7f7db80ffa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:14.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7db7fff700 1 -- 172.21.15.92:0/2156050226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac0095f0 con 0x7f7db8101390 2023-10-16T13:13:14.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7db7fff700 1 --2- 172.21.15.92:0/2156050226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8101390 0x7f7db819df40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7db0007ee0 tx=0x7f7db000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:14.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7db4ff9700 1 -- 172.21.15.92:0/2156050226 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0017070 con 0x7f7db8101390 2023-10-16T13:13:14.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7db4ff9700 1 -- 172.21.15.92:0/2156050226 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7db000f040 con 0x7f7db8101390 2023-10-16T13:13:14.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7db4ff9700 1 -- 172.21.15.92:0/2156050226 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0005760 con 0x7f7db8101390 2023-10-16T13:13:14.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.941+0000 7f7dbdb66700 1 -- 172.21.15.92:0/2156050226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db819ecf0 con 0x7f7db8101390 2023-10-16T13:13:14.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.942+0000 7f7dbdb66700 1 -- 172.21.15.92:0/2156050226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db819f1b0 con 0x7f7db8101390 2023-10-16T13:13:14.952 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:14 smithi152 ceph-mon[104423]: pgmap v304: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 9 op/s 2023-10-16T13:13:14.952 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:14 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2191946471' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:13:14.952 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:14 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3675318281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:13:14.952 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:14 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/430114212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:13:14.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.942+0000 7f7dbdb66700 1 -- 172.21.15.92:0/2156050226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db8106c40 con 0x7f7db8101390 2023-10-16T13:13:14.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.943+0000 7f7db4ff9700 1 -- 172.21.15.92:0/2156050226 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7db00058c0 con 0x7f7db8101390 2023-10-16T13:13:14.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.944+0000 7f7db4ff9700 1 --2- 172.21.15.92:0/2156050226 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7da00a1520 0x7f7da00a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:14.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.944+0000 7f7db77fe700 1 --2- 172.21.15.92:0/2156050226 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7da00a1520 0x7f7da00a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:14.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.944+0000 7f7db4ff9700 1 -- 172.21.15.92:0/2156050226 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f7db00cc490 con 0x7f7db8101390 2023-10-16T13:13:14.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.944+0000 7f7db77fe700 1 --2- 172.21.15.92:0/2156050226 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7da00a1520 0x7f7da00a39e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7dac006010 tx=0x7f7dac00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:14.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:14.948+0000 7f7db4ff9700 1 -- 172.21.15.92:0/2156050226 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7db0095af0 con 0x7f7db8101390 2023-10-16T13:13:15.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:14 smithi118 ceph-mon[103969]: pgmap v304: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 9 op/s 2023-10-16T13:13:15.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:14 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2191946471' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:13:15.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:14 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3675318281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:13:15.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:14 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/430114212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:13:15.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.136+0000 7f7dbdb66700 1 -- 172.21.15.92:0/2156050226 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7db802d2f0 con 0x7f7da00a1520 2023-10-16T13:13:15.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.146+0000 7f7db4ff9700 1 -- 172.21.15.92:0/2156050226 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345101 (secure 0 0 0) 0x7f7db802d2f0 con 0x7f7da00a1520 2023-10-16T13:13:15.154 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:13:15.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.150+0000 7f7dbdb66700 1 -- 172.21.15.92:0/2156050226 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7da00a1520 msgr2=0x7f7da00a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:15.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.150+0000 7f7dbdb66700 1 --2- 172.21.15.92:0/2156050226 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7da00a1520 0x7f7da00a39e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7dac006010 tx=0x7f7dac00b540 comp rx=0 tx=0).stop 2023-10-16T13:13:15.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.150+0000 7f7dbdb66700 1 -- 172.21.15.92:0/2156050226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8101390 msgr2=0x7f7db819df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:15.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.150+0000 7f7dbdb66700 1 --2- 172.21.15.92:0/2156050226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8101390 0x7f7db819df40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7db0007ee0 tx=0x7f7db000d3b0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.150+0000 7f7dbdb66700 1 -- 172.21.15.92:0/2156050226 shutdown_connections 2023-10-16T13:13:15.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.150+0000 7f7dbdb66700 1 --2- 172.21.15.92:0/2156050226 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7da00a1520 0x7f7da00a39e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.150+0000 7f7dbdb66700 1 --2- 172.21.15.92:0/2156050226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8101390 0x7f7db819df40 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.150+0000 7f7dbdb66700 1 --2- 172.21.15.92:0/2156050226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7db80fffe0 0x7f7db80ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.150+0000 7f7dbdb66700 1 --2- 172.21.15.92:0/2156050226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7db81009a0 0x7f7db819b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.150+0000 7f7dbdb66700 1 -- 172.21.15.92:0/2156050226 >> 172.21.15.92:0/2156050226 conn(0x7f7db80faab0 msgr2=0x7f7db80fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:15.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.150+0000 7f7dbdb66700 1 -- 172.21.15.92:0/2156050226 shutdown_connections 2023-10-16T13:13:15.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.150+0000 7f7dbdb66700 1 -- 172.21.15.92:0/2156050226 wait complete. 2023-10-16T13:13:15.159 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-10-16T13:13:15.165 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2023-10-16T13:13:13.282654+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655893,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":980,"num_read_kb":611,"num_write":429,"num_write_kb":3078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":1239417,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":853,"ondisk_log_size":853,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337296,"kb_used_data":13104,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604528,"statfs":{"total":1151940427776,"available":1151595036672,"internally_reserved":0,"allocated":13418496,"data_stored":7277643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19128,"internal_metadata":331855176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":531,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":53,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003526"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303433+0000","last_change":"2023-10-16T13:11:40.980978+0000","last_active":"2023-10-16T13:13:05.303433+0000","last_peered":"2023-10-16T13:13:05.303433+0000","last_clean":"2023-10-16T13:13:05.303433+0000","last_became_active":"2023-10-16T13:11:40.980468+0000","last_became_peered":"2023-10-16T13:11:40.980468+0000","last_unstale":"2023-10-16T13:13:05.303433+0000","last_undegraded":"2023-10-16T13:13:05.303433+0000","last_fullsized":"2023-10-16T13:13:05.303433+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.261864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.299587+0000","last_change":"2023-10-16T13:11:40.971625+0000","last_active":"2023-10-16T13:13:05.299587+0000","last_peered":"2023-10-16T13:13:05.299587+0000","last_clean":"2023-10-16T13:13:05.299587+0000","last_became_active":"2023-10-16T13:11:40.971028+0000","last_became_peered":"2023-10-16T13:11:40.971028+0000","last_unstale":"2023-10-16T13:13:05.299587+0000","last_undegraded":"2023-10-16T13:13:05.299587+0000","last_fullsized":"2023-10-16T13:13:05.299587+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:08.974553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.299538+0000","last_change":"2023-10-16T13:11:40.973705+0000","last_active":"2023-10-16T13:13:05.299538+0000","last_peered":"2023-10-16T13:13:05.299538+0000","last_clean":"2023-10-16T13:13:05.299538+0000","last_became_active":"2023-10-16T13:11:40.973347+0000","last_became_peered":"2023-10-16T13:11:40.973347+0000","last_unstale":"2023-10-16T13:13:05.299538+0000","last_undegraded":"2023-10-16T13:13:05.299538+0000","last_fullsized":"2023-10-16T13:13:05.299538+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:46.628383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.294240+0000","last_change":"2023-10-16T13:12:36.346510+0000","last_active":"2023-10-16T13:13:05.294240+0000","last_peered":"2023-10-16T13:13:05.294240+0000","last_clean":"2023-10-16T13:13:05.294240+0000","last_became_active":"2023-10-16T13:12:36.346149+0000","last_became_peered":"2023-10-16T13:12:36.346149+0000","last_unstale":"2023-10-16T13:13:05.294240+0000","last_undegraded":"2023-10-16T13:13:05.294240+0000","last_fullsized":"2023-10-16T13:13:05.294240+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:51.533396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292998+0000","last_change":"2023-10-16T13:11:40.976558+0000","last_active":"2023-10-16T13:13:05.292998+0000","last_peered":"2023-10-16T13:13:05.292998+0000","last_clean":"2023-10-16T13:13:05.292998+0000","last_became_active":"2023-10-16T13:11:40.976159+0000","last_became_peered":"2023-10-16T13:11:40.976159+0000","last_unstale":"2023-10-16T13:13:05.292998+0000","last_undegraded":"2023-10-16T13:13:05.292998+0000","last_fullsized":"2023-10-16T13:13:05.292998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:58:16.532294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295885+0000","last_change":"2023-10-16T13:11:40.977510+0000","last_active":"2023-10-16T13:13:05.295885+0000","last_peered":"2023-10-16T13:13:05.295885+0000","last_clean":"2023-10-16T13:13:05.295885+0000","last_became_active":"2023-10-16T13:11:40.977184+0000","last_became_peered":"2023-10-16T13:11:40.977184+0000","last_unstale":"2023-10-16T13:13:05.295885+0000","last_undegraded":"2023-10-16T13:13:05.295885+0000","last_fullsized":"2023-10-16T13:13:05.295885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:24:33.215430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.294624+0000","last_change":"2023-10-16T13:11:40.969982+0000","last_active":"2023-10-16T13:13:05.294624+0000","last_peered":"2023-10-16T13:13:05.294624+0000","last_clean":"2023-10-16T13:13:05.294624+0000","last_became_active":"2023-10-16T13:11:40.969651+0000","last_became_peered":"2023-10-16T13:11:40.969651+0000","last_unstale":"2023-10-16T13:13:05.294624+0000","last_undegraded":"2023-10-16T13:13:05.294624+0000","last_fullsized":"2023-10-16T13:13:05.294624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:37:01.702748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295874+0000","last_change":"2023-10-16T13:11:40.967952+0000","last_active":"2023-10-16T13:13:05.295874+0000","last_peered":"2023-10-16T13:13:05.295874+0000","last_clean":"2023-10-16T13:13:05.295874+0000","last_became_active":"2023-10-16T13:11:40.967621+0000","last_became_peered":"2023-10-16T13:11:40.967621+0000","last_unstale":"2023-10-16T13:13:05.295874+0000","last_undegraded":"2023-10-16T13:13:05.295874+0000","last_fullsized":"2023-10-16T13:13:05.295874+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:04:09.243563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.304200+0000","last_change":"2023-10-16T13:11:40.978172+0000","last_active":"2023-10-16T13:13:05.304200+0000","last_peered":"2023-10-16T13:13:05.304200+0000","last_clean":"2023-10-16T13:13:05.304200+0000","last_became_active":"2023-10-16T13:11:40.977727+0000","last_became_peered":"2023-10-16T13:11:40.977727+0000","last_unstale":"2023-10-16T13:13:05.304200+0000","last_undegraded":"2023-10-16T13:13:05.304200+0000","last_fullsized":"2023-10-16T13:13:05.304200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:06:16.469370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.301818+0000","last_change":"2023-10-16T13:11:40.973343+0000","last_active":"2023-10-16T13:13:05.301818+0000","last_peered":"2023-10-16T13:13:05.301818+0000","last_clean":"2023-10-16T13:13:05.301818+0000","last_became_active":"2023-10-16T13:11:40.972997+0000","last_became_peered":"2023-10-16T13:11:40.972997+0000","last_unstale":"2023-10-16T13:13:05.301818+0000","last_undegraded":"2023-10-16T13:13:05.301818+0000","last_fullsized":"2023-10-16T13:13:05.301818+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:23:21.235742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.298667+0000","last_change":"2023-10-16T13:11:40.980253+0000","last_active":"2023-10-16T13:13:05.298667+0000","last_peered":"2023-10-16T13:13:05.298667+0000","last_clean":"2023-10-16T13:13:05.298667+0000","last_became_active":"2023-10-16T13:11:40.979473+0000","last_became_peered":"2023-10-16T13:11:40.979473+0000","last_unstale":"2023-10-16T13:13:05.298667+0000","last_undegraded":"2023-10-16T13:13:05.298667+0000","last_fullsized":"2023-10-16T13:13:05.298667+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:37:46.976128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292256+0000","last_change":"2023-10-16T13:11:40.974791+0000","last_active":"2023-10-16T13:13:05.292256+0000","last_peered":"2023-10-16T13:13:05.292256+0000","last_clean":"2023-10-16T13:13:05.292256+0000","last_became_active":"2023-10-16T13:11:40.973353+0000","last_became_peered":"2023-10-16T13:11:40.973353+0000","last_unstale":"2023-10-16T13:13:05.292256+0000","last_undegraded":"2023-10-16T13:13:05.292256+0000","last_fullsized":"2023-10-16T13:13:05.292256+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:35:40.649071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.297133+0000","last_change":"2023-10-16T13:11:40.971681+0000","last_active":"2023-10-16T13:13:05.297133+0000","last_peered":"2023-10-16T13:13:05.297133+0000","last_clean":"2023-10-16T13:13:05.297133+0000","last_became_active":"2023-10-16T13:11:40.971349+0000","last_became_peered":"2023-10-16T13:11:40.971349+0000","last_unstale":"2023-10-16T13:13:05.297133+0000","last_undegraded":"2023-10-16T13:13:05.297133+0000","last_fullsized":"2023-10-16T13:13:05.297133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:50:38.285478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.301749+0000","last_change":"2023-10-16T13:11:40.971859+0000","last_active":"2023-10-16T13:13:05.301749+0000","last_peered":"2023-10-16T13:13:05.301749+0000","last_clean":"2023-10-16T13:13:05.301749+0000","last_became_active":"2023-10-16T13:11:40.971107+0000","last_became_peered":"2023-10-16T13:11:40.971107+0000","last_unstale":"2023-10-16T13:13:05.301749+0000","last_undegraded":"2023-10-16T13:13:05.301749+0000","last_fullsized":"2023-10-16T13:13:05.301749+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:57:52.655130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.302565+0000","last_change":"2023-10-16T13:11:40.976604+0000","last_active":"2023-10-16T13:13:05.302565+0000","last_peered":"2023-10-16T13:13:05.302565+0000","last_clean":"2023-10-16T13:13:05.302565+0000","last_became_active":"2023-10-16T13:11:40.976262+0000","last_became_peered":"2023-10-16T13:11:40.976262+0000","last_unstale":"2023-10-16T13:13:05.302565+0000","last_undegraded":"2023-10-16T13:13:05.302565+0000","last_fullsized":"2023-10-16T13:13:05.302565+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:18:55.867316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303865+0000","last_change":"2023-10-16T13:11:40.975785+0000","last_active":"2023-10-16T13:13:05.303865+0000","last_peered":"2023-10-16T13:13:05.303865+0000","last_clean":"2023-10-16T13:13:05.303865+0000","last_became_active":"2023-10-16T13:11:40.975463+0000","last_became_peered":"2023-10-16T13:11:40.975463+0000","last_unstale":"2023-10-16T13:13:05.303865+0000","last_undegraded":"2023-10-16T13:13:05.303865+0000","last_fullsized":"2023-10-16T13:13:05.303865+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:37:29.337596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303485+0000","last_change":"2023-10-16T13:11:40.980784+0000","last_active":"2023-10-16T13:13:05.303485+0000","last_peered":"2023-10-16T13:13:05.303485+0000","last_clean":"2023-10-16T13:13:05.303485+0000","last_became_active":"2023-10-16T13:11:40.980374+0000","last_became_peered":"2023-10-16T13:11:40.980374+0000","last_unstale":"2023-10-16T13:13:05.303485+0000","last_undegraded":"2023-10-16T13:13:05.303485+0000","last_fullsized":"2023-10-16T13:13:05.303485+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:38:12.236358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303359+0000","last_change":"2023-10-16T13:11:40.980775+0000","last_active":"2023-10-16T13:13:05.303359+0000","last_peered":"2023-10-16T13:13:05.303359+0000","last_clean":"2023-10-16T13:13:05.303359+0000","last_became_active":"2023-10-16T13:11:40.980261+0000","last_became_peered":"2023-10-16T13:11:40.980261+0000","last_unstale":"2023-10-16T13:13:05.303359+0000","last_undegraded":"2023-10-16T13:13:05.303359+0000","last_fullsized":"2023-10-16T13:13:05.303359+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:36:57.112989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.289251+0000","last_change":"2023-10-16T13:11:40.970030+0000","last_active":"2023-10-16T13:13:05.289251+0000","last_peered":"2023-10-16T13:13:05.289251+0000","last_clean":"2023-10-16T13:13:05.289251+0000","last_became_active":"2023-10-16T13:11:40.969698+0000","last_became_peered":"2023-10-16T13:11:40.969698+0000","last_unstale":"2023-10-16T13:13:05.289251+0000","last_undegraded":"2023-10-16T13:13:05.289251+0000","last_fullsized":"2023-10-16T13:13:05.289251+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:42:00.520386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":111,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:08.457233+0000","last_change":"2023-10-16T13:11:39.957688+0000","last_active":"2023-10-16T13:13:08.457233+0000","last_peered":"2023-10-16T13:13:08.457233+0000","last_clean":"2023-10-16T13:13:08.457233+0000","last_became_active":"2023-10-16T13:11:39.957391+0000","last_became_peered":"2023-10-16T13:11:39.957391+0000","last_unstale":"2023-10-16T13:13:08.457233+0000","last_undegraded":"2023-10-16T13:13:08.457233+0000","last_fullsized":"2023-10-16T13:13:08.457233+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:42:17.875770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292811+0000","last_change":"2023-10-16T13:11:40.968984+0000","last_active":"2023-10-16T13:13:05.292811+0000","last_peered":"2023-10-16T13:13:05.292811+0000","last_clean":"2023-10-16T13:13:05.292811+0000","last_became_active":"2023-10-16T13:11:40.968338+0000","last_became_peered":"2023-10-16T13:11:40.968338+0000","last_unstale":"2023-10-16T13:13:05.292811+0000","last_undegraded":"2023-10-16T13:13:05.292811+0000","last_fullsized":"2023-10-16T13:13:05.292811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:49:21.643029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.342126+0000","last_change":"2023-10-16T13:11:39.959458+0000","last_active":"2023-10-16T13:12:35.342126+0000","last_peered":"2023-10-16T13:12:35.342126+0000","last_clean":"2023-10-16T13:12:35.342126+0000","last_became_active":"2023-10-16T13:11:39.959155+0000","last_became_peered":"2023-10-16T13:11:39.959155+0000","last_unstale":"2023-10-16T13:12:35.342126+0000","last_undegraded":"2023-10-16T13:12:35.342126+0000","last_fullsized":"2023-10-16T13:12:35.342126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:18:30.725604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295104+0000","last_change":"2023-10-16T13:11:40.980168+0000","last_active":"2023-10-16T13:13:05.295104+0000","last_peered":"2023-10-16T13:13:05.295104+0000","last_clean":"2023-10-16T13:13:05.295104+0000","last_became_active":"2023-10-16T13:11:40.979839+0000","last_became_peered":"2023-10-16T13:11:40.979839+0000","last_unstale":"2023-10-16T13:13:05.295104+0000","last_undegraded":"2023-10-16T13:13:05.295104+0000","last_fullsized":"2023-10-16T13:13:05.295104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:25:31.374291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:12:36.364920+0000","last_change":"2023-10-16T13:12:36.364427+0000","last_active":"2023-10-16T13:12:36.364920+0000","last_peered":"2023-10-16T13:12:36.364920+0000","last_clean":"2023-10-16T13:12:36.364920+0000","last_became_active":"2023-10-16T13:12:36.350528+0000","last_became_peered":"2023-10-16T13:12:36.350528+0000","last_unstale":"2023-10-16T13:12:36.364920+0000","last_undegraded":"2023-10-16T13:12:36.364920+0000","last_fullsized":"2023-10-16T13:12:36.364920+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:16:17.166684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303398+0000","last_change":"2023-10-16T13:11:40.978989+0000","last_active":"2023-10-16T13:13:05.303398+0000","last_peered":"2023-10-16T13:13:05.303398+0000","last_clean":"2023-10-16T13:13:05.303398+0000","last_became_active":"2023-10-16T13:11:40.978582+0000","last_became_peered":"2023-10-16T13:11:40.978582+0000","last_unstale":"2023-10-16T13:13:05.303398+0000","last_undegraded":"2023-10-16T13:13:05.303398+0000","last_fullsized":"2023-10-16T13:13:05.303398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:29:54.733058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.346355+0000","last_change":"2023-10-16T13:11:39.955340+0000","last_active":"2023-10-16T13:12:35.346355+0000","last_peered":"2023-10-16T13:12:35.346355+0000","last_clean":"2023-10-16T13:12:35.346355+0000","last_became_active":"2023-10-16T13:11:39.955032+0000","last_became_peered":"2023-10-16T13:11:39.955032+0000","last_unstale":"2023-10-16T13:12:35.346355+0000","last_undegraded":"2023-10-16T13:12:35.346355+0000","last_fullsized":"2023-10-16T13:12:35.346355+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:01:11.518823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303337+0000","last_change":"2023-10-16T13:12:36.348095+0000","last_active":"2023-10-16T13:13:05.303337+0000","last_peered":"2023-10-16T13:13:05.303337+0000","last_clean":"2023-10-16T13:13:05.303337+0000","last_became_active":"2023-10-16T13:12:36.347771+0000","last_became_peered":"2023-10-16T13:12:36.347771+0000","last_unstale":"2023-10-16T13:13:05.303337+0000","last_undegraded":"2023-10-16T13:13:05.303337+0000","last_fullsized":"2023-10-16T13:13:05.303337+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:37:42.200445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1b","version":"85'7","reported_seq":123,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:07.395892+0000","last_change":"2023-10-16T13:12:36.353896+0000","last_active":"2023-10-16T13:13:07.395892+0000","last_peered":"2023-10-16T13:13:07.395892+0000","last_clean":"2023-10-16T13:13:07.395892+0000","last_became_active":"2023-10-16T13:12:36.347455+0000","last_became_peered":"2023-10-16T13:12:36.347455+0000","last_unstale":"2023-10-16T13:13:07.395892+0000","last_undegraded":"2023-10-16T13:13:07.395892+0000","last_fullsized":"2023-10-16T13:13:07.395892+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:46.709214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1012,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295779+0000","last_change":"2023-10-16T13:11:40.970345+0000","last_active":"2023-10-16T13:13:05.295779+0000","last_peered":"2023-10-16T13:13:05.295779+0000","last_clean":"2023-10-16T13:13:05.295779+0000","last_became_active":"2023-10-16T13:11:40.970024+0000","last_became_peered":"2023-10-16T13:11:40.970024+0000","last_unstale":"2023-10-16T13:13:05.295779+0000","last_undegraded":"2023-10-16T13:13:05.295779+0000","last_fullsized":"2023-10-16T13:13:05.295779+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:41.703074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.338123+0000","last_change":"2023-10-16T13:11:39.951194+0000","last_active":"2023-10-16T13:12:35.338123+0000","last_peered":"2023-10-16T13:12:35.338123+0000","last_clean":"2023-10-16T13:12:35.338123+0000","last_became_active":"2023-10-16T13:11:39.950837+0000","last_became_peered":"2023-10-16T13:11:39.950837+0000","last_unstale":"2023-10-16T13:12:35.338123+0000","last_undegraded":"2023-10-16T13:12:35.338123+0000","last_fullsized":"2023-10-16T13:12:35.338123+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:59:17.756924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.293658+0000","last_change":"2023-10-16T13:11:40.959602+0000","last_active":"2023-10-16T13:13:05.293658+0000","last_peered":"2023-10-16T13:13:05.293658+0000","last_clean":"2023-10-16T13:13:05.293658+0000","last_became_active":"2023-10-16T13:11:40.959231+0000","last_became_peered":"2023-10-16T13:11:40.959231+0000","last_unstale":"2023-10-16T13:13:05.293658+0000","last_undegraded":"2023-10-16T13:13:05.293658+0000","last_fullsized":"2023-10-16T13:13:05.293658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:59:54.623471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.343827+0000","last_change":"2023-10-16T13:11:39.952655+0000","last_active":"2023-10-16T13:12:35.343827+0000","last_peered":"2023-10-16T13:12:35.343827+0000","last_clean":"2023-10-16T13:12:35.343827+0000","last_became_active":"2023-10-16T13:11:39.952324+0000","last_became_peered":"2023-10-16T13:11:39.952324+0000","last_unstale":"2023-10-16T13:12:35.343827+0000","last_undegraded":"2023-10-16T13:12:35.343827+0000","last_fullsized":"2023-10-16T13:12:35.343827+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:09:14.077837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.298053+0000","last_change":"2023-10-16T13:11:40.969019+0000","last_active":"2023-10-16T13:13:05.298053+0000","last_peered":"2023-10-16T13:13:05.298053+0000","last_clean":"2023-10-16T13:13:05.298053+0000","last_became_active":"2023-10-16T13:11:40.968645+0000","last_became_peered":"2023-10-16T13:11:40.968645+0000","last_unstale":"2023-10-16T13:13:05.298053+0000","last_undegraded":"2023-10-16T13:13:05.298053+0000","last_fullsized":"2023-10-16T13:13:05.298053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:23:18.700377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.341262+0000","last_change":"2023-10-16T13:11:39.959826+0000","last_active":"2023-10-16T13:12:35.341262+0000","last_peered":"2023-10-16T13:12:35.341262+0000","last_clean":"2023-10-16T13:12:35.341262+0000","last_became_active":"2023-10-16T13:11:39.959490+0000","last_became_peered":"2023-10-16T13:11:39.959490+0000","last_unstale":"2023-10-16T13:12:35.341262+0000","last_undegraded":"2023-10-16T13:12:35.341262+0000","last_fullsized":"2023-10-16T13:12:35.341262+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:52:01.865005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295115+0000","last_change":"2023-10-16T13:11:40.977941+0000","last_active":"2023-10-16T13:13:05.295115+0000","last_peered":"2023-10-16T13:13:05.295115+0000","last_clean":"2023-10-16T13:13:05.295115+0000","last_became_active":"2023-10-16T13:11:40.977558+0000","last_became_peered":"2023-10-16T13:11:40.977558+0000","last_unstale":"2023-10-16T13:13:05.295115+0000","last_undegraded":"2023-10-16T13:13:05.295115+0000","last_fullsized":"2023-10-16T13:13:05.295115+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:29:16.932234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'5","reported_seq":188,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:10.400150+0000","last_change":"2023-10-16T13:11:39.953728+0000","last_active":"2023-10-16T13:13:10.400150+0000","last_peered":"2023-10-16T13:13:10.400150+0000","last_clean":"2023-10-16T13:13:10.400150+0000","last_became_active":"2023-10-16T13:11:39.953421+0000","last_became_peered":"2023-10-16T13:11:39.953421+0000","last_unstale":"2023-10-16T13:13:10.400150+0000","last_undegraded":"2023-10-16T13:13:10.400150+0000","last_fullsized":"2023-10-16T13:13:10.400150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:22:14.537974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":168,"num_read_kb":168,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303590+0000","last_change":"2023-10-16T13:11:40.978214+0000","last_active":"2023-10-16T13:13:05.303590+0000","last_peered":"2023-10-16T13:13:05.303590+0000","last_clean":"2023-10-16T13:13:05.303590+0000","last_became_active":"2023-10-16T13:11:40.977786+0000","last_became_peered":"2023-10-16T13:11:40.977786+0000","last_unstale":"2023-10-16T13:13:05.303590+0000","last_undegraded":"2023-10-16T13:13:05.303590+0000","last_fullsized":"2023-10-16T13:13:05.303590+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:43:51.218758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.344226+0000","last_change":"2023-10-16T13:11:39.959589+0000","last_active":"2023-10-16T13:12:35.344226+0000","last_peered":"2023-10-16T13:12:35.344226+0000","last_clean":"2023-10-16T13:12:35.344226+0000","last_became_active":"2023-10-16T13:11:39.959242+0000","last_became_peered":"2023-10-16T13:11:39.959242+0000","last_unstale":"2023-10-16T13:12:35.344226+0000","last_undegraded":"2023-10-16T13:12:35.344226+0000","last_fullsized":"2023-10-16T13:12:35.344226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:54.955605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.299538+0000","last_change":"2023-10-16T13:11:40.975814+0000","last_active":"2023-10-16T13:13:05.299538+0000","last_peered":"2023-10-16T13:13:05.299538+0000","last_clean":"2023-10-16T13:13:05.299538+0000","last_became_active":"2023-10-16T13:11:40.975485+0000","last_became_peered":"2023-10-16T13:11:40.975485+0000","last_unstale":"2023-10-16T13:13:05.299538+0000","last_undegraded":"2023-10-16T13:13:05.299538+0000","last_fullsized":"2023-10-16T13:13:05.299538+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:25.661616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.342931+0000","last_change":"2023-10-16T13:11:39.956586+0000","last_active":"2023-10-16T13:12:35.342931+0000","last_peered":"2023-10-16T13:12:35.342931+0000","last_clean":"2023-10-16T13:12:35.342931+0000","last_became_active":"2023-10-16T13:11:39.956270+0000","last_became_peered":"2023-10-16T13:11:39.956270+0000","last_unstale":"2023-10-16T13:12:35.342931+0000","last_undegraded":"2023-10-16T13:12:35.342931+0000","last_fullsized":"2023-10-16T13:12:35.342931+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:11:12.435377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.304529+0000","last_change":"2023-10-16T13:11:40.978918+0000","last_active":"2023-10-16T13:13:05.304529+0000","last_peered":"2023-10-16T13:13:05.304529+0000","last_clean":"2023-10-16T13:13:05.304529+0000","last_became_active":"2023-10-16T13:11:40.978520+0000","last_became_peered":"2023-10-16T13:11:40.978520+0000","last_unstale":"2023-10-16T13:13:05.304529+0000","last_undegraded":"2023-10-16T13:13:05.304529+0000","last_fullsized":"2023-10-16T13:13:05.304529+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:09:57.269111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'34","reported_seq":251,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:10.400223+0000","last_change":"2023-10-16T13:12:36.361156+0000","last_active":"2023-10-16T13:13:10.400223+0000","last_peered":"2023-10-16T13:13:10.400223+0000","last_clean":"2023-10-16T13:13:10.400223+0000","last_became_active":"2023-10-16T13:12:36.349336+0000","last_became_peered":"2023-10-16T13:12:36.349336+0000","last_unstale":"2023-10-16T13:13:10.400223+0000","last_undegraded":"2023-10-16T13:13:10.400223+0000","last_fullsized":"2023-10-16T13:13:10.400223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:55:10.489183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57795,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":166,"num_read_kb":139,"num_write":36,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":57546,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.291336+0000","last_change":"2023-10-16T13:11:40.969423+0000","last_active":"2023-10-16T13:13:05.291336+0000","last_peered":"2023-10-16T13:13:05.291336+0000","last_clean":"2023-10-16T13:13:05.291336+0000","last_became_active":"2023-10-16T13:11:40.969022+0000","last_became_peered":"2023-10-16T13:11:40.969022+0000","last_unstale":"2023-10-16T13:13:05.291336+0000","last_undegraded":"2023-10-16T13:13:05.291336+0000","last_fullsized":"2023-10-16T13:13:05.291336+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:51:26.911443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.338652+0000","last_change":"2023-10-16T13:11:39.962364+0000","last_active":"2023-10-16T13:12:35.338652+0000","last_peered":"2023-10-16T13:12:35.338652+0000","last_clean":"2023-10-16T13:12:35.338652+0000","last_became_active":"2023-10-16T13:11:39.962077+0000","last_became_peered":"2023-10-16T13:11:39.962077+0000","last_unstale":"2023-10-16T13:12:35.338652+0000","last_undegraded":"2023-10-16T13:12:35.338652+0000","last_fullsized":"2023-10-16T13:12:35.338652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:50:58.478054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.293992+0000","last_change":"2023-10-16T13:11:40.970958+0000","last_active":"2023-10-16T13:13:05.293992+0000","last_peered":"2023-10-16T13:13:05.293992+0000","last_clean":"2023-10-16T13:13:05.293992+0000","last_became_active":"2023-10-16T13:11:40.970670+0000","last_became_peered":"2023-10-16T13:11:40.970670+0000","last_unstale":"2023-10-16T13:13:05.293992+0000","last_undegraded":"2023-10-16T13:13:05.293992+0000","last_fullsized":"2023-10-16T13:13:05.293992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:47:30.594558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.341609+0000","last_change":"2023-10-16T13:11:39.957334+0000","last_active":"2023-10-16T13:12:35.341609+0000","last_peered":"2023-10-16T13:12:35.341609+0000","last_clean":"2023-10-16T13:12:35.341609+0000","last_became_active":"2023-10-16T13:11:39.957027+0000","last_became_peered":"2023-10-16T13:11:39.957027+0000","last_unstale":"2023-10-16T13:12:35.341609+0000","last_undegraded":"2023-10-16T13:12:35.341609+0000","last_fullsized":"2023-10-16T13:12:35.341609+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:27:37.164359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.304080+0000","last_change":"2023-10-16T13:11:40.977201+0000","last_active":"2023-10-16T13:13:05.304080+0000","last_peered":"2023-10-16T13:13:05.304080+0000","last_clean":"2023-10-16T13:13:05.304080+0000","last_became_active":"2023-10-16T13:11:40.976860+0000","last_became_peered":"2023-10-16T13:11:40.976860+0000","last_unstale":"2023-10-16T13:13:05.304080+0000","last_undegraded":"2023-10-16T13:13:05.304080+0000","last_fullsized":"2023-10-16T13:13:05.304080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:57.867339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'7","reported_seq":110,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:11.461998+0000","last_change":"2023-10-16T13:11:39.958627+0000","last_active":"2023-10-16T13:13:11.461998+0000","last_peered":"2023-10-16T13:13:11.461998+0000","last_clean":"2023-10-16T13:13:11.461998+0000","last_became_active":"2023-10-16T13:11:39.958230+0000","last_became_peered":"2023-10-16T13:11:39.958230+0000","last_unstale":"2023-10-16T13:13:11.461998+0000","last_undegraded":"2023-10-16T13:13:11.461998+0000","last_fullsized":"2023-10-16T13:13:11.461998+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:47:47.534392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.300019+0000","last_change":"2023-10-16T13:11:40.972841+0000","last_active":"2023-10-16T13:13:05.300019+0000","last_peered":"2023-10-16T13:13:05.300019+0000","last_clean":"2023-10-16T13:13:05.300019+0000","last_became_active":"2023-10-16T13:11:40.972406+0000","last_became_peered":"2023-10-16T13:11:40.972406+0000","last_unstale":"2023-10-16T13:13:05.300019+0000","last_undegraded":"2023-10-16T13:13:05.300019+0000","last_fullsized":"2023-10-16T13:13:05.300019+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:04.134000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.345733+0000","last_change":"2023-10-16T13:11:39.955064+0000","last_active":"2023-10-16T13:12:35.345733+0000","last_peered":"2023-10-16T13:12:35.345733+0000","last_clean":"2023-10-16T13:12:35.345733+0000","last_became_active":"2023-10-16T13:11:39.954690+0000","last_became_peered":"2023-10-16T13:11:39.954690+0000","last_unstale":"2023-10-16T13:12:35.345733+0000","last_undegraded":"2023-10-16T13:12:35.345733+0000","last_fullsized":"2023-10-16T13:12:35.345733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:30.341233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.287261+0000","last_change":"2023-10-16T13:11:40.978373+0000","last_active":"2023-10-16T13:13:05.287261+0000","last_peered":"2023-10-16T13:13:05.287261+0000","last_clean":"2023-10-16T13:13:05.287261+0000","last_became_active":"2023-10-16T13:11:40.977890+0000","last_became_peered":"2023-10-16T13:11:40.977890+0000","last_unstale":"2023-10-16T13:13:05.287261+0000","last_undegraded":"2023-10-16T13:13:05.287261+0000","last_fullsized":"2023-10-16T13:13:05.287261+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:33:21.566200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.346851+0000","last_change":"2023-10-16T13:11:39.952698+0000","last_active":"2023-10-16T13:12:35.346851+0000","last_peered":"2023-10-16T13:12:35.346851+0000","last_clean":"2023-10-16T13:12:35.346851+0000","last_became_active":"2023-10-16T13:11:39.952383+0000","last_became_peered":"2023-10-16T13:11:39.952383+0000","last_unstale":"2023-10-16T13:12:35.346851+0000","last_undegraded":"2023-10-16T13:12:35.346851+0000","last_fullsized":"2023-10-16T13:12:35.346851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:06:57.841990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.288531+0000","last_change":"2023-10-16T13:12:36.348036+0000","last_active":"2023-10-16T13:13:05.288531+0000","last_peered":"2023-10-16T13:13:05.288531+0000","last_clean":"2023-10-16T13:13:05.288531+0000","last_became_active":"2023-10-16T13:12:36.347566+0000","last_became_peered":"2023-10-16T13:12:36.347566+0000","last_unstale":"2023-10-16T13:13:05.288531+0000","last_undegraded":"2023-10-16T13:13:05.288531+0000","last_fullsized":"2023-10-16T13:13:05.288531+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:59:38.918902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.344912+0000","last_change":"2023-10-16T13:11:39.957430+0000","last_active":"2023-10-16T13:12:35.344912+0000","last_peered":"2023-10-16T13:12:35.344912+0000","last_clean":"2023-10-16T13:12:35.344912+0000","last_became_active":"2023-10-16T13:11:39.957088+0000","last_became_peered":"2023-10-16T13:11:39.957088+0000","last_unstale":"2023-10-16T13:12:35.344912+0000","last_undegraded":"2023-10-16T13:12:35.344912+0000","last_fullsized":"2023-10-16T13:12:35.344912+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:21:57.307718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.289154+0000","last_change":"2023-10-16T13:11:40.970009+0000","last_active":"2023-10-16T13:13:05.289154+0000","last_peered":"2023-10-16T13:13:05.289154+0000","last_clean":"2023-10-16T13:13:05.289154+0000","last_became_active":"2023-10-16T13:11:40.969668+0000","last_became_peered":"2023-10-16T13:11:40.969668+0000","last_unstale":"2023-10-16T13:13:05.289154+0000","last_undegraded":"2023-10-16T13:13:05.289154+0000","last_fullsized":"2023-10-16T13:13:05.289154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:48:35.556712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":104,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:09.459219+0000","last_change":"2023-10-16T13:11:39.958168+0000","last_active":"2023-10-16T13:13:09.459219+0000","last_peered":"2023-10-16T13:13:09.459219+0000","last_clean":"2023-10-16T13:13:09.459219+0000","last_became_active":"2023-10-16T13:11:39.957628+0000","last_became_peered":"2023-10-16T13:11:39.957628+0000","last_unstale":"2023-10-16T13:13:09.459219+0000","last_undegraded":"2023-10-16T13:13:09.459219+0000","last_fullsized":"2023-10-16T13:13:09.459219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:55:52.658523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.301832+0000","last_change":"2023-10-16T13:11:40.977161+0000","last_active":"2023-10-16T13:13:05.301832+0000","last_peered":"2023-10-16T13:13:05.301832+0000","last_clean":"2023-10-16T13:13:05.301832+0000","last_became_active":"2023-10-16T13:11:40.976821+0000","last_became_peered":"2023-10-16T13:11:40.976821+0000","last_unstale":"2023-10-16T13:13:05.301832+0000","last_undegraded":"2023-10-16T13:13:05.301832+0000","last_fullsized":"2023-10-16T13:13:05.301832+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:42:26.712826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.298415+0000","last_change":"2023-10-16T13:12:36.421172+0000","last_active":"2023-10-16T13:13:05.298415+0000","last_peered":"2023-10-16T13:13:05.298415+0000","last_clean":"2023-10-16T13:13:05.298415+0000","last_became_active":"2023-10-16T13:12:36.420820+0000","last_became_peered":"2023-10-16T13:12:36.420820+0000","last_unstale":"2023-10-16T13:13:05.298415+0000","last_undegraded":"2023-10-16T13:13:05.298415+0000","last_fullsized":"2023-10-16T13:13:05.298415+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:43:50.908556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'6","reported_seq":104,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:08.458081+0000","last_change":"2023-10-16T13:11:39.960180+0000","last_active":"2023-10-16T13:13:08.458081+0000","last_peered":"2023-10-16T13:13:08.458081+0000","last_clean":"2023-10-16T13:13:08.458081+0000","last_became_active":"2023-10-16T13:11:39.959816+0000","last_became_peered":"2023-10-16T13:11:39.959816+0000","last_unstale":"2023-10-16T13:13:08.458081+0000","last_undegraded":"2023-10-16T13:13:08.458081+0000","last_fullsized":"2023-10-16T13:13:08.458081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:14:08.890449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.290701+0000","last_change":"2023-10-16T13:11:40.975271+0000","last_active":"2023-10-16T13:13:05.290701+0000","last_peered":"2023-10-16T13:13:05.290701+0000","last_clean":"2023-10-16T13:13:05.290701+0000","last_became_active":"2023-10-16T13:11:40.974960+0000","last_became_peered":"2023-10-16T13:11:40.974960+0000","last_unstale":"2023-10-16T13:13:05.290701+0000","last_undegraded":"2023-10-16T13:13:05.290701+0000","last_fullsized":"2023-10-16T13:13:05.290701+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:09.467960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.341153+0000","last_change":"2023-10-16T13:11:39.951187+0000","last_active":"2023-10-16T13:12:35.341153+0000","last_peered":"2023-10-16T13:12:35.341153+0000","last_clean":"2023-10-16T13:12:35.341153+0000","last_became_active":"2023-10-16T13:11:39.950843+0000","last_became_peered":"2023-10-16T13:11:39.950843+0000","last_unstale":"2023-10-16T13:12:35.341153+0000","last_undegraded":"2023-10-16T13:12:35.341153+0000","last_fullsized":"2023-10-16T13:12:35.341153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:48.930247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":310,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.343565+0000","last_change":"2023-10-16T13:10:38.800469+0000","last_active":"2023-10-16T13:12:35.343565+0000","last_peered":"2023-10-16T13:12:35.343565+0000","last_clean":"2023-10-16T13:12:35.343565+0000","last_became_active":"2023-10-16T13:10:38.799911+0000","last_became_peered":"2023-10-16T13:10:38.799911+0000","last_unstale":"2023-10-16T13:12:35.343565+0000","last_undegraded":"2023-10-16T13:12:35.343565+0000","last_fullsized":"2023-10-16T13:12:35.343565+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:07:46.238647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:07:46.238647+0000","last_clean_scrub_stamp":"2023-10-16T13:07:46.238647+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:43:42.258738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.290528+0000","last_change":"2023-10-16T13:11:40.974984+0000","last_active":"2023-10-16T13:13:05.290528+0000","last_peered":"2023-10-16T13:13:05.290528+0000","last_clean":"2023-10-16T13:13:05.290528+0000","last_became_active":"2023-10-16T13:11:40.974689+0000","last_became_peered":"2023-10-16T13:11:40.974689+0000","last_unstale":"2023-10-16T13:13:05.290528+0000","last_undegraded":"2023-10-16T13:13:05.290528+0000","last_fullsized":"2023-10-16T13:13:05.290528+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:04.119797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.343748+0000","last_change":"2023-10-16T13:11:39.957999+0000","last_active":"2023-10-16T13:12:35.343748+0000","last_peered":"2023-10-16T13:12:35.343748+0000","last_clean":"2023-10-16T13:12:35.343748+0000","last_became_active":"2023-10-16T13:11:39.957043+0000","last_became_peered":"2023-10-16T13:11:39.957043+0000","last_unstale":"2023-10-16T13:12:35.343748+0000","last_undegraded":"2023-10-16T13:12:35.343748+0000","last_fullsized":"2023-10-16T13:12:35.343748+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:12:27.150065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.346569+0000","last_change":"2023-10-16T13:11:39.953082+0000","last_active":"2023-10-16T13:12:35.346569+0000","last_peered":"2023-10-16T13:12:35.346569+0000","last_clean":"2023-10-16T13:12:35.346569+0000","last_became_active":"2023-10-16T13:11:39.952785+0000","last_became_peered":"2023-10-16T13:11:39.952785+0000","last_unstale":"2023-10-16T13:12:35.346569+0000","last_undegraded":"2023-10-16T13:12:35.346569+0000","last_fullsized":"2023-10-16T13:12:35.346569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:06:34.427841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295250+0000","last_change":"2023-10-16T13:11:40.968761+0000","last_active":"2023-10-16T13:13:05.295250+0000","last_peered":"2023-10-16T13:13:05.295250+0000","last_clean":"2023-10-16T13:13:05.295250+0000","last_became_active":"2023-10-16T13:11:40.968466+0000","last_became_peered":"2023-10-16T13:11:40.968466+0000","last_unstale":"2023-10-16T13:13:05.295250+0000","last_undegraded":"2023-10-16T13:13:05.295250+0000","last_fullsized":"2023-10-16T13:13:05.295250+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:22:15.577411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'11","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:12:36.341238+0000","last_change":"2023-10-16T13:11:39.957019+0000","last_active":"2023-10-16T13:12:36.341238+0000","last_peered":"2023-10-16T13:12:36.341238+0000","last_clean":"2023-10-16T13:12:36.341238+0000","last_became_active":"2023-10-16T13:11:39.956687+0000","last_became_peered":"2023-10-16T13:11:39.956687+0000","last_unstale":"2023-10-16T13:12:36.341238+0000","last_undegraded":"2023-10-16T13:12:36.341238+0000","last_fullsized":"2023-10-16T13:12:36.341238+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:17.049740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.300128+0000","last_change":"2023-10-16T13:11:40.973938+0000","last_active":"2023-10-16T13:13:05.300128+0000","last_peered":"2023-10-16T13:13:05.300128+0000","last_clean":"2023-10-16T13:13:05.300128+0000","last_became_active":"2023-10-16T13:11:40.973579+0000","last_became_peered":"2023-10-16T13:11:40.973579+0000","last_unstale":"2023-10-16T13:13:05.300128+0000","last_undegraded":"2023-10-16T13:13:05.300128+0000","last_fullsized":"2023-10-16T13:13:05.300128+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:49:29.153231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.341898+0000","last_change":"2023-10-16T13:11:39.954368+0000","last_active":"2023-10-16T13:12:35.341898+0000","last_peered":"2023-10-16T13:12:35.341898+0000","last_clean":"2023-10-16T13:12:35.341898+0000","last_became_active":"2023-10-16T13:11:39.953967+0000","last_became_peered":"2023-10-16T13:11:39.953967+0000","last_unstale":"2023-10-16T13:12:35.341898+0000","last_undegraded":"2023-10-16T13:12:35.341898+0000","last_fullsized":"2023-10-16T13:12:35.341898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:43:49.278655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.302013+0000","last_change":"2023-10-16T13:11:40.975917+0000","last_active":"2023-10-16T13:13:05.302013+0000","last_peered":"2023-10-16T13:13:05.302013+0000","last_clean":"2023-10-16T13:13:05.302013+0000","last_became_active":"2023-10-16T13:11:40.975610+0000","last_became_peered":"2023-10-16T13:11:40.975610+0000","last_unstale":"2023-10-16T13:13:05.302013+0000","last_undegraded":"2023-10-16T13:13:05.302013+0000","last_fullsized":"2023-10-16T13:13:05.302013+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:41.006584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.342310+0000","last_change":"2023-10-16T13:11:39.960169+0000","last_active":"2023-10-16T13:12:35.342310+0000","last_peered":"2023-10-16T13:12:35.342310+0000","last_clean":"2023-10-16T13:12:35.342310+0000","last_became_active":"2023-10-16T13:11:39.959385+0000","last_became_peered":"2023-10-16T13:11:39.959385+0000","last_unstale":"2023-10-16T13:12:35.342310+0000","last_undegraded":"2023-10-16T13:12:35.342310+0000","last_fullsized":"2023-10-16T13:12:35.342310+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:50:12.442686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.275133+0000","last_change":"2023-10-16T13:11:40.971165+0000","last_active":"2023-10-16T13:13:05.275133+0000","last_peered":"2023-10-16T13:13:05.275133+0000","last_clean":"2023-10-16T13:13:05.275133+0000","last_became_active":"2023-10-16T13:11:40.970341+0000","last_became_peered":"2023-10-16T13:11:40.970341+0000","last_unstale":"2023-10-16T13:13:05.275133+0000","last_undegraded":"2023-10-16T13:13:05.275133+0000","last_fullsized":"2023-10-16T13:13:05.275133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:39:48.393642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.341601+0000","last_change":"2023-10-16T13:11:39.953044+0000","last_active":"2023-10-16T13:12:35.341601+0000","last_peered":"2023-10-16T13:12:35.341601+0000","last_clean":"2023-10-16T13:12:35.341601+0000","last_became_active":"2023-10-16T13:11:39.952752+0000","last_became_peered":"2023-10-16T13:11:39.952752+0000","last_unstale":"2023-10-16T13:12:35.341601+0000","last_undegraded":"2023-10-16T13:12:35.341601+0000","last_fullsized":"2023-10-16T13:12:35.341601+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:33:12.277430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.300954+0000","last_change":"2023-10-16T13:11:40.974739+0000","last_active":"2023-10-16T13:13:05.300954+0000","last_peered":"2023-10-16T13:13:05.300954+0000","last_clean":"2023-10-16T13:13:05.300954+0000","last_became_active":"2023-10-16T13:11:40.974387+0000","last_became_peered":"2023-10-16T13:11:40.974387+0000","last_unstale":"2023-10-16T13:13:05.300954+0000","last_undegraded":"2023-10-16T13:13:05.300954+0000","last_fullsized":"2023-10-16T13:13:05.300954+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:28:16.384359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:12:37.822867+0000","last_change":"2023-10-16T13:12:36.353537+0000","last_active":"2023-10-16T13:12:37.822867+0000","last_peered":"2023-10-16T13:12:37.822867+0000","last_clean":"2023-10-16T13:12:37.822867+0000","last_became_active":"2023-10-16T13:12:36.348246+0000","last_became_peered":"2023-10-16T13:12:36.348246+0000","last_unstale":"2023-10-16T13:12:37.822867+0000","last_undegraded":"2023-10-16T13:12:37.822867+0000","last_fullsized":"2023-10-16T13:12:37.822867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:52:54.550287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292097+0000","last_change":"2023-10-16T13:11:40.971153+0000","last_active":"2023-10-16T13:13:05.292097+0000","last_peered":"2023-10-16T13:13:05.292097+0000","last_clean":"2023-10-16T13:13:05.292097+0000","last_became_active":"2023-10-16T13:11:40.970772+0000","last_became_peered":"2023-10-16T13:11:40.970772+0000","last_unstale":"2023-10-16T13:13:05.292097+0000","last_undegraded":"2023-10-16T13:13:05.292097+0000","last_fullsized":"2023-10-16T13:13:05.292097+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:34.450600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.345873+0000","last_change":"2023-10-16T13:11:39.957589+0000","last_active":"2023-10-16T13:12:35.345873+0000","last_peered":"2023-10-16T13:12:35.345873+0000","last_clean":"2023-10-16T13:12:35.345873+0000","last_became_active":"2023-10-16T13:11:39.957334+0000","last_became_peered":"2023-10-16T13:11:39.957334+0000","last_unstale":"2023-10-16T13:12:35.345873+0000","last_undegraded":"2023-10-16T13:12:35.345873+0000","last_fullsized":"2023-10-16T13:12:35.345873+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:42:58.126279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.299537+0000","last_change":"2023-10-16T13:11:40.979906+0000","last_active":"2023-10-16T13:13:05.299537+0000","last_peered":"2023-10-16T13:13:05.299537+0000","last_clean":"2023-10-16T13:13:05.299537+0000","last_became_active":"2023-10-16T13:11:40.979506+0000","last_became_peered":"2023-10-16T13:11:40.979506+0000","last_unstale":"2023-10-16T13:13:05.299537+0000","last_undegraded":"2023-10-16T13:13:05.299537+0000","last_fullsized":"2023-10-16T13:13:05.299537+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:06:33.566642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":103,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:07.457207+0000","last_change":"2023-10-16T13:11:39.961062+0000","last_active":"2023-10-16T13:13:07.457207+0000","last_peered":"2023-10-16T13:13:07.457207+0000","last_clean":"2023-10-16T13:13:07.457207+0000","last_became_active":"2023-10-16T13:11:39.960615+0000","last_became_peered":"2023-10-16T13:11:39.960615+0000","last_unstale":"2023-10-16T13:13:07.457207+0000","last_undegraded":"2023-10-16T13:13:07.457207+0000","last_fullsized":"2023-10-16T13:13:07.457207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:59:52.598863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.299689+0000","last_change":"2023-10-16T13:11:40.979874+0000","last_active":"2023-10-16T13:13:05.299689+0000","last_peered":"2023-10-16T13:13:05.299689+0000","last_clean":"2023-10-16T13:13:05.299689+0000","last_became_active":"2023-10-16T13:11:40.979444+0000","last_became_peered":"2023-10-16T13:11:40.979444+0000","last_unstale":"2023-10-16T13:13:05.299689+0000","last_undegraded":"2023-10-16T13:13:05.299689+0000","last_fullsized":"2023-10-16T13:13:05.299689+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:27:38.533986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.342306+0000","last_change":"2023-10-16T13:11:39.962428+0000","last_active":"2023-10-16T13:12:35.342306+0000","last_peered":"2023-10-16T13:12:35.342306+0000","last_clean":"2023-10-16T13:12:35.342306+0000","last_became_active":"2023-10-16T13:11:39.962028+0000","last_became_peered":"2023-10-16T13:11:39.962028+0000","last_unstale":"2023-10-16T13:12:35.342306+0000","last_undegraded":"2023-10-16T13:12:35.342306+0000","last_fullsized":"2023-10-16T13:12:35.342306+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:43:25.415571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295958+0000","last_change":"2023-10-16T13:12:36.352328+0000","last_active":"2023-10-16T13:13:05.295958+0000","last_peered":"2023-10-16T13:13:05.295958+0000","last_clean":"2023-10-16T13:13:05.295958+0000","last_became_active":"2023-10-16T13:12:36.348641+0000","last_became_peered":"2023-10-16T13:12:36.348641+0000","last_unstale":"2023-10-16T13:13:05.295958+0000","last_undegraded":"2023-10-16T13:13:05.295958+0000","last_fullsized":"2023-10-16T13:13:05.295958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:41:00.806794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.344184+0000","last_change":"2023-10-16T13:11:39.960173+0000","last_active":"2023-10-16T13:12:35.344184+0000","last_peered":"2023-10-16T13:12:35.344184+0000","last_clean":"2023-10-16T13:12:35.344184+0000","last_became_active":"2023-10-16T13:11:39.959839+0000","last_became_peered":"2023-10-16T13:11:39.959839+0000","last_unstale":"2023-10-16T13:12:35.344184+0000","last_undegraded":"2023-10-16T13:12:35.344184+0000","last_fullsized":"2023-10-16T13:12:35.344184+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:31:16.379341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.296310+0000","last_change":"2023-10-16T13:11:40.974349+0000","last_active":"2023-10-16T13:13:05.296310+0000","last_peered":"2023-10-16T13:13:05.296310+0000","last_clean":"2023-10-16T13:13:05.296310+0000","last_became_active":"2023-10-16T13:11:40.973189+0000","last_became_peered":"2023-10-16T13:11:40.973189+0000","last_unstale":"2023-10-16T13:13:05.296310+0000","last_undegraded":"2023-10-16T13:13:05.296310+0000","last_fullsized":"2023-10-16T13:13:05.296310+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:45:05.177277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292212+0000","last_change":"2023-10-16T13:11:40.972862+0000","last_active":"2023-10-16T13:13:05.292212+0000","last_peered":"2023-10-16T13:13:05.292212+0000","last_clean":"2023-10-16T13:13:05.292212+0000","last_became_active":"2023-10-16T13:11:40.972558+0000","last_became_peered":"2023-10-16T13:11:40.972558+0000","last_unstale":"2023-10-16T13:13:05.292212+0000","last_undegraded":"2023-10-16T13:13:05.292212+0000","last_fullsized":"2023-10-16T13:13:05.292212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:09:36.149610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.289075+0000","last_change":"2023-10-16T13:11:40.973449+0000","last_active":"2023-10-16T13:13:05.289075+0000","last_peered":"2023-10-16T13:13:05.289075+0000","last_clean":"2023-10-16T13:13:05.289075+0000","last_became_active":"2023-10-16T13:11:40.973044+0000","last_became_peered":"2023-10-16T13:11:40.973044+0000","last_unstale":"2023-10-16T13:13:05.289075+0000","last_undegraded":"2023-10-16T13:13:05.289075+0000","last_fullsized":"2023-10-16T13:13:05.289075+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:22.883943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.300066+0000","last_change":"2023-10-16T13:11:40.970871+0000","last_active":"2023-10-16T13:13:05.300066+0000","last_peered":"2023-10-16T13:13:05.300066+0000","last_clean":"2023-10-16T13:13:05.300066+0000","last_became_active":"2023-10-16T13:11:40.970554+0000","last_became_peered":"2023-10-16T13:11:40.970554+0000","last_unstale":"2023-10-16T13:13:05.300066+0000","last_undegraded":"2023-10-16T13:13:05.300066+0000","last_fullsized":"2023-10-16T13:13:05.300066+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:46:34.449007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.302378+0000","last_change":"2023-10-16T13:11:40.975827+0000","last_active":"2023-10-16T13:13:05.302378+0000","last_peered":"2023-10-16T13:13:05.302378+0000","last_clean":"2023-10-16T13:13:05.302378+0000","last_became_active":"2023-10-16T13:11:40.975514+0000","last_became_peered":"2023-10-16T13:11:40.975514+0000","last_unstale":"2023-10-16T13:13:05.302378+0000","last_undegraded":"2023-10-16T13:13:05.302378+0000","last_fullsized":"2023-10-16T13:13:05.302378+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:34:47.901390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.300133+0000","last_change":"2023-10-16T13:11:40.975088+0000","last_active":"2023-10-16T13:13:05.300133+0000","last_peered":"2023-10-16T13:13:05.300133+0000","last_clean":"2023-10-16T13:13:05.300133+0000","last_became_active":"2023-10-16T13:11:40.974286+0000","last_became_peered":"2023-10-16T13:11:40.974286+0000","last_unstale":"2023-10-16T13:13:05.300133+0000","last_undegraded":"2023-10-16T13:13:05.300133+0000","last_fullsized":"2023-10-16T13:13:05.300133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:15:50.270651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292594+0000","last_change":"2023-10-16T13:11:40.973111+0000","last_active":"2023-10-16T13:13:05.292594+0000","last_peered":"2023-10-16T13:13:05.292594+0000","last_clean":"2023-10-16T13:13:05.292594+0000","last_became_active":"2023-10-16T13:11:40.972826+0000","last_became_peered":"2023-10-16T13:11:40.972826+0000","last_unstale":"2023-10-16T13:13:05.292594+0000","last_undegraded":"2023-10-16T13:13:05.292594+0000","last_fullsized":"2023-10-16T13:13:05.292594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:43.523165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.288220+0000","last_change":"2023-10-16T13:11:40.980303+0000","last_active":"2023-10-16T13:13:05.288220+0000","last_peered":"2023-10-16T13:13:05.288220+0000","last_clean":"2023-10-16T13:13:05.288220+0000","last_became_active":"2023-10-16T13:11:40.979987+0000","last_became_peered":"2023-10-16T13:11:40.979987+0000","last_unstale":"2023-10-16T13:13:05.288220+0000","last_undegraded":"2023-10-16T13:13:05.288220+0000","last_fullsized":"2023-10-16T13:13:05.288220+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:38:16.402231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292515+0000","last_change":"2023-10-16T13:11:40.966547+0000","last_active":"2023-10-16T13:13:05.292515+0000","last_peered":"2023-10-16T13:13:05.292515+0000","last_clean":"2023-10-16T13:13:05.292515+0000","last_became_active":"2023-10-16T13:11:40.966149+0000","last_became_peered":"2023-10-16T13:11:40.966149+0000","last_unstale":"2023-10-16T13:13:05.292515+0000","last_undegraded":"2023-10-16T13:13:05.292515+0000","last_fullsized":"2023-10-16T13:13:05.292515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:27:47.007356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295257+0000","last_change":"2023-10-16T13:11:40.968511+0000","last_active":"2023-10-16T13:13:05.295257+0000","last_peered":"2023-10-16T13:13:05.295257+0000","last_clean":"2023-10-16T13:13:05.295257+0000","last_became_active":"2023-10-16T13:11:40.968185+0000","last_became_peered":"2023-10-16T13:11:40.968185+0000","last_unstale":"2023-10-16T13:13:05.295257+0000","last_undegraded":"2023-10-16T13:13:05.295257+0000","last_fullsized":"2023-10-16T13:13:05.295257+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:31:43.779875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.293638+0000","last_change":"2023-10-16T13:11:40.974616+0000","last_active":"2023-10-16T13:13:05.293638+0000","last_peered":"2023-10-16T13:13:05.293638+0000","last_clean":"2023-10-16T13:13:05.293638+0000","last_became_active":"2023-10-16T13:11:40.974295+0000","last_became_peered":"2023-10-16T13:11:40.974295+0000","last_unstale":"2023-10-16T13:13:05.293638+0000","last_undegraded":"2023-10-16T13:13:05.293638+0000","last_fullsized":"2023-10-16T13:13:05.293638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:47.838853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.304078+0000","last_change":"2023-10-16T13:11:40.974927+0000","last_active":"2023-10-16T13:13:05.304078+0000","last_peered":"2023-10-16T13:13:05.304078+0000","last_clean":"2023-10-16T13:13:05.304078+0000","last_became_active":"2023-10-16T13:11:40.974332+0000","last_became_peered":"2023-10-16T13:11:40.974332+0000","last_unstale":"2023-10-16T13:13:05.304078+0000","last_undegraded":"2023-10-16T13:13:05.304078+0000","last_fullsized":"2023-10-16T13:13:05.304078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:07:24.974440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.301095+0000","last_change":"2023-10-16T13:11:40.972793+0000","last_active":"2023-10-16T13:13:05.301095+0000","last_peered":"2023-10-16T13:13:05.301095+0000","last_clean":"2023-10-16T13:13:05.301095+0000","last_became_active":"2023-10-16T13:11:40.972008+0000","last_became_peered":"2023-10-16T13:11:40.972008+0000","last_unstale":"2023-10-16T13:13:05.301095+0000","last_undegraded":"2023-10-16T13:13:05.301095+0000","last_fullsized":"2023-10-16T13:13:05.301095+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:53.487238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.300269+0000","last_change":"2023-10-16T13:11:40.977282+0000","last_active":"2023-10-16T13:13:05.300269+0000","last_peered":"2023-10-16T13:13:05.300269+0000","last_clean":"2023-10-16T13:13:05.300269+0000","last_became_active":"2023-10-16T13:11:40.976872+0000","last_became_peered":"2023-10-16T13:11:40.976872+0000","last_unstale":"2023-10-16T13:13:05.300269+0000","last_undegraded":"2023-10-16T13:13:05.300269+0000","last_fullsized":"2023-10-16T13:13:05.300269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:43:48.735584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65279,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":854,"num_read_kb":502,"num_write":246,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":58558,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":197109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449118,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":443952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.55700000000000005,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40699999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.45300000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.48799999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86399999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.58299999999999996,"15min":0.57299999999999995},"min":{"1min":0.40500000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.56699999999999995}]},{"osd":2,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.48699999999999999,"15min":0.47699999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.53300000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.63,"15min":0.621},"min":{"1min":0.47099999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.69999999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61299999999999999,"15min":0.60999999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.621,"15min":0.621},"min":{"1min":0.45600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.68200000000000005}]},{"osd":6,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.63},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.93899999999999995}]},{"osd":7,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.56299999999999994,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70199999999999996,"15min":0.69799999999999995},"min":{"1min":0.54000000000000004,"5min":0.434,"15min":0.434},"max":{"1min":0.95899999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.74099999999999999}]},{"osd":8,"last update":"Mon Oct 16 13:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.83199999999999996}]},{"osd":9,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76600000000000001,"15min":0.76300000000000001},"min":{"1min":0.58399999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.49299999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.71599999999999997}]},{"osd":10,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.76900000000000002,"15min":0.76600000000000001},"min":{"1min":0.627,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92800000000000005,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.79900000000000004,"15min":0.79300000000000004},"min":{"1min":0.68100000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.85899999999999999}]}]},{"osd":10,"up_from":71,"seq":304942678050,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1630208,"data_stored":1092995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.627},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.68000000000000005}]},{"osd":1,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.434,"15min":0.438},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.5,"15min":0.51100000000000001},"min":{"1min":0.34699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.61099999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.29599999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.50800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84299999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.45700000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.65200000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.57899999999999996,"15min":0.59099999999999997},"min":{"1min":0.41799999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75600000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.63800000000000001,"15min":0.65200000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.73299999999999998,"5min":0.997,"15min":0.997},"last":0.49399999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.434,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77500000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.438,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.89900000000000002,"5min":1.161,"15min":1.161},"last":0.34899999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67100000000000004,"15min":0.66000000000000003},"min":{"1min":0.57499999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.53600000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93999999999999995,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.55800000000000005}]},{"osd":6,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.68899999999999995,"15min":0.70099999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88300000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.69599999999999995,"15min":0.70399999999999996},"min":{"1min":0.52100000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.82699999999999996,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.63800000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.504}]},{"osd":8,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.61799999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.91900000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77800000000000002,"15min":0.77600000000000002},"min":{"1min":0.64300000000000002,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0049999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.74299999999999999}]},{"osd":9,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.85199999999999998,"15min":0.874},"min":{"1min":0.56399999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.86499999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97799999999999998,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.71799999999999997}]},{"osd":11,"last update":"Mon Oct 16 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.76600000000000001,"15min":0.76200000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.052,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96099999999999997,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.66500000000000004}]}]},{"osd":9,"up_from":66,"seq":283467841575,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":443687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.39000000000000001,"15min":0.39500000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.35099999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.58199999999999996,"15min":0.59199999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.85299999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79600000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.374}]},{"osd":2,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.38800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76000000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.497},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.755,"5min":0.88,"15min":0.88},"last":0.54200000000000004}]},{"osd":3,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.50800000000000001,"15min":0.51600000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.5,"15min":0.50600000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.70799999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.45000000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.625,"15min":0.63700000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.879,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63200000000000001,"15min":0.63800000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91100000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.46100000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79800000000000004,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84299999999999997,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.51300000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83299999999999996,"5min":1.109,"15min":1.109},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80900000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.60899999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70299999999999996,"15min":0.71299999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86099999999999999,"5min":0.996,"15min":0.996},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92800000000000005,"5min":1.222,"15min":1.222},"last":0.64500000000000002}]},{"osd":8,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72499999999999998,"15min":0.73499999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84799999999999998,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.746,"15min":0.755},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86499999999999999,"5min":1.153,"15min":1.153},"last":0.626}]},{"osd":10,"last update":"Mon Oct 16 13:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71499999999999997,"15min":0.72699999999999998},"min":{"1min":0.501,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.78200000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.73499999999999999,"15min":0.747},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.80900000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68400000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070507,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":443942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.40600000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.754,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38500000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78800000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.56699999999999995}]},{"osd":1,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60699999999999998,"15min":0.58899999999999997},"min":{"1min":0.52200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.625,"15min":0.61399999999999999},"min":{"1min":0.497,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85899999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.45300000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46200000000000002,"15min":0.45100000000000001},"min":{"1min":0.40300000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.65500000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.503,"15min":0.48299999999999998},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.54200000000000004}]},{"osd":3,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.42299999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.77400000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59699999999999998,"15min":0.58099999999999996},"min":{"1min":0.47499999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82699999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.75700000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.63600000000000001,"15min":0.63300000000000001},"min":{"1min":0.48399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.66000000000000003,"15min":0.64100000000000001},"min":{"1min":0.55000000000000004,"5min":0.377,"15min":0.377},"max":{"1min":1.02,"5min":1.036,"15min":1.036},"last":0.80700000000000005}]},{"osd":5,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.58699999999999997,"15min":0.55500000000000005},"min":{"1min":0.51500000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.60999999999999999,"15min":0.57999999999999996},"min":{"1min":0.52300000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.997,"5min":1.042,"15min":1.042},"last":0.71399999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.71899999999999997,"15min":0.67100000000000004},"min":{"1min":0.63100000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96199999999999997,"5min":3.6659999999999999,"15min":3.6659999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.74099999999999999,"15min":0.71499999999999997},"min":{"1min":0.56499999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":0.64900000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.745,"15min":0.71899999999999997},"min":{"1min":0.60099999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.73699999999999999,"15min":0.71899999999999997},"min":{"1min":0.61099999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.038,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.78100000000000003}]},{"osd":9,"last update":"Mon Oct 16 13:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.74199999999999999,"15min":0.71699999999999997},"min":{"1min":0.61099999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.415,"5min":2.415,"15min":2.415},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.71599999999999997,"15min":0.69999999999999996},"min":{"1min":0.54600000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.93200000000000005}]},{"osd":10,"last update":"Mon Oct 16 13:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.72399999999999998,"15min":0.70399999999999996},"min":{"1min":0.64300000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.034,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.85499999999999998,"15min":0.85099999999999998},"min":{"1min":0.69199999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.046,"5min":3.694,"15min":3.694},"last":0.96499999999999997}]},{"osd":11,"last update":"Mon Oct 16 13:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.89900000000000002}]}]},{"osd":7,"up_from":51,"seq":219043332143,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1552384,"data_stored":1037137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.38},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.34699999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.42199999999999999,"15min":0.41199999999999998},"min":{"1min":0.33700000000000002,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.42599999999999999,"15min":0.41199999999999998},"min":{"1min":0.36399999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.45500000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.48799999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.59899999999999998,"15min":0.57899999999999996},"min":{"1min":0.44900000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.66900000000000004}]},{"osd":3,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.59499999999999997},"min":{"1min":0.45400000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.72099999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.625},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.441,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78000000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55800000000000005}]},{"osd":4,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.51000000000000001,"15min":0.49199999999999999},"min":{"1min":0.40000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.49099999999999999,"15min":0.46899999999999997},"min":{"1min":0.39000000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.51100000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.65700000000000003,"15min":0.64400000000000002},"min":{"1min":0.55600000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89500000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68000000000000005,"15min":0.66000000000000003},"min":{"1min":0.51600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94399999999999995,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66900000000000004,"15min":0.65900000000000003},"min":{"1min":0.51400000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.67700000000000005,"15min":0.66300000000000003},"min":{"1min":0.54800000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.75700000000000001}]},{"osd":8,"last update":"Mon Oct 16 13:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.71999999999999997,"15min":0.69399999999999995},"min":{"1min":0.60899999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.68100000000000005,"15min":0.65700000000000003},"min":{"1min":0.65200000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.77500000000000002}]},{"osd":9,"last update":"Mon Oct 16 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.72599999999999998,"15min":0.71999999999999997},"min":{"1min":0.623,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.56899999999999995,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.85199999999999998}]},{"osd":10,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.70499999999999996,"15min":0.69799999999999995},"min":{"1min":0.53000000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.749,"15min":0.74099999999999999},"min":{"1min":0.64500000000000002,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.80400000000000005}]},{"osd":11,"last update":"Mon Oct 16 13:12:44 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.90200000000000002}]}]},{"osd":6,"up_from":46,"seq":197568495668,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":443287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.376,"15min":0.374},"min":{"1min":0.255,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":0.621,"15min":0.621},"last":0.375},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.39400000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54300000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.44800000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.36599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73199999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":1,"15min":1},"last":0.48199999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.45100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70799999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60799999999999998,"15min":0.60899999999999999},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.76200000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.64300000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.441,"15min":0.443},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.629,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65000000000000002,"5min":0.748,"15min":0.748},"last":0.40699999999999997}]},{"osd":4,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.629,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84799999999999998,"5min":1.014,"15min":1.014},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76300000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.495}]},{"osd":5,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77500000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77200000000000002,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Mon Oct 16 13:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67200000000000004,"15min":0.67100000000000004},"min":{"1min":0.48099999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.876,"5min":1.371,"15min":1.371},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.83299999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.57499999999999996}]},{"osd":8,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.65300000000000002,"15min":0.67200000000000004},"min":{"1min":0.435,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76100000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.64700000000000002,"15min":0.65800000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.74299999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.68799999999999994}]},{"osd":9,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.61299999999999999,"15min":0.63100000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.71099999999999997,"15min":0.73499999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82599999999999996,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.621}]},{"osd":10,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.82299999999999995,"5min":1.429,"15min":1.429},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.71399999999999997,"15min":0.72799999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.86299999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.72099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":503460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.502,"15min":0.46200000000000002},"min":{"1min":0.32700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53500000000000003,"15min":0.48199999999999998},"min":{"1min":0.35099999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.78700000000000003,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.52300000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.56699999999999995,"15min":0.52700000000000002},"min":{"1min":0.45300000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.57399999999999995,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.73199999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.50800000000000001},"min":{"1min":0.38200000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83999999999999997,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56899999999999995,"15min":0.52100000000000002},"min":{"1min":0.39700000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85199999999999998,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.55800000000000005}]},{"osd":4,"last update":"Mon Oct 16 13:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.432,"15min":0.40400000000000003},"min":{"1min":0.31,"5min":0.251,"15min":0.251},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.45700000000000002,"15min":0.433},"min":{"1min":0.30499999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.66900000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.64100000000000001,"15min":0.59899999999999998},"min":{"1min":0.45300000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.75},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.66100000000000003,"15min":0.60899999999999999},"min":{"1min":0.52200000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.81100000000000005}]},{"osd":6,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63300000000000001,"15min":0.64100000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84899999999999998,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.63100000000000001},"min":{"1min":0.45900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.876,"5min":1.429,"15min":1.429},"last":0.63800000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.56899999999999995,"15min":0.54400000000000004},"min":{"1min":0.40500000000000003,"5min":0.312,"15min":0.312},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.59299999999999997,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.82999999999999996}]},{"osd":8,"last update":"Mon Oct 16 13:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.69199999999999995,"15min":0.67400000000000004},"min":{"1min":0.52400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.71699999999999997,"15min":0.69199999999999995},"min":{"1min":0.53100000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.84299999999999997}]},{"osd":9,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.71699999999999997,"15min":0.70799999999999996},"min":{"1min":0.55100000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.98999999999999999,"5min":1.022,"15min":1.022},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.71999999999999997,"15min":0.71499999999999997},"min":{"1min":0.53500000000000003,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91600000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.88}]},{"osd":10,"last update":"Mon Oct 16 13:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.72699999999999998,"15min":0.71399999999999997},"min":{"1min":0.38200000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.87},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.755,"15min":0.74099999999999999},"min":{"1min":0.49199999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.97899999999999998}]},{"osd":11,"last update":"Mon Oct 16 13:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.012}]}]},{"osd":0,"up_from":8,"seq":34359738445,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":444938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53500000000000003,"15min":0.50900000000000001},"min":{"1min":0.40799999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69499999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.499},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54200000000000004,"15min":0.50600000000000001},"min":{"1min":0.41899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.77400000000000002,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.47699999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56299999999999994,"15min":0.53700000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77500000000000002,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.67100000000000004,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.433},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.38900000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54300000000000004,"15min":0.50800000000000001},"min":{"1min":0.42199999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.627,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.72499999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.61599999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.443,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79000000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.50800000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69699999999999995,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.52100000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:12:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.48099999999999998,"15min":0.48899999999999999},"min":{"1min":0.317,"5min":0.315,"15min":0.315},"max":{"1min":0.59499999999999997,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48599999999999999,"15min":0.47499999999999998},"min":{"1min":0.36399999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67300000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.45900000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.42099999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0169999999999999,"5min":1.51,"15min":1.51},"last":0.61199999999999999}]},{"osd":8,"last update":"Mon Oct 16 13:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68600000000000005,"15min":0.70999999999999996},"min":{"1min":0.53000000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.74199999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.495,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.76800000000000002,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.59599999999999997}]},{"osd":9,"last update":"Mon Oct 16 13:12:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.40600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.67000000000000004,"15min":0.68400000000000005},"min":{"1min":0.375,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.91700000000000004,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.54700000000000004}]},{"osd":10,"last update":"Mon Oct 16 13:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.70099999999999996,"15min":0.71199999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.76800000000000002,"5min":1.02,"15min":1.02},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.74099999999999999,"15min":0.75700000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.79300000000000004,"5min":1.097,"15min":1.097},"last":0.53100000000000003}]},{"osd":11,"last update":"Mon Oct 16 13:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.53800000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.80900000000000005,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67600000000000005,"15min":0.67800000000000005},"min":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93000000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.51200000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":443792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48599999999999999,"15min":0.47999999999999998},"min":{"1min":0.35399999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72499999999999998,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51900000000000002,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68799999999999994,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56399999999999995}]},{"osd":1,"last update":"Mon Oct 16 13:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57499999999999996,"15min":0.50900000000000001},"min":{"1min":0.34100000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86199999999999999,"5min":1,"15min":1},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.58499999999999996,"15min":0.51700000000000002},"min":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93100000000000005,"5min":1.02,"15min":1.02},"last":0.55100000000000005}]},{"osd":3,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.436,"5min":0.318,"15min":0.318},"max":{"1min":0.71899999999999997,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.44600000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72899999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.73999999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.48399999999999999,"15min":0.45900000000000002},"min":{"1min":0.30399999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.52500000000000002,"15min":0.48099999999999998},"min":{"1min":0.33400000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.81599999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.46899999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63600000000000001,"15min":0.629},"min":{"1min":0.45800000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.63300000000000001,"15min":0.62},"min":{"1min":0.50900000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.77400000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.49099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.58599999999999997}]},{"osd":8,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.63600000000000001,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.67800000000000005,"15min":0.66100000000000003},"min":{"1min":0.47399999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.97899999999999998,"5min":1.109,"15min":1.109},"last":0.61299999999999999}]},{"osd":9,"last update":"Mon Oct 16 13:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.55200000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93899999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70299999999999996,"15min":0.69299999999999995},"min":{"1min":0.57199999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.81599999999999995}]},{"osd":10,"last update":"Mon Oct 16 13:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.746,"15min":0.72799999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.746,"15min":0.72399999999999998},"min":{"1min":0.64000000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.80200000000000005}]},{"osd":11,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.75900000000000001}]}]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":442714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.33300000000000002},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.373,"5min":0.36899999999999999,"15min":0.34499999999999997},"min":{"1min":0.25600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.29199999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.50700000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53700000000000003,"15min":0.5},"min":{"1min":0.38100000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.749}]},{"osd":2,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.53300000000000003},"min":{"1min":0.41099999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.441},{"interface":"front","average":{"1min":0.622,"5min":0.57499999999999996,"15min":0.54200000000000004},"min":{"1min":0.48599999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.48399999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59699999999999998,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.748,"5min":6.032,"15min":6.032},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55700000000000005,"15min":0.53600000000000003},"min":{"1min":0.40100000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72099999999999997,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.439,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69399999999999995,"5min":0.871,"15min":0.871},"last":0.47099999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.501,"15min":0.5},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89200000000000002,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.60699999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.47199999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.75700000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.63500000000000001,"15min":0.625},"min":{"1min":0.48499999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78700000000000003,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.39900000000000002}]},{"osd":8,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.55500000000000005}]},{"osd":9,"last update":"Mon Oct 16 13:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.65800000000000003,"15min":0.66700000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.85699999999999998,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51000000000000001}]},{"osd":10,"last update":"Mon Oct 16 13:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.74199999999999999,"15min":0.755},"min":{"1min":0.55400000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.85299999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.56299999999999994,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.86799999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.499}]},{"osd":11,"last update":"Mon Oct 16 13:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.45500000000000002}]}]},{"osd":4,"up_from":33,"seq":141733920828,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":501786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.497,"15min":0.48799999999999999},"min":{"1min":0.377,"5min":0.318,"15min":0.318},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.51100000000000001,"15min":0.495},"min":{"1min":0.41899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.41899999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.39900000000000002,"15min":0.371},"min":{"1min":0.311,"5min":0.245,"15min":0.245},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.42399999999999999,"15min":0.40000000000000002},"min":{"1min":0.315,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57399999999999995,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.68200000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.624,"15min":0.58299999999999996},"min":{"1min":0.40699999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.63500000000000001,"15min":0.56899999999999995},"min":{"1min":0.47299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":3.5840000000000001,"5min":3.5840000000000001,"15min":3.5840000000000001},"last":0.69499999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57999999999999996,"15min":0.54600000000000004},"min":{"1min":0.495,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81000000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.76000000000000001,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.44600000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63800000000000001,"15min":0.621},"min":{"1min":0.38100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.84899999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63,"15min":0.59299999999999997},"min":{"1min":0.48099999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86199999999999999,"5min":1.399,"15min":1.399},"last":0.66300000000000003}]},{"osd":6,"last update":"Mon Oct 16 13:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60999999999999999,"15min":0.59599999999999997},"min":{"1min":0.42999999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77500000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.44500000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77400000000000002,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.40400000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57399999999999995,"15min":0.53700000000000003},"min":{"1min":0.38200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.59899999999999998,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.65500000000000003}]},{"osd":8,"last update":"Mon Oct 16 13:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.52100000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88700000000000001,"5min":0.999,"15min":0.999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.77600000000000002,"15min":0.73899999999999999},"min":{"1min":0.57699999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.6589999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":0.58599999999999997}]},{"osd":9,"last update":"Mon Oct 16 13:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.75,"15min":0.754},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.84699999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.63},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.753,"15min":0.76300000000000001},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88,"5min":1.595,"15min":1.595},"last":0.52000000000000002}]},{"osd":10,"last update":"Mon Oct 16 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78800000000000003,"15min":0.78600000000000003},"min":{"1min":0.60399999999999998,"5min":0.504,"15min":0.504},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.75,"15min":0.754},"min":{"1min":0.58399999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93799999999999994,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.504}]},{"osd":11,"last update":"Mon Oct 16 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.80500000000000005}]}]},{"osd":5,"up_from":38,"seq":163208757304,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1560576,"data_stored":1035953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.39400000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69499999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.38500000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74199999999999999,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.52100000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.57299999999999995,"15min":0.52900000000000003},"min":{"1min":0.41299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.81999999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.55300000000000005,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76600000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.57499999999999996}]},{"osd":2,"last update":"Mon Oct 16 13:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.438,"15min":0.40999999999999998},"min":{"1min":0.311,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69299999999999995,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.42099999999999999},"min":{"1min":0.36199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.74199999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.34799999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.36099999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83299999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.38100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72299999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.41099999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61099999999999999,"15min":0.58399999999999996},"min":{"1min":0.44600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80500000000000005,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.61499999999999999,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.60299999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.626,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83099999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.627,"15min":0.621},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.65000000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67500000000000004,"15min":0.66700000000000004},"min":{"1min":0.495,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.504,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86699999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.58799999999999997}]},{"osd":8,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.39800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.628},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.68899999999999995,"15min":0.67600000000000005},"min":{"1min":0.53400000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.99299999999999999,"5min":1.016,"15min":1.016},"last":0.72699999999999998}]},{"osd":9,"last update":"Mon Oct 16 13:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.71099999999999997,"15min":0.70299999999999996},"min":{"1min":0.55900000000000005,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68999999999999995,"15min":0.68200000000000005},"min":{"1min":0.56699999999999995,"5min":0.435,"15min":0.435},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.61499999999999999}]},{"osd":10,"last update":"Mon Oct 16 13:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.754,"15min":0.73999999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.90400000000000003,"15min":0.91900000000000004},"min":{"1min":0.58699999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.92000000000000004,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.70699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":61018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":59344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":60062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:13:15.173 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:13:15.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.324+0000 7f5afd68f700 1 -- 172.21.15.92:0/317545637 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8100a60 msgr2=0x7f5af8108320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:15.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.324+0000 7f5afd68f700 1 --2- 172.21.15.92:0/317545637 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8100a60 0x7f5af8108320 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5af000b0a0 tx=0x7f5af000b3b0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.325+0000 7f5afd68f700 1 -- 172.21.15.92:0/317545637 shutdown_connections 2023-10-16T13:13:15.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.325+0000 7f5afd68f700 1 --2- 172.21.15.92:0/317545637 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8100a60 0x7f5af8108320 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.325+0000 7f5afd68f700 1 --2- 172.21.15.92:0/317545637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5af8101420 0x7f5af8101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.325+0000 7f5afd68f700 1 --2- 172.21.15.92:0/317545637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af81000c0 0x7f5af8100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.325+0000 7f5afd68f700 1 -- 172.21.15.92:0/317545637 >> 172.21.15.92:0/317545637 conn(0x7f5af80fab30 msgr2=0x7f5af80fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:15.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.325+0000 7f5afd68f700 1 -- 172.21.15.92:0/317545637 shutdown_connections 2023-10-16T13:13:15.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.325+0000 7f5afd68f700 1 -- 172.21.15.92:0/317545637 wait complete. 2023-10-16T13:13:15.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.325+0000 7f5afd68f700 1 Processor -- start 2023-10-16T13:13:15.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.325+0000 7f5afd68f700 1 -- start start 2023-10-16T13:13:15.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.325+0000 7f5afd68f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5af81000c0 0x7f5af80ffb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:15.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.325+0000 7f5afd68f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af8100a60 0x7f5af819b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:15.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.325+0000 7f5afd68f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8101420 0x7f5af819e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:15.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.325+0000 7f5afd68f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af819e800 con 0x7f5af8101420 2023-10-16T13:13:15.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.326+0000 7f5afd68f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af819e970 con 0x7f5af81000c0 2023-10-16T13:13:15.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.326+0000 7f5afd68f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af819eb30 con 0x7f5af8100a60 2023-10-16T13:13:15.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.326+0000 7f5af77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8101420 0x7f5af819e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:15.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.326+0000 7f5af77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8101420 0x7f5af819e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36854/0 (socket says 172.21.15.92:36854) 2023-10-16T13:13:15.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.326+0000 7f5af77fe700 1 -- 172.21.15.92:0/1147063105 learned_addr learned my addr 172.21.15.92:0/1147063105 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:15.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.326+0000 7f5af6ffd700 1 --2- 172.21.15.92:0/1147063105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5af81000c0 0x7f5af80ffb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:15.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.326+0000 7f5af67fc700 1 --2- 172.21.15.92:0/1147063105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af8100a60 0x7f5af819b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:15.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.326+0000 7f5af77fe700 1 -- 172.21.15.92:0/1147063105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af8100a60 msgr2=0x7f5af819b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:15.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.326+0000 7f5af77fe700 1 --2- 172.21.15.92:0/1147063105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af8100a60 0x7f5af819b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.326+0000 7f5af77fe700 1 -- 172.21.15.92:0/1147063105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5af81000c0 msgr2=0x7f5af80ffb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:15.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.326+0000 7f5af77fe700 1 --2- 172.21.15.92:0/1147063105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5af81000c0 0x7f5af80ffb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.326+0000 7f5af77fe700 1 -- 172.21.15.92:0/1147063105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af0009d00 con 0x7f5af8101420 2023-10-16T13:13:15.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.326+0000 7f5af6ffd700 1 --2- 172.21.15.92:0/1147063105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5af81000c0 0x7f5af80ffb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:15.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.326+0000 7f5af77fe700 1 --2- 172.21.15.92:0/1147063105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8101420 0x7f5af819e030 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5af000b780 tx=0x7f5af000be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:15.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.326+0000 7f5adffff700 1 -- 172.21.15.92:0/1147063105 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af000e040 con 0x7f5af8101420 2023-10-16T13:13:15.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.326+0000 7f5adffff700 1 -- 172.21.15.92:0/1147063105 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5af0004e60 con 0x7f5af8101420 2023-10-16T13:13:15.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.326+0000 7f5afd68f700 1 -- 172.21.15.92:0/1147063105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af819edb0 con 0x7f5af8101420 2023-10-16T13:13:15.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.326+0000 7f5adffff700 1 -- 172.21.15.92:0/1147063105 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af00053d0 con 0x7f5af8101420 2023-10-16T13:13:15.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.326+0000 7f5afd68f700 1 -- 172.21.15.92:0/1147063105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af819f1d0 con 0x7f5af8101420 2023-10-16T13:13:15.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.327+0000 7f5afd68f700 1 -- 172.21.15.92:0/1147063105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af810b7a0 con 0x7f5af8101420 2023-10-16T13:13:15.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.329+0000 7f5adffff700 1 -- 172.21.15.92:0/1147063105 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5af001d470 con 0x7f5af8101420 2023-10-16T13:13:15.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.329+0000 7f5adffff700 1 --2- 172.21.15.92:0/1147063105 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5ae00a1520 0x7f5ae00a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:15.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.329+0000 7f5af6ffd700 1 --2- 172.21.15.92:0/1147063105 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5ae00a1520 0x7f5ae00a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:15.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.329+0000 7f5adffff700 1 -- 172.21.15.92:0/1147063105 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5af00ce810 con 0x7f5af8101420 2023-10-16T13:13:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.330+0000 7f5af6ffd700 1 --2- 172.21.15.92:0/1147063105 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5ae00a1520 0x7f5ae00a39e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5af8069040 tx=0x7f5ae8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.334+0000 7f5adffff700 1 -- 172.21.15.92:0/1147063105 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5af0098020 con 0x7f5af8101420 2023-10-16T13:13:15.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.522+0000 7f5afd68f700 1 -- 172.21.15.92:0/1147063105 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5af80612f0 con 0x7f5ae00a1520 2023-10-16T13:13:15.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.532+0000 7f5adffff700 1 -- 172.21.15.92:0/1147063105 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344990 (secure 0 0 0) 0x7f5af80612f0 con 0x7f5ae00a1520 2023-10-16T13:13:15.538 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:13:15.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.535+0000 7f5afd68f700 1 -- 172.21.15.92:0/1147063105 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5ae00a1520 msgr2=0x7f5ae00a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:15.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.535+0000 7f5afd68f700 1 --2- 172.21.15.92:0/1147063105 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5ae00a1520 0x7f5ae00a39e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5af8069040 tx=0x7f5ae8009260 comp rx=0 tx=0).stop 2023-10-16T13:13:15.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.535+0000 7f5afd68f700 1 -- 172.21.15.92:0/1147063105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8101420 msgr2=0x7f5af819e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:15.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.535+0000 7f5afd68f700 1 --2- 172.21.15.92:0/1147063105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8101420 0x7f5af819e030 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5af000b780 tx=0x7f5af000be10 comp rx=0 tx=0).stop 2023-10-16T13:13:15.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.535+0000 7f5afd68f700 1 -- 172.21.15.92:0/1147063105 shutdown_connections 2023-10-16T13:13:15.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.535+0000 7f5afd68f700 1 --2- 172.21.15.92:0/1147063105 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5ae00a1520 0x7f5ae00a39e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.535+0000 7f5afd68f700 1 --2- 172.21.15.92:0/1147063105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8101420 0x7f5af819e030 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.535+0000 7f5afd68f700 1 --2- 172.21.15.92:0/1147063105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5af81000c0 0x7f5af80ffb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.535+0000 7f5afd68f700 1 --2- 172.21.15.92:0/1147063105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af8100a60 0x7f5af819b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.535+0000 7f5afd68f700 1 -- 172.21.15.92:0/1147063105 >> 172.21.15.92:0/1147063105 conn(0x7f5af80fab30 msgr2=0x7f5af80fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:15.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.535+0000 7f5afd68f700 1 -- 172.21.15.92:0/1147063105 shutdown_connections 2023-10-16T13:13:15.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.535+0000 7f5afd68f700 1 -- 172.21.15.92:0/1147063105 wait complete. 2023-10-16T13:13:15.544 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-10-16T13:13:15.550 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2023-10-16T13:13:15.283107+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656211,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":996,"num_read_kb":617,"num_write":432,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":1239417,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":855,"ondisk_log_size":855,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337296,"kb_used_data":13104,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604528,"statfs":{"total":1151940427776,"available":1151595036672,"internally_reserved":0,"allocated":13418496,"data_stored":7277961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19128,"internal_metadata":331855176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":849,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":59,"num_write":14,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003539"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303433+0000","last_change":"2023-10-16T13:11:40.980978+0000","last_active":"2023-10-16T13:13:05.303433+0000","last_peered":"2023-10-16T13:13:05.303433+0000","last_clean":"2023-10-16T13:13:05.303433+0000","last_became_active":"2023-10-16T13:11:40.980468+0000","last_became_peered":"2023-10-16T13:11:40.980468+0000","last_unstale":"2023-10-16T13:13:05.303433+0000","last_undegraded":"2023-10-16T13:13:05.303433+0000","last_fullsized":"2023-10-16T13:13:05.303433+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.261864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.299587+0000","last_change":"2023-10-16T13:11:40.971625+0000","last_active":"2023-10-16T13:13:05.299587+0000","last_peered":"2023-10-16T13:13:05.299587+0000","last_clean":"2023-10-16T13:13:05.299587+0000","last_became_active":"2023-10-16T13:11:40.971028+0000","last_became_peered":"2023-10-16T13:11:40.971028+0000","last_unstale":"2023-10-16T13:13:05.299587+0000","last_undegraded":"2023-10-16T13:13:05.299587+0000","last_fullsized":"2023-10-16T13:13:05.299587+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:08.974553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.299538+0000","last_change":"2023-10-16T13:11:40.973705+0000","last_active":"2023-10-16T13:13:05.299538+0000","last_peered":"2023-10-16T13:13:05.299538+0000","last_clean":"2023-10-16T13:13:05.299538+0000","last_became_active":"2023-10-16T13:11:40.973347+0000","last_became_peered":"2023-10-16T13:11:40.973347+0000","last_unstale":"2023-10-16T13:13:05.299538+0000","last_undegraded":"2023-10-16T13:13:05.299538+0000","last_fullsized":"2023-10-16T13:13:05.299538+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:46.628383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.294240+0000","last_change":"2023-10-16T13:12:36.346510+0000","last_active":"2023-10-16T13:13:05.294240+0000","last_peered":"2023-10-16T13:13:05.294240+0000","last_clean":"2023-10-16T13:13:05.294240+0000","last_became_active":"2023-10-16T13:12:36.346149+0000","last_became_peered":"2023-10-16T13:12:36.346149+0000","last_unstale":"2023-10-16T13:13:05.294240+0000","last_undegraded":"2023-10-16T13:13:05.294240+0000","last_fullsized":"2023-10-16T13:13:05.294240+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:51.533396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292998+0000","last_change":"2023-10-16T13:11:40.976558+0000","last_active":"2023-10-16T13:13:05.292998+0000","last_peered":"2023-10-16T13:13:05.292998+0000","last_clean":"2023-10-16T13:13:05.292998+0000","last_became_active":"2023-10-16T13:11:40.976159+0000","last_became_peered":"2023-10-16T13:11:40.976159+0000","last_unstale":"2023-10-16T13:13:05.292998+0000","last_undegraded":"2023-10-16T13:13:05.292998+0000","last_fullsized":"2023-10-16T13:13:05.292998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:58:16.532294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295885+0000","last_change":"2023-10-16T13:11:40.977510+0000","last_active":"2023-10-16T13:13:05.295885+0000","last_peered":"2023-10-16T13:13:05.295885+0000","last_clean":"2023-10-16T13:13:05.295885+0000","last_became_active":"2023-10-16T13:11:40.977184+0000","last_became_peered":"2023-10-16T13:11:40.977184+0000","last_unstale":"2023-10-16T13:13:05.295885+0000","last_undegraded":"2023-10-16T13:13:05.295885+0000","last_fullsized":"2023-10-16T13:13:05.295885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:24:33.215430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.294624+0000","last_change":"2023-10-16T13:11:40.969982+0000","last_active":"2023-10-16T13:13:05.294624+0000","last_peered":"2023-10-16T13:13:05.294624+0000","last_clean":"2023-10-16T13:13:05.294624+0000","last_became_active":"2023-10-16T13:11:40.969651+0000","last_became_peered":"2023-10-16T13:11:40.969651+0000","last_unstale":"2023-10-16T13:13:05.294624+0000","last_undegraded":"2023-10-16T13:13:05.294624+0000","last_fullsized":"2023-10-16T13:13:05.294624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:37:01.702748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295874+0000","last_change":"2023-10-16T13:11:40.967952+0000","last_active":"2023-10-16T13:13:05.295874+0000","last_peered":"2023-10-16T13:13:05.295874+0000","last_clean":"2023-10-16T13:13:05.295874+0000","last_became_active":"2023-10-16T13:11:40.967621+0000","last_became_peered":"2023-10-16T13:11:40.967621+0000","last_unstale":"2023-10-16T13:13:05.295874+0000","last_undegraded":"2023-10-16T13:13:05.295874+0000","last_fullsized":"2023-10-16T13:13:05.295874+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:04:09.243563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.304200+0000","last_change":"2023-10-16T13:11:40.978172+0000","last_active":"2023-10-16T13:13:05.304200+0000","last_peered":"2023-10-16T13:13:05.304200+0000","last_clean":"2023-10-16T13:13:05.304200+0000","last_became_active":"2023-10-16T13:11:40.977727+0000","last_became_peered":"2023-10-16T13:11:40.977727+0000","last_unstale":"2023-10-16T13:13:05.304200+0000","last_undegraded":"2023-10-16T13:13:05.304200+0000","last_fullsized":"2023-10-16T13:13:05.304200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:06:16.469370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.301818+0000","last_change":"2023-10-16T13:11:40.973343+0000","last_active":"2023-10-16T13:13:05.301818+0000","last_peered":"2023-10-16T13:13:05.301818+0000","last_clean":"2023-10-16T13:13:05.301818+0000","last_became_active":"2023-10-16T13:11:40.972997+0000","last_became_peered":"2023-10-16T13:11:40.972997+0000","last_unstale":"2023-10-16T13:13:05.301818+0000","last_undegraded":"2023-10-16T13:13:05.301818+0000","last_fullsized":"2023-10-16T13:13:05.301818+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:23:21.235742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.298667+0000","last_change":"2023-10-16T13:11:40.980253+0000","last_active":"2023-10-16T13:13:05.298667+0000","last_peered":"2023-10-16T13:13:05.298667+0000","last_clean":"2023-10-16T13:13:05.298667+0000","last_became_active":"2023-10-16T13:11:40.979473+0000","last_became_peered":"2023-10-16T13:11:40.979473+0000","last_unstale":"2023-10-16T13:13:05.298667+0000","last_undegraded":"2023-10-16T13:13:05.298667+0000","last_fullsized":"2023-10-16T13:13:05.298667+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:37:46.976128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292256+0000","last_change":"2023-10-16T13:11:40.974791+0000","last_active":"2023-10-16T13:13:05.292256+0000","last_peered":"2023-10-16T13:13:05.292256+0000","last_clean":"2023-10-16T13:13:05.292256+0000","last_became_active":"2023-10-16T13:11:40.973353+0000","last_became_peered":"2023-10-16T13:11:40.973353+0000","last_unstale":"2023-10-16T13:13:05.292256+0000","last_undegraded":"2023-10-16T13:13:05.292256+0000","last_fullsized":"2023-10-16T13:13:05.292256+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:35:40.649071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.297133+0000","last_change":"2023-10-16T13:11:40.971681+0000","last_active":"2023-10-16T13:13:05.297133+0000","last_peered":"2023-10-16T13:13:05.297133+0000","last_clean":"2023-10-16T13:13:05.297133+0000","last_became_active":"2023-10-16T13:11:40.971349+0000","last_became_peered":"2023-10-16T13:11:40.971349+0000","last_unstale":"2023-10-16T13:13:05.297133+0000","last_undegraded":"2023-10-16T13:13:05.297133+0000","last_fullsized":"2023-10-16T13:13:05.297133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:50:38.285478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.301749+0000","last_change":"2023-10-16T13:11:40.971859+0000","last_active":"2023-10-16T13:13:05.301749+0000","last_peered":"2023-10-16T13:13:05.301749+0000","last_clean":"2023-10-16T13:13:05.301749+0000","last_became_active":"2023-10-16T13:11:40.971107+0000","last_became_peered":"2023-10-16T13:11:40.971107+0000","last_unstale":"2023-10-16T13:13:05.301749+0000","last_undegraded":"2023-10-16T13:13:05.301749+0000","last_fullsized":"2023-10-16T13:13:05.301749+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:57:52.655130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.302565+0000","last_change":"2023-10-16T13:11:40.976604+0000","last_active":"2023-10-16T13:13:05.302565+0000","last_peered":"2023-10-16T13:13:05.302565+0000","last_clean":"2023-10-16T13:13:05.302565+0000","last_became_active":"2023-10-16T13:11:40.976262+0000","last_became_peered":"2023-10-16T13:11:40.976262+0000","last_unstale":"2023-10-16T13:13:05.302565+0000","last_undegraded":"2023-10-16T13:13:05.302565+0000","last_fullsized":"2023-10-16T13:13:05.302565+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:18:55.867316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303865+0000","last_change":"2023-10-16T13:11:40.975785+0000","last_active":"2023-10-16T13:13:05.303865+0000","last_peered":"2023-10-16T13:13:05.303865+0000","last_clean":"2023-10-16T13:13:05.303865+0000","last_became_active":"2023-10-16T13:11:40.975463+0000","last_became_peered":"2023-10-16T13:11:40.975463+0000","last_unstale":"2023-10-16T13:13:05.303865+0000","last_undegraded":"2023-10-16T13:13:05.303865+0000","last_fullsized":"2023-10-16T13:13:05.303865+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:37:29.337596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303485+0000","last_change":"2023-10-16T13:11:40.980784+0000","last_active":"2023-10-16T13:13:05.303485+0000","last_peered":"2023-10-16T13:13:05.303485+0000","last_clean":"2023-10-16T13:13:05.303485+0000","last_became_active":"2023-10-16T13:11:40.980374+0000","last_became_peered":"2023-10-16T13:11:40.980374+0000","last_unstale":"2023-10-16T13:13:05.303485+0000","last_undegraded":"2023-10-16T13:13:05.303485+0000","last_fullsized":"2023-10-16T13:13:05.303485+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:38:12.236358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303359+0000","last_change":"2023-10-16T13:11:40.980775+0000","last_active":"2023-10-16T13:13:05.303359+0000","last_peered":"2023-10-16T13:13:05.303359+0000","last_clean":"2023-10-16T13:13:05.303359+0000","last_became_active":"2023-10-16T13:11:40.980261+0000","last_became_peered":"2023-10-16T13:11:40.980261+0000","last_unstale":"2023-10-16T13:13:05.303359+0000","last_undegraded":"2023-10-16T13:13:05.303359+0000","last_fullsized":"2023-10-16T13:13:05.303359+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:36:57.112989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.289251+0000","last_change":"2023-10-16T13:11:40.970030+0000","last_active":"2023-10-16T13:13:05.289251+0000","last_peered":"2023-10-16T13:13:05.289251+0000","last_clean":"2023-10-16T13:13:05.289251+0000","last_became_active":"2023-10-16T13:11:40.969698+0000","last_became_peered":"2023-10-16T13:11:40.969698+0000","last_unstale":"2023-10-16T13:13:05.289251+0000","last_undegraded":"2023-10-16T13:13:05.289251+0000","last_fullsized":"2023-10-16T13:13:05.289251+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:42:00.520386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":116,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:13.463544+0000","last_change":"2023-10-16T13:11:39.957688+0000","last_active":"2023-10-16T13:13:13.463544+0000","last_peered":"2023-10-16T13:13:13.463544+0000","last_clean":"2023-10-16T13:13:13.463544+0000","last_became_active":"2023-10-16T13:11:39.957391+0000","last_became_peered":"2023-10-16T13:11:39.957391+0000","last_unstale":"2023-10-16T13:13:13.463544+0000","last_undegraded":"2023-10-16T13:13:13.463544+0000","last_fullsized":"2023-10-16T13:13:13.463544+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:42:17.875770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292811+0000","last_change":"2023-10-16T13:11:40.968984+0000","last_active":"2023-10-16T13:13:05.292811+0000","last_peered":"2023-10-16T13:13:05.292811+0000","last_clean":"2023-10-16T13:13:05.292811+0000","last_became_active":"2023-10-16T13:11:40.968338+0000","last_became_peered":"2023-10-16T13:11:40.968338+0000","last_unstale":"2023-10-16T13:13:05.292811+0000","last_undegraded":"2023-10-16T13:13:05.292811+0000","last_fullsized":"2023-10-16T13:13:05.292811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:49:21.643029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.342126+0000","last_change":"2023-10-16T13:11:39.959458+0000","last_active":"2023-10-16T13:12:35.342126+0000","last_peered":"2023-10-16T13:12:35.342126+0000","last_clean":"2023-10-16T13:12:35.342126+0000","last_became_active":"2023-10-16T13:11:39.959155+0000","last_became_peered":"2023-10-16T13:11:39.959155+0000","last_unstale":"2023-10-16T13:12:35.342126+0000","last_undegraded":"2023-10-16T13:12:35.342126+0000","last_fullsized":"2023-10-16T13:12:35.342126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:18:30.725604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295104+0000","last_change":"2023-10-16T13:11:40.980168+0000","last_active":"2023-10-16T13:13:05.295104+0000","last_peered":"2023-10-16T13:13:05.295104+0000","last_clean":"2023-10-16T13:13:05.295104+0000","last_became_active":"2023-10-16T13:11:40.979839+0000","last_became_peered":"2023-10-16T13:11:40.979839+0000","last_unstale":"2023-10-16T13:13:05.295104+0000","last_undegraded":"2023-10-16T13:13:05.295104+0000","last_fullsized":"2023-10-16T13:13:05.295104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:25:31.374291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:12:36.364920+0000","last_change":"2023-10-16T13:12:36.364427+0000","last_active":"2023-10-16T13:12:36.364920+0000","last_peered":"2023-10-16T13:12:36.364920+0000","last_clean":"2023-10-16T13:12:36.364920+0000","last_became_active":"2023-10-16T13:12:36.350528+0000","last_became_peered":"2023-10-16T13:12:36.350528+0000","last_unstale":"2023-10-16T13:12:36.364920+0000","last_undegraded":"2023-10-16T13:12:36.364920+0000","last_fullsized":"2023-10-16T13:12:36.364920+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:16:17.166684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303398+0000","last_change":"2023-10-16T13:11:40.978989+0000","last_active":"2023-10-16T13:13:05.303398+0000","last_peered":"2023-10-16T13:13:05.303398+0000","last_clean":"2023-10-16T13:13:05.303398+0000","last_became_active":"2023-10-16T13:11:40.978582+0000","last_became_peered":"2023-10-16T13:11:40.978582+0000","last_unstale":"2023-10-16T13:13:05.303398+0000","last_undegraded":"2023-10-16T13:13:05.303398+0000","last_fullsized":"2023-10-16T13:13:05.303398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:29:54.733058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.346355+0000","last_change":"2023-10-16T13:11:39.955340+0000","last_active":"2023-10-16T13:12:35.346355+0000","last_peered":"2023-10-16T13:12:35.346355+0000","last_clean":"2023-10-16T13:12:35.346355+0000","last_became_active":"2023-10-16T13:11:39.955032+0000","last_became_peered":"2023-10-16T13:11:39.955032+0000","last_unstale":"2023-10-16T13:12:35.346355+0000","last_undegraded":"2023-10-16T13:12:35.346355+0000","last_fullsized":"2023-10-16T13:12:35.346355+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:01:11.518823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303337+0000","last_change":"2023-10-16T13:12:36.348095+0000","last_active":"2023-10-16T13:13:05.303337+0000","last_peered":"2023-10-16T13:13:05.303337+0000","last_clean":"2023-10-16T13:13:05.303337+0000","last_became_active":"2023-10-16T13:12:36.347771+0000","last_became_peered":"2023-10-16T13:12:36.347771+0000","last_unstale":"2023-10-16T13:13:05.303337+0000","last_undegraded":"2023-10-16T13:13:05.303337+0000","last_fullsized":"2023-10-16T13:13:05.303337+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:37:42.200445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1b","version":"85'7","reported_seq":128,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:12.404221+0000","last_change":"2023-10-16T13:12:36.353896+0000","last_active":"2023-10-16T13:13:12.404221+0000","last_peered":"2023-10-16T13:13:12.404221+0000","last_clean":"2023-10-16T13:13:12.404221+0000","last_became_active":"2023-10-16T13:12:36.347455+0000","last_became_peered":"2023-10-16T13:12:36.347455+0000","last_unstale":"2023-10-16T13:13:12.404221+0000","last_undegraded":"2023-10-16T13:13:12.404221+0000","last_fullsized":"2023-10-16T13:13:12.404221+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:46.709214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1012,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295779+0000","last_change":"2023-10-16T13:11:40.970345+0000","last_active":"2023-10-16T13:13:05.295779+0000","last_peered":"2023-10-16T13:13:05.295779+0000","last_clean":"2023-10-16T13:13:05.295779+0000","last_became_active":"2023-10-16T13:11:40.970024+0000","last_became_peered":"2023-10-16T13:11:40.970024+0000","last_unstale":"2023-10-16T13:13:05.295779+0000","last_undegraded":"2023-10-16T13:13:05.295779+0000","last_fullsized":"2023-10-16T13:13:05.295779+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:41.703074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.338123+0000","last_change":"2023-10-16T13:11:39.951194+0000","last_active":"2023-10-16T13:12:35.338123+0000","last_peered":"2023-10-16T13:12:35.338123+0000","last_clean":"2023-10-16T13:12:35.338123+0000","last_became_active":"2023-10-16T13:11:39.950837+0000","last_became_peered":"2023-10-16T13:11:39.950837+0000","last_unstale":"2023-10-16T13:12:35.338123+0000","last_undegraded":"2023-10-16T13:12:35.338123+0000","last_fullsized":"2023-10-16T13:12:35.338123+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:59:17.756924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.293658+0000","last_change":"2023-10-16T13:11:40.959602+0000","last_active":"2023-10-16T13:13:05.293658+0000","last_peered":"2023-10-16T13:13:05.293658+0000","last_clean":"2023-10-16T13:13:05.293658+0000","last_became_active":"2023-10-16T13:11:40.959231+0000","last_became_peered":"2023-10-16T13:11:40.959231+0000","last_unstale":"2023-10-16T13:13:05.293658+0000","last_undegraded":"2023-10-16T13:13:05.293658+0000","last_fullsized":"2023-10-16T13:13:05.293658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:59:54.623471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.343827+0000","last_change":"2023-10-16T13:11:39.952655+0000","last_active":"2023-10-16T13:12:35.343827+0000","last_peered":"2023-10-16T13:12:35.343827+0000","last_clean":"2023-10-16T13:12:35.343827+0000","last_became_active":"2023-10-16T13:11:39.952324+0000","last_became_peered":"2023-10-16T13:11:39.952324+0000","last_unstale":"2023-10-16T13:12:35.343827+0000","last_undegraded":"2023-10-16T13:12:35.343827+0000","last_fullsized":"2023-10-16T13:12:35.343827+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:09:14.077837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.298053+0000","last_change":"2023-10-16T13:11:40.969019+0000","last_active":"2023-10-16T13:13:05.298053+0000","last_peered":"2023-10-16T13:13:05.298053+0000","last_clean":"2023-10-16T13:13:05.298053+0000","last_became_active":"2023-10-16T13:11:40.968645+0000","last_became_peered":"2023-10-16T13:11:40.968645+0000","last_unstale":"2023-10-16T13:13:05.298053+0000","last_undegraded":"2023-10-16T13:13:05.298053+0000","last_fullsized":"2023-10-16T13:13:05.298053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:23:18.700377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.341262+0000","last_change":"2023-10-16T13:11:39.959826+0000","last_active":"2023-10-16T13:12:35.341262+0000","last_peered":"2023-10-16T13:12:35.341262+0000","last_clean":"2023-10-16T13:12:35.341262+0000","last_became_active":"2023-10-16T13:11:39.959490+0000","last_became_peered":"2023-10-16T13:11:39.959490+0000","last_unstale":"2023-10-16T13:12:35.341262+0000","last_undegraded":"2023-10-16T13:12:35.341262+0000","last_fullsized":"2023-10-16T13:12:35.341262+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:52:01.865005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295115+0000","last_change":"2023-10-16T13:11:40.977941+0000","last_active":"2023-10-16T13:13:05.295115+0000","last_peered":"2023-10-16T13:13:05.295115+0000","last_clean":"2023-10-16T13:13:05.295115+0000","last_became_active":"2023-10-16T13:11:40.977558+0000","last_became_peered":"2023-10-16T13:11:40.977558+0000","last_unstale":"2023-10-16T13:13:05.295115+0000","last_undegraded":"2023-10-16T13:13:05.295115+0000","last_fullsized":"2023-10-16T13:13:05.295115+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:29:16.932234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'5","reported_seq":188,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:10.400150+0000","last_change":"2023-10-16T13:11:39.953728+0000","last_active":"2023-10-16T13:13:10.400150+0000","last_peered":"2023-10-16T13:13:10.400150+0000","last_clean":"2023-10-16T13:13:10.400150+0000","last_became_active":"2023-10-16T13:11:39.953421+0000","last_became_peered":"2023-10-16T13:11:39.953421+0000","last_unstale":"2023-10-16T13:13:10.400150+0000","last_undegraded":"2023-10-16T13:13:10.400150+0000","last_fullsized":"2023-10-16T13:13:10.400150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:22:14.537974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":168,"num_read_kb":168,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303590+0000","last_change":"2023-10-16T13:11:40.978214+0000","last_active":"2023-10-16T13:13:05.303590+0000","last_peered":"2023-10-16T13:13:05.303590+0000","last_clean":"2023-10-16T13:13:05.303590+0000","last_became_active":"2023-10-16T13:11:40.977786+0000","last_became_peered":"2023-10-16T13:11:40.977786+0000","last_unstale":"2023-10-16T13:13:05.303590+0000","last_undegraded":"2023-10-16T13:13:05.303590+0000","last_fullsized":"2023-10-16T13:13:05.303590+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:43:51.218758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.344226+0000","last_change":"2023-10-16T13:11:39.959589+0000","last_active":"2023-10-16T13:12:35.344226+0000","last_peered":"2023-10-16T13:12:35.344226+0000","last_clean":"2023-10-16T13:12:35.344226+0000","last_became_active":"2023-10-16T13:11:39.959242+0000","last_became_peered":"2023-10-16T13:11:39.959242+0000","last_unstale":"2023-10-16T13:12:35.344226+0000","last_undegraded":"2023-10-16T13:12:35.344226+0000","last_fullsized":"2023-10-16T13:12:35.344226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:54.955605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.299538+0000","last_change":"2023-10-16T13:11:40.975814+0000","last_active":"2023-10-16T13:13:05.299538+0000","last_peered":"2023-10-16T13:13:05.299538+0000","last_clean":"2023-10-16T13:13:05.299538+0000","last_became_active":"2023-10-16T13:11:40.975485+0000","last_became_peered":"2023-10-16T13:11:40.975485+0000","last_unstale":"2023-10-16T13:13:05.299538+0000","last_undegraded":"2023-10-16T13:13:05.299538+0000","last_fullsized":"2023-10-16T13:13:05.299538+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:25.661616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.342931+0000","last_change":"2023-10-16T13:11:39.956586+0000","last_active":"2023-10-16T13:12:35.342931+0000","last_peered":"2023-10-16T13:12:35.342931+0000","last_clean":"2023-10-16T13:12:35.342931+0000","last_became_active":"2023-10-16T13:11:39.956270+0000","last_became_peered":"2023-10-16T13:11:39.956270+0000","last_unstale":"2023-10-16T13:12:35.342931+0000","last_undegraded":"2023-10-16T13:12:35.342931+0000","last_fullsized":"2023-10-16T13:12:35.342931+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:11:12.435377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.304529+0000","last_change":"2023-10-16T13:11:40.978918+0000","last_active":"2023-10-16T13:13:05.304529+0000","last_peered":"2023-10-16T13:13:05.304529+0000","last_clean":"2023-10-16T13:13:05.304529+0000","last_became_active":"2023-10-16T13:11:40.978520+0000","last_became_peered":"2023-10-16T13:11:40.978520+0000","last_unstale":"2023-10-16T13:13:05.304529+0000","last_undegraded":"2023-10-16T13:13:05.304529+0000","last_fullsized":"2023-10-16T13:13:05.304529+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:09:57.269111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'34","reported_seq":251,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:10.400223+0000","last_change":"2023-10-16T13:12:36.361156+0000","last_active":"2023-10-16T13:13:10.400223+0000","last_peered":"2023-10-16T13:13:10.400223+0000","last_clean":"2023-10-16T13:13:10.400223+0000","last_became_active":"2023-10-16T13:12:36.349336+0000","last_became_peered":"2023-10-16T13:12:36.349336+0000","last_unstale":"2023-10-16T13:13:10.400223+0000","last_undegraded":"2023-10-16T13:13:10.400223+0000","last_fullsized":"2023-10-16T13:13:10.400223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:55:10.489183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57795,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":166,"num_read_kb":139,"num_write":36,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":57546,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.291336+0000","last_change":"2023-10-16T13:11:40.969423+0000","last_active":"2023-10-16T13:13:05.291336+0000","last_peered":"2023-10-16T13:13:05.291336+0000","last_clean":"2023-10-16T13:13:05.291336+0000","last_became_active":"2023-10-16T13:11:40.969022+0000","last_became_peered":"2023-10-16T13:11:40.969022+0000","last_unstale":"2023-10-16T13:13:05.291336+0000","last_undegraded":"2023-10-16T13:13:05.291336+0000","last_fullsized":"2023-10-16T13:13:05.291336+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:51:26.911443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.338652+0000","last_change":"2023-10-16T13:11:39.962364+0000","last_active":"2023-10-16T13:12:35.338652+0000","last_peered":"2023-10-16T13:12:35.338652+0000","last_clean":"2023-10-16T13:12:35.338652+0000","last_became_active":"2023-10-16T13:11:39.962077+0000","last_became_peered":"2023-10-16T13:11:39.962077+0000","last_unstale":"2023-10-16T13:12:35.338652+0000","last_undegraded":"2023-10-16T13:12:35.338652+0000","last_fullsized":"2023-10-16T13:12:35.338652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:50:58.478054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.293992+0000","last_change":"2023-10-16T13:11:40.970958+0000","last_active":"2023-10-16T13:13:05.293992+0000","last_peered":"2023-10-16T13:13:05.293992+0000","last_clean":"2023-10-16T13:13:05.293992+0000","last_became_active":"2023-10-16T13:11:40.970670+0000","last_became_peered":"2023-10-16T13:11:40.970670+0000","last_unstale":"2023-10-16T13:13:05.293992+0000","last_undegraded":"2023-10-16T13:13:05.293992+0000","last_fullsized":"2023-10-16T13:13:05.293992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:47:30.594558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.341609+0000","last_change":"2023-10-16T13:11:39.957334+0000","last_active":"2023-10-16T13:12:35.341609+0000","last_peered":"2023-10-16T13:12:35.341609+0000","last_clean":"2023-10-16T13:12:35.341609+0000","last_became_active":"2023-10-16T13:11:39.957027+0000","last_became_peered":"2023-10-16T13:11:39.957027+0000","last_unstale":"2023-10-16T13:12:35.341609+0000","last_undegraded":"2023-10-16T13:12:35.341609+0000","last_fullsized":"2023-10-16T13:12:35.341609+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:27:37.164359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.304080+0000","last_change":"2023-10-16T13:11:40.977201+0000","last_active":"2023-10-16T13:13:05.304080+0000","last_peered":"2023-10-16T13:13:05.304080+0000","last_clean":"2023-10-16T13:13:05.304080+0000","last_became_active":"2023-10-16T13:11:40.976860+0000","last_became_peered":"2023-10-16T13:11:40.976860+0000","last_unstale":"2023-10-16T13:13:05.304080+0000","last_undegraded":"2023-10-16T13:13:05.304080+0000","last_fullsized":"2023-10-16T13:13:05.304080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:57.867339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'7","reported_seq":110,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:11.461998+0000","last_change":"2023-10-16T13:11:39.958627+0000","last_active":"2023-10-16T13:13:11.461998+0000","last_peered":"2023-10-16T13:13:11.461998+0000","last_clean":"2023-10-16T13:13:11.461998+0000","last_became_active":"2023-10-16T13:11:39.958230+0000","last_became_peered":"2023-10-16T13:11:39.958230+0000","last_unstale":"2023-10-16T13:13:11.461998+0000","last_undegraded":"2023-10-16T13:13:11.461998+0000","last_fullsized":"2023-10-16T13:13:11.461998+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:47:47.534392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.300019+0000","last_change":"2023-10-16T13:11:40.972841+0000","last_active":"2023-10-16T13:13:05.300019+0000","last_peered":"2023-10-16T13:13:05.300019+0000","last_clean":"2023-10-16T13:13:05.300019+0000","last_became_active":"2023-10-16T13:11:40.972406+0000","last_became_peered":"2023-10-16T13:11:40.972406+0000","last_unstale":"2023-10-16T13:13:05.300019+0000","last_undegraded":"2023-10-16T13:13:05.300019+0000","last_fullsized":"2023-10-16T13:13:05.300019+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:04.134000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.345733+0000","last_change":"2023-10-16T13:11:39.955064+0000","last_active":"2023-10-16T13:12:35.345733+0000","last_peered":"2023-10-16T13:12:35.345733+0000","last_clean":"2023-10-16T13:12:35.345733+0000","last_became_active":"2023-10-16T13:11:39.954690+0000","last_became_peered":"2023-10-16T13:11:39.954690+0000","last_unstale":"2023-10-16T13:12:35.345733+0000","last_undegraded":"2023-10-16T13:12:35.345733+0000","last_fullsized":"2023-10-16T13:12:35.345733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:30.341233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.287261+0000","last_change":"2023-10-16T13:11:40.978373+0000","last_active":"2023-10-16T13:13:05.287261+0000","last_peered":"2023-10-16T13:13:05.287261+0000","last_clean":"2023-10-16T13:13:05.287261+0000","last_became_active":"2023-10-16T13:11:40.977890+0000","last_became_peered":"2023-10-16T13:11:40.977890+0000","last_unstale":"2023-10-16T13:13:05.287261+0000","last_undegraded":"2023-10-16T13:13:05.287261+0000","last_fullsized":"2023-10-16T13:13:05.287261+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:33:21.566200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.346851+0000","last_change":"2023-10-16T13:11:39.952698+0000","last_active":"2023-10-16T13:12:35.346851+0000","last_peered":"2023-10-16T13:12:35.346851+0000","last_clean":"2023-10-16T13:12:35.346851+0000","last_became_active":"2023-10-16T13:11:39.952383+0000","last_became_peered":"2023-10-16T13:11:39.952383+0000","last_unstale":"2023-10-16T13:12:35.346851+0000","last_undegraded":"2023-10-16T13:12:35.346851+0000","last_fullsized":"2023-10-16T13:12:35.346851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:06:57.841990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.288531+0000","last_change":"2023-10-16T13:12:36.348036+0000","last_active":"2023-10-16T13:13:05.288531+0000","last_peered":"2023-10-16T13:13:05.288531+0000","last_clean":"2023-10-16T13:13:05.288531+0000","last_became_active":"2023-10-16T13:12:36.347566+0000","last_became_peered":"2023-10-16T13:12:36.347566+0000","last_unstale":"2023-10-16T13:13:05.288531+0000","last_undegraded":"2023-10-16T13:13:05.288531+0000","last_fullsized":"2023-10-16T13:13:05.288531+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:59:38.918902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.344912+0000","last_change":"2023-10-16T13:11:39.957430+0000","last_active":"2023-10-16T13:12:35.344912+0000","last_peered":"2023-10-16T13:12:35.344912+0000","last_clean":"2023-10-16T13:12:35.344912+0000","last_became_active":"2023-10-16T13:11:39.957088+0000","last_became_peered":"2023-10-16T13:11:39.957088+0000","last_unstale":"2023-10-16T13:12:35.344912+0000","last_undegraded":"2023-10-16T13:12:35.344912+0000","last_fullsized":"2023-10-16T13:12:35.344912+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:21:57.307718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.289154+0000","last_change":"2023-10-16T13:11:40.970009+0000","last_active":"2023-10-16T13:13:05.289154+0000","last_peered":"2023-10-16T13:13:05.289154+0000","last_clean":"2023-10-16T13:13:05.289154+0000","last_became_active":"2023-10-16T13:11:40.969668+0000","last_became_peered":"2023-10-16T13:11:40.969668+0000","last_unstale":"2023-10-16T13:13:05.289154+0000","last_undegraded":"2023-10-16T13:13:05.289154+0000","last_fullsized":"2023-10-16T13:13:05.289154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:48:35.556712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":104,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:09.459219+0000","last_change":"2023-10-16T13:11:39.958168+0000","last_active":"2023-10-16T13:13:09.459219+0000","last_peered":"2023-10-16T13:13:09.459219+0000","last_clean":"2023-10-16T13:13:09.459219+0000","last_became_active":"2023-10-16T13:11:39.957628+0000","last_became_peered":"2023-10-16T13:11:39.957628+0000","last_unstale":"2023-10-16T13:13:09.459219+0000","last_undegraded":"2023-10-16T13:13:09.459219+0000","last_fullsized":"2023-10-16T13:13:09.459219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:55:52.658523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.301832+0000","last_change":"2023-10-16T13:11:40.977161+0000","last_active":"2023-10-16T13:13:05.301832+0000","last_peered":"2023-10-16T13:13:05.301832+0000","last_clean":"2023-10-16T13:13:05.301832+0000","last_became_active":"2023-10-16T13:11:40.976821+0000","last_became_peered":"2023-10-16T13:11:40.976821+0000","last_unstale":"2023-10-16T13:13:05.301832+0000","last_undegraded":"2023-10-16T13:13:05.301832+0000","last_fullsized":"2023-10-16T13:13:05.301832+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:42:26.712826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.298415+0000","last_change":"2023-10-16T13:12:36.421172+0000","last_active":"2023-10-16T13:13:05.298415+0000","last_peered":"2023-10-16T13:13:05.298415+0000","last_clean":"2023-10-16T13:13:05.298415+0000","last_became_active":"2023-10-16T13:12:36.420820+0000","last_became_peered":"2023-10-16T13:12:36.420820+0000","last_unstale":"2023-10-16T13:13:05.298415+0000","last_undegraded":"2023-10-16T13:13:05.298415+0000","last_fullsized":"2023-10-16T13:13:05.298415+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:43:50.908556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'6","reported_seq":104,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:08.458081+0000","last_change":"2023-10-16T13:11:39.960180+0000","last_active":"2023-10-16T13:13:08.458081+0000","last_peered":"2023-10-16T13:13:08.458081+0000","last_clean":"2023-10-16T13:13:08.458081+0000","last_became_active":"2023-10-16T13:11:39.959816+0000","last_became_peered":"2023-10-16T13:11:39.959816+0000","last_unstale":"2023-10-16T13:13:08.458081+0000","last_undegraded":"2023-10-16T13:13:08.458081+0000","last_fullsized":"2023-10-16T13:13:08.458081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:14:08.890449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.290701+0000","last_change":"2023-10-16T13:11:40.975271+0000","last_active":"2023-10-16T13:13:05.290701+0000","last_peered":"2023-10-16T13:13:05.290701+0000","last_clean":"2023-10-16T13:13:05.290701+0000","last_became_active":"2023-10-16T13:11:40.974960+0000","last_became_peered":"2023-10-16T13:11:40.974960+0000","last_unstale":"2023-10-16T13:13:05.290701+0000","last_undegraded":"2023-10-16T13:13:05.290701+0000","last_fullsized":"2023-10-16T13:13:05.290701+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:09.467960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.341153+0000","last_change":"2023-10-16T13:11:39.951187+0000","last_active":"2023-10-16T13:12:35.341153+0000","last_peered":"2023-10-16T13:12:35.341153+0000","last_clean":"2023-10-16T13:12:35.341153+0000","last_became_active":"2023-10-16T13:11:39.950843+0000","last_became_peered":"2023-10-16T13:11:39.950843+0000","last_unstale":"2023-10-16T13:12:35.341153+0000","last_undegraded":"2023-10-16T13:12:35.341153+0000","last_fullsized":"2023-10-16T13:12:35.341153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:48.930247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":310,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.343565+0000","last_change":"2023-10-16T13:10:38.800469+0000","last_active":"2023-10-16T13:12:35.343565+0000","last_peered":"2023-10-16T13:12:35.343565+0000","last_clean":"2023-10-16T13:12:35.343565+0000","last_became_active":"2023-10-16T13:10:38.799911+0000","last_became_peered":"2023-10-16T13:10:38.799911+0000","last_unstale":"2023-10-16T13:12:35.343565+0000","last_undegraded":"2023-10-16T13:12:35.343565+0000","last_fullsized":"2023-10-16T13:12:35.343565+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:07:46.238647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:07:46.238647+0000","last_clean_scrub_stamp":"2023-10-16T13:07:46.238647+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:43:42.258738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.290528+0000","last_change":"2023-10-16T13:11:40.974984+0000","last_active":"2023-10-16T13:13:05.290528+0000","last_peered":"2023-10-16T13:13:05.290528+0000","last_clean":"2023-10-16T13:13:05.290528+0000","last_became_active":"2023-10-16T13:11:40.974689+0000","last_became_peered":"2023-10-16T13:11:40.974689+0000","last_unstale":"2023-10-16T13:13:05.290528+0000","last_undegraded":"2023-10-16T13:13:05.290528+0000","last_fullsized":"2023-10-16T13:13:05.290528+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:04.119797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.343748+0000","last_change":"2023-10-16T13:11:39.957999+0000","last_active":"2023-10-16T13:12:35.343748+0000","last_peered":"2023-10-16T13:12:35.343748+0000","last_clean":"2023-10-16T13:12:35.343748+0000","last_became_active":"2023-10-16T13:11:39.957043+0000","last_became_peered":"2023-10-16T13:11:39.957043+0000","last_unstale":"2023-10-16T13:12:35.343748+0000","last_undegraded":"2023-10-16T13:12:35.343748+0000","last_fullsized":"2023-10-16T13:12:35.343748+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:12:27.150065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.346569+0000","last_change":"2023-10-16T13:11:39.953082+0000","last_active":"2023-10-16T13:12:35.346569+0000","last_peered":"2023-10-16T13:12:35.346569+0000","last_clean":"2023-10-16T13:12:35.346569+0000","last_became_active":"2023-10-16T13:11:39.952785+0000","last_became_peered":"2023-10-16T13:11:39.952785+0000","last_unstale":"2023-10-16T13:12:35.346569+0000","last_undegraded":"2023-10-16T13:12:35.346569+0000","last_fullsized":"2023-10-16T13:12:35.346569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:06:34.427841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295250+0000","last_change":"2023-10-16T13:11:40.968761+0000","last_active":"2023-10-16T13:13:05.295250+0000","last_peered":"2023-10-16T13:13:05.295250+0000","last_clean":"2023-10-16T13:13:05.295250+0000","last_became_active":"2023-10-16T13:11:40.968466+0000","last_became_peered":"2023-10-16T13:11:40.968466+0000","last_unstale":"2023-10-16T13:13:05.295250+0000","last_undegraded":"2023-10-16T13:13:05.295250+0000","last_fullsized":"2023-10-16T13:13:05.295250+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:22:15.577411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'12","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:08.478831+0000","last_change":"2023-10-16T13:11:39.957019+0000","last_active":"2023-10-16T13:13:08.478831+0000","last_peered":"2023-10-16T13:13:08.478831+0000","last_clean":"2023-10-16T13:13:08.478831+0000","last_became_active":"2023-10-16T13:11:39.956687+0000","last_became_peered":"2023-10-16T13:11:39.956687+0000","last_unstale":"2023-10-16T13:13:08.478831+0000","last_undegraded":"2023-10-16T13:13:08.478831+0000","last_fullsized":"2023-10-16T13:13:08.478831+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:17.049740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.300128+0000","last_change":"2023-10-16T13:11:40.973938+0000","last_active":"2023-10-16T13:13:05.300128+0000","last_peered":"2023-10-16T13:13:05.300128+0000","last_clean":"2023-10-16T13:13:05.300128+0000","last_became_active":"2023-10-16T13:11:40.973579+0000","last_became_peered":"2023-10-16T13:11:40.973579+0000","last_unstale":"2023-10-16T13:13:05.300128+0000","last_undegraded":"2023-10-16T13:13:05.300128+0000","last_fullsized":"2023-10-16T13:13:05.300128+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:49:29.153231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.341898+0000","last_change":"2023-10-16T13:11:39.954368+0000","last_active":"2023-10-16T13:12:35.341898+0000","last_peered":"2023-10-16T13:12:35.341898+0000","last_clean":"2023-10-16T13:12:35.341898+0000","last_became_active":"2023-10-16T13:11:39.953967+0000","last_became_peered":"2023-10-16T13:11:39.953967+0000","last_unstale":"2023-10-16T13:12:35.341898+0000","last_undegraded":"2023-10-16T13:12:35.341898+0000","last_fullsized":"2023-10-16T13:12:35.341898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:43:49.278655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.302013+0000","last_change":"2023-10-16T13:11:40.975917+0000","last_active":"2023-10-16T13:13:05.302013+0000","last_peered":"2023-10-16T13:13:05.302013+0000","last_clean":"2023-10-16T13:13:05.302013+0000","last_became_active":"2023-10-16T13:11:40.975610+0000","last_became_peered":"2023-10-16T13:11:40.975610+0000","last_unstale":"2023-10-16T13:13:05.302013+0000","last_undegraded":"2023-10-16T13:13:05.302013+0000","last_fullsized":"2023-10-16T13:13:05.302013+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:41.006584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.342310+0000","last_change":"2023-10-16T13:11:39.960169+0000","last_active":"2023-10-16T13:12:35.342310+0000","last_peered":"2023-10-16T13:12:35.342310+0000","last_clean":"2023-10-16T13:12:35.342310+0000","last_became_active":"2023-10-16T13:11:39.959385+0000","last_became_peered":"2023-10-16T13:11:39.959385+0000","last_unstale":"2023-10-16T13:12:35.342310+0000","last_undegraded":"2023-10-16T13:12:35.342310+0000","last_fullsized":"2023-10-16T13:12:35.342310+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:50:12.442686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.275133+0000","last_change":"2023-10-16T13:11:40.971165+0000","last_active":"2023-10-16T13:13:05.275133+0000","last_peered":"2023-10-16T13:13:05.275133+0000","last_clean":"2023-10-16T13:13:05.275133+0000","last_became_active":"2023-10-16T13:11:40.970341+0000","last_became_peered":"2023-10-16T13:11:40.970341+0000","last_unstale":"2023-10-16T13:13:05.275133+0000","last_undegraded":"2023-10-16T13:13:05.275133+0000","last_fullsized":"2023-10-16T13:13:05.275133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:39:48.393642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.341601+0000","last_change":"2023-10-16T13:11:39.953044+0000","last_active":"2023-10-16T13:12:35.341601+0000","last_peered":"2023-10-16T13:12:35.341601+0000","last_clean":"2023-10-16T13:12:35.341601+0000","last_became_active":"2023-10-16T13:11:39.952752+0000","last_became_peered":"2023-10-16T13:11:39.952752+0000","last_unstale":"2023-10-16T13:12:35.341601+0000","last_undegraded":"2023-10-16T13:12:35.341601+0000","last_fullsized":"2023-10-16T13:12:35.341601+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:33:12.277430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.300954+0000","last_change":"2023-10-16T13:11:40.974739+0000","last_active":"2023-10-16T13:13:05.300954+0000","last_peered":"2023-10-16T13:13:05.300954+0000","last_clean":"2023-10-16T13:13:05.300954+0000","last_became_active":"2023-10-16T13:11:40.974387+0000","last_became_peered":"2023-10-16T13:11:40.974387+0000","last_unstale":"2023-10-16T13:13:05.300954+0000","last_undegraded":"2023-10-16T13:13:05.300954+0000","last_fullsized":"2023-10-16T13:13:05.300954+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:28:16.384359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:12:37.822867+0000","last_change":"2023-10-16T13:12:36.353537+0000","last_active":"2023-10-16T13:12:37.822867+0000","last_peered":"2023-10-16T13:12:37.822867+0000","last_clean":"2023-10-16T13:12:37.822867+0000","last_became_active":"2023-10-16T13:12:36.348246+0000","last_became_peered":"2023-10-16T13:12:36.348246+0000","last_unstale":"2023-10-16T13:12:37.822867+0000","last_undegraded":"2023-10-16T13:12:37.822867+0000","last_fullsized":"2023-10-16T13:12:37.822867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:52:54.550287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292097+0000","last_change":"2023-10-16T13:11:40.971153+0000","last_active":"2023-10-16T13:13:05.292097+0000","last_peered":"2023-10-16T13:13:05.292097+0000","last_clean":"2023-10-16T13:13:05.292097+0000","last_became_active":"2023-10-16T13:11:40.970772+0000","last_became_peered":"2023-10-16T13:11:40.970772+0000","last_unstale":"2023-10-16T13:13:05.292097+0000","last_undegraded":"2023-10-16T13:13:05.292097+0000","last_fullsized":"2023-10-16T13:13:05.292097+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:34.450600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.345873+0000","last_change":"2023-10-16T13:11:39.957589+0000","last_active":"2023-10-16T13:12:35.345873+0000","last_peered":"2023-10-16T13:12:35.345873+0000","last_clean":"2023-10-16T13:12:35.345873+0000","last_became_active":"2023-10-16T13:11:39.957334+0000","last_became_peered":"2023-10-16T13:11:39.957334+0000","last_unstale":"2023-10-16T13:12:35.345873+0000","last_undegraded":"2023-10-16T13:12:35.345873+0000","last_fullsized":"2023-10-16T13:12:35.345873+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:42:58.126279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.299537+0000","last_change":"2023-10-16T13:11:40.979906+0000","last_active":"2023-10-16T13:13:05.299537+0000","last_peered":"2023-10-16T13:13:05.299537+0000","last_clean":"2023-10-16T13:13:05.299537+0000","last_became_active":"2023-10-16T13:11:40.979506+0000","last_became_peered":"2023-10-16T13:11:40.979506+0000","last_unstale":"2023-10-16T13:13:05.299537+0000","last_undegraded":"2023-10-16T13:13:05.299537+0000","last_fullsized":"2023-10-16T13:13:05.299537+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:06:33.566642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'6","reported_seq":110,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:12.464047+0000","last_change":"2023-10-16T13:11:39.961062+0000","last_active":"2023-10-16T13:13:12.464047+0000","last_peered":"2023-10-16T13:13:12.464047+0000","last_clean":"2023-10-16T13:13:12.464047+0000","last_became_active":"2023-10-16T13:11:39.960615+0000","last_became_peered":"2023-10-16T13:11:39.960615+0000","last_unstale":"2023-10-16T13:13:12.464047+0000","last_undegraded":"2023-10-16T13:13:12.464047+0000","last_fullsized":"2023-10-16T13:13:12.464047+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:59:52.598863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.299689+0000","last_change":"2023-10-16T13:11:40.979874+0000","last_active":"2023-10-16T13:13:05.299689+0000","last_peered":"2023-10-16T13:13:05.299689+0000","last_clean":"2023-10-16T13:13:05.299689+0000","last_became_active":"2023-10-16T13:11:40.979444+0000","last_became_peered":"2023-10-16T13:11:40.979444+0000","last_unstale":"2023-10-16T13:13:05.299689+0000","last_undegraded":"2023-10-16T13:13:05.299689+0000","last_fullsized":"2023-10-16T13:13:05.299689+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:27:38.533986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.342306+0000","last_change":"2023-10-16T13:11:39.962428+0000","last_active":"2023-10-16T13:12:35.342306+0000","last_peered":"2023-10-16T13:12:35.342306+0000","last_clean":"2023-10-16T13:12:35.342306+0000","last_became_active":"2023-10-16T13:11:39.962028+0000","last_became_peered":"2023-10-16T13:11:39.962028+0000","last_unstale":"2023-10-16T13:12:35.342306+0000","last_undegraded":"2023-10-16T13:12:35.342306+0000","last_fullsized":"2023-10-16T13:12:35.342306+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:43:25.415571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295958+0000","last_change":"2023-10-16T13:12:36.352328+0000","last_active":"2023-10-16T13:13:05.295958+0000","last_peered":"2023-10-16T13:13:05.295958+0000","last_clean":"2023-10-16T13:13:05.295958+0000","last_became_active":"2023-10-16T13:12:36.348641+0000","last_became_peered":"2023-10-16T13:12:36.348641+0000","last_unstale":"2023-10-16T13:13:05.295958+0000","last_undegraded":"2023-10-16T13:13:05.295958+0000","last_fullsized":"2023-10-16T13:13:05.295958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:41:00.806794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.344184+0000","last_change":"2023-10-16T13:11:39.960173+0000","last_active":"2023-10-16T13:12:35.344184+0000","last_peered":"2023-10-16T13:12:35.344184+0000","last_clean":"2023-10-16T13:12:35.344184+0000","last_became_active":"2023-10-16T13:11:39.959839+0000","last_became_peered":"2023-10-16T13:11:39.959839+0000","last_unstale":"2023-10-16T13:12:35.344184+0000","last_undegraded":"2023-10-16T13:12:35.344184+0000","last_fullsized":"2023-10-16T13:12:35.344184+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:31:16.379341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.296310+0000","last_change":"2023-10-16T13:11:40.974349+0000","last_active":"2023-10-16T13:13:05.296310+0000","last_peered":"2023-10-16T13:13:05.296310+0000","last_clean":"2023-10-16T13:13:05.296310+0000","last_became_active":"2023-10-16T13:11:40.973189+0000","last_became_peered":"2023-10-16T13:11:40.973189+0000","last_unstale":"2023-10-16T13:13:05.296310+0000","last_undegraded":"2023-10-16T13:13:05.296310+0000","last_fullsized":"2023-10-16T13:13:05.296310+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:45:05.177277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292212+0000","last_change":"2023-10-16T13:11:40.972862+0000","last_active":"2023-10-16T13:13:05.292212+0000","last_peered":"2023-10-16T13:13:05.292212+0000","last_clean":"2023-10-16T13:13:05.292212+0000","last_became_active":"2023-10-16T13:11:40.972558+0000","last_became_peered":"2023-10-16T13:11:40.972558+0000","last_unstale":"2023-10-16T13:13:05.292212+0000","last_undegraded":"2023-10-16T13:13:05.292212+0000","last_fullsized":"2023-10-16T13:13:05.292212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:09:36.149610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.289075+0000","last_change":"2023-10-16T13:11:40.973449+0000","last_active":"2023-10-16T13:13:05.289075+0000","last_peered":"2023-10-16T13:13:05.289075+0000","last_clean":"2023-10-16T13:13:05.289075+0000","last_became_active":"2023-10-16T13:11:40.973044+0000","last_became_peered":"2023-10-16T13:11:40.973044+0000","last_unstale":"2023-10-16T13:13:05.289075+0000","last_undegraded":"2023-10-16T13:13:05.289075+0000","last_fullsized":"2023-10-16T13:13:05.289075+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:22.883943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.300066+0000","last_change":"2023-10-16T13:11:40.970871+0000","last_active":"2023-10-16T13:13:05.300066+0000","last_peered":"2023-10-16T13:13:05.300066+0000","last_clean":"2023-10-16T13:13:05.300066+0000","last_became_active":"2023-10-16T13:11:40.970554+0000","last_became_peered":"2023-10-16T13:11:40.970554+0000","last_unstale":"2023-10-16T13:13:05.300066+0000","last_undegraded":"2023-10-16T13:13:05.300066+0000","last_fullsized":"2023-10-16T13:13:05.300066+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:46:34.449007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.302378+0000","last_change":"2023-10-16T13:11:40.975827+0000","last_active":"2023-10-16T13:13:05.302378+0000","last_peered":"2023-10-16T13:13:05.302378+0000","last_clean":"2023-10-16T13:13:05.302378+0000","last_became_active":"2023-10-16T13:11:40.975514+0000","last_became_peered":"2023-10-16T13:11:40.975514+0000","last_unstale":"2023-10-16T13:13:05.302378+0000","last_undegraded":"2023-10-16T13:13:05.302378+0000","last_fullsized":"2023-10-16T13:13:05.302378+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:34:47.901390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.300133+0000","last_change":"2023-10-16T13:11:40.975088+0000","last_active":"2023-10-16T13:13:05.300133+0000","last_peered":"2023-10-16T13:13:05.300133+0000","last_clean":"2023-10-16T13:13:05.300133+0000","last_became_active":"2023-10-16T13:11:40.974286+0000","last_became_peered":"2023-10-16T13:11:40.974286+0000","last_unstale":"2023-10-16T13:13:05.300133+0000","last_undegraded":"2023-10-16T13:13:05.300133+0000","last_fullsized":"2023-10-16T13:13:05.300133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:15:50.270651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292594+0000","last_change":"2023-10-16T13:11:40.973111+0000","last_active":"2023-10-16T13:13:05.292594+0000","last_peered":"2023-10-16T13:13:05.292594+0000","last_clean":"2023-10-16T13:13:05.292594+0000","last_became_active":"2023-10-16T13:11:40.972826+0000","last_became_peered":"2023-10-16T13:11:40.972826+0000","last_unstale":"2023-10-16T13:13:05.292594+0000","last_undegraded":"2023-10-16T13:13:05.292594+0000","last_fullsized":"2023-10-16T13:13:05.292594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:43.523165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.288220+0000","last_change":"2023-10-16T13:11:40.980303+0000","last_active":"2023-10-16T13:13:05.288220+0000","last_peered":"2023-10-16T13:13:05.288220+0000","last_clean":"2023-10-16T13:13:05.288220+0000","last_became_active":"2023-10-16T13:11:40.979987+0000","last_became_peered":"2023-10-16T13:11:40.979987+0000","last_unstale":"2023-10-16T13:13:05.288220+0000","last_undegraded":"2023-10-16T13:13:05.288220+0000","last_fullsized":"2023-10-16T13:13:05.288220+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:38:16.402231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292515+0000","last_change":"2023-10-16T13:11:40.966547+0000","last_active":"2023-10-16T13:13:05.292515+0000","last_peered":"2023-10-16T13:13:05.292515+0000","last_clean":"2023-10-16T13:13:05.292515+0000","last_became_active":"2023-10-16T13:11:40.966149+0000","last_became_peered":"2023-10-16T13:11:40.966149+0000","last_unstale":"2023-10-16T13:13:05.292515+0000","last_undegraded":"2023-10-16T13:13:05.292515+0000","last_fullsized":"2023-10-16T13:13:05.292515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:27:47.007356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295257+0000","last_change":"2023-10-16T13:11:40.968511+0000","last_active":"2023-10-16T13:13:05.295257+0000","last_peered":"2023-10-16T13:13:05.295257+0000","last_clean":"2023-10-16T13:13:05.295257+0000","last_became_active":"2023-10-16T13:11:40.968185+0000","last_became_peered":"2023-10-16T13:11:40.968185+0000","last_unstale":"2023-10-16T13:13:05.295257+0000","last_undegraded":"2023-10-16T13:13:05.295257+0000","last_fullsized":"2023-10-16T13:13:05.295257+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:31:43.779875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.293638+0000","last_change":"2023-10-16T13:11:40.974616+0000","last_active":"2023-10-16T13:13:05.293638+0000","last_peered":"2023-10-16T13:13:05.293638+0000","last_clean":"2023-10-16T13:13:05.293638+0000","last_became_active":"2023-10-16T13:11:40.974295+0000","last_became_peered":"2023-10-16T13:11:40.974295+0000","last_unstale":"2023-10-16T13:13:05.293638+0000","last_undegraded":"2023-10-16T13:13:05.293638+0000","last_fullsized":"2023-10-16T13:13:05.293638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:47.838853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.304078+0000","last_change":"2023-10-16T13:11:40.974927+0000","last_active":"2023-10-16T13:13:05.304078+0000","last_peered":"2023-10-16T13:13:05.304078+0000","last_clean":"2023-10-16T13:13:05.304078+0000","last_became_active":"2023-10-16T13:11:40.974332+0000","last_became_peered":"2023-10-16T13:11:40.974332+0000","last_unstale":"2023-10-16T13:13:05.304078+0000","last_undegraded":"2023-10-16T13:13:05.304078+0000","last_fullsized":"2023-10-16T13:13:05.304078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:07:24.974440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.301095+0000","last_change":"2023-10-16T13:11:40.972793+0000","last_active":"2023-10-16T13:13:05.301095+0000","last_peered":"2023-10-16T13:13:05.301095+0000","last_clean":"2023-10-16T13:13:05.301095+0000","last_became_active":"2023-10-16T13:11:40.972008+0000","last_became_peered":"2023-10-16T13:11:40.972008+0000","last_unstale":"2023-10-16T13:13:05.301095+0000","last_undegraded":"2023-10-16T13:13:05.301095+0000","last_fullsized":"2023-10-16T13:13:05.301095+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:53.487238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.300269+0000","last_change":"2023-10-16T13:11:40.977282+0000","last_active":"2023-10-16T13:13:05.300269+0000","last_peered":"2023-10-16T13:13:05.300269+0000","last_clean":"2023-10-16T13:13:05.300269+0000","last_became_active":"2023-10-16T13:11:40.976872+0000","last_became_peered":"2023-10-16T13:11:40.976872+0000","last_unstale":"2023-10-16T13:13:05.300269+0000","last_undegraded":"2023-10-16T13:13:05.300269+0000","last_fullsized":"2023-10-16T13:13:05.300269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:43:48.735584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65597,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":870,"num_read_kb":508,"num_write":249,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":58558,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":197427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449118,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":443952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.55700000000000005,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40699999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.45300000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.48799999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86399999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.58299999999999996,"15min":0.57299999999999995},"min":{"1min":0.40500000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.56699999999999995}]},{"osd":2,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.48699999999999999,"15min":0.47699999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.53300000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.63,"15min":0.621},"min":{"1min":0.47099999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.69999999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61299999999999999,"15min":0.60999999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.621,"15min":0.621},"min":{"1min":0.45600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.68200000000000005}]},{"osd":6,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.63},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.93899999999999995}]},{"osd":7,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.56299999999999994,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70199999999999996,"15min":0.69799999999999995},"min":{"1min":0.54000000000000004,"5min":0.434,"15min":0.434},"max":{"1min":0.95899999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.74099999999999999}]},{"osd":8,"last update":"Mon Oct 16 13:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.83199999999999996}]},{"osd":9,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76600000000000001,"15min":0.76300000000000001},"min":{"1min":0.58399999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.49299999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.71599999999999997}]},{"osd":10,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.76900000000000002,"15min":0.76600000000000001},"min":{"1min":0.627,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92800000000000005,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.79900000000000004,"15min":0.79300000000000004},"min":{"1min":0.68100000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.85899999999999999}]}]},{"osd":10,"up_from":71,"seq":304942678050,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1630208,"data_stored":1092995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.627},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.68000000000000005}]},{"osd":1,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.434,"15min":0.438},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.5,"15min":0.51100000000000001},"min":{"1min":0.34699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.61099999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.29599999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.50800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84299999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.45700000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.65200000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.57899999999999996,"15min":0.59099999999999997},"min":{"1min":0.41799999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75600000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.63800000000000001,"15min":0.65200000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.73299999999999998,"5min":0.997,"15min":0.997},"last":0.49399999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.434,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77500000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.438,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.89900000000000002,"5min":1.161,"15min":1.161},"last":0.34899999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67100000000000004,"15min":0.66000000000000003},"min":{"1min":0.57499999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.53600000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93999999999999995,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.55800000000000005}]},{"osd":6,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.68899999999999995,"15min":0.70099999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88300000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.69599999999999995,"15min":0.70399999999999996},"min":{"1min":0.52100000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.82699999999999996,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.63800000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.504}]},{"osd":8,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.61799999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.91900000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77800000000000002,"15min":0.77600000000000002},"min":{"1min":0.64300000000000002,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0049999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.74299999999999999}]},{"osd":9,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.85199999999999998,"15min":0.874},"min":{"1min":0.56399999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.86499999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97799999999999998,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.71799999999999997}]},{"osd":11,"last update":"Mon Oct 16 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.76600000000000001,"15min":0.76200000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.052,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96099999999999997,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.66500000000000004}]}]},{"osd":9,"up_from":66,"seq":283467841576,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":443687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.39000000000000001,"15min":0.39500000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.372},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.35399999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.58199999999999996,"15min":0.59199999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.85299999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79600000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.56000000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.38800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76000000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.755,"5min":0.88,"15min":0.88},"last":0.51700000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.50800000000000001,"15min":0.51600000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.5,"15min":0.50600000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.70799999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.33500000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.625,"15min":0.63700000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.879,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63200000000000001,"15min":0.63800000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91100000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.54200000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79800000000000004,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.63},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84299999999999997,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.67000000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83299999999999996,"5min":1.109,"15min":1.109},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80900000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.59399999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70299999999999996,"15min":0.71299999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86099999999999999,"5min":0.996,"15min":0.996},"last":0.497},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92800000000000005,"5min":1.222,"15min":1.222},"last":0.57699999999999996}]},{"osd":8,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72499999999999998,"15min":0.73499999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84799999999999998,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.746,"15min":0.755},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86499999999999999,"5min":1.153,"15min":1.153},"last":0.70199999999999996}]},{"osd":10,"last update":"Mon Oct 16 13:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71499999999999997,"15min":0.72699999999999998},"min":{"1min":0.501,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.78200000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.73499999999999999,"15min":0.747},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.80900000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.623}]}]},{"osd":8,"up_from":59,"seq":253403070507,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":443942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.40600000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.754,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38500000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78800000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.56699999999999995}]},{"osd":1,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60699999999999998,"15min":0.58899999999999997},"min":{"1min":0.52200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.625,"15min":0.61399999999999999},"min":{"1min":0.497,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85899999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.45300000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46200000000000002,"15min":0.45100000000000001},"min":{"1min":0.40300000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.65500000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.503,"15min":0.48299999999999998},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.54200000000000004}]},{"osd":3,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.42299999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.77400000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59699999999999998,"15min":0.58099999999999996},"min":{"1min":0.47499999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82699999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.75700000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.63600000000000001,"15min":0.63300000000000001},"min":{"1min":0.48399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.66000000000000003,"15min":0.64100000000000001},"min":{"1min":0.55000000000000004,"5min":0.377,"15min":0.377},"max":{"1min":1.02,"5min":1.036,"15min":1.036},"last":0.80700000000000005}]},{"osd":5,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.58699999999999997,"15min":0.55500000000000005},"min":{"1min":0.51500000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.60999999999999999,"15min":0.57999999999999996},"min":{"1min":0.52300000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.997,"5min":1.042,"15min":1.042},"last":0.71399999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.71899999999999997,"15min":0.67100000000000004},"min":{"1min":0.63100000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96199999999999997,"5min":3.6659999999999999,"15min":3.6659999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.74099999999999999,"15min":0.71499999999999997},"min":{"1min":0.56499999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":0.64900000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.745,"15min":0.71899999999999997},"min":{"1min":0.60099999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.73699999999999999,"15min":0.71899999999999997},"min":{"1min":0.61099999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.038,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.78100000000000003}]},{"osd":9,"last update":"Mon Oct 16 13:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.74199999999999999,"15min":0.71699999999999997},"min":{"1min":0.61099999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.415,"5min":2.415,"15min":2.415},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.71599999999999997,"15min":0.69999999999999996},"min":{"1min":0.54600000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.93200000000000005}]},{"osd":10,"last update":"Mon Oct 16 13:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.72399999999999998,"15min":0.70399999999999996},"min":{"1min":0.64300000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.034,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.85499999999999998,"15min":0.85099999999999998},"min":{"1min":0.69199999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.046,"5min":3.694,"15min":3.694},"last":0.96499999999999997}]},{"osd":11,"last update":"Mon Oct 16 13:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.89900000000000002}]}]},{"osd":7,"up_from":51,"seq":219043332143,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1552384,"data_stored":1037137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.38},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.34699999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.42199999999999999,"15min":0.41199999999999998},"min":{"1min":0.33700000000000002,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.42599999999999999,"15min":0.41199999999999998},"min":{"1min":0.36399999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.45500000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.48799999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.59899999999999998,"15min":0.57899999999999996},"min":{"1min":0.44900000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.66900000000000004}]},{"osd":3,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.59499999999999997},"min":{"1min":0.45400000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.72099999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.625},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.441,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78000000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55800000000000005}]},{"osd":4,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.51000000000000001,"15min":0.49199999999999999},"min":{"1min":0.40000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.49099999999999999,"15min":0.46899999999999997},"min":{"1min":0.39000000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.51100000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.65700000000000003,"15min":0.64400000000000002},"min":{"1min":0.55600000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89500000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68000000000000005,"15min":0.66000000000000003},"min":{"1min":0.51600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94399999999999995,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66900000000000004,"15min":0.65900000000000003},"min":{"1min":0.51400000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.67700000000000005,"15min":0.66300000000000003},"min":{"1min":0.54800000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.75700000000000001}]},{"osd":8,"last update":"Mon Oct 16 13:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.71999999999999997,"15min":0.69399999999999995},"min":{"1min":0.60899999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.68100000000000005,"15min":0.65700000000000003},"min":{"1min":0.65200000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.77500000000000002}]},{"osd":9,"last update":"Mon Oct 16 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.72599999999999998,"15min":0.71999999999999997},"min":{"1min":0.623,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.56899999999999995,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.85199999999999998}]},{"osd":10,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.70499999999999996,"15min":0.69799999999999995},"min":{"1min":0.53000000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.749,"15min":0.74099999999999999},"min":{"1min":0.64500000000000002,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.80400000000000005}]},{"osd":11,"last update":"Mon Oct 16 13:12:44 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.90200000000000002}]}]},{"osd":6,"up_from":46,"seq":197568495668,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":443287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.376,"15min":0.374},"min":{"1min":0.255,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":0.621,"15min":0.621},"last":0.375},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.39400000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54300000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.44800000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.36599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73199999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":1,"15min":1},"last":0.48199999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.45100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70799999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60799999999999998,"15min":0.60899999999999999},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.76200000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.64300000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.441,"15min":0.443},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.629,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65000000000000002,"5min":0.748,"15min":0.748},"last":0.40699999999999997}]},{"osd":4,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.629,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84799999999999998,"5min":1.014,"15min":1.014},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76300000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.495}]},{"osd":5,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77500000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77200000000000002,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Mon Oct 16 13:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67200000000000004,"15min":0.67100000000000004},"min":{"1min":0.48099999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.876,"5min":1.371,"15min":1.371},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.83299999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.57499999999999996}]},{"osd":8,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.65300000000000002,"15min":0.67200000000000004},"min":{"1min":0.435,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76100000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.64700000000000002,"15min":0.65800000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.74299999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.68799999999999994}]},{"osd":9,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.61299999999999999,"15min":0.63100000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.71099999999999997,"15min":0.73499999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82599999999999996,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.621}]},{"osd":10,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.82299999999999995,"5min":1.429,"15min":1.429},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.71399999999999997,"15min":0.72799999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.86299999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.72099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":503460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.502,"15min":0.46200000000000002},"min":{"1min":0.32700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53500000000000003,"15min":0.48199999999999998},"min":{"1min":0.35099999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.78700000000000003,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.52300000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.56699999999999995,"15min":0.52700000000000002},"min":{"1min":0.45300000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.57399999999999995,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.73199999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.50800000000000001},"min":{"1min":0.38200000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83999999999999997,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56899999999999995,"15min":0.52100000000000002},"min":{"1min":0.39700000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85199999999999998,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.55800000000000005}]},{"osd":4,"last update":"Mon Oct 16 13:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.432,"15min":0.40400000000000003},"min":{"1min":0.31,"5min":0.251,"15min":0.251},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.45700000000000002,"15min":0.433},"min":{"1min":0.30499999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.66900000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.64100000000000001,"15min":0.59899999999999998},"min":{"1min":0.45300000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.75},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.66100000000000003,"15min":0.60899999999999999},"min":{"1min":0.52200000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.81100000000000005}]},{"osd":6,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63300000000000001,"15min":0.64100000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84899999999999998,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.63100000000000001},"min":{"1min":0.45900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.876,"5min":1.429,"15min":1.429},"last":0.63800000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.56899999999999995,"15min":0.54400000000000004},"min":{"1min":0.40500000000000003,"5min":0.312,"15min":0.312},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.59299999999999997,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.82999999999999996}]},{"osd":8,"last update":"Mon Oct 16 13:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.69199999999999995,"15min":0.67400000000000004},"min":{"1min":0.52400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.71699999999999997,"15min":0.69199999999999995},"min":{"1min":0.53100000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.84299999999999997}]},{"osd":9,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.71699999999999997,"15min":0.70799999999999996},"min":{"1min":0.55100000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.98999999999999999,"5min":1.022,"15min":1.022},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.71999999999999997,"15min":0.71499999999999997},"min":{"1min":0.53500000000000003,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91600000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.88}]},{"osd":10,"last update":"Mon Oct 16 13:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.72699999999999998,"15min":0.71399999999999997},"min":{"1min":0.38200000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.87},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.755,"15min":0.74099999999999999},"min":{"1min":0.49199999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.97899999999999998}]},{"osd":11,"last update":"Mon Oct 16 13:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.012}]}]},{"osd":0,"up_from":8,"seq":34359738445,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":444938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53500000000000003,"15min":0.50900000000000001},"min":{"1min":0.40799999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69499999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.499},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54200000000000004,"15min":0.50600000000000001},"min":{"1min":0.41899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.77400000000000002,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.47699999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56299999999999994,"15min":0.53700000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77500000000000002,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.67100000000000004,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.433},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.38900000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54300000000000004,"15min":0.50800000000000001},"min":{"1min":0.42199999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.627,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.72499999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.61599999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.443,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79000000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.50800000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69699999999999995,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.52100000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:12:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.48099999999999998,"15min":0.48899999999999999},"min":{"1min":0.317,"5min":0.315,"15min":0.315},"max":{"1min":0.59499999999999997,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48599999999999999,"15min":0.47499999999999998},"min":{"1min":0.36399999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67300000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.45900000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.42099999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0169999999999999,"5min":1.51,"15min":1.51},"last":0.61199999999999999}]},{"osd":8,"last update":"Mon Oct 16 13:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68600000000000005,"15min":0.70999999999999996},"min":{"1min":0.53000000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.74199999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.495,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.76800000000000002,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.59599999999999997}]},{"osd":9,"last update":"Mon Oct 16 13:12:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.40600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.67000000000000004,"15min":0.68400000000000005},"min":{"1min":0.375,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.91700000000000004,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.54700000000000004}]},{"osd":10,"last update":"Mon Oct 16 13:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.70099999999999996,"15min":0.71199999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.76800000000000002,"5min":1.02,"15min":1.02},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.74099999999999999,"15min":0.75700000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.79300000000000004,"5min":1.097,"15min":1.097},"last":0.53100000000000003}]},{"osd":11,"last update":"Mon Oct 16 13:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.53800000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.80900000000000005,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67600000000000005,"15min":0.67800000000000005},"min":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93000000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.51200000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":444110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48599999999999999,"15min":0.47999999999999998},"min":{"1min":0.35399999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72499999999999998,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.5},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51900000000000002,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68799999999999994,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.45000000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57499999999999996,"15min":0.50900000000000001},"min":{"1min":0.34100000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86199999999999999,"5min":1,"15min":1},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.58499999999999996,"15min":0.51700000000000002},"min":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93100000000000005,"5min":1.02,"15min":1.02},"last":0.59599999999999997}]},{"osd":3,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.436,"5min":0.318,"15min":0.318},"max":{"1min":0.71899999999999997,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.44600000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72899999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.623},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.48399999999999999,"15min":0.45900000000000002},"min":{"1min":0.30399999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.52500000000000002,"15min":0.48099999999999998},"min":{"1min":0.33400000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.81599999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.82199999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63600000000000001,"15min":0.629},"min":{"1min":0.45800000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.63300000000000001,"15min":0.62},"min":{"1min":0.50900000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.75600000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.49099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.58599999999999997}]},{"osd":8,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.63600000000000001,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.67800000000000005,"15min":0.66100000000000003},"min":{"1min":0.47399999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.97899999999999998,"5min":1.109,"15min":1.109},"last":0.96399999999999997}]},{"osd":9,"last update":"Mon Oct 16 13:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.55200000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93899999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70299999999999996,"15min":0.69299999999999995},"min":{"1min":0.57199999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.93000000000000005}]},{"osd":10,"last update":"Mon Oct 16 13:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.746,"15min":0.72799999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.746,"15min":0.72399999999999998},"min":{"1min":0.64000000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":1.0449999999999999}]},{"osd":11,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":1.006}]}]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":442714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.33300000000000002},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.373,"5min":0.36899999999999999,"15min":0.34499999999999997},"min":{"1min":0.25600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.29199999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.50700000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53700000000000003,"15min":0.5},"min":{"1min":0.38100000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.749}]},{"osd":2,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.53300000000000003},"min":{"1min":0.41099999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.441},{"interface":"front","average":{"1min":0.622,"5min":0.57499999999999996,"15min":0.54200000000000004},"min":{"1min":0.48599999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.48399999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59699999999999998,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.748,"5min":6.032,"15min":6.032},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55700000000000005,"15min":0.53600000000000003},"min":{"1min":0.40100000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72099999999999997,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.439,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69399999999999995,"5min":0.871,"15min":0.871},"last":0.47099999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.501,"15min":0.5},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89200000000000002,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.60699999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.47199999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.75700000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.63500000000000001,"15min":0.625},"min":{"1min":0.48499999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78700000000000003,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.39900000000000002}]},{"osd":8,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.55500000000000005}]},{"osd":9,"last update":"Mon Oct 16 13:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.65800000000000003,"15min":0.66700000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.85699999999999998,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51000000000000001}]},{"osd":10,"last update":"Mon Oct 16 13:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.74199999999999999,"15min":0.755},"min":{"1min":0.55400000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.85299999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.56299999999999994,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.86799999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.499}]},{"osd":11,"last update":"Mon Oct 16 13:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.45500000000000002}]}]},{"osd":4,"up_from":33,"seq":141733920828,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":501786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.497,"15min":0.48799999999999999},"min":{"1min":0.377,"5min":0.318,"15min":0.318},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.51100000000000001,"15min":0.495},"min":{"1min":0.41899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.41899999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.39900000000000002,"15min":0.371},"min":{"1min":0.311,"5min":0.245,"15min":0.245},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.42399999999999999,"15min":0.40000000000000002},"min":{"1min":0.315,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57399999999999995,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.68200000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.624,"15min":0.58299999999999996},"min":{"1min":0.40699999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.63500000000000001,"15min":0.56899999999999995},"min":{"1min":0.47299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":3.5840000000000001,"5min":3.5840000000000001,"15min":3.5840000000000001},"last":0.69499999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57999999999999996,"15min":0.54600000000000004},"min":{"1min":0.495,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81000000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.76000000000000001,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.44600000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63800000000000001,"15min":0.621},"min":{"1min":0.38100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.84899999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63,"15min":0.59299999999999997},"min":{"1min":0.48099999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86199999999999999,"5min":1.399,"15min":1.399},"last":0.66300000000000003}]},{"osd":6,"last update":"Mon Oct 16 13:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60999999999999999,"15min":0.59599999999999997},"min":{"1min":0.42999999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77500000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.44500000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77400000000000002,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.40400000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57399999999999995,"15min":0.53700000000000003},"min":{"1min":0.38200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.59899999999999998,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.65500000000000003}]},{"osd":8,"last update":"Mon Oct 16 13:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.52100000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88700000000000001,"5min":0.999,"15min":0.999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.77600000000000002,"15min":0.73899999999999999},"min":{"1min":0.57699999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.6589999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":0.58599999999999997}]},{"osd":9,"last update":"Mon Oct 16 13:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.75,"15min":0.754},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.84699999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.63},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.753,"15min":0.76300000000000001},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88,"5min":1.595,"15min":1.595},"last":0.52000000000000002}]},{"osd":10,"last update":"Mon Oct 16 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78800000000000003,"15min":0.78600000000000003},"min":{"1min":0.60399999999999998,"5min":0.504,"15min":0.504},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.75,"15min":0.754},"min":{"1min":0.58399999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93799999999999994,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.504}]},{"osd":11,"last update":"Mon Oct 16 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.80500000000000005}]}]},{"osd":5,"up_from":38,"seq":163208757305,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1560576,"data_stored":1035953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.39400000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69499999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.38500000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74199999999999999,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.78900000000000003}]},{"osd":1,"last update":"Mon Oct 16 13:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.57299999999999995,"15min":0.52900000000000003},"min":{"1min":0.41299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.81999999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.55300000000000005,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76600000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.754}]},{"osd":2,"last update":"Mon Oct 16 13:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.438,"15min":0.40999999999999998},"min":{"1min":0.311,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69299999999999995,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.42099999999999999},"min":{"1min":0.36199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.74199999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59199999999999997}]},{"osd":3,"last update":"Mon Oct 16 13:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.36099999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83299999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.38100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72299999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.65400000000000003}]},{"osd":4,"last update":"Mon Oct 16 13:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61099999999999999,"15min":0.58399999999999996},"min":{"1min":0.44600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80500000000000005,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.61499999999999999,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.89500000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.626,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83099999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.627,"15min":0.621},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.72299999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67500000000000004,"15min":0.66700000000000004},"min":{"1min":0.495,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.504,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86699999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.86399999999999999}]},{"osd":8,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.39800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.68899999999999995,"15min":0.67600000000000005},"min":{"1min":0.53400000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.99299999999999999,"5min":1.016,"15min":1.016},"last":0.82099999999999995}]},{"osd":9,"last update":"Mon Oct 16 13:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.71099999999999997,"15min":0.70299999999999996},"min":{"1min":0.55900000000000005,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68999999999999995,"15min":0.68200000000000005},"min":{"1min":0.56699999999999995,"5min":0.435,"15min":0.435},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.80500000000000005}]},{"osd":10,"last update":"Mon Oct 16 13:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.754,"15min":0.73999999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.90400000000000003,"15min":0.91900000000000004},"min":{"1min":0.58699999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.92000000000000004,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.92800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":61018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":59344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":60062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:13:15.558 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-10-16T13:13:15.558 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:13:15.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.710+0000 7f026519c700 1 -- 172.21.15.92:0/711602333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02600ff580 msgr2=0x7f02600ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:15.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.710+0000 7f026519c700 1 --2- 172.21.15.92:0/711602333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02600ff580 0x7f02600ff9a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f02500099c0 tx=0x7f0250009cd0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.710+0000 7f026519c700 1 -- 172.21.15.92:0/711602333 shutdown_connections 2023-10-16T13:13:15.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.710+0000 7f026519c700 1 --2- 172.21.15.92:0/711602333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02600ff580 0x7f02600ff9a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.710+0000 7f026519c700 1 --2- 172.21.15.92:0/711602333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0260101110 0x7f02601079c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.710+0000 7f026519c700 1 --2- 172.21.15.92:0/711602333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0260100770 0x7f0260100bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.710+0000 7f026519c700 1 -- 172.21.15.92:0/711602333 >> 172.21.15.92:0/711602333 conn(0x7f02600faad0 msgr2=0x7f02600fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:15.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.710+0000 7f026519c700 1 -- 172.21.15.92:0/711602333 shutdown_connections 2023-10-16T13:13:15.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.710+0000 7f026519c700 1 -- 172.21.15.92:0/711602333 wait complete. 2023-10-16T13:13:15.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.711+0000 7f026519c700 1 Processor -- start 2023-10-16T13:13:15.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.711+0000 7f026519c700 1 -- start start 2023-10-16T13:13:15.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.711+0000 7f026519c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02600ff580 0x7f0260198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:15.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.711+0000 7f026519c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0260100770 0x7f0260199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:15.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.711+0000 7f026519c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0260101110 0x7f02601a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:15.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.711+0000 7f026519c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02601a0950 con 0x7f0260101110 2023-10-16T13:13:15.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.711+0000 7f026519c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02601a0a90 con 0x7f02600ff580 2023-10-16T13:13:15.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.711+0000 7f026519c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02601a0c20 con 0x7f0260100770 2023-10-16T13:13:15.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.712+0000 7f025f59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0260101110 0x7f02601a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:15.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.712+0000 7f025f59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0260101110 0x7f02601a0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36868/0 (socket says 172.21.15.92:36868) 2023-10-16T13:13:15.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.712+0000 7f025f59e700 1 -- 172.21.15.92:0/1170698800 learned_addr learned my addr 172.21.15.92:0/1170698800 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:15.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.712+0000 7f025e59c700 1 --2- 172.21.15.92:0/1170698800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0260100770 0x7f0260199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:15.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.712+0000 7f025ed9d700 1 --2- 172.21.15.92:0/1170698800 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02600ff580 0x7f0260198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:15.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.712+0000 7f025f59e700 1 -- 172.21.15.92:0/1170698800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0260100770 msgr2=0x7f0260199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:15.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.712+0000 7f025f59e700 1 --2- 172.21.15.92:0/1170698800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0260100770 0x7f0260199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.712+0000 7f025f59e700 1 -- 172.21.15.92:0/1170698800 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02600ff580 msgr2=0x7f0260198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:15.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.712+0000 7f025f59e700 1 --2- 172.21.15.92:0/1170698800 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02600ff580 0x7f0260198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.712+0000 7f025f59e700 1 -- 172.21.15.92:0/1170698800 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02500095f0 con 0x7f0260101110 2023-10-16T13:13:15.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.712+0000 7f025f59e700 1 --2- 172.21.15.92:0/1170698800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0260101110 0x7f02601a0380 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0258007ee0 tx=0x7f025800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:15.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.712+0000 7f0247fff700 1 -- 172.21.15.92:0/1170698800 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258017070 con 0x7f0260101110 2023-10-16T13:13:15.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.712+0000 7f0247fff700 1 -- 172.21.15.92:0/1170698800 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f025800f040 con 0x7f0260101110 2023-10-16T13:13:15.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.712+0000 7f026519c700 1 -- 172.21.15.92:0/1170698800 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02601a0f00 con 0x7f0260101110 2023-10-16T13:13:15.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.712+0000 7f0247fff700 1 -- 172.21.15.92:0/1170698800 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258005610 con 0x7f0260101110 2023-10-16T13:13:15.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.712+0000 7f026519c700 1 -- 172.21.15.92:0/1170698800 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02601a1330 con 0x7f0260101110 2023-10-16T13:13:15.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.713+0000 7f026519c700 1 -- 172.21.15.92:0/1170698800 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0260106150 con 0x7f0260101110 2023-10-16T13:13:15.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.714+0000 7f0247fff700 1 -- 172.21.15.92:0/1170698800 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0258005790 con 0x7f0260101110 2023-10-16T13:13:15.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.715+0000 7f0247fff700 1 --2- 172.21.15.92:0/1170698800 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f02480a1520 0x7f02480a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:15.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.715+0000 7f0247fff700 1 -- 172.21.15.92:0/1170698800 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f02580cc420 con 0x7f0260101110 2023-10-16T13:13:15.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.715+0000 7f025ed9d700 1 --2- 172.21.15.92:0/1170698800 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f02480a1520 0x7f02480a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:15.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.715+0000 7f025ed9d700 1 --2- 172.21.15.92:0/1170698800 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f02480a1520 0x7f02480a39e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0250006010 tx=0x7f0250003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:15.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.720+0000 7f0247fff700 1 -- 172.21.15.92:0/1170698800 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0258095a80 con 0x7f0260101110 2023-10-16T13:13:15.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.906+0000 7f026519c700 1 -- 172.21.15.92:0/1170698800 --> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f026002d230 con 0x7f02480a1520 2023-10-16T13:13:15.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.916+0000 7f0247fff700 1 -- 172.21.15.92:0/1170698800 <== mgr.14152 v2:172.21.15.92:6800/2605982588 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344990 (secure 0 0 0) 0x7f026002d230 con 0x7f02480a1520 2023-10-16T13:13:15.924 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:13:15.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.921+0000 7f026519c700 1 -- 172.21.15.92:0/1170698800 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f02480a1520 msgr2=0x7f02480a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:15.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.921+0000 7f026519c700 1 --2- 172.21.15.92:0/1170698800 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f02480a1520 0x7f02480a39e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0250006010 tx=0x7f0250003680 comp rx=0 tx=0).stop 2023-10-16T13:13:15.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.921+0000 7f026519c700 1 -- 172.21.15.92:0/1170698800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0260101110 msgr2=0x7f02601a0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:15.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.921+0000 7f026519c700 1 --2- 172.21.15.92:0/1170698800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0260101110 0x7f02601a0380 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0258007ee0 tx=0x7f025800d3b0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.921+0000 7f026519c700 1 -- 172.21.15.92:0/1170698800 shutdown_connections 2023-10-16T13:13:15.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.921+0000 7f026519c700 1 --2- 172.21.15.92:0/1170698800 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f02480a1520 0x7f02480a39e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.921+0000 7f026519c700 1 --2- 172.21.15.92:0/1170698800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0260101110 0x7f02601a0380 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.921+0000 7f026519c700 1 --2- 172.21.15.92:0/1170698800 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02600ff580 0x7f0260198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.921+0000 7f026519c700 1 --2- 172.21.15.92:0/1170698800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0260100770 0x7f0260199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:15.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.921+0000 7f026519c700 1 -- 172.21.15.92:0/1170698800 >> 172.21.15.92:0/1170698800 conn(0x7f02600faad0 msgr2=0x7f02600fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:15.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.921+0000 7f026519c700 1 -- 172.21.15.92:0/1170698800 shutdown_connections 2023-10-16T13:13:15.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:15.921+0000 7f026519c700 1 -- 172.21.15.92:0/1170698800 wait complete. 2023-10-16T13:13:15.929 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-10-16T13:13:15.934 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:15 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1496418425' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:13:15.935 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2023-10-16T13:13:15.283107+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656211,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":996,"num_read_kb":617,"num_write":432,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":1239417,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":855,"ondisk_log_size":855,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337296,"kb_used_data":13104,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604528,"statfs":{"total":1151940427776,"available":1151595036672,"internally_reserved":0,"allocated":13418496,"data_stored":7277961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19128,"internal_metadata":331855176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":849,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":59,"num_write":14,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003539"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303433+0000","last_change":"2023-10-16T13:11:40.980978+0000","last_active":"2023-10-16T13:13:05.303433+0000","last_peered":"2023-10-16T13:13:05.303433+0000","last_clean":"2023-10-16T13:13:05.303433+0000","last_became_active":"2023-10-16T13:11:40.980468+0000","last_became_peered":"2023-10-16T13:11:40.980468+0000","last_unstale":"2023-10-16T13:13:05.303433+0000","last_undegraded":"2023-10-16T13:13:05.303433+0000","last_fullsized":"2023-10-16T13:13:05.303433+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.261864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.299587+0000","last_change":"2023-10-16T13:11:40.971625+0000","last_active":"2023-10-16T13:13:05.299587+0000","last_peered":"2023-10-16T13:13:05.299587+0000","last_clean":"2023-10-16T13:13:05.299587+0000","last_became_active":"2023-10-16T13:11:40.971028+0000","last_became_peered":"2023-10-16T13:11:40.971028+0000","last_unstale":"2023-10-16T13:13:05.299587+0000","last_undegraded":"2023-10-16T13:13:05.299587+0000","last_fullsized":"2023-10-16T13:13:05.299587+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:08.974553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.299538+0000","last_change":"2023-10-16T13:11:40.973705+0000","last_active":"2023-10-16T13:13:05.299538+0000","last_peered":"2023-10-16T13:13:05.299538+0000","last_clean":"2023-10-16T13:13:05.299538+0000","last_became_active":"2023-10-16T13:11:40.973347+0000","last_became_peered":"2023-10-16T13:11:40.973347+0000","last_unstale":"2023-10-16T13:13:05.299538+0000","last_undegraded":"2023-10-16T13:13:05.299538+0000","last_fullsized":"2023-10-16T13:13:05.299538+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:46.628383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.294240+0000","last_change":"2023-10-16T13:12:36.346510+0000","last_active":"2023-10-16T13:13:05.294240+0000","last_peered":"2023-10-16T13:13:05.294240+0000","last_clean":"2023-10-16T13:13:05.294240+0000","last_became_active":"2023-10-16T13:12:36.346149+0000","last_became_peered":"2023-10-16T13:12:36.346149+0000","last_unstale":"2023-10-16T13:13:05.294240+0000","last_undegraded":"2023-10-16T13:13:05.294240+0000","last_fullsized":"2023-10-16T13:13:05.294240+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:51.533396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292998+0000","last_change":"2023-10-16T13:11:40.976558+0000","last_active":"2023-10-16T13:13:05.292998+0000","last_peered":"2023-10-16T13:13:05.292998+0000","last_clean":"2023-10-16T13:13:05.292998+0000","last_became_active":"2023-10-16T13:11:40.976159+0000","last_became_peered":"2023-10-16T13:11:40.976159+0000","last_unstale":"2023-10-16T13:13:05.292998+0000","last_undegraded":"2023-10-16T13:13:05.292998+0000","last_fullsized":"2023-10-16T13:13:05.292998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:58:16.532294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295885+0000","last_change":"2023-10-16T13:11:40.977510+0000","last_active":"2023-10-16T13:13:05.295885+0000","last_peered":"2023-10-16T13:13:05.295885+0000","last_clean":"2023-10-16T13:13:05.295885+0000","last_became_active":"2023-10-16T13:11:40.977184+0000","last_became_peered":"2023-10-16T13:11:40.977184+0000","last_unstale":"2023-10-16T13:13:05.295885+0000","last_undegraded":"2023-10-16T13:13:05.295885+0000","last_fullsized":"2023-10-16T13:13:05.295885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:24:33.215430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.294624+0000","last_change":"2023-10-16T13:11:40.969982+0000","last_active":"2023-10-16T13:13:05.294624+0000","last_peered":"2023-10-16T13:13:05.294624+0000","last_clean":"2023-10-16T13:13:05.294624+0000","last_became_active":"2023-10-16T13:11:40.969651+0000","last_became_peered":"2023-10-16T13:11:40.969651+0000","last_unstale":"2023-10-16T13:13:05.294624+0000","last_undegraded":"2023-10-16T13:13:05.294624+0000","last_fullsized":"2023-10-16T13:13:05.294624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:37:01.702748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295874+0000","last_change":"2023-10-16T13:11:40.967952+0000","last_active":"2023-10-16T13:13:05.295874+0000","last_peered":"2023-10-16T13:13:05.295874+0000","last_clean":"2023-10-16T13:13:05.295874+0000","last_became_active":"2023-10-16T13:11:40.967621+0000","last_became_peered":"2023-10-16T13:11:40.967621+0000","last_unstale":"2023-10-16T13:13:05.295874+0000","last_undegraded":"2023-10-16T13:13:05.295874+0000","last_fullsized":"2023-10-16T13:13:05.295874+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:04:09.243563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.304200+0000","last_change":"2023-10-16T13:11:40.978172+0000","last_active":"2023-10-16T13:13:05.304200+0000","last_peered":"2023-10-16T13:13:05.304200+0000","last_clean":"2023-10-16T13:13:05.304200+0000","last_became_active":"2023-10-16T13:11:40.977727+0000","last_became_peered":"2023-10-16T13:11:40.977727+0000","last_unstale":"2023-10-16T13:13:05.304200+0000","last_undegraded":"2023-10-16T13:13:05.304200+0000","last_fullsized":"2023-10-16T13:13:05.304200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:06:16.469370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.301818+0000","last_change":"2023-10-16T13:11:40.973343+0000","last_active":"2023-10-16T13:13:05.301818+0000","last_peered":"2023-10-16T13:13:05.301818+0000","last_clean":"2023-10-16T13:13:05.301818+0000","last_became_active":"2023-10-16T13:11:40.972997+0000","last_became_peered":"2023-10-16T13:11:40.972997+0000","last_unstale":"2023-10-16T13:13:05.301818+0000","last_undegraded":"2023-10-16T13:13:05.301818+0000","last_fullsized":"2023-10-16T13:13:05.301818+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:23:21.235742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.298667+0000","last_change":"2023-10-16T13:11:40.980253+0000","last_active":"2023-10-16T13:13:05.298667+0000","last_peered":"2023-10-16T13:13:05.298667+0000","last_clean":"2023-10-16T13:13:05.298667+0000","last_became_active":"2023-10-16T13:11:40.979473+0000","last_became_peered":"2023-10-16T13:11:40.979473+0000","last_unstale":"2023-10-16T13:13:05.298667+0000","last_undegraded":"2023-10-16T13:13:05.298667+0000","last_fullsized":"2023-10-16T13:13:05.298667+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:37:46.976128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292256+0000","last_change":"2023-10-16T13:11:40.974791+0000","last_active":"2023-10-16T13:13:05.292256+0000","last_peered":"2023-10-16T13:13:05.292256+0000","last_clean":"2023-10-16T13:13:05.292256+0000","last_became_active":"2023-10-16T13:11:40.973353+0000","last_became_peered":"2023-10-16T13:11:40.973353+0000","last_unstale":"2023-10-16T13:13:05.292256+0000","last_undegraded":"2023-10-16T13:13:05.292256+0000","last_fullsized":"2023-10-16T13:13:05.292256+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:35:40.649071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.297133+0000","last_change":"2023-10-16T13:11:40.971681+0000","last_active":"2023-10-16T13:13:05.297133+0000","last_peered":"2023-10-16T13:13:05.297133+0000","last_clean":"2023-10-16T13:13:05.297133+0000","last_became_active":"2023-10-16T13:11:40.971349+0000","last_became_peered":"2023-10-16T13:11:40.971349+0000","last_unstale":"2023-10-16T13:13:05.297133+0000","last_undegraded":"2023-10-16T13:13:05.297133+0000","last_fullsized":"2023-10-16T13:13:05.297133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:50:38.285478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.301749+0000","last_change":"2023-10-16T13:11:40.971859+0000","last_active":"2023-10-16T13:13:05.301749+0000","last_peered":"2023-10-16T13:13:05.301749+0000","last_clean":"2023-10-16T13:13:05.301749+0000","last_became_active":"2023-10-16T13:11:40.971107+0000","last_became_peered":"2023-10-16T13:11:40.971107+0000","last_unstale":"2023-10-16T13:13:05.301749+0000","last_undegraded":"2023-10-16T13:13:05.301749+0000","last_fullsized":"2023-10-16T13:13:05.301749+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:57:52.655130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.302565+0000","last_change":"2023-10-16T13:11:40.976604+0000","last_active":"2023-10-16T13:13:05.302565+0000","last_peered":"2023-10-16T13:13:05.302565+0000","last_clean":"2023-10-16T13:13:05.302565+0000","last_became_active":"2023-10-16T13:11:40.976262+0000","last_became_peered":"2023-10-16T13:11:40.976262+0000","last_unstale":"2023-10-16T13:13:05.302565+0000","last_undegraded":"2023-10-16T13:13:05.302565+0000","last_fullsized":"2023-10-16T13:13:05.302565+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:18:55.867316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303865+0000","last_change":"2023-10-16T13:11:40.975785+0000","last_active":"2023-10-16T13:13:05.303865+0000","last_peered":"2023-10-16T13:13:05.303865+0000","last_clean":"2023-10-16T13:13:05.303865+0000","last_became_active":"2023-10-16T13:11:40.975463+0000","last_became_peered":"2023-10-16T13:11:40.975463+0000","last_unstale":"2023-10-16T13:13:05.303865+0000","last_undegraded":"2023-10-16T13:13:05.303865+0000","last_fullsized":"2023-10-16T13:13:05.303865+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:37:29.337596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303485+0000","last_change":"2023-10-16T13:11:40.980784+0000","last_active":"2023-10-16T13:13:05.303485+0000","last_peered":"2023-10-16T13:13:05.303485+0000","last_clean":"2023-10-16T13:13:05.303485+0000","last_became_active":"2023-10-16T13:11:40.980374+0000","last_became_peered":"2023-10-16T13:11:40.980374+0000","last_unstale":"2023-10-16T13:13:05.303485+0000","last_undegraded":"2023-10-16T13:13:05.303485+0000","last_fullsized":"2023-10-16T13:13:05.303485+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:38:12.236358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303359+0000","last_change":"2023-10-16T13:11:40.980775+0000","last_active":"2023-10-16T13:13:05.303359+0000","last_peered":"2023-10-16T13:13:05.303359+0000","last_clean":"2023-10-16T13:13:05.303359+0000","last_became_active":"2023-10-16T13:11:40.980261+0000","last_became_peered":"2023-10-16T13:11:40.980261+0000","last_unstale":"2023-10-16T13:13:05.303359+0000","last_undegraded":"2023-10-16T13:13:05.303359+0000","last_fullsized":"2023-10-16T13:13:05.303359+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:36:57.112989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.289251+0000","last_change":"2023-10-16T13:11:40.970030+0000","last_active":"2023-10-16T13:13:05.289251+0000","last_peered":"2023-10-16T13:13:05.289251+0000","last_clean":"2023-10-16T13:13:05.289251+0000","last_became_active":"2023-10-16T13:11:40.969698+0000","last_became_peered":"2023-10-16T13:11:40.969698+0000","last_unstale":"2023-10-16T13:13:05.289251+0000","last_undegraded":"2023-10-16T13:13:05.289251+0000","last_fullsized":"2023-10-16T13:13:05.289251+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:42:00.520386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":116,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:13.463544+0000","last_change":"2023-10-16T13:11:39.957688+0000","last_active":"2023-10-16T13:13:13.463544+0000","last_peered":"2023-10-16T13:13:13.463544+0000","last_clean":"2023-10-16T13:13:13.463544+0000","last_became_active":"2023-10-16T13:11:39.957391+0000","last_became_peered":"2023-10-16T13:11:39.957391+0000","last_unstale":"2023-10-16T13:13:13.463544+0000","last_undegraded":"2023-10-16T13:13:13.463544+0000","last_fullsized":"2023-10-16T13:13:13.463544+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:42:17.875770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292811+0000","last_change":"2023-10-16T13:11:40.968984+0000","last_active":"2023-10-16T13:13:05.292811+0000","last_peered":"2023-10-16T13:13:05.292811+0000","last_clean":"2023-10-16T13:13:05.292811+0000","last_became_active":"2023-10-16T13:11:40.968338+0000","last_became_peered":"2023-10-16T13:11:40.968338+0000","last_unstale":"2023-10-16T13:13:05.292811+0000","last_undegraded":"2023-10-16T13:13:05.292811+0000","last_fullsized":"2023-10-16T13:13:05.292811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:49:21.643029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.342126+0000","last_change":"2023-10-16T13:11:39.959458+0000","last_active":"2023-10-16T13:12:35.342126+0000","last_peered":"2023-10-16T13:12:35.342126+0000","last_clean":"2023-10-16T13:12:35.342126+0000","last_became_active":"2023-10-16T13:11:39.959155+0000","last_became_peered":"2023-10-16T13:11:39.959155+0000","last_unstale":"2023-10-16T13:12:35.342126+0000","last_undegraded":"2023-10-16T13:12:35.342126+0000","last_fullsized":"2023-10-16T13:12:35.342126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:18:30.725604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295104+0000","last_change":"2023-10-16T13:11:40.980168+0000","last_active":"2023-10-16T13:13:05.295104+0000","last_peered":"2023-10-16T13:13:05.295104+0000","last_clean":"2023-10-16T13:13:05.295104+0000","last_became_active":"2023-10-16T13:11:40.979839+0000","last_became_peered":"2023-10-16T13:11:40.979839+0000","last_unstale":"2023-10-16T13:13:05.295104+0000","last_undegraded":"2023-10-16T13:13:05.295104+0000","last_fullsized":"2023-10-16T13:13:05.295104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:25:31.374291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:12:36.364920+0000","last_change":"2023-10-16T13:12:36.364427+0000","last_active":"2023-10-16T13:12:36.364920+0000","last_peered":"2023-10-16T13:12:36.364920+0000","last_clean":"2023-10-16T13:12:36.364920+0000","last_became_active":"2023-10-16T13:12:36.350528+0000","last_became_peered":"2023-10-16T13:12:36.350528+0000","last_unstale":"2023-10-16T13:12:36.364920+0000","last_undegraded":"2023-10-16T13:12:36.364920+0000","last_fullsized":"2023-10-16T13:12:36.364920+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:16:17.166684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303398+0000","last_change":"2023-10-16T13:11:40.978989+0000","last_active":"2023-10-16T13:13:05.303398+0000","last_peered":"2023-10-16T13:13:05.303398+0000","last_clean":"2023-10-16T13:13:05.303398+0000","last_became_active":"2023-10-16T13:11:40.978582+0000","last_became_peered":"2023-10-16T13:11:40.978582+0000","last_unstale":"2023-10-16T13:13:05.303398+0000","last_undegraded":"2023-10-16T13:13:05.303398+0000","last_fullsized":"2023-10-16T13:13:05.303398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:29:54.733058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.346355+0000","last_change":"2023-10-16T13:11:39.955340+0000","last_active":"2023-10-16T13:12:35.346355+0000","last_peered":"2023-10-16T13:12:35.346355+0000","last_clean":"2023-10-16T13:12:35.346355+0000","last_became_active":"2023-10-16T13:11:39.955032+0000","last_became_peered":"2023-10-16T13:11:39.955032+0000","last_unstale":"2023-10-16T13:12:35.346355+0000","last_undegraded":"2023-10-16T13:12:35.346355+0000","last_fullsized":"2023-10-16T13:12:35.346355+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:01:11.518823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303337+0000","last_change":"2023-10-16T13:12:36.348095+0000","last_active":"2023-10-16T13:13:05.303337+0000","last_peered":"2023-10-16T13:13:05.303337+0000","last_clean":"2023-10-16T13:13:05.303337+0000","last_became_active":"2023-10-16T13:12:36.347771+0000","last_became_peered":"2023-10-16T13:12:36.347771+0000","last_unstale":"2023-10-16T13:13:05.303337+0000","last_undegraded":"2023-10-16T13:13:05.303337+0000","last_fullsized":"2023-10-16T13:13:05.303337+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:37:42.200445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1b","version":"85'7","reported_seq":128,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:12.404221+0000","last_change":"2023-10-16T13:12:36.353896+0000","last_active":"2023-10-16T13:13:12.404221+0000","last_peered":"2023-10-16T13:13:12.404221+0000","last_clean":"2023-10-16T13:13:12.404221+0000","last_became_active":"2023-10-16T13:12:36.347455+0000","last_became_peered":"2023-10-16T13:12:36.347455+0000","last_unstale":"2023-10-16T13:13:12.404221+0000","last_undegraded":"2023-10-16T13:13:12.404221+0000","last_fullsized":"2023-10-16T13:13:12.404221+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:46.709214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1012,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295779+0000","last_change":"2023-10-16T13:11:40.970345+0000","last_active":"2023-10-16T13:13:05.295779+0000","last_peered":"2023-10-16T13:13:05.295779+0000","last_clean":"2023-10-16T13:13:05.295779+0000","last_became_active":"2023-10-16T13:11:40.970024+0000","last_became_peered":"2023-10-16T13:11:40.970024+0000","last_unstale":"2023-10-16T13:13:05.295779+0000","last_undegraded":"2023-10-16T13:13:05.295779+0000","last_fullsized":"2023-10-16T13:13:05.295779+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:41.703074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.338123+0000","last_change":"2023-10-16T13:11:39.951194+0000","last_active":"2023-10-16T13:12:35.338123+0000","last_peered":"2023-10-16T13:12:35.338123+0000","last_clean":"2023-10-16T13:12:35.338123+0000","last_became_active":"2023-10-16T13:11:39.950837+0000","last_became_peered":"2023-10-16T13:11:39.950837+0000","last_unstale":"2023-10-16T13:12:35.338123+0000","last_undegraded":"2023-10-16T13:12:35.338123+0000","last_fullsized":"2023-10-16T13:12:35.338123+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:59:17.756924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.293658+0000","last_change":"2023-10-16T13:11:40.959602+0000","last_active":"2023-10-16T13:13:05.293658+0000","last_peered":"2023-10-16T13:13:05.293658+0000","last_clean":"2023-10-16T13:13:05.293658+0000","last_became_active":"2023-10-16T13:11:40.959231+0000","last_became_peered":"2023-10-16T13:11:40.959231+0000","last_unstale":"2023-10-16T13:13:05.293658+0000","last_undegraded":"2023-10-16T13:13:05.293658+0000","last_fullsized":"2023-10-16T13:13:05.293658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:59:54.623471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.343827+0000","last_change":"2023-10-16T13:11:39.952655+0000","last_active":"2023-10-16T13:12:35.343827+0000","last_peered":"2023-10-16T13:12:35.343827+0000","last_clean":"2023-10-16T13:12:35.343827+0000","last_became_active":"2023-10-16T13:11:39.952324+0000","last_became_peered":"2023-10-16T13:11:39.952324+0000","last_unstale":"2023-10-16T13:12:35.343827+0000","last_undegraded":"2023-10-16T13:12:35.343827+0000","last_fullsized":"2023-10-16T13:12:35.343827+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:09:14.077837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.298053+0000","last_change":"2023-10-16T13:11:40.969019+0000","last_active":"2023-10-16T13:13:05.298053+0000","last_peered":"2023-10-16T13:13:05.298053+0000","last_clean":"2023-10-16T13:13:05.298053+0000","last_became_active":"2023-10-16T13:11:40.968645+0000","last_became_peered":"2023-10-16T13:11:40.968645+0000","last_unstale":"2023-10-16T13:13:05.298053+0000","last_undegraded":"2023-10-16T13:13:05.298053+0000","last_fullsized":"2023-10-16T13:13:05.298053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:23:18.700377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.341262+0000","last_change":"2023-10-16T13:11:39.959826+0000","last_active":"2023-10-16T13:12:35.341262+0000","last_peered":"2023-10-16T13:12:35.341262+0000","last_clean":"2023-10-16T13:12:35.341262+0000","last_became_active":"2023-10-16T13:11:39.959490+0000","last_became_peered":"2023-10-16T13:11:39.959490+0000","last_unstale":"2023-10-16T13:12:35.341262+0000","last_undegraded":"2023-10-16T13:12:35.341262+0000","last_fullsized":"2023-10-16T13:12:35.341262+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:52:01.865005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295115+0000","last_change":"2023-10-16T13:11:40.977941+0000","last_active":"2023-10-16T13:13:05.295115+0000","last_peered":"2023-10-16T13:13:05.295115+0000","last_clean":"2023-10-16T13:13:05.295115+0000","last_became_active":"2023-10-16T13:11:40.977558+0000","last_became_peered":"2023-10-16T13:11:40.977558+0000","last_unstale":"2023-10-16T13:13:05.295115+0000","last_undegraded":"2023-10-16T13:13:05.295115+0000","last_fullsized":"2023-10-16T13:13:05.295115+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:29:16.932234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'5","reported_seq":188,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:10.400150+0000","last_change":"2023-10-16T13:11:39.953728+0000","last_active":"2023-10-16T13:13:10.400150+0000","last_peered":"2023-10-16T13:13:10.400150+0000","last_clean":"2023-10-16T13:13:10.400150+0000","last_became_active":"2023-10-16T13:11:39.953421+0000","last_became_peered":"2023-10-16T13:11:39.953421+0000","last_unstale":"2023-10-16T13:13:10.400150+0000","last_undegraded":"2023-10-16T13:13:10.400150+0000","last_fullsized":"2023-10-16T13:13:10.400150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:22:14.537974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":168,"num_read_kb":168,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.303590+0000","last_change":"2023-10-16T13:11:40.978214+0000","last_active":"2023-10-16T13:13:05.303590+0000","last_peered":"2023-10-16T13:13:05.303590+0000","last_clean":"2023-10-16T13:13:05.303590+0000","last_became_active":"2023-10-16T13:11:40.977786+0000","last_became_peered":"2023-10-16T13:11:40.977786+0000","last_unstale":"2023-10-16T13:13:05.303590+0000","last_undegraded":"2023-10-16T13:13:05.303590+0000","last_fullsized":"2023-10-16T13:13:05.303590+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:43:51.218758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.344226+0000","last_change":"2023-10-16T13:11:39.959589+0000","last_active":"2023-10-16T13:12:35.344226+0000","last_peered":"2023-10-16T13:12:35.344226+0000","last_clean":"2023-10-16T13:12:35.344226+0000","last_became_active":"2023-10-16T13:11:39.959242+0000","last_became_peered":"2023-10-16T13:11:39.959242+0000","last_unstale":"2023-10-16T13:12:35.344226+0000","last_undegraded":"2023-10-16T13:12:35.344226+0000","last_fullsized":"2023-10-16T13:12:35.344226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:54.955605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.299538+0000","last_change":"2023-10-16T13:11:40.975814+0000","last_active":"2023-10-16T13:13:05.299538+0000","last_peered":"2023-10-16T13:13:05.299538+0000","last_clean":"2023-10-16T13:13:05.299538+0000","last_became_active":"2023-10-16T13:11:40.975485+0000","last_became_peered":"2023-10-16T13:11:40.975485+0000","last_unstale":"2023-10-16T13:13:05.299538+0000","last_undegraded":"2023-10-16T13:13:05.299538+0000","last_fullsized":"2023-10-16T13:13:05.299538+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:25.661616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.342931+0000","last_change":"2023-10-16T13:11:39.956586+0000","last_active":"2023-10-16T13:12:35.342931+0000","last_peered":"2023-10-16T13:12:35.342931+0000","last_clean":"2023-10-16T13:12:35.342931+0000","last_became_active":"2023-10-16T13:11:39.956270+0000","last_became_peered":"2023-10-16T13:11:39.956270+0000","last_unstale":"2023-10-16T13:12:35.342931+0000","last_undegraded":"2023-10-16T13:12:35.342931+0000","last_fullsized":"2023-10-16T13:12:35.342931+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:11:12.435377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.304529+0000","last_change":"2023-10-16T13:11:40.978918+0000","last_active":"2023-10-16T13:13:05.304529+0000","last_peered":"2023-10-16T13:13:05.304529+0000","last_clean":"2023-10-16T13:13:05.304529+0000","last_became_active":"2023-10-16T13:11:40.978520+0000","last_became_peered":"2023-10-16T13:11:40.978520+0000","last_unstale":"2023-10-16T13:13:05.304529+0000","last_undegraded":"2023-10-16T13:13:05.304529+0000","last_fullsized":"2023-10-16T13:13:05.304529+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:09:57.269111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'34","reported_seq":251,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:10.400223+0000","last_change":"2023-10-16T13:12:36.361156+0000","last_active":"2023-10-16T13:13:10.400223+0000","last_peered":"2023-10-16T13:13:10.400223+0000","last_clean":"2023-10-16T13:13:10.400223+0000","last_became_active":"2023-10-16T13:12:36.349336+0000","last_became_peered":"2023-10-16T13:12:36.349336+0000","last_unstale":"2023-10-16T13:13:10.400223+0000","last_undegraded":"2023-10-16T13:13:10.400223+0000","last_fullsized":"2023-10-16T13:13:10.400223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:55:10.489183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57795,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":166,"num_read_kb":139,"num_write":36,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":57546,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.291336+0000","last_change":"2023-10-16T13:11:40.969423+0000","last_active":"2023-10-16T13:13:05.291336+0000","last_peered":"2023-10-16T13:13:05.291336+0000","last_clean":"2023-10-16T13:13:05.291336+0000","last_became_active":"2023-10-16T13:11:40.969022+0000","last_became_peered":"2023-10-16T13:11:40.969022+0000","last_unstale":"2023-10-16T13:13:05.291336+0000","last_undegraded":"2023-10-16T13:13:05.291336+0000","last_fullsized":"2023-10-16T13:13:05.291336+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:51:26.911443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.338652+0000","last_change":"2023-10-16T13:11:39.962364+0000","last_active":"2023-10-16T13:12:35.338652+0000","last_peered":"2023-10-16T13:12:35.338652+0000","last_clean":"2023-10-16T13:12:35.338652+0000","last_became_active":"2023-10-16T13:11:39.962077+0000","last_became_peered":"2023-10-16T13:11:39.962077+0000","last_unstale":"2023-10-16T13:12:35.338652+0000","last_undegraded":"2023-10-16T13:12:35.338652+0000","last_fullsized":"2023-10-16T13:12:35.338652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:50:58.478054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.293992+0000","last_change":"2023-10-16T13:11:40.970958+0000","last_active":"2023-10-16T13:13:05.293992+0000","last_peered":"2023-10-16T13:13:05.293992+0000","last_clean":"2023-10-16T13:13:05.293992+0000","last_became_active":"2023-10-16T13:11:40.970670+0000","last_became_peered":"2023-10-16T13:11:40.970670+0000","last_unstale":"2023-10-16T13:13:05.293992+0000","last_undegraded":"2023-10-16T13:13:05.293992+0000","last_fullsized":"2023-10-16T13:13:05.293992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:47:30.594558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.341609+0000","last_change":"2023-10-16T13:11:39.957334+0000","last_active":"2023-10-16T13:12:35.341609+0000","last_peered":"2023-10-16T13:12:35.341609+0000","last_clean":"2023-10-16T13:12:35.341609+0000","last_became_active":"2023-10-16T13:11:39.957027+0000","last_became_peered":"2023-10-16T13:11:39.957027+0000","last_unstale":"2023-10-16T13:12:35.341609+0000","last_undegraded":"2023-10-16T13:12:35.341609+0000","last_fullsized":"2023-10-16T13:12:35.341609+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:27:37.164359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.304080+0000","last_change":"2023-10-16T13:11:40.977201+0000","last_active":"2023-10-16T13:13:05.304080+0000","last_peered":"2023-10-16T13:13:05.304080+0000","last_clean":"2023-10-16T13:13:05.304080+0000","last_became_active":"2023-10-16T13:11:40.976860+0000","last_became_peered":"2023-10-16T13:11:40.976860+0000","last_unstale":"2023-10-16T13:13:05.304080+0000","last_undegraded":"2023-10-16T13:13:05.304080+0000","last_fullsized":"2023-10-16T13:13:05.304080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:57.867339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'7","reported_seq":110,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:11.461998+0000","last_change":"2023-10-16T13:11:39.958627+0000","last_active":"2023-10-16T13:13:11.461998+0000","last_peered":"2023-10-16T13:13:11.461998+0000","last_clean":"2023-10-16T13:13:11.461998+0000","last_became_active":"2023-10-16T13:11:39.958230+0000","last_became_peered":"2023-10-16T13:11:39.958230+0000","last_unstale":"2023-10-16T13:13:11.461998+0000","last_undegraded":"2023-10-16T13:13:11.461998+0000","last_fullsized":"2023-10-16T13:13:11.461998+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:47:47.534392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.300019+0000","last_change":"2023-10-16T13:11:40.972841+0000","last_active":"2023-10-16T13:13:05.300019+0000","last_peered":"2023-10-16T13:13:05.300019+0000","last_clean":"2023-10-16T13:13:05.300019+0000","last_became_active":"2023-10-16T13:11:40.972406+0000","last_became_peered":"2023-10-16T13:11:40.972406+0000","last_unstale":"2023-10-16T13:13:05.300019+0000","last_undegraded":"2023-10-16T13:13:05.300019+0000","last_fullsized":"2023-10-16T13:13:05.300019+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:04.134000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.345733+0000","last_change":"2023-10-16T13:11:39.955064+0000","last_active":"2023-10-16T13:12:35.345733+0000","last_peered":"2023-10-16T13:12:35.345733+0000","last_clean":"2023-10-16T13:12:35.345733+0000","last_became_active":"2023-10-16T13:11:39.954690+0000","last_became_peered":"2023-10-16T13:11:39.954690+0000","last_unstale":"2023-10-16T13:12:35.345733+0000","last_undegraded":"2023-10-16T13:12:35.345733+0000","last_fullsized":"2023-10-16T13:12:35.345733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:30.341233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.287261+0000","last_change":"2023-10-16T13:11:40.978373+0000","last_active":"2023-10-16T13:13:05.287261+0000","last_peered":"2023-10-16T13:13:05.287261+0000","last_clean":"2023-10-16T13:13:05.287261+0000","last_became_active":"2023-10-16T13:11:40.977890+0000","last_became_peered":"2023-10-16T13:11:40.977890+0000","last_unstale":"2023-10-16T13:13:05.287261+0000","last_undegraded":"2023-10-16T13:13:05.287261+0000","last_fullsized":"2023-10-16T13:13:05.287261+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:33:21.566200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.346851+0000","last_change":"2023-10-16T13:11:39.952698+0000","last_active":"2023-10-16T13:12:35.346851+0000","last_peered":"2023-10-16T13:12:35.346851+0000","last_clean":"2023-10-16T13:12:35.346851+0000","last_became_active":"2023-10-16T13:11:39.952383+0000","last_became_peered":"2023-10-16T13:11:39.952383+0000","last_unstale":"2023-10-16T13:12:35.346851+0000","last_undegraded":"2023-10-16T13:12:35.346851+0000","last_fullsized":"2023-10-16T13:12:35.346851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:06:57.841990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.288531+0000","last_change":"2023-10-16T13:12:36.348036+0000","last_active":"2023-10-16T13:13:05.288531+0000","last_peered":"2023-10-16T13:13:05.288531+0000","last_clean":"2023-10-16T13:13:05.288531+0000","last_became_active":"2023-10-16T13:12:36.347566+0000","last_became_peered":"2023-10-16T13:12:36.347566+0000","last_unstale":"2023-10-16T13:13:05.288531+0000","last_undegraded":"2023-10-16T13:13:05.288531+0000","last_fullsized":"2023-10-16T13:13:05.288531+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:59:38.918902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.344912+0000","last_change":"2023-10-16T13:11:39.957430+0000","last_active":"2023-10-16T13:12:35.344912+0000","last_peered":"2023-10-16T13:12:35.344912+0000","last_clean":"2023-10-16T13:12:35.344912+0000","last_became_active":"2023-10-16T13:11:39.957088+0000","last_became_peered":"2023-10-16T13:11:39.957088+0000","last_unstale":"2023-10-16T13:12:35.344912+0000","last_undegraded":"2023-10-16T13:12:35.344912+0000","last_fullsized":"2023-10-16T13:12:35.344912+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:21:57.307718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.289154+0000","last_change":"2023-10-16T13:11:40.970009+0000","last_active":"2023-10-16T13:13:05.289154+0000","last_peered":"2023-10-16T13:13:05.289154+0000","last_clean":"2023-10-16T13:13:05.289154+0000","last_became_active":"2023-10-16T13:11:40.969668+0000","last_became_peered":"2023-10-16T13:11:40.969668+0000","last_unstale":"2023-10-16T13:13:05.289154+0000","last_undegraded":"2023-10-16T13:13:05.289154+0000","last_fullsized":"2023-10-16T13:13:05.289154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:48:35.556712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":104,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:09.459219+0000","last_change":"2023-10-16T13:11:39.958168+0000","last_active":"2023-10-16T13:13:09.459219+0000","last_peered":"2023-10-16T13:13:09.459219+0000","last_clean":"2023-10-16T13:13:09.459219+0000","last_became_active":"2023-10-16T13:11:39.957628+0000","last_became_peered":"2023-10-16T13:11:39.957628+0000","last_unstale":"2023-10-16T13:13:09.459219+0000","last_undegraded":"2023-10-16T13:13:09.459219+0000","last_fullsized":"2023-10-16T13:13:09.459219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:55:52.658523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.301832+0000","last_change":"2023-10-16T13:11:40.977161+0000","last_active":"2023-10-16T13:13:05.301832+0000","last_peered":"2023-10-16T13:13:05.301832+0000","last_clean":"2023-10-16T13:13:05.301832+0000","last_became_active":"2023-10-16T13:11:40.976821+0000","last_became_peered":"2023-10-16T13:11:40.976821+0000","last_unstale":"2023-10-16T13:13:05.301832+0000","last_undegraded":"2023-10-16T13:13:05.301832+0000","last_fullsized":"2023-10-16T13:13:05.301832+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:42:26.712826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.298415+0000","last_change":"2023-10-16T13:12:36.421172+0000","last_active":"2023-10-16T13:13:05.298415+0000","last_peered":"2023-10-16T13:13:05.298415+0000","last_clean":"2023-10-16T13:13:05.298415+0000","last_became_active":"2023-10-16T13:12:36.420820+0000","last_became_peered":"2023-10-16T13:12:36.420820+0000","last_unstale":"2023-10-16T13:13:05.298415+0000","last_undegraded":"2023-10-16T13:13:05.298415+0000","last_fullsized":"2023-10-16T13:13:05.298415+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:43:50.908556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'6","reported_seq":104,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:08.458081+0000","last_change":"2023-10-16T13:11:39.960180+0000","last_active":"2023-10-16T13:13:08.458081+0000","last_peered":"2023-10-16T13:13:08.458081+0000","last_clean":"2023-10-16T13:13:08.458081+0000","last_became_active":"2023-10-16T13:11:39.959816+0000","last_became_peered":"2023-10-16T13:11:39.959816+0000","last_unstale":"2023-10-16T13:13:08.458081+0000","last_undegraded":"2023-10-16T13:13:08.458081+0000","last_fullsized":"2023-10-16T13:13:08.458081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:14:08.890449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.290701+0000","last_change":"2023-10-16T13:11:40.975271+0000","last_active":"2023-10-16T13:13:05.290701+0000","last_peered":"2023-10-16T13:13:05.290701+0000","last_clean":"2023-10-16T13:13:05.290701+0000","last_became_active":"2023-10-16T13:11:40.974960+0000","last_became_peered":"2023-10-16T13:11:40.974960+0000","last_unstale":"2023-10-16T13:13:05.290701+0000","last_undegraded":"2023-10-16T13:13:05.290701+0000","last_fullsized":"2023-10-16T13:13:05.290701+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:09.467960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.341153+0000","last_change":"2023-10-16T13:11:39.951187+0000","last_active":"2023-10-16T13:12:35.341153+0000","last_peered":"2023-10-16T13:12:35.341153+0000","last_clean":"2023-10-16T13:12:35.341153+0000","last_became_active":"2023-10-16T13:11:39.950843+0000","last_became_peered":"2023-10-16T13:11:39.950843+0000","last_unstale":"2023-10-16T13:12:35.341153+0000","last_undegraded":"2023-10-16T13:12:35.341153+0000","last_fullsized":"2023-10-16T13:12:35.341153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:48.930247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":310,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.343565+0000","last_change":"2023-10-16T13:10:38.800469+0000","last_active":"2023-10-16T13:12:35.343565+0000","last_peered":"2023-10-16T13:12:35.343565+0000","last_clean":"2023-10-16T13:12:35.343565+0000","last_became_active":"2023-10-16T13:10:38.799911+0000","last_became_peered":"2023-10-16T13:10:38.799911+0000","last_unstale":"2023-10-16T13:12:35.343565+0000","last_undegraded":"2023-10-16T13:12:35.343565+0000","last_fullsized":"2023-10-16T13:12:35.343565+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:07:46.238647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:07:46.238647+0000","last_clean_scrub_stamp":"2023-10-16T13:07:46.238647+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:43:42.258738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.290528+0000","last_change":"2023-10-16T13:11:40.974984+0000","last_active":"2023-10-16T13:13:05.290528+0000","last_peered":"2023-10-16T13:13:05.290528+0000","last_clean":"2023-10-16T13:13:05.290528+0000","last_became_active":"2023-10-16T13:11:40.974689+0000","last_became_peered":"2023-10-16T13:11:40.974689+0000","last_unstale":"2023-10-16T13:13:05.290528+0000","last_undegraded":"2023-10-16T13:13:05.290528+0000","last_fullsized":"2023-10-16T13:13:05.290528+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:04.119797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.343748+0000","last_change":"2023-10-16T13:11:39.957999+0000","last_active":"2023-10-16T13:12:35.343748+0000","last_peered":"2023-10-16T13:12:35.343748+0000","last_clean":"2023-10-16T13:12:35.343748+0000","last_became_active":"2023-10-16T13:11:39.957043+0000","last_became_peered":"2023-10-16T13:11:39.957043+0000","last_unstale":"2023-10-16T13:12:35.343748+0000","last_undegraded":"2023-10-16T13:12:35.343748+0000","last_fullsized":"2023-10-16T13:12:35.343748+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:12:27.150065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.346569+0000","last_change":"2023-10-16T13:11:39.953082+0000","last_active":"2023-10-16T13:12:35.346569+0000","last_peered":"2023-10-16T13:12:35.346569+0000","last_clean":"2023-10-16T13:12:35.346569+0000","last_became_active":"2023-10-16T13:11:39.952785+0000","last_became_peered":"2023-10-16T13:11:39.952785+0000","last_unstale":"2023-10-16T13:12:35.346569+0000","last_undegraded":"2023-10-16T13:12:35.346569+0000","last_fullsized":"2023-10-16T13:12:35.346569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:06:34.427841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295250+0000","last_change":"2023-10-16T13:11:40.968761+0000","last_active":"2023-10-16T13:13:05.295250+0000","last_peered":"2023-10-16T13:13:05.295250+0000","last_clean":"2023-10-16T13:13:05.295250+0000","last_became_active":"2023-10-16T13:11:40.968466+0000","last_became_peered":"2023-10-16T13:11:40.968466+0000","last_unstale":"2023-10-16T13:13:05.295250+0000","last_undegraded":"2023-10-16T13:13:05.295250+0000","last_fullsized":"2023-10-16T13:13:05.295250+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:22:15.577411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'12","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:08.478831+0000","last_change":"2023-10-16T13:11:39.957019+0000","last_active":"2023-10-16T13:13:08.478831+0000","last_peered":"2023-10-16T13:13:08.478831+0000","last_clean":"2023-10-16T13:13:08.478831+0000","last_became_active":"2023-10-16T13:11:39.956687+0000","last_became_peered":"2023-10-16T13:11:39.956687+0000","last_unstale":"2023-10-16T13:13:08.478831+0000","last_undegraded":"2023-10-16T13:13:08.478831+0000","last_fullsized":"2023-10-16T13:13:08.478831+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:17.049740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.300128+0000","last_change":"2023-10-16T13:11:40.973938+0000","last_active":"2023-10-16T13:13:05.300128+0000","last_peered":"2023-10-16T13:13:05.300128+0000","last_clean":"2023-10-16T13:13:05.300128+0000","last_became_active":"2023-10-16T13:11:40.973579+0000","last_became_peered":"2023-10-16T13:11:40.973579+0000","last_unstale":"2023-10-16T13:13:05.300128+0000","last_undegraded":"2023-10-16T13:13:05.300128+0000","last_fullsized":"2023-10-16T13:13:05.300128+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:49:29.153231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.341898+0000","last_change":"2023-10-16T13:11:39.954368+0000","last_active":"2023-10-16T13:12:35.341898+0000","last_peered":"2023-10-16T13:12:35.341898+0000","last_clean":"2023-10-16T13:12:35.341898+0000","last_became_active":"2023-10-16T13:11:39.953967+0000","last_became_peered":"2023-10-16T13:11:39.953967+0000","last_unstale":"2023-10-16T13:12:35.341898+0000","last_undegraded":"2023-10-16T13:12:35.341898+0000","last_fullsized":"2023-10-16T13:12:35.341898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:43:49.278655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.302013+0000","last_change":"2023-10-16T13:11:40.975917+0000","last_active":"2023-10-16T13:13:05.302013+0000","last_peered":"2023-10-16T13:13:05.302013+0000","last_clean":"2023-10-16T13:13:05.302013+0000","last_became_active":"2023-10-16T13:11:40.975610+0000","last_became_peered":"2023-10-16T13:11:40.975610+0000","last_unstale":"2023-10-16T13:13:05.302013+0000","last_undegraded":"2023-10-16T13:13:05.302013+0000","last_fullsized":"2023-10-16T13:13:05.302013+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:41.006584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.342310+0000","last_change":"2023-10-16T13:11:39.960169+0000","last_active":"2023-10-16T13:12:35.342310+0000","last_peered":"2023-10-16T13:12:35.342310+0000","last_clean":"2023-10-16T13:12:35.342310+0000","last_became_active":"2023-10-16T13:11:39.959385+0000","last_became_peered":"2023-10-16T13:11:39.959385+0000","last_unstale":"2023-10-16T13:12:35.342310+0000","last_undegraded":"2023-10-16T13:12:35.342310+0000","last_fullsized":"2023-10-16T13:12:35.342310+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:50:12.442686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.275133+0000","last_change":"2023-10-16T13:11:40.971165+0000","last_active":"2023-10-16T13:13:05.275133+0000","last_peered":"2023-10-16T13:13:05.275133+0000","last_clean":"2023-10-16T13:13:05.275133+0000","last_became_active":"2023-10-16T13:11:40.970341+0000","last_became_peered":"2023-10-16T13:11:40.970341+0000","last_unstale":"2023-10-16T13:13:05.275133+0000","last_undegraded":"2023-10-16T13:13:05.275133+0000","last_fullsized":"2023-10-16T13:13:05.275133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:39:48.393642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.341601+0000","last_change":"2023-10-16T13:11:39.953044+0000","last_active":"2023-10-16T13:12:35.341601+0000","last_peered":"2023-10-16T13:12:35.341601+0000","last_clean":"2023-10-16T13:12:35.341601+0000","last_became_active":"2023-10-16T13:11:39.952752+0000","last_became_peered":"2023-10-16T13:11:39.952752+0000","last_unstale":"2023-10-16T13:12:35.341601+0000","last_undegraded":"2023-10-16T13:12:35.341601+0000","last_fullsized":"2023-10-16T13:12:35.341601+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:33:12.277430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.300954+0000","last_change":"2023-10-16T13:11:40.974739+0000","last_active":"2023-10-16T13:13:05.300954+0000","last_peered":"2023-10-16T13:13:05.300954+0000","last_clean":"2023-10-16T13:13:05.300954+0000","last_became_active":"2023-10-16T13:11:40.974387+0000","last_became_peered":"2023-10-16T13:11:40.974387+0000","last_unstale":"2023-10-16T13:13:05.300954+0000","last_undegraded":"2023-10-16T13:13:05.300954+0000","last_fullsized":"2023-10-16T13:13:05.300954+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:28:16.384359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:12:37.822867+0000","last_change":"2023-10-16T13:12:36.353537+0000","last_active":"2023-10-16T13:12:37.822867+0000","last_peered":"2023-10-16T13:12:37.822867+0000","last_clean":"2023-10-16T13:12:37.822867+0000","last_became_active":"2023-10-16T13:12:36.348246+0000","last_became_peered":"2023-10-16T13:12:36.348246+0000","last_unstale":"2023-10-16T13:12:37.822867+0000","last_undegraded":"2023-10-16T13:12:37.822867+0000","last_fullsized":"2023-10-16T13:12:37.822867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:52:54.550287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292097+0000","last_change":"2023-10-16T13:11:40.971153+0000","last_active":"2023-10-16T13:13:05.292097+0000","last_peered":"2023-10-16T13:13:05.292097+0000","last_clean":"2023-10-16T13:13:05.292097+0000","last_became_active":"2023-10-16T13:11:40.970772+0000","last_became_peered":"2023-10-16T13:11:40.970772+0000","last_unstale":"2023-10-16T13:13:05.292097+0000","last_undegraded":"2023-10-16T13:13:05.292097+0000","last_fullsized":"2023-10-16T13:13:05.292097+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:34.450600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.345873+0000","last_change":"2023-10-16T13:11:39.957589+0000","last_active":"2023-10-16T13:12:35.345873+0000","last_peered":"2023-10-16T13:12:35.345873+0000","last_clean":"2023-10-16T13:12:35.345873+0000","last_became_active":"2023-10-16T13:11:39.957334+0000","last_became_peered":"2023-10-16T13:11:39.957334+0000","last_unstale":"2023-10-16T13:12:35.345873+0000","last_undegraded":"2023-10-16T13:12:35.345873+0000","last_fullsized":"2023-10-16T13:12:35.345873+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:42:58.126279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.299537+0000","last_change":"2023-10-16T13:11:40.979906+0000","last_active":"2023-10-16T13:13:05.299537+0000","last_peered":"2023-10-16T13:13:05.299537+0000","last_clean":"2023-10-16T13:13:05.299537+0000","last_became_active":"2023-10-16T13:11:40.979506+0000","last_became_peered":"2023-10-16T13:11:40.979506+0000","last_unstale":"2023-10-16T13:13:05.299537+0000","last_undegraded":"2023-10-16T13:13:05.299537+0000","last_fullsized":"2023-10-16T13:13:05.299537+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:06:33.566642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'6","reported_seq":110,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:12.464047+0000","last_change":"2023-10-16T13:11:39.961062+0000","last_active":"2023-10-16T13:13:12.464047+0000","last_peered":"2023-10-16T13:13:12.464047+0000","last_clean":"2023-10-16T13:13:12.464047+0000","last_became_active":"2023-10-16T13:11:39.960615+0000","last_became_peered":"2023-10-16T13:11:39.960615+0000","last_unstale":"2023-10-16T13:13:12.464047+0000","last_undegraded":"2023-10-16T13:13:12.464047+0000","last_fullsized":"2023-10-16T13:13:12.464047+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:59:52.598863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.299689+0000","last_change":"2023-10-16T13:11:40.979874+0000","last_active":"2023-10-16T13:13:05.299689+0000","last_peered":"2023-10-16T13:13:05.299689+0000","last_clean":"2023-10-16T13:13:05.299689+0000","last_became_active":"2023-10-16T13:11:40.979444+0000","last_became_peered":"2023-10-16T13:11:40.979444+0000","last_unstale":"2023-10-16T13:13:05.299689+0000","last_undegraded":"2023-10-16T13:13:05.299689+0000","last_fullsized":"2023-10-16T13:13:05.299689+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:27:38.533986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.342306+0000","last_change":"2023-10-16T13:11:39.962428+0000","last_active":"2023-10-16T13:12:35.342306+0000","last_peered":"2023-10-16T13:12:35.342306+0000","last_clean":"2023-10-16T13:12:35.342306+0000","last_became_active":"2023-10-16T13:11:39.962028+0000","last_became_peered":"2023-10-16T13:11:39.962028+0000","last_unstale":"2023-10-16T13:12:35.342306+0000","last_undegraded":"2023-10-16T13:12:35.342306+0000","last_fullsized":"2023-10-16T13:12:35.342306+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:43:25.415571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295958+0000","last_change":"2023-10-16T13:12:36.352328+0000","last_active":"2023-10-16T13:13:05.295958+0000","last_peered":"2023-10-16T13:13:05.295958+0000","last_clean":"2023-10-16T13:13:05.295958+0000","last_became_active":"2023-10-16T13:12:36.348641+0000","last_became_peered":"2023-10-16T13:12:36.348641+0000","last_unstale":"2023-10-16T13:13:05.295958+0000","last_undegraded":"2023-10-16T13:13:05.295958+0000","last_fullsized":"2023-10-16T13:13:05.295958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:41:00.806794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-16T13:12:35.344184+0000","last_change":"2023-10-16T13:11:39.960173+0000","last_active":"2023-10-16T13:12:35.344184+0000","last_peered":"2023-10-16T13:12:35.344184+0000","last_clean":"2023-10-16T13:12:35.344184+0000","last_became_active":"2023-10-16T13:11:39.959839+0000","last_became_peered":"2023-10-16T13:11:39.959839+0000","last_unstale":"2023-10-16T13:12:35.344184+0000","last_undegraded":"2023-10-16T13:12:35.344184+0000","last_fullsized":"2023-10-16T13:12:35.344184+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:38.937442+0000","last_clean_scrub_stamp":"2023-10-16T13:11:38.937442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:31:16.379341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.296310+0000","last_change":"2023-10-16T13:11:40.974349+0000","last_active":"2023-10-16T13:13:05.296310+0000","last_peered":"2023-10-16T13:13:05.296310+0000","last_clean":"2023-10-16T13:13:05.296310+0000","last_became_active":"2023-10-16T13:11:40.973189+0000","last_became_peered":"2023-10-16T13:11:40.973189+0000","last_unstale":"2023-10-16T13:13:05.296310+0000","last_undegraded":"2023-10-16T13:13:05.296310+0000","last_fullsized":"2023-10-16T13:13:05.296310+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:45:05.177277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292212+0000","last_change":"2023-10-16T13:11:40.972862+0000","last_active":"2023-10-16T13:13:05.292212+0000","last_peered":"2023-10-16T13:13:05.292212+0000","last_clean":"2023-10-16T13:13:05.292212+0000","last_became_active":"2023-10-16T13:11:40.972558+0000","last_became_peered":"2023-10-16T13:11:40.972558+0000","last_unstale":"2023-10-16T13:13:05.292212+0000","last_undegraded":"2023-10-16T13:13:05.292212+0000","last_fullsized":"2023-10-16T13:13:05.292212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:09:36.149610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.289075+0000","last_change":"2023-10-16T13:11:40.973449+0000","last_active":"2023-10-16T13:13:05.289075+0000","last_peered":"2023-10-16T13:13:05.289075+0000","last_clean":"2023-10-16T13:13:05.289075+0000","last_became_active":"2023-10-16T13:11:40.973044+0000","last_became_peered":"2023-10-16T13:11:40.973044+0000","last_unstale":"2023-10-16T13:13:05.289075+0000","last_undegraded":"2023-10-16T13:13:05.289075+0000","last_fullsized":"2023-10-16T13:13:05.289075+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:22.883943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.300066+0000","last_change":"2023-10-16T13:11:40.970871+0000","last_active":"2023-10-16T13:13:05.300066+0000","last_peered":"2023-10-16T13:13:05.300066+0000","last_clean":"2023-10-16T13:13:05.300066+0000","last_became_active":"2023-10-16T13:11:40.970554+0000","last_became_peered":"2023-10-16T13:11:40.970554+0000","last_unstale":"2023-10-16T13:13:05.300066+0000","last_undegraded":"2023-10-16T13:13:05.300066+0000","last_fullsized":"2023-10-16T13:13:05.300066+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:46:34.449007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.302378+0000","last_change":"2023-10-16T13:11:40.975827+0000","last_active":"2023-10-16T13:13:05.302378+0000","last_peered":"2023-10-16T13:13:05.302378+0000","last_clean":"2023-10-16T13:13:05.302378+0000","last_became_active":"2023-10-16T13:11:40.975514+0000","last_became_peered":"2023-10-16T13:11:40.975514+0000","last_unstale":"2023-10-16T13:13:05.302378+0000","last_undegraded":"2023-10-16T13:13:05.302378+0000","last_fullsized":"2023-10-16T13:13:05.302378+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:34:47.901390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.300133+0000","last_change":"2023-10-16T13:11:40.975088+0000","last_active":"2023-10-16T13:13:05.300133+0000","last_peered":"2023-10-16T13:13:05.300133+0000","last_clean":"2023-10-16T13:13:05.300133+0000","last_became_active":"2023-10-16T13:11:40.974286+0000","last_became_peered":"2023-10-16T13:11:40.974286+0000","last_unstale":"2023-10-16T13:13:05.300133+0000","last_undegraded":"2023-10-16T13:13:05.300133+0000","last_fullsized":"2023-10-16T13:13:05.300133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:15:50.270651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292594+0000","last_change":"2023-10-16T13:11:40.973111+0000","last_active":"2023-10-16T13:13:05.292594+0000","last_peered":"2023-10-16T13:13:05.292594+0000","last_clean":"2023-10-16T13:13:05.292594+0000","last_became_active":"2023-10-16T13:11:40.972826+0000","last_became_peered":"2023-10-16T13:11:40.972826+0000","last_unstale":"2023-10-16T13:13:05.292594+0000","last_undegraded":"2023-10-16T13:13:05.292594+0000","last_fullsized":"2023-10-16T13:13:05.292594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:43.523165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.288220+0000","last_change":"2023-10-16T13:11:40.980303+0000","last_active":"2023-10-16T13:13:05.288220+0000","last_peered":"2023-10-16T13:13:05.288220+0000","last_clean":"2023-10-16T13:13:05.288220+0000","last_became_active":"2023-10-16T13:11:40.979987+0000","last_became_peered":"2023-10-16T13:11:40.979987+0000","last_unstale":"2023-10-16T13:13:05.288220+0000","last_undegraded":"2023-10-16T13:13:05.288220+0000","last_fullsized":"2023-10-16T13:13:05.288220+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:38:16.402231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.292515+0000","last_change":"2023-10-16T13:11:40.966547+0000","last_active":"2023-10-16T13:13:05.292515+0000","last_peered":"2023-10-16T13:13:05.292515+0000","last_clean":"2023-10-16T13:13:05.292515+0000","last_became_active":"2023-10-16T13:11:40.966149+0000","last_became_peered":"2023-10-16T13:11:40.966149+0000","last_unstale":"2023-10-16T13:13:05.292515+0000","last_undegraded":"2023-10-16T13:13:05.292515+0000","last_fullsized":"2023-10-16T13:13:05.292515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:27:47.007356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.295257+0000","last_change":"2023-10-16T13:11:40.968511+0000","last_active":"2023-10-16T13:13:05.295257+0000","last_peered":"2023-10-16T13:13:05.295257+0000","last_clean":"2023-10-16T13:13:05.295257+0000","last_became_active":"2023-10-16T13:11:40.968185+0000","last_became_peered":"2023-10-16T13:11:40.968185+0000","last_unstale":"2023-10-16T13:13:05.295257+0000","last_undegraded":"2023-10-16T13:13:05.295257+0000","last_fullsized":"2023-10-16T13:13:05.295257+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:31:43.779875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.293638+0000","last_change":"2023-10-16T13:11:40.974616+0000","last_active":"2023-10-16T13:13:05.293638+0000","last_peered":"2023-10-16T13:13:05.293638+0000","last_clean":"2023-10-16T13:13:05.293638+0000","last_became_active":"2023-10-16T13:11:40.974295+0000","last_became_peered":"2023-10-16T13:11:40.974295+0000","last_unstale":"2023-10-16T13:13:05.293638+0000","last_undegraded":"2023-10-16T13:13:05.293638+0000","last_fullsized":"2023-10-16T13:13:05.293638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:47.838853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.304078+0000","last_change":"2023-10-16T13:11:40.974927+0000","last_active":"2023-10-16T13:13:05.304078+0000","last_peered":"2023-10-16T13:13:05.304078+0000","last_clean":"2023-10-16T13:13:05.304078+0000","last_became_active":"2023-10-16T13:11:40.974332+0000","last_became_peered":"2023-10-16T13:11:40.974332+0000","last_unstale":"2023-10-16T13:13:05.304078+0000","last_undegraded":"2023-10-16T13:13:05.304078+0000","last_fullsized":"2023-10-16T13:13:05.304078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:07:24.974440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.301095+0000","last_change":"2023-10-16T13:11:40.972793+0000","last_active":"2023-10-16T13:13:05.301095+0000","last_peered":"2023-10-16T13:13:05.301095+0000","last_clean":"2023-10-16T13:13:05.301095+0000","last_became_active":"2023-10-16T13:11:40.972008+0000","last_became_peered":"2023-10-16T13:11:40.972008+0000","last_unstale":"2023-10-16T13:13:05.301095+0000","last_undegraded":"2023-10-16T13:13:05.301095+0000","last_fullsized":"2023-10-16T13:13:05.301095+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:53.487238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-16T13:13:05.300269+0000","last_change":"2023-10-16T13:11:40.977282+0000","last_active":"2023-10-16T13:13:05.300269+0000","last_peered":"2023-10-16T13:13:05.300269+0000","last_clean":"2023-10-16T13:13:05.300269+0000","last_became_active":"2023-10-16T13:11:40.976872+0000","last_became_peered":"2023-10-16T13:11:40.976872+0000","last_unstale":"2023-10-16T13:13:05.300269+0000","last_undegraded":"2023-10-16T13:13:05.300269+0000","last_fullsized":"2023-10-16T13:13:05.300269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:11:39.939128+0000","last_clean_scrub_stamp":"2023-10-16T13:11:39.939128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:43:48.735584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65597,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":870,"num_read_kb":508,"num_write":249,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":58558,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":197427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449118,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":443952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.55700000000000005,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40699999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.45300000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.48799999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86399999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.58299999999999996,"15min":0.57299999999999995},"min":{"1min":0.40500000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.56699999999999995}]},{"osd":2,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.48699999999999999,"15min":0.47699999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.53300000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.63,"15min":0.621},"min":{"1min":0.47099999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.69999999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61299999999999999,"15min":0.60999999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.621,"15min":0.621},"min":{"1min":0.45600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.68200000000000005}]},{"osd":6,"last update":"Mon Oct 16 13:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.63},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.93899999999999995}]},{"osd":7,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.56299999999999994,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70199999999999996,"15min":0.69799999999999995},"min":{"1min":0.54000000000000004,"5min":0.434,"15min":0.434},"max":{"1min":0.95899999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.74099999999999999}]},{"osd":8,"last update":"Mon Oct 16 13:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.83199999999999996}]},{"osd":9,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76600000000000001,"15min":0.76300000000000001},"min":{"1min":0.58399999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.49299999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.71599999999999997}]},{"osd":10,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.76900000000000002,"15min":0.76600000000000001},"min":{"1min":0.627,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92800000000000005,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.79900000000000004,"15min":0.79300000000000004},"min":{"1min":0.68100000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.85899999999999999}]}]},{"osd":10,"up_from":71,"seq":304942678050,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1630208,"data_stored":1092995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.627},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.68000000000000005}]},{"osd":1,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.434,"15min":0.438},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.5,"15min":0.51100000000000001},"min":{"1min":0.34699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.61099999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.29599999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.50800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84299999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.45700000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.65200000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.57899999999999996,"15min":0.59099999999999997},"min":{"1min":0.41799999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75600000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.63800000000000001,"15min":0.65200000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.73299999999999998,"5min":0.997,"15min":0.997},"last":0.49399999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.434,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77500000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.438,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.89900000000000002,"5min":1.161,"15min":1.161},"last":0.34899999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67100000000000004,"15min":0.66000000000000003},"min":{"1min":0.57499999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.53600000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93999999999999995,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.55800000000000005}]},{"osd":6,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.68899999999999995,"15min":0.70099999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88300000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.69599999999999995,"15min":0.70399999999999996},"min":{"1min":0.52100000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.82699999999999996,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.63800000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.504}]},{"osd":8,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.61799999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.91900000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77800000000000002,"15min":0.77600000000000002},"min":{"1min":0.64300000000000002,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0049999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.74299999999999999}]},{"osd":9,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.85199999999999998,"15min":0.874},"min":{"1min":0.56399999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.86499999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97799999999999998,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.71799999999999997}]},{"osd":11,"last update":"Mon Oct 16 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.76600000000000001,"15min":0.76200000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.052,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96099999999999997,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.66500000000000004}]}]},{"osd":9,"up_from":66,"seq":283467841576,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":443687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.39000000000000001,"15min":0.39500000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.372},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.35399999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.58199999999999996,"15min":0.59199999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.85299999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79600000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.56000000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.38800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76000000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.755,"5min":0.88,"15min":0.88},"last":0.51700000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.50800000000000001,"15min":0.51600000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.5,"15min":0.50600000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.70799999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.33500000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.625,"15min":0.63700000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.879,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63200000000000001,"15min":0.63800000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91100000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.54200000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79800000000000004,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.63},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84299999999999997,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.67000000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83299999999999996,"5min":1.109,"15min":1.109},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80900000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.59399999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70299999999999996,"15min":0.71299999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86099999999999999,"5min":0.996,"15min":0.996},"last":0.497},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92800000000000005,"5min":1.222,"15min":1.222},"last":0.57699999999999996}]},{"osd":8,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72499999999999998,"15min":0.73499999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84799999999999998,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.746,"15min":0.755},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86499999999999999,"5min":1.153,"15min":1.153},"last":0.70199999999999996}]},{"osd":10,"last update":"Mon Oct 16 13:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71499999999999997,"15min":0.72699999999999998},"min":{"1min":0.501,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.78200000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.73499999999999999,"15min":0.747},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.80900000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.623}]}]},{"osd":8,"up_from":59,"seq":253403070507,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":443942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.40600000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.754,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38500000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78800000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.56699999999999995}]},{"osd":1,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60699999999999998,"15min":0.58899999999999997},"min":{"1min":0.52200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.625,"15min":0.61399999999999999},"min":{"1min":0.497,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85899999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.45300000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46200000000000002,"15min":0.45100000000000001},"min":{"1min":0.40300000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.65500000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.503,"15min":0.48299999999999998},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.54200000000000004}]},{"osd":3,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.42299999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.77400000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59699999999999998,"15min":0.58099999999999996},"min":{"1min":0.47499999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82699999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.75700000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.63600000000000001,"15min":0.63300000000000001},"min":{"1min":0.48399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.66000000000000003,"15min":0.64100000000000001},"min":{"1min":0.55000000000000004,"5min":0.377,"15min":0.377},"max":{"1min":1.02,"5min":1.036,"15min":1.036},"last":0.80700000000000005}]},{"osd":5,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.58699999999999997,"15min":0.55500000000000005},"min":{"1min":0.51500000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.60999999999999999,"15min":0.57999999999999996},"min":{"1min":0.52300000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.997,"5min":1.042,"15min":1.042},"last":0.71399999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.71899999999999997,"15min":0.67100000000000004},"min":{"1min":0.63100000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96199999999999997,"5min":3.6659999999999999,"15min":3.6659999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.74099999999999999,"15min":0.71499999999999997},"min":{"1min":0.56499999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":0.64900000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.745,"15min":0.71899999999999997},"min":{"1min":0.60099999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.73699999999999999,"15min":0.71899999999999997},"min":{"1min":0.61099999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.038,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.78100000000000003}]},{"osd":9,"last update":"Mon Oct 16 13:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.74199999999999999,"15min":0.71699999999999997},"min":{"1min":0.61099999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.415,"5min":2.415,"15min":2.415},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.71599999999999997,"15min":0.69999999999999996},"min":{"1min":0.54600000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.93200000000000005}]},{"osd":10,"last update":"Mon Oct 16 13:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.72399999999999998,"15min":0.70399999999999996},"min":{"1min":0.64300000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.034,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.85499999999999998,"15min":0.85099999999999998},"min":{"1min":0.69199999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.046,"5min":3.694,"15min":3.694},"last":0.96499999999999997}]},{"osd":11,"last update":"Mon Oct 16 13:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.89900000000000002}]}]},{"osd":7,"up_from":51,"seq":219043332143,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1552384,"data_stored":1037137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.38},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.34699999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.42199999999999999,"15min":0.41199999999999998},"min":{"1min":0.33700000000000002,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.42599999999999999,"15min":0.41199999999999998},"min":{"1min":0.36399999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.45500000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.48799999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.59899999999999998,"15min":0.57899999999999996},"min":{"1min":0.44900000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.66900000000000004}]},{"osd":3,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.59499999999999997},"min":{"1min":0.45400000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.72099999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.625},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.441,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78000000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55800000000000005}]},{"osd":4,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.51000000000000001,"15min":0.49199999999999999},"min":{"1min":0.40000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.49099999999999999,"15min":0.46899999999999997},"min":{"1min":0.39000000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.51100000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.65700000000000003,"15min":0.64400000000000002},"min":{"1min":0.55600000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89500000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68000000000000005,"15min":0.66000000000000003},"min":{"1min":0.51600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94399999999999995,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66900000000000004,"15min":0.65900000000000003},"min":{"1min":0.51400000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.67700000000000005,"15min":0.66300000000000003},"min":{"1min":0.54800000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.75700000000000001}]},{"osd":8,"last update":"Mon Oct 16 13:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.71999999999999997,"15min":0.69399999999999995},"min":{"1min":0.60899999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.68100000000000005,"15min":0.65700000000000003},"min":{"1min":0.65200000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.77500000000000002}]},{"osd":9,"last update":"Mon Oct 16 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.72599999999999998,"15min":0.71999999999999997},"min":{"1min":0.623,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.56899999999999995,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.85199999999999998}]},{"osd":10,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.70499999999999996,"15min":0.69799999999999995},"min":{"1min":0.53000000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.749,"15min":0.74099999999999999},"min":{"1min":0.64500000000000002,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.80400000000000005}]},{"osd":11,"last update":"Mon Oct 16 13:12:44 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.90200000000000002}]}]},{"osd":6,"up_from":46,"seq":197568495668,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":443287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.376,"15min":0.374},"min":{"1min":0.255,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":0.621,"15min":0.621},"last":0.375},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.39400000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54300000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.44800000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.36599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73199999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":1,"15min":1},"last":0.48199999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.45100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70799999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60799999999999998,"15min":0.60899999999999999},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.76200000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.64300000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.441,"15min":0.443},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.629,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65000000000000002,"5min":0.748,"15min":0.748},"last":0.40699999999999997}]},{"osd":4,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.629,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84799999999999998,"5min":1.014,"15min":1.014},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76300000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.495}]},{"osd":5,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77500000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77200000000000002,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Mon Oct 16 13:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67200000000000004,"15min":0.67100000000000004},"min":{"1min":0.48099999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.876,"5min":1.371,"15min":1.371},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.83299999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.57499999999999996}]},{"osd":8,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.65300000000000002,"15min":0.67200000000000004},"min":{"1min":0.435,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76100000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.64700000000000002,"15min":0.65800000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.74299999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.68799999999999994}]},{"osd":9,"last update":"Mon Oct 16 13:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.61299999999999999,"15min":0.63100000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.71099999999999997,"15min":0.73499999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82599999999999996,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.621}]},{"osd":10,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.82299999999999995,"5min":1.429,"15min":1.429},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.71399999999999997,"15min":0.72799999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.86299999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.72099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":503460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.502,"15min":0.46200000000000002},"min":{"1min":0.32700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53500000000000003,"15min":0.48199999999999998},"min":{"1min":0.35099999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.78700000000000003,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.52300000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.56699999999999995,"15min":0.52700000000000002},"min":{"1min":0.45300000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.57399999999999995,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.73199999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.50800000000000001},"min":{"1min":0.38200000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83999999999999997,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56899999999999995,"15min":0.52100000000000002},"min":{"1min":0.39700000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85199999999999998,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.55800000000000005}]},{"osd":4,"last update":"Mon Oct 16 13:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.432,"15min":0.40400000000000003},"min":{"1min":0.31,"5min":0.251,"15min":0.251},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.45700000000000002,"15min":0.433},"min":{"1min":0.30499999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.66900000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.64100000000000001,"15min":0.59899999999999998},"min":{"1min":0.45300000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.75},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.66100000000000003,"15min":0.60899999999999999},"min":{"1min":0.52200000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.81100000000000005}]},{"osd":6,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63300000000000001,"15min":0.64100000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84899999999999998,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.63100000000000001},"min":{"1min":0.45900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.876,"5min":1.429,"15min":1.429},"last":0.63800000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.56899999999999995,"15min":0.54400000000000004},"min":{"1min":0.40500000000000003,"5min":0.312,"15min":0.312},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.59299999999999997,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.82999999999999996}]},{"osd":8,"last update":"Mon Oct 16 13:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.69199999999999995,"15min":0.67400000000000004},"min":{"1min":0.52400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.71699999999999997,"15min":0.69199999999999995},"min":{"1min":0.53100000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.84299999999999997}]},{"osd":9,"last update":"Mon Oct 16 13:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.71699999999999997,"15min":0.70799999999999996},"min":{"1min":0.55100000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.98999999999999999,"5min":1.022,"15min":1.022},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.71999999999999997,"15min":0.71499999999999997},"min":{"1min":0.53500000000000003,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91600000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.88}]},{"osd":10,"last update":"Mon Oct 16 13:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.72699999999999998,"15min":0.71399999999999997},"min":{"1min":0.38200000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.87},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.755,"15min":0.74099999999999999},"min":{"1min":0.49199999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.97899999999999998}]},{"osd":11,"last update":"Mon Oct 16 13:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.012}]}]},{"osd":0,"up_from":8,"seq":34359738445,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":444938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53500000000000003,"15min":0.50900000000000001},"min":{"1min":0.40799999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69499999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.499},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54200000000000004,"15min":0.50600000000000001},"min":{"1min":0.41899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.77400000000000002,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.47699999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56299999999999994,"15min":0.53700000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77500000000000002,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.67100000000000004,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.433},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.38900000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54300000000000004,"15min":0.50800000000000001},"min":{"1min":0.42199999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.627,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.72499999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.61599999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.443,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79000000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.50800000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69699999999999995,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.52100000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:12:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.48099999999999998,"15min":0.48899999999999999},"min":{"1min":0.317,"5min":0.315,"15min":0.315},"max":{"1min":0.59499999999999997,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48599999999999999,"15min":0.47499999999999998},"min":{"1min":0.36399999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67300000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.45900000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.42099999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0169999999999999,"5min":1.51,"15min":1.51},"last":0.61199999999999999}]},{"osd":8,"last update":"Mon Oct 16 13:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68600000000000005,"15min":0.70999999999999996},"min":{"1min":0.53000000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.74199999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.495,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.76800000000000002,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.59599999999999997}]},{"osd":9,"last update":"Mon Oct 16 13:12:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.40600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.67000000000000004,"15min":0.68400000000000005},"min":{"1min":0.375,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.91700000000000004,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.54700000000000004}]},{"osd":10,"last update":"Mon Oct 16 13:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.70099999999999996,"15min":0.71199999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.76800000000000002,"5min":1.02,"15min":1.02},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.74099999999999999,"15min":0.75700000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.79300000000000004,"5min":1.097,"15min":1.097},"last":0.53100000000000003}]},{"osd":11,"last update":"Mon Oct 16 13:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.53800000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.80900000000000005,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67600000000000005,"15min":0.67800000000000005},"min":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93000000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.51200000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":444110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48599999999999999,"15min":0.47999999999999998},"min":{"1min":0.35399999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72499999999999998,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.5},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51900000000000002,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68799999999999994,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.45000000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57499999999999996,"15min":0.50900000000000001},"min":{"1min":0.34100000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86199999999999999,"5min":1,"15min":1},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.58499999999999996,"15min":0.51700000000000002},"min":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93100000000000005,"5min":1.02,"15min":1.02},"last":0.59599999999999997}]},{"osd":3,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.436,"5min":0.318,"15min":0.318},"max":{"1min":0.71899999999999997,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.44600000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72899999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.623},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.48399999999999999,"15min":0.45900000000000002},"min":{"1min":0.30399999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.52500000000000002,"15min":0.48099999999999998},"min":{"1min":0.33400000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.81599999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.82199999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63600000000000001,"15min":0.629},"min":{"1min":0.45800000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.63300000000000001,"15min":0.62},"min":{"1min":0.50900000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.75600000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.49099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.58599999999999997}]},{"osd":8,"last update":"Mon Oct 16 13:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.63600000000000001,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.67800000000000005,"15min":0.66100000000000003},"min":{"1min":0.47399999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.97899999999999998,"5min":1.109,"15min":1.109},"last":0.96399999999999997}]},{"osd":9,"last update":"Mon Oct 16 13:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.55200000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93899999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70299999999999996,"15min":0.69299999999999995},"min":{"1min":0.57199999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.93000000000000005}]},{"osd":10,"last update":"Mon Oct 16 13:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.746,"15min":0.72799999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.746,"15min":0.72399999999999998},"min":{"1min":0.64000000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":1.0449999999999999}]},{"osd":11,"last update":"Mon Oct 16 13:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":1.006}]}]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":442714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.33300000000000002},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.373,"5min":0.36899999999999999,"15min":0.34499999999999997},"min":{"1min":0.25600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.29199999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.50700000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53700000000000003,"15min":0.5},"min":{"1min":0.38100000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.749}]},{"osd":2,"last update":"Mon Oct 16 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.53300000000000003},"min":{"1min":0.41099999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.441},{"interface":"front","average":{"1min":0.622,"5min":0.57499999999999996,"15min":0.54200000000000004},"min":{"1min":0.48599999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.48399999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59699999999999998,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.748,"5min":6.032,"15min":6.032},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55700000000000005,"15min":0.53600000000000003},"min":{"1min":0.40100000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72099999999999997,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.439,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69399999999999995,"5min":0.871,"15min":0.871},"last":0.47099999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.501,"15min":0.5},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89200000000000002,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.60699999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.47199999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.75700000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.63500000000000001,"15min":0.625},"min":{"1min":0.48499999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78700000000000003,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.39900000000000002}]},{"osd":8,"last update":"Mon Oct 16 13:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.55500000000000005}]},{"osd":9,"last update":"Mon Oct 16 13:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.65800000000000003,"15min":0.66700000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.85699999999999998,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51000000000000001}]},{"osd":10,"last update":"Mon Oct 16 13:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.74199999999999999,"15min":0.755},"min":{"1min":0.55400000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.85299999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.56299999999999994,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.86799999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.499}]},{"osd":11,"last update":"Mon Oct 16 13:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.45500000000000002}]}]},{"osd":4,"up_from":33,"seq":141733920828,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":501786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.497,"15min":0.48799999999999999},"min":{"1min":0.377,"5min":0.318,"15min":0.318},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.51100000000000001,"15min":0.495},"min":{"1min":0.41899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.41899999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.39900000000000002,"15min":0.371},"min":{"1min":0.311,"5min":0.245,"15min":0.245},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.42399999999999999,"15min":0.40000000000000002},"min":{"1min":0.315,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57399999999999995,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.68200000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.624,"15min":0.58299999999999996},"min":{"1min":0.40699999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.63500000000000001,"15min":0.56899999999999995},"min":{"1min":0.47299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":3.5840000000000001,"5min":3.5840000000000001,"15min":3.5840000000000001},"last":0.69499999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57999999999999996,"15min":0.54600000000000004},"min":{"1min":0.495,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81000000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.76000000000000001,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.44600000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63800000000000001,"15min":0.621},"min":{"1min":0.38100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.84899999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63,"15min":0.59299999999999997},"min":{"1min":0.48099999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86199999999999999,"5min":1.399,"15min":1.399},"last":0.66300000000000003}]},{"osd":6,"last update":"Mon Oct 16 13:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60999999999999999,"15min":0.59599999999999997},"min":{"1min":0.42999999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77500000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.44500000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77400000000000002,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.40400000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57399999999999995,"15min":0.53700000000000003},"min":{"1min":0.38200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.59899999999999998,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.65500000000000003}]},{"osd":8,"last update":"Mon Oct 16 13:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.52100000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88700000000000001,"5min":0.999,"15min":0.999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.77600000000000002,"15min":0.73899999999999999},"min":{"1min":0.57699999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.6589999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":0.58599999999999997}]},{"osd":9,"last update":"Mon Oct 16 13:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.75,"15min":0.754},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.84699999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.63},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.753,"15min":0.76300000000000001},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88,"5min":1.595,"15min":1.595},"last":0.52000000000000002}]},{"osd":10,"last update":"Mon Oct 16 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78800000000000003,"15min":0.78600000000000003},"min":{"1min":0.60399999999999998,"5min":0.504,"15min":0.504},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.75,"15min":0.754},"min":{"1min":0.58399999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93799999999999994,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.504}]},{"osd":11,"last update":"Mon Oct 16 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.80500000000000005}]}]},{"osd":5,"up_from":38,"seq":163208757305,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1560576,"data_stored":1035953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.39400000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69499999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.38500000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74199999999999999,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.78900000000000003}]},{"osd":1,"last update":"Mon Oct 16 13:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.57299999999999995,"15min":0.52900000000000003},"min":{"1min":0.41299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.81999999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.55300000000000005,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76600000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.754}]},{"osd":2,"last update":"Mon Oct 16 13:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.438,"15min":0.40999999999999998},"min":{"1min":0.311,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69299999999999995,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.42099999999999999},"min":{"1min":0.36199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.74199999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59199999999999997}]},{"osd":3,"last update":"Mon Oct 16 13:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.36099999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83299999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.38100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72299999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.65400000000000003}]},{"osd":4,"last update":"Mon Oct 16 13:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61099999999999999,"15min":0.58399999999999996},"min":{"1min":0.44600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80500000000000005,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.61499999999999999,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.89500000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.626,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83099999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.627,"15min":0.621},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.72299999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67500000000000004,"15min":0.66700000000000004},"min":{"1min":0.495,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.504,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86699999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.86399999999999999}]},{"osd":8,"last update":"Mon Oct 16 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.39800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.68899999999999995,"15min":0.67600000000000005},"min":{"1min":0.53400000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.99299999999999999,"5min":1.016,"15min":1.016},"last":0.82099999999999995}]},{"osd":9,"last update":"Mon Oct 16 13:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.71099999999999997,"15min":0.70299999999999996},"min":{"1min":0.55900000000000005,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68999999999999995,"15min":0.68200000000000005},"min":{"1min":0.56699999999999995,"5min":0.435,"15min":0.435},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.80500000000000005}]},{"osd":10,"last update":"Mon Oct 16 13:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.754,"15min":0.73999999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.90400000000000003,"15min":0.91900000000000004},"min":{"1min":0.58699999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.92000000000000004,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.92800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":61018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":59344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":60062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:13:15.944 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:13:15.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:15 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1496418425' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:13:16.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:15 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1496418425' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:13:16.097 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.093+0000 7f643f30c700 1 -- 172.21.15.92:0/1766113708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6438104320 msgr2=0x7f6438106710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:16.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.093+0000 7f643f30c700 1 --2- 172.21.15.92:0/1766113708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6438104320 0x7f6438106710 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6434009990 tx=0x7f6434009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.093+0000 7f643f30c700 1 -- 172.21.15.92:0/1766113708 shutdown_connections 2023-10-16T13:13:16.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.093+0000 7f643f30c700 1 --2- 172.21.15.92:0/1766113708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6438106c50 0x7f6438109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.093+0000 7f643f30c700 1 --2- 172.21.15.92:0/1766113708 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64381019f0 0x7f6438103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.093+0000 7f643f30c700 1 --2- 172.21.15.92:0/1766113708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6438104320 0x7f6438106710 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.093+0000 7f643f30c700 1 -- 172.21.15.92:0/1766113708 >> 172.21.15.92:0/1766113708 conn(0x7f64380fb320 msgr2=0x7f64380fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:16.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.093+0000 7f643f30c700 1 -- 172.21.15.92:0/1766113708 shutdown_connections 2023-10-16T13:13:16.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.093+0000 7f643f30c700 1 -- 172.21.15.92:0/1766113708 wait complete. 2023-10-16T13:13:16.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.094+0000 7f643f30c700 1 Processor -- start 2023-10-16T13:13:16.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.094+0000 7f643f30c700 1 -- start start 2023-10-16T13:13:16.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.094+0000 7f643f30c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64381019f0 0x7f6438196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:16.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.094+0000 7f643f30c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6438104320 0x7f6438197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:16.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.094+0000 7f643f30c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6438106c50 0x7f643819e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:16.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.094+0000 7f643f30c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643819e660 con 0x7f6438104320 2023-10-16T13:13:16.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.094+0000 7f643f30c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643819e7a0 con 0x7f6438106c50 2023-10-16T13:13:16.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.094+0000 7f643f30c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643819e930 con 0x7f64381019f0 2023-10-16T13:13:16.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.094+0000 7f643c8a7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6438104320 0x7f6438197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:16.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.094+0000 7f643c8a7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6438104320 0x7f6438197020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36886/0 (socket says 172.21.15.92:36886) 2023-10-16T13:13:16.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.094+0000 7f643c8a7700 1 -- 172.21.15.92:0/1740216841 learned_addr learned my addr 172.21.15.92:0/1740216841 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:16.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.094+0000 7f643d8a9700 1 --2- 172.21.15.92:0/1740216841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6438106c50 0x7f643819e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:16.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.094+0000 7f643d0a8700 1 --2- 172.21.15.92:0/1740216841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64381019f0 0x7f6438196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:16.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.094+0000 7f643c8a7700 1 -- 172.21.15.92:0/1740216841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64381019f0 msgr2=0x7f6438196ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:16.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.094+0000 7f643c8a7700 1 --2- 172.21.15.92:0/1740216841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64381019f0 0x7f6438196ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.094+0000 7f643c8a7700 1 -- 172.21.15.92:0/1740216841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6438106c50 msgr2=0x7f643819e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:16.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.094+0000 7f643c8a7700 1 --2- 172.21.15.92:0/1740216841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6438106c50 0x7f643819e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.094+0000 7f643c8a7700 1 -- 172.21.15.92:0/1740216841 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64340095f0 con 0x7f6438104320 2023-10-16T13:13:16.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.094+0000 7f643c8a7700 1 --2- 172.21.15.92:0/1740216841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6438104320 0x7f6438197020 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f64340095c0 tx=0x7f643400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:16.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.095+0000 7f642e7fc700 1 -- 172.21.15.92:0/1740216841 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643401d070 con 0x7f6438104320 2023-10-16T13:13:16.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.095+0000 7f643f30c700 1 -- 172.21.15.92:0/1740216841 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643819ebb0 con 0x7f6438104320 2023-10-16T13:13:16.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.095+0000 7f642e7fc700 1 -- 172.21.15.92:0/1740216841 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6434005050 con 0x7f6438104320 2023-10-16T13:13:16.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.095+0000 7f643f30c700 1 -- 172.21.15.92:0/1740216841 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643819f030 con 0x7f6438104320 2023-10-16T13:13:16.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.095+0000 7f642e7fc700 1 -- 172.21.15.92:0/1740216841 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434004c70 con 0x7f6438104320 2023-10-16T13:13:16.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.095+0000 7f643f30c700 1 -- 172.21.15.92:0/1740216841 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f641c005310 con 0x7f6438104320 2023-10-16T13:13:16.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.097+0000 7f642e7fc700 1 -- 172.21.15.92:0/1740216841 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f643400fad0 con 0x7f6438104320 2023-10-16T13:13:16.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.097+0000 7f642e7fc700 1 --2- 172.21.15.92:0/1740216841 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f64240a1520 0x7f64240a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:16.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.097+0000 7f642e7fc700 1 -- 172.21.15.92:0/1740216841 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f64340cde80 con 0x7f6438104320 2023-10-16T13:13:16.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.097+0000 7f643d0a8700 1 --2- 172.21.15.92:0/1740216841 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f64240a1520 0x7f64240a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:16.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.098+0000 7f643d0a8700 1 --2- 172.21.15.92:0/1740216841 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f64240a1520 0x7f64240a39e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6428005950 tx=0x7f642800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:16.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.101+0000 7f642e7fc700 1 -- 172.21.15.92:0/1740216841 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6434097570 con 0x7f6438104320 2023-10-16T13:13:16.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.296+0000 7f643f30c700 1 -- 172.21.15.92:0/1740216841 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f641c005180 con 0x7f6438104320 2023-10-16T13:13:16.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.298+0000 7f642e7fc700 1 -- 172.21.15.92:0/1740216841 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22598 (secure 0 0 0) 0x7f643409ab90 con 0x7f6438104320 2023-10-16T13:13:16.300 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:13:16.300 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":85,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:12:36.335213+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:11:38.345035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:11:39.549912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:13:16.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.300+0000 7f643f30c700 1 -- 172.21.15.92:0/1740216841 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f64240a1520 msgr2=0x7f64240a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:16.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.300+0000 7f643f30c700 1 --2- 172.21.15.92:0/1740216841 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f64240a1520 0x7f64240a39e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6428005950 tx=0x7f642800b410 comp rx=0 tx=0).stop 2023-10-16T13:13:16.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.300+0000 7f643f30c700 1 -- 172.21.15.92:0/1740216841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6438104320 msgr2=0x7f6438197020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:16.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.300+0000 7f643f30c700 1 --2- 172.21.15.92:0/1740216841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6438104320 0x7f6438197020 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f64340095c0 tx=0x7f643400f690 comp rx=0 tx=0).stop 2023-10-16T13:13:16.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.300+0000 7f643f30c700 1 -- 172.21.15.92:0/1740216841 shutdown_connections 2023-10-16T13:13:16.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.300+0000 7f643f30c700 1 --2- 172.21.15.92:0/1740216841 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f64240a1520 0x7f64240a39e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.300+0000 7f643f30c700 1 --2- 172.21.15.92:0/1740216841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6438106c50 0x7f643819e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.300+0000 7f643f30c700 1 --2- 172.21.15.92:0/1740216841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64381019f0 0x7f6438196ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.300+0000 7f643f30c700 1 --2- 172.21.15.92:0/1740216841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6438104320 0x7f6438197020 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.300+0000 7f643f30c700 1 -- 172.21.15.92:0/1740216841 >> 172.21.15.92:0/1740216841 conn(0x7f64380fb320 msgr2=0x7f6438102660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:16.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.300+0000 7f643f30c700 1 -- 172.21.15.92:0/1740216841 shutdown_connections 2023-10-16T13:13:16.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.300+0000 7f643f30c700 1 -- 172.21.15.92:0/1740216841 wait complete. 2023-10-16T13:13:16.314 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:07:45.516334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:11:38.345035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:11:39.549912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:13:16.315 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:13:16.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.438+0000 7fcb6bfc8700 1 -- 172.21.15.92:0/2193200228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb640ffa00 msgr2=0x7fcb640ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:16.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.438+0000 7fcb6bfc8700 1 --2- 172.21.15.92:0/2193200228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb640ffa00 0x7fcb640ffe60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009990 tx=0x7fcb60009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.438+0000 7fcb6bfc8700 1 -- 172.21.15.92:0/2193200228 shutdown_connections 2023-10-16T13:13:16.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.438+0000 7fcb6bfc8700 1 --2- 172.21.15.92:0/2193200228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb641003a0 0x7fcb64108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.438+0000 7fcb6bfc8700 1 --2- 172.21.15.92:0/2193200228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb641014d0 0x7fcb641018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.438+0000 7fcb6bfc8700 1 --2- 172.21.15.92:0/2193200228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb640ffa00 0x7fcb640ffe60 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.438+0000 7fcb6bfc8700 1 -- 172.21.15.92:0/2193200228 >> 172.21.15.92:0/2193200228 conn(0x7fcb640fb320 msgr2=0x7fcb640fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:16.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.438+0000 7fcb6bfc8700 1 -- 172.21.15.92:0/2193200228 shutdown_connections 2023-10-16T13:13:16.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.438+0000 7fcb6bfc8700 1 -- 172.21.15.92:0/2193200228 wait complete. 2023-10-16T13:13:16.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb6bfc8700 1 Processor -- start 2023-10-16T13:13:16.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb6bfc8700 1 -- start start 2023-10-16T13:13:16.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb6bfc8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb640ffa00 0x7fcb64069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:16.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb6bfc8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb641003a0 0x7fcb6419bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:16.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb6bfc8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb641014d0 0x7fcb6419e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:16.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb6bfc8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6419e900 con 0x7fcb641014d0 2023-10-16T13:13:16.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb6bfc8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6419ea70 con 0x7fcb641003a0 2023-10-16T13:13:16.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb6bfc8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6419ec30 con 0x7fcb640ffa00 2023-10-16T13:13:16.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb6a565700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb641014d0 0x7fcb6419e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:16.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb6a565700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb641014d0 0x7fcb6419e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36902/0 (socket says 172.21.15.92:36902) 2023-10-16T13:13:16.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb6a565700 1 -- 172.21.15.92:0/725174798 learned_addr learned my addr 172.21.15.92:0/725174798 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:16.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb69d64700 1 --2- 172.21.15.92:0/725174798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb640ffa00 0x7fcb64069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:16.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb69563700 1 --2- 172.21.15.92:0/725174798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb641003a0 0x7fcb6419bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:16.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb6a565700 1 -- 172.21.15.92:0/725174798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb640ffa00 msgr2=0x7fcb64069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:16.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb6a565700 1 --2- 172.21.15.92:0/725174798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb640ffa00 0x7fcb64069b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb6a565700 1 -- 172.21.15.92:0/725174798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb641003a0 msgr2=0x7fcb6419bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:16.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb6a565700 1 --2- 172.21.15.92:0/725174798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb641003a0 0x7fcb6419bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb6a565700 1 -- 172.21.15.92:0/725174798 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb600095f0 con 0x7fcb641014d0 2023-10-16T13:13:16.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb69563700 1 --2- 172.21.15.92:0/725174798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb641003a0 0x7fcb6419bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:16.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb6a565700 1 --2- 172.21.15.92:0/725174798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb641014d0 0x7fcb6419e130 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00ada0 tx=0x7fcb5c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:16.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb5affd700 1 -- 172.21.15.92:0/725174798 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c00f070 con 0x7fcb641014d0 2023-10-16T13:13:16.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb5affd700 1 -- 172.21.15.92:0/725174798 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcb5c007b30 con 0x7fcb641014d0 2023-10-16T13:13:16.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb5affd700 1 -- 172.21.15.92:0/725174798 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0054a0 con 0x7fcb641014d0 2023-10-16T13:13:16.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.439+0000 7fcb6bfc8700 1 -- 172.21.15.92:0/725174798 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6419ef10 con 0x7fcb641014d0 2023-10-16T13:13:16.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.440+0000 7fcb6bfc8700 1 -- 172.21.15.92:0/725174798 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6419f340 con 0x7fcb641014d0 2023-10-16T13:13:16.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.440+0000 7fcb6bfc8700 1 -- 172.21.15.92:0/725174798 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb64106d20 con 0x7fcb641014d0 2023-10-16T13:13:16.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.442+0000 7fcb5affd700 1 -- 172.21.15.92:0/725174798 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fcb5c004ad0 con 0x7fcb641014d0 2023-10-16T13:13:16.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.443+0000 7fcb5affd700 1 --2- 172.21.15.92:0/725174798 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fcb500a1480 0x7fcb500a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:16.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.443+0000 7fcb69d64700 1 --2- 172.21.15.92:0/725174798 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fcb500a1480 0x7fcb500a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:16.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.443+0000 7fcb5affd700 1 -- 172.21.15.92:0/725174798 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fcb5c0cc950 con 0x7fcb641014d0 2023-10-16T13:13:16.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.443+0000 7fcb69d64700 1 --2- 172.21.15.92:0/725174798 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fcb500a1480 0x7fcb500a3940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcb54005950 tx=0x7fcb540058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:16.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.446+0000 7fcb5affd700 1 -- 172.21.15.92:0/725174798 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcb5c096040 con 0x7fcb641014d0 2023-10-16T13:13:16.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.636+0000 7fcb6bfc8700 1 -- 172.21.15.92:0/725174798 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcb6410b9b0 con 0x7fcb641014d0 2023-10-16T13:13:16.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.636+0000 7fcb5affd700 1 -- 172.21.15.92:0/725174798 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcb5c0b90a0 con 0x7fcb641014d0 2023-10-16T13:13:16.639 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-10-16T13:13:16.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.638+0000 7fcb6bfc8700 1 -- 172.21.15.92:0/725174798 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fcb500a1480 msgr2=0x7fcb500a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:16.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.638+0000 7fcb6bfc8700 1 --2- 172.21.15.92:0/725174798 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fcb500a1480 0x7fcb500a3940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcb54005950 tx=0x7fcb540058e0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.638+0000 7fcb6bfc8700 1 -- 172.21.15.92:0/725174798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb641014d0 msgr2=0x7fcb6419e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:16.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.638+0000 7fcb6bfc8700 1 --2- 172.21.15.92:0/725174798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb641014d0 0x7fcb6419e130 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00ada0 tx=0x7fcb5c00c330 comp rx=0 tx=0).stop 2023-10-16T13:13:16.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.639+0000 7fcb6bfc8700 1 -- 172.21.15.92:0/725174798 shutdown_connections 2023-10-16T13:13:16.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.639+0000 7fcb6bfc8700 1 --2- 172.21.15.92:0/725174798 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fcb500a1480 0x7fcb500a3940 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.639+0000 7fcb6bfc8700 1 --2- 172.21.15.92:0/725174798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb641014d0 0x7fcb6419e130 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.639+0000 7fcb6bfc8700 1 --2- 172.21.15.92:0/725174798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb640ffa00 0x7fcb64069b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.639+0000 7fcb6bfc8700 1 --2- 172.21.15.92:0/725174798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb641003a0 0x7fcb6419bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.639+0000 7fcb6bfc8700 1 -- 172.21.15.92:0/725174798 >> 172.21.15.92:0/725174798 conn(0x7fcb640fb320 msgr2=0x7fcb640fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:16.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.639+0000 7fcb6bfc8700 1 -- 172.21.15.92:0/725174798 shutdown_connections 2023-10-16T13:13:16.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.639+0000 7fcb6bfc8700 1 -- 172.21.15.92:0/725174798 wait complete. 2023-10-16T13:13:16.653 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:13:16.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.775+0000 7f088a6ff700 1 -- 172.21.15.92:0/1552370251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0884102a40 msgr2=0x7f0884109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:16.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.775+0000 7f088a6ff700 1 --2- 172.21.15.92:0/1552370251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0884102a40 0x7f0884109360 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f087c00b0a0 tx=0x7f087c00b3b0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.775+0000 7f088a6ff700 1 -- 172.21.15.92:0/1552370251 shutdown_connections 2023-10-16T13:13:16.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.775+0000 7f088a6ff700 1 --2- 172.21.15.92:0/1552370251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0884102a40 0x7f0884109360 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.775+0000 7f088a6ff700 1 --2- 172.21.15.92:0/1552370251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0884100ea0 0x7f08841012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.775+0000 7f088a6ff700 1 --2- 172.21.15.92:0/1552370251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0884102080 0x7f0884102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.775+0000 7f088a6ff700 1 -- 172.21.15.92:0/1552370251 >> 172.21.15.92:0/1552370251 conn(0x7f08840fc460 msgr2=0x7f08840fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:16.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.775+0000 7f088a6ff700 1 -- 172.21.15.92:0/1552370251 shutdown_connections 2023-10-16T13:13:16.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.775+0000 7f088a6ff700 1 -- 172.21.15.92:0/1552370251 wait complete. 2023-10-16T13:13:16.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.775+0000 7f088a6ff700 1 Processor -- start 2023-10-16T13:13:16.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.775+0000 7f088a6ff700 1 -- start start 2023-10-16T13:13:16.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.776+0000 7f088a6ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0884100ea0 0x7f0884074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:16.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.776+0000 7f088a6ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0884102080 0x7f08840732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:16.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.776+0000 7f088a6ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0884102a40 0x7f08840737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:16.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.776+0000 7f088a6ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0884073f80 con 0x7f0884102a40 2023-10-16T13:13:16.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.776+0000 7f088a6ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08840740f0 con 0x7f0884100ea0 2023-10-16T13:13:16.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.776+0000 7f088a6ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08841a0df0 con 0x7f0884102080 2023-10-16T13:13:16.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.776+0000 7f0888c9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0884102a40 0x7f08840737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:16.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.776+0000 7f0888c9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0884102a40 0x7f08840737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36916/0 (socket says 172.21.15.92:36916) 2023-10-16T13:13:16.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.776+0000 7f0888c9c700 1 -- 172.21.15.92:0/2971263428 learned_addr learned my addr 172.21.15.92:0/2971263428 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:16.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.776+0000 7f08837fe700 1 --2- 172.21.15.92:0/2971263428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0884102080 0x7f08840732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:16.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.776+0000 7f0883fff700 1 --2- 172.21.15.92:0/2971263428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0884100ea0 0x7f0884074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:16.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.776+0000 7f0888c9c700 1 -- 172.21.15.92:0/2971263428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0884102080 msgr2=0x7f08840732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:16.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.776+0000 7f0888c9c700 1 --2- 172.21.15.92:0/2971263428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0884102080 0x7f08840732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.776+0000 7f0888c9c700 1 -- 172.21.15.92:0/2971263428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0884100ea0 msgr2=0x7f0884074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:16.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.776+0000 7f0888c9c700 1 --2- 172.21.15.92:0/2971263428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0884100ea0 0x7f0884074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.776+0000 7f0888c9c700 1 -- 172.21.15.92:0/2971263428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c009d00 con 0x7f0884102a40 2023-10-16T13:13:16.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.776+0000 7f08837fe700 1 --2- 172.21.15.92:0/2971263428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0884102080 0x7f08840732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:16.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.776+0000 7f0888c9c700 1 --2- 172.21.15.92:0/2971263428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0884102a40 0x7f08840737e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f087c0062a0 tx=0x7f087c009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:16.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.777+0000 7f08817fa700 1 -- 172.21.15.92:0/2971263428 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c00e040 con 0x7f0884102a40 2023-10-16T13:13:16.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.777+0000 7f08817fa700 1 -- 172.21.15.92:0/2971263428 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f087c01db60 con 0x7f0884102a40 2023-10-16T13:13:16.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.777+0000 7f088a6ff700 1 -- 172.21.15.92:0/2971263428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08841a1070 con 0x7f0884102a40 2023-10-16T13:13:16.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.777+0000 7f08817fa700 1 -- 172.21.15.92:0/2971263428 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c01bcf0 con 0x7f0884102a40 2023-10-16T13:13:16.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.777+0000 7f088a6ff700 1 -- 172.21.15.92:0/2971263428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08841a14f0 con 0x7f0884102a40 2023-10-16T13:13:16.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.778+0000 7f088a6ff700 1 -- 172.21.15.92:0/2971263428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088410c880 con 0x7f0884102a40 2023-10-16T13:13:16.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.779+0000 7f08817fa700 1 -- 172.21.15.92:0/2971263428 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f087c01d680 con 0x7f0884102a40 2023-10-16T13:13:16.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.779+0000 7f08817fa700 1 --2- 172.21.15.92:0/2971263428 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f08700a1480 0x7f08700a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:16.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.780+0000 7f0883fff700 1 --2- 172.21.15.92:0/2971263428 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f08700a1480 0x7f08700a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:16.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.780+0000 7f08817fa700 1 -- 172.21.15.92:0/2971263428 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f087c0cec20 con 0x7f0884102a40 2023-10-16T13:13:16.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.780+0000 7f0883fff700 1 --2- 172.21.15.92:0/2971263428 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f08700a1480 0x7f08700a3940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f086c005950 tx=0x7f086c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:16.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.783+0000 7f08817fa700 1 -- 172.21.15.92:0/2971263428 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f087c0cee60 con 0x7f0884102a40 2023-10-16T13:13:16.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:16 smithi152 ceph-mon[104423]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:13:16.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:16 smithi152 ceph-mon[104423]: pgmap v305: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-16T13:13:16.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:16 smithi152 ceph-mon[104423]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:13:16.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:16 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1740216841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:16.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.975+0000 7f088a6ff700 1 -- 172.21.15.92:0/2971263428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0884107d10 con 0x7f0884102a40 2023-10-16T13:13:16.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.975+0000 7f08817fa700 1 -- 172.21.15.92:0/2971263428 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f087c0a0e60 con 0x7f0884102a40 2023-10-16T13:13:16.978 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-10-16T13:13:16.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.978+0000 7f088a6ff700 1 -- 172.21.15.92:0/2971263428 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f08700a1480 msgr2=0x7f08700a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:16.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.978+0000 7f088a6ff700 1 --2- 172.21.15.92:0/2971263428 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f08700a1480 0x7f08700a3940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f086c005950 tx=0x7f086c0058e0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.978+0000 7f088a6ff700 1 -- 172.21.15.92:0/2971263428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0884102a40 msgr2=0x7f08840737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:16.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.978+0000 7f088a6ff700 1 --2- 172.21.15.92:0/2971263428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0884102a40 0x7f08840737e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f087c0062a0 tx=0x7f087c009570 comp rx=0 tx=0).stop 2023-10-16T13:13:16.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.978+0000 7f088a6ff700 1 -- 172.21.15.92:0/2971263428 shutdown_connections 2023-10-16T13:13:16.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.978+0000 7f088a6ff700 1 --2- 172.21.15.92:0/2971263428 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f08700a1480 0x7f08700a3940 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.978+0000 7f088a6ff700 1 --2- 172.21.15.92:0/2971263428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0884102a40 0x7f08840737e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.978+0000 7f088a6ff700 1 --2- 172.21.15.92:0/2971263428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0884100ea0 0x7f0884074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.978+0000 7f088a6ff700 1 --2- 172.21.15.92:0/2971263428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0884102080 0x7f08840732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:16.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.978+0000 7f088a6ff700 1 -- 172.21.15.92:0/2971263428 >> 172.21.15.92:0/2971263428 conn(0x7f08840fc460 msgr2=0x7f08840fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:16.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.978+0000 7f088a6ff700 1 -- 172.21.15.92:0/2971263428 shutdown_connections 2023-10-16T13:13:16.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:16.978+0000 7f088a6ff700 1 -- 172.21.15.92:0/2971263428 wait complete. 2023-10-16T13:13:16.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:16 smithi092 ceph-mon[99542]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:13:16.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:16 smithi092 ceph-mon[99542]: pgmap v305: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-16T13:13:16.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:16 smithi092 ceph-mon[99542]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:13:16.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:16 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1740216841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:16.993 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:13:17.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:16 smithi118 ceph-mon[103969]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:13:17.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:16 smithi118 ceph-mon[103969]: pgmap v305: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-16T13:13:17.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:16 smithi118 ceph-mon[103969]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:13:17.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:16 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1740216841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:17.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.115+0000 7fa6fb361700 1 -- 172.21.15.92:0/2065390354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6f4101940 msgr2=0x7fa6f41081f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:17.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.115+0000 7fa6fb361700 1 --2- 172.21.15.92:0/2065390354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6f4101940 0x7fa6f41081f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00b0d0 tx=0x7fa6ec00b3e0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.115+0000 7fa6fb361700 1 -- 172.21.15.92:0/2065390354 shutdown_connections 2023-10-16T13:13:17.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.115+0000 7fa6fb361700 1 --2- 172.21.15.92:0/2065390354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6f4101940 0x7fa6f41081f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.115+0000 7fa6fb361700 1 --2- 172.21.15.92:0/2065390354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f40ffdb0 0x7fa6f41001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.115+0000 7fa6fb361700 1 --2- 172.21.15.92:0/2065390354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6f4100fa0 0x7fa6f4101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.115+0000 7fa6fb361700 1 -- 172.21.15.92:0/2065390354 >> 172.21.15.92:0/2065390354 conn(0x7fa6f40fb320 msgr2=0x7fa6f40fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:17.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.115+0000 7fa6fb361700 1 -- 172.21.15.92:0/2065390354 shutdown_connections 2023-10-16T13:13:17.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.115+0000 7fa6fb361700 1 -- 172.21.15.92:0/2065390354 wait complete. 2023-10-16T13:13:17.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.116+0000 7fa6fb361700 1 Processor -- start 2023-10-16T13:13:17.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.116+0000 7fa6fb361700 1 -- start start 2023-10-16T13:13:17.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.116+0000 7fa6fb361700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6f40ffdb0 0x7fa6f4068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:17.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.116+0000 7fa6fb361700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6f4100fa0 0x7fa6f419ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:17.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.116+0000 7fa6fb361700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f4101940 0x7fa6f419e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:17.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.116+0000 7fa6fb361700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f419e820 con 0x7fa6f40ffdb0 2023-10-16T13:13:17.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.116+0000 7fa6fb361700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f419e990 con 0x7fa6f4100fa0 2023-10-16T13:13:17.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.116+0000 7fa6fb361700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f419eb50 con 0x7fa6f4101940 2023-10-16T13:13:17.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.116+0000 7fa6f90fd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6f40ffdb0 0x7fa6f4068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:17.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.116+0000 7fa6f90fd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6f40ffdb0 0x7fa6f4068bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36928/0 (socket says 172.21.15.92:36928) 2023-10-16T13:13:17.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.116+0000 7fa6f90fd700 1 -- 172.21.15.92:0/1247742096 learned_addr learned my addr 172.21.15.92:0/1247742096 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:17.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.116+0000 7fa6f88fc700 1 --2- 172.21.15.92:0/1247742096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6f4100fa0 0x7fa6f419ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:17.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.116+0000 7fa6f98fe700 1 --2- 172.21.15.92:0/1247742096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f4101940 0x7fa6f419e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:17.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.116+0000 7fa6f90fd700 1 -- 172.21.15.92:0/1247742096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f4101940 msgr2=0x7fa6f419e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:17.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.117+0000 7fa6f90fd700 1 --2- 172.21.15.92:0/1247742096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f4101940 0x7fa6f419e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.117+0000 7fa6f90fd700 1 -- 172.21.15.92:0/1247742096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6f4100fa0 msgr2=0x7fa6f419ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:17.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.117+0000 7fa6f90fd700 1 --2- 172.21.15.92:0/1247742096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6f4100fa0 0x7fa6f419ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.117+0000 7fa6f90fd700 1 -- 172.21.15.92:0/1247742096 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ec009d00 con 0x7fa6f40ffdb0 2023-10-16T13:13:17.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.117+0000 7fa6f88fc700 1 --2- 172.21.15.92:0/1247742096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6f4100fa0 0x7fa6f419ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:17.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.117+0000 7fa6f90fd700 1 --2- 172.21.15.92:0/1247742096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6f40ffdb0 0x7fa6f4068bd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400d980 tx=0x7fa6e400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:17.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.117+0000 7fa6ea7fc700 1 -- 172.21.15.92:0/1247742096 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e400de60 con 0x7fa6f40ffdb0 2023-10-16T13:13:17.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.117+0000 7fa6fb361700 1 -- 172.21.15.92:0/1247742096 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f419ee30 con 0x7fa6f40ffdb0 2023-10-16T13:13:17.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.117+0000 7fa6ea7fc700 1 -- 172.21.15.92:0/1247742096 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa6e4004500 con 0x7fa6f40ffdb0 2023-10-16T13:13:17.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.117+0000 7fa6ea7fc700 1 -- 172.21.15.92:0/1247742096 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4003ce0 con 0x7fa6f40ffdb0 2023-10-16T13:13:17.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.117+0000 7fa6fb361700 1 -- 172.21.15.92:0/1247742096 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f419f2b0 con 0x7fa6f40ffdb0 2023-10-16T13:13:17.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.118+0000 7fa6fb361700 1 -- 172.21.15.92:0/1247742096 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f410b710 con 0x7fa6f40ffdb0 2023-10-16T13:13:17.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.119+0000 7fa6ea7fc700 1 -- 172.21.15.92:0/1247742096 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa6e4009cb0 con 0x7fa6f40ffdb0 2023-10-16T13:13:17.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.119+0000 7fa6ea7fc700 1 --2- 172.21.15.92:0/1247742096 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa6e00a1480 0x7fa6e00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:17.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.119+0000 7fa6f88fc700 1 --2- 172.21.15.92:0/1247742096 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa6e00a1480 0x7fa6e00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:17.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.119+0000 7fa6ea7fc700 1 -- 172.21.15.92:0/1247742096 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa6e40ccdb0 con 0x7fa6f40ffdb0 2023-10-16T13:13:17.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.120+0000 7fa6f88fc700 1 --2- 172.21.15.92:0/1247742096 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa6e00a1480 0x7fa6e00a3940 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0005fd0 tx=0x7fa6f0005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:17.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.123+0000 7fa6ea7fc700 1 -- 172.21.15.92:0/1247742096 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa6e4096410 con 0x7fa6f40ffdb0 2023-10-16T13:13:17.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.316+0000 7fa6fb361700 1 -- 172.21.15.92:0/1247742096 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6f4106b90 con 0x7fa6f40ffdb0 2023-10-16T13:13:17.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.316+0000 7fa6ea7fc700 1 -- 172.21.15.92:0/1247742096 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa6e4099a30 con 0x7fa6f40ffdb0 2023-10-16T13:13:17.319 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-10-16T13:13:17.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.318+0000 7fa6fb361700 1 -- 172.21.15.92:0/1247742096 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa6e00a1480 msgr2=0x7fa6e00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.318+0000 7fa6fb361700 1 --2- 172.21.15.92:0/1247742096 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa6e00a1480 0x7fa6e00a3940 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0005fd0 tx=0x7fa6f0005e30 comp rx=0 tx=0).stop 2023-10-16T13:13:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.318+0000 7fa6fb361700 1 -- 172.21.15.92:0/1247742096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6f40ffdb0 msgr2=0x7fa6f4068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.318+0000 7fa6fb361700 1 --2- 172.21.15.92:0/1247742096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6f40ffdb0 0x7fa6f4068bd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400d980 tx=0x7fa6e400dd40 comp rx=0 tx=0).stop 2023-10-16T13:13:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.318+0000 7fa6fb361700 1 -- 172.21.15.92:0/1247742096 shutdown_connections 2023-10-16T13:13:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.318+0000 7fa6fb361700 1 --2- 172.21.15.92:0/1247742096 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa6e00a1480 0x7fa6e00a3940 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.319+0000 7fa6fb361700 1 --2- 172.21.15.92:0/1247742096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6f40ffdb0 0x7fa6f4068bd0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.319+0000 7fa6fb361700 1 --2- 172.21.15.92:0/1247742096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f4101940 0x7fa6f419e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.319+0000 7fa6fb361700 1 --2- 172.21.15.92:0/1247742096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6f4100fa0 0x7fa6f419ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.319+0000 7fa6fb361700 1 -- 172.21.15.92:0/1247742096 >> 172.21.15.92:0/1247742096 conn(0x7fa6f40fb320 msgr2=0x7fa6f40fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.319+0000 7fa6fb361700 1 -- 172.21.15.92:0/1247742096 shutdown_connections 2023-10-16T13:13:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.319+0000 7fa6fb361700 1 -- 172.21.15.92:0/1247742096 wait complete. 2023-10-16T13:13:17.333 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:13:17.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.452+0000 7f9ee538b700 1 -- 172.21.15.92:0/6675524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ee0101930 msgr2=0x7f9ee0108250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:17.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.452+0000 7f9ee538b700 1 --2- 172.21.15.92:0/6675524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ee0101930 0x7f9ee0108250 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800b0a0 tx=0x7f9ed800b3b0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.452+0000 7f9ee538b700 1 -- 172.21.15.92:0/6675524 shutdown_connections 2023-10-16T13:13:17.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.452+0000 7f9ee538b700 1 --2- 172.21.15.92:0/6675524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ee0101930 0x7f9ee0108250 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.452+0000 7f9ee538b700 1 --2- 172.21.15.92:0/6675524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ee00ffe20 0x7f9ee0100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.452+0000 7f9ee538b700 1 --2- 172.21.15.92:0/6675524 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ee0100f70 0x7f9ee01013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.452+0000 7f9ee538b700 1 -- 172.21.15.92:0/6675524 >> 172.21.15.92:0/6675524 conn(0x7f9ee00fb370 msgr2=0x7f9ee00fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:17.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.452+0000 7f9ee538b700 1 -- 172.21.15.92:0/6675524 shutdown_connections 2023-10-16T13:13:17.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.452+0000 7f9ee538b700 1 -- 172.21.15.92:0/6675524 wait complete. 2023-10-16T13:13:17.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.453+0000 7f9ee538b700 1 Processor -- start 2023-10-16T13:13:17.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.453+0000 7f9ee538b700 1 -- start start 2023-10-16T13:13:17.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.453+0000 7f9ee538b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ee00ffe20 0x7f9ee0195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:17.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.453+0000 7f9ee538b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ee0100f70 0x7f9ee01960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:17.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.453+0000 7f9ee538b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ee0101930 0x7f9ee019d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:17.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.453+0000 7f9ee538b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee019d710 con 0x7f9ee0100f70 2023-10-16T13:13:17.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.453+0000 7f9ee538b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee019d850 con 0x7f9ee00ffe20 2023-10-16T13:13:17.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.453+0000 7f9ee538b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee019d9e0 con 0x7f9ee0101930 2023-10-16T13:13:17.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.453+0000 7f9ede7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ee0100f70 0x7f9ee01960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:17.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.453+0000 7f9ede7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ee0100f70 0x7f9ee01960d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36944/0 (socket says 172.21.15.92:36944) 2023-10-16T13:13:17.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.453+0000 7f9ede7fc700 1 -- 172.21.15.92:0/4046645535 learned_addr learned my addr 172.21.15.92:0/4046645535 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:17.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.453+0000 7f9edeffd700 1 --2- 172.21.15.92:0/4046645535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ee00ffe20 0x7f9ee0195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:17.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.453+0000 7f9edf7fe700 1 --2- 172.21.15.92:0/4046645535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ee0101930 0x7f9ee019d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:17.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.453+0000 7f9ede7fc700 1 -- 172.21.15.92:0/4046645535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ee0101930 msgr2=0x7f9ee019d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:17.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.453+0000 7f9ede7fc700 1 --2- 172.21.15.92:0/4046645535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ee0101930 0x7f9ee019d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.453+0000 7f9ede7fc700 1 -- 172.21.15.92:0/4046645535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ee00ffe20 msgr2=0x7f9ee0195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:17.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.453+0000 7f9ede7fc700 1 --2- 172.21.15.92:0/4046645535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ee00ffe20 0x7f9ee0195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.454+0000 7f9ede7fc700 1 -- 172.21.15.92:0/4046645535 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed8009d00 con 0x7f9ee0100f70 2023-10-16T13:13:17.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.454+0000 7f9ede7fc700 1 --2- 172.21.15.92:0/4046645535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ee0100f70 0x7f9ee01960d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000d950 tx=0x7f9ed000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:17.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.454+0000 7f9ec7fff700 1 -- 172.21.15.92:0/4046645535 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed000f890 con 0x7f9ee0100f70 2023-10-16T13:13:17.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.454+0000 7f9ee538b700 1 -- 172.21.15.92:0/4046645535 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee019dcc0 con 0x7f9ee0100f70 2023-10-16T13:13:17.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.454+0000 7f9ec7fff700 1 -- 172.21.15.92:0/4046645535 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9ed0010460 con 0x7f9ee0100f70 2023-10-16T13:13:17.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.454+0000 7f9ec7fff700 1 -- 172.21.15.92:0/4046645535 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed000e610 con 0x7f9ee0100f70 2023-10-16T13:13:17.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.454+0000 7f9ee538b700 1 -- 172.21.15.92:0/4046645535 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee019e1d0 con 0x7f9ee0100f70 2023-10-16T13:13:17.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.455+0000 7f9ee538b700 1 -- 172.21.15.92:0/4046645535 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee0106b10 con 0x7f9ee0100f70 2023-10-16T13:13:17.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.456+0000 7f9ec7fff700 1 -- 172.21.15.92:0/4046645535 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f9ed0010960 con 0x7f9ee0100f70 2023-10-16T13:13:17.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.456+0000 7f9ec7fff700 1 --2- 172.21.15.92:0/4046645535 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f9ec80a15a0 0x7f9ec80a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:17.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.457+0000 7f9edeffd700 1 --2- 172.21.15.92:0/4046645535 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f9ec80a15a0 0x7f9ec80a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:17.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.457+0000 7f9ec7fff700 1 -- 172.21.15.92:0/4046645535 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f9ed00cca90 con 0x7f9ee0100f70 2023-10-16T13:13:17.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.457+0000 7f9edeffd700 1 --2- 172.21.15.92:0/4046645535 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f9ec80a15a0 0x7f9ec80a3a60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4009c60 tx=0x7f9ed4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:17.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.460+0000 7f9ec7fff700 1 -- 172.21.15.92:0/4046645535 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9ed00960b0 con 0x7f9ee0100f70 2023-10-16T13:13:17.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.696+0000 7f9ee538b700 1 -- 172.21.15.92:0/4046645535 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ee010b770 con 0x7f9ee0100f70 2023-10-16T13:13:17.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.696+0000 7f9ec7fff700 1 -- 172.21.15.92:0/4046645535 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11379 (secure 0 0 0) 0x7f9ed0016090 con 0x7f9ee0100f70 2023-10-16T13:13:17.699 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:13:17.699 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-16T13:11:40.343309+0000","modified":"2023-10-16T13:11:48.346678+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24460,"mds_3":24428,"mds_4":24412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1790514945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1790514945},{"type":"v1","addr":"172.21.15.92:6839","nonce":1790514945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/1016260236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1016260236},{"type":"v1","addr":"172.21.15.92:6841","nonce":1016260236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24410":{"gid":24410,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/2133613540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":2133613540},{"type":"v1","addr":"172.21.15.118:6837","nonce":2133613540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6837/2403096460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":2403096460},{"type":"v1","addr":"172.21.15.152:6837","nonce":2403096460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1821921588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1821921588},{"type":"v1","addr":"172.21.15.152:6839","nonce":1821921588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6839/1577355936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":1577355936},{"type":"v1","addr":"172.21.15.118:6839","nonce":1577355936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:13:17.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.699+0000 7f9ee538b700 1 -- 172.21.15.92:0/4046645535 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f9ec80a15a0 msgr2=0x7f9ec80a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:17.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.699+0000 7f9ee538b700 1 --2- 172.21.15.92:0/4046645535 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f9ec80a15a0 0x7f9ec80a3a60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4009c60 tx=0x7f9ed4009260 comp rx=0 tx=0).stop 2023-10-16T13:13:17.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.699+0000 7f9ee538b700 1 -- 172.21.15.92:0/4046645535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ee0100f70 msgr2=0x7f9ee01960d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:17.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.699+0000 7f9ee538b700 1 --2- 172.21.15.92:0/4046645535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ee0100f70 0x7f9ee01960d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000d950 tx=0x7f9ed000dc60 comp rx=0 tx=0).stop 2023-10-16T13:13:17.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.699+0000 7f9ee538b700 1 -- 172.21.15.92:0/4046645535 shutdown_connections 2023-10-16T13:13:17.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.699+0000 7f9ee538b700 1 --2- 172.21.15.92:0/4046645535 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f9ec80a15a0 0x7f9ec80a3a60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.699+0000 7f9ee538b700 1 --2- 172.21.15.92:0/4046645535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ee0101930 0x7f9ee019d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.699+0000 7f9ee538b700 1 --2- 172.21.15.92:0/4046645535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ee00ffe20 0x7f9ee0195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.699+0000 7f9ee538b700 1 --2- 172.21.15.92:0/4046645535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ee0100f70 0x7f9ee01960d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.699+0000 7f9ee538b700 1 -- 172.21.15.92:0/4046645535 >> 172.21.15.92:0/4046645535 conn(0x7f9ee00fb370 msgr2=0x7f9ee00fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:17.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.699+0000 7f9ee538b700 1 -- 172.21.15.92:0/4046645535 shutdown_connections 2023-10-16T13:13:17.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.699+0000 7f9ee538b700 1 -- 172.21.15.92:0/4046645535 wait complete. 2023-10-16T13:13:17.703 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 27 2023-10-16T13:13:17.713 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:13:17.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.832+0000 7f269c544700 1 -- 172.21.15.92:0/197934484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26941042f0 msgr2=0x7f26941066e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:17.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.832+0000 7f269c544700 1 --2- 172.21.15.92:0/197934484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26941042f0 0x7f26941066e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2690009990 tx=0x7f2690009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.832+0000 7f269c544700 1 -- 172.21.15.92:0/197934484 shutdown_connections 2023-10-16T13:13:17.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.832+0000 7f269c544700 1 --2- 172.21.15.92:0/197934484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2694106c20 0x7f2694109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.832+0000 7f269c544700 1 --2- 172.21.15.92:0/197934484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26941019c0 0x7f2694103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.832+0000 7f269c544700 1 --2- 172.21.15.92:0/197934484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26941042f0 0x7f26941066e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.832+0000 7f269c544700 1 -- 172.21.15.92:0/197934484 >> 172.21.15.92:0/197934484 conn(0x7f26940fb310 msgr2=0x7f26940fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:17.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.832+0000 7f269c544700 1 -- 172.21.15.92:0/197934484 shutdown_connections 2023-10-16T13:13:17.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.832+0000 7f269c544700 1 -- 172.21.15.92:0/197934484 wait complete. 2023-10-16T13:13:17.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.832+0000 7f269c544700 1 Processor -- start 2023-10-16T13:13:17.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.832+0000 7f269c544700 1 -- start start 2023-10-16T13:13:17.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f269c544700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26941019c0 0x7f2694196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:17.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f269c544700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26941042f0 0x7f26941970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:17.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f269c544700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2694106c20 0x7f269419e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:17.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f269c544700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269419e6f0 con 0x7f26941019c0 2023-10-16T13:13:17.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f269c544700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269419e830 con 0x7f2694106c20 2023-10-16T13:13:17.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f269c544700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269419e9c0 con 0x7f26941042f0 2023-10-16T13:13:17.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f269a2e0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26941019c0 0x7f2694196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:17.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f269a2e0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26941019c0 0x7f2694196b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36956/0 (socket says 172.21.15.92:36956) 2023-10-16T13:13:17.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f269a2e0700 1 -- 172.21.15.92:0/621721605 learned_addr learned my addr 172.21.15.92:0/621721605 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:17.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f269aae1700 1 --2- 172.21.15.92:0/621721605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2694106c20 0x7f269419e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:17.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f269a2e0700 1 -- 172.21.15.92:0/621721605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26941042f0 msgr2=0x7f26941970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:17.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f2699adf700 1 --2- 172.21.15.92:0/621721605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26941042f0 0x7f26941970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:17.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f269a2e0700 1 --2- 172.21.15.92:0/621721605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26941042f0 0x7f26941970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f269a2e0700 1 -- 172.21.15.92:0/621721605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2694106c20 msgr2=0x7f269419e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:17.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f269a2e0700 1 --2- 172.21.15.92:0/621721605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2694106c20 0x7f269419e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:17.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f269a2e0700 1 -- 172.21.15.92:0/621721605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26900095f0 con 0x7f26941019c0 2023-10-16T13:13:17.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f269a2e0700 1 --2- 172.21.15.92:0/621721605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26941019c0 0x7f2694196b70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f268400c920 tx=0x7f268400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:17.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f268b7fe700 1 -- 172.21.15.92:0/621721605 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2684007b00 con 0x7f26941019c0 2023-10-16T13:13:17.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f269c544700 1 -- 172.21.15.92:0/621721605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269419eca0 con 0x7f26941019c0 2023-10-16T13:13:17.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f268b7fe700 1 -- 172.21.15.92:0/621721605 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f268400ce70 con 0x7f26941019c0 2023-10-16T13:13:17.842 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f268b7fe700 1 -- 172.21.15.92:0/621721605 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2684005520 con 0x7f26941019c0 2023-10-16T13:13:17.842 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.833+0000 7f269c544700 1 -- 172.21.15.92:0/621721605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269419f1b0 con 0x7f26941019c0 2023-10-16T13:13:17.843 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.834+0000 7f269c544700 1 -- 172.21.15.92:0/621721605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26940fce90 con 0x7f26941019c0 2023-10-16T13:13:17.843 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.835+0000 7f268b7fe700 1 -- 172.21.15.92:0/621721605 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2684004750 con 0x7f26941019c0 2023-10-16T13:13:17.843 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.836+0000 7f268b7fe700 1 --2- 172.21.15.92:0/621721605 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f26800a1520 0x7f26800a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:17.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.836+0000 7f2699adf700 1 --2- 172.21.15.92:0/621721605 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f26800a1520 0x7f26800a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:17.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.836+0000 7f268b7fe700 1 -- 172.21.15.92:0/621721605 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f26840ccd40 con 0x7f26941019c0 2023-10-16T13:13:17.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.836+0000 7f2699adf700 1 --2- 172.21.15.92:0/621721605 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f26800a1520 0x7f26800a39e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2690005b40 tx=0x7f2690005ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:17.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:17.839+0000 7f268b7fe700 1 -- 172.21.15.92:0/621721605 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f26840963a0 con 0x7f26941019c0 2023-10-16T13:13:17.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:17 smithi152 ceph-mon[104423]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:13:17.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:17 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/725174798' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:13:17.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:17 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2971263428' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:13:17.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:17 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1247742096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:13:17.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:17 smithi092 ceph-mon[99542]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:13:17.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:17 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/725174798' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:13:17.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:17 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2971263428' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:13:17.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:17 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1247742096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:13:18.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.031+0000 7f269c544700 1 -- 172.21.15.92:0/621721605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f269410cab0 con 0x7f26941019c0 2023-10-16T13:13:18.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:17 smithi118 ceph-mon[103969]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-16T13:13:18.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:17 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/725174798' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:13:18.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:17 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2971263428' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:13:18.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:17 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1247742096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:13:18.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.033+0000 7f268b7fe700 1 -- 172.21.15.92:0/621721605 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22598 (secure 0 0 0) 0x7f268401d020 con 0x7f26941019c0 2023-10-16T13:13:18.035 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:13:18.036 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":85,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:12:36.335213+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:11:38.345035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:11:39.549912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:13:18.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.035+0000 7f269c544700 1 -- 172.21.15.92:0/621721605 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f26800a1520 msgr2=0x7f26800a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.035+0000 7f269c544700 1 --2- 172.21.15.92:0/621721605 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f26800a1520 0x7f26800a39e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2690005b40 tx=0x7f2690005ad0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.035+0000 7f269c544700 1 -- 172.21.15.92:0/621721605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26941019c0 msgr2=0x7f2694196b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.035+0000 7f269c544700 1 --2- 172.21.15.92:0/621721605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26941019c0 0x7f2694196b70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f268400c920 tx=0x7f268400cc30 comp rx=0 tx=0).stop 2023-10-16T13:13:18.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.035+0000 7f269c544700 1 -- 172.21.15.92:0/621721605 shutdown_connections 2023-10-16T13:13:18.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.035+0000 7f269c544700 1 --2- 172.21.15.92:0/621721605 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f26800a1520 0x7f26800a39e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.035+0000 7f269c544700 1 --2- 172.21.15.92:0/621721605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26941019c0 0x7f2694196b70 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.035+0000 7f269c544700 1 --2- 172.21.15.92:0/621721605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2694106c20 0x7f269419e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.035+0000 7f269c544700 1 --2- 172.21.15.92:0/621721605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26941042f0 0x7f26941970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.035+0000 7f269c544700 1 -- 172.21.15.92:0/621721605 >> 172.21.15.92:0/621721605 conn(0x7f26940fb310 msgr2=0x7f26941026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:18.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.035+0000 7f269c544700 1 -- 172.21.15.92:0/621721605 shutdown_connections 2023-10-16T13:13:18.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.035+0000 7f269c544700 1 -- 172.21.15.92:0/621721605 wait complete. 2023-10-16T13:13:18.049 DEBUG:tasks.fwd_scrub:Yielding 2023-10-16T13:13:18.049 INFO:teuthology.run_tasks:Running task background_exec... 2023-10-16T13:13:18.061 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2023-10-16T13:13:18.061 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2023-10-16T13:13:18.062 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-10-16T13:13:18.062 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-16T13:13:18.062 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-16T13:13:18.064 INFO:teuthology.run_tasks:Running task workunit... 2023-10-16T13:13:18.076 INFO:tasks.workunit:Pulling workunits from ref 33be745ec4531df08cd1bb70b4c9c1f89be58078 2023-10-16T13:13:18.077 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-16T13:13:18.077 INFO:tasks.workunit:timeout=3h 2023-10-16T13:13:18.077 INFO:tasks.workunit:cleanup=True 2023-10-16T13:13:18.078 DEBUG:teuthology.orchestra.run.smithi092:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-16T13:13:18.095 INFO:teuthology.orchestra.run.smithi092.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-10-16T13:13:18.096 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-10-16T13:13:18.096 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 7ch/124d Inode: 1099511628283 Links: 2 2023-10-16T13:13:18.096 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:13:18.096 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:cephfs_t:s0 2023-10-16T13:13:18.097 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-16 13:11:47.510828174 +0000 2023-10-16T13:13:18.097 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-16 13:11:47.510828174 +0000 2023-10-16T13:13:18.097 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-16 13:13:11.327511948 +0000 2023-10-16T13:13:18.097 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2023-10-16 13:11:47.510828174 +0000 2023-10-16T13:13:18.097 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-10-16T13:13:18.098 DEBUG:teuthology.orchestra.run.smithi092:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-10-16T13:13:18.219 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/rishabh-d-dave/ceph /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 33be745ec4531df08cd1bb70b4c9c1f89be58078 2023-10-16T13:13:18.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.230+0000 7f508e3e3700 1 -- 172.21.15.92:0/1811321111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5088101940 msgr2=0x7f50881081f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.230+0000 7f508e3e3700 1 --2- 172.21.15.92:0/1811321111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5088101940 0x7f50881081f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f508000b0d0 tx=0x7f508000b3e0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.230+0000 7f508e3e3700 1 -- 172.21.15.92:0/1811321111 shutdown_connections 2023-10-16T13:13:18.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.230+0000 7f508e3e3700 1 --2- 172.21.15.92:0/1811321111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5088101940 0x7f50881081f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.230+0000 7f508e3e3700 1 --2- 172.21.15.92:0/1811321111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50880ffdb0 0x7f50881001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.230+0000 7f508e3e3700 1 --2- 172.21.15.92:0/1811321111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5088100fa0 0x7f5088101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.230+0000 7f508e3e3700 1 -- 172.21.15.92:0/1811321111 >> 172.21.15.92:0/1811321111 conn(0x7f50880fb320 msgr2=0x7f50880fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:18.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.230+0000 7f508e3e3700 1 -- 172.21.15.92:0/1811321111 shutdown_connections 2023-10-16T13:13:18.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.230+0000 7f508e3e3700 1 -- 172.21.15.92:0/1811321111 wait complete. 2023-10-16T13:13:18.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.230+0000 7f508e3e3700 1 Processor -- start 2023-10-16T13:13:18.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.230+0000 7f508e3e3700 1 -- start start 2023-10-16T13:13:18.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.231+0000 7f508e3e3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50880ffdb0 0x7f5088195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.231+0000 7f508e3e3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5088100fa0 0x7f50881961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.231+0000 7f508e3e3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5088101940 0x7f508819d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.231+0000 7f508e3e3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508819d820 con 0x7f5088101940 2023-10-16T13:13:18.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.231+0000 7f508e3e3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508819d990 con 0x7f5088100fa0 2023-10-16T13:13:18.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.231+0000 7f508e3e3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508819db50 con 0x7f50880ffdb0 2023-10-16T13:13:18.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.231+0000 7f508c980700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5088101940 0x7f508819d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.231+0000 7f508c980700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5088101940 0x7f508819d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36978/0 (socket says 172.21.15.92:36978) 2023-10-16T13:13:18.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.231+0000 7f508c980700 1 -- 172.21.15.92:0/2500980724 learned_addr learned my addr 172.21.15.92:0/2500980724 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:18.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.231+0000 7f50877fe700 1 --2- 172.21.15.92:0/2500980724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5088100fa0 0x7f50881961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.231+0000 7f5087fff700 1 --2- 172.21.15.92:0/2500980724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50880ffdb0 0x7f5088195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.231+0000 7f508c980700 1 -- 172.21.15.92:0/2500980724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50880ffdb0 msgr2=0x7f5088195cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.231+0000 7f508c980700 1 --2- 172.21.15.92:0/2500980724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50880ffdb0 0x7f5088195cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.231+0000 7f508c980700 1 -- 172.21.15.92:0/2500980724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5088100fa0 msgr2=0x7f50881961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.231+0000 7f508c980700 1 --2- 172.21.15.92:0/2500980724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5088100fa0 0x7f50881961f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.231+0000 7f508c980700 1 -- 172.21.15.92:0/2500980724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5080009d00 con 0x7f5088101940 2023-10-16T13:13:18.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.231+0000 7f508c980700 1 --2- 172.21.15.92:0/2500980724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5088101940 0x7f508819d250 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5080009300 tx=0x7f5080009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:18.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.232+0000 7f50857fa700 1 -- 172.21.15.92:0/2500980724 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508000e040 con 0x7f5088101940 2023-10-16T13:13:18.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.232+0000 7f508e3e3700 1 -- 172.21.15.92:0/2500980724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508819ddd0 con 0x7f5088101940 2023-10-16T13:13:18.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.232+0000 7f50857fa700 1 -- 172.21.15.92:0/2500980724 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5080003e10 con 0x7f5088101940 2023-10-16T13:13:18.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.232+0000 7f50857fa700 1 -- 172.21.15.92:0/2500980724 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080005440 con 0x7f5088101940 2023-10-16T13:13:18.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.232+0000 7f508e3e3700 1 -- 172.21.15.92:0/2500980724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508819e1f0 con 0x7f5088101940 2023-10-16T13:13:18.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.234+0000 7f50857fa700 1 -- 172.21.15.92:0/2500980724 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f508001ba30 con 0x7f5088101940 2023-10-16T13:13:18.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.234+0000 7f50857fa700 1 --2- 172.21.15.92:0/2500980724 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f50700a1480 0x7f50700a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.242 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.235+0000 7f50857fa700 1 -- 172.21.15.92:0/2500980724 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f50800ce310 con 0x7f5088101940 2023-10-16T13:13:18.242 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.235+0000 7f5087fff700 1 --2- 172.21.15.92:0/2500980724 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f50700a1480 0x7f50700a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.243 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.235+0000 7f5087fff700 1 --2- 172.21.15.92:0/2500980724 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f50700a1480 0x7f50700a3940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5078005950 tx=0x7f50780058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:18.243 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.235+0000 7f509a5cdb80 1 Processor -- start 2023-10-16T13:13:18.243 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.235+0000 7f509a5cdb80 1 -- start start 2023-10-16T13:13:18.243 INFO:tasks.workunit.client.0.smithi092.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-16T13:13:18.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.235+0000 7f509a5cdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac50530 0x55ec3ac4eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.235+0000 7f509a5cdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac4f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.235+0000 7f509a5cdb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ac590a0 0x55ec3ac5b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.235+0000 7f509a5cdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec3abc3cf0 con 0x55ec3ac50530 2023-10-16T13:13:18.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.235+0000 7f509a5cdb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec3aba8ce0 con 0x55ec3ac590a0 2023-10-16T13:13:18.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.235+0000 7f509a5cdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec3aba6600 con 0x55ec3ac4f0d0 2023-10-16T13:13:18.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.236+0000 7f5087fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac50530 0x55ec3ac4eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.236+0000 7f5087fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac50530 0x55ec3ac4eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36982/0 (socket says 172.21.15.92:36982) 2023-10-16T13:13:18.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.236+0000 7f5087fff700 1 -- 172.21.15.92:0/215284657 learned_addr learned my addr 172.21.15.92:0/215284657 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:18.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.236+0000 7f508c980700 1 --2- 172.21.15.92:0/215284657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ac590a0 0x55ec3ac5b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.236+0000 7f50877fe700 1 --2- 172.21.15.92:0/215284657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac4f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.236+0000 7f5087fff700 1 -- 172.21.15.92:0/215284657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac4f0d0 msgr2=0x55ec3ac4f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:18.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.236+0000 7f5087fff700 1 --2- 172.21.15.92:0/215284657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac4f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.236+0000 7f5087fff700 1 -- 172.21.15.92:0/215284657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ac590a0 msgr2=0x55ec3ac5b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:18.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.236+0000 7f5087fff700 1 --2- 172.21.15.92:0/215284657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ac590a0 0x55ec3ac5b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.236+0000 7f5087fff700 1 -- 172.21.15.92:0/215284657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec3ab5f470 con 0x55ec3ac50530 2023-10-16T13:13:18.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.236+0000 7f5087fff700 1 --2- 172.21.15.92:0/215284657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac50530 0x55ec3ac4eb90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f507800fd10 tx=0x7f5078012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7eed22260afa65 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:18.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.236+0000 7f506e7fc700 1 -- 172.21.15.92:0/215284657 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5078011ad0 con 0x55ec3ac50530 2023-10-16T13:13:18.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.236+0000 7f506e7fc700 1 -- 172.21.15.92:0/215284657 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5078011c30 con 0x55ec3ac50530 2023-10-16T13:13:18.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.236+0000 7f506e7fc700 1 -- 172.21.15.92:0/215284657 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507801d610 con 0x55ec3ac50530 2023-10-16T13:13:18.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.237+0000 7f509a5cdb80 1 -- 172.21.15.92:0/215284657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac50530 msgr2=0x55ec3ac4eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.237+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/215284657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac50530 0x55ec3ac4eb90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f507800fd10 tx=0x7f5078012000 comp rx=0 tx=0).stop 2023-10-16T13:13:18.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.237+0000 7f509a5cdb80 1 -- 172.21.15.92:0/215284657 shutdown_connections 2023-10-16T13:13:18.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.237+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/215284657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac50530 0x55ec3ac4eb90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.237+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/215284657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ac590a0 0x55ec3ac5b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.237+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/215284657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac4f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.237+0000 7f509a5cdb80 1 -- 172.21.15.92:0/215284657 >> 172.21.15.92:0/215284657 conn(0x55ec3ab7ce50 msgr2=0x55ec3ac4a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:18.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.237+0000 7f509a5cdb80 1 -- 172.21.15.92:0/215284657 shutdown_connections 2023-10-16T13:13:18.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.237+0000 7f509a5cdb80 1 -- 172.21.15.92:0/215284657 wait complete. 2023-10-16T13:13:18.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.237+0000 7f509a5cdb80 1 -- start start 2023-10-16T13:13:18.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f509a5cdb80 1 Processor -- start 2023-10-16T13:13:18.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f509a5cdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac5d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f509a5cdb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ac50530 0x55ec3ac5d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f509a5cdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac590a0 0x55ec3ac646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f509a5cdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec3aba1ef0 con 0x55ec3ac4f0d0 2023-10-16T13:13:18.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f509a5cdb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec3ab3e790 con 0x55ec3ac50530 2023-10-16T13:13:18.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f509a5cdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec3ab3e430 con 0x55ec3ac590a0 2023-10-16T13:13:18.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f509a5cdb80 10 client.0 _ll_register_callbacks cb 0x55ec3a99b880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:18.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f5087fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac5d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f5087fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac5d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36988/0 (socket says 172.21.15.92:36988) 2023-10-16T13:13:18.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f5087fff700 1 -- 172.21.15.92:0/3899152380 learned_addr learned my addr 172.21.15.92:0/3899152380 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:18.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f508c980700 1 --2- 172.21.15.92:0/3899152380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac590a0 0x55ec3ac646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f50877fe700 1 --2- 172.21.15.92:0/3899152380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ac50530 0x55ec3ac5d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f5087fff700 1 -- 172.21.15.92:0/3899152380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac590a0 msgr2=0x55ec3ac646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:18.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f5087fff700 1 --2- 172.21.15.92:0/3899152380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac590a0 0x55ec3ac646e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f5087fff700 1 -- 172.21.15.92:0/3899152380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ac50530 msgr2=0x55ec3ac5d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:18.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f5087fff700 1 --2- 172.21.15.92:0/3899152380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ac50530 0x55ec3ac5d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f5087fff700 1 -- 172.21.15.92:0/3899152380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f507800f9f0 con 0x55ec3ac4f0d0 2023-10-16T13:13:18.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f5087fff700 1 --2- 172.21.15.92:0/3899152380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac5d160 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5078011b60 tx=0x7f5078011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70327ca24493b04 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:18.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.238+0000 7f50677fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:18.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.239+0000 7f50677fe700 1 -- 172.21.15.92:0/3899152380 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507802e070 con 0x55ec3ac4f0d0 2023-10-16T13:13:18.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.239+0000 7f50677fe700 1 -- 172.21.15.92:0/3899152380 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5078005390 con 0x55ec3ac4f0d0 2023-10-16T13:13:18.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.239+0000 7f509a5cdb80 1 -- 172.21.15.92:0/3899152380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec3aba6f70 con 0x55ec3ac4f0d0 2023-10-16T13:13:18.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.239+0000 7f50677fe700 1 -- 172.21.15.92:0/3899152380 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5078005550 con 0x55ec3ac4f0d0 2023-10-16T13:13:18.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.239+0000 7f509a5cdb80 10 client.15444 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:18.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.239+0000 7f509a5cdb80 1 -- 172.21.15.92:0/3899152380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ec3a9cce60 con 0x55ec3ac4f0d0 2023-10-16T13:13:18.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.239+0000 7f50677fe700 1 -- 172.21.15.92:0/3899152380 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55ec3aba6f70 con 0x55ec3ac4f0d0 2023-10-16T13:13:18.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.239+0000 7f50677fe700 1 -- 172.21.15.92:0/3899152380 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f507801e830 con 0x55ec3ac4f0d0 2023-10-16T13:13:18.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.239+0000 7f509a5cdb80 10 client.15444 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:18.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.239+0000 7f509a5cdb80 10 client.15444 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:13:18.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.239+0000 7f509a5cdb80 20 client.15444 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:18.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.239+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/3899152380 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55ec3ac68dc0 0x55ec3ac6b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.239+0000 7f509a5cdb80 4 client.15444 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:13:18.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.239+0000 7f509a5cdb80 1 -- 172.21.15.92:0/3899152380 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ec3ac1ec90 con 0x55ec3ac68dc0 2023-10-16T13:13:18.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.239+0000 7f50877fe700 1 --2- 172.21.15.92:0/3899152380 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55ec3ac68dc0 0x55ec3ac6b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.240+0000 7f50877fe700 1 --2- 172.21.15.92:0/3899152380 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55ec3ac68dc0 0x55ec3ac6b1e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50f1958485595f6d server_cookie=2f7660d2cbc4a9fa in_seq=0 out_seq=0 2023-10-16T13:13:18.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.240+0000 7f50677fe700 10 client.15444 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:18.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.240+0000 7f50677fe700 1 -- 172.21.15.92:0/3899152380 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ec3ac1ec90 con 0x55ec3ac68dc0 2023-10-16T13:13:18.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.240+0000 7f50677fe700 10 client.15444 handle_command_reply: tid=0 2023-10-16T13:13:18.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.241+0000 7f509a5cdb80 1 client.15444 shutdown 2023-10-16T13:13:18.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.241+0000 7f509a5cdb80 1 -- 172.21.15.92:0/3899152380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac4f0d0 msgr2=0x55ec3ac5d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.241+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/3899152380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac5d160 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5078011b60 tx=0x7f5078011b90 comp rx=0 tx=0).stop 2023-10-16T13:13:18.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.241+0000 7f509a5cdb80 1 -- 172.21.15.92:0/3899152380 shutdown_connections 2023-10-16T13:13:18.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.241+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/3899152380 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55ec3ac68dc0 0x55ec3ac6b1e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.241+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/3899152380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac5d160 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.241+0000 7f50677fe700 0 client.15444 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:18.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.241+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/3899152380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac590a0 0x55ec3ac646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.241+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/3899152380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ac50530 0x55ec3ac5d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.241+0000 7f509a5cdb80 1 -- 172.21.15.92:0/3899152380 >> 172.21.15.92:0/3899152380 conn(0x55ec3ab7ce50 msgr2=0x55ec3ac49c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:18.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.241+0000 7f509a5cdb80 1 -- 172.21.15.92:0/3899152380 shutdown_connections 2023-10-16T13:13:18.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.241+0000 7f509a5cdb80 1 -- 172.21.15.92:0/3899152380 wait complete. 2023-10-16T13:13:18.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.241+0000 7f509a5cdb80 20 client.15444 trim_cache size 0 max 16384 2023-10-16T13:13:18.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.257+0000 7f509a5cdb80 1 Processor -- start 2023-10-16T13:13:18.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.257+0000 7f509a5cdb80 1 -- start start 2023-10-16T13:13:18.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f509a5cdb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ab7ce50 0x55ec3ac5cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f509a5cdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f509a5cdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac50530 0x55ec3ac5d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f509a5cdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec3aa229a0 con 0x55ec3ac4f0d0 2023-10-16T13:13:18.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f509a5cdb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec3ac4c000 con 0x55ec3ab7ce50 2023-10-16T13:13:18.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f509a5cdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec3ac5c660 con 0x55ec3ac50530 2023-10-16T13:13:18.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f50877fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f50877fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac646a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36998/0 (socket says 172.21.15.92:36998) 2023-10-16T13:13:18.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f50877fe700 1 -- 172.21.15.92:0/2909860409 learned_addr learned my addr 172.21.15.92:0/2909860409 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:18.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f5087fff700 1 --2- 172.21.15.92:0/2909860409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ab7ce50 0x55ec3ac5cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f508c980700 1 --2- 172.21.15.92:0/2909860409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac50530 0x55ec3ac5d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f50877fe700 1 -- 172.21.15.92:0/2909860409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac50530 msgr2=0x55ec3ac5d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:18.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f50877fe700 1 --2- 172.21.15.92:0/2909860409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac50530 0x55ec3ac5d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f50877fe700 1 -- 172.21.15.92:0/2909860409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ab7ce50 msgr2=0x55ec3ac5cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:18.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f50877fe700 1 --2- 172.21.15.92:0/2909860409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ab7ce50 0x55ec3ac5cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f50877fe700 1 -- 172.21.15.92:0/2909860409 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec3a9b5ce0 con 0x55ec3ac4f0d0 2023-10-16T13:13:18.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f508c980700 1 --2- 172.21.15.92:0/2909860409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac50530 0x55ec3ac5d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:18.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f50877fe700 1 --2- 172.21.15.92:0/2909860409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac646a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x55ec3ac6baf0 tx=0x7f507c00bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef18872caa614b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:18.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f506effd700 1 -- 172.21.15.92:0/2909860409 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c017040 con 0x55ec3ac4f0d0 2023-10-16T13:13:18.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f506effd700 1 -- 172.21.15.92:0/2909860409 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f507c01cde0 con 0x55ec3ac4f0d0 2023-10-16T13:13:18.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.258+0000 7f506effd700 1 -- 172.21.15.92:0/2909860409 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c005310 con 0x55ec3ac4f0d0 2023-10-16T13:13:18.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.259+0000 7f509a5cdb80 1 -- 172.21.15.92:0/2909860409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac4f0d0 msgr2=0x55ec3ac646a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.259+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/2909860409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac646a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x55ec3ac6baf0 tx=0x7f507c00bba0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.259+0000 7f509a5cdb80 1 -- 172.21.15.92:0/2909860409 shutdown_connections 2023-10-16T13:13:18.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.259+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/2909860409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac50530 0x55ec3ac5d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.259+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/2909860409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ab7ce50 0x55ec3ac5cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.259+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/2909860409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac646a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.259+0000 7f509a5cdb80 1 -- 172.21.15.92:0/2909860409 >> 172.21.15.92:0/2909860409 conn(0x55ec3ac4fa30 msgr2=0x55ec3ac64fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:18.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.259+0000 7f509a5cdb80 1 -- 172.21.15.92:0/2909860409 shutdown_connections 2023-10-16T13:13:18.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.259+0000 7f509a5cdb80 1 -- 172.21.15.92:0/2909860409 wait complete. 2023-10-16T13:13:18.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.259+0000 7f509a5cdb80 1 -- start start 2023-10-16T13:13:18.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f509a5cdb80 1 Processor -- start 2023-10-16T13:13:18.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f509a5cdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ab7ce50 0x55ec3ac63d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f509a5cdb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac64270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f509a5cdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac50530 0x55ec3acbd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f509a5cdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec3acbd770 con 0x55ec3ab7ce50 2023-10-16T13:13:18.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f509a5cdb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec3acbd8b0 con 0x55ec3ac4f0d0 2023-10-16T13:13:18.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f509a5cdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec3acbda40 con 0x55ec3ac50530 2023-10-16T13:13:18.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f509a5cdb80 10 client.0 _ll_register_callbacks cb 0x7f508001bd00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:18.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f5087fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ab7ce50 0x55ec3ac63d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f5087fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ab7ce50 0x55ec3ac63d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37002/0 (socket says 172.21.15.92:37002) 2023-10-16T13:13:18.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f5087fff700 1 -- 172.21.15.92:0/3475058478 learned_addr learned my addr 172.21.15.92:0/3475058478 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:18.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f508c980700 1 --2- 172.21.15.92:0/3475058478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac50530 0x55ec3acbd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f5087fff700 1 -- 172.21.15.92:0/3475058478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac50530 msgr2=0x55ec3acbd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:18.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f5087fff700 1 --2- 172.21.15.92:0/3475058478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac50530 0x55ec3acbd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f50877fe700 1 --2- 172.21.15.92:0/3475058478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac64270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f5087fff700 1 -- 172.21.15.92:0/3475058478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ac4f0d0 msgr2=0x55ec3ac64270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:18.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f5087fff700 1 --2- 172.21.15.92:0/3475058478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac64270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f5087fff700 1 -- 172.21.15.92:0/3475058478 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f507c004360 con 0x55ec3ab7ce50 2023-10-16T13:13:18.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f508c980700 1 --2- 172.21.15.92:0/3475058478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac50530 0x55ec3acbd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:18.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f5087fff700 1 --2- 172.21.15.92:0/3475058478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ab7ce50 0x55ec3ac63d30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5078011c00 tx=0x7f5078012f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09ee1ebbb8b8285 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:18.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.260+0000 7f50677fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:18.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.261+0000 7f50677fe700 1 -- 172.21.15.92:0/3475058478 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507802e040 con 0x55ec3ab7ce50 2023-10-16T13:13:18.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.261+0000 7f50677fe700 1 -- 172.21.15.92:0/3475058478 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5078039030 con 0x55ec3ab7ce50 2023-10-16T13:13:18.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.261+0000 7f509a5cdb80 1 -- 172.21.15.92:0/3475058478 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5078011c30 con 0x55ec3ab7ce50 2023-10-16T13:13:18.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.261+0000 7f50677fe700 1 -- 172.21.15.92:0/3475058478 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5078005680 con 0x55ec3ab7ce50 2023-10-16T13:13:18.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.261+0000 7f509a5cdb80 10 client.15450 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:18.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.261+0000 7f509a5cdb80 1 -- 172.21.15.92:0/3475058478 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ec3a9f32d0 con 0x55ec3ab7ce50 2023-10-16T13:13:18.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.261+0000 7f50677fe700 1 -- 172.21.15.92:0/3475058478 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5078011c30 con 0x55ec3ab7ce50 2023-10-16T13:13:18.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.261+0000 7f50677fe700 1 -- 172.21.15.92:0/3475058478 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5078004980 con 0x55ec3ab7ce50 2023-10-16T13:13:18.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.261+0000 7f509a5cdb80 10 client.15450 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:18.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.261+0000 7f509a5cdb80 10 client.15450 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:13:18.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.261+0000 7f509a5cdb80 20 client.15450 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:18.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.261+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/3475058478 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55ec3ac590a0 0x55ec3acc1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.261+0000 7f509a5cdb80 4 client.15450 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-16T13:13:18.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.261+0000 7f509a5cdb80 1 -- 172.21.15.92:0/3475058478 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55ec3ab9aed0 con 0x55ec3ac590a0 2023-10-16T13:13:18.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.261+0000 7f50877fe700 1 --2- 172.21.15.92:0/3475058478 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55ec3ac590a0 0x55ec3acc1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.262+0000 7f50677fe700 10 client.15450 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:18.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.262+0000 7f50877fe700 1 --2- 172.21.15.92:0/3475058478 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55ec3ac590a0 0x55ec3acc1040 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c0a5a28872510d server_cookie=eb320a6e17d1112f in_seq=0 out_seq=0 2023-10-16T13:13:18.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.263+0000 7f50677fe700 1 -- 172.21.15.92:0/3475058478 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55ec3ab9aed0 con 0x55ec3ac590a0 2023-10-16T13:13:18.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.263+0000 7f50677fe700 10 client.15450 handle_command_reply: tid=0 2023-10-16T13:13:18.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.263+0000 7f509a5cdb80 1 client.15450 shutdown 2023-10-16T13:13:18.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.263+0000 7f509a5cdb80 1 -- 172.21.15.92:0/3475058478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ab7ce50 msgr2=0x55ec3ac63d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.263+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/3475058478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ab7ce50 0x55ec3ac63d30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5078011c00 tx=0x7f5078012f40 comp rx=0 tx=0).stop 2023-10-16T13:13:18.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.263+0000 7f509a5cdb80 1 -- 172.21.15.92:0/3475058478 shutdown_connections 2023-10-16T13:13:18.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.263+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/3475058478 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55ec3ac590a0 0x55ec3acc1040 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.263+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/3475058478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec3ab7ce50 0x55ec3ac63d30 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.263+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/3475058478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec3ac50530 0x55ec3acbd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.263+0000 7f50677fe700 0 client.15450 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:18.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.263+0000 7f509a5cdb80 1 --2- 172.21.15.92:0/3475058478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3ac4f0d0 0x55ec3ac64270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.263+0000 7f509a5cdb80 1 -- 172.21.15.92:0/3475058478 >> 172.21.15.92:0/3475058478 conn(0x55ec3ac4fa30 msgr2=0x55ec3ac5cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:18.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.263+0000 7f509a5cdb80 1 -- 172.21.15.92:0/3475058478 shutdown_connections 2023-10-16T13:13:18.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.263+0000 7f509a5cdb80 1 -- 172.21.15.92:0/3475058478 wait complete. 2023-10-16T13:13:18.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.263+0000 7f509a5cdb80 20 client.15450 trim_cache size 0 max 16384 2023-10-16T13:13:18.287 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:13:18.287 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2023-10-16T13:13:18.287 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "5abbd5b4-c254-4f2b-ab04-ee27760fe78c", 2023-10-16T13:13:18.288 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2023-10-16T13:13:18.288 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:13:18.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.264+0000 7f508e3e3700 1 -- 172.21.15.92:0/2500980724 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f50700a1480 msgr2=0x7f50700a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.264+0000 7f508e3e3700 1 --2- 172.21.15.92:0/2500980724 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f50700a1480 0x7f50700a3940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5078005950 tx=0x7f50780058e0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.264+0000 7f508e3e3700 1 -- 172.21.15.92:0/2500980724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5088101940 msgr2=0x7f508819d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.264+0000 7f508e3e3700 1 --2- 172.21.15.92:0/2500980724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5088101940 0x7f508819d250 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5080009300 tx=0x7f5080009330 comp rx=0 tx=0).stop 2023-10-16T13:13:18.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.264+0000 7f508e3e3700 1 -- 172.21.15.92:0/2500980724 shutdown_connections 2023-10-16T13:13:18.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.264+0000 7f508e3e3700 1 --2- 172.21.15.92:0/2500980724 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f50700a1480 0x7f50700a3940 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.264+0000 7f508e3e3700 1 --2- 172.21.15.92:0/2500980724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5088101940 0x7f508819d250 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.264+0000 7f508e3e3700 1 --2- 172.21.15.92:0/2500980724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50880ffdb0 0x7f5088195cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.264+0000 7f508e3e3700 1 --2- 172.21.15.92:0/2500980724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5088100fa0 0x7f50881961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.264+0000 7f508e3e3700 1 -- 172.21.15.92:0/2500980724 >> 172.21.15.92:0/2500980724 conn(0x7f50880fb320 msgr2=0x7f5088104440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:18.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.264+0000 7f508e3e3700 1 -- 172.21.15.92:0/2500980724 shutdown_connections 2023-10-16T13:13:18.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.264+0000 7f508e3e3700 1 -- 172.21.15.92:0/2500980724 wait complete. 2023-10-16T13:13:18.292 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-16T13:13:18.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.453+0000 7fc824084700 1 -- 172.21.15.92:0/970103335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc81c1013a0 msgr2=0x7fc81c1017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.453+0000 7fc824084700 1 --2- 172.21.15.92:0/970103335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc81c1013a0 0x7fc81c1017c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009990 tx=0x7fc80c009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.453+0000 7fc824084700 1 -- 172.21.15.92:0/970103335 shutdown_connections 2023-10-16T13:13:18.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.453+0000 7fc824084700 1 --2- 172.21.15.92:0/970103335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc81c1013a0 0x7fc81c1017c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.453+0000 7fc824084700 1 --2- 172.21.15.92:0/970103335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc81c1009e0 0x7fc81c1082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.453+0000 7fc824084700 1 --2- 172.21.15.92:0/970103335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc81c100040 0x7fc81c1004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.453+0000 7fc824084700 1 -- 172.21.15.92:0/970103335 >> 172.21.15.92:0/970103335 conn(0x7fc81c0faa90 msgr2=0x7fc81c0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:18.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.453+0000 7fc824084700 1 -- 172.21.15.92:0/970103335 shutdown_connections 2023-10-16T13:13:18.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.453+0000 7fc824084700 1 -- 172.21.15.92:0/970103335 wait complete. 2023-10-16T13:13:18.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc824084700 1 Processor -- start 2023-10-16T13:13:18.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc824084700 1 -- start start 2023-10-16T13:13:18.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc824084700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc81c100040 0x7fc81c195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc824084700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc81c1009e0 0x7fc81c196130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc824084700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc81c1013a0 0x7fc81c19d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc824084700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c19d770 con 0x7fc81c100040 2023-10-16T13:13:18.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc824084700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c19d8b0 con 0x7fc81c1009e0 2023-10-16T13:13:18.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc824084700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c19da40 con 0x7fc81c1013a0 2023-10-16T13:13:18.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc821e20700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc81c100040 0x7fc81c195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc821e20700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc81c100040 0x7fc81c195bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37018/0 (socket says 172.21.15.92:37018) 2023-10-16T13:13:18.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc821e20700 1 -- 172.21.15.92:0/2635230112 learned_addr learned my addr 172.21.15.92:0/2635230112 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:18.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc82161f700 1 --2- 172.21.15.92:0/2635230112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc81c1009e0 0x7fc81c196130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc822621700 1 --2- 172.21.15.92:0/2635230112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc81c1013a0 0x7fc81c19d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc821e20700 1 -- 172.21.15.92:0/2635230112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc81c1013a0 msgr2=0x7fc81c19d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc821e20700 1 --2- 172.21.15.92:0/2635230112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc81c1013a0 0x7fc81c19d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc821e20700 1 -- 172.21.15.92:0/2635230112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc81c1009e0 msgr2=0x7fc81c196130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc821e20700 1 --2- 172.21.15.92:0/2635230112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc81c1009e0 0x7fc81c196130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc821e20700 1 -- 172.21.15.92:0/2635230112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80c0095f0 con 0x7fc81c100040 2023-10-16T13:13:18.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc821e20700 1 --2- 172.21.15.92:0/2635230112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc81c100040 0x7fc81c195bf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00b5c0 tx=0x7fc80c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:18.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.454+0000 7fc812ffd700 1 -- 172.21.15.92:0/2635230112 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c01d070 con 0x7fc81c100040 2023-10-16T13:13:18.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.455+0000 7fc824084700 1 -- 172.21.15.92:0/2635230112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81c19dcc0 con 0x7fc81c100040 2023-10-16T13:13:18.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.455+0000 7fc812ffd700 1 -- 172.21.15.92:0/2635230112 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc80c004cb0 con 0x7fc81c100040 2023-10-16T13:13:18.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.455+0000 7fc812ffd700 1 -- 172.21.15.92:0/2635230112 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c0054f0 con 0x7fc81c100040 2023-10-16T13:13:18.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.455+0000 7fc824084700 1 -- 172.21.15.92:0/2635230112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81c19e0e0 con 0x7fc81c100040 2023-10-16T13:13:18.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.456+0000 7fc812ffd700 1 -- 172.21.15.92:0/2635230112 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fc80c0047d0 con 0x7fc81c100040 2023-10-16T13:13:18.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.457+0000 7fc812ffd700 1 --2- 172.21.15.92:0/2635230112 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc8080a1480 0x7fc8080a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.457+0000 7fc812ffd700 1 -- 172.21.15.92:0/2635230112 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc80c0cde10 con 0x7fc81c100040 2023-10-16T13:13:18.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.457+0000 7fc82161f700 1 --2- 172.21.15.92:0/2635230112 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc8080a1480 0x7fc8080a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.457+0000 7fc82161f700 1 --2- 172.21.15.92:0/2635230112 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc8080a1480 0x7fc8080a3940 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc818005950 tx=0x7fc8180058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:18.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.458+0000 7fc83026eb80 1 Processor -- start 2023-10-16T13:13:18.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.458+0000 7fc83026eb80 1 -- start start 2023-10-16T13:13:18.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.458+0000 7fc83026eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83314ee20 0x55a83314f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.458+0000 7fc83026eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314f780 0x55a833150040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.458+0000 7fc83026eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a833150620 0x55a833150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.458+0000 7fc83026eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8330c3c70 con 0x55a83314f780 2023-10-16T13:13:18.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.458+0000 7fc83026eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8330a8c60 con 0x55a833150620 2023-10-16T13:13:18.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.458+0000 7fc83026eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8330a6580 con 0x55a83314ee20 2023-10-16T13:13:18.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.459+0000 7fc82161f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314f780 0x55a833150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.459+0000 7fc82161f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314f780 0x55a833150040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37028/0 (socket says 172.21.15.92:37028) 2023-10-16T13:13:18.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.459+0000 7fc82161f700 1 -- 172.21.15.92:0/1025110109 learned_addr learned my addr 172.21.15.92:0/1025110109 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:18.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.459+0000 7fc822621700 1 --2- 172.21.15.92:0/1025110109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a833150620 0x55a833150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.459+0000 7fc821e20700 1 --2- 172.21.15.92:0/1025110109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83314ee20 0x55a83314f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.459+0000 7fc82161f700 1 -- 172.21.15.92:0/1025110109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83314ee20 msgr2=0x55a83314f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:18.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.459+0000 7fc82161f700 1 --2- 172.21.15.92:0/1025110109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83314ee20 0x55a83314f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.459+0000 7fc82161f700 1 -- 172.21.15.92:0/1025110109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a833150620 msgr2=0x55a833150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:18.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.459+0000 7fc82161f700 1 --2- 172.21.15.92:0/1025110109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a833150620 0x55a833150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.459+0000 7fc82161f700 1 -- 172.21.15.92:0/1025110109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a83305f3f0 con 0x55a83314f780 2023-10-16T13:13:18.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.459+0000 7fc822621700 1 --2- 172.21.15.92:0/1025110109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a833150620 0x55a833150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:18.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.459+0000 7fc82161f700 1 --2- 172.21.15.92:0/1025110109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314f780 0x55a833150040 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc81800fd70 tx=0x7fc818012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ac76bca49f7f1e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:18.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.459+0000 7fc807fff700 1 -- 172.21.15.92:0/1025110109 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc818011c60 con 0x55a83314f780 2023-10-16T13:13:18.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.459+0000 7fc807fff700 1 -- 172.21.15.92:0/1025110109 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc818011dc0 con 0x55a83314f780 2023-10-16T13:13:18.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.459+0000 7fc807fff700 1 -- 172.21.15.92:0/1025110109 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81801d870 con 0x55a83314f780 2023-10-16T13:13:18.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.460+0000 7fc83026eb80 1 -- 172.21.15.92:0/1025110109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314f780 msgr2=0x55a833150040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.460+0000 7fc83026eb80 1 --2- 172.21.15.92:0/1025110109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314f780 0x55a833150040 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc81800fd70 tx=0x7fc818012000 comp rx=0 tx=0).stop 2023-10-16T13:13:18.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.460+0000 7fc83026eb80 1 -- 172.21.15.92:0/1025110109 shutdown_connections 2023-10-16T13:13:18.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.460+0000 7fc83026eb80 1 --2- 172.21.15.92:0/1025110109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a833150620 0x55a833150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.460+0000 7fc83026eb80 1 --2- 172.21.15.92:0/1025110109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83314ee20 0x55a83314f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.460+0000 7fc83026eb80 1 --2- 172.21.15.92:0/1025110109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314f780 0x55a833150040 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.460+0000 7fc83026eb80 1 -- 172.21.15.92:0/1025110109 >> 172.21.15.92:0/1025110109 conn(0x55a83307cdd0 msgr2=0x55a833149fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:18.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.460+0000 7fc83026eb80 1 -- 172.21.15.92:0/1025110109 shutdown_connections 2023-10-16T13:13:18.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.460+0000 7fc83026eb80 1 -- 172.21.15.92:0/1025110109 wait complete. 2023-10-16T13:13:18.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.460+0000 7fc83026eb80 1 -- start start 2023-10-16T13:13:18.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.460+0000 7fc83026eb80 1 Processor -- start 2023-10-16T13:13:18.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc83026eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83314ee20 0x55a83315ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc83026eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a83314f780 0x55a83315b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc83026eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a833150620 0x55a833162410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc83026eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8330a1e70 con 0x55a833150620 2023-10-16T13:13:18.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc83026eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a83303e710 con 0x55a83314f780 2023-10-16T13:13:18.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc83026eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a83303e3b0 con 0x55a83314ee20 2023-10-16T13:13:18.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc83026eb80 10 client.0 _ll_register_callbacks cb 0x55a832e9b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:18.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc822621700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a833150620 0x55a833162410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc822621700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a833150620 0x55a833162410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37036/0 (socket says 172.21.15.92:37036) 2023-10-16T13:13:18.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc822621700 1 -- 172.21.15.92:0/4047302490 learned_addr learned my addr 172.21.15.92:0/4047302490 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:18.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc82161f700 1 --2- 172.21.15.92:0/4047302490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a83314f780 0x55a83315b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc821e20700 1 --2- 172.21.15.92:0/4047302490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83314ee20 0x55a83315ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc822621700 1 -- 172.21.15.92:0/4047302490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83314ee20 msgr2=0x55a83315ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:18.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc822621700 1 --2- 172.21.15.92:0/4047302490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83314ee20 0x55a83315ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc822621700 1 -- 172.21.15.92:0/4047302490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a83314f780 msgr2=0x55a83315b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:18.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc822621700 1 --2- 172.21.15.92:0/4047302490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a83314f780 0x55a83315b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc822621700 1 -- 172.21.15.92:0/4047302490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81800fa20 con 0x55a833150620 2023-10-16T13:13:18.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc82161f700 1 --2- 172.21.15.92:0/4047302490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a83314f780 0x55a83315b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:18.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc822621700 1 --2- 172.21.15.92:0/4047302490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a833150620 0x55a833162410 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc81400d8a0 tx=0x7fc81400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3e7251dc8f602e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:18.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc8057fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:18.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.461+0000 7fc8057fa700 1 -- 172.21.15.92:0/4047302490 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81400b870 con 0x55a833150620 2023-10-16T13:13:18.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.462+0000 7fc8057fa700 1 -- 172.21.15.92:0/4047302490 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc814006e40 con 0x55a833150620 2023-10-16T13:13:18.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.462+0000 7fc83026eb80 1 -- 172.21.15.92:0/4047302490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8330a6ef0 con 0x55a833150620 2023-10-16T13:13:18.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.462+0000 7fc8057fa700 1 -- 172.21.15.92:0/4047302490 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc81400b9d0 con 0x55a833150620 2023-10-16T13:13:18.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.462+0000 7fc83026eb80 10 client.15462 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:18.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.462+0000 7fc83026eb80 1 -- 172.21.15.92:0/4047302490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a832eccde0 con 0x55a833150620 2023-10-16T13:13:18.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.462+0000 7fc8057fa700 1 -- 172.21.15.92:0/4047302490 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55a8330a6ef0 con 0x55a833150620 2023-10-16T13:13:18.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.462+0000 7fc8057fa700 1 -- 172.21.15.92:0/4047302490 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc814017020 con 0x55a833150620 2023-10-16T13:13:18.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.462+0000 7fc83026eb80 10 client.15462 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:18.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.462+0000 7fc83026eb80 10 client.15462 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:13:18.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.462+0000 7fc83026eb80 20 client.15462 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:18.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.462+0000 7fc83026eb80 1 --2- 172.21.15.92:0/4047302490 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a833166d00 0x55a833169120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.462+0000 7fc83026eb80 4 client.15462 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:13:18.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.462+0000 7fc83026eb80 1 -- 172.21.15.92:0/4047302490 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a83311ec10 con 0x55a833166d00 2023-10-16T13:13:18.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.462+0000 7fc821e20700 1 --2- 172.21.15.92:0/4047302490 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a833166d00 0x55a833169120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.463+0000 7fc8057fa700 10 client.15462 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:18.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.463+0000 7fc821e20700 1 --2- 172.21.15.92:0/4047302490 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a833166d00 0x55a833169120 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efb18a1d23028b62 server_cookie=76b7fce0f797fe0f in_seq=0 out_seq=0 2023-10-16T13:13:18.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.463+0000 7fc8057fa700 1 -- 172.21.15.92:0/4047302490 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a83311ec10 con 0x55a833166d00 2023-10-16T13:13:18.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.463+0000 7fc8057fa700 10 client.15462 handle_command_reply: tid=0 2023-10-16T13:13:18.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.463+0000 7fc83026eb80 1 client.15462 shutdown 2023-10-16T13:13:18.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.463+0000 7fc83026eb80 1 -- 172.21.15.92:0/4047302490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a833150620 msgr2=0x55a833162410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.463+0000 7fc83026eb80 1 --2- 172.21.15.92:0/4047302490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a833150620 0x55a833162410 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc81400d8a0 tx=0x7fc81400dc60 comp rx=0 tx=0).stop 2023-10-16T13:13:18.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.463+0000 7fc83026eb80 1 -- 172.21.15.92:0/4047302490 shutdown_connections 2023-10-16T13:13:18.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.463+0000 7fc83026eb80 1 --2- 172.21.15.92:0/4047302490 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a833166d00 0x55a833169120 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.463+0000 7fc83026eb80 1 --2- 172.21.15.92:0/4047302490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a833150620 0x55a833162410 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.463+0000 7fc83026eb80 1 --2- 172.21.15.92:0/4047302490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83314ee20 0x55a83315ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.463+0000 7fc8057fa700 0 client.15462 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:18.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.463+0000 7fc83026eb80 1 --2- 172.21.15.92:0/4047302490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a83314f780 0x55a83315b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.463+0000 7fc83026eb80 1 -- 172.21.15.92:0/4047302490 >> 172.21.15.92:0/4047302490 conn(0x55a83307cdd0 msgr2=0x55a833149bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:18.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.464+0000 7fc83026eb80 1 -- 172.21.15.92:0/4047302490 shutdown_connections 2023-10-16T13:13:18.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.464+0000 7fc83026eb80 1 -- 172.21.15.92:0/4047302490 wait complete. 2023-10-16T13:13:18.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.464+0000 7fc83026eb80 20 client.15462 trim_cache size 0 max 16384 2023-10-16T13:13:18.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc83026eb80 1 Processor -- start 2023-10-16T13:13:18.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc83026eb80 1 -- start start 2023-10-16T13:13:18.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc83026eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314ee20 0x55a833155790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc83026eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a83314f780 0x55a833155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc83026eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a833150620 0x55a83315ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc83026eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a832f22920 con 0x55a83314ee20 2023-10-16T13:13:18.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc83026eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a833144c00 con 0x55a83314f780 2023-10-16T13:13:18.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc83026eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a83315c010 con 0x55a833150620 2023-10-16T13:13:18.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc821e20700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314ee20 0x55a833155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc821e20700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314ee20 0x55a833155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37040/0 (socket says 172.21.15.92:37040) 2023-10-16T13:13:18.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc821e20700 1 -- 172.21.15.92:0/4197877326 learned_addr learned my addr 172.21.15.92:0/4197877326 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:18.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc82161f700 1 --2- 172.21.15.92:0/4197877326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a83314f780 0x55a833155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc822621700 1 --2- 172.21.15.92:0/4197877326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a833150620 0x55a83315ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc821e20700 1 -- 172.21.15.92:0/4197877326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a833150620 msgr2=0x55a83315ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc821e20700 1 --2- 172.21.15.92:0/4197877326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a833150620 0x55a83315ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc821e20700 1 -- 172.21.15.92:0/4197877326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a83314f780 msgr2=0x55a833155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc821e20700 1 --2- 172.21.15.92:0/4197877326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a83314f780 0x55a833155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc821e20700 1 -- 172.21.15.92:0/4197877326 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a832eb5c60 con 0x55a83314ee20 2023-10-16T13:13:18.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc822621700 1 --2- 172.21.15.92:0/4197877326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a833150620 0x55a83315ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:18.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.481+0000 7fc821e20700 1 --2- 172.21.15.92:0/4197877326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314ee20 0x55a833155790 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0059d0 tx=0x7fc80c01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a96f3e1ee6f8241 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:18.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.482+0000 7fc810ff9700 1 -- 172.21.15.92:0/4197877326 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c09b1c0 con 0x55a83314ee20 2023-10-16T13:13:18.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.482+0000 7fc810ff9700 1 -- 172.21.15.92:0/4197877326 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc80c09f310 con 0x55a83314ee20 2023-10-16T13:13:18.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.482+0000 7fc810ff9700 1 -- 172.21.15.92:0/4197877326 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c099560 con 0x55a83314ee20 2023-10-16T13:13:18.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.482+0000 7fc83026eb80 1 -- 172.21.15.92:0/4197877326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314ee20 msgr2=0x55a833155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.482+0000 7fc83026eb80 1 --2- 172.21.15.92:0/4197877326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314ee20 0x55a833155790 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0059d0 tx=0x7fc80c01a040 comp rx=0 tx=0).stop 2023-10-16T13:13:18.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.482+0000 7fc83026eb80 1 -- 172.21.15.92:0/4197877326 shutdown_connections 2023-10-16T13:13:18.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.482+0000 7fc83026eb80 1 --2- 172.21.15.92:0/4197877326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314ee20 0x55a833155790 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.482+0000 7fc83026eb80 1 --2- 172.21.15.92:0/4197877326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a833150620 0x55a83315ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.482+0000 7fc83026eb80 1 --2- 172.21.15.92:0/4197877326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a83314f780 0x55a833155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.482+0000 7fc83026eb80 1 -- 172.21.15.92:0/4197877326 >> 172.21.15.92:0/4197877326 conn(0x55a83307cdd0 msgr2=0x55a833149b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.482+0000 7fc83026eb80 1 -- 172.21.15.92:0/4197877326 shutdown_connections 2023-10-16T13:13:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.482+0000 7fc83026eb80 1 -- 172.21.15.92:0/4197877326 wait complete. 2023-10-16T13:13:18.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc83026eb80 1 -- start start 2023-10-16T13:13:18.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc83026eb80 1 Processor -- start 2023-10-16T13:13:18.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc83026eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314ee20 0x55a8331b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc83026eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83314f780 0x55a8331b5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc83026eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a833150620 0x55a8331bc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc83026eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8331bc5d0 con 0x55a83314ee20 2023-10-16T13:13:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc83026eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8331bc710 con 0x55a833150620 2023-10-16T13:13:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc83026eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8331bc8d0 con 0x55a83314f780 2023-10-16T13:13:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc83026eb80 10 client.0 _ll_register_callbacks cb 0x7fc814007d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc821e20700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314ee20 0x55a8331b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc821e20700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314ee20 0x55a8331b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37046/0 (socket says 172.21.15.92:37046) 2023-10-16T13:13:18.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc821e20700 1 -- 172.21.15.92:0/2487252677 learned_addr learned my addr 172.21.15.92:0/2487252677 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:18.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc82161f700 1 --2- 172.21.15.92:0/2487252677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83314f780 0x55a8331b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc822621700 1 --2- 172.21.15.92:0/2487252677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a833150620 0x55a8331bc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc821e20700 1 -- 172.21.15.92:0/2487252677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83314f780 msgr2=0x55a8331b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:18.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc821e20700 1 --2- 172.21.15.92:0/2487252677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83314f780 0x55a8331b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc821e20700 1 -- 172.21.15.92:0/2487252677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a833150620 msgr2=0x55a8331bc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:18.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc821e20700 1 --2- 172.21.15.92:0/2487252677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a833150620 0x55a8331bc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc821e20700 1 -- 172.21.15.92:0/2487252677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81c19e0e0 con 0x55a83314ee20 2023-10-16T13:13:18.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc822621700 1 --2- 172.21.15.92:0/2487252677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a833150620 0x55a8331bc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:18.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.483+0000 7fc82161f700 1 --2- 172.21.15.92:0/2487252677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83314f780 0x55a8331b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:18.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.484+0000 7fc821e20700 1 --2- 172.21.15.92:0/2487252677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314ee20 0x55a8331b4d40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc80c000c00 tx=0x7fc80c00ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54bedbd129a8daf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:18.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.484+0000 7fc8057fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:18.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.484+0000 7fc8057fa700 1 -- 172.21.15.92:0/2487252677 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c09b1c0 con 0x55a83314ee20 2023-10-16T13:13:18.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.484+0000 7fc8057fa700 1 -- 172.21.15.92:0/2487252677 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc80c005650 con 0x55a83314ee20 2023-10-16T13:13:18.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.484+0000 7fc83026eb80 1 -- 172.21.15.92:0/2487252677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc818011dc0 con 0x55a83314ee20 2023-10-16T13:13:18.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.484+0000 7fc8057fa700 1 -- 172.21.15.92:0/2487252677 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc80c0cba20 con 0x55a83314ee20 2023-10-16T13:13:18.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.484+0000 7fc83026eb80 10 client.15468 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:18.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.484+0000 7fc83026eb80 1 -- 172.21.15.92:0/2487252677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a832ef3250 con 0x55a83314ee20 2023-10-16T13:13:18.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.484+0000 7fc8057fa700 1 -- 172.21.15.92:0/2487252677 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc818011dc0 con 0x55a83314ee20 2023-10-16T13:13:18.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.484+0000 7fc8057fa700 1 -- 172.21.15.92:0/2487252677 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc80c0b9070 con 0x55a83314ee20 2023-10-16T13:13:18.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.484+0000 7fc83026eb80 10 client.15468 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:18.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.484+0000 7fc83026eb80 10 client.15468 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:13:18.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.484+0000 7fc83026eb80 20 client.15468 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:18.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.484+0000 7fc83026eb80 1 --2- 172.21.15.92:0/2487252677 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a8331bddf0 0x55a8331c0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:18.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.484+0000 7fc83026eb80 4 client.15468 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-16T13:13:18.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.484+0000 7fc83026eb80 1 -- 172.21.15.92:0/2487252677 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a83309ae50 con 0x55a8331bddf0 2023-10-16T13:13:18.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.484+0000 7fc82161f700 1 --2- 172.21.15.92:0/2487252677 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a8331bddf0 0x55a8331c0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:18.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.485+0000 7fc8057fa700 10 client.15468 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:18.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.485+0000 7fc82161f700 1 --2- 172.21.15.92:0/2487252677 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a8331bddf0 0x55a8331c0210 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfc4948146d4a7f4 server_cookie=b0330fd98fe1a34c in_seq=0 out_seq=0 2023-10-16T13:13:18.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.485+0000 7fc8057fa700 1 -- 172.21.15.92:0/2487252677 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a83309ae50 con 0x55a8331bddf0 2023-10-16T13:13:18.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.485+0000 7fc8057fa700 10 client.15468 handle_command_reply: tid=0 2023-10-16T13:13:18.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.485+0000 7fc83026eb80 1 client.15468 shutdown 2023-10-16T13:13:18.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.485+0000 7fc83026eb80 1 -- 172.21.15.92:0/2487252677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314ee20 msgr2=0x55a8331b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.485+0000 7fc83026eb80 1 --2- 172.21.15.92:0/2487252677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314ee20 0x55a8331b4d40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc80c000c00 tx=0x7fc80c00ff20 comp rx=0 tx=0).stop 2023-10-16T13:13:18.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.485+0000 7fc83026eb80 1 -- 172.21.15.92:0/2487252677 shutdown_connections 2023-10-16T13:13:18.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.485+0000 7fc83026eb80 1 --2- 172.21.15.92:0/2487252677 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a8331bddf0 0x55a8331c0210 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.485+0000 7fc83026eb80 1 --2- 172.21.15.92:0/2487252677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a83314ee20 0x55a8331b4d40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.485+0000 7fc83026eb80 1 --2- 172.21.15.92:0/2487252677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a833150620 0x55a8331bc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.485+0000 7fc8057fa700 0 client.15468 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:18.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.485+0000 7fc83026eb80 1 --2- 172.21.15.92:0/2487252677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83314f780 0x55a8331b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.485+0000 7fc83026eb80 1 -- 172.21.15.92:0/2487252677 >> 172.21.15.92:0/2487252677 conn(0x55a83307cdd0 msgr2=0x55a833155790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:18.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.485+0000 7fc83026eb80 1 -- 172.21.15.92:0/2487252677 shutdown_connections 2023-10-16T13:13:18.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.485+0000 7fc83026eb80 1 -- 172.21.15.92:0/2487252677 wait complete. 2023-10-16T13:13:18.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.485+0000 7fc83026eb80 20 client.15468 trim_cache size 0 max 16384 2023-10-16T13:13:18.527 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:13:18.527 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-16T13:13:18.528 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2023-10-16T13:13:18.528 INFO:teuthology.orchestra.run.smithi092.stdout: "5abbd5b4-c254-4f2b-ab04-ee27760fe78c": { 2023-10-16T13:13:18.528 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2023-10-16T13:13:18.528 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "5abbd5b4-c254-4f2b-ab04-ee27760fe78c", 2023-10-16T13:13:18.528 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2023-10-16T13:13:18.529 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:13:18.529 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:13:18.529 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:13:18.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.486+0000 7fc824084700 1 -- 172.21.15.92:0/2635230112 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc8080a1480 msgr2=0x7fc8080a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.486+0000 7fc824084700 1 --2- 172.21.15.92:0/2635230112 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc8080a1480 0x7fc8080a3940 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc818005950 tx=0x7fc8180058e0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.486+0000 7fc824084700 1 -- 172.21.15.92:0/2635230112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc81c100040 msgr2=0x7fc81c195bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:18.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.486+0000 7fc824084700 1 --2- 172.21.15.92:0/2635230112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc81c100040 0x7fc81c195bf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00b5c0 tx=0x7fc80c00f740 comp rx=0 tx=0).stop 2023-10-16T13:13:18.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.486+0000 7fc824084700 1 -- 172.21.15.92:0/2635230112 shutdown_connections 2023-10-16T13:13:18.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.486+0000 7fc824084700 1 --2- 172.21.15.92:0/2635230112 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc8080a1480 0x7fc8080a3940 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.486+0000 7fc824084700 1 --2- 172.21.15.92:0/2635230112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc81c100040 0x7fc81c195bf0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.486+0000 7fc824084700 1 --2- 172.21.15.92:0/2635230112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc81c1013a0 0x7fc81c19d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.486+0000 7fc824084700 1 --2- 172.21.15.92:0/2635230112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc81c1009e0 0x7fc81c196130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:18.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.486+0000 7fc824084700 1 -- 172.21.15.92:0/2635230112 >> 172.21.15.92:0/2635230112 conn(0x7fc81c0faa90 msgr2=0x7fc81c1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:18.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.486+0000 7fc824084700 1 -- 172.21.15.92:0/2635230112 shutdown_connections 2023-10-16T13:13:18.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:18.486+0000 7fc824084700 1 -- 172.21.15.92:0/2635230112 wait complete. 2023-10-16T13:13:18.533 INFO:tasks.cephfs.filesystem:scrub status for tag:5abbd5b4-c254-4f2b-ab04-ee27760fe78c - {'path': '/', 'tag': '5abbd5b4-c254-4f2b-ab04-ee27760fe78c', 'options': 'recursive,force'} 2023-10-16T13:13:18.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:18 smithi152 ceph-mon[104423]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-10-16T13:13:18.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:18 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/4046645535' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:13:18.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:18 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/621721605' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:18.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:18 smithi152 ceph-mon[104423]: scrub queued for path: / 2023-10-16T13:13:18.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:18 smithi152 ceph-mon[104423]: scrub summary: idle+waiting paths [/] 2023-10-16T13:13:18.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:18 smithi152 ceph-mon[104423]: scrub summary: active paths [/] 2023-10-16T13:13:18.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:18 smithi152 ceph-mon[104423]: scrub summary: idle+waiting paths [/] 2023-10-16T13:13:18.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:18 smithi092 ceph-mon[99542]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-10-16T13:13:18.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:18 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/4046645535' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:13:18.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:18 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/621721605' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:18.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:18 smithi092 ceph-mon[99542]: scrub queued for path: / 2023-10-16T13:13:18.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:18 smithi092 ceph-mon[99542]: scrub summary: idle+waiting paths [/] 2023-10-16T13:13:18.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:18 smithi092 ceph-mon[99542]: scrub summary: active paths [/] 2023-10-16T13:13:18.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:18 smithi092 ceph-mon[99542]: scrub summary: idle+waiting paths [/] 2023-10-16T13:13:19.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:18 smithi118 ceph-mon[103969]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-10-16T13:13:19.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:18 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/4046645535' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:13:19.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:18 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/621721605' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:13:19.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:18 smithi118 ceph-mon[103969]: scrub queued for path: / 2023-10-16T13:13:19.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:18 smithi118 ceph-mon[103969]: scrub summary: idle+waiting paths [/] 2023-10-16T13:13:19.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:18 smithi118 ceph-mon[103969]: scrub summary: active paths [/] 2023-10-16T13:13:19.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:18 smithi118 ceph-mon[103969]: scrub summary: idle+waiting paths [/] 2023-10-16T13:13:19.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:19 smithi152 ceph-mon[104423]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 10 op/s 2023-10-16T13:13:19.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:19 smithi092 ceph-mon[99542]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 10 op/s 2023-10-16T13:13:20.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:19 smithi118 ceph-mon[103969]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 10 op/s 2023-10-16T13:13:22.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:22 smithi152 ceph-mon[104423]: pgmap v308: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2023-10-16T13:13:22.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:22 smithi092 ceph-mon[99542]: pgmap v308: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2023-10-16T13:13:22.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:22 smithi118 ceph-mon[103969]: pgmap v308: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2023-10-16T13:13:24.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:24 smithi152 ceph-mon[104423]: pgmap v309: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2023-10-16T13:13:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:24 smithi092 ceph-mon[99542]: pgmap v309: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2023-10-16T13:13:24.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:24 smithi118 ceph-mon[103969]: pgmap v309: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2023-10-16T13:13:26.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:26 smithi152 ceph-mon[104423]: pgmap v310: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-16T13:13:26.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:26 smithi092 ceph-mon[99542]: pgmap v310: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-16T13:13:26.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:26 smithi118 ceph-mon[103969]: pgmap v310: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-16T13:13:28.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:28 smithi152 ceph-mon[104423]: pgmap v311: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-10-16T13:13:28.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:28 smithi092 ceph-mon[99542]: pgmap v311: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-10-16T13:13:28.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:28 smithi118 ceph-mon[103969]: pgmap v311: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-10-16T13:13:29.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:29 smithi152 ceph-mon[104423]: scrub summary: idle 2023-10-16T13:13:29.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:29 smithi092 ceph-mon[99542]: scrub summary: idle 2023-10-16T13:13:29.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:29 smithi118 ceph-mon[103969]: scrub summary: idle 2023-10-16T13:13:30.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:30 smithi152 ceph-mon[104423]: pgmap v312: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2023-10-16T13:13:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:30 smithi092 ceph-mon[99542]: pgmap v312: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2023-10-16T13:13:30.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:30 smithi118 ceph-mon[103969]: pgmap v312: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2023-10-16T13:13:31.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.223+0000 7f0c05716700 1 -- 172.21.15.92:0/1367485327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c000ffdf0 msgr2=0x7f0c00100210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:31.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.223+0000 7f0c05716700 1 --2- 172.21.15.92:0/1367485327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c000ffdf0 0x7f0c00100210 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00099c0 tx=0x7f0bf0009cd0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.223+0000 7f0c05716700 1 -- 172.21.15.92:0/1367485327 shutdown_connections 2023-10-16T13:13:31.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.223+0000 7f0c05716700 1 --2- 172.21.15.92:0/1367485327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c000ffdf0 0x7f0c00100210 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.223+0000 7f0c05716700 1 --2- 172.21.15.92:0/1367485327 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c00101980 0x7f0c00108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.223+0000 7f0c05716700 1 --2- 172.21.15.92:0/1367485327 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c00100fe0 0x7f0c00101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.223+0000 7f0c05716700 1 -- 172.21.15.92:0/1367485327 >> 172.21.15.92:0/1367485327 conn(0x7f0c000fb340 msgr2=0x7f0c000fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.223+0000 7f0c05716700 1 -- 172.21.15.92:0/1367485327 shutdown_connections 2023-10-16T13:13:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.223+0000 7f0c05716700 1 -- 172.21.15.92:0/1367485327 wait complete. 2023-10-16T13:13:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.224+0000 7f0c05716700 1 Processor -- start 2023-10-16T13:13:31.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.224+0000 7f0c05716700 1 -- start start 2023-10-16T13:13:31.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.225+0000 7f0c05716700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c000ffdf0 0x7f0c00196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:31.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.225+0000 7f0c05716700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c00100fe0 0x7f0c001972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:31.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.225+0000 7f0c05716700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c00101980 0x7f0c00198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:31.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.225+0000 7f0c05716700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c00198770 con 0x7f0c00101980 2023-10-16T13:13:31.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.225+0000 7f0c05716700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c001988e0 con 0x7f0c000ffdf0 2023-10-16T13:13:31.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.225+0000 7f0c05716700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c00198aa0 con 0x7f0c00100fe0 2023-10-16T13:13:31.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.225+0000 7f0bff7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c00101980 0x7f0c00198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:31.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.225+0000 7f0bff7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c00101980 0x7f0c00198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37062/0 (socket says 172.21.15.92:37062) 2023-10-16T13:13:31.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.225+0000 7f0bff7fe700 1 -- 172.21.15.92:0/3422240104 learned_addr learned my addr 172.21.15.92:0/3422240104 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:31.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.225+0000 7f0bfeffd700 1 --2- 172.21.15.92:0/3422240104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c000ffdf0 0x7f0c00196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:31.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.225+0000 7f0bfe7fc700 1 --2- 172.21.15.92:0/3422240104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c00100fe0 0x7f0c001972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:31.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.225+0000 7f0bff7fe700 1 -- 172.21.15.92:0/3422240104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c00100fe0 msgr2=0x7f0c001972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:31.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.225+0000 7f0bff7fe700 1 --2- 172.21.15.92:0/3422240104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c00100fe0 0x7f0c001972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.225+0000 7f0bff7fe700 1 -- 172.21.15.92:0/3422240104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c000ffdf0 msgr2=0x7f0c00196d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:31.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.225+0000 7f0bff7fe700 1 --2- 172.21.15.92:0/3422240104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c000ffdf0 0x7f0c00196d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.225+0000 7f0bff7fe700 1 -- 172.21.15.92:0/3422240104 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf00095f0 con 0x7f0c00101980 2023-10-16T13:13:31.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.225+0000 7f0bff7fe700 1 --2- 172.21.15.92:0/3422240104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c00101980 0x7f0c00198060 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8007ee0 tx=0x7f0bf800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:31.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.225+0000 7f0be7fff700 1 -- 172.21.15.92:0/3422240104 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8017070 con 0x7f0c00101980 2023-10-16T13:13:31.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.226+0000 7f0be7fff700 1 -- 172.21.15.92:0/3422240104 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0bf800f040 con 0x7f0c00101980 2023-10-16T13:13:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.226+0000 7f0c05716700 1 -- 172.21.15.92:0/3422240104 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c00198d80 con 0x7f0c00101980 2023-10-16T13:13:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.226+0000 7f0be7fff700 1 -- 172.21.15.92:0/3422240104 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8005760 con 0x7f0c00101980 2023-10-16T13:13:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.226+0000 7f0c05716700 1 -- 172.21.15.92:0/3422240104 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0019f4e0 con 0x7f0c00101980 2023-10-16T13:13:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.228+0000 7f0be7fff700 1 -- 172.21.15.92:0/3422240104 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0bf80058c0 con 0x7f0c00101980 2023-10-16T13:13:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.228+0000 7f0be7fff700 1 --2- 172.21.15.92:0/3422240104 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0be80a1480 0x7f0be80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.229+0000 7f0bfeffd700 1 --2- 172.21.15.92:0/3422240104 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0be80a1480 0x7f0be80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.229+0000 7f0be7fff700 1 -- 172.21.15.92:0/3422240104 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f0bf80cc410 con 0x7f0c00101980 2023-10-16T13:13:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.229+0000 7f0c11900b80 1 Processor -- start 2023-10-16T13:13:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.229+0000 7f0bfeffd700 1 --2- 172.21.15.92:0/3422240104 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0be80a1480 0x7f0be80a3940 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0c00196ad0 tx=0x7f0bf000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.229+0000 7f0c11900b80 1 -- start start 2023-10-16T13:13:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.229+0000 7f0c11900b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca4850 0x55e6d5ca4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.229+0000 7f0c11900b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca51b0 0x55e6d5ca5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.229+0000 7f0c11900b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 0x55e6d5ca6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.229+0000 7f0c11900b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6d5c19c10 con 0x55e6d5ca60a0 2023-10-16T13:13:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.229+0000 7f0c11900b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6d5bfec00 con 0x55e6d5ca51b0 2023-10-16T13:13:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.229+0000 7f0c11900b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6d5bfc520 con 0x55e6d5ca4850 2023-10-16T13:13:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.229+0000 7f0bff7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 0x55e6d5ca6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.229+0000 7f0bff7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 0x55e6d5ca6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37070/0 (socket says 172.21.15.92:37070) 2023-10-16T13:13:31.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.229+0000 7f0bff7fe700 1 -- 172.21.15.92:0/1609378131 learned_addr learned my addr 172.21.15.92:0/1609378131 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:31.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.230+0000 7f0bfe7fc700 1 --2- 172.21.15.92:0/1609378131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca51b0 0x55e6d5ca5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:31.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.230+0000 7f0bfeffd700 1 --2- 172.21.15.92:0/1609378131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca4850 0x55e6d5ca4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:31.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.230+0000 7f0bff7fe700 1 -- 172.21.15.92:0/1609378131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca4850 msgr2=0x55e6d5ca4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:31.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.230+0000 7f0bff7fe700 1 --2- 172.21.15.92:0/1609378131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca4850 0x55e6d5ca4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.230+0000 7f0bff7fe700 1 -- 172.21.15.92:0/1609378131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca51b0 msgr2=0x55e6d5ca5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:31.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.230+0000 7f0bff7fe700 1 --2- 172.21.15.92:0/1609378131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca51b0 0x55e6d5ca5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.230+0000 7f0bff7fe700 1 -- 172.21.15.92:0/1609378131 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6d5bb5390 con 0x55e6d5ca60a0 2023-10-16T13:13:31.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.230+0000 7f0bff7fe700 1 --2- 172.21.15.92:0/1609378131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 0x55e6d5ca6520 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80961a0 tx=0x7f0bf8095a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be9e8e8e3ce454a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:31.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.230+0000 7f0be57fa700 1 -- 172.21.15.92:0/1609378131 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf80b90d0 con 0x55e6d5ca60a0 2023-10-16T13:13:31.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.230+0000 7f0be57fa700 1 -- 172.21.15.92:0/1609378131 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0bf8099730 con 0x55e6d5ca60a0 2023-10-16T13:13:31.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.230+0000 7f0be57fa700 1 -- 172.21.15.92:0/1609378131 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf80840c0 con 0x55e6d5ca60a0 2023-10-16T13:13:31.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.231+0000 7f0c11900b80 1 -- 172.21.15.92:0/1609378131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 msgr2=0x55e6d5ca6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:31.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.231+0000 7f0c11900b80 1 --2- 172.21.15.92:0/1609378131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 0x55e6d5ca6520 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80961a0 tx=0x7f0bf8095a70 comp rx=0 tx=0).stop 2023-10-16T13:13:31.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.231+0000 7f0c11900b80 1 -- 172.21.15.92:0/1609378131 shutdown_connections 2023-10-16T13:13:31.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.231+0000 7f0c11900b80 1 --2- 172.21.15.92:0/1609378131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 0x55e6d5ca6520 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.231+0000 7f0c11900b80 1 --2- 172.21.15.92:0/1609378131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca4850 0x55e6d5ca4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.231+0000 7f0c11900b80 1 --2- 172.21.15.92:0/1609378131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca51b0 0x55e6d5ca5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.231+0000 7f0c11900b80 1 -- 172.21.15.92:0/1609378131 >> 172.21.15.92:0/1609378131 conn(0x55e6d5bd2d70 msgr2=0x55e6d5c9fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:31.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.231+0000 7f0c11900b80 1 -- 172.21.15.92:0/1609378131 shutdown_connections 2023-10-16T13:13:31.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.231+0000 7f0c11900b80 1 -- 172.21.15.92:0/1609378131 wait complete. 2023-10-16T13:13:31.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.231+0000 7f0c11900b80 1 -- start start 2023-10-16T13:13:31.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.232+0000 7f0c11900b80 1 Processor -- start 2023-10-16T13:13:31.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.232+0000 7f0c11900b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca4850 0x55e6d5cae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:31.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.232+0000 7f0c11900b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca51b0 0x55e6d5caed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:31.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.232+0000 7f0c11900b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca60a0 0x55e6d5cb5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:31.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.232+0000 7f0c11900b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6d5bf7e10 con 0x55e6d5ca4850 2023-10-16T13:13:31.249 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.232+0000 7f0c11900b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6d5b946b0 con 0x55e6d5ca60a0 2023-10-16T13:13:31.249 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.232+0000 7f0c11900b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6d5b94350 con 0x55e6d5ca51b0 2023-10-16T13:13:31.249 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.232+0000 7f0c11900b80 10 client.0 _ll_register_callbacks cb 0x55e6d59f17a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:31.249 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.232+0000 7f0bfeffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca4850 0x55e6d5cae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:31.249 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.232+0000 7f0bfeffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca4850 0x55e6d5cae7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37072/0 (socket says 172.21.15.92:37072) 2023-10-16T13:13:31.250 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.232+0000 7f0bfeffd700 1 -- 172.21.15.92:0/4072137631 learned_addr learned my addr 172.21.15.92:0/4072137631 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:31.250 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.232+0000 7f0bff7fe700 1 --2- 172.21.15.92:0/4072137631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca60a0 0x55e6d5cb5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:31.250 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.232+0000 7f0bfe7fc700 1 --2- 172.21.15.92:0/4072137631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca51b0 0x55e6d5caed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:31.250 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.232+0000 7f0bfeffd700 1 -- 172.21.15.92:0/4072137631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca51b0 msgr2=0x55e6d5caed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:31.250 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.232+0000 7f0bfeffd700 1 --2- 172.21.15.92:0/4072137631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca51b0 0x55e6d5caed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.250 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.232+0000 7f0bfeffd700 1 -- 172.21.15.92:0/4072137631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca60a0 msgr2=0x55e6d5cb5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.232+0000 7f0bfeffd700 1 --2- 172.21.15.92:0/4072137631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca60a0 0x55e6d5cb5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.232+0000 7f0bfeffd700 1 -- 172.21.15.92:0/4072137631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0019f4e0 con 0x55e6d5ca4850 2023-10-16T13:13:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.232+0000 7f0bfe7fc700 1 --2- 172.21.15.92:0/4072137631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca51b0 0x55e6d5caed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.233+0000 7f0bfeffd700 1 --2- 172.21.15.92:0/4072137631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca4850 0x55e6d5cae7d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0003760 tx=0x7f0bf0009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5ead6c1c1d6710 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.233+0000 7f0be2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.233+0000 7f0be2ff5700 1 -- 172.21.15.92:0/4072137631 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000f660 con 0x55e6d5ca4850 2023-10-16T13:13:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.233+0000 7f0be2ff5700 1 -- 172.21.15.92:0/4072137631 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f0bf000f7c0 con 0x55e6d5ca4850 2023-10-16T13:13:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.233+0000 7f0c11900b80 1 -- 172.21.15.92:0/4072137631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e6d5bfce90 con 0x55e6d5ca4850 2023-10-16T13:13:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.233+0000 7f0be2ff5700 1 -- 172.21.15.92:0/4072137631 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bf000f980 con 0x55e6d5ca4850 2023-10-16T13:13:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.233+0000 7f0c11900b80 10 client.15480 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.233+0000 7f0c11900b80 1 -- 172.21.15.92:0/4072137631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e6d5a22d80 con 0x55e6d5ca4850 2023-10-16T13:13:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.233+0000 7f0be2ff5700 1 -- 172.21.15.92:0/4072137631 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55e6d5bfce90 con 0x55e6d5ca4850 2023-10-16T13:13:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.233+0000 7f0be2ff5700 1 -- 172.21.15.92:0/4072137631 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0bf0024cb0 con 0x55e6d5ca4850 2023-10-16T13:13:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.233+0000 7f0c11900b80 10 client.15480 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.233+0000 7f0c11900b80 10 client.15480 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-16T13:13:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.233+0000 7f0c11900b80 20 client.15480 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.233+0000 7f0c11900b80 1 --2- 172.21.15.92:0/4072137631 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e6d5cba5d0 0x55e6d5cbc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.233+0000 7f0c11900b80 4 client.15480 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:13:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.233+0000 7f0c11900b80 1 -- 172.21.15.92:0/4072137631 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e6d5c74bb0 con 0x55e6d5cba5d0 2023-10-16T13:13:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.233+0000 7f0bfe7fc700 1 --2- 172.21.15.92:0/4072137631 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e6d5cba5d0 0x55e6d5cbc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:31.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.234+0000 7f0be2ff5700 10 client.15480 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:31.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.234+0000 7f0bfe7fc700 1 --2- 172.21.15.92:0/4072137631 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e6d5cba5d0 0x55e6d5cbc9f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd942be51f4df07e server_cookie=966ae793af6a129e in_seq=0 out_seq=0 2023-10-16T13:13:31.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.234+0000 7f0be2ff5700 1 -- 172.21.15.92:0/4072137631 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e6d5c74bb0 con 0x55e6d5cba5d0 2023-10-16T13:13:31.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.234+0000 7f0be2ff5700 10 client.15480 handle_command_reply: tid=0 2023-10-16T13:13:31.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.235+0000 7f0c11900b80 1 client.15480 shutdown 2023-10-16T13:13:31.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.235+0000 7f0c11900b80 1 -- 172.21.15.92:0/4072137631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca4850 msgr2=0x55e6d5cae7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:31.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.235+0000 7f0c11900b80 1 --2- 172.21.15.92:0/4072137631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca4850 0x55e6d5cae7d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0003760 tx=0x7f0bf0009cd0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.235+0000 7f0c11900b80 1 -- 172.21.15.92:0/4072137631 shutdown_connections 2023-10-16T13:13:31.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.235+0000 7f0c11900b80 1 --2- 172.21.15.92:0/4072137631 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e6d5cba5d0 0x55e6d5cbc9f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.235+0000 7f0c11900b80 1 --2- 172.21.15.92:0/4072137631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca4850 0x55e6d5cae7d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.235+0000 7f0be2ff5700 0 client.15480 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.235+0000 7f0c11900b80 1 --2- 172.21.15.92:0/4072137631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca60a0 0x55e6d5cb5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.235+0000 7f0c11900b80 1 --2- 172.21.15.92:0/4072137631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca51b0 0x55e6d5caed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.235+0000 7f0c11900b80 1 -- 172.21.15.92:0/4072137631 >> 172.21.15.92:0/4072137631 conn(0x55e6d5bd2d70 msgr2=0x55e6d5c9f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.235+0000 7f0c11900b80 1 -- 172.21.15.92:0/4072137631 shutdown_connections 2023-10-16T13:13:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.235+0000 7f0c11900b80 1 -- 172.21.15.92:0/4072137631 wait complete. 2023-10-16T13:13:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.235+0000 7f0c11900b80 20 client.15480 trim_cache size 0 max 16384 2023-10-16T13:13:31.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.260+0000 7f0c11900b80 1 Processor -- start 2023-10-16T13:13:31.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.260+0000 7f0c11900b80 1 -- start start 2023-10-16T13:13:31.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.260+0000 7f0c11900b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca4850 0x55e6d5ca9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:31.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.260+0000 7f0c11900b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca51b0 0x55e6d5ca9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:31.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.260+0000 7f0c11900b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 0x55e6d5cb5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:31.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.260+0000 7f0c11900b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6d5a788c0 con 0x55e6d5ca60a0 2023-10-16T13:13:31.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.260+0000 7f0c11900b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6d5ca5f20 con 0x55e6d5ca51b0 2023-10-16T13:13:31.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.260+0000 7f0c11900b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6d5cadc80 con 0x55e6d5ca4850 2023-10-16T13:13:31.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.260+0000 7f0bff7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 0x55e6d5cb5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:31.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.260+0000 7f0bff7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 0x55e6d5cb5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37084/0 (socket says 172.21.15.92:37084) 2023-10-16T13:13:31.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.260+0000 7f0bff7fe700 1 -- 172.21.15.92:0/1394644073 learned_addr learned my addr 172.21.15.92:0/1394644073 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:31.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.260+0000 7f0bfe7fc700 1 --2- 172.21.15.92:0/1394644073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca51b0 0x55e6d5ca9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:31.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.260+0000 7f0bfeffd700 1 --2- 172.21.15.92:0/1394644073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca4850 0x55e6d5ca9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.260+0000 7f0bff7fe700 1 -- 172.21.15.92:0/1394644073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca4850 msgr2=0x55e6d5ca9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.260+0000 7f0bff7fe700 1 --2- 172.21.15.92:0/1394644073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca4850 0x55e6d5ca9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.260+0000 7f0bff7fe700 1 -- 172.21.15.92:0/1394644073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca51b0 msgr2=0x55e6d5ca9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.260+0000 7f0bff7fe700 1 --2- 172.21.15.92:0/1394644073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca51b0 0x55e6d5ca9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.260+0000 7f0bff7fe700 1 -- 172.21.15.92:0/1394644073 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6d5a0bc00 con 0x55e6d5ca60a0 2023-10-16T13:13:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.261+0000 7f0bfeffd700 1 --2- 172.21.15.92:0/1394644073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca4850 0x55e6d5ca9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.261+0000 7f0bff7fe700 1 --2- 172.21.15.92:0/1394644073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 0x55e6d5cb5d10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x55e6d5ca5880 tx=0x7f0bf8095ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd3e088ab257343 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.261+0000 7f0be5ffb700 1 -- 172.21.15.92:0/1394644073 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf80b90d0 con 0x55e6d5ca60a0 2023-10-16T13:13:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.261+0000 7f0be5ffb700 1 -- 172.21.15.92:0/1394644073 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0bf80b1070 con 0x55e6d5ca60a0 2023-10-16T13:13:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.261+0000 7f0be5ffb700 1 -- 172.21.15.92:0/1394644073 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8084050 con 0x55e6d5ca60a0 2023-10-16T13:13:31.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0c11900b80 1 -- 172.21.15.92:0/1394644073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 msgr2=0x55e6d5cb5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:31.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0c11900b80 1 --2- 172.21.15.92:0/1394644073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 0x55e6d5cb5d10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x55e6d5ca5880 tx=0x7f0bf8095ba0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0c11900b80 1 -- 172.21.15.92:0/1394644073 shutdown_connections 2023-10-16T13:13:31.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0c11900b80 1 --2- 172.21.15.92:0/1394644073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 0x55e6d5cb5d10 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0c11900b80 1 --2- 172.21.15.92:0/1394644073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca4850 0x55e6d5ca9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0c11900b80 1 --2- 172.21.15.92:0/1394644073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca51b0 0x55e6d5ca9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0c11900b80 1 -- 172.21.15.92:0/1394644073 >> 172.21.15.92:0/1394644073 conn(0x55e6d5bd2d70 msgr2=0x55e6d5cac4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0c11900b80 1 -- 172.21.15.92:0/1394644073 shutdown_connections 2023-10-16T13:13:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0c11900b80 1 -- 172.21.15.92:0/1394644073 wait complete. 2023-10-16T13:13:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0c11900b80 1 -- start start 2023-10-16T13:13:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0c11900b80 1 Processor -- start 2023-10-16T13:13:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0c11900b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca4850 0x55e6d5cb3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0c11900b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca51b0 0x55e6d5cb4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0c11900b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 0x55e6d5cb5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0c11900b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6d5cb5670 con 0x55e6d5ca60a0 2023-10-16T13:13:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0c11900b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6d5cb57e0 con 0x55e6d5ca4850 2023-10-16T13:13:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0c11900b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6d5cb59a0 con 0x55e6d5ca51b0 2023-10-16T13:13:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0c11900b80 10 client.0 _ll_register_callbacks cb 0x55e6d59f17a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0bff7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 0x55e6d5cb5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0bff7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 0x55e6d5cb5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37090/0 (socket says 172.21.15.92:37090) 2023-10-16T13:13:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0bff7fe700 1 -- 172.21.15.92:0/1177001282 learned_addr learned my addr 172.21.15.92:0/1177001282 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:31.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.262+0000 7f0bfeffd700 1 --2- 172.21.15.92:0/1177001282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca4850 0x55e6d5cb3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:31.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.263+0000 7f0bfe7fc700 1 --2- 172.21.15.92:0/1177001282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca51b0 0x55e6d5cb4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:31.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.263+0000 7f0bff7fe700 1 -- 172.21.15.92:0/1177001282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca51b0 msgr2=0x55e6d5cb4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:31.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.263+0000 7f0bff7fe700 1 --2- 172.21.15.92:0/1177001282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca51b0 0x55e6d5cb4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.263+0000 7f0bff7fe700 1 -- 172.21.15.92:0/1177001282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca4850 msgr2=0x55e6d5cb3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:31.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.263+0000 7f0bff7fe700 1 --2- 172.21.15.92:0/1177001282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca4850 0x55e6d5cb3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.263+0000 7f0bff7fe700 1 -- 172.21.15.92:0/1177001282 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e6d5bb5390 con 0x55e6d5ca60a0 2023-10-16T13:13:31.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.263+0000 7f0bff7fe700 1 --2- 172.21.15.92:0/1177001282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 0x55e6d5cb5130 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8004cf0 tx=0x7f0bf80c9f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5639796a55bff754 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:31.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.263+0000 7f0be2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:31.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.263+0000 7f0be2ff5700 1 -- 172.21.15.92:0/1177001282 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8022450 con 0x55e6d5ca60a0 2023-10-16T13:13:31.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.263+0000 7f0c11900b80 1 -- 172.21.15.92:0/1177001282 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0bf8099730 con 0x55e6d5ca60a0 2023-10-16T13:13:31.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.263+0000 7f0be2ff5700 1 -- 172.21.15.92:0/1177001282 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f0bf80a1ac0 con 0x55e6d5ca60a0 2023-10-16T13:13:31.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.263+0000 7f0be2ff5700 1 -- 172.21.15.92:0/1177001282 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bf8009400 con 0x55e6d5ca60a0 2023-10-16T13:13:31.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.263+0000 7f0c11900b80 10 client.15486 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:31.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.263+0000 7f0c11900b80 1 -- 172.21.15.92:0/1177001282 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e6d5a491f0 con 0x55e6d5ca60a0 2023-10-16T13:13:31.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.263+0000 7f0be2ff5700 1 -- 172.21.15.92:0/1177001282 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0bf8099730 con 0x55e6d5ca60a0 2023-10-16T13:13:31.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.264+0000 7f0be2ff5700 1 -- 172.21.15.92:0/1177001282 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0bf80a1630 con 0x55e6d5ca60a0 2023-10-16T13:13:31.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.264+0000 7f0c11900b80 10 client.15486 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:31.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.264+0000 7f0c11900b80 10 client.15486 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-16T13:13:31.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.264+0000 7f0c11900b80 20 client.15486 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:31.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.264+0000 7f0c11900b80 1 --2- 172.21.15.92:0/1177001282 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e6d5d0eeb0 0x55e6d5d112a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:31.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.264+0000 7f0c11900b80 4 client.15486 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-16T13:13:31.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.264+0000 7f0c11900b80 1 -- 172.21.15.92:0/1177001282 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e6d5bf0df0 con 0x55e6d5d0eeb0 2023-10-16T13:13:31.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.264+0000 7f0bfeffd700 1 --2- 172.21.15.92:0/1177001282 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e6d5d0eeb0 0x55e6d5d112a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:31.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.264+0000 7f0be2ff5700 10 client.15486 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:31.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.264+0000 7f0bfeffd700 1 --2- 172.21.15.92:0/1177001282 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e6d5d0eeb0 0x55e6d5d112a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=504a44ad369db9f6 server_cookie=2ff99f091a8a481c in_seq=0 out_seq=0 2023-10-16T13:13:31.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.276+0000 7f0be2ff5700 1 -- 172.21.15.92:0/1177001282 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e6d5bf0df0 con 0x55e6d5d0eeb0 2023-10-16T13:13:31.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.276+0000 7f0be2ff5700 10 client.15486 handle_command_reply: tid=0 2023-10-16T13:13:31.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.276+0000 7f0c11900b80 1 client.15486 shutdown 2023-10-16T13:13:31.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.276+0000 7f0c11900b80 1 -- 172.21.15.92:0/1177001282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 msgr2=0x55e6d5cb5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:31.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.276+0000 7f0c11900b80 1 --2- 172.21.15.92:0/1177001282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 0x55e6d5cb5130 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8004cf0 tx=0x7f0bf80c9f90 comp rx=0 tx=0).stop 2023-10-16T13:13:31.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.276+0000 7f0c11900b80 1 -- 172.21.15.92:0/1177001282 shutdown_connections 2023-10-16T13:13:31.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.276+0000 7f0c11900b80 1 --2- 172.21.15.92:0/1177001282 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e6d5d0eeb0 0x55e6d5d112a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.276+0000 7f0c11900b80 1 --2- 172.21.15.92:0/1177001282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6d5ca60a0 0x55e6d5cb5130 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.276+0000 7f0c11900b80 1 --2- 172.21.15.92:0/1177001282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6d5ca4850 0x55e6d5cb3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.276+0000 7f0be2ff5700 0 client.15486 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.276+0000 7f0c11900b80 1 --2- 172.21.15.92:0/1177001282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5ca51b0 0x55e6d5cb4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.276+0000 7f0c11900b80 1 -- 172.21.15.92:0/1177001282 >> 172.21.15.92:0/1177001282 conn(0x55e6d5bd2d70 msgr2=0x55e6d5ca9010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.276+0000 7f0c11900b80 1 -- 172.21.15.92:0/1177001282 shutdown_connections 2023-10-16T13:13:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.276+0000 7f0c11900b80 1 -- 172.21.15.92:0/1177001282 wait complete. 2023-10-16T13:13:31.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.276+0000 7f0c11900b80 20 client.15486 trim_cache size 0 max 16384 2023-10-16T13:13:31.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2023-10-16T13:13:31.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2023-10-16T13:13:31.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2023-10-16T13:13:31.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2023-10-16T13:13:31.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.276+0000 7f0c05716700 1 -- 172.21.15.92:0/3422240104 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0be80a1480 msgr2=0x7f0be80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.277+0000 7f0c05716700 1 --2- 172.21.15.92:0/3422240104 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0be80a1480 0x7f0be80a3940 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0c00196ad0 tx=0x7f0bf000b540 comp rx=0 tx=0).stop 2023-10-16T13:13:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.277+0000 7f0c05716700 1 -- 172.21.15.92:0/3422240104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c00101980 msgr2=0x7f0c00198060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.277+0000 7f0c05716700 1 --2- 172.21.15.92:0/3422240104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c00101980 0x7f0c00198060 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8007ee0 tx=0x7f0bf800d3b0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.277+0000 7f0c05716700 1 -- 172.21.15.92:0/3422240104 shutdown_connections 2023-10-16T13:13:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.277+0000 7f0c05716700 1 --2- 172.21.15.92:0/3422240104 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0be80a1480 0x7f0be80a3940 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.277+0000 7f0c05716700 1 --2- 172.21.15.92:0/3422240104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c00101980 0x7f0c00198060 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.277+0000 7f0c05716700 1 --2- 172.21.15.92:0/3422240104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c000ffdf0 0x7f0c00196d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.277+0000 7f0c05716700 1 --2- 172.21.15.92:0/3422240104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c00100fe0 0x7f0c001972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.277+0000 7f0c05716700 1 -- 172.21.15.92:0/3422240104 >> 172.21.15.92:0/3422240104 conn(0x7f0c000fb340 msgr2=0x7f0c000fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.277+0000 7f0c05716700 1 -- 172.21.15.92:0/3422240104 shutdown_connections 2023-10-16T13:13:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:31.277+0000 7f0c05716700 1 -- 172.21.15.92:0/3422240104 wait complete. 2023-10-16T13:13:32.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:32 smithi152 ceph-mon[104423]: pgmap v313: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 938 B/s wr, 12 op/s 2023-10-16T13:13:32.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:32 smithi092 ceph-mon[99542]: pgmap v313: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 938 B/s wr, 12 op/s 2023-10-16T13:13:32.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:32 smithi118 ceph-mon[103969]: pgmap v313: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 938 B/s wr, 12 op/s 2023-10-16T13:13:34.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:34 smithi152 ceph-mon[104423]: pgmap v314: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 9 op/s 2023-10-16T13:13:34.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:34 smithi092 ceph-mon[99542]: pgmap v314: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 9 op/s 2023-10-16T13:13:34.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:34 smithi118 ceph-mon[103969]: pgmap v314: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 9 op/s 2023-10-16T13:13:36.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:36 smithi152 ceph-mon[104423]: pgmap v315: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 12 op/s 2023-10-16T13:13:36.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:36 smithi092 ceph-mon[99542]: pgmap v315: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 12 op/s 2023-10-16T13:13:36.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:36 smithi118 ceph-mon[103969]: pgmap v315: 97 pgs: 97 active+clean; 651 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 12 op/s 2023-10-16T13:13:38.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:38 smithi152 ceph-mon[104423]: pgmap v316: 97 pgs: 97 active+clean; 652 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 15 op/s 2023-10-16T13:13:38.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:38 smithi092 ceph-mon[99542]: pgmap v316: 97 pgs: 97 active+clean; 652 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 15 op/s 2023-10-16T13:13:38.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:38 smithi118 ceph-mon[103969]: pgmap v316: 97 pgs: 97 active+clean; 652 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 15 op/s 2023-10-16T13:13:40.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:40 smithi152 ceph-mon[104423]: pgmap v317: 97 pgs: 97 active+clean; 652 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2023-10-16T13:13:40.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:40 smithi092 ceph-mon[99542]: pgmap v317: 97 pgs: 97 active+clean; 652 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2023-10-16T13:13:40.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:40 smithi118 ceph-mon[103969]: pgmap v317: 97 pgs: 97 active+clean; 652 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2023-10-16T13:13:42.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:42 smithi152 ceph-mon[104423]: pgmap v318: 97 pgs: 97 active+clean; 652 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 15 op/s 2023-10-16T13:13:42.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:42 smithi092 ceph-mon[99542]: pgmap v318: 97 pgs: 97 active+clean; 652 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 15 op/s 2023-10-16T13:13:42.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:42 smithi118 ceph-mon[103969]: pgmap v318: 97 pgs: 97 active+clean; 652 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 15 op/s 2023-10-16T13:13:43.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:43 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:13:43.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:43 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:13:43.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:43 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:13:44.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.445+0000 7fc0801b4700 1 -- 172.21.15.92:0/1701879322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0780ff570 msgr2=0x7fc0780ff990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.445+0000 7fc0801b4700 1 --2- 172.21.15.92:0/1701879322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0780ff570 0x7fc0780ff990 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc0740099c0 tx=0x7fc074009cd0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.445+0000 7fc0801b4700 1 -- 172.21.15.92:0/1701879322 shutdown_connections 2023-10-16T13:13:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.445+0000 7fc0801b4700 1 --2- 172.21.15.92:0/1701879322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0780ff570 0x7fc0780ff990 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.445+0000 7fc0801b4700 1 --2- 172.21.15.92:0/1701879322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc078101100 0x7fc0781079b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.445+0000 7fc0801b4700 1 --2- 172.21.15.92:0/1701879322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc078100760 0x7fc078100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.445+0000 7fc0801b4700 1 -- 172.21.15.92:0/1701879322 >> 172.21.15.92:0/1701879322 conn(0x7fc0780faac0 msgr2=0x7fc0780fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:44.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.445+0000 7fc0801b4700 1 -- 172.21.15.92:0/1701879322 shutdown_connections 2023-10-16T13:13:44.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.446+0000 7fc0801b4700 1 -- 172.21.15.92:0/1701879322 wait complete. 2023-10-16T13:13:44.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.446+0000 7fc0801b4700 1 Processor -- start 2023-10-16T13:13:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.446+0000 7fc0801b4700 1 -- start start 2023-10-16T13:13:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.447+0000 7fc0801b4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0780ff570 0x7fc078194da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.447+0000 7fc0801b4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc078100760 0x7fc0781952e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.447+0000 7fc0801b4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc078101100 0x7fc078196080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.447+0000 7fc0801b4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc078196790 con 0x7fc0780ff570 2023-10-16T13:13:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.447+0000 7fc0801b4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc078196900 con 0x7fc078101100 2023-10-16T13:13:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.447+0000 7fc0801b4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc078196ac0 con 0x7fc078100760 2023-10-16T13:13:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.447+0000 7fc07df50700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0780ff570 0x7fc078194da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.447+0000 7fc07df50700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0780ff570 0x7fc078194da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37100/0 (socket says 172.21.15.92:37100) 2023-10-16T13:13:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.447+0000 7fc07df50700 1 -- 172.21.15.92:0/1939699083 learned_addr learned my addr 172.21.15.92:0/1939699083 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.447+0000 7fc07d74f700 1 --2- 172.21.15.92:0/1939699083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc078100760 0x7fc0781952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.447+0000 7fc07e751700 1 --2- 172.21.15.92:0/1939699083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc078101100 0x7fc078196080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.447+0000 7fc07df50700 1 -- 172.21.15.92:0/1939699083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc078100760 msgr2=0x7fc0781952e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.447+0000 7fc07df50700 1 --2- 172.21.15.92:0/1939699083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc078100760 0x7fc0781952e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.447+0000 7fc07df50700 1 -- 172.21.15.92:0/1939699083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc078101100 msgr2=0x7fc078196080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.447+0000 7fc07df50700 1 --2- 172.21.15.92:0/1939699083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc078101100 0x7fc078196080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.447+0000 7fc07df50700 1 -- 172.21.15.92:0/1939699083 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0740095f0 con 0x7fc0780ff570 2023-10-16T13:13:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.447+0000 7fc07d74f700 1 --2- 172.21.15.92:0/1939699083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc078100760 0x7fc0781952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:13:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.447+0000 7fc07e751700 1 --2- 172.21.15.92:0/1939699083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc078101100 0x7fc078196080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:13:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.447+0000 7fc07df50700 1 --2- 172.21.15.92:0/1939699083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0780ff570 0x7fc078194da0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc0740098e0 tx=0x7fc07400dc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.448+0000 7fc06effd700 1 -- 172.21.15.92:0/1939699083 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074003f90 con 0x7fc0780ff570 2023-10-16T13:13:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.448+0000 7fc0801b4700 1 -- 172.21.15.92:0/1939699083 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc078196d40 con 0x7fc0780ff570 2023-10-16T13:13:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.448+0000 7fc0801b4700 1 -- 172.21.15.92:0/1939699083 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07819d4b0 con 0x7fc0780ff570 2023-10-16T13:13:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.448+0000 7fc06effd700 1 -- 172.21.15.92:0/1939699083 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc0740059e0 con 0x7fc0780ff570 2023-10-16T13:13:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.448+0000 7fc06effd700 1 -- 172.21.15.92:0/1939699083 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074005620 con 0x7fc0780ff570 2023-10-16T13:13:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.451+0000 7fc06effd700 1 -- 172.21.15.92:0/1939699083 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fc0740040f0 con 0x7fc0780ff570 2023-10-16T13:13:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.452+0000 7fc06effd700 1 --2- 172.21.15.92:0/1939699083 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc0640a1500 0x7fc0640a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.452+0000 7fc06effd700 1 -- 172.21.15.92:0/1939699083 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc0740cd360 con 0x7fc0780ff570 2023-10-16T13:13:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.452+0000 7fc08c39eb80 1 Processor -- start 2023-10-16T13:13:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.453+0000 7fc08c39eb80 1 -- start start 2023-10-16T13:13:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.453+0000 7fc08c39eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd69f850 0x556ebd69fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.453+0000 7fc08c39eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd6a01b0 0x556ebd6a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.453+0000 7fc08c39eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd6a10a0 0x556ebd6a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.453+0000 7fc08c39eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebd614c10 con 0x556ebd6a10a0 2023-10-16T13:13:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.453+0000 7fc08c39eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebd5f9c00 con 0x556ebd6a01b0 2023-10-16T13:13:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.453+0000 7fc08c39eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebd5f7520 con 0x556ebd69f850 2023-10-16T13:13:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.453+0000 7fc07d74f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd6a01b0 0x556ebd6a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.453+0000 7fc07e751700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd6a10a0 0x556ebd6a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.453+0000 7fc07d74f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd6a01b0 0x556ebd6a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:37918/0 (socket says 172.21.15.92:37918) 2023-10-16T13:13:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.453+0000 7fc07d74f700 1 -- 172.21.15.92:0/3030100522 learned_addr learned my addr 172.21.15.92:0/3030100522 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.453+0000 7fc07df50700 1 --2- 172.21.15.92:0/3030100522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd69f850 0x556ebd69fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.453+0000 7fc07e751700 1 -- 172.21.15.92:0/3030100522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd69f850 msgr2=0x556ebd69fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.453+0000 7fc07e751700 1 --2- 172.21.15.92:0/3030100522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd69f850 0x556ebd69fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.453+0000 7fc07e751700 1 -- 172.21.15.92:0/3030100522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd6a01b0 msgr2=0x556ebd6a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.453+0000 7fc07e751700 1 --2- 172.21.15.92:0/3030100522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd6a01b0 0x556ebd6a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.453+0000 7fc07e751700 1 -- 172.21.15.92:0/3030100522 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ebd5b0390 con 0x556ebd6a10a0 2023-10-16T13:13:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.453+0000 7fc07df50700 1 --2- 172.21.15.92:0/3030100522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd69f850 0x556ebd69fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:13:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.453+0000 7fc07d74f700 1 --2- 172.21.15.92:0/3030100522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd6a01b0 0x556ebd6a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:13:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.454+0000 7fc07e751700 1 --2- 172.21.15.92:0/3030100522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd6a10a0 0x556ebd6a1520 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc070004090 tx=0x7fc07000a980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ca56eb80fafef9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.454+0000 7fc063fff700 1 -- 172.21.15.92:0/3030100522 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07000f040 con 0x556ebd6a10a0 2023-10-16T13:13:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.454+0000 7fc063fff700 1 -- 172.21.15.92:0/3030100522 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc07000a4e0 con 0x556ebd6a10a0 2023-10-16T13:13:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.454+0000 7fc063fff700 1 -- 172.21.15.92:0/3030100522 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070015940 con 0x556ebd6a10a0 2023-10-16T13:13:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.455+0000 7fc07d74f700 1 --2- 172.21.15.92:0/1939699083 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc0640a1500 0x7fc0640a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.455+0000 7fc08c39eb80 1 -- 172.21.15.92:0/3030100522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd6a10a0 msgr2=0x556ebd6a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.455+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/3030100522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd6a10a0 0x556ebd6a1520 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc070004090 tx=0x7fc07000a980 comp rx=0 tx=0).stop 2023-10-16T13:13:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.455+0000 7fc08c39eb80 1 -- 172.21.15.92:0/3030100522 shutdown_connections 2023-10-16T13:13:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.455+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/3030100522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd6a10a0 0x556ebd6a1520 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.455+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/3030100522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd69f850 0x556ebd69fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.455+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/3030100522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd6a01b0 0x556ebd6a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.455+0000 7fc08c39eb80 1 -- 172.21.15.92:0/3030100522 >> 172.21.15.92:0/3030100522 conn(0x556ebd5cdd70 msgr2=0x556ebd69ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.455+0000 7fc07d74f700 1 --2- 172.21.15.92:0/1939699083 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc0640a1500 0x7fc0640a39c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc068009a30 tx=0x7fc0680047c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.456+0000 7fc08c39eb80 1 -- 172.21.15.92:0/3030100522 shutdown_connections 2023-10-16T13:13:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.456+0000 7fc08c39eb80 1 -- 172.21.15.92:0/3030100522 wait complete. 2023-10-16T13:13:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.456+0000 7fc08c39eb80 1 -- start start 2023-10-16T13:13:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.456+0000 7fc08c39eb80 1 Processor -- start 2023-10-16T13:13:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc08c39eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd69f850 0x556ebd6a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc08c39eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd6a01b0 0x556ebd6a9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc08c39eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd6a10a0 0x556ebd6b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc08c39eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebd5f2e10 con 0x556ebd6a01b0 2023-10-16T13:13:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc08c39eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebd58f6b0 con 0x556ebd69f850 2023-10-16T13:13:44.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc08c39eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebd58f350 con 0x556ebd6a10a0 2023-10-16T13:13:44.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc08c39eb80 10 client.0 _ll_register_callbacks cb 0x556ebd3ec7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:44.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc07df50700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd69f850 0x556ebd6a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:44.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc07df50700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd69f850 0x556ebd6a96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:37922/0 (socket says 172.21.15.92:37922) 2023-10-16T13:13:44.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc07df50700 1 -- 172.21.15.92:0/4074828374 learned_addr learned my addr 172.21.15.92:0/4074828374 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:44.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc07e751700 1 --2- 172.21.15.92:0/4074828374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd6a10a0 0x556ebd6b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:44.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc07d74f700 1 --2- 172.21.15.92:0/4074828374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd6a01b0 0x556ebd6a9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:44.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc07e751700 1 -- 172.21.15.92:0/4074828374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd69f850 msgr2=0x556ebd6a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:44.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc07e751700 1 --2- 172.21.15.92:0/4074828374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd69f850 0x556ebd6a96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc07e751700 1 -- 172.21.15.92:0/4074828374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd6a01b0 msgr2=0x556ebd6a9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:44.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc07e751700 1 --2- 172.21.15.92:0/4074828374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd6a01b0 0x556ebd6a9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc07e751700 1 -- 172.21.15.92:0/4074828374 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc068017040 con 0x556ebd6a10a0 2023-10-16T13:13:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc07df50700 1 --2- 172.21.15.92:0/4074828374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd69f850 0x556ebd6a96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:13:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc07e751700 1 --2- 172.21.15.92:0/4074828374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd6a10a0 0x556ebd6b0c50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc070008500 tx=0x7fc0700088c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f46a12b2ee43acf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.457+0000 7fc0617fa700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-10-16T13:13:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.458+0000 7fc0617fa700 1 -- 172.21.15.92:0/4074828374 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070004e20 con 0x556ebd6a10a0 2023-10-16T13:13:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.458+0000 7fc0617fa700 1 -- 172.21.15.92:0/4074828374 <== mon.1 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc07000f030 con 0x556ebd6a10a0 2023-10-16T13:13:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.458+0000 7fc08c39eb80 1 -- 172.21.15.92:0/4074828374 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556ebd5f7e90 con 0x556ebd6a10a0 2023-10-16T13:13:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.458+0000 7fc0617fa700 1 -- 172.21.15.92:0/4074828374 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc070008cc0 con 0x556ebd6a10a0 2023-10-16T13:13:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.458+0000 7fc08c39eb80 10 client.25054 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.458+0000 7fc08c39eb80 1 -- 172.21.15.92:0/4074828374 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fc070003dd0 con 0x556ebd6a10a0 2023-10-16T13:13:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.458+0000 7fc0617fa700 1 -- 172.21.15.92:0/4074828374 <== mon.1 v2:172.21.15.152:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x556ebd5f7e90 con 0x556ebd6a10a0 2023-10-16T13:13:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.458+0000 7fc0617fa700 1 -- 172.21.15.92:0/4074828374 <== mon.1 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc070005560 con 0x556ebd6a10a0 2023-10-16T13:13:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.458+0000 7fc08c39eb80 10 client.25054 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.458+0000 7fc08c39eb80 10 client.25054 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-16T13:13:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.458+0000 7fc08c39eb80 20 client.25054 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.458+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/4074828374 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x556ebd6b54a0 0x556ebd6b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.458+0000 7fc08c39eb80 4 client.25054 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:13:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.458+0000 7fc08c39eb80 1 -- 172.21.15.92:0/4074828374 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556ebd66fbb0 con 0x556ebd6b54a0 2023-10-16T13:13:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.459+0000 7fc07df50700 1 --2- 172.21.15.92:0/4074828374 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x556ebd6b54a0 0x556ebd6b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.459+0000 7fc0617fa700 10 client.25054 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.459+0000 7fc07df50700 1 --2- 172.21.15.92:0/4074828374 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x556ebd6b54a0 0x556ebd6b78c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d8ef71b93c8dd32 server_cookie=75d896686594b4d5 in_seq=0 out_seq=0 2023-10-16T13:13:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.460+0000 7fc0617fa700 1 -- 172.21.15.92:0/4074828374 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x7fc0740b8730 con 0x556ebd6b54a0 2023-10-16T13:13:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.460+0000 7fc0617fa700 10 client.25054 handle_command_reply: tid=0 2023-10-16T13:13:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.460+0000 7fc08c39eb80 1 client.25054 shutdown 2023-10-16T13:13:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.460+0000 7fc08c39eb80 1 -- 172.21.15.92:0/4074828374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd6a10a0 msgr2=0x556ebd6b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.460+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/4074828374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd6a10a0 0x556ebd6b0c50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc070008500 tx=0x7fc0700088c0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.460+0000 7fc08c39eb80 1 -- 172.21.15.92:0/4074828374 shutdown_connections 2023-10-16T13:13:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.460+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/4074828374 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x556ebd6b54a0 0x556ebd6b78c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.460+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/4074828374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd6a10a0 0x556ebd6b0c50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.460+0000 7fc0617fa700 0 client.25054 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.460+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/4074828374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd69f850 0x556ebd6a96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.460+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/4074828374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd6a01b0 0x556ebd6a9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.460+0000 7fc08c39eb80 1 -- 172.21.15.92:0/4074828374 >> 172.21.15.92:0/4074828374 conn(0x556ebd5cdd70 msgr2=0x556ebd69a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.460+0000 7fc08c39eb80 1 -- 172.21.15.92:0/4074828374 shutdown_connections 2023-10-16T13:13:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.460+0000 7fc08c39eb80 1 -- 172.21.15.92:0/4074828374 wait complete. 2023-10-16T13:13:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.460+0000 7fc08c39eb80 20 client.25054 trim_cache size 0 max 16384 2023-10-16T13:13:44.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.488+0000 7fc08c39eb80 1 Processor -- start 2023-10-16T13:13:44.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.488+0000 7fc08c39eb80 1 -- start start 2023-10-16T13:13:44.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.488+0000 7fc08c39eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd69f850 0x556ebd69fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:44.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.488+0000 7fc08c39eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd6a01b0 0x556ebd6b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:44.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.488+0000 7fc08c39eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd6a10a0 0x556ebd6a7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:44.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.488+0000 7fc08c39eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebd4738c0 con 0x556ebd69f850 2023-10-16T13:13:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.488+0000 7fc08c39eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebd5f7e90 con 0x556ebd6a01b0 2023-10-16T13:13:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.488+0000 7fc08c39eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebd6a0f20 con 0x556ebd6a10a0 2023-10-16T13:13:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.488+0000 7fc07df50700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd69f850 0x556ebd69fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.488+0000 7fc07df50700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd69f850 0x556ebd69fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37122/0 (socket says 172.21.15.92:37122) 2023-10-16T13:13:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.488+0000 7fc07df50700 1 -- 172.21.15.92:0/2965440376 learned_addr learned my addr 172.21.15.92:0/2965440376 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.488+0000 7fc07e751700 1 --2- 172.21.15.92:0/2965440376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd6a10a0 0x556ebd6a7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:44.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.489+0000 7fc07e751700 1 -- 172.21.15.92:0/2965440376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd6a01b0 msgr2=0x556ebd6b0c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T13:13:44.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.489+0000 7fc07e751700 1 --2- 172.21.15.92:0/2965440376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd6a01b0 0x556ebd6b0c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.489+0000 7fc07e751700 1 -- 172.21.15.92:0/2965440376 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd69f850 msgr2=0x556ebd69fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:44.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.489+0000 7fc07e751700 1 --2- 172.21.15.92:0/2965440376 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd69f850 0x556ebd69fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.489+0000 7fc07e751700 1 -- 172.21.15.92:0/2965440376 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ebd41dd80 con 0x556ebd6a10a0 2023-10-16T13:13:44.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.489+0000 7fc07df50700 1 --2- 172.21.15.92:0/2965440376 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd69f850 0x556ebd69fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:13:44.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.489+0000 7fc07e751700 1 --2- 172.21.15.92:0/2965440376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd6a10a0 0x556ebd6a7430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc070005890 tx=0x7fc07000a980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d55e0be4cd4c1e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:44.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.489+0000 7fc06cff9700 1 -- 172.21.15.92:0/2965440376 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07001e420 con 0x556ebd6a10a0 2023-10-16T13:13:44.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.489+0000 7fc06cff9700 1 -- 172.21.15.92:0/2965440376 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc070008cc0 con 0x556ebd6a10a0 2023-10-16T13:13:44.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.489+0000 7fc06cff9700 1 -- 172.21.15.92:0/2965440376 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0700052a0 con 0x556ebd6a10a0 2023-10-16T13:13:44.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.490+0000 7fc08c39eb80 1 -- 172.21.15.92:0/2965440376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd6a10a0 msgr2=0x556ebd6a7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:44.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.490+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/2965440376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd6a10a0 0x556ebd6a7430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc070005890 tx=0x7fc07000a980 comp rx=0 tx=0).stop 2023-10-16T13:13:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.490+0000 7fc08c39eb80 1 -- 172.21.15.92:0/2965440376 shutdown_connections 2023-10-16T13:13:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.490+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/2965440376 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd69f850 0x556ebd69fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.490+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/2965440376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd6a10a0 0x556ebd6a7430 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.490+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/2965440376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd6a01b0 0x556ebd6b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.490+0000 7fc08c39eb80 1 -- 172.21.15.92:0/2965440376 >> 172.21.15.92:0/2965440376 conn(0x556ebd5cdd70 msgr2=0x556ebd6a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.493+0000 7fc08c39eb80 1 -- 172.21.15.92:0/2965440376 shutdown_connections 2023-10-16T13:13:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.493+0000 7fc08c39eb80 1 -- 172.21.15.92:0/2965440376 wait complete. 2023-10-16T13:13:44.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.494+0000 7fc08c39eb80 1 -- start start 2023-10-16T13:13:44.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.494+0000 7fc08c39eb80 1 Processor -- start 2023-10-16T13:13:44.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.495+0000 7fc08c39eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd69f850 0x556ebd6ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:44.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.495+0000 7fc08c39eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd6a10a0 0x556ebd6ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.495+0000 7fc08c39eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd6afa10 0x556ebd6afe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.495+0000 7fc08c39eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebd6b03d0 con 0x556ebd6a10a0 2023-10-16T13:13:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.495+0000 7fc08c39eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebd6b0540 con 0x556ebd6afa10 2023-10-16T13:13:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.495+0000 7fc08c39eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebd6b0700 con 0x556ebd69f850 2023-10-16T13:13:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.495+0000 7fc08c39eb80 10 client.0 _ll_register_callbacks cb 0x7fc06800fed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.496+0000 7fc07d74f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd6a10a0 0x556ebd6ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.496+0000 7fc07d74f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd6a10a0 0x556ebd6ac9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37128/0 (socket says 172.21.15.92:37128) 2023-10-16T13:13:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.496+0000 7fc07d74f700 1 -- 172.21.15.92:0/4233946011 learned_addr learned my addr 172.21.15.92:0/4233946011 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.496+0000 7fc07df50700 1 --2- 172.21.15.92:0/4233946011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd69f850 0x556ebd6ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.496+0000 7fc07e751700 1 --2- 172.21.15.92:0/4233946011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd6afa10 0x556ebd6afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.496+0000 7fc07df50700 1 -- 172.21.15.92:0/4233946011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd6afa10 msgr2=0x556ebd6afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.496+0000 7fc07df50700 1 --2- 172.21.15.92:0/4233946011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd6afa10 0x556ebd6afe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.496+0000 7fc07df50700 1 -- 172.21.15.92:0/4233946011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd6a10a0 msgr2=0x556ebd6ac9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.496+0000 7fc07df50700 1 --2- 172.21.15.92:0/4233946011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd6a10a0 0x556ebd6ac9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.496+0000 7fc07df50700 1 -- 172.21.15.92:0/4233946011 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc078196d40 con 0x556ebd69f850 2023-10-16T13:13:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.496+0000 7fc07df50700 1 --2- 172.21.15.92:0/4233946011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd69f850 0x556ebd6ac4b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc074097130 tx=0x7fc074085040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5190da543399728b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:44.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.503+0000 7fc0617fa700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-10-16T13:13:44.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.503+0000 7fc0617fa700 1 -- 172.21.15.92:0/4233946011 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07409a710 con 0x556ebd69f850 2023-10-16T13:13:44.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.503+0000 7fc0617fa700 1 -- 172.21.15.92:0/4233946011 <== mon.1 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc07409e860 con 0x556ebd69f850 2023-10-16T13:13:44.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.503+0000 7fc08c39eb80 1 -- 172.21.15.92:0/4233946011 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc07000a4e0 con 0x556ebd69f850 2023-10-16T13:13:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.506+0000 7fc0617fa700 1 -- 172.21.15.92:0/4233946011 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0740a2a10 con 0x556ebd69f850 2023-10-16T13:13:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.506+0000 7fc08c39eb80 10 client.25060 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.506+0000 7fc08c39eb80 1 -- 172.21.15.92:0/4233946011 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fc070003dd0 con 0x556ebd69f850 2023-10-16T13:13:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.506+0000 7fc0617fa700 1 -- 172.21.15.92:0/4233946011 <== mon.1 v2:172.21.15.152:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc074080030 con 0x556ebd69f850 2023-10-16T13:13:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.506+0000 7fc0617fa700 1 -- 172.21.15.92:0/4233946011 <== mon.1 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc0740a2580 con 0x556ebd69f850 2023-10-16T13:13:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.506+0000 7fc08c39eb80 10 client.25060 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.506+0000 7fc08c39eb80 10 client.25060 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-16T13:13:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.506+0000 7fc08c39eb80 20 client.25060 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.506+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/4233946011 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x556ebd7237a0 0x556ebd725bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.506+0000 7fc08c39eb80 4 client.25060 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-16T13:13:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.506+0000 7fc08c39eb80 1 -- 172.21.15.92:0/4233946011 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556ebd5ebdf0 con 0x556ebd7237a0 2023-10-16T13:13:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.507+0000 7fc07d74f700 1 --2- 172.21.15.92:0/4233946011 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x556ebd7237a0 0x556ebd725bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.508+0000 7fc0617fa700 10 client.25060 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.508+0000 7fc07d74f700 1 --2- 172.21.15.92:0/4233946011 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x556ebd7237a0 0x556ebd725bc0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc6f898b0ba2b1a8 server_cookie=20c6b51b281dcfb9 in_seq=0 out_seq=0 2023-10-16T13:13:44.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.511+0000 7fc0617fa700 1 -- 172.21.15.92:0/4233946011 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556ebd5ebdf0 con 0x556ebd7237a0 2023-10-16T13:13:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.511+0000 7fc0617fa700 10 client.25060 handle_command_reply: tid=0 2023-10-16T13:13:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.511+0000 7fc08c39eb80 1 client.25060 shutdown 2023-10-16T13:13:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.511+0000 7fc08c39eb80 1 -- 172.21.15.92:0/4233946011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd69f850 msgr2=0x556ebd6ac4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.511+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/4233946011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd69f850 0x556ebd6ac4b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc074097130 tx=0x7fc074085040 comp rx=0 tx=0).stop 2023-10-16T13:13:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.511+0000 7fc08c39eb80 1 -- 172.21.15.92:0/4233946011 shutdown_connections 2023-10-16T13:13:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.511+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/4233946011 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x556ebd7237a0 0x556ebd725bc0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.511+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/4233946011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556ebd6afa10 0x556ebd6afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.511+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/4233946011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ebd69f850 0x556ebd6ac4b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.511+0000 7fc08c39eb80 1 --2- 172.21.15.92:0/4233946011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ebd6a10a0 0x556ebd6ac9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.511+0000 7fc08c39eb80 1 -- 172.21.15.92:0/4233946011 >> 172.21.15.92:0/4233946011 conn(0x556ebd5cdd70 msgr2=0x556ebd6a7430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:44.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.511+0000 7fc0617fa700 0 client.25060 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:44.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.512+0000 7fc08c39eb80 1 -- 172.21.15.92:0/4233946011 shutdown_connections 2023-10-16T13:13:44.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.512+0000 7fc08c39eb80 1 -- 172.21.15.92:0/4233946011 wait complete. 2023-10-16T13:13:44.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.512+0000 7fc08c39eb80 20 client.25060 trim_cache size 0 max 16384 2023-10-16T13:13:44.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2023-10-16T13:13:44.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2023-10-16T13:13:44.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2023-10-16T13:13:44.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2023-10-16T13:13:44.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.512+0000 7fc0801b4700 1 -- 172.21.15.92:0/1939699083 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc0640a1500 msgr2=0x7fc0640a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.512+0000 7fc0801b4700 1 --2- 172.21.15.92:0/1939699083 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc0640a1500 0x7fc0640a39c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc068009a30 tx=0x7fc0680047c0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.512+0000 7fc0801b4700 1 -- 172.21.15.92:0/1939699083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0780ff570 msgr2=0x7fc078194da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.512+0000 7fc0801b4700 1 --2- 172.21.15.92:0/1939699083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0780ff570 0x7fc078194da0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc0740098e0 tx=0x7fc07400dc50 comp rx=0 tx=0).stop 2023-10-16T13:13:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.513+0000 7fc0801b4700 1 -- 172.21.15.92:0/1939699083 shutdown_connections 2023-10-16T13:13:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.513+0000 7fc0801b4700 1 --2- 172.21.15.92:0/1939699083 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fc0640a1500 0x7fc0640a39c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.513+0000 7fc0801b4700 1 --2- 172.21.15.92:0/1939699083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0780ff570 0x7fc078194da0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.513+0000 7fc0801b4700 1 --2- 172.21.15.92:0/1939699083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc078101100 0x7fc078196080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.513+0000 7fc0801b4700 1 --2- 172.21.15.92:0/1939699083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc078100760 0x7fc0781952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.513+0000 7fc0801b4700 1 -- 172.21.15.92:0/1939699083 >> 172.21.15.92:0/1939699083 conn(0x7fc0780faac0 msgr2=0x7fc0780fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.513+0000 7fc0801b4700 1 -- 172.21.15.92:0/1939699083 shutdown_connections 2023-10-16T13:13:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:44.513+0000 7fc0801b4700 1 -- 172.21.15.92:0/1939699083 wait complete. 2023-10-16T13:13:44.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:44 smithi152 ceph-mon[104423]: pgmap v319: 97 pgs: 97 active+clean; 652 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2023-10-16T13:13:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:44 smithi092 ceph-mon[99542]: pgmap v319: 97 pgs: 97 active+clean; 652 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2023-10-16T13:13:44.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:44 smithi118 ceph-mon[103969]: pgmap v319: 97 pgs: 97 active+clean; 652 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2023-10-16T13:13:46.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:46 smithi152 ceph-mon[104423]: pgmap v320: 97 pgs: 97 active+clean; 652 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-10-16T13:13:46.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:46.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:46.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:46.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:46 smithi092 ceph-mon[99542]: pgmap v320: 97 pgs: 97 active+clean; 652 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-10-16T13:13:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:46.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:46.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:46 smithi118 ceph-mon[103969]: pgmap v320: 97 pgs: 97 active+clean; 652 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-10-16T13:13:46.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:46.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:46.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:46.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:47.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:47 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:47.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:47 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:47.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:47 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:13:47.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:47 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:13:47.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:47 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:47.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:47.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:47.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:13:47.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:13:47.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:47.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:47 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:47.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:47 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:47.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:47 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:13:47.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:47 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:13:47.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:47 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:13:48.534 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-16T13:13:48.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.686+0000 7f638706f700 1 -- 172.21.15.92:0/180902109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6380102af0 msgr2=0x7f63801093a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:48.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.686+0000 7f638706f700 1 --2- 172.21.15.92:0/180902109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6380102af0 0x7f63801093a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f637800b0a0 tx=0x7f637800b3b0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.686+0000 7f638706f700 1 -- 172.21.15.92:0/180902109 shutdown_connections 2023-10-16T13:13:48.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.686+0000 7f638706f700 1 --2- 172.21.15.92:0/180902109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6380102af0 0x7f63801093a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.686+0000 7f638706f700 1 --2- 172.21.15.92:0/180902109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63800ff180 0x7f63800ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.686+0000 7f638706f700 1 --2- 172.21.15.92:0/180902109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6380102150 0x7f63801025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.686+0000 7f638706f700 1 -- 172.21.15.92:0/180902109 >> 172.21.15.92:0/180902109 conn(0x7f63800faa90 msgr2=0x7f63800fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:48.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.686+0000 7f638706f700 1 -- 172.21.15.92:0/180902109 shutdown_connections 2023-10-16T13:13:48.691 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.686+0000 7f638706f700 1 -- 172.21.15.92:0/180902109 wait complete. 2023-10-16T13:13:48.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.687+0000 7f638706f700 1 Processor -- start 2023-10-16T13:13:48.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.687+0000 7f638706f700 1 -- start start 2023-10-16T13:13:48.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.687+0000 7f638706f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63800ff180 0x7f6380101ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.687+0000 7f638706f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6380102150 0x7f6380100100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.687+0000 7f638706f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6380102af0 0x7f6380100640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.687+0000 7f638706f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6380100de0 con 0x7f63800ff180 2023-10-16T13:13:48.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.687+0000 7f638706f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6380100f50 con 0x7f6380102150 2023-10-16T13:13:48.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.687+0000 7f638706f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63801a0c40 con 0x7f6380102af0 2023-10-16T13:13:48.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.687+0000 7f6384e0b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63800ff180 0x7f6380101ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.687+0000 7f6384e0b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63800ff180 0x7f6380101ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37140/0 (socket says 172.21.15.92:37140) 2023-10-16T13:13:48.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.687+0000 7f6384e0b700 1 -- 172.21.15.92:0/3342038879 learned_addr learned my addr 172.21.15.92:0/3342038879 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:48.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.687+0000 7f637ffff700 1 --2- 172.21.15.92:0/3342038879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6380102150 0x7f6380100100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.687+0000 7f638560c700 1 --2- 172.21.15.92:0/3342038879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6380102af0 0x7f6380100640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.687+0000 7f6384e0b700 1 -- 172.21.15.92:0/3342038879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6380102af0 msgr2=0x7f6380100640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:48.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.687+0000 7f6384e0b700 1 --2- 172.21.15.92:0/3342038879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6380102af0 0x7f6380100640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.687+0000 7f6384e0b700 1 -- 172.21.15.92:0/3342038879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6380102150 msgr2=0x7f6380100100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:48.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.687+0000 7f6384e0b700 1 --2- 172.21.15.92:0/3342038879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6380102150 0x7f6380100100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.687+0000 7f6384e0b700 1 -- 172.21.15.92:0/3342038879 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6378009d00 con 0x7f63800ff180 2023-10-16T13:13:48.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.688+0000 7f6384e0b700 1 --2- 172.21.15.92:0/3342038879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63800ff180 0x7f6380101ac0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f637400d980 tx=0x7f637400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:48.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.688+0000 7f637dffb700 1 -- 172.21.15.92:0/3342038879 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374004020 con 0x7f63800ff180 2023-10-16T13:13:48.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.688+0000 7f638706f700 1 -- 172.21.15.92:0/3342038879 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63801a0f20 con 0x7f63800ff180 2023-10-16T13:13:48.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.688+0000 7f637dffb700 1 -- 172.21.15.92:0/3342038879 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6374009730 con 0x7f63800ff180 2023-10-16T13:13:48.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.688+0000 7f637dffb700 1 -- 172.21.15.92:0/3342038879 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374003be0 con 0x7f63800ff180 2023-10-16T13:13:48.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.688+0000 7f638706f700 1 -- 172.21.15.92:0/3342038879 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63801a13a0 con 0x7f63800ff180 2023-10-16T13:13:48.698 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:48 smithi152 ceph-mon[104423]: pgmap v321: 97 pgs: 97 active+clean; 653 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 767 B/s wr, 12 op/s 2023-10-16T13:13:48.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.693+0000 7f6393259b80 1 Processor -- start 2023-10-16T13:13:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.693+0000 7f6393259b80 1 -- start start 2023-10-16T13:13:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.693+0000 7f6393259b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df1e20 0x55e8e4df2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.693+0000 7f6393259b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e4df2780 0x55e8e4df3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.693+0000 7f6393259b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df3620 0x55e8e4df3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.693+0000 7f6393259b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e4d66c70 con 0x55e8e4df3620 2023-10-16T13:13:48.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.693+0000 7f6393259b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e4d4bc60 con 0x55e8e4df1e20 2023-10-16T13:13:48.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.693+0000 7f6393259b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e4d49580 con 0x55e8e4df2780 2023-10-16T13:13:48.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.693+0000 7f637ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df3620 0x55e8e4df3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.693+0000 7f637ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df3620 0x55e8e4df3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37148/0 (socket says 172.21.15.92:37148) 2023-10-16T13:13:48.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.693+0000 7f637ffff700 1 -- 172.21.15.92:0/674516034 learned_addr learned my addr 172.21.15.92:0/674516034 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:48.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.693+0000 7f638560c700 1 --2- 172.21.15.92:0/674516034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df1e20 0x55e8e4df2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.694+0000 7f637ffff700 1 -- 172.21.15.92:0/674516034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e4df2780 msgr2=0x55e8e4df3040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T13:13:48.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.694+0000 7f637ffff700 1 --2- 172.21.15.92:0/674516034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e4df2780 0x55e8e4df3040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.694+0000 7f637ffff700 1 -- 172.21.15.92:0/674516034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df1e20 msgr2=0x55e8e4df2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:48.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.694+0000 7f637ffff700 1 --2- 172.21.15.92:0/674516034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df1e20 0x55e8e4df2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.694+0000 7f637ffff700 1 -- 172.21.15.92:0/674516034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8e4d023f0 con 0x55e8e4df3620 2023-10-16T13:13:48.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.694+0000 7f638560c700 1 --2- 172.21.15.92:0/674516034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df1e20 0x55e8e4df2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:48.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.694+0000 7f637ffff700 1 --2- 172.21.15.92:0/674516034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df3620 0x55e8e4df3aa0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f636c00bd70 tx=0x7f636c0106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b18df72cfc2a17 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:48.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.694+0000 7f637dffb700 1 -- 172.21.15.92:0/3342038879 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6374009ba0 con 0x7f63800ff180 2023-10-16T13:13:48.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.694+0000 7f636affd700 1 -- 172.21.15.92:0/674516034 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c010ec0 con 0x55e8e4df3620 2023-10-16T13:13:48.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.694+0000 7f636affd700 1 -- 172.21.15.92:0/674516034 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f636c015070 con 0x55e8e4df3620 2023-10-16T13:13:48.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.694+0000 7f636affd700 1 -- 172.21.15.92:0/674516034 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c011440 con 0x55e8e4df3620 2023-10-16T13:13:48.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.695+0000 7f637dffb700 1 --2- 172.21.15.92:0/3342038879 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f63700a1500 0x7f63700a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.695+0000 7f638560c700 1 --2- 172.21.15.92:0/3342038879 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f63700a1500 0x7f63700a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.695+0000 7f637dffb700 1 -- 172.21.15.92:0/3342038879 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f63740cc8d0 con 0x7f63800ff180 2023-10-16T13:13:48.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.695+0000 7f6393259b80 1 -- 172.21.15.92:0/674516034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df3620 msgr2=0x55e8e4df3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:48.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.695+0000 7f6393259b80 1 --2- 172.21.15.92:0/674516034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df3620 0x55e8e4df3aa0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f636c00bd70 tx=0x7f636c0106b0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.695+0000 7f6393259b80 1 -- 172.21.15.92:0/674516034 shutdown_connections 2023-10-16T13:13:48.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.695+0000 7f6393259b80 1 --2- 172.21.15.92:0/674516034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df3620 0x55e8e4df3aa0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.695+0000 7f6393259b80 1 --2- 172.21.15.92:0/674516034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df1e20 0x55e8e4df2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.695+0000 7f6393259b80 1 --2- 172.21.15.92:0/674516034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e4df2780 0x55e8e4df3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.695+0000 7f6393259b80 1 -- 172.21.15.92:0/674516034 >> 172.21.15.92:0/674516034 conn(0x55e8e4d1fdd0 msgr2=0x55e8e4decfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:48.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.695+0000 7f6393259b80 1 -- 172.21.15.92:0/674516034 shutdown_connections 2023-10-16T13:13:48.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.695+0000 7f638560c700 1 --2- 172.21.15.92:0/3342038879 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f63700a1500 0x7f63700a39c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f637800b830 tx=0x7f6378006000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:48.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.695+0000 7f6393259b80 1 -- 172.21.15.92:0/674516034 wait complete. 2023-10-16T13:13:48.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.695+0000 7f6393259b80 1 -- start start 2023-10-16T13:13:48.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.696+0000 7f6393259b80 1 Processor -- start 2023-10-16T13:13:48.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.696+0000 7f6393259b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e4df1e20 0x55e8e4dfbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.696+0000 7f6393259b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df2780 0x55e8e4dfc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.696+0000 7f6393259b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df3620 0x55e8e4e03280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.696+0000 7f6393259b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e4d44e70 con 0x55e8e4df2780 2023-10-16T13:13:48.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.696+0000 7f6393259b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e4ce1710 con 0x55e8e4df3620 2023-10-16T13:13:48.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.696+0000 7f6393259b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e4ce13b0 con 0x55e8e4df1e20 2023-10-16T13:13:48.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.696+0000 7f6393259b80 10 client.0 _ll_register_callbacks cb 0x55e8e4b3e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:48.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.696+0000 7f637ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df2780 0x55e8e4dfc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.696+0000 7f637ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df2780 0x55e8e4dfc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37154/0 (socket says 172.21.15.92:37154) 2023-10-16T13:13:48.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.696+0000 7f637ffff700 1 -- 172.21.15.92:0/2059132593 learned_addr learned my addr 172.21.15.92:0/2059132593 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:48.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.696+0000 7f6384e0b700 1 --2- 172.21.15.92:0/2059132593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e4df1e20 0x55e8e4dfbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.696+0000 7f638560c700 1 --2- 172.21.15.92:0/2059132593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df3620 0x55e8e4e03280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.696+0000 7f637ffff700 1 -- 172.21.15.92:0/2059132593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e4df1e20 msgr2=0x55e8e4dfbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:48.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.696+0000 7f637ffff700 1 --2- 172.21.15.92:0/2059132593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e4df1e20 0x55e8e4dfbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.696+0000 7f637ffff700 1 -- 172.21.15.92:0/2059132593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df3620 msgr2=0x55e8e4e03280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:48.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.696+0000 7f637ffff700 1 --2- 172.21.15.92:0/2059132593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df3620 0x55e8e4e03280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.697+0000 7f637ffff700 1 -- 172.21.15.92:0/2059132593 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636c00b9a0 con 0x55e8e4df2780 2023-10-16T13:13:48.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.697+0000 7f637ffff700 1 --2- 172.21.15.92:0/2059132593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df2780 0x55e8e4dfc240 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f636c00bd40 tx=0x7f636c00bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3965fad2c6d5382b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:48.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.697+0000 7f635ffff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:48.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.697+0000 7f635ffff700 1 -- 172.21.15.92:0/2059132593 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c020070 con 0x55e8e4df2780 2023-10-16T13:13:48.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.697+0000 7f6393259b80 1 -- 172.21.15.92:0/2059132593 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e8e4d49ef0 con 0x55e8e4df2780 2023-10-16T13:13:48.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.697+0000 7f635ffff700 1 -- 172.21.15.92:0/2059132593 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f636c017070 con 0x55e8e4df2780 2023-10-16T13:13:48.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.697+0000 7f635ffff700 1 -- 172.21.15.92:0/2059132593 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f636c010e70 con 0x55e8e4df2780 2023-10-16T13:13:48.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.697+0000 7f6393259b80 10 client.15516 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:48.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.697+0000 7f6393259b80 1 -- 172.21.15.92:0/2059132593 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e8e4b6fde0 con 0x55e8e4df2780 2023-10-16T13:13:48.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.697+0000 7f635ffff700 1 -- 172.21.15.92:0/2059132593 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55e8e4d49ef0 con 0x55e8e4df2780 2023-10-16T13:13:48.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.697+0000 7f635ffff700 1 -- 172.21.15.92:0/2059132593 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f636c003680 con 0x55e8e4df2780 2023-10-16T13:13:48.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.698+0000 7f6393259b80 10 client.15516 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:48.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.698+0000 7f6393259b80 10 client.15516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:13:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.698+0000 7f6393259b80 20 client.15516 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.698+0000 7f6393259b80 1 --2- 172.21.15.92:0/2059132593 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e8e4e07980 0x55e8e4e09da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.698+0000 7f6393259b80 4 client.15516 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:13:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.698+0000 7f6393259b80 1 -- 172.21.15.92:0/2059132593 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e8e4dc1c10 con 0x55e8e4e07980 2023-10-16T13:13:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.698+0000 7f6384e0b700 1 --2- 172.21.15.92:0/2059132593 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e8e4e07980 0x55e8e4e09da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.698+0000 7f635ffff700 10 client.15516 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.698+0000 7f6384e0b700 1 --2- 172.21.15.92:0/2059132593 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e8e4e07980 0x55e8e4e09da0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbfba8059dbd7858 server_cookie=19e664e9e23d45dc in_seq=0 out_seq=0 2023-10-16T13:13:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.699+0000 7f635ffff700 1 -- 172.21.15.92:0/2059132593 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e8e4dc1c10 con 0x55e8e4e07980 2023-10-16T13:13:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.699+0000 7f635ffff700 10 client.15516 handle_command_reply: tid=0 2023-10-16T13:13:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.699+0000 7f6393259b80 1 client.15516 shutdown 2023-10-16T13:13:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.699+0000 7f6393259b80 1 -- 172.21.15.92:0/2059132593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df2780 msgr2=0x55e8e4dfc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:48.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.699+0000 7f6393259b80 1 --2- 172.21.15.92:0/2059132593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df2780 0x55e8e4dfc240 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f636c00bd40 tx=0x7f636c00bf70 comp rx=0 tx=0).stop 2023-10-16T13:13:48.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.699+0000 7f6393259b80 1 -- 172.21.15.92:0/2059132593 shutdown_connections 2023-10-16T13:13:48.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.699+0000 7f6393259b80 1 --2- 172.21.15.92:0/2059132593 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e8e4e07980 0x55e8e4e09da0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.699+0000 7f6393259b80 1 --2- 172.21.15.92:0/2059132593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df3620 0x55e8e4e03280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.699+0000 7f6393259b80 1 --2- 172.21.15.92:0/2059132593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e4df1e20 0x55e8e4dfbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.699+0000 7f6393259b80 1 --2- 172.21.15.92:0/2059132593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df2780 0x55e8e4dfc240 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.699+0000 7f6393259b80 1 -- 172.21.15.92:0/2059132593 >> 172.21.15.92:0/2059132593 conn(0x55e8e4d1fdd0 msgr2=0x55e8e4decbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.699+0000 7f635ffff700 0 client.15516 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.699+0000 7f6393259b80 1 -- 172.21.15.92:0/2059132593 shutdown_connections 2023-10-16T13:13:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.699+0000 7f6393259b80 1 -- 172.21.15.92:0/2059132593 wait complete. 2023-10-16T13:13:48.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.699+0000 7f6393259b80 20 client.15516 trim_cache size 0 max 16384 2023-10-16T13:13:48.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.716+0000 7f6393259b80 1 Processor -- start 2023-10-16T13:13:48.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.716+0000 7f6393259b80 1 -- start start 2023-10-16T13:13:48.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.716+0000 7f6393259b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df1e20 0x55e8e4df6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.716+0000 7f6393259b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df2780 0x55e8e4e03240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.716+0000 7f6393259b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e4df3620 0x55e8e4df6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.716+0000 7f6393259b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e4bc5920 con 0x55e8e4df2780 2023-10-16T13:13:48.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.716+0000 7f6393259b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e4dfb870 con 0x55e8e4df1e20 2023-10-16T13:13:48.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.716+0000 7f6393259b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e4de7c00 con 0x55e8e4df3620 2023-10-16T13:13:48.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.716+0000 7f637ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df2780 0x55e8e4e03240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.716+0000 7f637ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df2780 0x55e8e4e03240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37164/0 (socket says 172.21.15.92:37164) 2023-10-16T13:13:48.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.716+0000 7f637ffff700 1 -- 172.21.15.92:0/186448761 learned_addr learned my addr 172.21.15.92:0/186448761 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:48.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.716+0000 7f638560c700 1 --2- 172.21.15.92:0/186448761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e4df3620 0x55e8e4df6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.716+0000 7f6384e0b700 1 --2- 172.21.15.92:0/186448761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df1e20 0x55e8e4df6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.717+0000 7f637ffff700 1 -- 172.21.15.92:0/186448761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e4df3620 msgr2=0x55e8e4df6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:48.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.717+0000 7f637ffff700 1 --2- 172.21.15.92:0/186448761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e4df3620 0x55e8e4df6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.717+0000 7f637ffff700 1 -- 172.21.15.92:0/186448761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df1e20 msgr2=0x55e8e4df6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:48.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.717+0000 7f637ffff700 1 --2- 172.21.15.92:0/186448761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df1e20 0x55e8e4df6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.717+0000 7f637ffff700 1 -- 172.21.15.92:0/186448761 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8e4b58c60 con 0x55e8e4df2780 2023-10-16T13:13:48.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.717+0000 7f637ffff700 1 --2- 172.21.15.92:0/186448761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df2780 0x55e8e4e03240 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f636c00bc90 tx=0x7f636c00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879b8bc84b801674 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:48.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.717+0000 7f636b7fe700 1 -- 172.21.15.92:0/186448761 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c020040 con 0x55e8e4df2780 2023-10-16T13:13:48.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.717+0000 7f636b7fe700 1 -- 172.21.15.92:0/186448761 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f636c005280 con 0x55e8e4df2780 2023-10-16T13:13:48.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.717+0000 7f636b7fe700 1 -- 172.21.15.92:0/186448761 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c0041e0 con 0x55e8e4df2780 2023-10-16T13:13:48.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.718+0000 7f6393259b80 1 -- 172.21.15.92:0/186448761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df2780 msgr2=0x55e8e4e03240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:48.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.718+0000 7f6393259b80 1 --2- 172.21.15.92:0/186448761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df2780 0x55e8e4e03240 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f636c00bc90 tx=0x7f636c00b630 comp rx=0 tx=0).stop 2023-10-16T13:13:48.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.718+0000 7f6393259b80 1 -- 172.21.15.92:0/186448761 shutdown_connections 2023-10-16T13:13:48.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.718+0000 7f6393259b80 1 --2- 172.21.15.92:0/186448761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e4df3620 0x55e8e4df6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.718+0000 7f6393259b80 1 --2- 172.21.15.92:0/186448761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df1e20 0x55e8e4df6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.718+0000 7f6393259b80 1 --2- 172.21.15.92:0/186448761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df2780 0x55e8e4e03240 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.718+0000 7f6393259b80 1 -- 172.21.15.92:0/186448761 >> 172.21.15.92:0/186448761 conn(0x55e8e4d1fdd0 msgr2=0x55e8e4df9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:48.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.718+0000 7f6393259b80 1 -- 172.21.15.92:0/186448761 shutdown_connections 2023-10-16T13:13:48.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.718+0000 7f6393259b80 1 -- 172.21.15.92:0/186448761 wait complete. 2023-10-16T13:13:48.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.718+0000 7f6393259b80 1 -- start start 2023-10-16T13:13:48.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.718+0000 7f6393259b80 1 Processor -- start 2023-10-16T13:13:48.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.719+0000 7f6393259b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df1e20 0x55e8e4e00e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.719+0000 7f6393259b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df2780 0x55e8e4e01340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.719+0000 7f6393259b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e4df3620 0x55e8e4e02350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.719+0000 7f6393259b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e4e02890 con 0x55e8e4df1e20 2023-10-16T13:13:48.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.719+0000 7f6393259b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e4e02a00 con 0x55e8e4df2780 2023-10-16T13:13:48.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.719+0000 7f6393259b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e4e02bc0 con 0x55e8e4df3620 2023-10-16T13:13:48.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.719+0000 7f6393259b80 10 client.0 _ll_register_callbacks cb 0x7f636c00bbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:48.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.719+0000 7f6384e0b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df1e20 0x55e8e4e00e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.719+0000 7f6384e0b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df1e20 0x55e8e4e00e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37166/0 (socket says 172.21.15.92:37166) 2023-10-16T13:13:48.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.719+0000 7f6384e0b700 1 -- 172.21.15.92:0/3376309277 learned_addr learned my addr 172.21.15.92:0/3376309277 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:48.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.719+0000 7f638560c700 1 --2- 172.21.15.92:0/3376309277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e4df3620 0x55e8e4e02350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.719+0000 7f6384e0b700 1 -- 172.21.15.92:0/3376309277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e4df3620 msgr2=0x55e8e4e02350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:48.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.719+0000 7f6384e0b700 1 --2- 172.21.15.92:0/3376309277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e4df3620 0x55e8e4e02350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.719+0000 7f6384e0b700 1 -- 172.21.15.92:0/3376309277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df2780 msgr2=0x55e8e4e01340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:48.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.719+0000 7f6384e0b700 1 --2- 172.21.15.92:0/3376309277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df2780 0x55e8e4e01340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.719+0000 7f6384e0b700 1 -- 172.21.15.92:0/3376309277 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e8e4b6fde0 con 0x55e8e4df1e20 2023-10-16T13:13:48.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.719+0000 7f6384e0b700 1 --2- 172.21.15.92:0/3376309277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df1e20 0x55e8e4e00e00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6374099b80 tx=0x7f6374095810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e526ccb5181f2db server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:48.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.719+0000 7f635ffff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:48.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.720+0000 7f635ffff700 1 -- 172.21.15.92:0/3376309277 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637409dd40 con 0x55e8e4df1e20 2023-10-16T13:13:48.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.720+0000 7f635ffff700 1 -- 172.21.15.92:0/3376309277 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f63740a1f80 con 0x55e8e4df1e20 2023-10-16T13:13:48.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.720+0000 7f6393259b80 1 -- 172.21.15.92:0/3376309277 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e8e4dfb010 con 0x55e8e4df1e20 2023-10-16T13:13:48.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.720+0000 7f635ffff700 1 -- 172.21.15.92:0/3376309277 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6374096300 con 0x55e8e4df1e20 2023-10-16T13:13:48.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.720+0000 7f6393259b80 10 client.15522 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:48.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.720+0000 7f6393259b80 1 -- 172.21.15.92:0/3376309277 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e8e4b96250 con 0x55e8e4df1e20 2023-10-16T13:13:48.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.720+0000 7f635ffff700 1 -- 172.21.15.92:0/3376309277 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55e8e4dfb010 con 0x55e8e4df1e20 2023-10-16T13:13:48.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.720+0000 7f635ffff700 1 -- 172.21.15.92:0/3376309277 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f63740a1af0 con 0x55e8e4df1e20 2023-10-16T13:13:48.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.720+0000 7f6393259b80 10 client.15522 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:48.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.720+0000 7f6393259b80 10 client.15522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:13:48.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.720+0000 7f6393259b80 20 client.15522 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:48.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.720+0000 7f6393259b80 1 --2- 172.21.15.92:0/3376309277 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e8e4e5c5b0 0x55e8e4e5e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.720+0000 7f6393259b80 4 client.15522 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-16T13:13:48.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.720+0000 7f6393259b80 1 -- 172.21.15.92:0/3376309277 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f636c015070 con 0x55e8e4e5c5b0 2023-10-16T13:13:48.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.721+0000 7f637ffff700 1 --2- 172.21.15.92:0/3376309277 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e8e4e5c5b0 0x55e8e4e5e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.721+0000 7f635ffff700 10 client.15522 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:48.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.721+0000 7f637ffff700 1 --2- 172.21.15.92:0/3376309277 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e8e4e5c5b0 0x55e8e4e5e9d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59b5f9d70d749fc4 server_cookie=a74c8ecf0937eda2 in_seq=0 out_seq=0 2023-10-16T13:13:48.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.721+0000 7f635ffff700 1 -- 172.21.15.92:0/3376309277 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7f636c015070 con 0x55e8e4e5c5b0 2023-10-16T13:13:48.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.721+0000 7f635ffff700 10 client.15522 handle_command_reply: tid=0 2023-10-16T13:13:48.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.721+0000 7f6393259b80 1 client.15522 shutdown 2023-10-16T13:13:48.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.721+0000 7f6393259b80 1 -- 172.21.15.92:0/3376309277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df1e20 msgr2=0x55e8e4e00e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:48.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.721+0000 7f6393259b80 1 --2- 172.21.15.92:0/3376309277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df1e20 0x55e8e4e00e00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6374099b80 tx=0x7f6374095810 comp rx=0 tx=0).stop 2023-10-16T13:13:48.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.722+0000 7f6393259b80 1 -- 172.21.15.92:0/3376309277 shutdown_connections 2023-10-16T13:13:48.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.722+0000 7f6393259b80 1 --2- 172.21.15.92:0/3376309277 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e8e4e5c5b0 0x55e8e4e5e9d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.722+0000 7f6393259b80 1 --2- 172.21.15.92:0/3376309277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8e4df1e20 0x55e8e4e00e00 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.722+0000 7f635ffff700 0 client.15522 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:48.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.722+0000 7f6393259b80 1 --2- 172.21.15.92:0/3376309277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e8e4df3620 0x55e8e4e02350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.722+0000 7f6393259b80 1 --2- 172.21.15.92:0/3376309277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8e4df2780 0x55e8e4e01340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.722+0000 7f6393259b80 1 -- 172.21.15.92:0/3376309277 >> 172.21.15.92:0/3376309277 conn(0x55e8e4d1fdd0 msgr2=0x55e8e4df6580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:48.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.722+0000 7f6393259b80 1 -- 172.21.15.92:0/3376309277 shutdown_connections 2023-10-16T13:13:48.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.722+0000 7f6393259b80 1 -- 172.21.15.92:0/3376309277 wait complete. 2023-10-16T13:13:48.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.722+0000 7f6393259b80 20 client.15522 trim_cache size 0 max 16384 2023-10-16T13:13:48.741 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:13:48.741 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2023-10-16T13:13:48.741 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2023-10-16T13:13:48.742 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:13:48.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.722+0000 7f638706f700 1 -- 172.21.15.92:0/3342038879 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f63700a1500 msgr2=0x7f63700a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:48.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.722+0000 7f638706f700 1 --2- 172.21.15.92:0/3342038879 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f63700a1500 0x7f63700a39c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f637800b830 tx=0x7f6378006000 comp rx=0 tx=0).stop 2023-10-16T13:13:48.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.722+0000 7f638706f700 1 -- 172.21.15.92:0/3342038879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63800ff180 msgr2=0x7f6380101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:48.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.722+0000 7f638706f700 1 --2- 172.21.15.92:0/3342038879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63800ff180 0x7f6380101ac0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f637400d980 tx=0x7f637400dc90 comp rx=0 tx=0).stop 2023-10-16T13:13:48.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.723+0000 7f638706f700 1 -- 172.21.15.92:0/3342038879 shutdown_connections 2023-10-16T13:13:48.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.723+0000 7f638706f700 1 --2- 172.21.15.92:0/3342038879 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f63700a1500 0x7f63700a39c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.723+0000 7f638706f700 1 --2- 172.21.15.92:0/3342038879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63800ff180 0x7f6380101ac0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.723+0000 7f638706f700 1 --2- 172.21.15.92:0/3342038879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6380102af0 0x7f6380100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.723+0000 7f638706f700 1 --2- 172.21.15.92:0/3342038879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6380102150 0x7f6380100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.723+0000 7f638706f700 1 -- 172.21.15.92:0/3342038879 >> 172.21.15.92:0/3342038879 conn(0x7f63800faa90 msgr2=0x7f63800fccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:48.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.723+0000 7f638706f700 1 -- 172.21.15.92:0/3342038879 shutdown_connections 2023-10-16T13:13:48.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.723+0000 7f638706f700 1 -- 172.21.15.92:0/3342038879 wait complete. 2023-10-16T13:13:48.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:48 smithi092 ceph-mon[99542]: pgmap v321: 97 pgs: 97 active+clean; 653 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 767 B/s wr, 12 op/s 2023-10-16T13:13:48.746 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-16T13:13:48.746 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:13:48.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:48 smithi118 ceph-mon[103969]: pgmap v321: 97 pgs: 97 active+clean; 653 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 767 B/s wr, 12 op/s 2023-10-16T13:13:48.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.917+0000 7ff8ccdb9700 1 -- 172.21.15.92:0/3269886230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8c81009c0 msgr2=0x7ff8c8108260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:48.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.917+0000 7ff8ccdb9700 1 --2- 172.21.15.92:0/3269886230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8c81009c0 0x7ff8c8108260 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff8c000b0a0 tx=0x7ff8c000b3b0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.917+0000 7ff8ccdb9700 1 -- 172.21.15.92:0/3269886230 shutdown_connections 2023-10-16T13:13:48.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.917+0000 7ff8ccdb9700 1 --2- 172.21.15.92:0/3269886230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8c81009c0 0x7ff8c8108260 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.917+0000 7ff8ccdb9700 1 --2- 172.21.15.92:0/3269886230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8c81013b0 0x7ff8c81017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.917+0000 7ff8ccdb9700 1 --2- 172.21.15.92:0/3269886230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8c8100000 0x7ff8c8100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.917+0000 7ff8ccdb9700 1 -- 172.21.15.92:0/3269886230 >> 172.21.15.92:0/3269886230 conn(0x7ff8c80faab0 msgr2=0x7ff8c80fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:48.922 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.917+0000 7ff8ccdb9700 1 -- 172.21.15.92:0/3269886230 shutdown_connections 2023-10-16T13:13:48.922 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.917+0000 7ff8ccdb9700 1 -- 172.21.15.92:0/3269886230 wait complete. 2023-10-16T13:13:48.924 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.918+0000 7ff8ccdb9700 1 Processor -- start 2023-10-16T13:13:48.924 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.918+0000 7ff8ccdb9700 1 -- start start 2023-10-16T13:13:48.924 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.918+0000 7ff8ccdb9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8c8100000 0x7ff8c810a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.924 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.919+0000 7ff8ccdb9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8c81009c0 0x7ff8c8108be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.924 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.919+0000 7ff8ccdb9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8c81013b0 0x7ff8c8109120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.919+0000 7ff8ccdb9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c81098c0 con 0x7ff8c81009c0 2023-10-16T13:13:48.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.919+0000 7ff8ccdb9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c8109a30 con 0x7ff8c81013b0 2023-10-16T13:13:48.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.919+0000 7ff8ccdb9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c81a0d30 con 0x7ff8c8100000 2023-10-16T13:13:48.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.919+0000 7ff8c5d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8c81009c0 0x7ff8c8108be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.919+0000 7ff8c5d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8c81009c0 0x7ff8c8108be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37182/0 (socket says 172.21.15.92:37182) 2023-10-16T13:13:48.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.919+0000 7ff8c5d9b700 1 -- 172.21.15.92:0/200653490 learned_addr learned my addr 172.21.15.92:0/200653490 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:48.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.919+0000 7ff8c659c700 1 --2- 172.21.15.92:0/200653490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8c8100000 0x7ff8c810a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.919+0000 7ff8c6d9d700 1 --2- 172.21.15.92:0/200653490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8c81013b0 0x7ff8c8109120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.919+0000 7ff8c5d9b700 1 -- 172.21.15.92:0/200653490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8c8100000 msgr2=0x7ff8c810a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:48.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.919+0000 7ff8c5d9b700 1 --2- 172.21.15.92:0/200653490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8c8100000 0x7ff8c810a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.919+0000 7ff8c5d9b700 1 -- 172.21.15.92:0/200653490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8c81013b0 msgr2=0x7ff8c8109120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:48.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.919+0000 7ff8c5d9b700 1 --2- 172.21.15.92:0/200653490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8c81013b0 0x7ff8c8109120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:48.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.919+0000 7ff8c5d9b700 1 -- 172.21.15.92:0/200653490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c0009d00 con 0x7ff8c81009c0 2023-10-16T13:13:48.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.919+0000 7ff8c5d9b700 1 --2- 172.21.15.92:0/200653490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8c81009c0 0x7ff8c8108be0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00e970 tx=0x7ff8bc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:48.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.919+0000 7ff8b77fe700 1 -- 172.21.15.92:0/200653490 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc009790 con 0x7ff8c81009c0 2023-10-16T13:13:48.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.920+0000 7ff8ccdb9700 1 -- 172.21.15.92:0/200653490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c8196a10 con 0x7ff8c81009c0 2023-10-16T13:13:48.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.920+0000 7ff8ccdb9700 1 -- 172.21.15.92:0/200653490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c8196f40 con 0x7ff8c81009c0 2023-10-16T13:13:48.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.920+0000 7ff8b77fe700 1 -- 172.21.15.92:0/200653490 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff8bc00ccc0 con 0x7ff8c81009c0 2023-10-16T13:13:48.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.920+0000 7ff8b77fe700 1 -- 172.21.15.92:0/200653490 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc003cb0 con 0x7ff8c81009c0 2023-10-16T13:13:48.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.921+0000 7ff8ccdb9700 1 -- 172.21.15.92:0/200653490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a8005310 con 0x7ff8c81009c0 2023-10-16T13:13:48.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.923+0000 7ff8b77fe700 1 -- 172.21.15.92:0/200653490 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff8bc004220 con 0x7ff8c81009c0 2023-10-16T13:13:48.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.923+0000 7ff8b77fe700 1 --2- 172.21.15.92:0/200653490 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff8b00a15a0 0x7ff8b00a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:48.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.923+0000 7ff8c659c700 1 --2- 172.21.15.92:0/200653490 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff8b00a15a0 0x7ff8b00a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:48.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.923+0000 7ff8b77fe700 1 -- 172.21.15.92:0/200653490 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff8bc014070 con 0x7ff8c81009c0 2023-10-16T13:13:48.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.924+0000 7ff8c659c700 1 --2- 172.21.15.92:0/200653490 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff8b00a15a0 0x7ff8b00a3a60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8067b10 tx=0x7ff8b8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:48.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:48.927+0000 7ff8b77fe700 1 -- 172.21.15.92:0/200653490 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff8bc0967c0 con 0x7ff8c81009c0 2023-10-16T13:13:49.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.182+0000 7ff8ccdb9700 1 -- 172.21.15.92:0/200653490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8a8005180 con 0x7ff8c81009c0 2023-10-16T13:13:49.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.183+0000 7ff8b77fe700 1 -- 172.21.15.92:0/200653490 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11379 (secure 0 0 0) 0x7ff8bc099de0 con 0x7ff8c81009c0 2023-10-16T13:13:49.186 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:13:49.186 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-16T13:11:40.343309+0000","modified":"2023-10-16T13:11:48.346678+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24460,"mds_3":24428,"mds_4":24412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1790514945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1790514945},{"type":"v1","addr":"172.21.15.92:6839","nonce":1790514945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/1016260236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1016260236},{"type":"v1","addr":"172.21.15.92:6841","nonce":1016260236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24410":{"gid":24410,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/2133613540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":2133613540},{"type":"v1","addr":"172.21.15.118:6837","nonce":2133613540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6837/2403096460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":2403096460},{"type":"v1","addr":"172.21.15.152:6837","nonce":2403096460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1821921588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1821921588},{"type":"v1","addr":"172.21.15.152:6839","nonce":1821921588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6839/1577355936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":1577355936},{"type":"v1","addr":"172.21.15.118:6839","nonce":1577355936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:13:49.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.185+0000 7ff8ccdb9700 1 -- 172.21.15.92:0/200653490 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff8b00a15a0 msgr2=0x7ff8b00a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.185+0000 7ff8ccdb9700 1 --2- 172.21.15.92:0/200653490 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff8b00a15a0 0x7ff8b00a3a60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8067b10 tx=0x7ff8b8009260 comp rx=0 tx=0).stop 2023-10-16T13:13:49.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.185+0000 7ff8ccdb9700 1 -- 172.21.15.92:0/200653490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8c81009c0 msgr2=0x7ff8c8108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.185+0000 7ff8ccdb9700 1 --2- 172.21.15.92:0/200653490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8c81009c0 0x7ff8c8108be0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00e970 tx=0x7ff8bc00ec80 comp rx=0 tx=0).stop 2023-10-16T13:13:49.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.185+0000 7ff8ccdb9700 1 -- 172.21.15.92:0/200653490 shutdown_connections 2023-10-16T13:13:49.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.185+0000 7ff8ccdb9700 1 --2- 172.21.15.92:0/200653490 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff8b00a15a0 0x7ff8b00a3a60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.185+0000 7ff8ccdb9700 1 --2- 172.21.15.92:0/200653490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8c81013b0 0x7ff8c8109120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.185+0000 7ff8ccdb9700 1 --2- 172.21.15.92:0/200653490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8c8100000 0x7ff8c810a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.185+0000 7ff8ccdb9700 1 --2- 172.21.15.92:0/200653490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8c81009c0 0x7ff8c8108be0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.185+0000 7ff8ccdb9700 1 -- 172.21.15.92:0/200653490 >> 172.21.15.92:0/200653490 conn(0x7ff8c80faab0 msgr2=0x7ff8c80fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.185+0000 7ff8ccdb9700 1 -- 172.21.15.92:0/200653490 shutdown_connections 2023-10-16T13:13:49.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.185+0000 7ff8ccdb9700 1 -- 172.21.15.92:0/200653490 wait complete. 2023-10-16T13:13:49.191 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 27 2023-10-16T13:13:49.200 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-16T13:13:49.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.327+0000 7f52996b7700 1 -- 172.21.15.92:0/3365603742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5294101940 msgr2=0x7f52941081f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.327+0000 7f52996b7700 1 --2- 172.21.15.92:0/3365603742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5294101940 0x7f52941081f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f528c00b0d0 tx=0x7f528c00b3e0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.327+0000 7f52996b7700 1 -- 172.21.15.92:0/3365603742 shutdown_connections 2023-10-16T13:13:49.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.327+0000 7f52996b7700 1 --2- 172.21.15.92:0/3365603742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5294101940 0x7f52941081f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.327+0000 7f52996b7700 1 --2- 172.21.15.92:0/3365603742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52940ffdb0 0x7f52941001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.327+0000 7f52996b7700 1 --2- 172.21.15.92:0/3365603742 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5294100fa0 0x7f5294101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.327+0000 7f52996b7700 1 -- 172.21.15.92:0/3365603742 >> 172.21.15.92:0/3365603742 conn(0x7f52940fb320 msgr2=0x7f52940fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.327+0000 7f52996b7700 1 -- 172.21.15.92:0/3365603742 shutdown_connections 2023-10-16T13:13:49.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.328+0000 7f52996b7700 1 -- 172.21.15.92:0/3365603742 wait complete. 2023-10-16T13:13:49.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.328+0000 7f52996b7700 1 Processor -- start 2023-10-16T13:13:49.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.328+0000 7f52996b7700 1 -- start start 2023-10-16T13:13:49.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.328+0000 7f52996b7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52940ffdb0 0x7f5294068c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.328+0000 7f52996b7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5294100fa0 0x7f529419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.328+0000 7f52996b7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5294101940 0x7f529419e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.328+0000 7f52996b7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529419e7f0 con 0x7f5294101940 2023-10-16T13:13:49.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.328+0000 7f52996b7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529419e960 con 0x7f5294100fa0 2023-10-16T13:13:49.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.328+0000 7f52996b7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529419eb20 con 0x7f52940ffdb0 2023-10-16T13:13:49.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.329+0000 7f52937fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5294101940 0x7f529419e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.329+0000 7f52937fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5294101940 0x7f529419e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37196/0 (socket says 172.21.15.92:37196) 2023-10-16T13:13:49.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.329+0000 7f52937fe700 1 -- 172.21.15.92:0/1691048075 learned_addr learned my addr 172.21.15.92:0/1691048075 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.329+0000 7f5292ffd700 1 --2- 172.21.15.92:0/1691048075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52940ffdb0 0x7f5294068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.329+0000 7f52927fc700 1 --2- 172.21.15.92:0/1691048075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5294100fa0 0x7f529419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.329+0000 7f52937fe700 1 -- 172.21.15.92:0/1691048075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52940ffdb0 msgr2=0x7f5294068c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.329+0000 7f52937fe700 1 --2- 172.21.15.92:0/1691048075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52940ffdb0 0x7f5294068c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.329+0000 7f52937fe700 1 -- 172.21.15.92:0/1691048075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5294100fa0 msgr2=0x7f529419b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.329+0000 7f52937fe700 1 --2- 172.21.15.92:0/1691048075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5294100fa0 0x7f529419b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.329+0000 7f52937fe700 1 -- 172.21.15.92:0/1691048075 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528c009d00 con 0x7f5294101940 2023-10-16T13:13:49.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.329+0000 7f5292ffd700 1 --2- 172.21.15.92:0/1691048075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52940ffdb0 0x7f5294068c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:49.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.329+0000 7f52937fe700 1 --2- 172.21.15.92:0/1691048075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5294101940 0x7f529419e050 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f528c009300 tx=0x7f528c0093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.329+0000 7f527bfff700 1 -- 172.21.15.92:0/1691048075 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c00e040 con 0x7f5294101940 2023-10-16T13:13:49.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.329+0000 7f52996b7700 1 -- 172.21.15.92:0/1691048075 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529419eda0 con 0x7f5294101940 2023-10-16T13:13:49.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.329+0000 7f527bfff700 1 -- 172.21.15.92:0/1691048075 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f528c003e10 con 0x7f5294101940 2023-10-16T13:13:49.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.329+0000 7f527bfff700 1 -- 172.21.15.92:0/1691048075 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c005390 con 0x7f5294101940 2023-10-16T13:13:49.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.329+0000 7f52996b7700 1 -- 172.21.15.92:0/1691048075 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529419f1d0 con 0x7f5294101940 2023-10-16T13:13:49.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.332+0000 7f527bfff700 1 -- 172.21.15.92:0/1691048075 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f528c01b450 con 0x7f5294101940 2023-10-16T13:13:49.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.333+0000 7f527bfff700 1 --2- 172.21.15.92:0/1691048075 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f527c0a1480 0x7f527c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.333+0000 7f527bfff700 1 -- 172.21.15.92:0/1691048075 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f528c0ce3c0 con 0x7f5294101940 2023-10-16T13:13:49.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.333+0000 7f5292ffd700 1 --2- 172.21.15.92:0/1691048075 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f527c0a1480 0x7f527c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.333+0000 7f52a58a1b80 1 Processor -- start 2023-10-16T13:13:49.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.334+0000 7f52a58a1b80 1 -- start start 2023-10-16T13:13:49.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.334+0000 7f52a58a1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40ae20 0x55c51c40b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.334+0000 7f52a58a1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40b780 0x55c51c40c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.334+0000 7f52a58a1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40c620 0x55c51c40caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.334+0000 7f52a58a1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c51c37fc70 con 0x55c51c40ae20 2023-10-16T13:13:49.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.334+0000 7f52a58a1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c51c364c60 con 0x55c51c40c620 2023-10-16T13:13:49.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.334+0000 7f52a58a1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c51c362580 con 0x55c51c40b780 2023-10-16T13:13:49.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.334+0000 7f5292ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40ae20 0x55c51c40b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.334+0000 7f5292ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40ae20 0x55c51c40b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37204/0 (socket says 172.21.15.92:37204) 2023-10-16T13:13:49.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.334+0000 7f5292ffd700 1 -- 172.21.15.92:0/3973602610 learned_addr learned my addr 172.21.15.92:0/3973602610 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.334+0000 7f5292ffd700 1 --2- 172.21.15.92:0/1691048075 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f527c0a1480 0x7f527c0a3940 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5284005950 tx=0x7f52840058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.334+0000 7f52927fc700 1 --2- 172.21.15.92:0/3973602610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40b780 0x55c51c40c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.334+0000 7f52937fe700 1 --2- 172.21.15.92:0/3973602610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40c620 0x55c51c40caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.334+0000 7f5292ffd700 1 -- 172.21.15.92:0/3973602610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40b780 msgr2=0x55c51c40c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.334+0000 7f5292ffd700 1 --2- 172.21.15.92:0/3973602610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40b780 0x55c51c40c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.334+0000 7f5292ffd700 1 -- 172.21.15.92:0/3973602610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40c620 msgr2=0x55c51c40caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.334+0000 7f5292ffd700 1 --2- 172.21.15.92:0/3973602610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40c620 0x55c51c40caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.334+0000 7f5292ffd700 1 -- 172.21.15.92:0/3973602610 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c51c31b3f0 con 0x55c51c40ae20 2023-10-16T13:13:49.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.334+0000 7f52937fe700 1 --2- 172.21.15.92:0/3973602610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40c620 0x55c51c40caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:49.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.335+0000 7f5292ffd700 1 --2- 172.21.15.92:0/3973602610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40ae20 0x55c51c40b240 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f528400ff00 tx=0x7f5284012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c0af1dcb4fb736 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.335+0000 7f52797fa700 1 -- 172.21.15.92:0/3973602610 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5284011bb0 con 0x55c51c40ae20 2023-10-16T13:13:49.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.335+0000 7f52797fa700 1 -- 172.21.15.92:0/3973602610 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5284011d10 con 0x55c51c40ae20 2023-10-16T13:13:49.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.335+0000 7f52797fa700 1 -- 172.21.15.92:0/3973602610 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52840107d0 con 0x55c51c40ae20 2023-10-16T13:13:49.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.335+0000 7f52a58a1b80 1 -- 172.21.15.92:0/3973602610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40ae20 msgr2=0x55c51c40b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.335+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/3973602610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40ae20 0x55c51c40b240 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f528400ff00 tx=0x7f5284012000 comp rx=0 tx=0).stop 2023-10-16T13:13:49.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.336+0000 7f52a58a1b80 1 -- 172.21.15.92:0/3973602610 shutdown_connections 2023-10-16T13:13:49.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.336+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/3973602610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40ae20 0x55c51c40b240 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.336+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/3973602610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40c620 0x55c51c40caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.336+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/3973602610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40b780 0x55c51c40c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.336+0000 7f52a58a1b80 1 -- 172.21.15.92:0/3973602610 >> 172.21.15.92:0/3973602610 conn(0x55c51c338dd0 msgr2=0x55c51c405fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.336+0000 7f52a58a1b80 1 -- 172.21.15.92:0/3973602610 shutdown_connections 2023-10-16T13:13:49.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.336+0000 7f52a58a1b80 1 -- 172.21.15.92:0/3973602610 wait complete. 2023-10-16T13:13:49.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.336+0000 7f52a58a1b80 1 -- start start 2023-10-16T13:13:49.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.336+0000 7f52a58a1b80 1 Processor -- start 2023-10-16T13:13:49.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.336+0000 7f52a58a1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40ae20 0x55c51c414bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.336+0000 7f52a58a1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40b780 0x55c51c415100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.336+0000 7f52a58a1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40c620 0x55c51c416110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.336+0000 7f52a58a1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c51c35de70 con 0x55c51c40c620 2023-10-16T13:13:49.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.336+0000 7f52a58a1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c51c2fa710 con 0x55c51c40b780 2023-10-16T13:13:49.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.336+0000 7f52a58a1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c51c2fa3b0 con 0x55c51c40ae20 2023-10-16T13:13:49.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.337+0000 7f52a58a1b80 10 client.0 _ll_register_callbacks cb 0x55c51c157800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:49.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.337+0000 7f5292ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40ae20 0x55c51c414bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.337+0000 7f5292ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40ae20 0x55c51c414bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.92:44038/0 (socket says 172.21.15.92:44038) 2023-10-16T13:13:49.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.337+0000 7f5292ffd700 1 -- 172.21.15.92:0/2198199767 learned_addr learned my addr 172.21.15.92:0/2198199767 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.337+0000 7f52937fe700 1 --2- 172.21.15.92:0/2198199767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40c620 0x55c51c416110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.337+0000 7f52927fc700 1 --2- 172.21.15.92:0/2198199767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40b780 0x55c51c415100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.337+0000 7f52937fe700 1 -- 172.21.15.92:0/2198199767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40ae20 msgr2=0x55c51c414bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.337+0000 7f52937fe700 1 --2- 172.21.15.92:0/2198199767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40ae20 0x55c51c414bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.337+0000 7f52937fe700 1 -- 172.21.15.92:0/2198199767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40b780 msgr2=0x55c51c415100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.337+0000 7f52937fe700 1 --2- 172.21.15.92:0/2198199767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40b780 0x55c51c415100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.337+0000 7f52937fe700 1 -- 172.21.15.92:0/2198199767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f528400fbb0 con 0x55c51c40c620 2023-10-16T13:13:49.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.337+0000 7f5292ffd700 1 --2- 172.21.15.92:0/2198199767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40ae20 0x55c51c414bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:13:49.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.337+0000 7f52927fc700 1 --2- 172.21.15.92:0/2198199767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40b780 0x55c51c415100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:49.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.337+0000 7f52937fe700 1 --2- 172.21.15.92:0/2198199767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40c620 0x55c51c416110 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f528c007b60 tx=0x7f528c006230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b69dd8af9378f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.337+0000 7f5276ff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:49.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.337+0000 7f5276ff5700 1 -- 172.21.15.92:0/2198199767 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0bb070 con 0x55c51c40c620 2023-10-16T13:13:49.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.337+0000 7f5276ff5700 1 -- 172.21.15.92:0/2198199767 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f528c09be70 con 0x55c51c40c620 2023-10-16T13:13:49.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.338+0000 7f52a58a1b80 1 -- 172.21.15.92:0/2198199767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c51c362ef0 con 0x55c51c40c620 2023-10-16T13:13:49.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.338+0000 7f5276ff5700 1 -- 172.21.15.92:0/2198199767 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f528c09b770 con 0x55c51c40c620 2023-10-16T13:13:49.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.338+0000 7f52a58a1b80 10 client.15540 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:49.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.338+0000 7f52a58a1b80 1 -- 172.21.15.92:0/2198199767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c51c188de0 con 0x55c51c40c620 2023-10-16T13:13:49.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.338+0000 7f5276ff5700 1 -- 172.21.15.92:0/2198199767 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55c51c362ef0 con 0x55c51c40c620 2023-10-16T13:13:49.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.338+0000 7f5276ff5700 1 -- 172.21.15.92:0/2198199767 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f528c0b9be0 con 0x55c51c40c620 2023-10-16T13:13:49.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.338+0000 7f52a58a1b80 10 client.15540 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:49.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.338+0000 7f52a58a1b80 10 client.15540 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2023-10-16T13:13:49.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.338+0000 7f52a58a1b80 20 client.15540 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:49.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.338+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/2198199767 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c51c429090 0x55c51c42b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.338+0000 7f52a58a1b80 4 client.15540 mds_command: new command op to 24412 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:13:49.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.338+0000 7f52a58a1b80 1 -- 172.21.15.92:0/2198199767 --> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c51c3dac10 con 0x55c51c429090 2023-10-16T13:13:49.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.338+0000 7f5292ffd700 1 --2- 172.21.15.92:0/2198199767 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c51c429090 0x55c51c42b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.339+0000 7f5276ff5700 10 client.15540 ms_handle_connect on v2:172.21.15.152:6832/1273074399 2023-10-16T13:13:49.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.339+0000 7f5292ffd700 1 --2- 172.21.15.92:0/2198199767 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c51c429090 0x55c51c42b4b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ff08743d8bf12ba9 server_cookie=8ab77b01fcfdee69 in_seq=0 out_seq=0 2023-10-16T13:13:49.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.340+0000 7f5276ff5700 1 -- 172.21.15.92:0/2198199767 <== mds.4 v2:172.21.15.152:6832/1273074399 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c51c3dac10 con 0x55c51c429090 2023-10-16T13:13:49.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.340+0000 7f5276ff5700 10 client.15540 handle_command_reply: tid=0 2023-10-16T13:13:49.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.340+0000 7f52a58a1b80 1 client.15540 shutdown 2023-10-16T13:13:49.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.340+0000 7f52a58a1b80 1 -- 172.21.15.92:0/2198199767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40c620 msgr2=0x55c51c416110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.340+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/2198199767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40c620 0x55c51c416110 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f528c007b60 tx=0x7f528c006230 comp rx=0 tx=0).stop 2023-10-16T13:13:49.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.340+0000 7f52a58a1b80 1 -- 172.21.15.92:0/2198199767 shutdown_connections 2023-10-16T13:13:49.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.340+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/2198199767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40c620 0x55c51c416110 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.340+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/2198199767 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c51c429090 0x55c51c42b4b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.340+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/2198199767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40ae20 0x55c51c414bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.340+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/2198199767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40b780 0x55c51c415100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.340+0000 7f5276ff5700 0 client.15540 ms_handle_reset on v2:172.21.15.152:6832/1273074399 2023-10-16T13:13:49.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.340+0000 7f52a58a1b80 1 -- 172.21.15.92:0/2198199767 >> 172.21.15.92:0/2198199767 conn(0x55c51c338dd0 msgr2=0x55c51c405b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.340+0000 7f52a58a1b80 1 -- 172.21.15.92:0/2198199767 shutdown_connections 2023-10-16T13:13:49.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.340+0000 7f52a58a1b80 1 -- 172.21.15.92:0/2198199767 wait complete. 2023-10-16T13:13:49.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.340+0000 7f52a58a1b80 20 client.15540 trim_cache size 0 max 16384 2023-10-16T13:13:49.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.357+0000 7f52a58a1b80 1 Processor -- start 2023-10-16T13:13:49.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.357+0000 7f52a58a1b80 1 -- start start 2023-10-16T13:13:49.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.357+0000 7f52a58a1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40ae20 0x55c51c40b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.358+0000 7f52a58a1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40b780 0x55c51c414bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.358+0000 7f52a58a1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40c620 0x55c51c415100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.358+0000 7f52a58a1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c51c1de920 con 0x55c51c40c620 2023-10-16T13:13:49.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.358+0000 7f52a58a1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c51c40c4a0 con 0x55c51c40b780 2023-10-16T13:13:49.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.358+0000 7f52a58a1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c51c414070 con 0x55c51c40ae20 2023-10-16T13:13:49.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.358+0000 7f52937fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40c620 0x55c51c415100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.358+0000 7f52937fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40c620 0x55c51c415100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37220/0 (socket says 172.21.15.92:37220) 2023-10-16T13:13:49.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.358+0000 7f52937fe700 1 -- 172.21.15.92:0/4088475392 learned_addr learned my addr 172.21.15.92:0/4088475392 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.358+0000 7f52927fc700 1 --2- 172.21.15.92:0/4088475392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40b780 0x55c51c414bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.358+0000 7f5292ffd700 1 --2- 172.21.15.92:0/4088475392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40ae20 0x55c51c40b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.358+0000 7f52937fe700 1 -- 172.21.15.92:0/4088475392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40ae20 msgr2=0x55c51c40b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.358+0000 7f52937fe700 1 --2- 172.21.15.92:0/4088475392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40ae20 0x55c51c40b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.358+0000 7f52937fe700 1 -- 172.21.15.92:0/4088475392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40b780 msgr2=0x55c51c414bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.358+0000 7f52937fe700 1 --2- 172.21.15.92:0/4088475392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40b780 0x55c51c414bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.358+0000 7f52937fe700 1 -- 172.21.15.92:0/4088475392 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c51c171c60 con 0x55c51c40c620 2023-10-16T13:13:49.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.358+0000 7f5292ffd700 1 --2- 172.21.15.92:0/4088475392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40ae20 0x55c51c40b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:49.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.358+0000 7f52937fe700 1 --2- 172.21.15.92:0/4088475392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40c620 0x55c51c415100 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f528c009fd0 tx=0x7f528c00cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4efe6dc087b692c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.358+0000 7f5279ffb700 1 -- 172.21.15.92:0/4088475392 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0bb0b0 con 0x55c51c40c620 2023-10-16T13:13:49.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.359+0000 7f5279ffb700 1 -- 172.21.15.92:0/4088475392 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f528c09baf0 con 0x55c51c40c620 2023-10-16T13:13:49.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.359+0000 7f5279ffb700 1 -- 172.21.15.92:0/4088475392 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0a3b00 con 0x55c51c40c620 2023-10-16T13:13:49.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.359+0000 7f52a58a1b80 1 -- 172.21.15.92:0/4088475392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40c620 msgr2=0x55c51c415100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.359+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/4088475392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40c620 0x55c51c415100 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f528c009fd0 tx=0x7f528c00cfa0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.360+0000 7f52a58a1b80 1 -- 172.21.15.92:0/4088475392 shutdown_connections 2023-10-16T13:13:49.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.360+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/4088475392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40c620 0x55c51c415100 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.360+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/4088475392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40ae20 0x55c51c40b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.360+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/4088475392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40b780 0x55c51c414bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.360+0000 7f52a58a1b80 1 -- 172.21.15.92:0/4088475392 >> 172.21.15.92:0/4088475392 conn(0x55c51c338dd0 msgr2=0x55c51c42fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.360+0000 7f52a58a1b80 1 -- 172.21.15.92:0/4088475392 shutdown_connections 2023-10-16T13:13:49.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.360+0000 7f52a58a1b80 1 -- 172.21.15.92:0/4088475392 wait complete. 2023-10-16T13:13:49.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.360+0000 7f52a58a1b80 1 -- start start 2023-10-16T13:13:49.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.360+0000 7f52a58a1b80 1 Processor -- start 2023-10-16T13:13:49.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.360+0000 7f52a58a1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40ae20 0x55c51c422f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.360+0000 7f52a58a1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40b780 0x55c51c4234b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.360+0000 7f52a58a1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40c620 0x55c51c4244c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.360+0000 7f52a58a1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c51c424a00 con 0x55c51c40c620 2023-10-16T13:13:49.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.360+0000 7f52a58a1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c51c424b70 con 0x55c51c40ae20 2023-10-16T13:13:49.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.360+0000 7f52a58a1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c51c424d30 con 0x55c51c40b780 2023-10-16T13:13:49.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.360+0000 7f52a58a1b80 10 client.0 _ll_register_callbacks cb 0x7f528c009b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:49.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.361+0000 7f5292ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40ae20 0x55c51c422f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.361+0000 7f52937fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40c620 0x55c51c4244c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.361+0000 7f5292ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40ae20 0x55c51c422f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:38030/0 (socket says 172.21.15.92:38030) 2023-10-16T13:13:49.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.361+0000 7f5292ffd700 1 -- 172.21.15.92:0/1795733320 learned_addr learned my addr 172.21.15.92:0/1795733320 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.361+0000 7f52927fc700 1 --2- 172.21.15.92:0/1795733320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40b780 0x55c51c4234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.361+0000 7f52937fe700 1 -- 172.21.15.92:0/1795733320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40b780 msgr2=0x55c51c4234b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.361+0000 7f52937fe700 1 --2- 172.21.15.92:0/1795733320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40b780 0x55c51c4234b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.361+0000 7f52937fe700 1 -- 172.21.15.92:0/1795733320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40ae20 msgr2=0x55c51c422f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.361+0000 7f52937fe700 1 --2- 172.21.15.92:0/1795733320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40ae20 0x55c51c422f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.361+0000 7f52937fe700 1 -- 172.21.15.92:0/1795733320 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c51c188de0 con 0x55c51c40c620 2023-10-16T13:13:49.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.361+0000 7f5292ffd700 1 --2- 172.21.15.92:0/1795733320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40ae20 0x55c51c422f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:13:49.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.361+0000 7f52937fe700 1 --2- 172.21.15.92:0/1795733320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40c620 0x55c51c4244c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f528c09b700 tx=0x7f528c007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802dd02bfec6be18 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.361+0000 7f5276ff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:49.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.361+0000 7f5276ff5700 1 -- 172.21.15.92:0/1795733320 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0a3ae0 con 0x55c51c40c620 2023-10-16T13:13:49.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.361+0000 7f5276ff5700 1 -- 172.21.15.92:0/1795733320 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f528c067050 con 0x55c51c40c620 2023-10-16T13:13:49.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.361+0000 7f52a58a1b80 1 -- 172.21.15.92:0/1795733320 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5284011d10 con 0x55c51c40c620 2023-10-16T13:13:49.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.361+0000 7f5276ff5700 1 -- 172.21.15.92:0/1795733320 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f528c09b770 con 0x55c51c40c620 2023-10-16T13:13:49.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.362+0000 7f52a58a1b80 10 client.15546 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:49.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.362+0000 7f52a58a1b80 1 -- 172.21.15.92:0/1795733320 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c51c1af250 con 0x55c51c40c620 2023-10-16T13:13:49.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.362+0000 7f5276ff5700 1 -- 172.21.15.92:0/1795733320 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5284011d10 con 0x55c51c40c620 2023-10-16T13:13:49.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.362+0000 7f5276ff5700 1 -- 172.21.15.92:0/1795733320 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f528c09ac60 con 0x55c51c40c620 2023-10-16T13:13:49.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.362+0000 7f52a58a1b80 10 client.15546 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:49.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.362+0000 7f52a58a1b80 10 client.15546 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2023-10-16T13:13:49.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.362+0000 7f52a58a1b80 20 client.15546 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:49.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.362+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/1795733320 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c51c47ceb0 0x55c51c47f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.362+0000 7f52a58a1b80 4 client.15546 mds_command: new command op to 24412 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-16T13:13:49.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.362+0000 7f52a58a1b80 1 -- 172.21.15.92:0/1795733320 --> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c51c356e50 con 0x55c51c47ceb0 2023-10-16T13:13:49.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.362+0000 7f5292ffd700 1 --2- 172.21.15.92:0/1795733320 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c51c47ceb0 0x55c51c47f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.363+0000 7f5276ff5700 10 client.15546 ms_handle_connect on v2:172.21.15.152:6832/1273074399 2023-10-16T13:13:49.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.363+0000 7f5292ffd700 1 --2- 172.21.15.92:0/1795733320 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c51c47ceb0 0x55c51c47f2d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=508d178f7bdbecb server_cookie=c5ee238b930a0457 in_seq=0 out_seq=0 2023-10-16T13:13:49.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.363+0000 7f5276ff5700 1 -- 172.21.15.92:0/1795733320 <== mds.4 v2:172.21.15.152:6832/1273074399 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c51c356e50 con 0x55c51c47ceb0 2023-10-16T13:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.363+0000 7f5276ff5700 10 client.15546 handle_command_reply: tid=0 2023-10-16T13:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.363+0000 7f52a58a1b80 1 client.15546 shutdown 2023-10-16T13:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.363+0000 7f52a58a1b80 1 -- 172.21.15.92:0/1795733320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40c620 msgr2=0x55c51c4244c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.363+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/1795733320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40c620 0x55c51c4244c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f528c09b700 tx=0x7f528c007500 comp rx=0 tx=0).stop 2023-10-16T13:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.363+0000 7f52a58a1b80 1 -- 172.21.15.92:0/1795733320 shutdown_connections 2023-10-16T13:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.363+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/1795733320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c51c40c620 0x55c51c4244c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.363+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/1795733320 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c51c47ceb0 0x55c51c47f2d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.363+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/1795733320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c51c40ae20 0x55c51c422f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.363+0000 7f52a58a1b80 1 --2- 172.21.15.92:0/1795733320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c51c40b780 0x55c51c4234b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.363+0000 7f5276ff5700 0 client.15546 ms_handle_reset on v2:172.21.15.152:6832/1273074399 2023-10-16T13:13:49.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.363+0000 7f52a58a1b80 1 -- 172.21.15.92:0/1795733320 >> 172.21.15.92:0/1795733320 conn(0x55c51c338dd0 msgr2=0x55c51c40f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.363+0000 7f52a58a1b80 1 -- 172.21.15.92:0/1795733320 shutdown_connections 2023-10-16T13:13:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.363+0000 7f52a58a1b80 1 -- 172.21.15.92:0/1795733320 wait complete. 2023-10-16T13:13:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.363+0000 7f52a58a1b80 20 client.15546 trim_cache size 0 max 16384 2023-10-16T13:13:49.390 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2023-10-16T13:13:49.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.364+0000 7f52996b7700 1 -- 172.21.15.92:0/1691048075 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f527c0a1480 msgr2=0x7f527c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.364+0000 7f52996b7700 1 --2- 172.21.15.92:0/1691048075 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f527c0a1480 0x7f527c0a3940 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5284005950 tx=0x7f52840058e0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.364+0000 7f52996b7700 1 -- 172.21.15.92:0/1691048075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5294101940 msgr2=0x7f529419e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.364+0000 7f52996b7700 1 --2- 172.21.15.92:0/1691048075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5294101940 0x7f529419e050 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f528c009300 tx=0x7f528c0093e0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.364+0000 7f52996b7700 1 -- 172.21.15.92:0/1691048075 shutdown_connections 2023-10-16T13:13:49.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.364+0000 7f52996b7700 1 --2- 172.21.15.92:0/1691048075 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f527c0a1480 0x7f527c0a3940 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.364+0000 7f52996b7700 1 --2- 172.21.15.92:0/1691048075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5294101940 0x7f529419e050 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.364+0000 7f52996b7700 1 --2- 172.21.15.92:0/1691048075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52940ffdb0 0x7f5294068c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.364+0000 7f52996b7700 1 --2- 172.21.15.92:0/1691048075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5294100fa0 0x7f529419b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.364+0000 7f52996b7700 1 -- 172.21.15.92:0/1691048075 >> 172.21.15.92:0/1691048075 conn(0x7f52940fb320 msgr2=0x7f52940fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.364+0000 7f52996b7700 1 -- 172.21.15.92:0/1691048075 shutdown_connections 2023-10-16T13:13:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.364+0000 7f52996b7700 1 -- 172.21.15.92:0/1691048075 wait complete. 2023-10-16T13:13:49.394 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-16T13:13:49.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:49 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/200653490' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:13:49.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.534+0000 7f8b0f467700 1 -- 172.21.15.92:0/3549626417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b08100a80 msgr2=0x7f8b08100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.534+0000 7f8b0f467700 1 --2- 172.21.15.92:0/3549626417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b08100a80 0x7f8b08100f00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8b0000b0d0 tx=0x7f8b0000b3e0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.534+0000 7f8b0f467700 1 -- 172.21.15.92:0/3549626417 shutdown_connections 2023-10-16T13:13:49.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.534+0000 7f8b0f467700 1 --2- 172.21.15.92:0/3549626417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b08100a80 0x7f8b08100f00 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.534+0000 7f8b0f467700 1 --2- 172.21.15.92:0/3549626417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b080ff760 0x7f8b080ffb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.534+0000 7f8b0f467700 1 --2- 172.21.15.92:0/3549626417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b081000c0 0x7f8b08100540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.534+0000 7f8b0f467700 1 -- 172.21.15.92:0/3549626417 >> 172.21.15.92:0/3549626417 conn(0x7f8b080fb320 msgr2=0x7f8b080fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.534+0000 7f8b0f467700 1 -- 172.21.15.92:0/3549626417 shutdown_connections 2023-10-16T13:13:49.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.534+0000 7f8b0f467700 1 -- 172.21.15.92:0/3549626417 wait complete. 2023-10-16T13:13:49.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.535+0000 7f8b0f467700 1 Processor -- start 2023-10-16T13:13:49.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.535+0000 7f8b0f467700 1 -- start start 2023-10-16T13:13:49.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.535+0000 7f8b0f467700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b080ff760 0x7f8b081990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.535+0000 7f8b0f467700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b081000c0 0x7f8b08199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.535+0000 7f8b0f467700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b08100a80 0x7f8b081a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.535+0000 7f8b0f467700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b081a0c70 con 0x7f8b081000c0 2023-10-16T13:13:49.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.535+0000 7f8b0f467700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b081a0db0 con 0x7f8b080ff760 2023-10-16T13:13:49.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.535+0000 7f8b0f467700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b081a0f40 con 0x7f8b08100a80 2023-10-16T13:13:49.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.535+0000 7f8b0ca02700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b081000c0 0x7f8b08199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.535+0000 7f8b0ca02700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b081000c0 0x7f8b08199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37238/0 (socket says 172.21.15.92:37238) 2023-10-16T13:13:49.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.535+0000 7f8b0ca02700 1 -- 172.21.15.92:0/4247885276 learned_addr learned my addr 172.21.15.92:0/4247885276 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.535+0000 7f8b0d203700 1 --2- 172.21.15.92:0/4247885276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b080ff760 0x7f8b081990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.535+0000 7f8b0da04700 1 --2- 172.21.15.92:0/4247885276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b08100a80 0x7f8b081a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.536+0000 7f8b0ca02700 1 -- 172.21.15.92:0/4247885276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b08100a80 msgr2=0x7f8b081a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.536+0000 7f8b0ca02700 1 --2- 172.21.15.92:0/4247885276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b08100a80 0x7f8b081a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.536+0000 7f8b0ca02700 1 -- 172.21.15.92:0/4247885276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b080ff760 msgr2=0x7f8b081990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.536+0000 7f8b0ca02700 1 --2- 172.21.15.92:0/4247885276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b080ff760 0x7f8b081990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.536+0000 7f8b0ca02700 1 -- 172.21.15.92:0/4247885276 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b00009d00 con 0x7f8b081000c0 2023-10-16T13:13:49.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.536+0000 7f8b0ca02700 1 --2- 172.21.15.92:0/4247885276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b081000c0 0x7f8b08199630 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8af800e9a0 tx=0x7f8af800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.536+0000 7f8afe7fc700 1 -- 172.21.15.92:0/4247885276 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8009790 con 0x7f8b081000c0 2023-10-16T13:13:49.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.536+0000 7f8afe7fc700 1 -- 172.21.15.92:0/4247885276 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8af800cbd0 con 0x7f8b081000c0 2023-10-16T13:13:49.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.536+0000 7f8b0f467700 1 -- 172.21.15.92:0/4247885276 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b081a1220 con 0x7f8b081000c0 2023-10-16T13:13:49.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.536+0000 7f8afe7fc700 1 -- 172.21.15.92:0/4247885276 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8018680 con 0x7f8b081000c0 2023-10-16T13:13:49.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.536+0000 7f8b0f467700 1 -- 172.21.15.92:0/4247885276 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b081a1730 con 0x7f8b081000c0 2023-10-16T13:13:49.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.539+0000 7f8afe7fc700 1 -- 172.21.15.92:0/4247885276 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8af80188a0 con 0x7f8b081000c0 2023-10-16T13:13:49.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.540+0000 7f8afe7fc700 1 --2- 172.21.15.92:0/4247885276 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f8af40a1480 0x7f8af40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.540+0000 7f8b0d203700 1 --2- 172.21.15.92:0/4247885276 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f8af40a1480 0x7f8af40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.540+0000 7f8afe7fc700 1 -- 172.21.15.92:0/4247885276 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f8af8014070 con 0x7f8b081000c0 2023-10-16T13:13:49.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.540+0000 7f8b0d203700 1 --2- 172.21.15.92:0/4247885276 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f8af40a1480 0x7f8af40a3940 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009c60 tx=0x7f8b04009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.541+0000 7f8b1b651b80 1 Processor -- start 2023-10-16T13:13:49.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.541+0000 7f8b1b651b80 1 -- start start 2023-10-16T13:13:49.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8b1b651b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330be20 0x55a43330c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8b1b651b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330c780 0x55a43330d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8b1b651b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330d620 0x55a43330daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8b1b651b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a433280c70 con 0x55a43330be20 2023-10-16T13:13:49.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8b1b651b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a433265c60 con 0x55a43330d620 2023-10-16T13:13:49.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8b1b651b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a433263580 con 0x55a43330c780 2023-10-16T13:13:49.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8b0d203700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330be20 0x55a43330c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8b0d203700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330be20 0x55a43330c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37244/0 (socket says 172.21.15.92:37244) 2023-10-16T13:13:49.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8b0d203700 1 -- 172.21.15.92:0/2027055518 learned_addr learned my addr 172.21.15.92:0/2027055518 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8b0ca02700 1 --2- 172.21.15.92:0/2027055518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330c780 0x55a43330d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8b0d203700 1 -- 172.21.15.92:0/2027055518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330c780 msgr2=0x55a43330d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8b0d203700 1 --2- 172.21.15.92:0/2027055518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330c780 0x55a43330d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8b0d203700 1 -- 172.21.15.92:0/2027055518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330d620 msgr2=0x55a43330daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8b0d203700 1 --2- 172.21.15.92:0/2027055518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330d620 0x55a43330daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8b0d203700 1 -- 172.21.15.92:0/2027055518 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a43321c3f0 con 0x55a43330be20 2023-10-16T13:13:49.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8b0ca02700 1 --2- 172.21.15.92:0/2027055518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330c780 0x55a43330d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:49.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8b0d203700 1 --2- 172.21.15.92:0/2027055518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330be20 0x55a43330c240 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400e4e0 tx=0x7f8b04014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1468a38f7223492 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8af37fe700 1 -- 172.21.15.92:0/2027055518 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b04026430 con 0x55a43330be20 2023-10-16T13:13:49.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8af37fe700 1 -- 172.21.15.92:0/2027055518 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8b04021070 con 0x55a43330be20 2023-10-16T13:13:49.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.542+0000 7f8af37fe700 1 -- 172.21.15.92:0/2027055518 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0401d7f0 con 0x55a43330be20 2023-10-16T13:13:49.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.543+0000 7f8b1b651b80 1 -- 172.21.15.92:0/2027055518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330be20 msgr2=0x55a43330c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.543+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/2027055518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330be20 0x55a43330c240 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400e4e0 tx=0x7f8b04014000 comp rx=0 tx=0).stop 2023-10-16T13:13:49.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.543+0000 7f8b1b651b80 1 -- 172.21.15.92:0/2027055518 shutdown_connections 2023-10-16T13:13:49.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.543+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/2027055518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330be20 0x55a43330c240 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.543+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/2027055518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330d620 0x55a43330daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.543+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/2027055518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330c780 0x55a43330d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.543+0000 7f8b1b651b80 1 -- 172.21.15.92:0/2027055518 >> 172.21.15.92:0/2027055518 conn(0x55a433239dd0 msgr2=0x55a433306fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.543+0000 7f8b1b651b80 1 -- 172.21.15.92:0/2027055518 shutdown_connections 2023-10-16T13:13:49.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.544+0000 7f8b1b651b80 1 -- 172.21.15.92:0/2027055518 wait complete. 2023-10-16T13:13:49.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.544+0000 7f8b1b651b80 1 -- start start 2023-10-16T13:13:49.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.544+0000 7f8b1b651b80 1 Processor -- start 2023-10-16T13:13:49.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.544+0000 7f8b1b651b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330be20 0x55a433315cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.544+0000 7f8b1b651b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330c780 0x55a433316210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.544+0000 7f8b1b651b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330d620 0x55a43331d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.544+0000 7f8b1b651b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a43325ee70 con 0x55a43330d620 2023-10-16T13:13:49.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.544+0000 7f8b1b651b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4331fb710 con 0x55a43330be20 2023-10-16T13:13:49.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.544+0000 7f8b1b651b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4331fb3b0 con 0x55a43330c780 2023-10-16T13:13:49.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.544+0000 7f8b1b651b80 10 client.0 _ll_register_callbacks cb 0x55a433058800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:49.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.545+0000 7f8b0d203700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330be20 0x55a433315cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.545+0000 7f8b0d203700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330be20 0x55a433315cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:38058/0 (socket says 172.21.15.92:38058) 2023-10-16T13:13:49.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.545+0000 7f8b0da04700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330d620 0x55a43331d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.545+0000 7f8b0d203700 1 -- 172.21.15.92:0/2736751737 learned_addr learned my addr 172.21.15.92:0/2736751737 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.545+0000 7f8b0ca02700 1 --2- 172.21.15.92:0/2736751737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330c780 0x55a433316210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.545+0000 7f8b0d203700 1 -- 172.21.15.92:0/2736751737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330c780 msgr2=0x55a433316210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.545+0000 7f8b0d203700 1 --2- 172.21.15.92:0/2736751737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330c780 0x55a433316210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.545+0000 7f8b0d203700 1 -- 172.21.15.92:0/2736751737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330d620 msgr2=0x55a43331d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.545+0000 7f8b0d203700 1 --2- 172.21.15.92:0/2736751737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330d620 0x55a43331d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.545+0000 7f8b0d203700 1 -- 172.21.15.92:0/2736751737 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b04017070 con 0x55a43330be20 2023-10-16T13:13:49.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.545+0000 7f8b0d203700 1 --2- 172.21.15.92:0/2736751737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330be20 0x55a433315cd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8b04005950 tx=0x7f8b0400ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=329726f0f89f4bdb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.545+0000 7f8af0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-16T13:13:49.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.545+0000 7f8af0ff9700 1 -- 172.21.15.92:0/2736751737 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b040052d0 con 0x55a43330be20 2023-10-16T13:13:49.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.545+0000 7f8b1b651b80 1 -- 172.21.15.92:0/2736751737 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a433263ef0 con 0x55a43330be20 2023-10-16T13:13:49.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.545+0000 7f8af0ff9700 1 -- 172.21.15.92:0/2736751737 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f8b04005430 con 0x55a43330be20 2023-10-16T13:13:49.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.546+0000 7f8af0ff9700 1 -- 172.21.15.92:0/2736751737 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b040055f0 con 0x55a43330be20 2023-10-16T13:13:49.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.546+0000 7f8b1b651b80 10 client.25148 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:49.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.546+0000 7f8b1b651b80 1 -- 172.21.15.92:0/2736751737 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a433089de0 con 0x55a43330be20 2023-10-16T13:13:49.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.546+0000 7f8af0ff9700 1 -- 172.21.15.92:0/2736751737 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55a433263ef0 con 0x55a43330be20 2023-10-16T13:13:49.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.546+0000 7f8af0ff9700 1 -- 172.21.15.92:0/2736751737 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8b04003a90 con 0x55a43330be20 2023-10-16T13:13:49.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.546+0000 7f8b1b651b80 10 client.25148 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:49.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.546+0000 7f8b1b651b80 10 client.25148 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-10-16T13:13:49.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.546+0000 7f8b1b651b80 20 client.25148 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:49.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.546+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/2736751737 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x55a433321990 0x55a433323db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.546+0000 7f8b1b651b80 4 client.25148 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:13:49.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.546+0000 7f8b1b651b80 1 -- 172.21.15.92:0/2736751737 --> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a4332dbc10 con 0x55a433321990 2023-10-16T13:13:49.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.546+0000 7f8b0ca02700 1 --2- 172.21.15.92:0/2736751737 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x55a433321990 0x55a433323db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.547+0000 7f8af0ff9700 10 client.25148 ms_handle_connect on v2:172.21.15.118:6834/2381374755 2023-10-16T13:13:49.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.547+0000 7f8b0ca02700 1 --2- 172.21.15.92:0/2736751737 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x55a433321990 0x55a433323db0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5e6df5d490967608 server_cookie=b95360113c4584d9 in_seq=0 out_seq=0 2023-10-16T13:13:49.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.547+0000 7f8af0ff9700 1 -- 172.21.15.92:0/2736751737 <== mds.3 v2:172.21.15.118:6834/2381374755 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a4332dbc10 con 0x55a433321990 2023-10-16T13:13:49.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.547+0000 7f8af0ff9700 10 client.25148 handle_command_reply: tid=0 2023-10-16T13:13:49.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.547+0000 7f8b1b651b80 1 client.25148 shutdown 2023-10-16T13:13:49.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.548+0000 7f8b1b651b80 1 -- 172.21.15.92:0/2736751737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330be20 msgr2=0x55a433315cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.548+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/2736751737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330be20 0x55a433315cd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8b04005950 tx=0x7f8b0400ee30 comp rx=0 tx=0).stop 2023-10-16T13:13:49.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.548+0000 7f8b1b651b80 1 -- 172.21.15.92:0/2736751737 shutdown_connections 2023-10-16T13:13:49.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.548+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/2736751737 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x55a433321990 0x55a433323db0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.548+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/2736751737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330d620 0x55a43331d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.548+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/2736751737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330be20 0x55a433315cd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.548+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/2736751737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330c780 0x55a433316210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.548+0000 7f8b1b651b80 1 -- 172.21.15.92:0/2736751737 >> 172.21.15.92:0/2736751737 conn(0x55a433239dd0 msgr2=0x55a433306bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.548+0000 7f8af0ff9700 0 client.25148 ms_handle_reset on v2:172.21.15.118:6834/2381374755 2023-10-16T13:13:49.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.548+0000 7f8b1b651b80 1 -- 172.21.15.92:0/2736751737 shutdown_connections 2023-10-16T13:13:49.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.548+0000 7f8b1b651b80 1 -- 172.21.15.92:0/2736751737 wait complete. 2023-10-16T13:13:49.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.548+0000 7f8b1b651b80 20 client.25148 trim_cache size 0 max 16384 2023-10-16T13:13:49.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.568+0000 7f8b1b651b80 1 Processor -- start 2023-10-16T13:13:49.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.568+0000 7f8b1b651b80 1 -- start start 2023-10-16T13:13:49.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.568+0000 7f8b1b651b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330be20 0x55a433308be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.568+0000 7f8b1b651b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330c780 0x55a43331d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.568+0000 7f8b1b651b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330d620 0x55a4333239a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.568+0000 7f8b1b651b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4330df920 con 0x55a43330c780 2023-10-16T13:13:49.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.568+0000 7f8b1b651b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4333158a0 con 0x55a43330d620 2023-10-16T13:13:49.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.568+0000 7f8b1b651b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a433321480 con 0x55a43330be20 2023-10-16T13:13:49.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.568+0000 7f8b0ca02700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330c780 0x55a43331d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.568+0000 7f8b0ca02700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330c780 0x55a43331d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37260/0 (socket says 172.21.15.92:37260) 2023-10-16T13:13:49.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.568+0000 7f8b0ca02700 1 -- 172.21.15.92:0/913168740 learned_addr learned my addr 172.21.15.92:0/913168740 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.568+0000 7f8b0d203700 1 --2- 172.21.15.92:0/913168740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330be20 0x55a433308be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.568+0000 7f8b0da04700 1 --2- 172.21.15.92:0/913168740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330d620 0x55a4333239a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.574 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.568+0000 7f8b0ca02700 1 -- 172.21.15.92:0/913168740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330be20 msgr2=0x55a433308be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.574 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.568+0000 7f8b0ca02700 1 --2- 172.21.15.92:0/913168740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330be20 0x55a433308be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.574 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.568+0000 7f8b0ca02700 1 -- 172.21.15.92:0/913168740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330d620 msgr2=0x55a4333239a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.574 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.568+0000 7f8b0ca02700 1 --2- 172.21.15.92:0/913168740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330d620 0x55a4333239a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.574 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.569+0000 7f8b0ca02700 1 -- 172.21.15.92:0/913168740 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a433303580 con 0x55a43330c780 2023-10-16T13:13:49.575 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.569+0000 7f8b0ca02700 1 --2- 172.21.15.92:0/913168740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330c780 0x55a43331d210 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8af800c5b0 tx=0x7f8af80cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f84246f9b0d80e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.575 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.569+0000 7f8af3fff700 1 -- 172.21.15.92:0/913168740 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af80b0070 con 0x55a43330c780 2023-10-16T13:13:49.575 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.569+0000 7f8af3fff700 1 -- 172.21.15.92:0/913168740 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8af80b2070 con 0x55a43330c780 2023-10-16T13:13:49.575 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.569+0000 7f8af3fff700 1 -- 172.21.15.92:0/913168740 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8098650 con 0x55a43330c780 2023-10-16T13:13:49.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.570+0000 7f8b1b651b80 1 -- 172.21.15.92:0/913168740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330c780 msgr2=0x55a43331d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.570+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/913168740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330c780 0x55a43331d210 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8af800c5b0 tx=0x7f8af80cc040 comp rx=0 tx=0).stop 2023-10-16T13:13:49.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.570+0000 7f8b1b651b80 1 -- 172.21.15.92:0/913168740 shutdown_connections 2023-10-16T13:13:49.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.570+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/913168740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330d620 0x55a4333239a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.570+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/913168740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330be20 0x55a433308be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.570+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/913168740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330c780 0x55a43331d210 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.570+0000 7f8b1b651b80 1 -- 172.21.15.92:0/913168740 >> 172.21.15.92:0/913168740 conn(0x55a433239dd0 msgr2=0x55a433306240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.570+0000 7f8b1b651b80 1 -- 172.21.15.92:0/913168740 shutdown_connections 2023-10-16T13:13:49.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.570+0000 7f8b1b651b80 1 -- 172.21.15.92:0/913168740 wait complete. 2023-10-16T13:13:49.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.570+0000 7f8b1b651b80 1 -- start start 2023-10-16T13:13:49.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.570+0000 7f8b1b651b80 1 Processor -- start 2023-10-16T13:13:49.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8b1b651b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330be20 0x55a433318a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8b1b651b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330c780 0x55a433318f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8b1b651b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330d620 0x55a43331be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8b1b651b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a43331c3c0 con 0x55a43330be20 2023-10-16T13:13:49.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8b1b651b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a43331c530 con 0x55a43330d620 2023-10-16T13:13:49.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8b1b651b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a43331c6f0 con 0x55a43330c780 2023-10-16T13:13:49.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8b1b651b80 10 client.0 _ll_register_callbacks cb 0x7f8b0400e3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:49.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8b0d203700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330be20 0x55a433318a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8b0d203700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330be20 0x55a433318a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37264/0 (socket says 172.21.15.92:37264) 2023-10-16T13:13:49.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8b0d203700 1 -- 172.21.15.92:0/966537947 learned_addr learned my addr 172.21.15.92:0/966537947 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8b0ca02700 1 --2- 172.21.15.92:0/966537947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330c780 0x55a433318f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8b0d203700 1 -- 172.21.15.92:0/966537947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330c780 msgr2=0x55a433318f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8b0da04700 1 --2- 172.21.15.92:0/966537947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330d620 0x55a43331be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8b0d203700 1 --2- 172.21.15.92:0/966537947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330c780 0x55a433318f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8b0d203700 1 -- 172.21.15.92:0/966537947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330d620 msgr2=0x55a43331be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8b0d203700 1 --2- 172.21.15.92:0/966537947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330d620 0x55a43331be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8b0d203700 1 -- 172.21.15.92:0/966537947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b081a1730 con 0x55a43330be20 2023-10-16T13:13:49.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8b0ca02700 1 --2- 172.21.15.92:0/966537947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330c780 0x55a433318f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:49.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8af0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:49.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.571+0000 7f8b0d203700 1 --2- 172.21.15.92:0/966537947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330be20 0x55a433318a00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8b04016040 tx=0x7f8b04005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c94b21d9a28430 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.572+0000 7f8af0ff9700 1 -- 172.21.15.92:0/966537947 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b040092d0 con 0x55a43330be20 2023-10-16T13:13:49.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.572+0000 7f8af0ff9700 1 -- 172.21.15.92:0/966537947 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f8b0401ce00 con 0x55a43330be20 2023-10-16T13:13:49.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.572+0000 7f8b1b651b80 1 -- 172.21.15.92:0/966537947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8b04021070 con 0x55a43330be20 2023-10-16T13:13:49.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.572+0000 7f8af0ff9700 1 -- 172.21.15.92:0/966537947 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b04003890 con 0x55a43330be20 2023-10-16T13:13:49.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.572+0000 7f8b1b651b80 10 client.15564 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:49.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.572+0000 7f8b1b651b80 1 -- 172.21.15.92:0/966537947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a433072c60 con 0x55a43330be20 2023-10-16T13:13:49.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.572+0000 7f8af0ff9700 1 -- 172.21.15.92:0/966537947 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8b04021070 con 0x55a43330be20 2023-10-16T13:13:49.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.572+0000 7f8af0ff9700 1 -- 172.21.15.92:0/966537947 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8b0401d5d0 con 0x55a43330be20 2023-10-16T13:13:49.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.572+0000 7f8b1b651b80 10 client.15564 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:49.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.572+0000 7f8b1b651b80 10 client.15564 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-10-16T13:13:49.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.572+0000 7f8b1b651b80 20 client.15564 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:49.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.572+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/966537947 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x55a433386e40 0x55a433389260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.572+0000 7f8b1b651b80 4 client.15564 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-16T13:13:49.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.572+0000 7f8b1b651b80 1 -- 172.21.15.92:0/966537947 --> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a433257e50 con 0x55a433386e40 2023-10-16T13:13:49.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.573+0000 7f8b0ca02700 1 --2- 172.21.15.92:0/966537947 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x55a433386e40 0x55a433389260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.573+0000 7f8b0ca02700 1 --2- 172.21.15.92:0/966537947 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x55a433386e40 0x55a433389260 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fc241908db42ac5f server_cookie=a7a1dbbb483cee31 in_seq=0 out_seq=0 2023-10-16T13:13:49.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.573+0000 7f8af0ff9700 10 client.15564 ms_handle_connect on v2:172.21.15.118:6834/2381374755 2023-10-16T13:13:49.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.573+0000 7f8af0ff9700 1 -- 172.21.15.92:0/966537947 <== mds.3 v2:172.21.15.118:6834/2381374755 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a433257e50 con 0x55a433386e40 2023-10-16T13:13:49.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.573+0000 7f8af0ff9700 10 client.15564 handle_command_reply: tid=0 2023-10-16T13:13:49.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.573+0000 7f8b1b651b80 1 client.15564 shutdown 2023-10-16T13:13:49.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.574+0000 7f8b1b651b80 1 -- 172.21.15.92:0/966537947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330be20 msgr2=0x55a433318a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.574+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/966537947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330be20 0x55a433318a00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8b04016040 tx=0x7f8b04005bb0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.574+0000 7f8b1b651b80 1 -- 172.21.15.92:0/966537947 shutdown_connections 2023-10-16T13:13:49.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.574+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/966537947 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x55a433386e40 0x55a433389260 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.574+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/966537947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a43330be20 0x55a433318a00 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.574+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/966537947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a43330d620 0x55a43331be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.574+0000 7f8b1b651b80 1 --2- 172.21.15.92:0/966537947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a43330c780 0x55a433318f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.574+0000 7f8b1b651b80 1 -- 172.21.15.92:0/966537947 >> 172.21.15.92:0/966537947 conn(0x55a433239dd0 msgr2=0x55a4333239a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.574+0000 7f8af0ff9700 0 client.15564 ms_handle_reset on v2:172.21.15.118:6834/2381374755 2023-10-16T13:13:49.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.574+0000 7f8b1b651b80 1 -- 172.21.15.92:0/966537947 shutdown_connections 2023-10-16T13:13:49.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.574+0000 7f8b1b651b80 1 -- 172.21.15.92:0/966537947 wait complete. 2023-10-16T13:13:49.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.574+0000 7f8b1b651b80 20 client.15564 trim_cache size 0 max 16384 2023-10-16T13:13:49.591 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2023-10-16T13:13:49.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.574+0000 7f8b0f467700 1 -- 172.21.15.92:0/4247885276 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f8af40a1480 msgr2=0x7f8af40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.574+0000 7f8b0f467700 1 --2- 172.21.15.92:0/4247885276 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f8af40a1480 0x7f8af40a3940 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009c60 tx=0x7f8b04009260 comp rx=0 tx=0).stop 2023-10-16T13:13:49.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.575+0000 7f8b0f467700 1 -- 172.21.15.92:0/4247885276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b081000c0 msgr2=0x7f8b08199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.575+0000 7f8b0f467700 1 --2- 172.21.15.92:0/4247885276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b081000c0 0x7f8b08199630 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8af800e9a0 tx=0x7f8af800ecb0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.576+0000 7f8b0f467700 1 -- 172.21.15.92:0/4247885276 shutdown_connections 2023-10-16T13:13:49.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.576+0000 7f8b0f467700 1 --2- 172.21.15.92:0/4247885276 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f8af40a1480 0x7f8af40a3940 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.576+0000 7f8b0f467700 1 --2- 172.21.15.92:0/4247885276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b08100a80 0x7f8b081a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.576+0000 7f8b0f467700 1 --2- 172.21.15.92:0/4247885276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b080ff760 0x7f8b081990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.576+0000 7f8b0f467700 1 --2- 172.21.15.92:0/4247885276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b081000c0 0x7f8b08199630 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.576+0000 7f8b0f467700 1 -- 172.21.15.92:0/4247885276 >> 172.21.15.92:0/4247885276 conn(0x7f8b080fb320 msgr2=0x7f8b080fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.576+0000 7f8b0f467700 1 -- 172.21.15.92:0/4247885276 shutdown_connections 2023-10-16T13:13:49.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.576+0000 7f8b0f467700 1 -- 172.21.15.92:0/4247885276 wait complete. 2023-10-16T13:13:49.595 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-16T13:13:49.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:49 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/200653490' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:13:49.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.718+0000 7f2769f17700 1 -- 172.21.15.92:0/370479329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2764106c20 msgr2=0x7f2764109030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.718+0000 7f2769f17700 1 --2- 172.21.15.92:0/370479329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2764106c20 0x7f2764109030 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f275c00b0a0 tx=0x7f275c00b3b0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.718+0000 7f2769f17700 1 -- 172.21.15.92:0/370479329 shutdown_connections 2023-10-16T13:13:49.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.718+0000 7f2769f17700 1 --2- 172.21.15.92:0/370479329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2764106c20 0x7f2764109030 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.718+0000 7f2769f17700 1 --2- 172.21.15.92:0/370479329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27641019c0 0x7f2764103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.718+0000 7f2769f17700 1 --2- 172.21.15.92:0/370479329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27641042f0 0x7f27641066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.718+0000 7f2769f17700 1 -- 172.21.15.92:0/370479329 >> 172.21.15.92:0/370479329 conn(0x7f27640fb310 msgr2=0x7f27640fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.718+0000 7f2769f17700 1 -- 172.21.15.92:0/370479329 shutdown_connections 2023-10-16T13:13:49.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.718+0000 7f2769f17700 1 -- 172.21.15.92:0/370479329 wait complete. 2023-10-16T13:13:49.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f2769f17700 1 Processor -- start 2023-10-16T13:13:49.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f2769f17700 1 -- start start 2023-10-16T13:13:49.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f2769f17700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27641019c0 0x7f2764196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f2769f17700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27641042f0 0x7f27641971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f2769f17700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2764106c20 0x7f276419e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f2769f17700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276419e800 con 0x7f2764106c20 2023-10-16T13:13:49.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f2769f17700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276419e970 con 0x7f27641042f0 2023-10-16T13:13:49.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f2769f17700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276419eb30 con 0x7f27641019c0 2023-10-16T13:13:49.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f2763fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2764106c20 0x7f276419e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f2763fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2764106c20 0x7f276419e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37282/0 (socket says 172.21.15.92:37282) 2023-10-16T13:13:49.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f2763fff700 1 -- 172.21.15.92:0/4246902546 learned_addr learned my addr 172.21.15.92:0/4246902546 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f27637fe700 1 --2- 172.21.15.92:0/4246902546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27641019c0 0x7f2764196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f2762ffd700 1 --2- 172.21.15.92:0/4246902546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27641042f0 0x7f27641971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f2763fff700 1 -- 172.21.15.92:0/4246902546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27641019c0 msgr2=0x7f2764196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f2763fff700 1 --2- 172.21.15.92:0/4246902546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27641019c0 0x7f2764196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f2763fff700 1 -- 172.21.15.92:0/4246902546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27641042f0 msgr2=0x7f27641971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f2763fff700 1 --2- 172.21.15.92:0/4246902546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27641042f0 0x7f27641971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f2763fff700 1 -- 172.21.15.92:0/4246902546 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c009d00 con 0x7f2764106c20 2023-10-16T13:13:49.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f27637fe700 1 --2- 172.21.15.92:0/4246902546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27641019c0 0x7f2764196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:49.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.719+0000 7f2762ffd700 1 --2- 172.21.15.92:0/4246902546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27641042f0 0x7f27641971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:49.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.720+0000 7f2763fff700 1 --2- 172.21.15.92:0/4246902546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2764106c20 0x7f276419e230 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f275c009fd0 tx=0x7f275c004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.720+0000 7f2760ff9700 1 -- 172.21.15.92:0/4246902546 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c00e040 con 0x7f2764106c20 2023-10-16T13:13:49.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.720+0000 7f2769f17700 1 -- 172.21.15.92:0/4246902546 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276419edb0 con 0x7f2764106c20 2023-10-16T13:13:49.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.720+0000 7f2760ff9700 1 -- 172.21.15.92:0/4246902546 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f275c009440 con 0x7f2764106c20 2023-10-16T13:13:49.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.720+0000 7f2760ff9700 1 -- 172.21.15.92:0/4246902546 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c004280 con 0x7f2764106c20 2023-10-16T13:13:49.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.720+0000 7f2769f17700 1 -- 172.21.15.92:0/4246902546 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276419f1d0 con 0x7f2764106c20 2023-10-16T13:13:49.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.722+0000 7f2760ff9700 1 -- 172.21.15.92:0/4246902546 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f275c01d820 con 0x7f2764106c20 2023-10-16T13:13:49.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.722+0000 7f2760ff9700 1 --2- 172.21.15.92:0/4246902546 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f274c0a1480 0x7f274c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.723+0000 7f27637fe700 1 --2- 172.21.15.92:0/4246902546 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f274c0a1480 0x7f274c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.723+0000 7f2760ff9700 1 -- 172.21.15.92:0/4246902546 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f275c0ce430 con 0x7f2764106c20 2023-10-16T13:13:49.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.723+0000 7f27637fe700 1 --2- 172.21.15.92:0/4246902546 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f274c0a1480 0x7f274c0a3940 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2764197b60 tx=0x7f275400a680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.724+0000 7f2776101b80 1 Processor -- start 2023-10-16T13:13:49.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.724+0000 7f2776101b80 1 -- start start 2023-10-16T13:13:49.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.724+0000 7f2776101b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b79e20 0x5597b6b7a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.724+0000 7f2776101b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7a780 0x5597b6b7b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.724+0000 7f2776101b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7b620 0x5597b6b7baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.724+0000 7f2776101b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597b6aeec70 con 0x5597b6b7a780 2023-10-16T13:13:49.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.724+0000 7f2776101b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597b6ad3c60 con 0x5597b6b7b620 2023-10-16T13:13:49.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.724+0000 7f2776101b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597b6ad1580 con 0x5597b6b79e20 2023-10-16T13:13:49.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.724+0000 7f2762ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7a780 0x5597b6b7b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.724+0000 7f2762ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7a780 0x5597b6b7b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37288/0 (socket says 172.21.15.92:37288) 2023-10-16T13:13:49.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.724+0000 7f2762ffd700 1 -- 172.21.15.92:0/3820921820 learned_addr learned my addr 172.21.15.92:0/3820921820 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.724+0000 7f27637fe700 1 --2- 172.21.15.92:0/3820921820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b79e20 0x5597b6b7a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.724+0000 7f2763fff700 1 --2- 172.21.15.92:0/3820921820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7b620 0x5597b6b7baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.724+0000 7f2762ffd700 1 -- 172.21.15.92:0/3820921820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b79e20 msgr2=0x5597b6b7a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.724+0000 7f2762ffd700 1 --2- 172.21.15.92:0/3820921820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b79e20 0x5597b6b7a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.724+0000 7f2762ffd700 1 -- 172.21.15.92:0/3820921820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7b620 msgr2=0x5597b6b7baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.724+0000 7f2762ffd700 1 --2- 172.21.15.92:0/3820921820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7b620 0x5597b6b7baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.724+0000 7f2762ffd700 1 -- 172.21.15.92:0/3820921820 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597b6a8a3f0 con 0x5597b6b7a780 2023-10-16T13:13:49.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.725+0000 7f2762ffd700 1 --2- 172.21.15.92:0/3820921820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7a780 0x5597b6b7b040 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f275800bbe0 tx=0x7f275800bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ca6688e8fd8de2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.725+0000 7f2749ffb700 1 -- 172.21.15.92:0/3820921820 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275800ddb0 con 0x5597b6b7a780 2023-10-16T13:13:49.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.725+0000 7f2749ffb700 1 -- 172.21.15.92:0/3820921820 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f275800b690 con 0x5597b6b7a780 2023-10-16T13:13:49.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.725+0000 7f2749ffb700 1 -- 172.21.15.92:0/3820921820 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275800f870 con 0x5597b6b7a780 2023-10-16T13:13:49.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.725+0000 7f2776101b80 1 -- 172.21.15.92:0/3820921820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7a780 msgr2=0x5597b6b7b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.725+0000 7f2776101b80 1 --2- 172.21.15.92:0/3820921820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7a780 0x5597b6b7b040 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f275800bbe0 tx=0x7f275800bef0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.726+0000 7f2776101b80 1 -- 172.21.15.92:0/3820921820 shutdown_connections 2023-10-16T13:13:49.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.726+0000 7f2776101b80 1 --2- 172.21.15.92:0/3820921820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7b620 0x5597b6b7baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.726+0000 7f2776101b80 1 --2- 172.21.15.92:0/3820921820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b79e20 0x5597b6b7a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.726+0000 7f2776101b80 1 --2- 172.21.15.92:0/3820921820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7a780 0x5597b6b7b040 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.726+0000 7f2776101b80 1 -- 172.21.15.92:0/3820921820 >> 172.21.15.92:0/3820921820 conn(0x5597b6aa7dd0 msgr2=0x5597b6b74fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.726+0000 7f2776101b80 1 -- 172.21.15.92:0/3820921820 shutdown_connections 2023-10-16T13:13:49.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.726+0000 7f2776101b80 1 -- 172.21.15.92:0/3820921820 wait complete. 2023-10-16T13:13:49.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.726+0000 7f2776101b80 1 -- start start 2023-10-16T13:13:49.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.726+0000 7f2776101b80 1 Processor -- start 2023-10-16T13:13:49.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.726+0000 7f2776101b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b79e20 0x5597b6b83c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.726+0000 7f2776101b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7a780 0x5597b6b84160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.726+0000 7f2776101b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7b620 0x5597b6b8b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.726+0000 7f2776101b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597b6acce70 con 0x5597b6b7b620 2023-10-16T13:13:49.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.726+0000 7f2776101b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597b6a69710 con 0x5597b6b7a780 2023-10-16T13:13:49.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.726+0000 7f2776101b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597b6a693b0 con 0x5597b6b79e20 2023-10-16T13:13:49.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.726+0000 7f2776101b80 10 client.0 _ll_register_callbacks cb 0x5597b68c6800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:49.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.726+0000 7f2763fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7b620 0x5597b6b8b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.727+0000 7f2763fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7b620 0x5597b6b8b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37296/0 (socket says 172.21.15.92:37296) 2023-10-16T13:13:49.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.727+0000 7f2763fff700 1 -- 172.21.15.92:0/3947698106 learned_addr learned my addr 172.21.15.92:0/3947698106 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.727+0000 7f27637fe700 1 --2- 172.21.15.92:0/3947698106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b79e20 0x5597b6b83c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.727+0000 7f2762ffd700 1 --2- 172.21.15.92:0/3947698106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7a780 0x5597b6b84160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.727+0000 7f2763fff700 1 -- 172.21.15.92:0/3947698106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b79e20 msgr2=0x5597b6b83c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.727+0000 7f2763fff700 1 --2- 172.21.15.92:0/3947698106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b79e20 0x5597b6b83c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.727+0000 7f2763fff700 1 -- 172.21.15.92:0/3947698106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7a780 msgr2=0x5597b6b84160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.727+0000 7f2763fff700 1 --2- 172.21.15.92:0/3947698106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7a780 0x5597b6b84160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.727+0000 7f2763fff700 1 -- 172.21.15.92:0/3947698106 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275800b810 con 0x5597b6b7b620 2023-10-16T13:13:49.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.727+0000 7f2763fff700 1 --2- 172.21.15.92:0/3947698106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7b620 0x5597b6b8b1a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f275c09b4e0 tx=0x7f275c0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9bfcff2b915530 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.727+0000 7f2742ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:49.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.727+0000 7f2742ffd700 1 -- 172.21.15.92:0/3947698106 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c09bee0 con 0x5597b6b7b620 2023-10-16T13:13:49.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.727+0000 7f2742ffd700 1 -- 172.21.15.92:0/3947698106 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f275c09b7e0 con 0x5597b6b7b620 2023-10-16T13:13:49.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.727+0000 7f2776101b80 1 -- 172.21.15.92:0/3947698106 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5597b6b49c10 con 0x5597b6b7b620 2023-10-16T13:13:49.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.727+0000 7f2742ffd700 1 -- 172.21.15.92:0/3947698106 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f275c09f930 con 0x5597b6b7b620 2023-10-16T13:13:49.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.727+0000 7f2776101b80 10 client.15576 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:49.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.727+0000 7f2776101b80 1 -- 172.21.15.92:0/3947698106 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5597b68f7de0 con 0x5597b6b7b620 2023-10-16T13:13:49.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.727+0000 7f2742ffd700 1 -- 172.21.15.92:0/3947698106 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5597b6b49c10 con 0x5597b6b7b620 2023-10-16T13:13:49.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.728+0000 7f2742ffd700 1 -- 172.21.15.92:0/3947698106 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f275c0b6020 con 0x5597b6b7b620 2023-10-16T13:13:49.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.728+0000 7f2776101b80 10 client.15576 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:49.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.728+0000 7f2776101b80 10 client.15576 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-10-16T13:13:49.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.728+0000 7f2776101b80 20 client.15576 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:49.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.728+0000 7f2776101b80 1 --2- 172.21.15.92:0/3947698106 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x5597b6b8f720 0x5597b6b91b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.728+0000 7f2776101b80 4 client.15576 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:13:49.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.728+0000 7f2776101b80 1 -- 172.21.15.92:0/3947698106 --> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5597b6ac5e50 con 0x5597b6b8f720 2023-10-16T13:13:49.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.728+0000 7f27637fe700 1 --2- 172.21.15.92:0/3947698106 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x5597b6b8f720 0x5597b6b91b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.728+0000 7f2742ffd700 10 client.15576 ms_handle_connect on v2:172.21.15.152:6834/1393840132 2023-10-16T13:13:49.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.728+0000 7f27637fe700 1 --2- 172.21.15.92:0/3947698106 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x5597b6b8f720 0x5597b6b91b10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d0ac8e949ed9d61 server_cookie=6f0fbd9628924986 in_seq=0 out_seq=0 2023-10-16T13:13:49.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.729+0000 7f2742ffd700 1 -- 172.21.15.92:0/3947698106 <== mds.2 v2:172.21.15.152:6834/1393840132 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5597b6ac5e50 con 0x5597b6b8f720 2023-10-16T13:13:49.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.729+0000 7f2742ffd700 10 client.15576 handle_command_reply: tid=0 2023-10-16T13:13:49.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.729+0000 7f2776101b80 1 client.15576 shutdown 2023-10-16T13:13:49.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.729+0000 7f2776101b80 1 -- 172.21.15.92:0/3947698106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7b620 msgr2=0x5597b6b8b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.729+0000 7f2776101b80 1 --2- 172.21.15.92:0/3947698106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7b620 0x5597b6b8b1a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f275c09b4e0 tx=0x7f275c0099e0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.729+0000 7f2776101b80 1 -- 172.21.15.92:0/3947698106 shutdown_connections 2023-10-16T13:13:49.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.729+0000 7f2776101b80 1 --2- 172.21.15.92:0/3947698106 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x5597b6b8f720 0x5597b6b91b10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.729+0000 7f2776101b80 1 --2- 172.21.15.92:0/3947698106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7b620 0x5597b6b8b1a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.729+0000 7f2776101b80 1 --2- 172.21.15.92:0/3947698106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b79e20 0x5597b6b83c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.729+0000 7f2776101b80 1 --2- 172.21.15.92:0/3947698106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7a780 0x5597b6b84160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.729+0000 7f2776101b80 1 -- 172.21.15.92:0/3947698106 >> 172.21.15.92:0/3947698106 conn(0x5597b6aa7dd0 msgr2=0x5597b6b74bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.729+0000 7f2742ffd700 0 client.15576 ms_handle_reset on v2:172.21.15.152:6834/1393840132 2023-10-16T13:13:49.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.729+0000 7f2776101b80 1 -- 172.21.15.92:0/3947698106 shutdown_connections 2023-10-16T13:13:49.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.729+0000 7f2776101b80 1 -- 172.21.15.92:0/3947698106 wait complete. 2023-10-16T13:13:49.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.730+0000 7f2776101b80 20 client.15576 trim_cache size 0 max 16384 2023-10-16T13:13:49.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.742+0000 7f2776101b80 1 Processor -- start 2023-10-16T13:13:49.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.742+0000 7f2776101b80 1 -- start start 2023-10-16T13:13:49.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.742+0000 7f2776101b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b79e20 0x5597b6b81a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f2776101b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b7a780 0x5597b6b8b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f2776101b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7b620 0x5597b6b74b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f2776101b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597b694d920 con 0x5597b6b79e20 2023-10-16T13:13:49.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f2776101b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597b6b7b4a0 con 0x5597b6b7b620 2023-10-16T13:13:49.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f2776101b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597b6b830d0 con 0x5597b6b7a780 2023-10-16T13:13:49.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f27637fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b79e20 0x5597b6b81a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f27637fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b79e20 0x5597b6b81a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37300/0 (socket says 172.21.15.92:37300) 2023-10-16T13:13:49.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f27637fe700 1 -- 172.21.15.92:0/2101898169 learned_addr learned my addr 172.21.15.92:0/2101898169 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f2763fff700 1 --2- 172.21.15.92:0/2101898169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7b620 0x5597b6b74b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f2762ffd700 1 --2- 172.21.15.92:0/2101898169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b7a780 0x5597b6b8b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f27637fe700 1 -- 172.21.15.92:0/2101898169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b7a780 msgr2=0x5597b6b8b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f27637fe700 1 --2- 172.21.15.92:0/2101898169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b7a780 0x5597b6b8b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f27637fe700 1 -- 172.21.15.92:0/2101898169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7b620 msgr2=0x5597b6b74b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f27637fe700 1 --2- 172.21.15.92:0/2101898169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7b620 0x5597b6b74b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f27637fe700 1 -- 172.21.15.92:0/2101898169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597b68e0c60 con 0x5597b6b79e20 2023-10-16T13:13:49.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f27637fe700 1 --2- 172.21.15.92:0/2101898169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b79e20 0x5597b6b81a20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2754013040 tx=0x7f2754014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d7dc283e0fc82b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f2763fff700 1 --2- 172.21.15.92:0/2101898169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7b620 0x5597b6b74b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:49.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f274a7fc700 1 -- 172.21.15.92:0/2101898169 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754024040 con 0x5597b6b79e20 2023-10-16T13:13:49.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f274a7fc700 1 -- 172.21.15.92:0/2101898169 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f27540264c0 con 0x5597b6b79e20 2023-10-16T13:13:49.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.743+0000 7f274a7fc700 1 -- 172.21.15.92:0/2101898169 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275401e430 con 0x5597b6b79e20 2023-10-16T13:13:49.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.744+0000 7f2776101b80 1 -- 172.21.15.92:0/2101898169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b79e20 msgr2=0x5597b6b81a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.744+0000 7f2776101b80 1 --2- 172.21.15.92:0/2101898169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b79e20 0x5597b6b81a20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2754013040 tx=0x7f2754014000 comp rx=0 tx=0).stop 2023-10-16T13:13:49.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.744+0000 7f2776101b80 1 -- 172.21.15.92:0/2101898169 shutdown_connections 2023-10-16T13:13:49.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.744+0000 7f2776101b80 1 --2- 172.21.15.92:0/2101898169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b79e20 0x5597b6b81a20 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.744+0000 7f2776101b80 1 --2- 172.21.15.92:0/2101898169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7b620 0x5597b6b74b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.744+0000 7f2776101b80 1 --2- 172.21.15.92:0/2101898169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b7a780 0x5597b6b8b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.744+0000 7f2776101b80 1 -- 172.21.15.92:0/2101898169 >> 172.21.15.92:0/2101898169 conn(0x5597b6aa7dd0 msgr2=0x5597b6b8ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.744+0000 7f2776101b80 1 -- 172.21.15.92:0/2101898169 shutdown_connections 2023-10-16T13:13:49.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.744+0000 7f2776101b80 1 -- 172.21.15.92:0/2101898169 wait complete. 2023-10-16T13:13:49.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.744+0000 7f2776101b80 1 -- start start 2023-10-16T13:13:49.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.745+0000 7f2776101b80 1 Processor -- start 2023-10-16T13:13:49.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.745+0000 7f2776101b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b79e20 0x5597b6b88f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.745+0000 7f2776101b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7a780 0x5597b6b894a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.745+0000 7f2776101b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7b620 0x5597b6b8a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.745+0000 7f2776101b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597b6b8a9f0 con 0x5597b6b7b620 2023-10-16T13:13:49.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.745+0000 7f2776101b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597b6b8ab60 con 0x5597b6b7a780 2023-10-16T13:13:49.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.745+0000 7f2776101b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597b6b8ad20 con 0x5597b6b79e20 2023-10-16T13:13:49.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.745+0000 7f2776101b80 10 client.0 _ll_register_callbacks cb 0x7f275c097b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:49.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.745+0000 7f2763fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7b620 0x5597b6b8a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.745+0000 7f2763fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7b620 0x5597b6b8a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37310/0 (socket says 172.21.15.92:37310) 2023-10-16T13:13:49.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.745+0000 7f2763fff700 1 -- 172.21.15.92:0/4025062044 learned_addr learned my addr 172.21.15.92:0/4025062044 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.745+0000 7f2762ffd700 1 --2- 172.21.15.92:0/4025062044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7a780 0x5597b6b894a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.745+0000 7f27637fe700 1 --2- 172.21.15.92:0/4025062044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b79e20 0x5597b6b88f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.746+0000 7f2763fff700 1 -- 172.21.15.92:0/4025062044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b79e20 msgr2=0x5597b6b88f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.746+0000 7f2763fff700 1 --2- 172.21.15.92:0/4025062044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b79e20 0x5597b6b88f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.746+0000 7f2763fff700 1 -- 172.21.15.92:0/4025062044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7a780 msgr2=0x5597b6b894a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.746+0000 7f2763fff700 1 --2- 172.21.15.92:0/4025062044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7a780 0x5597b6b894a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.746+0000 7f2763fff700 1 -- 172.21.15.92:0/4025062044 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275400ebd0 con 0x5597b6b7b620 2023-10-16T13:13:49.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.746+0000 7f27637fe700 1 --2- 172.21.15.92:0/4025062044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b79e20 0x5597b6b88f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:49.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.746+0000 7f2763fff700 1 --2- 172.21.15.92:0/4025062044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7b620 0x5597b6b8a4b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f275c006070 tx=0x7f275c09b270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2c8ba5f058bbb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.746+0000 7f2742ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:49.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.746+0000 7f2742ffd700 1 -- 172.21.15.92:0/4025062044 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c009b80 con 0x5597b6b7b620 2023-10-16T13:13:49.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.746+0000 7f2742ffd700 1 -- 172.21.15.92:0/4025062044 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f275c09bee0 con 0x5597b6b7b620 2023-10-16T13:13:49.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.746+0000 7f2776101b80 1 -- 172.21.15.92:0/4025062044 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5597b6ad1ef0 con 0x5597b6b7b620 2023-10-16T13:13:49.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.746+0000 7f2742ffd700 1 -- 172.21.15.92:0/4025062044 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f275c09b7e0 con 0x5597b6b7b620 2023-10-16T13:13:49.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.746+0000 7f2776101b80 10 client.15582 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:49.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.746+0000 7f2776101b80 1 -- 172.21.15.92:0/4025062044 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5597b691e250 con 0x5597b6b7b620 2023-10-16T13:13:49.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.746+0000 7f2742ffd700 1 -- 172.21.15.92:0/4025062044 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5597b6ad1ef0 con 0x5597b6b7b620 2023-10-16T13:13:49.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.746+0000 7f2742ffd700 1 -- 172.21.15.92:0/4025062044 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f275c09acd0 con 0x5597b6b7b620 2023-10-16T13:13:49.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.746+0000 7f2776101b80 10 client.15582 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:49.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.746+0000 7f2776101b80 10 client.15582 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-10-16T13:13:49.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.746+0000 7f2776101b80 20 client.15582 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:49.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.747+0000 7f2776101b80 1 --2- 172.21.15.92:0/4025062044 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x5597b6be3f30 0x5597b6be6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.747+0000 7f2776101b80 4 client.15582 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-16T13:13:49.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.747+0000 7f2776101b80 1 -- 172.21.15.92:0/4025062044 --> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5597b6ac5b70 con 0x5597b6be3f30 2023-10-16T13:13:49.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.747+0000 7f27637fe700 1 --2- 172.21.15.92:0/4025062044 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x5597b6be3f30 0x5597b6be6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.747+0000 7f27637fe700 1 --2- 172.21.15.92:0/4025062044 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x5597b6be3f30 0x5597b6be6350 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1435f9e2f679bb00 server_cookie=c3a8d8eb75d28fc3 in_seq=0 out_seq=0 2023-10-16T13:13:49.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.747+0000 7f2742ffd700 10 client.15582 ms_handle_connect on v2:172.21.15.152:6834/1393840132 2023-10-16T13:13:49.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.747+0000 7f2742ffd700 1 -- 172.21.15.92:0/4025062044 <== mds.2 v2:172.21.15.152:6834/1393840132 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5597b6ac5b70 con 0x5597b6be3f30 2023-10-16T13:13:49.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.747+0000 7f2742ffd700 10 client.15582 handle_command_reply: tid=0 2023-10-16T13:13:49.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.747+0000 7f2776101b80 1 client.15582 shutdown 2023-10-16T13:13:49.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2776101b80 1 -- 172.21.15.92:0/4025062044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7b620 msgr2=0x5597b6b8a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2776101b80 1 --2- 172.21.15.92:0/4025062044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7b620 0x5597b6b8a4b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f275c006070 tx=0x7f275c09b270 comp rx=0 tx=0).stop 2023-10-16T13:13:49.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2776101b80 1 -- 172.21.15.92:0/4025062044 shutdown_connections 2023-10-16T13:13:49.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2776101b80 1 --2- 172.21.15.92:0/4025062044 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x5597b6be3f30 0x5597b6be6350 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2776101b80 1 --2- 172.21.15.92:0/4025062044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597b6b7b620 0x5597b6b8a4b0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2742ffd700 0 client.15582 ms_handle_reset on v2:172.21.15.152:6834/1393840132 2023-10-16T13:13:49.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2776101b80 1 --2- 172.21.15.92:0/4025062044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597b6b79e20 0x5597b6b88f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2776101b80 1 --2- 172.21.15.92:0/4025062044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597b6b7a780 0x5597b6b894a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2776101b80 1 -- 172.21.15.92:0/4025062044 >> 172.21.15.92:0/4025062044 conn(0x5597b6aa7dd0 msgr2=0x5597b6b7e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2776101b80 1 -- 172.21.15.92:0/4025062044 shutdown_connections 2023-10-16T13:13:49.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2776101b80 1 -- 172.21.15.92:0/4025062044 wait complete. 2023-10-16T13:13:49.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2776101b80 20 client.15582 trim_cache size 0 max 16384 2023-10-16T13:13:49.775 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2023-10-16T13:13:49.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2769f17700 1 -- 172.21.15.92:0/4246902546 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f274c0a1480 msgr2=0x7f274c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2769f17700 1 --2- 172.21.15.92:0/4246902546 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f274c0a1480 0x7f274c0a3940 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2764197b60 tx=0x7f275400a680 comp rx=0 tx=0).stop 2023-10-16T13:13:49.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2769f17700 1 -- 172.21.15.92:0/4246902546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2764106c20 msgr2=0x7f276419e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2769f17700 1 --2- 172.21.15.92:0/4246902546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2764106c20 0x7f276419e230 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f275c009fd0 tx=0x7f275c004d30 comp rx=0 tx=0).stop 2023-10-16T13:13:49.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2769f17700 1 -- 172.21.15.92:0/4246902546 shutdown_connections 2023-10-16T13:13:49.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2769f17700 1 --2- 172.21.15.92:0/4246902546 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f274c0a1480 0x7f274c0a3940 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2769f17700 1 --2- 172.21.15.92:0/4246902546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2764106c20 0x7f276419e230 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2769f17700 1 --2- 172.21.15.92:0/4246902546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27641019c0 0x7f2764196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2769f17700 1 --2- 172.21.15.92:0/4246902546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27641042f0 0x7f27641971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.748+0000 7f2769f17700 1 -- 172.21.15.92:0/4246902546 >> 172.21.15.92:0/4246902546 conn(0x7f27640fb310 msgr2=0x7f2764102630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.749+0000 7f2769f17700 1 -- 172.21.15.92:0/4246902546 shutdown_connections 2023-10-16T13:13:49.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.749+0000 7f2769f17700 1 -- 172.21.15.92:0/4246902546 wait complete. 2023-10-16T13:13:49.779 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-16T13:13:49.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:49 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/200653490' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:13:49.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.933+0000 7f6f9bcd8700 1 -- 172.21.15.92:0/1742598116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f940ff180 msgr2=0x7f6f940ff5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.933+0000 7f6f9bcd8700 1 --2- 172.21.15.92:0/1742598116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f940ff180 0x7f6f940ff5a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009990 tx=0x7f6f90009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.933+0000 7f6f9bcd8700 1 -- 172.21.15.92:0/1742598116 shutdown_connections 2023-10-16T13:13:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.933+0000 7f6f9bcd8700 1 --2- 172.21.15.92:0/1742598116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f940ff180 0x7f6f940ff5a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.933+0000 7f6f9bcd8700 1 --2- 172.21.15.92:0/1742598116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f94102af0 0x7f6f941093a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.933+0000 7f6f9bcd8700 1 --2- 172.21.15.92:0/1742598116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f94102150 0x7f6f941025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.933+0000 7f6f9bcd8700 1 -- 172.21.15.92:0/1742598116 >> 172.21.15.92:0/1742598116 conn(0x7f6f940faa90 msgr2=0x7f6f940fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.933+0000 7f6f9bcd8700 1 -- 172.21.15.92:0/1742598116 shutdown_connections 2023-10-16T13:13:49.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.933+0000 7f6f9bcd8700 1 -- 172.21.15.92:0/1742598116 wait complete. 2023-10-16T13:13:49.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.934+0000 7f6f9bcd8700 1 Processor -- start 2023-10-16T13:13:49.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.934+0000 7f6f9bcd8700 1 -- start start 2023-10-16T13:13:49.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.934+0000 7f6f9bcd8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f940ff180 0x7f6f94101ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.934+0000 7f6f9bcd8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f94102150 0x7f6f94100100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.934+0000 7f6f9bcd8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f94102af0 0x7f6f94100640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.934+0000 7f6f9bcd8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f94100de0 con 0x7f6f94102150 2023-10-16T13:13:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.934+0000 7f6f9bcd8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f94100f50 con 0x7f6f940ff180 2023-10-16T13:13:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.934+0000 7f6f9bcd8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f941a0cf0 con 0x7f6f94102af0 2023-10-16T13:13:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.935+0000 7f6f99273700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f94102150 0x7f6f94100100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.935+0000 7f6f99a74700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f940ff180 0x7f6f94101ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.935+0000 7f6f99273700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f94102150 0x7f6f94100100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37322/0 (socket says 172.21.15.92:37322) 2023-10-16T13:13:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.935+0000 7f6f99273700 1 -- 172.21.15.92:0/1251272341 learned_addr learned my addr 172.21.15.92:0/1251272341 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.942 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.935+0000 7f6f9a275700 1 --2- 172.21.15.92:0/1251272341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f94102af0 0x7f6f94100640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.942 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.935+0000 7f6f99273700 1 -- 172.21.15.92:0/1251272341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f94102af0 msgr2=0x7f6f94100640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.942 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.935+0000 7f6f99273700 1 --2- 172.21.15.92:0/1251272341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f94102af0 0x7f6f94100640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.942 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.935+0000 7f6f99273700 1 -- 172.21.15.92:0/1251272341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f940ff180 msgr2=0x7f6f94101ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.942 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.935+0000 7f6f99273700 1 --2- 172.21.15.92:0/1251272341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f940ff180 0x7f6f94101ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.935+0000 7f6f99273700 1 -- 172.21.15.92:0/1251272341 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f900095f0 con 0x7f6f94102150 2023-10-16T13:13:49.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.935+0000 7f6f9a275700 1 --2- 172.21.15.92:0/1251272341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f94102af0 0x7f6f94100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:49.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.935+0000 7f6f99a74700 1 --2- 172.21.15.92:0/1251272341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f940ff180 0x7f6f94101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:13:49.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.935+0000 7f6f99273700 1 --2- 172.21.15.92:0/1251272341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f94102150 0x7f6f94100100 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400e9a0 tx=0x7f6f8400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.935+0000 7f6f8affd700 1 -- 172.21.15.92:0/1251272341 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84009790 con 0x7f6f94102150 2023-10-16T13:13:49.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.935+0000 7f6f8affd700 1 -- 172.21.15.92:0/1251272341 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6f8400cbd0 con 0x7f6f94102150 2023-10-16T13:13:49.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.935+0000 7f6f9bcd8700 1 -- 172.21.15.92:0/1251272341 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f941a0fd0 con 0x7f6f94102150 2023-10-16T13:13:49.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.935+0000 7f6f8affd700 1 -- 172.21.15.92:0/1251272341 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84018680 con 0x7f6f94102150 2023-10-16T13:13:49.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.935+0000 7f6f9bcd8700 1 -- 172.21.15.92:0/1251272341 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f941a1450 con 0x7f6f94102150 2023-10-16T13:13:49.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.938+0000 7f6f8affd700 1 -- 172.21.15.92:0/1251272341 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6f840188a0 con 0x7f6f94102150 2023-10-16T13:13:49.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.939+0000 7f6f8affd700 1 --2- 172.21.15.92:0/1251272341 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6f800a1480 0x7f6f800a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.939+0000 7f6f99a74700 1 --2- 172.21.15.92:0/1251272341 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6f800a1480 0x7f6f800a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.939+0000 7f6f8affd700 1 -- 172.21.15.92:0/1251272341 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6f84014070 con 0x7f6f94102150 2023-10-16T13:13:49.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.939+0000 7f6f99a74700 1 --2- 172.21.15.92:0/1251272341 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6f800a1480 0x7f6f800a3940 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000b2e0 tx=0x7f6f90005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.940+0000 7f6fa7ec2b80 1 Processor -- start 2023-10-16T13:13:49.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.940+0000 7f6fa7ec2b80 1 -- start start 2023-10-16T13:13:49.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.940+0000 7f6fa7ec2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821de20 0x55ab3821e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.940+0000 7f6fa7ec2b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821e780 0x55ab3821f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.940+0000 7f6fa7ec2b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821f620 0x55ab3821faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.940+0000 7f6fa7ec2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab38192c70 con 0x55ab3821de20 2023-10-16T13:13:49.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.940+0000 7f6fa7ec2b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab38177c60 con 0x55ab3821f620 2023-10-16T13:13:49.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.940+0000 7f6fa7ec2b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab38175580 con 0x55ab3821e780 2023-10-16T13:13:49.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.941+0000 7f6f99273700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821e780 0x55ab3821f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.941+0000 7f6f99a74700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821de20 0x55ab3821e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.941+0000 7f6f99a74700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821de20 0x55ab3821e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37328/0 (socket says 172.21.15.92:37328) 2023-10-16T13:13:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.941+0000 7f6f99273700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821e780 0x55ab3821f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.92:44160/0 (socket says 172.21.15.92:44160) 2023-10-16T13:13:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.941+0000 7f6f99a74700 1 -- 172.21.15.92:0/4239110460 learned_addr learned my addr 172.21.15.92:0/4239110460 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.941+0000 7f6f9a275700 1 --2- 172.21.15.92:0/4239110460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821f620 0x55ab3821faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.941+0000 7f6f99a74700 1 -- 172.21.15.92:0/4239110460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821e780 msgr2=0x55ab3821f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.941+0000 7f6f99a74700 1 --2- 172.21.15.92:0/4239110460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821e780 0x55ab3821f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.941+0000 7f6f99a74700 1 -- 172.21.15.92:0/4239110460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821f620 msgr2=0x55ab3821faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.941+0000 7f6f99a74700 1 --2- 172.21.15.92:0/4239110460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821f620 0x55ab3821faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.941+0000 7f6f99a74700 1 -- 172.21.15.92:0/4239110460 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab3812e3f0 con 0x55ab3821de20 2023-10-16T13:13:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.941+0000 7f6f9a275700 1 --2- 172.21.15.92:0/4239110460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821f620 0x55ab3821faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.941+0000 7f6f99a74700 1 --2- 172.21.15.92:0/4239110460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821de20 0x55ab3821e240 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6f90015000 tx=0x7f6f90020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdcc17a94d1d635f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.941+0000 7f6f7ffff700 1 -- 172.21.15.92:0/4239110460 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9002b070 con 0x55ab3821de20 2023-10-16T13:13:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.941+0000 7f6f7ffff700 1 -- 172.21.15.92:0/4239110460 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6f9001e040 con 0x55ab3821de20 2023-10-16T13:13:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.941+0000 7f6f7ffff700 1 -- 172.21.15.92:0/4239110460 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9002f400 con 0x55ab3821de20 2023-10-16T13:13:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.942+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/4239110460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821de20 msgr2=0x55ab3821e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.942+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/4239110460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821de20 0x55ab3821e240 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6f90015000 tx=0x7f6f90020000 comp rx=0 tx=0).stop 2023-10-16T13:13:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.942+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/4239110460 shutdown_connections 2023-10-16T13:13:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.942+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/4239110460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821de20 0x55ab3821e240 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.955 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.942+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/4239110460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821f620 0x55ab3821faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.955 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.942+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/4239110460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821e780 0x55ab3821f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.955 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.942+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/4239110460 >> 172.21.15.92:0/4239110460 conn(0x55ab3814bdd0 msgr2=0x55ab38218fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.955 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.943+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/4239110460 shutdown_connections 2023-10-16T13:13:49.955 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.943+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/4239110460 wait complete. 2023-10-16T13:13:49.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.943+0000 7f6fa7ec2b80 1 -- start start 2023-10-16T13:13:49.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.943+0000 7f6fa7ec2b80 1 Processor -- start 2023-10-16T13:13:49.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6fa7ec2b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821de20 0x55ab38227c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6fa7ec2b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821e780 0x55ab38228140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6fa7ec2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821f620 0x55ab3822f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.956 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6fa7ec2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab38170e70 con 0x55ab3821f620 2023-10-16T13:13:49.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6fa7ec2b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab3810d710 con 0x55ab3821de20 2023-10-16T13:13:49.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6fa7ec2b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab3810d3b0 con 0x55ab3821e780 2023-10-16T13:13:49.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6fa7ec2b80 10 client.0 _ll_register_callbacks cb 0x55ab37f6a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:49.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6f9a275700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821f620 0x55ab3822f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6f9a275700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821f620 0x55ab3822f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37336/0 (socket says 172.21.15.92:37336) 2023-10-16T13:13:49.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6f9a275700 1 -- 172.21.15.92:0/655319274 learned_addr learned my addr 172.21.15.92:0/655319274 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6f99a74700 1 --2- 172.21.15.92:0/655319274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821de20 0x55ab38227c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6f99273700 1 --2- 172.21.15.92:0/655319274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821e780 0x55ab38228140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6f9a275700 1 -- 172.21.15.92:0/655319274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821e780 msgr2=0x55ab38228140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6f9a275700 1 --2- 172.21.15.92:0/655319274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821e780 0x55ab38228140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6f9a275700 1 -- 172.21.15.92:0/655319274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821de20 msgr2=0x55ab38227c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6f9a275700 1 --2- 172.21.15.92:0/655319274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821de20 0x55ab38227c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6f9a275700 1 -- 172.21.15.92:0/655319274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f94109ca0 con 0x55ab3821f620 2023-10-16T13:13:49.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6f99a74700 1 --2- 172.21.15.92:0/655319274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821de20 0x55ab38227c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:13:49.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6f9a275700 1 --2- 172.21.15.92:0/655319274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821f620 0x55ab3822f180 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0079d0 tx=0x7f6f8c007ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1149acdeb2c22733 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.944+0000 7f6f7d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:49.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.945+0000 7f6f7d7fa700 1 -- 172.21.15.92:0/655319274 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c0117f0 con 0x55ab3821f620 2023-10-16T13:13:49.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.945+0000 7f6f7d7fa700 1 -- 172.21.15.92:0/655319274 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6f8c011950 con 0x55ab3821f620 2023-10-16T13:13:49.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.945+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/655319274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab38175ef0 con 0x55ab3821f620 2023-10-16T13:13:49.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.945+0000 7f6f7d7fa700 1 -- 172.21.15.92:0/655319274 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f8c011b10 con 0x55ab3821f620 2023-10-16T13:13:49.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.945+0000 7f6fa7ec2b80 10 client.15594 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:49.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.945+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/655319274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ab37f9bde0 con 0x55ab3821f620 2023-10-16T13:13:49.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.945+0000 7f6f7d7fa700 1 -- 172.21.15.92:0/655319274 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55ab38175ef0 con 0x55ab3821f620 2023-10-16T13:13:49.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.945+0000 7f6f7d7fa700 1 -- 172.21.15.92:0/655319274 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6f8c014070 con 0x55ab3821f620 2023-10-16T13:13:49.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.945+0000 7f6fa7ec2b80 10 client.15594 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:49.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.945+0000 7f6fa7ec2b80 10 client.15594 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-16T13:13:49.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.945+0000 7f6fa7ec2b80 20 client.15594 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:49.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.945+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/655319274 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55ab38233b50 0x55ab38235f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.945+0000 7f6fa7ec2b80 4 client.15594 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:13:49.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.945+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/655319274 --> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ab381edc10 con 0x55ab38233b50 2023-10-16T13:13:49.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.946+0000 7f6f99a74700 1 --2- 172.21.15.92:0/655319274 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55ab38233b50 0x55ab38235f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.946+0000 7f6f7d7fa700 10 client.15594 ms_handle_connect on v2:172.21.15.152:6838/1821921588 2023-10-16T13:13:49.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.946+0000 7f6f99a74700 1 --2- 172.21.15.92:0/655319274 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55ab38233b50 0x55ab38235f70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=53c0db33e5ed5c3 server_cookie=13c78b4153f11b60 in_seq=0 out_seq=0 2023-10-16T13:13:49.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.947+0000 7f6f7d7fa700 1 -- 172.21.15.92:0/655319274 <== mds.1 v2:172.21.15.152:6838/1821921588 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ab381edc10 con 0x55ab38233b50 2023-10-16T13:13:49.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.947+0000 7f6f7d7fa700 10 client.15594 handle_command_reply: tid=0 2023-10-16T13:13:49.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.947+0000 7f6fa7ec2b80 1 client.15594 shutdown 2023-10-16T13:13:49.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.947+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/655319274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821f620 msgr2=0x55ab3822f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.947+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/655319274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821f620 0x55ab3822f180 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0079d0 tx=0x7f6f8c007ce0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.947+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/655319274 shutdown_connections 2023-10-16T13:13:49.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.947+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/655319274 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55ab38233b50 0x55ab38235f70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.947+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/655319274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821f620 0x55ab3822f180 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.947+0000 7f6f7d7fa700 0 client.15594 ms_handle_reset on v2:172.21.15.152:6838/1821921588 2023-10-16T13:13:49.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.947+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/655319274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821de20 0x55ab38227c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.947+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/655319274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821e780 0x55ab38228140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.947+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/655319274 >> 172.21.15.92:0/655319274 conn(0x55ab3814bdd0 msgr2=0x55ab38218bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.947+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/655319274 shutdown_connections 2023-10-16T13:13:49.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.947+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/655319274 wait complete. 2023-10-16T13:13:49.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.947+0000 7f6fa7ec2b80 20 client.15594 trim_cache size 0 max 16384 2023-10-16T13:13:49.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.965+0000 7f6fa7ec2b80 1 Processor -- start 2023-10-16T13:13:49.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.965+0000 7f6fa7ec2b80 1 -- start start 2023-10-16T13:13:49.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.965+0000 7f6fa7ec2b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821de20 0x55ab3821e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.965+0000 7f6fa7ec2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821e780 0x55ab3822f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.965+0000 7f6fa7ec2b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821f620 0x55ab382177a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.965+0000 7f6fa7ec2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab37ff1920 con 0x55ab3821e780 2023-10-16T13:13:49.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.965+0000 7f6fa7ec2b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab38175ef0 con 0x55ab3821de20 2023-10-16T13:13:49.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.965+0000 7f6fa7ec2b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab38213c00 con 0x55ab3821f620 2023-10-16T13:13:49.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.965+0000 7f6f99273700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821e780 0x55ab3822f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.965+0000 7f6f99273700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821e780 0x55ab3822f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37344/0 (socket says 172.21.15.92:37344) 2023-10-16T13:13:49.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.965+0000 7f6f99273700 1 -- 172.21.15.92:0/3420749802 learned_addr learned my addr 172.21.15.92:0/3420749802 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.965+0000 7f6f99a74700 1 --2- 172.21.15.92:0/3420749802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821de20 0x55ab3821e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.965+0000 7f6f9a275700 1 --2- 172.21.15.92:0/3420749802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821f620 0x55ab382177a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.965+0000 7f6f99273700 1 -- 172.21.15.92:0/3420749802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821f620 msgr2=0x55ab382177a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.965+0000 7f6f99273700 1 --2- 172.21.15.92:0/3420749802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821f620 0x55ab382177a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.965+0000 7f6f99273700 1 -- 172.21.15.92:0/3420749802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821de20 msgr2=0x55ab3821e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.965+0000 7f6f99273700 1 --2- 172.21.15.92:0/3420749802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821de20 0x55ab3821e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.965+0000 7f6f99273700 1 -- 172.21.15.92:0/3420749802 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab37f84c60 con 0x55ab3821e780 2023-10-16T13:13:49.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.965+0000 7f6f9a275700 1 --2- 172.21.15.92:0/3420749802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821f620 0x55ab382177a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:49.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.966+0000 7f6f99273700 1 --2- 172.21.15.92:0/3420749802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821e780 0x55ab3822f0a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400cfd0 tx=0x7f6f84099eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43018d7029d47db4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.966+0000 7f6f88d82700 1 -- 172.21.15.92:0/3420749802 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8409ab30 con 0x55ab3821e780 2023-10-16T13:13:49.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.966+0000 7f6f88d82700 1 -- 172.21.15.92:0/3420749802 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6f8409a430 con 0x55ab3821e780 2023-10-16T13:13:49.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.966+0000 7f6f88d82700 1 -- 172.21.15.92:0/3420749802 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84099920 con 0x55ab3821e780 2023-10-16T13:13:49.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.966+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/3420749802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821e780 msgr2=0x55ab3822f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.966+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/3420749802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821e780 0x55ab3822f0a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400cfd0 tx=0x7f6f84099eb0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.966+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/3420749802 shutdown_connections 2023-10-16T13:13:49.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.966+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/3420749802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821f620 0x55ab382177a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.966+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/3420749802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821de20 0x55ab3821e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.966+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/3420749802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821e780 0x55ab3822f0a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.966+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/3420749802 >> 172.21.15.92:0/3420749802 conn(0x55ab3814bdd0 msgr2=0x55ab38226890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.967+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/3420749802 shutdown_connections 2023-10-16T13:13:49.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.967+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/3420749802 wait complete. 2023-10-16T13:13:49.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.967+0000 7f6fa7ec2b80 1 -- start start 2023-10-16T13:13:49.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.967+0000 7f6fa7ec2b80 1 Processor -- start 2023-10-16T13:13:49.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.967+0000 7f6fa7ec2b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821de20 0x55ab3822ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.967+0000 7f6fa7ec2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821e780 0x55ab3822d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.967+0000 7f6fa7ec2b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821f620 0x55ab3822e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.967+0000 7f6fa7ec2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab3822e8d0 con 0x55ab3821e780 2023-10-16T13:13:49.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.967+0000 7f6fa7ec2b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab3822ea40 con 0x55ab3821de20 2023-10-16T13:13:49.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.967+0000 7f6fa7ec2b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab3822ec00 con 0x55ab3821f620 2023-10-16T13:13:49.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.967+0000 7f6fa7ec2b80 10 client.0 _ll_register_callbacks cb 0x7f6f8c009470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:49.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.968+0000 7f6f99a74700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821de20 0x55ab3822ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.968+0000 7f6f99a74700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821de20 0x55ab3822ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:38156/0 (socket says 172.21.15.92:38156) 2023-10-16T13:13:49.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.968+0000 7f6f99a74700 1 -- 172.21.15.92:0/2050259086 learned_addr learned my addr 172.21.15.92:0/2050259086 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:49.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.968+0000 7f6f99273700 1 --2- 172.21.15.92:0/2050259086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821e780 0x55ab3822d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.968+0000 7f6f9a275700 1 --2- 172.21.15.92:0/2050259086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821f620 0x55ab3822e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.968+0000 7f6f99a74700 1 -- 172.21.15.92:0/2050259086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821f620 msgr2=0x55ab3822e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.968+0000 7f6f99a74700 1 --2- 172.21.15.92:0/2050259086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821f620 0x55ab3822e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.968+0000 7f6f99a74700 1 -- 172.21.15.92:0/2050259086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821e780 msgr2=0x55ab3822d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:49.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.968+0000 7f6f99a74700 1 --2- 172.21.15.92:0/2050259086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821e780 0x55ab3822d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.968+0000 7f6f99a74700 1 -- 172.21.15.92:0/2050259086 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f941a1450 con 0x55ab3821de20 2023-10-16T13:13:49.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.968+0000 7f6f9a275700 1 --2- 172.21.15.92:0/2050259086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821f620 0x55ab3822e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:49.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.968+0000 7f6f99273700 1 --2- 172.21.15.92:0/2050259086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821e780 0x55ab3822d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:13:49.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.968+0000 7f6f99a74700 1 --2- 172.21.15.92:0/2050259086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821de20 0x55ab3822ce40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6f90031040 tx=0x7f6f90024970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b5e5eb5b3bfe6ee server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:49.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.968+0000 7f6f7d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-16T13:13:49.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.968+0000 7f6f7d7fa700 1 -- 172.21.15.92:0/2050259086 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9002b040 con 0x55ab3821de20 2023-10-16T13:13:49.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.968+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/2050259086 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6f9001e040 con 0x55ab3821de20 2023-10-16T13:13:49.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.968+0000 7f6f7d7fa700 1 -- 172.21.15.92:0/2050259086 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6f9003dc80 con 0x55ab3821de20 2023-10-16T13:13:49.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.969+0000 7f6f7d7fa700 1 -- 172.21.15.92:0/2050259086 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f90024ea0 con 0x55ab3821de20 2023-10-16T13:13:49.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.969+0000 7f6fa7ec2b80 10 client.25178 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:49.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.969+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/2050259086 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ab37fc2250 con 0x55ab3821de20 2023-10-16T13:13:49.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.969+0000 7f6f7d7fa700 1 -- 172.21.15.92:0/2050259086 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6f9001e040 con 0x55ab3821de20 2023-10-16T13:13:49.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.969+0000 7f6f7d7fa700 1 -- 172.21.15.92:0/2050259086 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6f9000f460 con 0x55ab3821de20 2023-10-16T13:13:49.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.969+0000 7f6fa7ec2b80 10 client.25178 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:49.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.969+0000 7f6fa7ec2b80 10 client.25178 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-16T13:13:49.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.969+0000 7f6fa7ec2b80 20 client.25178 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:49.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.969+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/2050259086 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55ab38288500 0x55ab3828a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:49.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.969+0000 7f6fa7ec2b80 4 client.25178 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-16T13:13:49.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.969+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/2050259086 --> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ab38169e50 con 0x55ab38288500 2023-10-16T13:13:49.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.969+0000 7f6f99273700 1 --2- 172.21.15.92:0/2050259086 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55ab38288500 0x55ab3828a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:49.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.970+0000 7f6f7d7fa700 10 client.25178 ms_handle_connect on v2:172.21.15.152:6838/1821921588 2023-10-16T13:13:49.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.970+0000 7f6f99273700 1 --2- 172.21.15.92:0/2050259086 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55ab38288500 0x55ab3828a920 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=83018296a44514ed server_cookie=b0d56d5cd4aaf676 in_seq=0 out_seq=0 2023-10-16T13:13:49.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.970+0000 7f6f7d7fa700 1 -- 172.21.15.92:0/2050259086 <== mds.1 v2:172.21.15.152:6838/1821921588 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ab38169e50 con 0x55ab38288500 2023-10-16T13:13:49.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.970+0000 7f6f7d7fa700 10 client.25178 handle_command_reply: tid=0 2023-10-16T13:13:49.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.970+0000 7f6fa7ec2b80 1 client.25178 shutdown 2023-10-16T13:13:49.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.970+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/2050259086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821de20 msgr2=0x55ab3822ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.970+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/2050259086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821de20 0x55ab3822ce40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6f90031040 tx=0x7f6f90024970 comp rx=0 tx=0).stop 2023-10-16T13:13:49.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.970+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/2050259086 shutdown_connections 2023-10-16T13:13:49.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.970+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/2050259086 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55ab38288500 0x55ab3828a920 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.970+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/2050259086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab3821f620 0x55ab3822e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.970+0000 7f6f7d7fa700 0 client.25178 ms_handle_reset on v2:172.21.15.152:6838/1821921588 2023-10-16T13:13:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.970+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/2050259086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab3821de20 0x55ab3822ce40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.970+0000 7f6fa7ec2b80 1 --2- 172.21.15.92:0/2050259086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab3821e780 0x55ab3822d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.970+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/2050259086 >> 172.21.15.92:0/2050259086 conn(0x55ab3814bdd0 msgr2=0x55ab382177a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.970+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/2050259086 shutdown_connections 2023-10-16T13:13:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.970+0000 7f6fa7ec2b80 1 -- 172.21.15.92:0/2050259086 wait complete. 2023-10-16T13:13:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.970+0000 7f6fa7ec2b80 20 client.25178 trim_cache size 0 max 16384 2023-10-16T13:13:49.988 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2023-10-16T13:13:49.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.971+0000 7f6f9bcd8700 1 -- 172.21.15.92:0/1251272341 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6f800a1480 msgr2=0x7f6f800a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.971+0000 7f6f9bcd8700 1 --2- 172.21.15.92:0/1251272341 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6f800a1480 0x7f6f800a3940 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000b2e0 tx=0x7f6f90005fb0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.971+0000 7f6f9bcd8700 1 -- 172.21.15.92:0/1251272341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f94102150 msgr2=0x7f6f94100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:49.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.971+0000 7f6f9bcd8700 1 --2- 172.21.15.92:0/1251272341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f94102150 0x7f6f94100100 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400e9a0 tx=0x7f6f8400ecb0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.971+0000 7f6f9bcd8700 1 -- 172.21.15.92:0/1251272341 shutdown_connections 2023-10-16T13:13:49.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.971+0000 7f6f9bcd8700 1 --2- 172.21.15.92:0/1251272341 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6f800a1480 0x7f6f800a3940 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.971+0000 7f6f9bcd8700 1 --2- 172.21.15.92:0/1251272341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f94102af0 0x7f6f94100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.971+0000 7f6f9bcd8700 1 --2- 172.21.15.92:0/1251272341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f940ff180 0x7f6f94101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.971+0000 7f6f9bcd8700 1 --2- 172.21.15.92:0/1251272341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f94102150 0x7f6f94100100 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:49.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.971+0000 7f6f9bcd8700 1 -- 172.21.15.92:0/1251272341 >> 172.21.15.92:0/1251272341 conn(0x7f6f940faa90 msgr2=0x7f6f940fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:49.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.971+0000 7f6f9bcd8700 1 -- 172.21.15.92:0/1251272341 shutdown_connections 2023-10-16T13:13:49.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:49.971+0000 7f6f9bcd8700 1 -- 172.21.15.92:0/1251272341 wait complete. 2023-10-16T13:13:49.992 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-16T13:13:50.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.124+0000 7f35a33f7700 1 -- 172.21.15.92:0/3189971245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f359c0ffdb0 msgr2=0x7f359c1001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:50.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.124+0000 7f35a33f7700 1 --2- 172.21.15.92:0/3189971245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f359c0ffdb0 0x7f359c1001d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3598009990 tx=0x7f3598009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.124+0000 7f35a33f7700 1 -- 172.21.15.92:0/3189971245 shutdown_connections 2023-10-16T13:13:50.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.124+0000 7f35a33f7700 1 --2- 172.21.15.92:0/3189971245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f359c101940 0x7f359c1081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.124+0000 7f35a33f7700 1 --2- 172.21.15.92:0/3189971245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f359c0ffdb0 0x7f359c1001d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.124+0000 7f35a33f7700 1 --2- 172.21.15.92:0/3189971245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f359c100fa0 0x7f359c101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.124+0000 7f35a33f7700 1 -- 172.21.15.92:0/3189971245 >> 172.21.15.92:0/3189971245 conn(0x7f359c0fb320 msgr2=0x7f359c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:50.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.124+0000 7f35a33f7700 1 -- 172.21.15.92:0/3189971245 shutdown_connections 2023-10-16T13:13:50.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.124+0000 7f35a33f7700 1 -- 172.21.15.92:0/3189971245 wait complete. 2023-10-16T13:13:50.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.125+0000 7f35a33f7700 1 Processor -- start 2023-10-16T13:13:50.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.125+0000 7f35a33f7700 1 -- start start 2023-10-16T13:13:50.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.125+0000 7f35a33f7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f359c0ffdb0 0x7f359c196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:50.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.125+0000 7f35a33f7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f359c100fa0 0x7f359c197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:50.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.125+0000 7f35a33f7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f359c101940 0x7f359c19e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:50.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.125+0000 7f35a33f7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c19e840 con 0x7f359c101940 2023-10-16T13:13:50.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.125+0000 7f35a33f7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c19e9b0 con 0x7f359c0ffdb0 2023-10-16T13:13:50.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.125+0000 7f35a33f7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c19eb70 con 0x7f359c100fa0 2023-10-16T13:13:50.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.126+0000 7f35a1193700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f359c0ffdb0 0x7f359c196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:50.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.126+0000 7f35a1193700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f359c0ffdb0 0x7f359c196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:38170/0 (socket says 172.21.15.92:38170) 2023-10-16T13:13:50.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.126+0000 7f35a1193700 1 -- 172.21.15.92:0/1918856890 learned_addr learned my addr 172.21.15.92:0/1918856890 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:50.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.126+0000 7f35a0992700 1 --2- 172.21.15.92:0/1918856890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f359c100fa0 0x7f359c197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:50.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.126+0000 7f35a1994700 1 --2- 172.21.15.92:0/1918856890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f359c101940 0x7f359c19e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:50.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.126+0000 7f35a1193700 1 -- 172.21.15.92:0/1918856890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f359c100fa0 msgr2=0x7f359c197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:50.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.126+0000 7f35a1193700 1 --2- 172.21.15.92:0/1918856890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f359c100fa0 0x7f359c197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.126+0000 7f35a1193700 1 -- 172.21.15.92:0/1918856890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f359c101940 msgr2=0x7f359c19e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:50.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.126+0000 7f35a1193700 1 --2- 172.21.15.92:0/1918856890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f359c101940 0x7f359c19e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.126+0000 7f35a1193700 1 -- 172.21.15.92:0/1918856890 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35980095f0 con 0x7f359c0ffdb0 2023-10-16T13:13:50.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.126+0000 7f35a1193700 1 --2- 172.21.15.92:0/1918856890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f359c0ffdb0 0x7f359c196d00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f35980095c0 tx=0x7f359800b680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:50.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.126+0000 7f35927fc700 1 -- 172.21.15.92:0/1918856890 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800fd40 con 0x7f359c0ffdb0 2023-10-16T13:13:50.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.126+0000 7f35927fc700 1 -- 172.21.15.92:0/1918856890 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3598004cd0 con 0x7f359c0ffdb0 2023-10-16T13:13:50.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.126+0000 7f35a33f7700 1 -- 172.21.15.92:0/1918856890 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359c1089b0 con 0x7f359c0ffdb0 2023-10-16T13:13:50.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.126+0000 7f35927fc700 1 -- 172.21.15.92:0/1918856890 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359801f730 con 0x7f359c0ffdb0 2023-10-16T13:13:50.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.127+0000 7f35a33f7700 1 -- 172.21.15.92:0/1918856890 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359c108e60 con 0x7f359c0ffdb0 2023-10-16T13:13:50.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.129+0000 7f35927fc700 1 -- 172.21.15.92:0/1918856890 <== mon.2 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f35980047f0 con 0x7f359c0ffdb0 2023-10-16T13:13:50.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.130+0000 7f35927fc700 1 --2- 172.21.15.92:0/1918856890 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f35880a1480 0x7f35880a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:50.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.130+0000 7f35a0992700 1 --2- 172.21.15.92:0/1918856890 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f35880a1480 0x7f35880a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:50.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.130+0000 7f35927fc700 1 -- 172.21.15.92:0/1918856890 <== mon.2 v2:172.21.15.118:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f35980d27a0 con 0x7f359c0ffdb0 2023-10-16T13:13:50.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.130+0000 7f35a0992700 1 --2- 172.21.15.92:0/1918856890 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f35880a1480 0x7f35880a3940 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f358c009c60 tx=0x7f358c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:50.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.131+0000 7f35af5e1b80 1 Processor -- start 2023-10-16T13:13:50.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.131+0000 7f35af5e1b80 1 -- start start 2023-10-16T13:13:50.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.132+0000 7f35af5e1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda29630 0x5573fda29a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:50.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.132+0000 7f35af5e1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda29f90 0x5573fda2a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:50.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.132+0000 7f35af5e1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda2ae30 0x5573fda2b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:50.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.132+0000 7f35af5e1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573fd995c70 con 0x5573fda29f90 2023-10-16T13:13:50.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.132+0000 7f35af5e1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573fd97ac60 con 0x5573fda2ae30 2023-10-16T13:13:50.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.132+0000 7f35af5e1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573fd978580 con 0x5573fda29630 2023-10-16T13:13:50.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.132+0000 7f35a0992700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda29f90 0x5573fda2a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:50.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.132+0000 7f35a0992700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda29f90 0x5573fda2a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37372/0 (socket says 172.21.15.92:37372) 2023-10-16T13:13:50.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.132+0000 7f35a0992700 1 -- 172.21.15.92:0/2896977644 learned_addr learned my addr 172.21.15.92:0/2896977644 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:50.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.132+0000 7f35a1193700 1 --2- 172.21.15.92:0/2896977644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda29630 0x5573fda29a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:50.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.132+0000 7f35a0992700 1 -- 172.21.15.92:0/2896977644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda29630 msgr2=0x5573fda29a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:50.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.132+0000 7f35a0992700 1 --2- 172.21.15.92:0/2896977644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda29630 0x5573fda29a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.132+0000 7f35a0992700 1 -- 172.21.15.92:0/2896977644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda2ae30 msgr2=0x5573fda2b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:50.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.132+0000 7f35a0992700 1 --2- 172.21.15.92:0/2896977644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda2ae30 0x5573fda2b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.132+0000 7f35a0992700 1 -- 172.21.15.92:0/2896977644 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573fd9313f0 con 0x5573fda29f90 2023-10-16T13:13:50.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.132+0000 7f35a0992700 1 --2- 172.21.15.92:0/2896977644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda29f90 0x5573fda2a850 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f358c00e4e0 tx=0x7f358c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6139bc74a653830 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:50.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.133+0000 7f35877fe700 1 -- 172.21.15.92:0/2896977644 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c026430 con 0x5573fda29f90 2023-10-16T13:13:50.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.133+0000 7f35877fe700 1 -- 172.21.15.92:0/2896977644 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f358c021070 con 0x5573fda29f90 2023-10-16T13:13:50.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.133+0000 7f35877fe700 1 -- 172.21.15.92:0/2896977644 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c01d740 con 0x5573fda29f90 2023-10-16T13:13:50.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.133+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2896977644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda29f90 msgr2=0x5573fda2a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:50.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.133+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/2896977644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda29f90 0x5573fda2a850 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f358c00e4e0 tx=0x7f358c014000 comp rx=0 tx=0).stop 2023-10-16T13:13:50.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.133+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2896977644 shutdown_connections 2023-10-16T13:13:50.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.133+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/2896977644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda2ae30 0x5573fda2b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.133+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/2896977644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda29630 0x5573fda29a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.133+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/2896977644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda29f90 0x5573fda2a850 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.134+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2896977644 >> 172.21.15.92:0/2896977644 conn(0x5573fd94edd0 msgr2=0x5573fda1bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:50.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.134+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2896977644 shutdown_connections 2023-10-16T13:13:50.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.134+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2896977644 wait complete. 2023-10-16T13:13:50.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.134+0000 7f35af5e1b80 1 -- start start 2023-10-16T13:13:50.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.134+0000 7f35af5e1b80 1 Processor -- start 2023-10-16T13:13:50.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.134+0000 7f35af5e1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29630 0x5573fda22420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:50.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.134+0000 7f35af5e1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda29f90 0x5573fda22960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:50.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.134+0000 7f35af5e1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda2ae30 0x5573fda27990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:50.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.134+0000 7f35af5e1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573fd973e70 con 0x5573fda2ae30 2023-10-16T13:13:50.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.134+0000 7f35af5e1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573fd910710 con 0x5573fda29630 2023-10-16T13:13:50.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.134+0000 7f35af5e1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573fd9103b0 con 0x5573fda29f90 2023-10-16T13:13:50.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.135+0000 7f35af5e1b80 10 client.0 _ll_register_callbacks cb 0x5573fd76d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:50.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.135+0000 7f35a1994700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda2ae30 0x5573fda27990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:50.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.135+0000 7f35a1193700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29630 0x5573fda22420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:50.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.135+0000 7f35a1193700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29630 0x5573fda22420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:38184/0 (socket says 172.21.15.92:38184) 2023-10-16T13:13:50.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.135+0000 7f35a1193700 1 -- 172.21.15.92:0/2188638886 learned_addr learned my addr 172.21.15.92:0/2188638886 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:50.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.135+0000 7f35a0992700 1 --2- 172.21.15.92:0/2188638886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda29f90 0x5573fda22960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:50.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.135+0000 7f35a1193700 1 -- 172.21.15.92:0/2188638886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda29f90 msgr2=0x5573fda22960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:50.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.135+0000 7f35a1193700 1 --2- 172.21.15.92:0/2188638886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda29f90 0x5573fda22960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.135+0000 7f35a1193700 1 -- 172.21.15.92:0/2188638886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda2ae30 msgr2=0x5573fda27990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:50.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.135+0000 7f35a1193700 1 --2- 172.21.15.92:0/2188638886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda2ae30 0x5573fda27990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.135+0000 7f35a1193700 1 -- 172.21.15.92:0/2188638886 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358c017070 con 0x5573fda29630 2023-10-16T13:13:50.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.135+0000 7f35a1193700 1 --2- 172.21.15.92:0/2188638886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29630 0x5573fda22420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f359800b2e0 tx=0x7f3598005a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f2c820b096b4485 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:50.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.135+0000 7f3584ff9700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-16T13:13:50.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.136+0000 7f3584ff9700 1 -- 172.21.15.92:0/2188638886 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35980a3c60 con 0x5573fda29630 2023-10-16T13:13:50.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.136+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2188638886 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5573fd978ef0 con 0x5573fda29630 2023-10-16T13:13:50.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.136+0000 7f3584ff9700 1 -- 172.21.15.92:0/2188638886 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f35980a0e40 con 0x5573fda29630 2023-10-16T13:13:50.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.136+0000 7f3584ff9700 1 -- 172.21.15.92:0/2188638886 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35980a7e10 con 0x5573fda29630 2023-10-16T13:13:50.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.136+0000 7f35af5e1b80 10 client.25187 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:50.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.136+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2188638886 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5573fd79ede0 con 0x5573fda29630 2023-10-16T13:13:50.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.136+0000 7f3584ff9700 1 -- 172.21.15.92:0/2188638886 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f35980bc020 con 0x5573fda29630 2023-10-16T13:13:50.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.136+0000 7f3584ff9700 1 -- 172.21.15.92:0/2188638886 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f35980b8120 con 0x5573fda29630 2023-10-16T13:13:50.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.136+0000 7f35af5e1b80 10 client.25187 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:50.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.136+0000 7f35af5e1b80 10 client.25187 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:13:50.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.136+0000 7f35af5e1b80 20 client.25187 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:50.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.136+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/2188638886 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5573fda476c0 0x5573fda49ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:50.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.136+0000 7f35af5e1b80 4 client.25187 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:13:50.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.136+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2188638886 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5573fd9f0c10 con 0x5573fda476c0 2023-10-16T13:13:50.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.137+0000 7f35a0992700 1 --2- 172.21.15.92:0/2188638886 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5573fda476c0 0x5573fda49ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:50.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.137+0000 7f35a0992700 1 --2- 172.21.15.92:0/2188638886 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5573fda476c0 0x5573fda49ae0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cb1048aa08181a server_cookie=3719515761f2059c in_seq=0 out_seq=0 2023-10-16T13:13:50.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.137+0000 7f3584ff9700 10 client.25187 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:50.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.138+0000 7f3584ff9700 1 -- 172.21.15.92:0/2188638886 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5573fd9f0c10 con 0x5573fda476c0 2023-10-16T13:13:50.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.138+0000 7f3584ff9700 10 client.25187 handle_command_reply: tid=0 2023-10-16T13:13:50.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.138+0000 7f35af5e1b80 1 client.25187 shutdown 2023-10-16T13:13:50.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.138+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2188638886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29630 msgr2=0x5573fda22420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:50.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.138+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/2188638886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29630 0x5573fda22420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f359800b2e0 tx=0x7f3598005a90 comp rx=0 tx=0).stop 2023-10-16T13:13:50.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.138+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2188638886 shutdown_connections 2023-10-16T13:13:50.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.138+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/2188638886 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5573fda476c0 0x5573fda49ae0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.138+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/2188638886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda2ae30 0x5573fda27990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.138+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/2188638886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29630 0x5573fda22420 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.138+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/2188638886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda29f90 0x5573fda22960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.138+0000 7f3584ff9700 0 client.25187 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:50.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.138+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2188638886 >> 172.21.15.92:0/2188638886 conn(0x5573fd94edd0 msgr2=0x5573fda1bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:50.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.138+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2188638886 shutdown_connections 2023-10-16T13:13:50.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.138+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2188638886 wait complete. 2023-10-16T13:13:50.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.138+0000 7f35af5e1b80 20 client.25187 trim_cache size 0 max 16384 2023-10-16T13:13:50.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.152+0000 7f35af5e1b80 1 Processor -- start 2023-10-16T13:13:50.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.152+0000 7f35af5e1b80 1 -- start start 2023-10-16T13:13:50.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.152+0000 7f35af5e1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda29630 0x5573fda572c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:50.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.152+0000 7f35af5e1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29f90 0x5573fda21030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:50.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.152+0000 7f35af5e1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda2ae30 0x5573fda2de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:50.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.152+0000 7f35af5e1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573fd7f4920 con 0x5573fda29630 2023-10-16T13:13:50.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.152+0000 7f35af5e1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573fda21f90 con 0x5573fda29f90 2023-10-16T13:13:50.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.152+0000 7f35af5e1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573fda1dfb0 con 0x5573fda2ae30 2023-10-16T13:13:50.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.153+0000 7f35a0992700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29f90 0x5573fda21030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:50.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.153+0000 7f35a0992700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29f90 0x5573fda21030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:38194/0 (socket says 172.21.15.92:38194) 2023-10-16T13:13:50.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.153+0000 7f35a0992700 1 -- 172.21.15.92:0/243520259 learned_addr learned my addr 172.21.15.92:0/243520259 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:50.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.153+0000 7f35a1994700 1 --2- 172.21.15.92:0/243520259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda2ae30 0x5573fda2de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:50.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.153+0000 7f35a0992700 1 -- 172.21.15.92:0/243520259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda2ae30 msgr2=0x5573fda2de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:50.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.153+0000 7f35a0992700 1 --2- 172.21.15.92:0/243520259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda2ae30 0x5573fda2de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.153+0000 7f35a0992700 1 -- 172.21.15.92:0/243520259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda29630 msgr2=0x5573fda572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:50.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.153+0000 7f35a0992700 1 --2- 172.21.15.92:0/243520259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda29630 0x5573fda572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.153+0000 7f35a0992700 1 -- 172.21.15.92:0/243520259 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573fd787c60 con 0x5573fda29f90 2023-10-16T13:13:50.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.153+0000 7f35a1994700 1 --2- 172.21.15.92:0/243520259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda2ae30 0x5573fda2de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:50.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.153+0000 7f35a0992700 1 --2- 172.21.15.92:0/243520259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29f90 0x5573fda21030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f358c00e4e0 tx=0x7f358c009f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1edb969f49b4848 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:50.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.153+0000 7f3587fff700 1 -- 172.21.15.92:0/243520259 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c01cdd0 con 0x5573fda29f90 2023-10-16T13:13:50.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.153+0000 7f3587fff700 1 -- 172.21.15.92:0/243520259 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f358c032560 con 0x5573fda29f90 2023-10-16T13:13:50.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.153+0000 7f3587fff700 1 -- 172.21.15.92:0/243520259 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c01c670 con 0x5573fda29f90 2023-10-16T13:13:50.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.154+0000 7f35af5e1b80 1 -- 172.21.15.92:0/243520259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29f90 msgr2=0x5573fda21030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:50.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.154+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/243520259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29f90 0x5573fda21030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f358c00e4e0 tx=0x7f358c009f80 comp rx=0 tx=0).stop 2023-10-16T13:13:50.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.154+0000 7f35af5e1b80 1 -- 172.21.15.92:0/243520259 shutdown_connections 2023-10-16T13:13:50.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.154+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/243520259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda29630 0x5573fda572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.154+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/243520259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda2ae30 0x5573fda2de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.154+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/243520259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29f90 0x5573fda21030 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.154+0000 7f35af5e1b80 1 -- 172.21.15.92:0/243520259 >> 172.21.15.92:0/243520259 conn(0x5573fd94edd0 msgr2=0x5573fda31320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:50.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.154+0000 7f35af5e1b80 1 -- 172.21.15.92:0/243520259 shutdown_connections 2023-10-16T13:13:50.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.154+0000 7f35af5e1b80 1 -- 172.21.15.92:0/243520259 wait complete. 2023-10-16T13:13:50.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.155+0000 7f35af5e1b80 1 -- start start 2023-10-16T13:13:50.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.155+0000 7f35af5e1b80 1 Processor -- start 2023-10-16T13:13:50.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.155+0000 7f35af5e1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda29630 0x5573fda95bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:50.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.155+0000 7f35af5e1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29f90 0x5573fda98140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:50.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.155+0000 7f35af5e1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda2ae30 0x5573fda9a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:50.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.155+0000 7f35af5e1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573fda9acb0 con 0x5573fda2ae30 2023-10-16T13:13:50.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.155+0000 7f35af5e1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573fda9ae20 con 0x5573fda29f90 2023-10-16T13:13:50.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.155+0000 7f35af5e1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573fda9afe0 con 0x5573fda29630 2023-10-16T13:13:50.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.155+0000 7f35af5e1b80 10 client.0 _ll_register_callbacks cb 0x7f359809f470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:50.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.155+0000 7f35a0992700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29f90 0x5573fda98140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:50.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.155+0000 7f35a0992700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29f90 0x5573fda98140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:38200/0 (socket says 172.21.15.92:38200) 2023-10-16T13:13:50.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.155+0000 7f35a0992700 1 -- 172.21.15.92:0/2591282027 learned_addr learned my addr 172.21.15.92:0/2591282027 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:50.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.155+0000 7f35a1193700 1 --2- 172.21.15.92:0/2591282027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda29630 0x5573fda95bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:50.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.156+0000 7f35a0992700 1 -- 172.21.15.92:0/2591282027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda29630 msgr2=0x5573fda95bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:50.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.156+0000 7f35a0992700 1 --2- 172.21.15.92:0/2591282027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda29630 0x5573fda95bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.156+0000 7f35a0992700 1 -- 172.21.15.92:0/2591282027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda2ae30 msgr2=0x5573fda9a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:50.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.156+0000 7f35a0992700 1 --2- 172.21.15.92:0/2591282027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda2ae30 0x5573fda9a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.156+0000 7f35a0992700 1 -- 172.21.15.92:0/2591282027 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358c02a040 con 0x5573fda29f90 2023-10-16T13:13:50.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.156+0000 7f35a0992700 1 --2- 172.21.15.92:0/2591282027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29f90 0x5573fda98140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f358c005520 tx=0x7f358c01cfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3366fc598ee77665 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:50.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.156+0000 7f3584ff9700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-16T13:13:50.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.156+0000 7f3584ff9700 1 -- 172.21.15.92:0/2591282027 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c0050d0 con 0x5573fda29f90 2023-10-16T13:13:50.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.156+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2591282027 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f358c021070 con 0x5573fda29f90 2023-10-16T13:13:50.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.156+0000 7f3584ff9700 1 -- 172.21.15.92:0/2591282027 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f358c005230 con 0x5573fda29f90 2023-10-16T13:13:50.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.156+0000 7f3584ff9700 1 -- 172.21.15.92:0/2591282027 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f358c0320b0 con 0x5573fda29f90 2023-10-16T13:13:50.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.156+0000 7f35af5e1b80 10 client.25193 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:50.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.156+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2591282027 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5573fd7c5250 con 0x5573fda29f90 2023-10-16T13:13:50.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.157+0000 7f3584ff9700 1 -- 172.21.15.92:0/2591282027 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f358c021070 con 0x5573fda29f90 2023-10-16T13:13:50.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.157+0000 7f3584ff9700 1 -- 172.21.15.92:0/2591282027 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f358c039070 con 0x5573fda29f90 2023-10-16T13:13:50.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.157+0000 7f35af5e1b80 10 client.25193 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:50.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.157+0000 7f35af5e1b80 10 client.25193 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:13:50.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.157+0000 7f35af5e1b80 20 client.25193 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:50.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.157+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/2591282027 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5573fda9c6f0 0x5573fda9eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:50.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.157+0000 7f35af5e1b80 4 client.25193 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-16T13:13:50.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.157+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2591282027 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5573fd96ce50 con 0x5573fda9c6f0 2023-10-16T13:13:50.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.157+0000 7f35a1193700 1 --2- 172.21.15.92:0/2591282027 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5573fda9c6f0 0x5573fda9eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:50.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.157+0000 7f3584ff9700 10 client.25193 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:50.171 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.157+0000 7f35a1193700 1 --2- 172.21.15.92:0/2591282027 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5573fda9c6f0 0x5573fda9eb10 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f96fecf660c45b9 server_cookie=f702f7996b92ee61 in_seq=0 out_seq=0 2023-10-16T13:13:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.158+0000 7f3584ff9700 1 -- 172.21.15.92:0/2591282027 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5573fd96ce50 con 0x5573fda9c6f0 2023-10-16T13:13:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.158+0000 7f3584ff9700 10 client.25193 handle_command_reply: tid=0 2023-10-16T13:13:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.158+0000 7f35af5e1b80 1 client.25193 shutdown 2023-10-16T13:13:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.158+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2591282027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29f90 msgr2=0x5573fda98140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.158+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/2591282027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29f90 0x5573fda98140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f358c005520 tx=0x7f358c01cfd0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.158+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2591282027 shutdown_connections 2023-10-16T13:13:50.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.158+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/2591282027 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5573fda9c6f0 0x5573fda9eb10 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.158+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/2591282027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573fda2ae30 0x5573fda9a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.158+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/2591282027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573fda29630 0x5573fda95bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.158+0000 7f35af5e1b80 1 --2- 172.21.15.92:0/2591282027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5573fda29f90 0x5573fda98140 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.158+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2591282027 >> 172.21.15.92:0/2591282027 conn(0x5573fd94edd0 msgr2=0x5573fda21030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:50.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.158+0000 7f3584ff9700 0 client.25193 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:50.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.158+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2591282027 shutdown_connections 2023-10-16T13:13:50.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.158+0000 7f35af5e1b80 1 -- 172.21.15.92:0/2591282027 wait complete. 2023-10-16T13:13:50.174 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.158+0000 7f35af5e1b80 20 client.25193 trim_cache size 0 max 16384 2023-10-16T13:13:50.174 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2023-10-16T13:13:50.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.159+0000 7f35a33f7700 1 -- 172.21.15.92:0/1918856890 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f35880a1480 msgr2=0x7f35880a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:50.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.159+0000 7f35a33f7700 1 --2- 172.21.15.92:0/1918856890 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f35880a1480 0x7f35880a3940 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f358c009c60 tx=0x7f358c009260 comp rx=0 tx=0).stop 2023-10-16T13:13:50.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.159+0000 7f35a33f7700 1 -- 172.21.15.92:0/1918856890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f359c0ffdb0 msgr2=0x7f359c196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:50.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.159+0000 7f35a33f7700 1 --2- 172.21.15.92:0/1918856890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f359c0ffdb0 0x7f359c196d00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f35980095c0 tx=0x7f359800b680 comp rx=0 tx=0).stop 2023-10-16T13:13:50.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.159+0000 7f35a33f7700 1 -- 172.21.15.92:0/1918856890 shutdown_connections 2023-10-16T13:13:50.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.159+0000 7f35a33f7700 1 --2- 172.21.15.92:0/1918856890 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f35880a1480 0x7f35880a3940 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.159+0000 7f35a33f7700 1 --2- 172.21.15.92:0/1918856890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f359c101940 0x7f359c19e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.159+0000 7f35a33f7700 1 --2- 172.21.15.92:0/1918856890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f359c0ffdb0 0x7f359c196d00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.159+0000 7f35a33f7700 1 --2- 172.21.15.92:0/1918856890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f359c100fa0 0x7f359c197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:50.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.159+0000 7f35a33f7700 1 -- 172.21.15.92:0/1918856890 >> 172.21.15.92:0/1918856890 conn(0x7f359c0fb320 msgr2=0x7f359c0fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:50.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.159+0000 7f35a33f7700 1 -- 172.21.15.92:0/1918856890 shutdown_connections 2023-10-16T13:13:50.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:50.159+0000 7f35a33f7700 1 -- 172.21.15.92:0/1918856890 wait complete. 2023-10-16T13:13:50.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:50 smithi152 ceph-mon[104423]: pgmap v322: 97 pgs: 97 active+clean; 653 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-16T13:13:50.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:50 smithi092 ceph-mon[99542]: pgmap v322: 97 pgs: 97 active+clean; 653 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-16T13:13:50.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:50 smithi118 ceph-mon[103969]: pgmap v322: 97 pgs: 97 active+clean; 653 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-16T13:13:51.178 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-16T13:13:51.178 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-16T13:13:51.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.332+0000 7f2332c66700 1 -- 172.21.15.92:0/2614297094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f232c0ffa10 msgr2=0x7f232c0ffe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:51.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.332+0000 7f2332c66700 1 --2- 172.21.15.92:0/2614297094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f232c0ffa10 0x7f232c0ffe70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2318009990 tx=0x7f2318009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.332+0000 7f2332c66700 1 -- 172.21.15.92:0/2614297094 shutdown_connections 2023-10-16T13:13:51.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.332+0000 7f2332c66700 1 --2- 172.21.15.92:0/2614297094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f232c1014e0 0x7f232c101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.332+0000 7f2332c66700 1 --2- 172.21.15.92:0/2614297094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f232c1003b0 0x7f232c108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.332+0000 7f2332c66700 1 --2- 172.21.15.92:0/2614297094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f232c0ffa10 0x7f232c0ffe70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.332+0000 7f2332c66700 1 -- 172.21.15.92:0/2614297094 >> 172.21.15.92:0/2614297094 conn(0x7f232c0fb330 msgr2=0x7f232c0fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:51.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.333+0000 7f2332c66700 1 -- 172.21.15.92:0/2614297094 shutdown_connections 2023-10-16T13:13:51.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.333+0000 7f2332c66700 1 -- 172.21.15.92:0/2614297094 wait complete. 2023-10-16T13:13:51.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.333+0000 7f2332c66700 1 Processor -- start 2023-10-16T13:13:51.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.333+0000 7f2332c66700 1 -- start start 2023-10-16T13:13:51.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.334+0000 7f2332c66700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f232c0ffa10 0x7f232c10a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.334+0000 7f2332c66700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f232c1003b0 0x7f232c108c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.334+0000 7f2332c66700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f232c1014e0 0x7f232c1091b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.334+0000 7f2332c66700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c109950 con 0x7f232c0ffa10 2023-10-16T13:13:51.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.334+0000 7f2332c66700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c109ac0 con 0x7f232c1003b0 2023-10-16T13:13:51.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.334+0000 7f2332c66700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c1a0de0 con 0x7f232c1014e0 2023-10-16T13:13:51.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.334+0000 7f2330a02700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f232c0ffa10 0x7f232c10a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.334+0000 7f2330a02700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f232c0ffa10 0x7f232c10a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37404/0 (socket says 172.21.15.92:37404) 2023-10-16T13:13:51.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.334+0000 7f2330a02700 1 -- 172.21.15.92:0/4156935462 learned_addr learned my addr 172.21.15.92:0/4156935462 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:51.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.334+0000 7f232bfff700 1 --2- 172.21.15.92:0/4156935462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f232c1003b0 0x7f232c108c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.334+0000 7f2331203700 1 --2- 172.21.15.92:0/4156935462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f232c1014e0 0x7f232c1091b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.334+0000 7f2330a02700 1 -- 172.21.15.92:0/4156935462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f232c1014e0 msgr2=0x7f232c1091b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:51.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.334+0000 7f2330a02700 1 --2- 172.21.15.92:0/4156935462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f232c1014e0 0x7f232c1091b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.334+0000 7f2330a02700 1 -- 172.21.15.92:0/4156935462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f232c1003b0 msgr2=0x7f232c108c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:51.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.334+0000 7f2330a02700 1 --2- 172.21.15.92:0/4156935462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f232c1003b0 0x7f232c108c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.334+0000 7f2330a02700 1 -- 172.21.15.92:0/4156935462 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23180095f0 con 0x7f232c0ffa10 2023-10-16T13:13:51.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.334+0000 7f2331203700 1 --2- 172.21.15.92:0/4156935462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f232c1014e0 0x7f232c1091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:51.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.334+0000 7f2330a02700 1 --2- 172.21.15.92:0/4156935462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f232c0ffa10 0x7f232c10a630 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f232000d980 tx=0x7f232000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:51.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.334+0000 7f2329ffb700 1 -- 172.21.15.92:0/4156935462 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2320004020 con 0x7f232c0ffa10 2023-10-16T13:13:51.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.335+0000 7f2332c66700 1 -- 172.21.15.92:0/4156935462 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232c196a00 con 0x7f232c0ffa10 2023-10-16T13:13:51.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.335+0000 7f2329ffb700 1 -- 172.21.15.92:0/4156935462 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2320009730 con 0x7f232c0ffa10 2023-10-16T13:13:51.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.335+0000 7f2329ffb700 1 -- 172.21.15.92:0/4156935462 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2320003be0 con 0x7f232c0ffa10 2023-10-16T13:13:51.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.335+0000 7f2332c66700 1 -- 172.21.15.92:0/4156935462 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c196f60 con 0x7f232c0ffa10 2023-10-16T13:13:51.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.337+0000 7f2329ffb700 1 -- 172.21.15.92:0/4156935462 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2320009ba0 con 0x7f232c0ffa10 2023-10-16T13:13:51.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.338+0000 7f2329ffb700 1 --2- 172.21.15.92:0/4156935462 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f231c0a1480 0x7f231c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.338+0000 7f2329ffb700 1 -- 172.21.15.92:0/4156935462 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f23200cc140 con 0x7f232c0ffa10 2023-10-16T13:13:51.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.339+0000 7f233ee50b80 1 Processor -- start 2023-10-16T13:13:51.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.339+0000 7f233ee50b80 1 -- start start 2023-10-16T13:13:51.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.339+0000 7f233ee50b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e7d506ea0 0x560e7d5072c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.339+0000 7f233ee50b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d507800 0x560e7d5080c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.339+0000 7f233ee50b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d5086a0 0x560e7d508b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.339+0000 7f233ee50b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7d47bcf0 con 0x560e7d5086a0 2023-10-16T13:13:51.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.339+0000 7f233ee50b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7d460ce0 con 0x560e7d506ea0 2023-10-16T13:13:51.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.339+0000 7f233ee50b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7d45e600 con 0x560e7d507800 2023-10-16T13:13:51.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.339+0000 7f2331203700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d5086a0 0x560e7d508b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.340+0000 7f2331203700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d5086a0 0x560e7d508b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37412/0 (socket says 172.21.15.92:37412) 2023-10-16T13:13:51.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.340+0000 7f2331203700 1 -- 172.21.15.92:0/2311315012 learned_addr learned my addr 172.21.15.92:0/2311315012 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:51.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.340+0000 7f232bfff700 1 --2- 172.21.15.92:0/4156935462 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f231c0a1480 0x7f231c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.340+0000 7f2331203700 1 -- 172.21.15.92:0/2311315012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d507800 msgr2=0x560e7d5080c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T13:13:51.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.340+0000 7f2331203700 1 --2- 172.21.15.92:0/2311315012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d507800 0x560e7d5080c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.340+0000 7f2331203700 1 -- 172.21.15.92:0/2311315012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e7d506ea0 msgr2=0x560e7d5072c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T13:13:51.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.340+0000 7f2331203700 1 --2- 172.21.15.92:0/2311315012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e7d506ea0 0x560e7d5072c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.340+0000 7f2331203700 1 -- 172.21.15.92:0/2311315012 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e7d417470 con 0x560e7d5086a0 2023-10-16T13:13:51.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.340+0000 7f2331203700 1 --2- 172.21.15.92:0/2311315012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d5086a0 0x560e7d508b20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f23240093f0 tx=0x7f2324009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f966c7852fd2cf0d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:51.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.340+0000 7f232bfff700 1 --2- 172.21.15.92:0/4156935462 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f231c0a1480 0x7f231c0a3940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f231800b780 tx=0x7f2318005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:51.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.340+0000 7f2316ffd700 1 -- 172.21.15.92:0/2311315012 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232400e030 con 0x560e7d5086a0 2023-10-16T13:13:51.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.340+0000 7f2316ffd700 1 -- 172.21.15.92:0/2311315012 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f232400f040 con 0x560e7d5086a0 2023-10-16T13:13:51.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.340+0000 7f2316ffd700 1 -- 172.21.15.92:0/2311315012 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324015b20 con 0x560e7d5086a0 2023-10-16T13:13:51.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.341+0000 7f233ee50b80 1 -- 172.21.15.92:0/2311315012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d5086a0 msgr2=0x560e7d508b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:51.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.341+0000 7f233ee50b80 1 --2- 172.21.15.92:0/2311315012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d5086a0 0x560e7d508b20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f23240093f0 tx=0x7f2324009920 comp rx=0 tx=0).stop 2023-10-16T13:13:51.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.341+0000 7f233ee50b80 1 -- 172.21.15.92:0/2311315012 shutdown_connections 2023-10-16T13:13:51.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.341+0000 7f233ee50b80 1 --2- 172.21.15.92:0/2311315012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d5086a0 0x560e7d508b20 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.341+0000 7f233ee50b80 1 --2- 172.21.15.92:0/2311315012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e7d506ea0 0x560e7d5072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.341+0000 7f233ee50b80 1 --2- 172.21.15.92:0/2311315012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d507800 0x560e7d5080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.341+0000 7f233ee50b80 1 -- 172.21.15.92:0/2311315012 >> 172.21.15.92:0/2311315012 conn(0x560e7d434e50 msgr2=0x560e7d502060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:51.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.341+0000 7f233ee50b80 1 -- 172.21.15.92:0/2311315012 shutdown_connections 2023-10-16T13:13:51.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.341+0000 7f233ee50b80 1 -- 172.21.15.92:0/2311315012 wait complete. 2023-10-16T13:13:51.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.342+0000 7f233ee50b80 1 -- start start 2023-10-16T13:13:51.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.342+0000 7f233ee50b80 1 Processor -- start 2023-10-16T13:13:51.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.342+0000 7f233ee50b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d506ea0 0x560e7d510db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.342+0000 7f233ee50b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e7d507800 0x560e7d5112f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.342+0000 7f233ee50b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d5086a0 0x560e7d518330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.342+0000 7f233ee50b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7d459ef0 con 0x560e7d506ea0 2023-10-16T13:13:51.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.342+0000 7f233ee50b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7d3f6790 con 0x560e7d507800 2023-10-16T13:13:51.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.342+0000 7f233ee50b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7d3f6430 con 0x560e7d5086a0 2023-10-16T13:13:51.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.342+0000 7f233ee50b80 10 client.0 _ll_register_callbacks cb 0x560e7d253880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:51.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.342+0000 7f2330a02700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d506ea0 0x560e7d510db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.342+0000 7f2330a02700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d506ea0 0x560e7d510db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37418/0 (socket says 172.21.15.92:37418) 2023-10-16T13:13:51.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.342+0000 7f2330a02700 1 -- 172.21.15.92:0/2200781074 learned_addr learned my addr 172.21.15.92:0/2200781074 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:51.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.342+0000 7f2331203700 1 --2- 172.21.15.92:0/2200781074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d5086a0 0x560e7d518330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.343+0000 7f232bfff700 1 --2- 172.21.15.92:0/2200781074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e7d507800 0x560e7d5112f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.343+0000 7f2331203700 1 -- 172.21.15.92:0/2200781074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e7d507800 msgr2=0x560e7d5112f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:51.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.343+0000 7f2331203700 1 --2- 172.21.15.92:0/2200781074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e7d507800 0x560e7d5112f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.343+0000 7f2331203700 1 -- 172.21.15.92:0/2200781074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d506ea0 msgr2=0x560e7d510db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:51.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.343+0000 7f2331203700 1 --2- 172.21.15.92:0/2200781074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d506ea0 0x560e7d510db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.343+0000 7f2331203700 1 -- 172.21.15.92:0/2200781074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23240090d0 con 0x560e7d5086a0 2023-10-16T13:13:51.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.343+0000 7f2330a02700 1 --2- 172.21.15.92:0/2200781074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d506ea0 0x560e7d510db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:13:51.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.343+0000 7f2331203700 1 --2- 172.21.15.92:0/2200781074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d5086a0 0x560e7d518330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2324015730 tx=0x7f2324016b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36161957715bd492 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:51.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.343+0000 7f230ffff700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-10-16T13:13:51.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.343+0000 7f230ffff700 1 -- 172.21.15.92:0/2200781074 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232400e040 con 0x560e7d5086a0 2023-10-16T13:13:51.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.343+0000 7f233ee50b80 1 -- 172.21.15.92:0/2200781074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e7d45ef70 con 0x560e7d5086a0 2023-10-16T13:13:51.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.343+0000 7f230ffff700 1 -- 172.21.15.92:0/2200781074 <== mon.1 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2324007e40 con 0x560e7d5086a0 2023-10-16T13:13:51.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.343+0000 7f230ffff700 1 -- 172.21.15.92:0/2200781074 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2324015480 con 0x560e7d5086a0 2023-10-16T13:13:51.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.344+0000 7f233ee50b80 10 client.25153 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:51.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.344+0000 7f233ee50b80 1 -- 172.21.15.92:0/2200781074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x560e7d284e60 con 0x560e7d5086a0 2023-10-16T13:13:51.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.344+0000 7f230ffff700 1 -- 172.21.15.92:0/2200781074 <== mon.1 v2:172.21.15.152:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x560e7d45ef70 con 0x560e7d5086a0 2023-10-16T13:13:51.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.344+0000 7f230ffff700 1 -- 172.21.15.92:0/2200781074 <== mon.1 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2324028940 con 0x560e7d5086a0 2023-10-16T13:13:51.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.344+0000 7f233ee50b80 10 client.25153 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:51.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.344+0000 7f233ee50b80 10 client.25153 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:13:51.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.344+0000 7f233ee50b80 20 client.25153 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:51.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.344+0000 7f233ee50b80 1 --2- 172.21.15.92:0/2200781074 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x560e7d51ca50 0x560e7d51ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.344+0000 7f233ee50b80 4 client.25153 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:13:51.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.344+0000 7f233ee50b80 1 -- 172.21.15.92:0/2200781074 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e7d4d6c90 con 0x560e7d51ca50 2023-10-16T13:13:51.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.344+0000 7f2330a02700 1 --2- 172.21.15.92:0/2200781074 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x560e7d51ca50 0x560e7d51ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.345+0000 7f2330a02700 1 --2- 172.21.15.92:0/2200781074 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x560e7d51ca50 0x560e7d51ee70 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c73dbece30a351f server_cookie=3d30674af4d9febe in_seq=0 out_seq=0 2023-10-16T13:13:51.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.345+0000 7f230ffff700 10 client.25153 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:51.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.345+0000 7f230ffff700 1 -- 172.21.15.92:0/2200781074 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560e7d4d6c90 con 0x560e7d51ca50 2023-10-16T13:13:51.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.345+0000 7f230ffff700 10 client.25153 handle_command_reply: tid=0 2023-10-16T13:13:51.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.345+0000 7f233ee50b80 1 client.25153 shutdown 2023-10-16T13:13:51.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.345+0000 7f233ee50b80 1 -- 172.21.15.92:0/2200781074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d5086a0 msgr2=0x560e7d518330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:51.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.345+0000 7f233ee50b80 1 --2- 172.21.15.92:0/2200781074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d5086a0 0x560e7d518330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2324015730 tx=0x7f2324016b20 comp rx=0 tx=0).stop 2023-10-16T13:13:51.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.346+0000 7f233ee50b80 1 -- 172.21.15.92:0/2200781074 shutdown_connections 2023-10-16T13:13:51.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.346+0000 7f233ee50b80 1 --2- 172.21.15.92:0/2200781074 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x560e7d51ca50 0x560e7d51ee70 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.346+0000 7f233ee50b80 1 --2- 172.21.15.92:0/2200781074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d506ea0 0x560e7d510db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.346+0000 7f233ee50b80 1 --2- 172.21.15.92:0/2200781074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d5086a0 0x560e7d518330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.346+0000 7f230ffff700 0 client.25153 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:51.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.346+0000 7f233ee50b80 1 --2- 172.21.15.92:0/2200781074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e7d507800 0x560e7d5112f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.346+0000 7f233ee50b80 1 -- 172.21.15.92:0/2200781074 >> 172.21.15.92:0/2200781074 conn(0x560e7d434e50 msgr2=0x560e7d501c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:51.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.346+0000 7f233ee50b80 1 -- 172.21.15.92:0/2200781074 shutdown_connections 2023-10-16T13:13:51.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.346+0000 7f233ee50b80 1 -- 172.21.15.92:0/2200781074 wait complete. 2023-10-16T13:13:51.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.346+0000 7f233ee50b80 20 client.25153 trim_cache size 0 max 16384 2023-10-16T13:13:51.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.364+0000 7f233ee50b80 1 Processor -- start 2023-10-16T13:13:51.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.364+0000 7f233ee50b80 1 -- start start 2023-10-16T13:13:51.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.364+0000 7f233ee50b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d506ea0 0x560e7d510d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.364+0000 7f233ee50b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e7d507800 0x560e7d5182f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.364+0000 7f233ee50b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d5086a0 0x560e7d5112d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.364+0000 7f233ee50b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7d2da9a0 con 0x560e7d506ea0 2023-10-16T13:13:51.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.364+0000 7f233ee50b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7d508520 con 0x560e7d507800 2023-10-16T13:13:51.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.364+0000 7f233ee50b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7d510260 con 0x560e7d5086a0 2023-10-16T13:13:51.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.364+0000 7f2330a02700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d506ea0 0x560e7d510d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.364+0000 7f2330a02700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d506ea0 0x560e7d510d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37426/0 (socket says 172.21.15.92:37426) 2023-10-16T13:13:51.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.364+0000 7f2330a02700 1 -- 172.21.15.92:0/1537956695 learned_addr learned my addr 172.21.15.92:0/1537956695 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:51.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.364+0000 7f2331203700 1 --2- 172.21.15.92:0/1537956695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d5086a0 0x560e7d5112d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.364+0000 7f232bfff700 1 --2- 172.21.15.92:0/1537956695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e7d507800 0x560e7d5182f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.364+0000 7f2330a02700 1 -- 172.21.15.92:0/1537956695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d5086a0 msgr2=0x560e7d5112d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:51.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.364+0000 7f2330a02700 1 --2- 172.21.15.92:0/1537956695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d5086a0 0x560e7d5112d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.364+0000 7f2330a02700 1 -- 172.21.15.92:0/1537956695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e7d507800 msgr2=0x560e7d5182f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:51.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.364+0000 7f2330a02700 1 --2- 172.21.15.92:0/1537956695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e7d507800 0x560e7d5182f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.364+0000 7f2330a02700 1 -- 172.21.15.92:0/1537956695 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e7d523aa0 con 0x560e7d506ea0 2023-10-16T13:13:51.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.365+0000 7f2330a02700 1 --2- 172.21.15.92:0/1537956695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d506ea0 0x560e7d510d90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2320009f50 tx=0x7f2320095080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8327e789554090e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:51.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.365+0000 7f23177fe700 1 -- 172.21.15.92:0/1537956695 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2320099460 con 0x560e7d506ea0 2023-10-16T13:13:51.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.365+0000 7f23177fe700 1 -- 172.21.15.92:0/1537956695 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f232009d5b0 con 0x560e7d506ea0 2023-10-16T13:13:51.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.365+0000 7f23177fe700 1 -- 172.21.15.92:0/1537956695 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232009d3b0 con 0x560e7d506ea0 2023-10-16T13:13:51.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.366+0000 7f233ee50b80 1 -- 172.21.15.92:0/1537956695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d506ea0 msgr2=0x560e7d510d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:51.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.366+0000 7f233ee50b80 1 --2- 172.21.15.92:0/1537956695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d506ea0 0x560e7d510d90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2320009f50 tx=0x7f2320095080 comp rx=0 tx=0).stop 2023-10-16T13:13:51.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.366+0000 7f233ee50b80 1 -- 172.21.15.92:0/1537956695 shutdown_connections 2023-10-16T13:13:51.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.366+0000 7f233ee50b80 1 --2- 172.21.15.92:0/1537956695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d506ea0 0x560e7d510d90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.366+0000 7f233ee50b80 1 --2- 172.21.15.92:0/1537956695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d5086a0 0x560e7d5112d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.366+0000 7f233ee50b80 1 --2- 172.21.15.92:0/1537956695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e7d507800 0x560e7d5182f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.366+0000 7f233ee50b80 1 -- 172.21.15.92:0/1537956695 >> 172.21.15.92:0/1537956695 conn(0x560e7d434e50 msgr2=0x560e7d50b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:51.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.366+0000 7f233ee50b80 1 -- 172.21.15.92:0/1537956695 shutdown_connections 2023-10-16T13:13:51.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.366+0000 7f233ee50b80 1 -- 172.21.15.92:0/1537956695 wait complete. 2023-10-16T13:13:51.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.366+0000 7f233ee50b80 1 -- start start 2023-10-16T13:13:51.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.366+0000 7f233ee50b80 1 Processor -- start 2023-10-16T13:13:51.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.367+0000 7f233ee50b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e7d506ea0 0x560e7d516950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.367+0000 7f233ee50b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d507800 0x560e7d516e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.367+0000 7f233ee50b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d5086a0 0x560e7d5173d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.367+0000 7f233ee50b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7d5185d0 con 0x560e7d5086a0 2023-10-16T13:13:51.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.367+0000 7f233ee50b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7d570870 con 0x560e7d506ea0 2023-10-16T13:13:51.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.367+0000 7f233ee50b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7d5709b0 con 0x560e7d507800 2023-10-16T13:13:51.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.367+0000 7f233ee50b80 10 client.0 _ll_register_callbacks cb 0x7f23240092f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:51.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.367+0000 7f2331203700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d5086a0 0x560e7d5173d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.367+0000 7f2331203700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d5086a0 0x560e7d5173d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37436/0 (socket says 172.21.15.92:37436) 2023-10-16T13:13:51.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.367+0000 7f2331203700 1 -- 172.21.15.92:0/2268598324 learned_addr learned my addr 172.21.15.92:0/2268598324 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:51.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.367+0000 7f2330a02700 1 --2- 172.21.15.92:0/2268598324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e7d506ea0 0x560e7d516950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.367+0000 7f232bfff700 1 --2- 172.21.15.92:0/2268598324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d507800 0x560e7d516e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.367+0000 7f2331203700 1 -- 172.21.15.92:0/2268598324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d507800 msgr2=0x560e7d516e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:51.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.367+0000 7f2331203700 1 --2- 172.21.15.92:0/2268598324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d507800 0x560e7d516e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.367+0000 7f2331203700 1 -- 172.21.15.92:0/2268598324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e7d506ea0 msgr2=0x560e7d516950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:51.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.367+0000 7f2331203700 1 --2- 172.21.15.92:0/2268598324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e7d506ea0 0x560e7d516950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.367+0000 7f2331203700 1 -- 172.21.15.92:0/2268598324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c196f60 con 0x560e7d5086a0 2023-10-16T13:13:51.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.367+0000 7f232bfff700 1 --2- 172.21.15.92:0/2268598324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d507800 0x560e7d516e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:51.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.368+0000 7f2331203700 1 --2- 172.21.15.92:0/2268598324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d5086a0 0x560e7d5173d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2324007b70 tx=0x7f2324028c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f6364554f2b2da server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:51.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.368+0000 7f230ffff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:51.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.368+0000 7f230ffff700 1 -- 172.21.15.92:0/2268598324 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232400e030 con 0x560e7d5086a0 2023-10-16T13:13:51.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.368+0000 7f233ee50b80 1 -- 172.21.15.92:0/2268598324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f232400f040 con 0x560e7d5086a0 2023-10-16T13:13:51.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.368+0000 7f230ffff700 1 -- 172.21.15.92:0/2268598324 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2324007e40 con 0x560e7d5086a0 2023-10-16T13:13:51.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.368+0000 7f230ffff700 1 -- 172.21.15.92:0/2268598324 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23240145f0 con 0x560e7d5086a0 2023-10-16T13:13:51.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.368+0000 7f233ee50b80 10 client.15630 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:51.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.368+0000 7f233ee50b80 1 -- 172.21.15.92:0/2268598324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x560e7d26dce0 con 0x560e7d5086a0 2023-10-16T13:13:51.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.368+0000 7f230ffff700 1 -- 172.21.15.92:0/2268598324 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2324042020 con 0x560e7d5086a0 2023-10-16T13:13:51.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.368+0000 7f230ffff700 1 -- 172.21.15.92:0/2268598324 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f232403e7c0 con 0x560e7d5086a0 2023-10-16T13:13:51.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.368+0000 7f233ee50b80 10 client.15630 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:51.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.368+0000 7f233ee50b80 10 client.15630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:13:51.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.368+0000 7f233ee50b80 20 client.15630 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:51.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.368+0000 7f233ee50b80 1 --2- 172.21.15.92:0/2268598324 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x560e7d5720b0 0x560e7d5744d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.369+0000 7f233ee50b80 4 client.15630 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-16T13:13:51.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.369+0000 7f233ee50b80 1 -- 172.21.15.92:0/2268598324 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x560e7d452ed0 con 0x560e7d5720b0 2023-10-16T13:13:51.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.369+0000 7f2330a02700 1 --2- 172.21.15.92:0/2268598324 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x560e7d5720b0 0x560e7d5744d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.369+0000 7f2330a02700 1 --2- 172.21.15.92:0/2268598324 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x560e7d5720b0 0x560e7d5744d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c7674b0d7f5b39b server_cookie=c29143b313a582cf in_seq=0 out_seq=0 2023-10-16T13:13:51.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.369+0000 7f230ffff700 10 client.15630 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:51.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.371+0000 7f230ffff700 1 -- 172.21.15.92:0/2268598324 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x560e7d452ed0 con 0x560e7d5720b0 2023-10-16T13:13:51.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.371+0000 7f230ffff700 10 client.15630 handle_command_reply: tid=0 2023-10-16T13:13:51.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.371+0000 7f233ee50b80 1 client.15630 shutdown 2023-10-16T13:13:51.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.371+0000 7f233ee50b80 1 -- 172.21.15.92:0/2268598324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d5086a0 msgr2=0x560e7d5173d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:51.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.371+0000 7f233ee50b80 1 --2- 172.21.15.92:0/2268598324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d5086a0 0x560e7d5173d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2324007b70 tx=0x7f2324028c10 comp rx=0 tx=0).stop 2023-10-16T13:13:51.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.371+0000 7f233ee50b80 1 -- 172.21.15.92:0/2268598324 shutdown_connections 2023-10-16T13:13:51.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.371+0000 7f233ee50b80 1 --2- 172.21.15.92:0/2268598324 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x560e7d5720b0 0x560e7d5744d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.371+0000 7f233ee50b80 1 --2- 172.21.15.92:0/2268598324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e7d5086a0 0x560e7d5173d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.371+0000 7f233ee50b80 1 --2- 172.21.15.92:0/2268598324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e7d506ea0 0x560e7d516950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.371+0000 7f233ee50b80 1 --2- 172.21.15.92:0/2268598324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560e7d507800 0x560e7d516e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.371+0000 7f233ee50b80 1 -- 172.21.15.92:0/2268598324 >> 172.21.15.92:0/2268598324 conn(0x560e7d434e50 msgr2=0x560e7d510d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:51.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.371+0000 7f230ffff700 0 client.15630 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:51.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.371+0000 7f233ee50b80 1 -- 172.21.15.92:0/2268598324 shutdown_connections 2023-10-16T13:13:51.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.371+0000 7f233ee50b80 1 -- 172.21.15.92:0/2268598324 wait complete. 2023-10-16T13:13:51.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.371+0000 7f233ee50b80 20 client.15630 trim_cache size 0 max 16384 2023-10-16T13:13:51.388 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:13:51.388 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2023-10-16T13:13:51.388 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "d760f2b0-0ec6-4958-9176-4bd9bc6f8bf3", 2023-10-16T13:13:51.388 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2023-10-16T13:13:51.389 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:13:51.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.372+0000 7f2332c66700 1 -- 172.21.15.92:0/4156935462 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f231c0a1480 msgr2=0x7f231c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:51.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.372+0000 7f2332c66700 1 --2- 172.21.15.92:0/4156935462 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f231c0a1480 0x7f231c0a3940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f231800b780 tx=0x7f2318005fd0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.372+0000 7f2332c66700 1 -- 172.21.15.92:0/4156935462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f232c0ffa10 msgr2=0x7f232c10a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:51.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.372+0000 7f2332c66700 1 --2- 172.21.15.92:0/4156935462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f232c0ffa10 0x7f232c10a630 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f232000d980 tx=0x7f232000dc90 comp rx=0 tx=0).stop 2023-10-16T13:13:51.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.372+0000 7f2332c66700 1 -- 172.21.15.92:0/4156935462 shutdown_connections 2023-10-16T13:13:51.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.372+0000 7f2332c66700 1 --2- 172.21.15.92:0/4156935462 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f231c0a1480 0x7f231c0a3940 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.372+0000 7f2332c66700 1 --2- 172.21.15.92:0/4156935462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f232c0ffa10 0x7f232c10a630 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.372+0000 7f2332c66700 1 --2- 172.21.15.92:0/4156935462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f232c1014e0 0x7f232c1091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.372+0000 7f2332c66700 1 --2- 172.21.15.92:0/4156935462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f232c1003b0 0x7f232c108c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.372+0000 7f2332c66700 1 -- 172.21.15.92:0/4156935462 >> 172.21.15.92:0/4156935462 conn(0x7f232c0fb330 msgr2=0x7f232c0fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:51.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.372+0000 7f2332c66700 1 -- 172.21.15.92:0/4156935462 shutdown_connections 2023-10-16T13:13:51.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.372+0000 7f2332c66700 1 -- 172.21.15.92:0/4156935462 wait complete. 2023-10-16T13:13:51.393 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-16T13:13:51.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.538+0000 7f9e02c98700 1 -- 172.21.15.92:0/1797345858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dfc102050 msgr2=0x7f9dfc1024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:51.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.538+0000 7f9e02c98700 1 --2- 172.21.15.92:0/1797345858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dfc102050 0x7f9dfc1024d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9de8009990 tx=0x7f9de8009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.538+0000 7f9e02c98700 1 -- 172.21.15.92:0/1797345858 shutdown_connections 2023-10-16T13:13:51.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.538+0000 7f9e02c98700 1 --2- 172.21.15.92:0/1797345858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dfc102a10 0x7f9dfc109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.538+0000 7f9e02c98700 1 --2- 172.21.15.92:0/1797345858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dfc100e70 0x7f9dfc101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.538+0000 7f9e02c98700 1 --2- 172.21.15.92:0/1797345858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dfc102050 0x7f9dfc1024d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.538+0000 7f9e02c98700 1 -- 172.21.15.92:0/1797345858 >> 172.21.15.92:0/1797345858 conn(0x7f9dfc0fc3f0 msgr2=0x7f9dfc0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:51.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.538+0000 7f9e02c98700 1 -- 172.21.15.92:0/1797345858 shutdown_connections 2023-10-16T13:13:51.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.538+0000 7f9e02c98700 1 -- 172.21.15.92:0/1797345858 wait complete. 2023-10-16T13:13:51.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.539+0000 7f9e02c98700 1 Processor -- start 2023-10-16T13:13:51.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.539+0000 7f9e02c98700 1 -- start start 2023-10-16T13:13:51.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.539+0000 7f9e02c98700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dfc100e70 0x7f9dfc198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.539+0000 7f9e02c98700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dfc102050 0x7f9dfc199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.539+0000 7f9e02c98700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dfc102a10 0x7f9dfc1a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.539+0000 7f9e02c98700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc1a09d0 con 0x7f9dfc100e70 2023-10-16T13:13:51.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.539+0000 7f9e02c98700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc1a0b10 con 0x7f9dfc102a10 2023-10-16T13:13:51.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.539+0000 7f9e02c98700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc1a0ca0 con 0x7f9dfc102050 2023-10-16T13:13:51.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.539+0000 7f9e00a34700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dfc100e70 0x7f9dfc198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.539+0000 7f9e00a34700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dfc100e70 0x7f9dfc198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37444/0 (socket says 172.21.15.92:37444) 2023-10-16T13:13:51.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.539+0000 7f9e00a34700 1 -- 172.21.15.92:0/3953004554 learned_addr learned my addr 172.21.15.92:0/3953004554 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:51.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.539+0000 7f9dfbfff700 1 --2- 172.21.15.92:0/3953004554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dfc102050 0x7f9dfc199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.539+0000 7f9e00a34700 1 -- 172.21.15.92:0/3953004554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dfc102050 msgr2=0x7f9dfc199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:51.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.539+0000 7f9e00a34700 1 --2- 172.21.15.92:0/3953004554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dfc102050 0x7f9dfc199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.539+0000 7f9e01235700 1 --2- 172.21.15.92:0/3953004554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dfc102a10 0x7f9dfc1a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.539+0000 7f9e00a34700 1 -- 172.21.15.92:0/3953004554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dfc102a10 msgr2=0x7f9dfc1a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:51.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.539+0000 7f9e00a34700 1 --2- 172.21.15.92:0/3953004554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dfc102a10 0x7f9dfc1a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.539+0000 7f9e00a34700 1 -- 172.21.15.92:0/3953004554 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de80095f0 con 0x7f9dfc100e70 2023-10-16T13:13:51.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.540+0000 7f9e00a34700 1 --2- 172.21.15.92:0/3953004554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dfc100e70 0x7f9dfc198e50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9df000c990 tx=0x7f9df000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:51.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.540+0000 7f9df9ffb700 1 -- 172.21.15.92:0/3953004554 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df0007b00 con 0x7f9dfc100e70 2023-10-16T13:13:51.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.540+0000 7f9df9ffb700 1 -- 172.21.15.92:0/3953004554 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9df0007c60 con 0x7f9dfc100e70 2023-10-16T13:13:51.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.540+0000 7f9e02c98700 1 -- 172.21.15.92:0/3953004554 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc1a0f80 con 0x7f9dfc100e70 2023-10-16T13:13:51.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.540+0000 7f9df9ffb700 1 -- 172.21.15.92:0/3953004554 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df0018680 con 0x7f9dfc100e70 2023-10-16T13:13:51.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.540+0000 7f9e02c98700 1 -- 172.21.15.92:0/3953004554 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc1a13b0 con 0x7f9dfc100e70 2023-10-16T13:13:51.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.543+0000 7f9df9ffb700 1 -- 172.21.15.92:0/3953004554 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f9df000f450 con 0x7f9dfc100e70 2023-10-16T13:13:51.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.544+0000 7f9df9ffb700 1 --2- 172.21.15.92:0/3953004554 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f9dec0a1500 0x7f9dec0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.544+0000 7f9dfbfff700 1 --2- 172.21.15.92:0/3953004554 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f9dec0a1500 0x7f9dec0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.544+0000 7f9df9ffb700 1 -- 172.21.15.92:0/3953004554 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f9df00ccd00 con 0x7f9dfc100e70 2023-10-16T13:13:51.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.544+0000 7f9e0ee82b80 1 Processor -- start 2023-10-16T13:13:51.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.544+0000 7f9dfbfff700 1 --2- 172.21.15.92:0/3953004554 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f9dec0a1500 0x7f9dec0a39c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9de800b5c0 tx=0x7f9de8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:51.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.544+0000 7f9e0ee82b80 1 -- start start 2023-10-16T13:13:51.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.545+0000 7f9e0ee82b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f949e20 0x55a99f94a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.545+0000 7f9e0ee82b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94a780 0x55a99f94b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.545+0000 7f9e0ee82b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94b620 0x55a99f94baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.545+0000 7f9e0ee82b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a99f8bec70 con 0x55a99f94a780 2023-10-16T13:13:51.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.545+0000 7f9e0ee82b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a99f8a3c60 con 0x55a99f949e20 2023-10-16T13:13:51.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.545+0000 7f9e0ee82b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a99f8a1580 con 0x55a99f94b620 2023-10-16T13:13:51.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.545+0000 7f9dfbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94a780 0x55a99f94b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.545+0000 7f9dfbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94a780 0x55a99f94b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37454/0 (socket says 172.21.15.92:37454) 2023-10-16T13:13:51.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.545+0000 7f9dfbfff700 1 -- 172.21.15.92:0/2305130109 learned_addr learned my addr 172.21.15.92:0/2305130109 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:51.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.545+0000 7f9e00a34700 1 --2- 172.21.15.92:0/2305130109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f949e20 0x55a99f94a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.545+0000 7f9e01235700 1 --2- 172.21.15.92:0/2305130109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94b620 0x55a99f94baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.545+0000 7f9dfbfff700 1 -- 172.21.15.92:0/2305130109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94b620 msgr2=0x55a99f94baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:51.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.545+0000 7f9dfbfff700 1 --2- 172.21.15.92:0/2305130109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94b620 0x55a99f94baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.545+0000 7f9dfbfff700 1 -- 172.21.15.92:0/2305130109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f949e20 msgr2=0x55a99f94a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:51.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.545+0000 7f9dfbfff700 1 --2- 172.21.15.92:0/2305130109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f949e20 0x55a99f94a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.545+0000 7f9dfbfff700 1 -- 172.21.15.92:0/2305130109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a99f85a3f0 con 0x55a99f94a780 2023-10-16T13:13:51.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.545+0000 7f9dfbfff700 1 --2- 172.21.15.92:0/2305130109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94a780 0x55a99f94b040 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc100b90 tx=0x7f9de801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904a1f7ca38c2f09 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:51.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.545+0000 7f9de6ffd700 1 -- 172.21.15.92:0/2305130109 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de802b070 con 0x55a99f94a780 2023-10-16T13:13:51.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.546+0000 7f9de6ffd700 1 -- 172.21.15.92:0/2305130109 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9de801e040 con 0x55a99f94a780 2023-10-16T13:13:51.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.546+0000 7f9de6ffd700 1 -- 172.21.15.92:0/2305130109 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de8024820 con 0x55a99f94a780 2023-10-16T13:13:51.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.546+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/2305130109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94a780 msgr2=0x55a99f94b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:51.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.546+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/2305130109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94a780 0x55a99f94b040 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc100b90 tx=0x7f9de801f000 comp rx=0 tx=0).stop 2023-10-16T13:13:51.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.546+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/2305130109 shutdown_connections 2023-10-16T13:13:51.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.546+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/2305130109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94b620 0x55a99f94baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.546+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/2305130109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f949e20 0x55a99f94a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.546+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/2305130109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94a780 0x55a99f94b040 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.546+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/2305130109 >> 172.21.15.92:0/2305130109 conn(0x55a99f877dd0 msgr2=0x55a99f944fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:51.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.546+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/2305130109 shutdown_connections 2023-10-16T13:13:51.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.546+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/2305130109 wait complete. 2023-10-16T13:13:51.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.547+0000 7f9e0ee82b80 1 -- start start 2023-10-16T13:13:51.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.547+0000 7f9e0ee82b80 1 Processor -- start 2023-10-16T13:13:51.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.547+0000 7f9e0ee82b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f949e20 0x55a99f953c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.547+0000 7f9e0ee82b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94a780 0x55a99f954180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.547+0000 7f9e0ee82b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94b620 0x55a99f95b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.547+0000 7f9e0ee82b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a99f89ce70 con 0x55a99f94b620 2023-10-16T13:13:51.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.547+0000 7f9e0ee82b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a99f839710 con 0x55a99f949e20 2023-10-16T13:13:51.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.547+0000 7f9e0ee82b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a99f8393b0 con 0x55a99f94a780 2023-10-16T13:13:51.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.548+0000 7f9e0ee82b80 10 client.0 _ll_register_callbacks cb 0x55a99f696800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:51.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.548+0000 7f9e01235700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94b620 0x55a99f95b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.548+0000 7f9e01235700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94b620 0x55a99f95b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37462/0 (socket says 172.21.15.92:37462) 2023-10-16T13:13:51.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.548+0000 7f9dfbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94a780 0x55a99f954180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.548+0000 7f9e01235700 1 -- 172.21.15.92:0/860622366 learned_addr learned my addr 172.21.15.92:0/860622366 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:51.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.548+0000 7f9e00a34700 1 --2- 172.21.15.92:0/860622366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f949e20 0x55a99f953c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.548+0000 7f9e01235700 1 -- 172.21.15.92:0/860622366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94a780 msgr2=0x55a99f954180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:51.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.548+0000 7f9e01235700 1 --2- 172.21.15.92:0/860622366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94a780 0x55a99f954180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.548+0000 7f9e01235700 1 -- 172.21.15.92:0/860622366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f949e20 msgr2=0x55a99f953c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:51.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.548+0000 7f9e01235700 1 --2- 172.21.15.92:0/860622366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f949e20 0x55a99f953c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.548+0000 7f9e01235700 1 -- 172.21.15.92:0/860622366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc109c60 con 0x55a99f94b620 2023-10-16T13:13:51.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.548+0000 7f9dfbfff700 1 --2- 172.21.15.92:0/860622366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94a780 0x55a99f954180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:13:51.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.548+0000 7f9e01235700 1 --2- 172.21.15.92:0/860622366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94b620 0x55a99f95b1c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9df4007870 tx=0x7f9df4007b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309f02b96c5c6b4b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:51.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.548+0000 7f9ddbfff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:51.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.548+0000 7f9ddbfff700 1 -- 172.21.15.92:0/860622366 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40155f0 con 0x55a99f94b620 2023-10-16T13:13:51.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.548+0000 7f9ddbfff700 1 -- 172.21.15.92:0/860622366 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f9df4015750 con 0x55a99f94b620 2023-10-16T13:13:51.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.548+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/860622366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a99f8a1ef0 con 0x55a99f94b620 2023-10-16T13:13:51.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.549+0000 7f9ddbfff700 1 -- 172.21.15.92:0/860622366 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9df4015910 con 0x55a99f94b620 2023-10-16T13:13:51.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.549+0000 7f9e0ee82b80 10 client.15642 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:51.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.549+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/860622366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a99f6c7de0 con 0x55a99f94b620 2023-10-16T13:13:51.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.549+0000 7f9ddbfff700 1 -- 172.21.15.92:0/860622366 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9df4025020 con 0x55a99f94b620 2023-10-16T13:13:51.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.549+0000 7f9ddbfff700 1 -- 172.21.15.92:0/860622366 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9df401f400 con 0x55a99f94b620 2023-10-16T13:13:51.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.549+0000 7f9e0ee82b80 10 client.15642 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:51.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.549+0000 7f9e0ee82b80 10 client.15642 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:13:51.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.549+0000 7f9e0ee82b80 20 client.15642 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:51.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.549+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/860622366 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a99f95fb70 0x55a99f961f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.549+0000 7f9e0ee82b80 4 client.15642 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:13:51.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.549+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/860622366 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a99f919c10 con 0x55a99f95fb70 2023-10-16T13:13:51.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.549+0000 7f9e00a34700 1 --2- 172.21.15.92:0/860622366 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a99f95fb70 0x55a99f961f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.550+0000 7f9ddbfff700 10 client.15642 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:51.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.550+0000 7f9e00a34700 1 --2- 172.21.15.92:0/860622366 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a99f95fb70 0x55a99f961f90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6ae69502e51bd69 server_cookie=22e2c2ec1f4d4d4 in_seq=0 out_seq=0 2023-10-16T13:13:51.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.550+0000 7f9ddbfff700 1 -- 172.21.15.92:0/860622366 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a99f919c10 con 0x55a99f95fb70 2023-10-16T13:13:51.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.550+0000 7f9ddbfff700 10 client.15642 handle_command_reply: tid=0 2023-10-16T13:13:51.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.551+0000 7f9e0ee82b80 1 client.15642 shutdown 2023-10-16T13:13:51.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.551+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/860622366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94b620 msgr2=0x55a99f95b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:51.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.551+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/860622366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94b620 0x55a99f95b1c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9df4007870 tx=0x7f9df4007b80 comp rx=0 tx=0).stop 2023-10-16T13:13:51.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.551+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/860622366 shutdown_connections 2023-10-16T13:13:51.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.551+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/860622366 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a99f95fb70 0x55a99f961f90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.551+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/860622366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94b620 0x55a99f95b1c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.551+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/860622366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f949e20 0x55a99f953c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.551+0000 7f9ddbfff700 0 client.15642 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:51.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.551+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/860622366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94a780 0x55a99f954180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.551+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/860622366 >> 172.21.15.92:0/860622366 conn(0x55a99f877dd0 msgr2=0x55a99f944bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:51.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.551+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/860622366 shutdown_connections 2023-10-16T13:13:51.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.551+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/860622366 wait complete. 2023-10-16T13:13:51.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.551+0000 7f9e0ee82b80 20 client.15642 trim_cache size 0 max 16384 2023-10-16T13:13:51.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.583+0000 7f9e0ee82b80 1 Processor -- start 2023-10-16T13:13:51.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.583+0000 7f9e0ee82b80 1 -- start start 2023-10-16T13:13:51.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.583+0000 7f9e0ee82b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f949e20 0x55a99f94e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.583+0000 7f9e0ee82b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f94a780 0x55a99f95b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.583+0000 7f9e0ee82b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94b620 0x55a99f94eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.583+0000 7f9e0ee82b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a99f71d920 con 0x55a99f949e20 2023-10-16T13:13:51.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.583+0000 7f9e0ee82b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a99f952f10 con 0x55a99f94a780 2023-10-16T13:13:51.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.583+0000 7f9e0ee82b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a99f9548c0 con 0x55a99f94b620 2023-10-16T13:13:51.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.583+0000 7f9e00a34700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f949e20 0x55a99f94e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.583+0000 7f9e00a34700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f949e20 0x55a99f94e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37466/0 (socket says 172.21.15.92:37466) 2023-10-16T13:13:51.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.583+0000 7f9e00a34700 1 -- 172.21.15.92:0/1371106395 learned_addr learned my addr 172.21.15.92:0/1371106395 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:51.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.584+0000 7f9e01235700 1 --2- 172.21.15.92:0/1371106395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94b620 0x55a99f94eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.584+0000 7f9e00a34700 1 -- 172.21.15.92:0/1371106395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94b620 msgr2=0x55a99f94eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:51.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.584+0000 7f9e00a34700 1 --2- 172.21.15.92:0/1371106395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94b620 0x55a99f94eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.584+0000 7f9e00a34700 1 -- 172.21.15.92:0/1371106395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f94a780 msgr2=0x55a99f95b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:51.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.584+0000 7f9e00a34700 1 --2- 172.21.15.92:0/1371106395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f94a780 0x55a99f95b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.584+0000 7f9e00a34700 1 -- 172.21.15.92:0/1371106395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a99f6b0c60 con 0x55a99f949e20 2023-10-16T13:13:51.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.584+0000 7f9e00a34700 1 --2- 172.21.15.92:0/1371106395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f949e20 0x55a99f94e5c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9df0000c00 tx=0x7f9df00ca6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7343be9ffc22b8ba server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:51.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.584+0000 7f9de77fe700 1 -- 172.21.15.92:0/1371106395 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df00a23b0 con 0x55a99f949e20 2023-10-16T13:13:51.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.584+0000 7f9de77fe700 1 -- 172.21.15.92:0/1371106395 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9df007c070 con 0x55a99f949e20 2023-10-16T13:13:51.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.584+0000 7f9de77fe700 1 -- 172.21.15.92:0/1371106395 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df00b8210 con 0x55a99f949e20 2023-10-16T13:13:51.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.585+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/1371106395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f949e20 msgr2=0x55a99f94e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:51.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.585+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/1371106395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f949e20 0x55a99f94e5c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9df0000c00 tx=0x7f9df00ca6d0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.585+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/1371106395 shutdown_connections 2023-10-16T13:13:51.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.585+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/1371106395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f949e20 0x55a99f94e5c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.585+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/1371106395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94b620 0x55a99f94eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.585+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/1371106395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f94a780 0x55a99f95b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.585+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/1371106395 >> 172.21.15.92:0/1371106395 conn(0x55a99f877dd0 msgr2=0x55a99f951a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:51.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.585+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/1371106395 shutdown_connections 2023-10-16T13:13:51.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.585+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/1371106395 wait complete. 2023-10-16T13:13:51.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.586+0000 7f9e0ee82b80 1 -- start start 2023-10-16T13:13:51.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.586+0000 7f9e0ee82b80 1 Processor -- start 2023-10-16T13:13:51.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.586+0000 7f9e0ee82b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f949e20 0x55a99f95af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.586+0000 7f9e0ee82b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94a780 0x55a99f9595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.586+0000 7f9e0ee82b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94b620 0x55a99f959ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.586+0000 7f9e0ee82b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a99f95a0c0 con 0x55a99f94a780 2023-10-16T13:13:51.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.586+0000 7f9e0ee82b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a99f95a230 con 0x55a99f949e20 2023-10-16T13:13:51.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.586+0000 7f9e0ee82b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a99f95a3f0 con 0x55a99f94b620 2023-10-16T13:13:51.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.586+0000 7f9e0ee82b80 10 client.0 _ll_register_callbacks cb 0x7f9df4009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:51.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.586+0000 7f9e00a34700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f949e20 0x55a99f95af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.586+0000 7f9e00a34700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f949e20 0x55a99f95af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:38280/0 (socket says 172.21.15.92:38280) 2023-10-16T13:13:51.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.586+0000 7f9e00a34700 1 -- 172.21.15.92:0/3344056377 learned_addr learned my addr 172.21.15.92:0/3344056377 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:51.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.586+0000 7f9dfbfff700 1 --2- 172.21.15.92:0/3344056377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94a780 0x55a99f9595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.587+0000 7f9e00a34700 1 -- 172.21.15.92:0/3344056377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94b620 msgr2=0x55a99f959ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:51.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.587+0000 7f9e01235700 1 --2- 172.21.15.92:0/3344056377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94b620 0x55a99f959ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.587+0000 7f9e00a34700 1 --2- 172.21.15.92:0/3344056377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94b620 0x55a99f959ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.587+0000 7f9e00a34700 1 -- 172.21.15.92:0/3344056377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94a780 msgr2=0x55a99f9595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:51.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.587+0000 7f9e00a34700 1 --2- 172.21.15.92:0/3344056377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94a780 0x55a99f9595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.587+0000 7f9e00a34700 1 -- 172.21.15.92:0/3344056377 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc1a13b0 con 0x55a99f949e20 2023-10-16T13:13:51.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.587+0000 7f9e01235700 1 --2- 172.21.15.92:0/3344056377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94b620 0x55a99f959ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:51.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.587+0000 7f9dfbfff700 1 --2- 172.21.15.92:0/3344056377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94a780 0x55a99f9595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:13:51.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.587+0000 7f9e00a34700 1 --2- 172.21.15.92:0/3344056377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f949e20 0x55a99f95af90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9df009a8d0 tx=0x7f9df00a23b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=944f4dd373c21d4f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:51.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.587+0000 7f9ddbfff700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-16T13:13:51.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.587+0000 7f9ddbfff700 1 -- 172.21.15.92:0/3344056377 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df001fde0 con 0x55a99f949e20 2023-10-16T13:13:51.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.587+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/3344056377 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9de801e040 con 0x55a99f949e20 2023-10-16T13:13:51.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.587+0000 7f9ddbfff700 1 -- 172.21.15.92:0/3344056377 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f9df00b8210 con 0x55a99f949e20 2023-10-16T13:13:51.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.587+0000 7f9ddbfff700 1 -- 172.21.15.92:0/3344056377 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9df009a280 con 0x55a99f949e20 2023-10-16T13:13:51.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.588+0000 7f9e0ee82b80 10 client.25220 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:51.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.588+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/3344056377 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a99f6ee250 con 0x55a99f949e20 2023-10-16T13:13:51.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.588+0000 7f9ddbfff700 1 -- 172.21.15.92:0/3344056377 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9de801e040 con 0x55a99f949e20 2023-10-16T13:13:51.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.588+0000 7f9ddbfff700 1 -- 172.21.15.92:0/3344056377 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9df00a1f20 con 0x55a99f949e20 2023-10-16T13:13:51.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.588+0000 7f9e0ee82b80 10 client.25220 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:51.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.588+0000 7f9e0ee82b80 10 client.25220 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:13:51.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.588+0000 7f9e0ee82b80 20 client.25220 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:51.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.588+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/3344056377 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a99f9bd5b0 0x55a99f9bf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:51.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.588+0000 7f9e0ee82b80 4 client.25220 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-16T13:13:51.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.588+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/3344056377 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a99f895e50 con 0x55a99f9bd5b0 2023-10-16T13:13:51.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.588+0000 7f9dfbfff700 1 --2- 172.21.15.92:0/3344056377 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a99f9bd5b0 0x55a99f9bf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:51.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.589+0000 7f9ddbfff700 10 client.25220 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:51.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.589+0000 7f9dfbfff700 1 --2- 172.21.15.92:0/3344056377 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a99f9bd5b0 0x55a99f9bf9d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67b2ada5e883d699 server_cookie=9611c9ea7b79c2c3 in_seq=0 out_seq=0 2023-10-16T13:13:51.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.589+0000 7f9ddbfff700 1 -- 172.21.15.92:0/3344056377 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a99f895e50 con 0x55a99f9bd5b0 2023-10-16T13:13:51.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.589+0000 7f9ddbfff700 10 client.25220 handle_command_reply: tid=0 2023-10-16T13:13:51.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.589+0000 7f9e0ee82b80 1 client.25220 shutdown 2023-10-16T13:13:51.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.589+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/3344056377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f949e20 msgr2=0x55a99f95af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:51.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.589+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/3344056377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f949e20 0x55a99f95af90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9df009a8d0 tx=0x7f9df00a23b0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.589+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/3344056377 shutdown_connections 2023-10-16T13:13:51.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.589+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/3344056377 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55a99f9bd5b0 0x55a99f9bf9d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.589+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/3344056377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a99f94b620 0x55a99f959ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.589+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/3344056377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a99f949e20 0x55a99f95af90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.589+0000 7f9e0ee82b80 1 --2- 172.21.15.92:0/3344056377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a99f94a780 0x55a99f9595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.589+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/3344056377 >> 172.21.15.92:0/3344056377 conn(0x55a99f877dd0 msgr2=0x55a99f94e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:51.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.589+0000 7f9ddbfff700 0 client.25220 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:51.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.589+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/3344056377 shutdown_connections 2023-10-16T13:13:51.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.589+0000 7f9e0ee82b80 1 -- 172.21.15.92:0/3344056377 wait complete. 2023-10-16T13:13:51.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.589+0000 7f9e0ee82b80 20 client.25220 trim_cache size 0 max 16384 2023-10-16T13:13:51.606 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:13:51.607 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-16T13:13:51.607 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2023-10-16T13:13:51.607 INFO:teuthology.orchestra.run.smithi092.stdout: "d760f2b0-0ec6-4958-9176-4bd9bc6f8bf3": { 2023-10-16T13:13:51.607 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2023-10-16T13:13:51.607 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "d760f2b0-0ec6-4958-9176-4bd9bc6f8bf3", 2023-10-16T13:13:51.607 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2023-10-16T13:13:51.608 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:13:51.608 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:13:51.608 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:13:51.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.590+0000 7f9e02c98700 1 -- 172.21.15.92:0/3953004554 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f9dec0a1500 msgr2=0x7f9dec0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:51.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.590+0000 7f9e02c98700 1 --2- 172.21.15.92:0/3953004554 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f9dec0a1500 0x7f9dec0a39c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9de800b5c0 tx=0x7f9de8005fb0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.590+0000 7f9e02c98700 1 -- 172.21.15.92:0/3953004554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dfc100e70 msgr2=0x7f9dfc198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:51.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.590+0000 7f9e02c98700 1 --2- 172.21.15.92:0/3953004554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dfc100e70 0x7f9dfc198e50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9df000c990 tx=0x7f9df000cd50 comp rx=0 tx=0).stop 2023-10-16T13:13:51.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.590+0000 7f9e02c98700 1 -- 172.21.15.92:0/3953004554 shutdown_connections 2023-10-16T13:13:51.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.590+0000 7f9e02c98700 1 --2- 172.21.15.92:0/3953004554 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f9dec0a1500 0x7f9dec0a39c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.590+0000 7f9e02c98700 1 --2- 172.21.15.92:0/3953004554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dfc100e70 0x7f9dfc198e50 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.590+0000 7f9e02c98700 1 --2- 172.21.15.92:0/3953004554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dfc102a10 0x7f9dfc1a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.590+0000 7f9e02c98700 1 --2- 172.21.15.92:0/3953004554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dfc102050 0x7f9dfc199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:51.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.590+0000 7f9e02c98700 1 -- 172.21.15.92:0/3953004554 >> 172.21.15.92:0/3953004554 conn(0x7f9dfc0fc3f0 msgr2=0x7f9dfc107920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:51.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.590+0000 7f9e02c98700 1 -- 172.21.15.92:0/3953004554 shutdown_connections 2023-10-16T13:13:51.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:13:51.590+0000 7f9e02c98700 1 -- 172.21.15.92:0/3953004554 wait complete. 2023-10-16T13:13:51.612 INFO:tasks.cephfs.filesystem:scrub status for tag:d760f2b0-0ec6-4958-9176-4bd9bc6f8bf3 - {'path': '/', 'tag': 'd760f2b0-0ec6-4958-9176-4bd9bc6f8bf3', 'options': 'recursive,force'} 2023-10-16T13:13:52.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:52 smithi152 ceph-mon[104423]: pgmap v323: 97 pgs: 97 active+clean; 653 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-16T13:13:52.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:52 smithi152 ceph-mon[104423]: scrub queued for path: / 2023-10-16T13:13:52.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:52 smithi152 ceph-mon[104423]: scrub summary: idle+waiting paths [/] 2023-10-16T13:13:52.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:52 smithi152 ceph-mon[104423]: scrub summary: active paths [/] 2023-10-16T13:13:52.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:52 smithi152 ceph-mon[104423]: scrub summary: idle+waiting paths [/] 2023-10-16T13:13:52.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:52 smithi092 ceph-mon[99542]: pgmap v323: 97 pgs: 97 active+clean; 653 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-16T13:13:52.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:52 smithi092 ceph-mon[99542]: scrub queued for path: / 2023-10-16T13:13:52.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:52 smithi092 ceph-mon[99542]: scrub summary: idle+waiting paths [/] 2023-10-16T13:13:52.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:52 smithi092 ceph-mon[99542]: scrub summary: active paths [/] 2023-10-16T13:13:52.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:52 smithi092 ceph-mon[99542]: scrub summary: idle+waiting paths [/] 2023-10-16T13:13:52.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:52 smithi118 ceph-mon[103969]: pgmap v323: 97 pgs: 97 active+clean; 653 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-16T13:13:52.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:52 smithi118 ceph-mon[103969]: scrub queued for path: / 2023-10-16T13:13:52.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:52 smithi118 ceph-mon[103969]: scrub summary: idle+waiting paths [/] 2023-10-16T13:13:52.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:52 smithi118 ceph-mon[103969]: scrub summary: active paths [/] 2023-10-16T13:13:52.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:52 smithi118 ceph-mon[103969]: scrub summary: idle+waiting paths [/] 2023-10-16T13:13:54.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:54 smithi152 ceph-mon[104423]: pgmap v324: 97 pgs: 97 active+clean; 653 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-16T13:13:54.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:54 smithi152 ceph-mon[104423]: scrub summary: idle 2023-10-16T13:13:54.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:54 smithi092 ceph-mon[99542]: pgmap v324: 97 pgs: 97 active+clean; 653 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-16T13:13:54.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:54 smithi092 ceph-mon[99542]: scrub summary: idle 2023-10-16T13:13:54.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:54 smithi118 ceph-mon[103969]: pgmap v324: 97 pgs: 97 active+clean; 653 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-16T13:13:54.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:54 smithi118 ceph-mon[103969]: scrub summary: idle 2023-10-16T13:13:55.212 INFO:tasks.workunit.client.0.smithi092.stderr:Note: switching to '33be745ec4531df08cd1bb70b4c9c1f89be58078'. 2023-10-16T13:13:55.212 INFO:tasks.workunit.client.0.smithi092.stderr: 2023-10-16T13:13:55.213 INFO:tasks.workunit.client.0.smithi092.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-16T13:13:55.213 INFO:tasks.workunit.client.0.smithi092.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-16T13:13:55.213 INFO:tasks.workunit.client.0.smithi092.stderr:state without impacting any branches by switching back to a branch. 2023-10-16T13:13:55.213 INFO:tasks.workunit.client.0.smithi092.stderr: 2023-10-16T13:13:55.214 INFO:tasks.workunit.client.0.smithi092.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-16T13:13:55.214 INFO:tasks.workunit.client.0.smithi092.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-16T13:13:55.214 INFO:tasks.workunit.client.0.smithi092.stderr: 2023-10-16T13:13:55.214 INFO:tasks.workunit.client.0.smithi092.stderr: git switch -c 2023-10-16T13:13:55.214 INFO:tasks.workunit.client.0.smithi092.stderr: 2023-10-16T13:13:55.215 INFO:tasks.workunit.client.0.smithi092.stderr:Or undo this operation with: 2023-10-16T13:13:55.215 INFO:tasks.workunit.client.0.smithi092.stderr: 2023-10-16T13:13:55.215 INFO:tasks.workunit.client.0.smithi092.stderr: git switch - 2023-10-16T13:13:55.215 INFO:tasks.workunit.client.0.smithi092.stderr: 2023-10-16T13:13:55.216 INFO:tasks.workunit.client.0.smithi092.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-16T13:13:55.216 INFO:tasks.workunit.client.0.smithi092.stderr: 2023-10-16T13:13:55.216 INFO:tasks.workunit.client.0.smithi092.stderr:HEAD is now at 33be745ec45 Merge remote-tracking branches 'temp2/adding-useful-print', 'milind/mds-enqueue-all-child-frags-for-scrub-for-a-given-fragset', 'temp3/fix-mds-metadata-lost', 'rishabh/before-fs-rename-fail-fs' and 'temp1/origin/tmp2' into rishabh-2023oct13-b2 2023-10-16T13:13:55.218 DEBUG:teuthology.orchestra.run.smithi092:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-16T13:13:55.244 INFO:tasks.workunit.client.0.smithi092.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-16T13:13:55.247 INFO:tasks.workunit.client.0.smithi092.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-16T13:13:55.247 INFO:tasks.workunit.client.0.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-16T13:13:55.845 INFO:tasks.workunit.client.0.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-16T13:13:55.898 INFO:tasks.workunit.client.0.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-16T13:13:55.935 INFO:tasks.workunit.client.0.smithi092.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-16T13:13:55.937 INFO:tasks.workunit.client.0.smithi092.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-16T13:13:55.937 INFO:tasks.workunit.client.0.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-16T13:13:55.974 INFO:tasks.workunit.client.0.smithi092.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-16T13:13:55.977 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T13:13:55.978 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-16T13:13:56.035 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2023-10-16T13:13:56.037 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2023-10-16T13:13:56.037 DEBUG:teuthology.orchestra.run.smithi092:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=33be745ec4531df08cd1bb70b4c9c1f89be58078 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2023-10-16T13:13:56.098 INFO:tasks.workunit.client.0.smithi092.stderr:+ KERNEL=linux-4.0.5 2023-10-16T13:13:56.098 INFO:tasks.workunit.client.0.smithi092.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2023-10-16T13:13:56.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:56 smithi152 ceph-mon[104423]: pgmap v325: 97 pgs: 97 active+clean; 653 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-16T13:13:56.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:56 smithi092 ceph-mon[99542]: pgmap v325: 97 pgs: 97 active+clean; 653 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-16T13:13:56.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:56 smithi118 ceph-mon[103969]: pgmap v325: 97 pgs: 97 active+clean; 653 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-16T13:13:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.633+0000 7fd50fe0e700 1 -- 172.21.15.92:0/3657243751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5080ff1d0 msgr2=0x7fd5080ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.633+0000 7fd50fe0e700 1 --2- 172.21.15.92:0/3657243751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5080ff1d0 0x7fd5080ff5f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009990 tx=0x7fd4f8009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.633+0000 7fd50fe0e700 1 -- 172.21.15.92:0/3657243751 shutdown_connections 2023-10-16T13:13:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.633+0000 7fd50fe0e700 1 --2- 172.21.15.92:0/3657243751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5080ff1d0 0x7fd5080ff5f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.633+0000 7fd50fe0e700 1 --2- 172.21.15.92:0/3657243751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd508102be0 0x7fd508109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.633+0000 7fd50fe0e700 1 --2- 172.21.15.92:0/3657243751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd508102240 0x7fd5081026a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.633+0000 7fd50fe0e700 1 -- 172.21.15.92:0/3657243751 >> 172.21.15.92:0/3657243751 conn(0x7fd5080faac0 msgr2=0x7fd5080fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.633+0000 7fd50fe0e700 1 -- 172.21.15.92:0/3657243751 shutdown_connections 2023-10-16T13:13:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.633+0000 7fd50fe0e700 1 -- 172.21.15.92:0/3657243751 wait complete. 2023-10-16T13:13:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50fe0e700 1 Processor -- start 2023-10-16T13:13:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50fe0e700 1 -- start start 2023-10-16T13:13:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50fe0e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5080ff1d0 0x7fd508196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50fe0e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd508102240 0x7fd508197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50fe0e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd508102be0 0x7fd508198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50fe0e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd508198870 con 0x7fd5080ff1d0 2023-10-16T13:13:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50fe0e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5081989e0 con 0x7fd508102240 2023-10-16T13:13:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50fe0e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd508198ba0 con 0x7fd508102be0 2023-10-16T13:13:57.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50dbaa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5080ff1d0 0x7fd508196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:57.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50dbaa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5080ff1d0 0x7fd508196ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37490/0 (socket says 172.21.15.92:37490) 2023-10-16T13:13:57.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50dbaa700 1 -- 172.21.15.92:0/2810876208 learned_addr learned my addr 172.21.15.92:0/2810876208 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:57.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50e3ab700 1 --2- 172.21.15.92:0/2810876208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd508102be0 0x7fd508198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:57.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50d3a9700 1 --2- 172.21.15.92:0/2810876208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd508102240 0x7fd508197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50dbaa700 1 -- 172.21.15.92:0/2810876208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd508102be0 msgr2=0x7fd508198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50dbaa700 1 --2- 172.21.15.92:0/2810876208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd508102be0 0x7fd508198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50dbaa700 1 -- 172.21.15.92:0/2810876208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd508102240 msgr2=0x7fd508197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50dbaa700 1 --2- 172.21.15.92:0/2810876208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd508102240 0x7fd508197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50dbaa700 1 -- 172.21.15.92:0/2810876208 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f80095f0 con 0x7fd5080ff1d0 2023-10-16T13:13:57.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50e3ab700 1 --2- 172.21.15.92:0/2810876208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd508102be0 0x7fd508198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:57.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50d3a9700 1 --2- 172.21.15.92:0/2810876208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd508102240 0x7fd508197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:57.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.634+0000 7fd50dbaa700 1 --2- 172.21.15.92:0/2810876208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5080ff1d0 0x7fd508196ef0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8003790 tx=0x7fd4f800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:57.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.635+0000 7fd4feffd700 1 -- 172.21.15.92:0/2810876208 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f801d070 con 0x7fd5080ff1d0 2023-10-16T13:13:57.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.635+0000 7fd50fe0e700 1 -- 172.21.15.92:0/2810876208 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd508198e20 con 0x7fd5080ff1d0 2023-10-16T13:13:57.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.635+0000 7fd4feffd700 1 -- 172.21.15.92:0/2810876208 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd4f8004cc0 con 0x7fd5080ff1d0 2023-10-16T13:13:57.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.635+0000 7fd4feffd700 1 -- 172.21.15.92:0/2810876208 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8005680 con 0x7fd5080ff1d0 2023-10-16T13:13:57.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.635+0000 7fd50fe0e700 1 -- 172.21.15.92:0/2810876208 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50819f5a0 con 0x7fd5080ff1d0 2023-10-16T13:13:57.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.638+0000 7fd4feffd700 1 -- 172.21.15.92:0/2810876208 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd4f80047e0 con 0x7fd5080ff1d0 2023-10-16T13:13:57.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.638+0000 7fd51bff8b80 1 Processor -- start 2023-10-16T13:13:57.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd51bff8b80 1 -- start start 2023-10-16T13:13:57.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd51bff8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563431439850 0x563431439c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:57.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd51bff8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56343143a1b0 0x56343143aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:57.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd51bff8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143b0a0 0x56343143b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:57.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd51bff8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634313aec10 con 0x56343143a1b0 2023-10-16T13:13:57.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd51bff8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563431393c00 con 0x563431439850 2023-10-16T13:13:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd51bff8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563431391520 con 0x56343143b0a0 2023-10-16T13:13:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd50dbaa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56343143a1b0 0x56343143aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd50dbaa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56343143a1b0 0x56343143aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37498/0 (socket says 172.21.15.92:37498) 2023-10-16T13:13:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd50dbaa700 1 -- 172.21.15.92:0/948472261 learned_addr learned my addr 172.21.15.92:0/948472261 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd50e3ab700 1 --2- 172.21.15.92:0/948472261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563431439850 0x563431439c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd50d3a9700 1 --2- 172.21.15.92:0/948472261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143b0a0 0x56343143b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd50dbaa700 1 -- 172.21.15.92:0/948472261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143b0a0 msgr2=0x56343143b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd50dbaa700 1 --2- 172.21.15.92:0/948472261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143b0a0 0x56343143b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd50dbaa700 1 -- 172.21.15.92:0/948472261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563431439850 msgr2=0x563431439c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd50dbaa700 1 --2- 172.21.15.92:0/948472261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563431439850 0x563431439c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd50dbaa700 1 -- 172.21.15.92:0/948472261 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56343134a390 con 0x56343143a1b0 2023-10-16T13:13:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd4feffd700 1 --2- 172.21.15.92:0/2810876208 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd4f40a1480 0x7fd4f40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd50e3ab700 1 --2- 172.21.15.92:0/2810876208 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd4f40a1480 0x7fd4f40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.639+0000 7fd50dbaa700 1 --2- 172.21.15.92:0/948472261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56343143a1b0 0x56343143aac0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80d1f70 tx=0x7fd4f80d63c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe66572de8359462 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.640+0000 7fd4feffd700 1 -- 172.21.15.92:0/2810876208 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd4f80cdfc0 con 0x7fd5080ff1d0 2023-10-16T13:13:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.640+0000 7fd4f3fff700 1 -- 172.21.15.92:0/948472261 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80d1c00 con 0x56343143a1b0 2023-10-16T13:13:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.640+0000 7fd4f3fff700 1 -- 172.21.15.92:0/948472261 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd4f809b1e0 con 0x56343143a1b0 2023-10-16T13:13:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.640+0000 7fd4f3fff700 1 -- 172.21.15.92:0/948472261 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f809af50 con 0x56343143a1b0 2023-10-16T13:13:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.640+0000 7fd50e3ab700 1 --2- 172.21.15.92:0/2810876208 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd4f40a1480 0x7fd4f40a3940 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd50000c530 tx=0x7fd50000e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.640+0000 7fd51bff8b80 1 -- 172.21.15.92:0/948472261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56343143a1b0 msgr2=0x56343143aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.640+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/948472261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56343143a1b0 0x56343143aac0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80d1f70 tx=0x7fd4f80d63c0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.640+0000 7fd51bff8b80 1 -- 172.21.15.92:0/948472261 shutdown_connections 2023-10-16T13:13:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.640+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/948472261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143b0a0 0x56343143b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.640+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/948472261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563431439850 0x563431439c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.640+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/948472261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56343143a1b0 0x56343143aac0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.640+0000 7fd51bff8b80 1 -- 172.21.15.92:0/948472261 >> 172.21.15.92:0/948472261 conn(0x563431367d70 msgr2=0x563431434c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:57.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.641+0000 7fd51bff8b80 1 -- 172.21.15.92:0/948472261 shutdown_connections 2023-10-16T13:13:57.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.641+0000 7fd51bff8b80 1 -- 172.21.15.92:0/948472261 wait complete. 2023-10-16T13:13:57.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.641+0000 7fd51bff8b80 1 -- start start 2023-10-16T13:13:57.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.641+0000 7fd51bff8b80 1 Processor -- start 2023-10-16T13:13:57.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.641+0000 7fd51bff8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563431439850 0x563431447830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:57.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.641+0000 7fd51bff8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143a1b0 0x563431447d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:57.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.641+0000 7fd51bff8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56343143b0a0 0x56343144edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:57.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.641+0000 7fd51bff8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56343138ce10 con 0x56343143b0a0 2023-10-16T13:13:57.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.641+0000 7fd51bff8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634313296b0 con 0x563431439850 2023-10-16T13:13:57.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.641+0000 7fd51bff8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563431329350 con 0x56343143a1b0 2023-10-16T13:13:57.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.641+0000 7fd51bff8b80 10 client.0 _ll_register_callbacks cb 0x5634311867a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.641+0000 7fd50e3ab700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56343143b0a0 0x56343144edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.641+0000 7fd50e3ab700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56343143b0a0 0x56343144edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37508/0 (socket says 172.21.15.92:37508) 2023-10-16T13:13:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.641+0000 7fd50e3ab700 1 -- 172.21.15.92:0/1691105027 learned_addr learned my addr 172.21.15.92:0/1691105027 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.642+0000 7fd50dbaa700 1 --2- 172.21.15.92:0/1691105027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563431439850 0x563431447830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.642+0000 7fd50d3a9700 1 --2- 172.21.15.92:0/1691105027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143a1b0 0x563431447d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.642+0000 7fd50e3ab700 1 -- 172.21.15.92:0/1691105027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143a1b0 msgr2=0x563431447d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:57.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.642+0000 7fd50e3ab700 1 --2- 172.21.15.92:0/1691105027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143a1b0 0x563431447d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.642+0000 7fd50e3ab700 1 -- 172.21.15.92:0/1691105027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563431439850 msgr2=0x563431447830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:57.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.642+0000 7fd50e3ab700 1 --2- 172.21.15.92:0/1691105027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563431439850 0x563431447830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.642+0000 7fd50e3ab700 1 -- 172.21.15.92:0/1691105027 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50819f5a0 con 0x56343143b0a0 2023-10-16T13:13:57.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.642+0000 7fd50d3a9700 1 --2- 172.21.15.92:0/1691105027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143a1b0 0x563431447d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.642+0000 7fd50dbaa700 1 --2- 172.21.15.92:0/1691105027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563431439850 0x563431447830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:13:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.642+0000 7fd50e3ab700 1 --2- 172.21.15.92:0/1691105027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56343143b0a0 0x56343144edb0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd500018ab0 tx=0x7fd500004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b845883cdc0da3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.642+0000 7fd4f17fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.642+0000 7fd4f17fa700 1 -- 172.21.15.92:0/1691105027 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd500009dc0 con 0x56343143b0a0 2023-10-16T13:13:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.642+0000 7fd51bff8b80 1 -- 172.21.15.92:0/1691105027 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563431391e90 con 0x56343143b0a0 2023-10-16T13:13:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.642+0000 7fd4f17fa700 1 -- 172.21.15.92:0/1691105027 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd500006e40 con 0x56343143b0a0 2023-10-16T13:13:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.642+0000 7fd4f17fa700 1 -- 172.21.15.92:0/1691105027 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd500016a50 con 0x56343143b0a0 2023-10-16T13:13:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.642+0000 7fd51bff8b80 10 client.15660 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.642+0000 7fd51bff8b80 1 -- 172.21.15.92:0/1691105027 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5634311b7d80 con 0x56343143b0a0 2023-10-16T13:13:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.642+0000 7fd4f17fa700 1 -- 172.21.15.92:0/1691105027 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x563431391e90 con 0x56343143b0a0 2023-10-16T13:13:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.643+0000 7fd4f17fa700 1 -- 172.21.15.92:0/1691105027 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd50002b400 con 0x56343143b0a0 2023-10-16T13:13:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.643+0000 7fd51bff8b80 10 client.15660 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.643+0000 7fd51bff8b80 10 client.15660 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-16T13:13:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.643+0000 7fd51bff8b80 20 client.15660 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.643+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/1691105027 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563431453760 0x563431455b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.643+0000 7fd51bff8b80 4 client.15660 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:13:57.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.643+0000 7fd51bff8b80 1 -- 172.21.15.92:0/1691105027 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563431409bb0 con 0x563431453760 2023-10-16T13:13:57.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.643+0000 7fd50dbaa700 1 --2- 172.21.15.92:0/1691105027 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563431453760 0x563431455b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:57.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.643+0000 7fd4f17fa700 10 client.15660 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:57.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.643+0000 7fd50dbaa700 1 --2- 172.21.15.92:0/1691105027 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563431453760 0x563431455b80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd60d3e26a6d8a21 server_cookie=7346c24307de2edb in_seq=0 out_seq=0 2023-10-16T13:13:57.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.644+0000 7fd4f17fa700 1 -- 172.21.15.92:0/1691105027 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563431409bb0 con 0x563431453760 2023-10-16T13:13:57.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.644+0000 7fd4f17fa700 10 client.15660 handle_command_reply: tid=0 2023-10-16T13:13:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.644+0000 7fd51bff8b80 1 client.15660 shutdown 2023-10-16T13:13:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.644+0000 7fd51bff8b80 1 -- 172.21.15.92:0/1691105027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56343143b0a0 msgr2=0x56343144edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.644+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/1691105027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56343143b0a0 0x56343144edb0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd500018ab0 tx=0x7fd500004ad0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.644+0000 7fd51bff8b80 1 -- 172.21.15.92:0/1691105027 shutdown_connections 2023-10-16T13:13:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.644+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/1691105027 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563431453760 0x563431455b80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.644+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/1691105027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56343143b0a0 0x56343144edb0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.644+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/1691105027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563431439850 0x563431447830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.644+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/1691105027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143a1b0 0x563431447d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.644+0000 7fd4f17fa700 0 client.15660 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.644+0000 7fd51bff8b80 1 -- 172.21.15.92:0/1691105027 >> 172.21.15.92:0/1691105027 conn(0x563431367d70 msgr2=0x563431434830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.644+0000 7fd51bff8b80 1 -- 172.21.15.92:0/1691105027 shutdown_connections 2023-10-16T13:13:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.644+0000 7fd51bff8b80 1 -- 172.21.15.92:0/1691105027 wait complete. 2023-10-16T13:13:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.644+0000 7fd51bff8b80 20 client.15660 trim_cache size 0 max 16384 2023-10-16T13:13:57.672 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.659+0000 7fd51bff8b80 1 Processor -- start 2023-10-16T13:13:57.672 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.659+0000 7fd51bff8b80 1 -- start start 2023-10-16T13:13:57.672 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.659+0000 7fd51bff8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563431439850 0x563431441470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:57.672 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.659+0000 7fd51bff8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143a1b0 0x56343144ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:57.673 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.659+0000 7fd51bff8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56343143b0a0 0x56343143dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:57.673 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.659+0000 7fd51bff8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56343120d8c0 con 0x563431439850 2023-10-16T13:13:57.673 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.659+0000 7fd51bff8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563431431400 con 0x56343143b0a0 2023-10-16T13:13:57.673 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.659+0000 7fd51bff8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56343144f210 con 0x56343143a1b0 2023-10-16T13:13:57.673 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.659+0000 7fd50dbaa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563431439850 0x563431441470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:57.673 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.659+0000 7fd50dbaa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563431439850 0x563431441470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37512/0 (socket says 172.21.15.92:37512) 2023-10-16T13:13:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.659+0000 7fd50dbaa700 1 -- 172.21.15.92:0/983323178 learned_addr learned my addr 172.21.15.92:0/983323178 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.659+0000 7fd50d3a9700 1 --2- 172.21.15.92:0/983323178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143a1b0 0x56343144ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.659+0000 7fd50e3ab700 1 --2- 172.21.15.92:0/983323178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56343143b0a0 0x56343143dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.659+0000 7fd50dbaa700 1 -- 172.21.15.92:0/983323178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143a1b0 msgr2=0x56343144ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.659+0000 7fd50dbaa700 1 --2- 172.21.15.92:0/983323178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143a1b0 0x56343144ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.659+0000 7fd50dbaa700 1 -- 172.21.15.92:0/983323178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56343143b0a0 msgr2=0x56343143dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.659+0000 7fd50dbaa700 1 --2- 172.21.15.92:0/983323178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56343143b0a0 0x56343143dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.659+0000 7fd50dbaa700 1 -- 172.21.15.92:0/983323178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634311a0c00 con 0x563431439850 2023-10-16T13:13:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.659+0000 7fd50e3ab700 1 --2- 172.21.15.92:0/983323178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56343143b0a0 0x56343143dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.660+0000 7fd50dbaa700 1 --2- 172.21.15.92:0/983323178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563431439850 0x563431441470 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8097910 tx=0x7fd4f8009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0770d2c8e3a8ee server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.660+0000 7fd4fcff9700 1 -- 172.21.15.92:0/983323178 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80d1c00 con 0x563431439850 2023-10-16T13:13:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.660+0000 7fd4fcff9700 1 -- 172.21.15.92:0/983323178 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd4f809ad70 con 0x563431439850 2023-10-16T13:13:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.660+0000 7fd4fcff9700 1 -- 172.21.15.92:0/983323178 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f809f560 con 0x563431439850 2023-10-16T13:13:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.660+0000 7fd51bff8b80 1 -- 172.21.15.92:0/983323178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563431439850 msgr2=0x563431441470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.660+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/983323178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563431439850 0x563431441470 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8097910 tx=0x7fd4f8009ca0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.660+0000 7fd51bff8b80 1 -- 172.21.15.92:0/983323178 shutdown_connections 2023-10-16T13:13:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.660+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/983323178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563431439850 0x563431441470 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.660+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/983323178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56343143b0a0 0x56343143dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.660+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/983323178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143a1b0 0x56343144ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.660+0000 7fd51bff8b80 1 -- 172.21.15.92:0/983323178 >> 172.21.15.92:0/983323178 conn(0x563431367d70 msgr2=0x563431446520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.660+0000 7fd51bff8b80 1 -- 172.21.15.92:0/983323178 shutdown_connections 2023-10-16T13:13:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.660+0000 7fd51bff8b80 1 -- 172.21.15.92:0/983323178 wait complete. 2023-10-16T13:13:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.661+0000 7fd51bff8b80 1 -- start start 2023-10-16T13:13:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.661+0000 7fd51bff8b80 1 Processor -- start 2023-10-16T13:13:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.661+0000 7fd51bff8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563431439850 0x56343144a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.661+0000 7fd51bff8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143a1b0 0x56343144ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.661+0000 7fd51bff8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56343143b0a0 0x56343144dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.661+0000 7fd51bff8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56343144e2a0 con 0x563431439850 2023-10-16T13:13:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.661+0000 7fd51bff8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56343144e410 con 0x56343143b0a0 2023-10-16T13:13:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.661+0000 7fd51bff8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56343144e5d0 con 0x56343143a1b0 2023-10-16T13:13:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.661+0000 7fd51bff8b80 10 client.0 _ll_register_callbacks cb 0x7fd5000183f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:13:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.661+0000 7fd50dbaa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563431439850 0x56343144a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.661+0000 7fd50dbaa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563431439850 0x56343144a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37520/0 (socket says 172.21.15.92:37520) 2023-10-16T13:13:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.661+0000 7fd50dbaa700 1 -- 172.21.15.92:0/3055601798 learned_addr learned my addr 172.21.15.92:0/3055601798 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:13:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.661+0000 7fd50e3ab700 1 --2- 172.21.15.92:0/3055601798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56343143b0a0 0x56343144dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.661+0000 7fd50d3a9700 1 --2- 172.21.15.92:0/3055601798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143a1b0 0x56343144ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd50dbaa700 1 -- 172.21.15.92:0/3055601798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143a1b0 msgr2=0x56343144ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd50dbaa700 1 --2- 172.21.15.92:0/3055601798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143a1b0 0x56343144ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd50dbaa700 1 -- 172.21.15.92:0/3055601798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56343143b0a0 msgr2=0x56343144dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:13:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd50dbaa700 1 --2- 172.21.15.92:0/3055601798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56343143b0a0 0x56343144dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd50dbaa700 1 -- 172.21.15.92:0/3055601798 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56343134a390 con 0x563431439850 2023-10-16T13:13:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd50d3a9700 1 --2- 172.21.15.92:0/3055601798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143a1b0 0x56343144ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:13:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd50dbaa700 1 --2- 172.21.15.92:0/3055601798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563431439850 0x56343144a800 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd4f809aee0 tx=0x7fd4f8097810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af85cdfa3517397f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:13:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd4f17fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:13:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd4f17fa700 1 -- 172.21.15.92:0/3055601798 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80d1c00 con 0x563431439850 2023-10-16T13:13:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd4f17fa700 1 -- 172.21.15.92:0/3055601798 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd4f80b3e40 con 0x563431439850 2023-10-16T13:13:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd51bff8b80 1 -- 172.21.15.92:0/3055601798 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd4f809b1e0 con 0x563431439850 2023-10-16T13:13:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd4f17fa700 1 -- 172.21.15.92:0/3055601798 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4f809af50 con 0x563431439850 2023-10-16T13:13:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd51bff8b80 10 client.15666 fetch_fsmap learned FSMap version 27 2023-10-16T13:13:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd51bff8b80 1 -- 172.21.15.92:0/3055601798 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5634311de1f0 con 0x563431439850 2023-10-16T13:13:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd4f17fa700 1 -- 172.21.15.92:0/3055601798 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd4f809b1e0 con 0x563431439850 2023-10-16T13:13:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd4f17fa700 1 -- 172.21.15.92:0/3055601798 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd4f8097b20 con 0x563431439850 2023-10-16T13:13:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd51bff8b80 10 client.15666 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:13:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd51bff8b80 10 client.15666 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-16T13:13:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd51bff8b80 20 client.15666 populate_metadata read hostname 'smithi092' 2023-10-16T13:13:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/3055601798 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5634314a7d00 0x5634314aa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:13:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd51bff8b80 4 client.15666 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-16T13:13:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.662+0000 7fd51bff8b80 1 -- 172.21.15.92:0/3055601798 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563431385df0 con 0x5634314a7d00 2023-10-16T13:13:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.663+0000 7fd50d3a9700 1 --2- 172.21.15.92:0/3055601798 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5634314a7d00 0x5634314aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:13:57.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.663+0000 7fd4f17fa700 10 client.15666 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:57.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.663+0000 7fd50d3a9700 1 --2- 172.21.15.92:0/3055601798 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5634314a7d00 0x5634314aa120 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=668141c04603f2e3 server_cookie=884a5b6df24a0f24 in_seq=0 out_seq=0 2023-10-16T13:13:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.672+0000 7fd4f17fa700 1 -- 172.21.15.92:0/3055601798 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563431385df0 con 0x5634314a7d00 2023-10-16T13:13:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.672+0000 7fd4f17fa700 10 client.15666 handle_command_reply: tid=0 2023-10-16T13:13:57.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.672+0000 7fd51bff8b80 1 client.15666 shutdown 2023-10-16T13:13:57.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.672+0000 7fd51bff8b80 1 -- 172.21.15.92:0/3055601798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563431439850 msgr2=0x56343144a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:57.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.672+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/3055601798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563431439850 0x56343144a800 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd4f809aee0 tx=0x7fd4f8097810 comp rx=0 tx=0).stop 2023-10-16T13:13:57.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.672+0000 7fd51bff8b80 1 -- 172.21.15.92:0/3055601798 shutdown_connections 2023-10-16T13:13:57.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.672+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/3055601798 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5634314a7d00 0x5634314aa120 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.672+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/3055601798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563431439850 0x56343144a800 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.672+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/3055601798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56343143b0a0 0x56343144dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.672+0000 7fd4f17fa700 0 client.15666 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:13:57.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.672+0000 7fd51bff8b80 1 --2- 172.21.15.92:0/3055601798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56343143a1b0 0x56343144ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.672+0000 7fd51bff8b80 1 -- 172.21.15.92:0/3055601798 >> 172.21.15.92:0/3055601798 conn(0x563431367d70 msgr2=0x563431441470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:57.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.672+0000 7fd51bff8b80 1 -- 172.21.15.92:0/3055601798 shutdown_connections 2023-10-16T13:13:57.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.672+0000 7fd51bff8b80 1 -- 172.21.15.92:0/3055601798 wait complete. 2023-10-16T13:13:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.672+0000 7fd51bff8b80 20 client.15666 trim_cache size 0 max 16384 2023-10-16T13:13:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2023-10-16T13:13:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2023-10-16T13:13:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2023-10-16T13:13:57.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2023-10-16T13:13:57.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.673+0000 7fd50fe0e700 1 -- 172.21.15.92:0/2810876208 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd4f40a1480 msgr2=0x7fd4f40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.673+0000 7fd50fe0e700 1 --2- 172.21.15.92:0/2810876208 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd4f40a1480 0x7fd4f40a3940 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd50000c530 tx=0x7fd50000e040 comp rx=0 tx=0).stop 2023-10-16T13:13:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.673+0000 7fd50fe0e700 1 -- 172.21.15.92:0/2810876208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5080ff1d0 msgr2=0x7fd508196ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:13:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.673+0000 7fd50fe0e700 1 --2- 172.21.15.92:0/2810876208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5080ff1d0 0x7fd508196ef0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8003790 tx=0x7fd4f800f690 comp rx=0 tx=0).stop 2023-10-16T13:13:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.673+0000 7fd50fe0e700 1 -- 172.21.15.92:0/2810876208 shutdown_connections 2023-10-16T13:13:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.673+0000 7fd50fe0e700 1 --2- 172.21.15.92:0/2810876208 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd4f40a1480 0x7fd4f40a3940 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.673+0000 7fd50fe0e700 1 --2- 172.21.15.92:0/2810876208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5080ff1d0 0x7fd508196ef0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.673+0000 7fd50fe0e700 1 --2- 172.21.15.92:0/2810876208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd508102be0 0x7fd508198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.673+0000 7fd50fe0e700 1 --2- 172.21.15.92:0/2810876208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd508102240 0x7fd508197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:13:57.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.673+0000 7fd50fe0e700 1 -- 172.21.15.92:0/2810876208 >> 172.21.15.92:0/2810876208 conn(0x7fd5080faac0 msgr2=0x7fd5080fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:13:57.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.673+0000 7fd50fe0e700 1 -- 172.21.15.92:0/2810876208 shutdown_connections 2023-10-16T13:13:57.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:13:57.673+0000 7fd50fe0e700 1 -- 172.21.15.92:0/2810876208 wait complete. 2023-10-16T13:13:58.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:13:58 smithi092 ceph-mon[99542]: pgmap v326: 97 pgs: 97 active+clean; 663 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-10-16T13:13:58.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:13:58 smithi118 ceph-mon[103969]: pgmap v326: 97 pgs: 97 active+clean; 663 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-10-16T13:13:58.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:13:58 smithi152 ceph-mon[104423]: pgmap v326: 97 pgs: 97 active+clean; 663 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-10-16T13:13:59.710 INFO:tasks.workunit.client.0.smithi092.stderr:+ mkdir untar_tar 2023-10-16T13:13:59.712 INFO:tasks.workunit.client.0.smithi092.stderr:+ cd untar_tar 2023-10-16T13:13:59.712 INFO:tasks.workunit.client.0.smithi092.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2023-10-16T13:13:59.736 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ 2023-10-16T13:13:59.738 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/00-INDEX 2023-10-16T13:13:59.739 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/ 2023-10-16T13:13:59.740 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/README 2023-10-16T13:13:59.741 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2023-10-16T13:13:59.742 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2023-10-16T13:13:59.743 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2023-10-16T13:13:59.743 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2023-10-16T13:13:59.744 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2023-10-16T13:13:59.744 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2023-10-16T13:13:59.744 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2023-10-16T13:13:59.744 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/removed/ 2023-10-16T13:13:59.747 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2023-10-16T13:13:59.748 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2023-10-16T13:13:59.749 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2023-10-16T13:13:59.749 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2023-10-16T13:13:59.749 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2023-10-16T13:13:59.749 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2023-10-16T13:13:59.750 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2023-10-16T13:13:59.750 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/ 2023-10-16T13:13:59.752 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2023-10-16T13:13:59.756 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2023-10-16T13:13:59.756 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2023-10-16T13:13:59.756 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2023-10-16T13:13:59.756 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2023-10-16T13:13:59.757 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2023-10-16T13:13:59.757 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2023-10-16T13:13:59.757 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2023-10-16T13:13:59.757 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2023-10-16T13:13:59.757 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2023-10-16T13:13:59.758 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2023-10-16T13:13:59.758 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2023-10-16T13:13:59.758 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2023-10-16T13:13:59.758 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2023-10-16T13:13:59.758 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2023-10-16T13:13:59.759 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2023-10-16T13:13:59.759 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2023-10-16T13:13:59.759 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2023-10-16T13:13:59.759 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2023-10-16T13:13:59.759 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2023-10-16T13:13:59.760 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2023-10-16T13:13:59.760 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2023-10-16T13:13:59.760 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2023-10-16T13:13:59.760 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2023-10-16T13:13:59.760 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2023-10-16T13:13:59.760 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2023-10-16T13:13:59.761 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/ 2023-10-16T13:13:59.769 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2023-10-16T13:13:59.788 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2023-10-16T13:13:59.788 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2023-10-16T13:13:59.788 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2023-10-16T13:13:59.789 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2023-10-16T13:13:59.789 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2023-10-16T13:13:59.789 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2023-10-16T13:13:59.789 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2023-10-16T13:13:59.789 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2023-10-16T13:13:59.790 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2023-10-16T13:13:59.790 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2023-10-16T13:13:59.790 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2023-10-16T13:13:59.790 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2023-10-16T13:13:59.790 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2023-10-16T13:13:59.790 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2023-10-16T13:13:59.791 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2023-10-16T13:13:59.791 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2023-10-16T13:13:59.791 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2023-10-16T13:13:59.791 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2023-10-16T13:13:59.791 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2023-10-16T13:13:59.792 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2023-10-16T13:13:59.792 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2023-10-16T13:13:59.792 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2023-10-16T13:13:59.792 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2023-10-16T13:13:59.792 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2023-10-16T13:13:59.792 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2023-10-16T13:13:59.793 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2023-10-16T13:13:59.793 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2023-10-16T13:13:59.793 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2023-10-16T13:13:59.793 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2023-10-16T13:13:59.793 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2023-10-16T13:13:59.794 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2023-10-16T13:13:59.794 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2023-10-16T13:13:59.794 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2023-10-16T13:13:59.794 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2023-10-16T13:13:59.794 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2023-10-16T13:13:59.794 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2023-10-16T13:13:59.795 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2023-10-16T13:13:59.795 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2023-10-16T13:13:59.795 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2023-10-16T13:13:59.795 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2023-10-16T13:13:59.795 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2023-10-16T13:13:59.796 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2023-10-16T13:13:59.796 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2023-10-16T13:13:59.796 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2023-10-16T13:13:59.796 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2023-10-16T13:13:59.796 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2023-10-16T13:13:59.796 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2023-10-16T13:13:59.797 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2023-10-16T13:13:59.797 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2023-10-16T13:13:59.797 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2023-10-16T13:13:59.797 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2023-10-16T13:13:59.797 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2023-10-16T13:13:59.797 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2023-10-16T13:13:59.798 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2023-10-16T13:13:59.798 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2023-10-16T13:13:59.798 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2023-10-16T13:13:59.798 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2023-10-16T13:13:59.798 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2023-10-16T13:13:59.799 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2023-10-16T13:13:59.799 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2023-10-16T13:13:59.799 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2023-10-16T13:13:59.799 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2023-10-16T13:13:59.799 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2023-10-16T13:13:59.799 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2023-10-16T13:13:59.800 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2023-10-16T13:13:59.800 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2023-10-16T13:13:59.800 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2023-10-16T13:13:59.800 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2023-10-16T13:13:59.800 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2023-10-16T13:13:59.801 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2023-10-16T13:13:59.801 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2023-10-16T13:13:59.801 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2023-10-16T13:13:59.801 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2023-10-16T13:13:59.801 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2023-10-16T13:13:59.801 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2023-10-16T13:13:59.802 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2023-10-16T13:13:59.802 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2023-10-16T13:13:59.802 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2023-10-16T13:13:59.802 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2023-10-16T13:13:59.802 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2023-10-16T13:13:59.803 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2023-10-16T13:13:59.803 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2023-10-16T13:13:59.803 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2023-10-16T13:13:59.803 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2023-10-16T13:13:59.803 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2023-10-16T13:13:59.803 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2023-10-16T13:13:59.804 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2023-10-16T13:13:59.804 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2023-10-16T13:13:59.804 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2023-10-16T13:13:59.804 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2023-10-16T13:13:59.804 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2023-10-16T13:13:59.804 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2023-10-16T13:13:59.805 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2023-10-16T13:13:59.805 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2023-10-16T13:13:59.805 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2023-10-16T13:13:59.805 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2023-10-16T13:13:59.805 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2023-10-16T13:13:59.806 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2023-10-16T13:13:59.806 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2023-10-16T13:13:59.806 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2023-10-16T13:13:59.806 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2023-10-16T13:13:59.806 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2023-10-16T13:13:59.807 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2023-10-16T13:13:59.807 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2023-10-16T13:13:59.807 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2023-10-16T13:13:59.807 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2023-10-16T13:13:59.807 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2023-10-16T13:13:59.808 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2023-10-16T13:13:59.808 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2023-10-16T13:13:59.808 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2023-10-16T13:13:59.808 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2023-10-16T13:13:59.808 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2023-10-16T13:13:59.809 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2023-10-16T13:13:59.809 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2023-10-16T13:13:59.809 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2023-10-16T13:13:59.809 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2023-10-16T13:13:59.809 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2023-10-16T13:13:59.810 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2023-10-16T13:13:59.810 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2023-10-16T13:13:59.810 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2023-10-16T13:13:59.810 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2023-10-16T13:13:59.810 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2023-10-16T13:13:59.810 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2023-10-16T13:13:59.811 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2023-10-16T13:13:59.811 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2023-10-16T13:13:59.811 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2023-10-16T13:13:59.811 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2023-10-16T13:13:59.811 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2023-10-16T13:13:59.811 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2023-10-16T13:13:59.812 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2023-10-16T13:13:59.812 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2023-10-16T13:13:59.812 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2023-10-16T13:13:59.812 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2023-10-16T13:13:59.812 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2023-10-16T13:13:59.813 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2023-10-16T13:13:59.813 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2023-10-16T13:13:59.813 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2023-10-16T13:13:59.813 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2023-10-16T13:13:59.813 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2023-10-16T13:13:59.813 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2023-10-16T13:13:59.814 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2023-10-16T13:13:59.814 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2023-10-16T13:13:59.814 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2023-10-16T13:13:59.814 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2023-10-16T13:13:59.814 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2023-10-16T13:13:59.815 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2023-10-16T13:13:59.815 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2023-10-16T13:13:59.815 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2023-10-16T13:13:59.815 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2023-10-16T13:13:59.815 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2023-10-16T13:13:59.816 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2023-10-16T13:13:59.816 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2023-10-16T13:13:59.816 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2023-10-16T13:13:59.816 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2023-10-16T13:13:59.816 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2023-10-16T13:13:59.816 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2023-10-16T13:13:59.817 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2023-10-16T13:13:59.817 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2023-10-16T13:13:59.817 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2023-10-16T13:13:59.817 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2023-10-16T13:13:59.817 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2023-10-16T13:13:59.818 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2023-10-16T13:13:59.818 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2023-10-16T13:13:59.818 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2023-10-16T13:13:59.818 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2023-10-16T13:13:59.818 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2023-10-16T13:13:59.819 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2023-10-16T13:13:59.819 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2023-10-16T13:13:59.819 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2023-10-16T13:13:59.819 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2023-10-16T13:13:59.819 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2023-10-16T13:13:59.820 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2023-10-16T13:13:59.820 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2023-10-16T13:13:59.820 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2023-10-16T13:13:59.820 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2023-10-16T13:13:59.820 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2023-10-16T13:13:59.820 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2023-10-16T13:13:59.821 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2023-10-16T13:13:59.821 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2023-10-16T13:13:59.821 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2023-10-16T13:13:59.821 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2023-10-16T13:13:59.821 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2023-10-16T13:13:59.822 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2023-10-16T13:13:59.822 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2023-10-16T13:13:59.822 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2023-10-16T13:13:59.822 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2023-10-16T13:13:59.822 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2023-10-16T13:13:59.823 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2023-10-16T13:13:59.823 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2023-10-16T13:13:59.823 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2023-10-16T13:13:59.823 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2023-10-16T13:13:59.823 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2023-10-16T13:13:59.823 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2023-10-16T13:13:59.824 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2023-10-16T13:13:59.824 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2023-10-16T13:13:59.824 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2023-10-16T13:13:59.824 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2023-10-16T13:13:59.824 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2023-10-16T13:13:59.825 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2023-10-16T13:13:59.825 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2023-10-16T13:13:59.825 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2023-10-16T13:13:59.825 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2023-10-16T13:13:59.825 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2023-10-16T13:13:59.826 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2023-10-16T13:13:59.826 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2023-10-16T13:13:59.826 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2023-10-16T13:13:59.826 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2023-10-16T13:13:59.826 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2023-10-16T13:13:59.826 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2023-10-16T13:13:59.827 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2023-10-16T13:13:59.827 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2023-10-16T13:13:59.827 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2023-10-16T13:13:59.827 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2023-10-16T13:13:59.827 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2023-10-16T13:13:59.828 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/Changes 2023-10-16T13:13:59.828 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/CodeOfConflict 2023-10-16T13:13:59.828 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/CodingStyle 2023-10-16T13:13:59.828 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2023-10-16T13:13:59.828 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DMA-API.txt 2023-10-16T13:13:59.828 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2023-10-16T13:13:59.829 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2023-10-16T13:13:59.829 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/ 2023-10-16T13:13:59.888 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2023-10-16T13:13:59.889 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2023-10-16T13:13:59.889 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2023-10-16T13:13:59.890 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2023-10-16T13:13:59.890 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2023-10-16T13:13:59.890 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2023-10-16T13:13:59.890 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2023-10-16T13:13:59.891 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2023-10-16T13:13:59.891 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2023-10-16T13:13:59.892 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2023-10-16T13:13:59.892 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2023-10-16T13:13:59.893 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2023-10-16T13:13:59.893 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2023-10-16T13:13:59.893 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2023-10-16T13:13:59.893 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2023-10-16T13:13:59.894 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2023-10-16T13:13:59.894 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2023-10-16T13:13:59.895 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2023-10-16T13:13:59.895 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2023-10-16T13:13:59.896 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/ 2023-10-16T13:13:59.898 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2023-10-16T13:13:59.899 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2023-10-16T13:13:59.899 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2023-10-16T13:13:59.900 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2023-10-16T13:13:59.900 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2023-10-16T13:13:59.901 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2023-10-16T13:13:59.903 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2023-10-16T13:13:59.903 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2023-10-16T13:13:59.903 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2023-10-16T13:13:59.903 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2023-10-16T13:13:59.903 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2023-10-16T13:13:59.904 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2023-10-16T13:13:59.905 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2023-10-16T13:13:59.905 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2023-10-16T13:13:59.905 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2023-10-16T13:13:59.905 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2023-10-16T13:13:59.906 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2023-10-16T13:13:59.906 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2023-10-16T13:13:59.906 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2023-10-16T13:13:59.907 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2023-10-16T13:13:59.908 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2023-10-16T13:13:59.910 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2023-10-16T13:13:59.910 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2023-10-16T13:13:59.910 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2023-10-16T13:13:59.911 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2023-10-16T13:13:59.912 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2023-10-16T13:13:59.913 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2023-10-16T13:13:59.914 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2023-10-16T13:13:59.914 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2023-10-16T13:13:59.914 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2023-10-16T13:13:59.915 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2023-10-16T13:13:59.915 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2023-10-16T13:13:59.918 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2023-10-16T13:13:59.919 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2023-10-16T13:13:59.919 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2023-10-16T13:13:59.919 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2023-10-16T13:13:59.919 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2023-10-16T13:13:59.919 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2023-10-16T13:13:59.919 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2023-10-16T13:13:59.920 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2023-10-16T13:13:59.920 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2023-10-16T13:13:59.920 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2023-10-16T13:13:59.920 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2023-10-16T13:13:59.920 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2023-10-16T13:13:59.921 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2023-10-16T13:13:59.921 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2023-10-16T13:13:59.921 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2023-10-16T13:13:59.921 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2023-10-16T13:13:59.921 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2023-10-16T13:13:59.935 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2023-10-16T13:13:59.935 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2023-10-16T13:13:59.936 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2023-10-16T13:13:59.936 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2023-10-16T13:13:59.936 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2023-10-16T13:13:59.936 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2023-10-16T13:13:59.936 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2023-10-16T13:13:59.937 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2023-10-16T13:13:59.937 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2023-10-16T13:13:59.937 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2023-10-16T13:13:59.937 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2023-10-16T13:13:59.937 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2023-10-16T13:13:59.938 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2023-10-16T13:13:59.938 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2023-10-16T13:13:59.938 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2023-10-16T13:13:59.938 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2023-10-16T13:13:59.938 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2023-10-16T13:13:59.939 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2023-10-16T13:13:59.939 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2023-10-16T13:13:59.939 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2023-10-16T13:13:59.939 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2023-10-16T13:13:59.939 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2023-10-16T13:13:59.939 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2023-10-16T13:13:59.940 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2023-10-16T13:13:59.940 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2023-10-16T13:13:59.940 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2023-10-16T13:13:59.940 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2023-10-16T13:13:59.940 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2023-10-16T13:13:59.941 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2023-10-16T13:13:59.941 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2023-10-16T13:13:59.941 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2023-10-16T13:13:59.941 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2023-10-16T13:13:59.941 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2023-10-16T13:13:59.942 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2023-10-16T13:13:59.942 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2023-10-16T13:13:59.942 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2023-10-16T13:13:59.942 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2023-10-16T13:13:59.942 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2023-10-16T13:13:59.943 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2023-10-16T13:13:59.943 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2023-10-16T13:13:59.943 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2023-10-16T13:13:59.943 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2023-10-16T13:13:59.943 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2023-10-16T13:13:59.943 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2023-10-16T13:13:59.944 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2023-10-16T13:13:59.944 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2023-10-16T13:13:59.944 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2023-10-16T13:13:59.944 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2023-10-16T13:13:59.944 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2023-10-16T13:13:59.945 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2023-10-16T13:13:59.945 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2023-10-16T13:13:59.945 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2023-10-16T13:13:59.945 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2023-10-16T13:13:59.945 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2023-10-16T13:13:59.946 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2023-10-16T13:13:59.946 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2023-10-16T13:13:59.946 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2023-10-16T13:13:59.946 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2023-10-16T13:13:59.946 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2023-10-16T13:13:59.947 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2023-10-16T13:13:59.947 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2023-10-16T13:13:59.947 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2023-10-16T13:13:59.947 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2023-10-16T13:13:59.947 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2023-10-16T13:13:59.947 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2023-10-16T13:13:59.948 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2023-10-16T13:13:59.948 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2023-10-16T13:13:59.948 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2023-10-16T13:13:59.948 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2023-10-16T13:13:59.948 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2023-10-16T13:13:59.949 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2023-10-16T13:13:59.949 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2023-10-16T13:13:59.949 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2023-10-16T13:13:59.949 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2023-10-16T13:13:59.949 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2023-10-16T13:13:59.949 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2023-10-16T13:13:59.950 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2023-10-16T13:13:59.950 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2023-10-16T13:13:59.950 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2023-10-16T13:13:59.950 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2023-10-16T13:13:59.950 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2023-10-16T13:13:59.951 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2023-10-16T13:13:59.951 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2023-10-16T13:13:59.951 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2023-10-16T13:13:59.951 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2023-10-16T13:13:59.951 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2023-10-16T13:13:59.952 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2023-10-16T13:13:59.952 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2023-10-16T13:13:59.952 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2023-10-16T13:13:59.952 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2023-10-16T13:13:59.952 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2023-10-16T13:13:59.952 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2023-10-16T13:13:59.953 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2023-10-16T13:13:59.953 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2023-10-16T13:13:59.953 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2023-10-16T13:13:59.953 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2023-10-16T13:13:59.953 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2023-10-16T13:13:59.954 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2023-10-16T13:13:59.954 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2023-10-16T13:13:59.954 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2023-10-16T13:13:59.954 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2023-10-16T13:13:59.954 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2023-10-16T13:13:59.954 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2023-10-16T13:13:59.955 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2023-10-16T13:13:59.955 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2023-10-16T13:13:59.955 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2023-10-16T13:13:59.955 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2023-10-16T13:13:59.955 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2023-10-16T13:13:59.956 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2023-10-16T13:13:59.956 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2023-10-16T13:13:59.956 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2023-10-16T13:13:59.956 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2023-10-16T13:13:59.956 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2023-10-16T13:13:59.956 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2023-10-16T13:13:59.957 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2023-10-16T13:13:59.957 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2023-10-16T13:13:59.957 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2023-10-16T13:13:59.957 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2023-10-16T13:13:59.957 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2023-10-16T13:13:59.958 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2023-10-16T13:13:59.958 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2023-10-16T13:13:59.958 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2023-10-16T13:13:59.958 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2023-10-16T13:13:59.958 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2023-10-16T13:13:59.959 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2023-10-16T13:13:59.959 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2023-10-16T13:13:59.959 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2023-10-16T13:13:59.959 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2023-10-16T13:13:59.959 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2023-10-16T13:13:59.959 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2023-10-16T13:13:59.960 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2023-10-16T13:13:59.960 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2023-10-16T13:13:59.960 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2023-10-16T13:13:59.960 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2023-10-16T13:13:59.960 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2023-10-16T13:13:59.961 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2023-10-16T13:13:59.961 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2023-10-16T13:13:59.961 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2023-10-16T13:13:59.961 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2023-10-16T13:13:59.961 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2023-10-16T13:13:59.962 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2023-10-16T13:13:59.962 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2023-10-16T13:13:59.962 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2023-10-16T13:13:59.962 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2023-10-16T13:13:59.962 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2023-10-16T13:13:59.962 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2023-10-16T13:13:59.963 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2023-10-16T13:13:59.963 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2023-10-16T13:13:59.963 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2023-10-16T13:13:59.963 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2023-10-16T13:13:59.963 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2023-10-16T13:13:59.964 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2023-10-16T13:13:59.964 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2023-10-16T13:13:59.964 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2023-10-16T13:13:59.964 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2023-10-16T13:13:59.964 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2023-10-16T13:13:59.964 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2023-10-16T13:13:59.965 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2023-10-16T13:13:59.965 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2023-10-16T13:13:59.965 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2023-10-16T13:13:59.965 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2023-10-16T13:13:59.965 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2023-10-16T13:13:59.966 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2023-10-16T13:13:59.966 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/EDID/ 2023-10-16T13:13:59.999 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2023-10-16T13:14:00.001 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2023-10-16T13:14:00.002 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2023-10-16T13:14:00.002 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2023-10-16T13:14:00.002 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2023-10-16T13:14:00.002 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2023-10-16T13:14:00.003 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2023-10-16T13:14:00.003 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/EDID/Makefile 2023-10-16T13:14:00.003 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/EDID/edid.S 2023-10-16T13:14:00.003 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/EDID/hex 2023-10-16T13:14:00.003 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/HOWTO 2023-10-16T13:14:00.004 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/IPMI.txt 2023-10-16T13:14:00.004 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2023-10-16T13:14:00.004 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2023-10-16T13:14:00.004 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/IRQ.txt 2023-10-16T13:14:00.004 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2023-10-16T13:14:00.005 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/Makefile 2023-10-16T13:14:00.005 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ManagementStyle 2023-10-16T13:14:00.005 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/PCI/ 2023-10-16T13:14:00.009 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2023-10-16T13:14:00.010 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2023-10-16T13:14:00.011 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2023-10-16T13:14:00.011 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2023-10-16T13:14:00.011 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2023-10-16T13:14:00.011 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2023-10-16T13:14:00.011 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2023-10-16T13:14:00.012 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/RCU/ 2023-10-16T13:14:00.157 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2023-10-16T13:14:00.158 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2023-10-16T13:14:00.159 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2023-10-16T13:14:00.159 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2023-10-16T13:14:00.160 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2023-10-16T13:14:00.160 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2023-10-16T13:14:00.161 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2023-10-16T13:14:00.161 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2023-10-16T13:14:00.161 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2023-10-16T13:14:00.161 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2023-10-16T13:14:00.161 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2023-10-16T13:14:00.162 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2023-10-16T13:14:00.162 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2023-10-16T13:14:00.162 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2023-10-16T13:14:00.162 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2023-10-16T13:14:00.162 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2023-10-16T13:14:00.164 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2023-10-16T13:14:00.164 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2023-10-16T13:14:00.164 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/SAK.txt 2023-10-16T13:14:00.164 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/SM501.txt 2023-10-16T13:14:00.164 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/SecurityBugs 2023-10-16T13:14:00.165 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/SubmitChecklist 2023-10-16T13:14:00.165 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2023-10-16T13:14:00.165 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/SubmittingPatches 2023-10-16T13:14:00.165 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2023-10-16T13:14:00.165 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/accounting/ 2023-10-16T13:14:00.193 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2023-10-16T13:14:00.195 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/accounting/Makefile 2023-10-16T13:14:00.195 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2023-10-16T13:14:00.195 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2023-10-16T13:14:00.195 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2023-10-16T13:14:00.195 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2023-10-16T13:14:00.196 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2023-10-16T13:14:00.196 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/acpi/ 2023-10-16T13:14:00.198 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/acpi/apei/ 2023-10-16T13:14:00.199 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2023-10-16T13:14:00.200 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2023-10-16T13:14:00.200 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2023-10-16T13:14:00.202 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2023-10-16T13:14:00.202 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2023-10-16T13:14:00.203 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2023-10-16T13:14:00.203 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2023-10-16T13:14:00.203 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2023-10-16T13:14:00.203 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2023-10-16T13:14:00.203 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2023-10-16T13:14:00.203 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2023-10-16T13:14:00.204 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2023-10-16T13:14:00.204 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/aoe/ 2023-10-16T13:14:00.207 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2023-10-16T13:14:00.208 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2023-10-16T13:14:00.208 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/aoe/status.sh 2023-10-16T13:14:00.208 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2023-10-16T13:14:00.209 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2023-10-16T13:14:00.209 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2023-10-16T13:14:00.209 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/applying-patches.txt 2023-10-16T13:14:00.209 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/ 2023-10-16T13:14:00.211 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2023-10-16T13:14:00.213 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2023-10-16T13:14:00.213 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2023-10-16T13:14:00.215 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Booting 2023-10-16T13:14:00.215 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2023-10-16T13:14:00.215 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2023-10-16T13:14:00.215 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Interrupts 2023-10-16T13:14:00.216 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Makefile 2023-10-16T13:14:00.216 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2023-10-16T13:14:00.218 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2023-10-16T13:14:00.219 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Netwinder 2023-10-16T13:14:00.219 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2023-10-16T13:14:00.220 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2023-10-16T13:14:00.221 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2023-10-16T13:14:00.222 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Porting 2023-10-16T13:14:00.222 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/README 2023-10-16T13:14:00.222 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2023-10-16T13:14:00.223 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2023-10-16T13:14:00.226 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2023-10-16T13:14:00.226 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2023-10-16T13:14:00.226 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2023-10-16T13:14:00.226 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2023-10-16T13:14:00.227 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2023-10-16T13:14:00.227 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2023-10-16T13:14:00.227 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2023-10-16T13:14:00.227 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2023-10-16T13:14:00.227 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2023-10-16T13:14:00.228 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2023-10-16T13:14:00.228 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2023-10-16T13:14:00.228 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2023-10-16T13:14:00.228 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2023-10-16T13:14:00.228 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2023-10-16T13:14:00.228 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2023-10-16T13:14:00.229 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2023-10-16T13:14:00.229 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2023-10-16T13:14:00.229 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2023-10-16T13:14:00.233 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2023-10-16T13:14:00.234 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2023-10-16T13:14:00.234 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2023-10-16T13:14:00.235 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2023-10-16T13:14:00.235 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2023-10-16T13:14:00.235 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2023-10-16T13:14:00.237 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2023-10-16T13:14:00.238 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2023-10-16T13:14:00.239 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2023-10-16T13:14:00.240 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2023-10-16T13:14:00.241 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2023-10-16T13:14:00.241 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2023-10-16T13:14:00.241 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2023-10-16T13:14:00.241 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2023-10-16T13:14:00.241 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2023-10-16T13:14:00.242 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2023-10-16T13:14:00.242 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2023-10-16T13:14:00.242 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2023-10-16T13:14:00.242 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2023-10-16T13:14:00.242 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2023-10-16T13:14:00.245 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2023-10-16T13:14:00.246 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2023-10-16T13:14:00.247 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2023-10-16T13:14:00.247 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/Setup 2023-10-16T13:14:00.247 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/VFP/ 2023-10-16T13:14:00.248 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2023-10-16T13:14:00.250 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2023-10-16T13:14:00.250 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2023-10-16T13:14:00.250 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2023-10-16T13:14:00.251 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2023-10-16T13:14:00.251 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2023-10-16T13:14:00.251 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/memory.txt 2023-10-16T13:14:00.251 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/msm/ 2023-10-16T13:14:00.253 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2023-10-16T13:14:00.255 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2023-10-16T13:14:00.255 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2023-10-16T13:14:00.257 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2023-10-16T13:14:00.257 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2023-10-16T13:14:00.257 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2023-10-16T13:14:00.257 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/pxa/ 2023-10-16T13:14:00.259 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2023-10-16T13:14:00.260 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/sti/ 2023-10-16T13:14:00.261 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2023-10-16T13:14:00.262 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2023-10-16T13:14:00.262 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2023-10-16T13:14:00.262 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2023-10-16T13:14:00.262 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2023-10-16T13:14:00.263 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2023-10-16T13:14:00.264 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2023-10-16T13:14:00.266 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2023-10-16T13:14:00.266 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2023-10-16T13:14:00.266 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2023-10-16T13:14:00.266 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2023-10-16T13:14:00.267 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2023-10-16T13:14:00.267 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm64/ 2023-10-16T13:14:00.269 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2023-10-16T13:14:00.270 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2023-10-16T13:14:00.270 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2023-10-16T13:14:00.271 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2023-10-16T13:14:00.271 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/assoc_array.txt 2023-10-16T13:14:00.271 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2023-10-16T13:14:00.271 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/auxdisplay/ 2023-10-16T13:14:00.273 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2023-10-16T13:14:00.274 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2023-10-16T13:14:00.275 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2023-10-16T13:14:00.275 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2023-10-16T13:14:00.275 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2023-10-16T13:14:00.275 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/backlight/ 2023-10-16T13:14:00.277 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2023-10-16T13:14:00.278 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/bad_memory.txt 2023-10-16T13:14:00.278 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2023-10-16T13:14:00.279 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/bcache.txt 2023-10-16T13:14:00.279 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2023-10-16T13:14:00.279 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blackfin/ 2023-10-16T13:14:00.281 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2023-10-16T13:14:00.282 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2023-10-16T13:14:00.282 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2023-10-16T13:14:00.283 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2023-10-16T13:14:00.283 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2023-10-16T13:14:00.283 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/block/ 2023-10-16T13:14:00.285 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/block/00-INDEX 2023-10-16T13:14:00.287 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2023-10-16T13:14:00.287 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2023-10-16T13:14:00.287 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/block/capability.txt 2023-10-16T13:14:00.287 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2023-10-16T13:14:00.288 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2023-10-16T13:14:00.288 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2023-10-16T13:14:00.288 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2023-10-16T13:14:00.288 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2023-10-16T13:14:00.288 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2023-10-16T13:14:00.289 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2023-10-16T13:14:00.289 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/block/request.txt 2023-10-16T13:14:00.289 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/block/stat.txt 2023-10-16T13:14:00.289 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2023-10-16T13:14:00.289 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2023-10-16T13:14:00.290 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/ 2023-10-16T13:14:00.293 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2023-10-16T13:14:00.294 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2023-10-16T13:14:00.295 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2023-10-16T13:14:00.295 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2023-10-16T13:14:00.295 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2023-10-16T13:14:00.296 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2023-10-16T13:14:00.299 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2023-10-16T13:14:00.299 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2023-10-16T13:14:00.299 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2023-10-16T13:14:00.299 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2023-10-16T13:14:00.300 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2023-10-16T13:14:00.300 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2023-10-16T13:14:00.300 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2023-10-16T13:14:00.300 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2023-10-16T13:14:00.300 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2023-10-16T13:14:00.301 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2023-10-16T13:14:00.301 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2023-10-16T13:14:00.301 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2023-10-16T13:14:00.301 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2023-10-16T13:14:00.301 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/braille-console.txt 2023-10-16T13:14:00.301 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2023-10-16T13:14:00.302 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/btmrvl.txt 2023-10-16T13:14:00.302 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/bus-devices/ 2023-10-16T13:14:00.307 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2023-10-16T13:14:00.308 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2023-10-16T13:14:00.308 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cachetlb.txt 2023-10-16T13:14:00.308 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cdrom/ 2023-10-16T13:14:00.310 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2023-10-16T13:14:00.311 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2023-10-16T13:14:00.311 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2023-10-16T13:14:00.311 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2023-10-16T13:14:00.311 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2023-10-16T13:14:00.312 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cgroups/ 2023-10-16T13:14:00.314 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2023-10-16T13:14:00.316 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2023-10-16T13:14:00.316 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2023-10-16T13:14:00.316 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2023-10-16T13:14:00.316 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2023-10-16T13:14:00.316 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2023-10-16T13:14:00.317 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2023-10-16T13:14:00.317 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2023-10-16T13:14:00.317 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2023-10-16T13:14:00.317 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2023-10-16T13:14:00.318 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2023-10-16T13:14:00.319 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2023-10-16T13:14:00.319 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2023-10-16T13:14:00.319 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2023-10-16T13:14:00.319 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/clk.txt 2023-10-16T13:14:00.319 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/coccinelle.txt 2023-10-16T13:14:00.320 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/connector/ 2023-10-16T13:14:00.323 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/connector/.gitignore 2023-10-16T13:14:00.324 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/connector/Makefile 2023-10-16T13:14:00.324 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2023-10-16T13:14:00.324 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/connector/connector.txt 2023-10-16T13:14:00.324 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/connector/ucon.c 2023-10-16T13:14:00.325 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/console/ 2023-10-16T13:14:00.326 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/console/console.txt 2023-10-16T13:14:00.328 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cpu-freq/ 2023-10-16T13:14:00.329 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2023-10-16T13:14:00.331 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2023-10-16T13:14:00.331 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2023-10-16T13:14:00.331 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2023-10-16T13:14:00.331 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2023-10-16T13:14:00.333 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2023-10-16T13:14:00.333 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2023-10-16T13:14:00.333 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2023-10-16T13:14:00.333 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2023-10-16T13:14:00.334 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2023-10-16T13:14:00.334 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2023-10-16T13:14:00.334 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2023-10-16T13:14:00.334 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cpu-load.txt 2023-10-16T13:14:00.334 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cpuidle/ 2023-10-16T13:14:00.336 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2023-10-16T13:14:00.338 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2023-10-16T13:14:00.338 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2023-10-16T13:14:00.338 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2023-10-16T13:14:00.338 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cputopology.txt 2023-10-16T13:14:00.338 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/crc32.txt 2023-10-16T13:14:00.339 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cris/ 2023-10-16T13:14:00.341 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/cris/README 2023-10-16T13:14:00.342 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/crypto/ 2023-10-16T13:14:00.343 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2023-10-16T13:14:00.344 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2023-10-16T13:14:00.345 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2023-10-16T13:14:00.345 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2023-10-16T13:14:00.345 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2023-10-16T13:14:00.345 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dcdbas.txt 2023-10-16T13:14:00.346 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2023-10-16T13:14:00.346 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2023-10-16T13:14:00.346 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2023-10-16T13:14:00.346 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/development-process/ 2023-10-16T13:14:00.349 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2023-10-16T13:14:00.351 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/development-process/2.Process 2023-10-16T13:14:00.351 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2023-10-16T13:14:00.351 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2023-10-16T13:14:00.351 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2023-10-16T13:14:00.352 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2023-10-16T13:14:00.352 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2023-10-16T13:14:00.353 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2023-10-16T13:14:00.353 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/ 2023-10-16T13:14:00.355 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2023-10-16T13:14:00.358 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2023-10-16T13:14:00.358 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2023-10-16T13:14:00.358 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2023-10-16T13:14:00.358 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2023-10-16T13:14:00.359 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2023-10-16T13:14:00.359 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2023-10-16T13:14:00.359 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2023-10-16T13:14:00.359 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2023-10-16T13:14:00.359 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2023-10-16T13:14:00.360 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2023-10-16T13:14:00.360 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2023-10-16T13:14:00.360 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2023-10-16T13:14:00.360 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2023-10-16T13:14:00.360 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2023-10-16T13:14:00.360 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2023-10-16T13:14:00.361 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2023-10-16T13:14:00.361 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2023-10-16T13:14:00.361 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2023-10-16T13:14:00.361 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2023-10-16T13:14:00.361 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2023-10-16T13:14:00.362 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2023-10-16T13:14:00.362 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devices.txt 2023-10-16T13:14:00.362 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/ 2023-10-16T13:14:00.368 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2023-10-16T13:14:00.369 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2023-10-16T13:14:00.370 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2023-10-16T13:14:00.371 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2023-10-16T13:14:00.372 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2023-10-16T13:14:00.373 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2023-10-16T13:14:00.373 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2023-10-16T13:14:00.374 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2023-10-16T13:14:00.375 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2023-10-16T13:14:00.376 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2023-10-16T13:14:00.378 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2023-10-16T13:14:00.378 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2023-10-16T13:14:00.379 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2023-10-16T13:14:00.379 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2023-10-16T13:14:00.379 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2023-10-16T13:14:00.379 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2023-10-16T13:14:00.379 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2023-10-16T13:14:00.380 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2023-10-16T13:14:00.380 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2023-10-16T13:14:00.380 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2023-10-16T13:14:00.380 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2023-10-16T13:14:00.380 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2023-10-16T13:14:00.381 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2023-10-16T13:14:00.381 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2023-10-16T13:14:00.381 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2023-10-16T13:14:00.381 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2023-10-16T13:14:00.385 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2023-10-16T13:14:00.387 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2023-10-16T13:14:00.387 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2023-10-16T13:14:00.387 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2023-10-16T13:14:00.388 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2023-10-16T13:14:00.388 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2023-10-16T13:14:00.388 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2023-10-16T13:14:00.388 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2023-10-16T13:14:00.389 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2023-10-16T13:14:00.389 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2023-10-16T13:14:00.389 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2023-10-16T13:14:00.389 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2023-10-16T13:14:00.389 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2023-10-16T13:14:00.392 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2023-10-16T13:14:00.394 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2023-10-16T13:14:00.394 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2023-10-16T13:14:00.394 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2023-10-16T13:14:00.394 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2023-10-16T13:14:00.395 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2023-10-16T13:14:00.395 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2023-10-16T13:14:00.395 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2023-10-16T13:14:00.395 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2023-10-16T13:14:00.397 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2023-10-16T13:14:00.399 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2023-10-16T13:14:00.399 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2023-10-16T13:14:00.399 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2023-10-16T13:14:00.400 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2023-10-16T13:14:00.401 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2023-10-16T13:14:00.402 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2023-10-16T13:14:00.403 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2023-10-16T13:14:00.404 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2023-10-16T13:14:00.404 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2023-10-16T13:14:00.405 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2023-10-16T13:14:00.407 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2023-10-16T13:14:00.407 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2023-10-16T13:14:00.407 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2023-10-16T13:14:00.407 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2023-10-16T13:14:00.407 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2023-10-16T13:14:00.408 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2023-10-16T13:14:00.408 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2023-10-16T13:14:00.410 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2023-10-16T13:14:00.411 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2023-10-16T13:14:00.411 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2023-10-16T13:14:00.412 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2023-10-16T13:14:00.413 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2023-10-16T13:14:00.414 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2023-10-16T13:14:00.415 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2023-10-16T13:14:00.415 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2023-10-16T13:14:00.415 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2023-10-16T13:14:00.415 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2023-10-16T13:14:00.416 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2023-10-16T13:14:00.416 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2023-10-16T13:14:00.416 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2023-10-16T13:14:00.416 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2023-10-16T13:14:00.419 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2023-10-16T13:14:00.420 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2023-10-16T13:14:00.420 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2023-10-16T13:14:00.421 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2023-10-16T13:14:00.423 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2023-10-16T13:14:00.423 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2023-10-16T13:14:00.423 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2023-10-16T13:14:00.423 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2023-10-16T13:14:00.423 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2023-10-16T13:14:00.425 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2023-10-16T13:14:00.427 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2023-10-16T13:14:00.427 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2023-10-16T13:14:00.427 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2023-10-16T13:14:00.427 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2023-10-16T13:14:00.428 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2023-10-16T13:14:00.428 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2023-10-16T13:14:00.428 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2023-10-16T13:14:00.430 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2023-10-16T13:14:00.432 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2023-10-16T13:14:00.432 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2023-10-16T13:14:00.433 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2023-10-16T13:14:00.433 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2023-10-16T13:14:00.433 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2023-10-16T13:14:00.433 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2023-10-16T13:14:00.433 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2023-10-16T13:14:00.434 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2023-10-16T13:14:00.434 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2023-10-16T13:14:00.434 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2023-10-16T13:14:00.434 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2023-10-16T13:14:00.434 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2023-10-16T13:14:00.435 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2023-10-16T13:14:00.435 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2023-10-16T13:14:00.435 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2023-10-16T13:14:00.435 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2023-10-16T13:14:00.439 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2023-10-16T13:14:00.441 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2023-10-16T13:14:00.441 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2023-10-16T13:14:00.441 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2023-10-16T13:14:00.442 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2023-10-16T13:14:00.442 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2023-10-16T13:14:00.444 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2023-10-16T13:14:00.445 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2023-10-16T13:14:00.446 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2023-10-16T13:14:00.446 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2023-10-16T13:14:00.446 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2023-10-16T13:14:00.446 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2023-10-16T13:14:00.447 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2023-10-16T13:14:00.447 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2023-10-16T13:14:00.447 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2023-10-16T13:14:00.447 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2023-10-16T13:14:00.447 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2023-10-16T13:14:00.450 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2023-10-16T13:14:00.451 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2023-10-16T13:14:00.452 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2023-10-16T13:14:00.452 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2023-10-16T13:14:00.452 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2023-10-16T13:14:00.452 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2023-10-16T13:14:00.452 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2023-10-16T13:14:00.453 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2023-10-16T13:14:00.455 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2023-10-16T13:14:00.456 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2023-10-16T13:14:00.457 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2023-10-16T13:14:00.457 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2023-10-16T13:14:00.457 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2023-10-16T13:14:00.457 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2023-10-16T13:14:00.458 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2023-10-16T13:14:00.458 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2023-10-16T13:14:00.458 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2023-10-16T13:14:00.460 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2023-10-16T13:14:00.462 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2023-10-16T13:14:00.462 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2023-10-16T13:14:00.462 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2023-10-16T13:14:00.463 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2023-10-16T13:14:00.463 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2023-10-16T13:14:00.463 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2023-10-16T13:14:00.463 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2023-10-16T13:14:00.463 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2023-10-16T13:14:00.466 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2023-10-16T13:14:00.467 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2023-10-16T13:14:00.468 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2023-10-16T13:14:00.468 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2023-10-16T13:14:00.468 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2023-10-16T13:14:00.468 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2023-10-16T13:14:00.470 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2023-10-16T13:14:00.473 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2023-10-16T13:14:00.473 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2023-10-16T13:14:00.473 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2023-10-16T13:14:00.473 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2023-10-16T13:14:00.473 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2023-10-16T13:14:00.474 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2023-10-16T13:14:00.474 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2023-10-16T13:14:00.474 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2023-10-16T13:14:00.474 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2023-10-16T13:14:00.474 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2023-10-16T13:14:00.475 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2023-10-16T13:14:00.475 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2023-10-16T13:14:00.475 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2023-10-16T13:14:00.475 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2023-10-16T13:14:00.475 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2023-10-16T13:14:00.476 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2023-10-16T13:14:00.480 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2023-10-16T13:14:00.481 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2023-10-16T13:14:00.481 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2023-10-16T13:14:00.482 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2023-10-16T13:14:00.482 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2023-10-16T13:14:00.482 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2023-10-16T13:14:00.482 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2023-10-16T13:14:00.484 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2023-10-16T13:14:00.486 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2023-10-16T13:14:00.486 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2023-10-16T13:14:00.486 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2023-10-16T13:14:00.486 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2023-10-16T13:14:00.487 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2023-10-16T13:14:00.487 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2023-10-16T13:14:00.487 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2023-10-16T13:14:00.489 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2023-10-16T13:14:00.497 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2023-10-16T13:14:00.497 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2023-10-16T13:14:00.497 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2023-10-16T13:14:00.498 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2023-10-16T13:14:00.498 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2023-10-16T13:14:00.498 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2023-10-16T13:14:00.498 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2023-10-16T13:14:00.498 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2023-10-16T13:14:00.498 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2023-10-16T13:14:00.499 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2023-10-16T13:14:00.499 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2023-10-16T13:14:00.499 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2023-10-16T13:14:00.499 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2023-10-16T13:14:00.499 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2023-10-16T13:14:00.500 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2023-10-16T13:14:00.500 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2023-10-16T13:14:00.500 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2023-10-16T13:14:00.500 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2023-10-16T13:14:00.500 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2023-10-16T13:14:00.501 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2023-10-16T13:14:00.501 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2023-10-16T13:14:00.501 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2023-10-16T13:14:00.501 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2023-10-16T13:14:00.501 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2023-10-16T13:14:00.501 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2023-10-16T13:14:00.502 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2023-10-16T13:14:00.502 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2023-10-16T13:14:00.502 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2023-10-16T13:14:00.502 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2023-10-16T13:14:00.502 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2023-10-16T13:14:00.503 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2023-10-16T13:14:00.503 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2023-10-16T13:14:00.503 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2023-10-16T13:14:00.503 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2023-10-16T13:14:00.503 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2023-10-16T13:14:00.504 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2023-10-16T13:14:00.504 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2023-10-16T13:14:00.504 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2023-10-16T13:14:00.504 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2023-10-16T13:14:00.504 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2023-10-16T13:14:00.504 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2023-10-16T13:14:00.505 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2023-10-16T13:14:00.505 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2023-10-16T13:14:00.505 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2023-10-16T13:14:00.505 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2023-10-16T13:14:00.505 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2023-10-16T13:14:00.506 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2023-10-16T13:14:00.506 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2023-10-16T13:14:00.506 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2023-10-16T13:14:00.506 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2023-10-16T13:14:00.506 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2023-10-16T13:14:00.507 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2023-10-16T13:14:00.507 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2023-10-16T13:14:00.507 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2023-10-16T13:14:00.507 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2023-10-16T13:14:00.507 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2023-10-16T13:14:00.508 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2023-10-16T13:14:00.508 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2023-10-16T13:14:00.508 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2023-10-16T13:14:00.508 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2023-10-16T13:14:00.508 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2023-10-16T13:14:00.509 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2023-10-16T13:14:00.509 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2023-10-16T13:14:00.509 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2023-10-16T13:14:00.509 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2023-10-16T13:14:00.509 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2023-10-16T13:14:00.510 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2023-10-16T13:14:00.510 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2023-10-16T13:14:00.510 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2023-10-16T13:14:00.510 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2023-10-16T13:14:00.510 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2023-10-16T13:14:00.511 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2023-10-16T13:14:00.511 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2023-10-16T13:14:00.511 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2023-10-16T13:14:00.511 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2023-10-16T13:14:00.511 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2023-10-16T13:14:00.511 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2023-10-16T13:14:00.512 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2023-10-16T13:14:00.512 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2023-10-16T13:14:00.512 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2023-10-16T13:14:00.512 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2023-10-16T13:14:00.512 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2023-10-16T13:14:00.513 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2023-10-16T13:14:00.513 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2023-10-16T13:14:00.530 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2023-10-16T13:14:00.532 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2023-10-16T13:14:00.532 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2023-10-16T13:14:00.532 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2023-10-16T13:14:00.533 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2023-10-16T13:14:00.533 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2023-10-16T13:14:00.533 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2023-10-16T13:14:00.533 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2023-10-16T13:14:00.533 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2023-10-16T13:14:00.534 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2023-10-16T13:14:00.534 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2023-10-16T13:14:00.534 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2023-10-16T13:14:00.534 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2023-10-16T13:14:00.710 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2023-10-16T13:14:00.713 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2023-10-16T13:14:00.713 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2023-10-16T13:14:00.713 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2023-10-16T13:14:00.713 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2023-10-16T13:14:00.714 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2023-10-16T13:14:00.714 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2023-10-16T13:14:00.714 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2023-10-16T13:14:00.714 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2023-10-16T13:14:00.715 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2023-10-16T13:14:00.715 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2023-10-16T13:14:00.715 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2023-10-16T13:14:00.715 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2023-10-16T13:14:00.715 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2023-10-16T13:14:00.715 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2023-10-16T13:14:00.716 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2023-10-16T13:14:00.716 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2023-10-16T13:14:00.721 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2023-10-16T13:14:00.722 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2023-10-16T13:14:00.722 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2023-10-16T13:14:00.722 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2023-10-16T13:14:00.722 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2023-10-16T13:14:00.724 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2023-10-16T13:14:00.726 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2023-10-16T13:14:00.726 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2023-10-16T13:14:00.726 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2023-10-16T13:14:00.727 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2023-10-16T13:14:00.727 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2023-10-16T13:14:00.727 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2023-10-16T13:14:00.727 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2023-10-16T13:14:00.727 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2023-10-16T13:14:00.728 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2023-10-16T13:14:00.728 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2023-10-16T13:14:00.728 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2023-10-16T13:14:00.728 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2023-10-16T13:14:00.728 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2023-10-16T13:14:00.729 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2023-10-16T13:14:00.732 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2023-10-16T13:14:00.733 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2023-10-16T13:14:00.734 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2023-10-16T13:14:00.735 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2023-10-16T13:14:00.738 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2023-10-16T13:14:00.739 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2023-10-16T13:14:00.739 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2023-10-16T13:14:00.739 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2023-10-16T13:14:00.739 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2023-10-16T13:14:00.739 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2023-10-16T13:14:00.740 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2023-10-16T13:14:00.740 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2023-10-16T13:14:00.740 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2023-10-16T13:14:00.740 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2023-10-16T13:14:00.740 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2023-10-16T13:14:00.741 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2023-10-16T13:14:00.741 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2023-10-16T13:14:00.741 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2023-10-16T13:14:00.741 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2023-10-16T13:14:00.741 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2023-10-16T13:14:00.741 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2023-10-16T13:14:00.742 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2023-10-16T13:14:00.742 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2023-10-16T13:14:00.742 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2023-10-16T13:14:00.742 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2023-10-16T13:14:00.742 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2023-10-16T13:14:00.745 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2023-10-16T13:14:00.745 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2023-10-16T13:14:00.745 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2023-10-16T13:14:00.745 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2023-10-16T13:14:00.746 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2023-10-16T13:14:00.746 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2023-10-16T13:14:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:00 smithi092 ceph-mon[99542]: pgmap v327: 97 pgs: 97 active+clean; 663 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 938 B/s wr, 10 op/s 2023-10-16T13:14:00.751 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2023-10-16T13:14:00.752 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2023-10-16T13:14:00.752 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2023-10-16T13:14:00.753 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2023-10-16T13:14:00.754 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2023-10-16T13:14:00.755 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2023-10-16T13:14:00.756 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2023-10-16T13:14:00.757 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2023-10-16T13:14:00.758 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2023-10-16T13:14:00.759 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2023-10-16T13:14:00.760 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2023-10-16T13:14:00.761 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2023-10-16T13:14:00.762 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2023-10-16T13:14:00.763 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2023-10-16T13:14:00.763 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2023-10-16T13:14:00.763 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2023-10-16T13:14:00.765 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2023-10-16T13:14:00.766 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2023-10-16T13:14:00.766 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2023-10-16T13:14:00.766 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2023-10-16T13:14:00.768 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2023-10-16T13:14:00.769 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2023-10-16T13:14:00.769 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2023-10-16T13:14:00.770 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2023-10-16T13:14:00.770 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2023-10-16T13:14:00.770 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2023-10-16T13:14:00.772 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2023-10-16T13:14:00.773 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2023-10-16T13:14:00.773 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2023-10-16T13:14:00.773 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2023-10-16T13:14:00.775 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2023-10-16T13:14:00.776 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2023-10-16T13:14:00.776 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2023-10-16T13:14:00.777 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2023-10-16T13:14:00.778 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2023-10-16T13:14:00.779 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2023-10-16T13:14:00.780 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2023-10-16T13:14:00.781 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2023-10-16T13:14:00.786 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2023-10-16T13:14:00.787 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2023-10-16T13:14:00.787 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2023-10-16T13:14:00.787 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2023-10-16T13:14:00.787 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2023-10-16T13:14:00.787 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2023-10-16T13:14:00.788 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2023-10-16T13:14:00.788 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2023-10-16T13:14:00.788 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2023-10-16T13:14:00.788 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2023-10-16T13:14:00.788 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2023-10-16T13:14:00.789 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2023-10-16T13:14:00.789 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2023-10-16T13:14:00.789 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2023-10-16T13:14:00.789 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2023-10-16T13:14:00.789 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2023-10-16T13:14:00.790 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2023-10-16T13:14:00.790 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2023-10-16T13:14:00.790 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2023-10-16T13:14:00.790 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2023-10-16T13:14:00.790 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2023-10-16T13:14:00.791 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2023-10-16T13:14:00.791 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2023-10-16T13:14:00.791 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2023-10-16T13:14:00.791 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2023-10-16T13:14:00.791 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2023-10-16T13:14:00.792 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2023-10-16T13:14:00.792 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2023-10-16T13:14:00.792 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2023-10-16T13:14:00.792 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2023-10-16T13:14:00.792 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2023-10-16T13:14:00.792 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2023-10-16T13:14:00.793 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2023-10-16T13:14:00.793 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2023-10-16T13:14:00.793 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2023-10-16T13:14:00.793 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2023-10-16T13:14:00.793 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2023-10-16T13:14:00.794 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2023-10-16T13:14:00.794 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2023-10-16T13:14:00.794 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2023-10-16T13:14:00.794 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2023-10-16T13:14:00.794 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2023-10-16T13:14:00.795 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2023-10-16T13:14:00.795 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2023-10-16T13:14:00.795 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2023-10-16T13:14:00.795 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2023-10-16T13:14:00.795 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2023-10-16T13:14:00.795 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2023-10-16T13:14:00.796 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2023-10-16T13:14:00.796 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2023-10-16T13:14:00.796 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2023-10-16T13:14:00.796 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2023-10-16T13:14:00.796 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2023-10-16T13:14:00.796 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2023-10-16T13:14:00.797 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:00 smithi118 ceph-mon[103969]: pgmap v327: 97 pgs: 97 active+clean; 663 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 938 B/s wr, 10 op/s 2023-10-16T13:14:00.809 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2023-10-16T13:14:00.810 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2023-10-16T13:14:00.810 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2023-10-16T13:14:00.811 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2023-10-16T13:14:00.811 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2023-10-16T13:14:00.811 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2023-10-16T13:14:00.811 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2023-10-16T13:14:00.813 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2023-10-16T13:14:00.815 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2023-10-16T13:14:00.816 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2023-10-16T13:14:00.817 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2023-10-16T13:14:00.817 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2023-10-16T13:14:00.817 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2023-10-16T13:14:00.819 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2023-10-16T13:14:00.820 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2023-10-16T13:14:00.820 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2023-10-16T13:14:00.821 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2023-10-16T13:14:00.821 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2023-10-16T13:14:00.821 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2023-10-16T13:14:00.821 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2023-10-16T13:14:00.821 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2023-10-16T13:14:00.822 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2023-10-16T13:14:00.824 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2023-10-16T13:14:00.825 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2023-10-16T13:14:00.826 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2023-10-16T13:14:00.826 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2023-10-16T13:14:00.827 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2023-10-16T13:14:00.832 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2023-10-16T13:14:00.832 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2023-10-16T13:14:00.833 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2023-10-16T13:14:00.833 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2023-10-16T13:14:00.833 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2023-10-16T13:14:00.833 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2023-10-16T13:14:00.833 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2023-10-16T13:14:00.834 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2023-10-16T13:14:00.834 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2023-10-16T13:14:00.834 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2023-10-16T13:14:00.834 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2023-10-16T13:14:00.834 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2023-10-16T13:14:00.835 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2023-10-16T13:14:00.835 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2023-10-16T13:14:00.835 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2023-10-16T13:14:00.835 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2023-10-16T13:14:00.835 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2023-10-16T13:14:00.836 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2023-10-16T13:14:00.836 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2023-10-16T13:14:00.836 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2023-10-16T13:14:00.836 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2023-10-16T13:14:00.836 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2023-10-16T13:14:00.836 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2023-10-16T13:14:00.837 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2023-10-16T13:14:00.837 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2023-10-16T13:14:00.837 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2023-10-16T13:14:00.837 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2023-10-16T13:14:00.837 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2023-10-16T13:14:00.838 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2023-10-16T13:14:00.838 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2023-10-16T13:14:00.838 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2023-10-16T13:14:00.838 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2023-10-16T13:14:00.838 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2023-10-16T13:14:00.839 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2023-10-16T13:14:00.839 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2023-10-16T13:14:00.839 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2023-10-16T13:14:00.839 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2023-10-16T13:14:00.839 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2023-10-16T13:14:00.840 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2023-10-16T13:14:00.840 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2023-10-16T13:14:00.840 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2023-10-16T13:14:00.840 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2023-10-16T13:14:00.840 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2023-10-16T13:14:00.840 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2023-10-16T13:14:00.841 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2023-10-16T13:14:00.841 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2023-10-16T13:14:00.841 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2023-10-16T13:14:00.841 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2023-10-16T13:14:00.841 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2023-10-16T13:14:00.842 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2023-10-16T13:14:00.842 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2023-10-16T13:14:00.842 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2023-10-16T13:14:00.854 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2023-10-16T13:14:00.855 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2023-10-16T13:14:00.856 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2023-10-16T13:14:00.857 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2023-10-16T13:14:00.859 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2023-10-16T13:14:00.859 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2023-10-16T13:14:00.859 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2023-10-16T13:14:00.859 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2023-10-16T13:14:00.860 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2023-10-16T13:14:00.860 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2023-10-16T13:14:00.860 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2023-10-16T13:14:00.860 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2023-10-16T13:14:00.860 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2023-10-16T13:14:00.861 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2023-10-16T13:14:00.863 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2023-10-16T13:14:00.865 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2023-10-16T13:14:00.865 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2023-10-16T13:14:00.866 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2023-10-16T13:14:00.867 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2023-10-16T13:14:00.868 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2023-10-16T13:14:00.869 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2023-10-16T13:14:00.870 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2023-10-16T13:14:00.871 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2023-10-16T13:14:00.872 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2023-10-16T13:14:00.872 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2023-10-16T13:14:00.873 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2023-10-16T13:14:00.873 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2023-10-16T13:14:00.874 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2023-10-16T13:14:00.875 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2023-10-16T13:14:00.875 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2023-10-16T13:14:00.877 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2023-10-16T13:14:00.878 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2023-10-16T13:14:00.878 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2023-10-16T13:14:00.878 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2023-10-16T13:14:00.880 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2023-10-16T13:14:00.884 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2023-10-16T13:14:00.884 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2023-10-16T13:14:00.884 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2023-10-16T13:14:00.884 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2023-10-16T13:14:00.885 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2023-10-16T13:14:00.885 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2023-10-16T13:14:00.885 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2023-10-16T13:14:00.885 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2023-10-16T13:14:00.885 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2023-10-16T13:14:00.886 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2023-10-16T13:14:00.886 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2023-10-16T13:14:00.886 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2023-10-16T13:14:00.886 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2023-10-16T13:14:00.886 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2023-10-16T13:14:00.887 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2023-10-16T13:14:00.887 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2023-10-16T13:14:00.887 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2023-10-16T13:14:00.887 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2023-10-16T13:14:00.887 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2023-10-16T13:14:00.888 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2023-10-16T13:14:00.888 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2023-10-16T13:14:00.888 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2023-10-16T13:14:00.888 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2023-10-16T13:14:00.888 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2023-10-16T13:14:00.888 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2023-10-16T13:14:00.889 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2023-10-16T13:14:00.889 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2023-10-16T13:14:00.889 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2023-10-16T13:14:00.889 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2023-10-16T13:14:00.889 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2023-10-16T13:14:00.890 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2023-10-16T13:14:00.890 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2023-10-16T13:14:00.890 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2023-10-16T13:14:00.890 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2023-10-16T13:14:00.890 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2023-10-16T13:14:00.891 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2023-10-16T13:14:00.891 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2023-10-16T13:14:00.900 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2023-10-16T13:14:00.902 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2023-10-16T13:14:00.902 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2023-10-16T13:14:00.903 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2023-10-16T13:14:00.903 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2023-10-16T13:14:00.903 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2023-10-16T13:14:00.903 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2023-10-16T13:14:00.903 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2023-10-16T13:14:00.904 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2023-10-16T13:14:00.904 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2023-10-16T13:14:00.904 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2023-10-16T13:14:00.904 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2023-10-16T13:14:00.904 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2023-10-16T13:14:00.905 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2023-10-16T13:14:00.905 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2023-10-16T13:14:00.905 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2023-10-16T13:14:00.905 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2023-10-16T13:14:00.905 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2023-10-16T13:14:00.906 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2023-10-16T13:14:00.910 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2023-10-16T13:14:00.913 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2023-10-16T13:14:00.913 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2023-10-16T13:14:00.913 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2023-10-16T13:14:00.914 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2023-10-16T13:14:00.914 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2023-10-16T13:14:00.914 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2023-10-16T13:14:00.914 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2023-10-16T13:14:00.914 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2023-10-16T13:14:00.915 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2023-10-16T13:14:00.915 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2023-10-16T13:14:00.915 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2023-10-16T13:14:00.915 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2023-10-16T13:14:00.915 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2023-10-16T13:14:00.915 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2023-10-16T13:14:00.916 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2023-10-16T13:14:00.916 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2023-10-16T13:14:00.916 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2023-10-16T13:14:00.916 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2023-10-16T13:14:00.916 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2023-10-16T13:14:00.917 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2023-10-16T13:14:00.917 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2023-10-16T13:14:00.922 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2023-10-16T13:14:00.924 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2023-10-16T13:14:00.924 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2023-10-16T13:14:00.924 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2023-10-16T13:14:00.924 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2023-10-16T13:14:00.925 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2023-10-16T13:14:00.925 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2023-10-16T13:14:00.925 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2023-10-16T13:14:00.925 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2023-10-16T13:14:00.928 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2023-10-16T13:14:00.929 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2023-10-16T13:14:00.930 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2023-10-16T13:14:00.930 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2023-10-16T13:14:00.930 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2023-10-16T13:14:00.930 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2023-10-16T13:14:00.930 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2023-10-16T13:14:00.931 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2023-10-16T13:14:00.931 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2023-10-16T13:14:00.931 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2023-10-16T13:14:00.934 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2023-10-16T13:14:00.935 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2023-10-16T13:14:00.935 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2023-10-16T13:14:00.937 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2023-10-16T13:14:00.938 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2023-10-16T13:14:00.938 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2023-10-16T13:14:00.938 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2023-10-16T13:14:00.939 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2023-10-16T13:14:00.940 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2023-10-16T13:14:00.942 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2023-10-16T13:14:00.942 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2023-10-16T13:14:00.942 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2023-10-16T13:14:00.942 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2023-10-16T13:14:00.943 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2023-10-16T13:14:00.943 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2023-10-16T13:14:00.943 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2023-10-16T13:14:00.943 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2023-10-16T13:14:00.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:00 smithi152 ceph-mon[104423]: pgmap v327: 97 pgs: 97 active+clean; 663 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 938 B/s wr, 10 op/s 2023-10-16T13:14:00.946 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2023-10-16T13:14:00.950 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2023-10-16T13:14:00.950 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2023-10-16T13:14:00.950 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2023-10-16T13:14:00.950 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2023-10-16T13:14:00.951 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2023-10-16T13:14:00.951 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2023-10-16T13:14:00.951 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2023-10-16T13:14:00.951 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2023-10-16T13:14:00.951 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2023-10-16T13:14:00.951 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2023-10-16T13:14:00.952 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2023-10-16T13:14:00.952 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2023-10-16T13:14:00.952 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2023-10-16T13:14:00.952 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2023-10-16T13:14:00.952 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2023-10-16T13:14:00.953 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2023-10-16T13:14:00.953 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2023-10-16T13:14:00.953 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2023-10-16T13:14:00.953 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2023-10-16T13:14:00.953 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2023-10-16T13:14:00.953 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2023-10-16T13:14:00.954 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2023-10-16T13:14:00.954 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2023-10-16T13:14:00.954 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2023-10-16T13:14:00.954 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2023-10-16T13:14:00.959 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2023-10-16T13:14:00.960 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2023-10-16T13:14:00.961 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2023-10-16T13:14:00.963 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2023-10-16T13:14:00.963 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2023-10-16T13:14:00.963 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2023-10-16T13:14:00.963 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2023-10-16T13:14:00.963 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2023-10-16T13:14:00.964 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2023-10-16T13:14:00.966 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2023-10-16T13:14:00.967 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2023-10-16T13:14:00.968 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2023-10-16T13:14:00.969 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2023-10-16T13:14:00.969 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2023-10-16T13:14:00.969 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2023-10-16T13:14:00.971 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2023-10-16T13:14:00.975 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2023-10-16T13:14:00.976 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2023-10-16T13:14:00.976 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2023-10-16T13:14:00.976 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2023-10-16T13:14:00.976 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2023-10-16T13:14:00.977 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2023-10-16T13:14:00.977 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2023-10-16T13:14:00.977 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2023-10-16T13:14:00.977 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2023-10-16T13:14:00.977 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2023-10-16T13:14:00.977 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2023-10-16T13:14:00.978 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2023-10-16T13:14:00.978 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2023-10-16T13:14:00.978 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2023-10-16T13:14:00.978 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2023-10-16T13:14:00.978 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2023-10-16T13:14:00.979 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2023-10-16T13:14:00.979 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2023-10-16T13:14:00.979 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2023-10-16T13:14:00.979 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2023-10-16T13:14:00.979 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2023-10-16T13:14:00.980 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2023-10-16T13:14:00.980 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2023-10-16T13:14:00.980 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2023-10-16T13:14:00.980 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2023-10-16T13:14:00.980 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2023-10-16T13:14:00.981 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2023-10-16T13:14:00.981 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2023-10-16T13:14:00.981 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2023-10-16T13:14:00.981 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2023-10-16T13:14:00.981 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2023-10-16T13:14:00.982 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2023-10-16T13:14:00.982 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2023-10-16T13:14:00.982 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2023-10-16T13:14:00.982 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2023-10-16T13:14:00.982 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2023-10-16T13:14:00.983 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2023-10-16T13:14:00.983 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2023-10-16T13:14:00.983 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2023-10-16T13:14:00.983 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2023-10-16T13:14:00.983 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2023-10-16T13:14:00.983 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2023-10-16T13:14:00.984 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2023-10-16T13:14:00.984 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2023-10-16T13:14:00.984 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2023-10-16T13:14:01.116 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2023-10-16T13:14:01.117 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2023-10-16T13:14:01.118 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2023-10-16T13:14:01.119 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2023-10-16T13:14:01.120 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2023-10-16T13:14:01.121 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2023-10-16T13:14:01.122 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2023-10-16T13:14:01.122 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2023-10-16T13:14:01.122 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2023-10-16T13:14:01.122 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2023-10-16T13:14:01.124 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2023-10-16T13:14:01.126 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2023-10-16T13:14:01.126 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2023-10-16T13:14:01.126 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2023-10-16T13:14:01.126 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2023-10-16T13:14:01.126 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2023-10-16T13:14:01.127 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2023-10-16T13:14:01.129 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2023-10-16T13:14:01.129 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2023-10-16T13:14:01.130 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2023-10-16T13:14:01.132 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2023-10-16T13:14:01.132 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2023-10-16T13:14:01.133 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2023-10-16T13:14:01.133 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2023-10-16T13:14:01.133 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2023-10-16T13:14:01.133 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2023-10-16T13:14:01.133 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2023-10-16T13:14:01.134 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2023-10-16T13:14:01.134 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2023-10-16T13:14:01.134 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2023-10-16T13:14:01.134 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2023-10-16T13:14:01.134 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2023-10-16T13:14:01.138 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2023-10-16T13:14:01.142 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2023-10-16T13:14:01.143 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2023-10-16T13:14:01.143 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2023-10-16T13:14:01.143 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2023-10-16T13:14:01.143 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2023-10-16T13:14:01.144 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2023-10-16T13:14:01.144 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2023-10-16T13:14:01.144 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2023-10-16T13:14:01.144 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2023-10-16T13:14:01.144 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2023-10-16T13:14:01.144 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2023-10-16T13:14:01.145 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2023-10-16T13:14:01.145 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2023-10-16T13:14:01.145 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2023-10-16T13:14:01.145 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2023-10-16T13:14:01.145 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2023-10-16T13:14:01.146 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2023-10-16T13:14:01.146 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2023-10-16T13:14:01.146 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2023-10-16T13:14:01.146 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2023-10-16T13:14:01.146 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2023-10-16T13:14:01.147 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2023-10-16T13:14:01.147 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2023-10-16T13:14:01.147 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2023-10-16T13:14:01.147 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2023-10-16T13:14:01.147 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2023-10-16T13:14:01.147 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2023-10-16T13:14:01.148 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2023-10-16T13:14:01.148 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2023-10-16T13:14:01.148 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2023-10-16T13:14:01.148 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2023-10-16T13:14:01.148 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2023-10-16T13:14:01.149 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2023-10-16T13:14:01.149 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2023-10-16T13:14:01.149 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2023-10-16T13:14:01.149 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2023-10-16T13:14:01.149 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2023-10-16T13:14:01.149 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2023-10-16T13:14:01.150 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2023-10-16T13:14:01.159 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2023-10-16T13:14:01.162 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2023-10-16T13:14:01.163 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2023-10-16T13:14:01.163 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2023-10-16T13:14:01.163 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2023-10-16T13:14:01.163 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2023-10-16T13:14:01.163 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2023-10-16T13:14:01.164 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2023-10-16T13:14:01.164 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2023-10-16T13:14:01.164 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2023-10-16T13:14:01.164 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2023-10-16T13:14:01.164 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2023-10-16T13:14:01.164 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2023-10-16T13:14:01.165 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2023-10-16T13:14:01.165 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2023-10-16T13:14:01.165 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2023-10-16T13:14:01.165 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2023-10-16T13:14:01.165 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2023-10-16T13:14:01.166 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2023-10-16T13:14:01.166 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2023-10-16T13:14:01.166 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2023-10-16T13:14:01.166 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2023-10-16T13:14:01.166 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2023-10-16T13:14:01.166 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2023-10-16T13:14:01.167 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2023-10-16T13:14:01.167 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2023-10-16T13:14:01.167 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2023-10-16T13:14:01.167 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2023-10-16T13:14:01.167 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2023-10-16T13:14:01.167 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2023-10-16T13:14:01.175 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2023-10-16T13:14:01.177 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2023-10-16T13:14:01.177 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2023-10-16T13:14:01.177 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2023-10-16T13:14:01.177 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2023-10-16T13:14:01.178 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2023-10-16T13:14:01.178 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2023-10-16T13:14:01.178 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2023-10-16T13:14:01.178 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2023-10-16T13:14:01.178 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2023-10-16T13:14:01.179 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2023-10-16T13:14:01.179 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2023-10-16T13:14:01.179 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2023-10-16T13:14:01.179 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2023-10-16T13:14:01.179 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2023-10-16T13:14:01.184 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2023-10-16T13:14:01.186 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2023-10-16T13:14:01.186 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2023-10-16T13:14:01.186 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2023-10-16T13:14:01.187 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2023-10-16T13:14:01.187 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2023-10-16T13:14:01.187 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2023-10-16T13:14:01.187 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2023-10-16T13:14:01.187 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2023-10-16T13:14:01.188 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2023-10-16T13:14:01.188 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2023-10-16T13:14:01.188 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2023-10-16T13:14:01.188 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2023-10-16T13:14:01.188 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2023-10-16T13:14:01.189 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2023-10-16T13:14:01.189 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2023-10-16T13:14:01.189 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2023-10-16T13:14:01.189 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2023-10-16T13:14:01.189 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2023-10-16T13:14:01.189 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2023-10-16T13:14:01.190 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2023-10-16T13:14:01.195 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2023-10-16T13:14:01.196 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2023-10-16T13:14:01.197 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2023-10-16T13:14:01.197 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2023-10-16T13:14:01.197 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2023-10-16T13:14:01.197 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2023-10-16T13:14:01.198 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2023-10-16T13:14:01.198 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2023-10-16T13:14:01.198 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2023-10-16T13:14:01.198 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2023-10-16T13:14:01.201 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2023-10-16T13:14:01.203 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2023-10-16T13:14:01.204 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2023-10-16T13:14:01.204 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2023-10-16T13:14:01.204 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2023-10-16T13:14:01.204 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2023-10-16T13:14:01.204 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2023-10-16T13:14:01.205 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2023-10-16T13:14:01.205 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2023-10-16T13:14:01.205 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2023-10-16T13:14:01.205 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2023-10-16T13:14:01.205 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2023-10-16T13:14:01.205 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2023-10-16T13:14:01.206 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2023-10-16T13:14:01.206 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2023-10-16T13:14:01.206 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2023-10-16T13:14:01.206 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2023-10-16T13:14:01.206 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2023-10-16T13:14:01.207 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2023-10-16T13:14:01.207 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2023-10-16T13:14:01.212 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2023-10-16T13:14:01.214 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2023-10-16T13:14:01.215 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2023-10-16T13:14:01.215 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2023-10-16T13:14:01.215 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2023-10-16T13:14:01.215 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2023-10-16T13:14:01.215 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2023-10-16T13:14:01.216 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2023-10-16T13:14:01.216 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2023-10-16T13:14:01.216 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2023-10-16T13:14:01.216 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2023-10-16T13:14:01.216 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2023-10-16T13:14:01.217 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2023-10-16T13:14:01.217 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2023-10-16T13:14:01.217 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2023-10-16T13:14:01.217 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2023-10-16T13:14:01.217 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2023-10-16T13:14:01.217 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2023-10-16T13:14:01.225 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2023-10-16T13:14:01.227 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2023-10-16T13:14:01.227 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2023-10-16T13:14:01.227 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2023-10-16T13:14:01.230 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2023-10-16T13:14:01.231 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2023-10-16T13:14:01.231 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2023-10-16T13:14:01.233 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2023-10-16T13:14:01.235 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2023-10-16T13:14:01.235 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2023-10-16T13:14:01.237 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2023-10-16T13:14:01.240 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2023-10-16T13:14:01.241 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2023-10-16T13:14:01.241 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2023-10-16T13:14:01.241 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2023-10-16T13:14:01.241 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2023-10-16T13:14:01.241 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2023-10-16T13:14:01.241 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2023-10-16T13:14:01.242 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2023-10-16T13:14:01.242 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2023-10-16T13:14:01.242 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2023-10-16T13:14:01.242 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2023-10-16T13:14:01.242 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2023-10-16T13:14:01.243 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2023-10-16T13:14:01.243 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2023-10-16T13:14:01.243 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2023-10-16T13:14:01.243 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2023-10-16T13:14:01.243 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2023-10-16T13:14:01.244 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2023-10-16T13:14:01.244 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2023-10-16T13:14:01.244 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2023-10-16T13:14:01.244 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2023-10-16T13:14:01.244 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2023-10-16T13:14:01.244 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2023-10-16T13:14:01.245 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2023-10-16T13:14:01.245 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2023-10-16T13:14:01.245 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2023-10-16T13:14:01.245 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2023-10-16T13:14:01.275 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2023-10-16T13:14:01.286 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2023-10-16T13:14:01.287 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2023-10-16T13:14:01.287 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2023-10-16T13:14:01.287 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2023-10-16T13:14:01.287 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2023-10-16T13:14:01.287 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2023-10-16T13:14:01.288 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2023-10-16T13:14:01.288 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2023-10-16T13:14:01.288 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2023-10-16T13:14:01.288 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2023-10-16T13:14:01.288 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2023-10-16T13:14:01.289 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2023-10-16T13:14:01.289 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2023-10-16T13:14:01.289 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2023-10-16T13:14:01.289 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2023-10-16T13:14:01.289 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2023-10-16T13:14:01.289 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2023-10-16T13:14:01.290 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2023-10-16T13:14:01.290 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2023-10-16T13:14:01.290 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2023-10-16T13:14:01.334 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2023-10-16T13:14:01.538 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2023-10-16T13:14:01.538 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2023-10-16T13:14:01.539 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2023-10-16T13:14:01.539 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2023-10-16T13:14:01.539 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2023-10-16T13:14:01.539 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2023-10-16T13:14:01.539 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2023-10-16T13:14:01.540 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2023-10-16T13:14:01.540 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2023-10-16T13:14:01.540 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2023-10-16T13:14:01.540 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2023-10-16T13:14:01.540 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2023-10-16T13:14:01.541 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2023-10-16T13:14:01.541 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2023-10-16T13:14:01.541 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2023-10-16T13:14:01.541 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2023-10-16T13:14:01.541 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2023-10-16T13:14:01.542 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2023-10-16T13:14:01.542 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2023-10-16T13:14:01.542 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2023-10-16T13:14:02.182 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2023-10-16T13:14:02.185 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2023-10-16T13:14:02.185 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2023-10-16T13:14:02.186 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2023-10-16T13:14:02.186 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2023-10-16T13:14:02.186 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2023-10-16T13:14:02.186 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2023-10-16T13:14:02.186 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2023-10-16T13:14:02.187 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2023-10-16T13:14:02.187 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2023-10-16T13:14:02.187 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2023-10-16T13:14:02.187 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2023-10-16T13:14:02.187 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2023-10-16T13:14:02.188 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2023-10-16T13:14:02.188 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2023-10-16T13:14:02.188 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2023-10-16T13:14:02.188 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2023-10-16T13:14:02.188 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2023-10-16T13:14:02.189 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2023-10-16T13:14:02.189 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2023-10-16T13:14:02.189 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2023-10-16T13:14:02.189 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2023-10-16T13:14:02.189 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2023-10-16T13:14:02.190 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2023-10-16T13:14:02.190 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2023-10-16T13:14:02.190 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2023-10-16T13:14:02.190 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2023-10-16T13:14:02.193 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2023-10-16T13:14:02.193 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2023-10-16T13:14:02.193 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2023-10-16T13:14:02.194 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2023-10-16T13:14:02.194 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2023-10-16T13:14:02.194 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2023-10-16T13:14:02.194 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2023-10-16T13:14:02.194 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2023-10-16T13:14:02.195 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2023-10-16T13:14:02.195 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2023-10-16T13:14:02.195 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2023-10-16T13:14:02.195 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2023-10-16T13:14:02.195 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2023-10-16T13:14:02.196 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2023-10-16T13:14:02.196 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2023-10-16T13:14:02.196 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2023-10-16T13:14:02.196 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2023-10-16T13:14:02.196 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2023-10-16T13:14:02.197 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2023-10-16T13:14:02.197 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2023-10-16T13:14:02.197 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2023-10-16T13:14:02.197 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2023-10-16T13:14:02.197 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2023-10-16T13:14:02.197 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2023-10-16T13:14:02.198 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2023-10-16T13:14:02.198 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2023-10-16T13:14:02.198 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2023-10-16T13:14:02.198 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2023-10-16T13:14:02.198 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2023-10-16T13:14:02.199 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2023-10-16T13:14:02.199 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2023-10-16T13:14:02.212 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2023-10-16T13:14:02.214 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2023-10-16T13:14:02.214 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2023-10-16T13:14:02.214 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2023-10-16T13:14:02.215 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2023-10-16T13:14:02.215 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2023-10-16T13:14:02.215 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2023-10-16T13:14:02.215 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2023-10-16T13:14:02.218 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2023-10-16T13:14:02.219 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2023-10-16T13:14:02.219 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2023-10-16T13:14:02.219 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2023-10-16T13:14:02.220 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2023-10-16T13:14:02.220 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2023-10-16T13:14:02.220 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2023-10-16T13:14:02.220 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2023-10-16T13:14:02.223 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2023-10-16T13:14:02.224 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2023-10-16T13:14:02.225 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2023-10-16T13:14:02.225 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2023-10-16T13:14:02.225 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2023-10-16T13:14:02.226 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2023-10-16T13:14:02.228 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2023-10-16T13:14:02.229 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2023-10-16T13:14:02.229 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2023-10-16T13:14:02.229 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2023-10-16T13:14:02.229 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2023-10-16T13:14:02.230 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2023-10-16T13:14:02.230 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2023-10-16T13:14:02.230 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2023-10-16T13:14:02.230 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2023-10-16T13:14:02.230 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2023-10-16T13:14:02.231 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2023-10-16T13:14:02.231 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2023-10-16T13:14:02.231 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2023-10-16T13:14:02.231 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2023-10-16T13:14:02.231 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2023-10-16T13:14:02.236 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2023-10-16T13:14:02.236 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2023-10-16T13:14:02.238 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2023-10-16T13:14:02.239 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2023-10-16T13:14:02.239 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2023-10-16T13:14:02.239 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2023-10-16T13:14:02.239 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2023-10-16T13:14:02.239 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2023-10-16T13:14:02.239 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2023-10-16T13:14:02.242 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2023-10-16T13:14:02.243 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2023-10-16T13:14:02.243 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2023-10-16T13:14:02.244 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2023-10-16T13:14:02.245 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2023-10-16T13:14:02.246 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2023-10-16T13:14:02.247 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2023-10-16T13:14:02.249 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2023-10-16T13:14:02.249 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2023-10-16T13:14:02.249 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2023-10-16T13:14:02.249 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2023-10-16T13:14:02.249 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2023-10-16T13:14:02.250 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2023-10-16T13:14:02.250 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2023-10-16T13:14:02.252 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2023-10-16T13:14:02.256 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2023-10-16T13:14:02.256 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2023-10-16T13:14:02.257 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2023-10-16T13:14:02.257 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2023-10-16T13:14:02.257 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2023-10-16T13:14:02.257 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2023-10-16T13:14:02.257 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2023-10-16T13:14:02.258 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2023-10-16T13:14:02.258 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2023-10-16T13:14:02.258 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2023-10-16T13:14:02.258 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2023-10-16T13:14:02.258 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2023-10-16T13:14:02.258 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2023-10-16T13:14:02.259 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2023-10-16T13:14:02.259 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2023-10-16T13:14:02.259 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2023-10-16T13:14:02.259 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2023-10-16T13:14:02.259 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2023-10-16T13:14:02.260 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2023-10-16T13:14:02.260 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2023-10-16T13:14:02.260 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2023-10-16T13:14:02.260 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2023-10-16T13:14:02.260 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2023-10-16T13:14:02.261 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2023-10-16T13:14:02.261 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2023-10-16T13:14:02.261 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2023-10-16T13:14:02.261 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2023-10-16T13:14:02.261 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2023-10-16T13:14:02.261 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2023-10-16T13:14:02.262 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2023-10-16T13:14:02.262 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2023-10-16T13:14:02.269 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2023-10-16T13:14:02.270 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2023-10-16T13:14:02.271 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2023-10-16T13:14:02.272 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2023-10-16T13:14:02.273 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2023-10-16T13:14:02.274 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2023-10-16T13:14:02.277 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2023-10-16T13:14:02.278 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2023-10-16T13:14:02.278 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2023-10-16T13:14:02.278 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2023-10-16T13:14:02.278 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2023-10-16T13:14:02.278 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2023-10-16T13:14:02.279 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2023-10-16T13:14:02.279 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2023-10-16T13:14:02.279 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2023-10-16T13:14:02.279 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2023-10-16T13:14:02.279 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2023-10-16T13:14:02.280 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2023-10-16T13:14:02.280 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2023-10-16T13:14:02.280 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2023-10-16T13:14:02.280 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2023-10-16T13:14:02.280 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2023-10-16T13:14:02.280 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2023-10-16T13:14:02.281 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2023-10-16T13:14:02.281 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2023-10-16T13:14:02.281 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2023-10-16T13:14:02.281 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2023-10-16T13:14:02.281 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2023-10-16T13:14:02.282 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2023-10-16T13:14:02.282 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2023-10-16T13:14:02.282 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2023-10-16T13:14:02.282 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2023-10-16T13:14:02.282 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2023-10-16T13:14:02.283 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2023-10-16T13:14:02.290 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2023-10-16T13:14:02.291 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2023-10-16T13:14:02.292 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2023-10-16T13:14:02.296 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2023-10-16T13:14:02.297 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2023-10-16T13:14:02.297 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2023-10-16T13:14:02.297 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2023-10-16T13:14:02.297 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2023-10-16T13:14:02.297 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2023-10-16T13:14:02.298 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2023-10-16T13:14:02.298 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2023-10-16T13:14:02.298 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2023-10-16T13:14:02.298 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2023-10-16T13:14:02.298 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2023-10-16T13:14:02.299 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2023-10-16T13:14:02.299 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2023-10-16T13:14:02.299 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2023-10-16T13:14:02.299 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2023-10-16T13:14:02.299 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2023-10-16T13:14:02.300 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2023-10-16T13:14:02.300 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2023-10-16T13:14:02.300 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2023-10-16T13:14:02.300 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2023-10-16T13:14:02.300 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2023-10-16T13:14:02.301 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2023-10-16T13:14:02.301 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2023-10-16T13:14:02.301 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2023-10-16T13:14:02.301 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2023-10-16T13:14:02.301 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2023-10-16T13:14:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2023-10-16T13:14:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2023-10-16T13:14:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2023-10-16T13:14:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2023-10-16T13:14:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2023-10-16T13:14:02.303 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2023-10-16T13:14:02.303 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2023-10-16T13:14:02.303 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2023-10-16T13:14:02.303 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2023-10-16T13:14:02.303 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2023-10-16T13:14:02.304 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2023-10-16T13:14:02.304 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2023-10-16T13:14:02.313 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2023-10-16T13:14:02.314 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2023-10-16T13:14:02.315 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2023-10-16T13:14:02.317 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2023-10-16T13:14:02.317 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2023-10-16T13:14:02.317 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2023-10-16T13:14:02.318 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2023-10-16T13:14:02.318 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2023-10-16T13:14:02.318 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2023-10-16T13:14:02.318 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2023-10-16T13:14:02.319 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2023-10-16T13:14:02.319 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2023-10-16T13:14:02.321 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2023-10-16T13:14:02.322 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2023-10-16T13:14:02.323 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2023-10-16T13:14:02.323 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2023-10-16T13:14:02.324 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2023-10-16T13:14:02.328 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2023-10-16T13:14:02.328 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2023-10-16T13:14:02.328 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2023-10-16T13:14:02.328 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2023-10-16T13:14:02.328 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2023-10-16T13:14:02.329 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2023-10-16T13:14:02.329 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2023-10-16T13:14:02.329 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2023-10-16T13:14:02.329 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2023-10-16T13:14:02.329 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2023-10-16T13:14:02.330 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2023-10-16T13:14:02.330 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2023-10-16T13:14:02.330 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2023-10-16T13:14:02.330 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2023-10-16T13:14:02.330 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2023-10-16T13:14:02.331 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2023-10-16T13:14:02.331 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2023-10-16T13:14:02.331 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2023-10-16T13:14:02.331 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2023-10-16T13:14:02.331 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2023-10-16T13:14:02.332 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2023-10-16T13:14:02.332 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2023-10-16T13:14:02.332 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2023-10-16T13:14:02.332 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2023-10-16T13:14:02.332 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2023-10-16T13:14:02.333 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2023-10-16T13:14:02.333 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2023-10-16T13:14:02.333 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2023-10-16T13:14:02.333 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2023-10-16T13:14:02.333 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2023-10-16T13:14:02.341 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2023-10-16T13:14:02.342 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2023-10-16T13:14:02.343 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2023-10-16T13:14:02.344 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2023-10-16T13:14:02.348 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2023-10-16T13:14:02.348 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2023-10-16T13:14:02.349 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2023-10-16T13:14:02.349 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2023-10-16T13:14:02.349 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2023-10-16T13:14:02.349 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2023-10-16T13:14:02.349 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2023-10-16T13:14:02.349 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2023-10-16T13:14:02.350 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2023-10-16T13:14:02.350 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2023-10-16T13:14:02.350 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2023-10-16T13:14:02.350 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2023-10-16T13:14:02.351 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2023-10-16T13:14:02.351 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2023-10-16T13:14:02.351 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2023-10-16T13:14:02.351 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2023-10-16T13:14:02.351 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2023-10-16T13:14:02.351 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2023-10-16T13:14:02.352 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2023-10-16T13:14:02.352 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2023-10-16T13:14:02.352 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2023-10-16T13:14:02.352 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2023-10-16T13:14:02.352 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2023-10-16T13:14:02.353 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2023-10-16T13:14:02.353 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2023-10-16T13:14:02.353 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2023-10-16T13:14:02.353 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2023-10-16T13:14:02.353 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2023-10-16T13:14:02.354 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2023-10-16T13:14:02.354 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2023-10-16T13:14:02.354 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2023-10-16T13:14:02.354 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2023-10-16T13:14:02.354 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2023-10-16T13:14:02.355 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2023-10-16T13:14:02.355 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2023-10-16T13:14:02.355 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2023-10-16T13:14:02.365 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2023-10-16T13:14:02.366 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2023-10-16T13:14:02.367 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2023-10-16T13:14:02.367 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2023-10-16T13:14:02.367 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2023-10-16T13:14:02.369 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2023-10-16T13:14:02.370 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2023-10-16T13:14:02.371 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2023-10-16T13:14:02.371 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2023-10-16T13:14:02.371 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2023-10-16T13:14:02.372 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2023-10-16T13:14:02.373 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2023-10-16T13:14:02.375 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2023-10-16T13:14:02.376 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2023-10-16T13:14:02.377 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2023-10-16T13:14:02.377 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2023-10-16T13:14:02.378 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2023-10-16T13:14:02.391 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2023-10-16T13:14:02.391 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2023-10-16T13:14:02.391 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2023-10-16T13:14:02.392 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2023-10-16T13:14:02.392 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2023-10-16T13:14:02.392 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2023-10-16T13:14:02.392 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2023-10-16T13:14:02.392 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2023-10-16T13:14:02.393 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2023-10-16T13:14:02.393 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2023-10-16T13:14:02.393 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2023-10-16T13:14:02.393 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2023-10-16T13:14:02.393 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2023-10-16T13:14:02.393 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2023-10-16T13:14:02.394 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2023-10-16T13:14:02.394 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2023-10-16T13:14:02.394 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2023-10-16T13:14:02.394 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2023-10-16T13:14:02.394 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2023-10-16T13:14:02.395 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2023-10-16T13:14:02.395 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2023-10-16T13:14:02.395 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2023-10-16T13:14:02.395 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2023-10-16T13:14:02.395 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2023-10-16T13:14:02.396 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2023-10-16T13:14:02.396 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2023-10-16T13:14:02.396 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2023-10-16T13:14:02.396 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2023-10-16T13:14:02.396 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2023-10-16T13:14:02.396 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2023-10-16T13:14:02.397 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2023-10-16T13:14:02.397 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2023-10-16T13:14:02.397 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2023-10-16T13:14:02.397 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2023-10-16T13:14:02.397 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2023-10-16T13:14:02.398 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2023-10-16T13:14:02.398 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2023-10-16T13:14:02.398 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2023-10-16T13:14:02.398 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2023-10-16T13:14:02.399 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2023-10-16T13:14:02.399 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2023-10-16T13:14:02.399 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2023-10-16T13:14:02.399 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2023-10-16T13:14:02.399 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2023-10-16T13:14:02.400 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2023-10-16T13:14:02.400 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2023-10-16T13:14:02.400 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2023-10-16T13:14:02.400 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2023-10-16T13:14:02.400 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2023-10-16T13:14:02.400 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2023-10-16T13:14:02.401 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2023-10-16T13:14:02.401 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2023-10-16T13:14:02.401 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2023-10-16T13:14:02.401 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2023-10-16T13:14:02.401 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2023-10-16T13:14:02.402 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2023-10-16T13:14:02.402 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2023-10-16T13:14:02.402 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2023-10-16T13:14:02.402 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2023-10-16T13:14:02.402 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2023-10-16T13:14:02.403 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2023-10-16T13:14:02.403 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2023-10-16T13:14:02.403 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2023-10-16T13:14:02.403 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2023-10-16T13:14:02.403 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2023-10-16T13:14:02.404 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2023-10-16T13:14:02.404 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2023-10-16T13:14:02.404 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2023-10-16T13:14:02.404 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2023-10-16T13:14:02.404 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2023-10-16T13:14:02.405 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2023-10-16T13:14:02.405 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2023-10-16T13:14:02.405 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2023-10-16T13:14:02.405 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2023-10-16T13:14:02.405 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2023-10-16T13:14:02.406 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2023-10-16T13:14:02.406 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2023-10-16T13:14:02.406 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2023-10-16T13:14:02.406 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2023-10-16T13:14:02.406 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2023-10-16T13:14:02.407 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2023-10-16T13:14:02.407 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2023-10-16T13:14:02.407 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2023-10-16T13:14:02.407 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2023-10-16T13:14:02.407 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2023-10-16T13:14:02.408 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2023-10-16T13:14:02.408 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2023-10-16T13:14:02.408 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2023-10-16T13:14:02.408 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2023-10-16T13:14:02.409 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2023-10-16T13:14:02.409 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2023-10-16T13:14:02.409 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2023-10-16T13:14:02.409 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2023-10-16T13:14:02.409 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2023-10-16T13:14:02.409 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2023-10-16T13:14:02.410 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2023-10-16T13:14:02.410 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2023-10-16T13:14:02.410 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2023-10-16T13:14:02.410 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2023-10-16T13:14:02.411 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2023-10-16T13:14:02.411 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2023-10-16T13:14:02.411 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2023-10-16T13:14:02.411 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2023-10-16T13:14:02.411 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2023-10-16T13:14:02.412 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2023-10-16T13:14:02.412 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2023-10-16T13:14:02.412 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2023-10-16T13:14:02.412 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2023-10-16T13:14:02.412 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2023-10-16T13:14:02.413 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2023-10-16T13:14:02.413 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2023-10-16T13:14:02.413 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2023-10-16T13:14:02.413 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2023-10-16T13:14:02.413 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2023-10-16T13:14:02.413 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2023-10-16T13:14:02.414 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2023-10-16T13:14:02.414 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2023-10-16T13:14:02.414 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2023-10-16T13:14:02.414 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2023-10-16T13:14:02.415 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2023-10-16T13:14:02.415 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2023-10-16T13:14:02.415 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2023-10-16T13:14:02.415 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2023-10-16T13:14:02.416 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2023-10-16T13:14:02.416 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2023-10-16T13:14:02.416 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2023-10-16T13:14:02.416 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2023-10-16T13:14:02.416 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2023-10-16T13:14:02.449 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2023-10-16T13:14:02.453 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2023-10-16T13:14:02.453 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2023-10-16T13:14:02.453 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2023-10-16T13:14:02.453 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2023-10-16T13:14:02.454 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2023-10-16T13:14:02.454 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2023-10-16T13:14:02.454 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2023-10-16T13:14:02.454 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2023-10-16T13:14:02.454 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2023-10-16T13:14:02.455 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2023-10-16T13:14:02.455 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2023-10-16T13:14:02.455 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2023-10-16T13:14:02.455 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2023-10-16T13:14:02.455 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2023-10-16T13:14:02.456 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2023-10-16T13:14:02.456 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2023-10-16T13:14:02.456 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2023-10-16T13:14:02.456 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2023-10-16T13:14:02.456 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2023-10-16T13:14:02.457 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2023-10-16T13:14:02.457 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2023-10-16T13:14:02.457 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2023-10-16T13:14:02.457 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2023-10-16T13:14:02.457 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2023-10-16T13:14:02.457 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2023-10-16T13:14:02.458 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2023-10-16T13:14:02.458 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2023-10-16T13:14:02.458 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2023-10-16T13:14:02.458 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2023-10-16T13:14:02.458 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2023-10-16T13:14:02.459 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2023-10-16T13:14:02.459 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2023-10-16T13:14:02.459 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2023-10-16T13:14:02.459 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2023-10-16T13:14:02.459 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2023-10-16T13:14:02.460 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2023-10-16T13:14:02.460 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2023-10-16T13:14:02.481 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2023-10-16T13:14:02.482 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2023-10-16T13:14:02.482 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2023-10-16T13:14:02.484 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2023-10-16T13:14:02.485 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2023-10-16T13:14:02.486 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2023-10-16T13:14:02.488 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2023-10-16T13:14:02.488 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2023-10-16T13:14:02.489 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2023-10-16T13:14:02.489 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2023-10-16T13:14:02.491 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2023-10-16T13:14:02.493 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2023-10-16T13:14:02.494 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2023-10-16T13:14:02.494 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2023-10-16T13:14:02.494 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2023-10-16T13:14:02.494 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2023-10-16T13:14:02.494 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2023-10-16T13:14:02.495 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2023-10-16T13:14:02.495 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2023-10-16T13:14:02.495 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2023-10-16T13:14:02.495 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2023-10-16T13:14:02.495 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2023-10-16T13:14:02.496 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2023-10-16T13:14:02.496 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2023-10-16T13:14:02.503 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2023-10-16T13:14:02.506 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2023-10-16T13:14:02.507 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2023-10-16T13:14:02.507 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2023-10-16T13:14:02.507 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2023-10-16T13:14:02.507 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2023-10-16T13:14:02.508 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2023-10-16T13:14:02.508 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2023-10-16T13:14:02.508 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2023-10-16T13:14:02.508 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2023-10-16T13:14:02.508 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2023-10-16T13:14:02.509 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2023-10-16T13:14:02.509 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2023-10-16T13:14:02.509 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2023-10-16T13:14:02.509 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2023-10-16T13:14:02.509 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2023-10-16T13:14:02.510 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2023-10-16T13:14:02.510 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2023-10-16T13:14:02.510 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2023-10-16T13:14:02.510 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2023-10-16T13:14:02.510 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2023-10-16T13:14:02.511 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2023-10-16T13:14:02.511 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2023-10-16T13:14:02.511 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2023-10-16T13:14:02.511 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2023-10-16T13:14:02.511 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2023-10-16T13:14:02.524 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2023-10-16T13:14:02.525 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2023-10-16T13:14:02.525 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2023-10-16T13:14:02.527 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2023-10-16T13:14:02.532 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2023-10-16T13:14:02.532 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2023-10-16T13:14:02.532 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2023-10-16T13:14:02.533 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2023-10-16T13:14:02.533 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2023-10-16T13:14:02.533 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2023-10-16T13:14:02.533 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2023-10-16T13:14:02.533 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2023-10-16T13:14:02.534 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2023-10-16T13:14:02.534 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2023-10-16T13:14:02.534 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2023-10-16T13:14:02.534 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2023-10-16T13:14:02.534 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2023-10-16T13:14:02.534 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2023-10-16T13:14:02.535 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2023-10-16T13:14:02.535 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2023-10-16T13:14:02.535 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2023-10-16T13:14:02.535 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2023-10-16T13:14:02.535 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2023-10-16T13:14:02.536 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2023-10-16T13:14:02.536 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2023-10-16T13:14:02.536 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2023-10-16T13:14:02.536 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2023-10-16T13:14:02.536 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2023-10-16T13:14:02.537 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2023-10-16T13:14:02.537 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2023-10-16T13:14:02.537 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2023-10-16T13:14:02.537 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2023-10-16T13:14:02.537 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2023-10-16T13:14:02.538 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2023-10-16T13:14:02.538 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2023-10-16T13:14:02.538 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2023-10-16T13:14:02.538 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2023-10-16T13:14:02.538 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2023-10-16T13:14:02.539 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2023-10-16T13:14:02.539 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2023-10-16T13:14:02.539 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2023-10-16T13:14:02.539 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2023-10-16T13:14:02.539 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2023-10-16T13:14:02.539 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2023-10-16T13:14:02.540 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2023-10-16T13:14:02.540 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2023-10-16T13:14:02.540 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2023-10-16T13:14:02.540 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2023-10-16T13:14:02.540 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2023-10-16T13:14:02.564 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2023-10-16T13:14:02.566 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2023-10-16T13:14:02.566 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2023-10-16T13:14:02.566 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2023-10-16T13:14:02.566 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2023-10-16T13:14:02.567 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2023-10-16T13:14:02.570 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2023-10-16T13:14:02.571 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2023-10-16T13:14:02.572 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2023-10-16T13:14:02.572 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2023-10-16T13:14:02.572 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2023-10-16T13:14:02.572 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2023-10-16T13:14:02.572 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2023-10-16T13:14:02.576 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2023-10-16T13:14:02.581 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2023-10-16T13:14:02.582 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2023-10-16T13:14:02.582 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2023-10-16T13:14:02.582 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2023-10-16T13:14:02.582 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2023-10-16T13:14:02.582 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2023-10-16T13:14:02.583 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2023-10-16T13:14:02.583 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2023-10-16T13:14:02.583 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2023-10-16T13:14:02.583 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2023-10-16T13:14:02.583 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2023-10-16T13:14:02.583 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2023-10-16T13:14:02.584 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2023-10-16T13:14:02.584 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2023-10-16T13:14:02.584 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2023-10-16T13:14:02.584 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2023-10-16T13:14:02.584 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2023-10-16T13:14:02.585 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2023-10-16T13:14:02.585 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2023-10-16T13:14:02.585 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2023-10-16T13:14:02.585 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2023-10-16T13:14:02.585 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2023-10-16T13:14:02.585 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2023-10-16T13:14:02.586 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2023-10-16T13:14:02.586 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2023-10-16T13:14:02.586 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2023-10-16T13:14:02.586 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2023-10-16T13:14:02.586 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2023-10-16T13:14:02.587 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2023-10-16T13:14:02.587 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2023-10-16T13:14:02.587 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2023-10-16T13:14:02.587 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2023-10-16T13:14:02.587 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2023-10-16T13:14:02.588 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2023-10-16T13:14:02.588 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2023-10-16T13:14:02.588 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2023-10-16T13:14:02.588 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2023-10-16T13:14:02.588 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2023-10-16T13:14:02.588 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2023-10-16T13:14:02.589 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2023-10-16T13:14:02.589 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2023-10-16T13:14:02.589 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2023-10-16T13:14:02.589 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2023-10-16T13:14:02.589 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2023-10-16T13:14:02.615 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2023-10-16T13:14:02.616 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2023-10-16T13:14:02.618 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2023-10-16T13:14:02.620 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2023-10-16T13:14:02.620 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2023-10-16T13:14:02.620 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2023-10-16T13:14:02.623 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2023-10-16T13:14:02.626 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2023-10-16T13:14:02.626 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2023-10-16T13:14:02.626 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2023-10-16T13:14:02.627 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2023-10-16T13:14:02.627 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2023-10-16T13:14:02.627 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2023-10-16T13:14:02.628 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2023-10-16T13:14:02.628 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2023-10-16T13:14:02.628 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2023-10-16T13:14:02.629 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2023-10-16T13:14:02.629 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2023-10-16T13:14:02.629 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2023-10-16T13:14:02.630 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2023-10-16T13:14:02.630 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2023-10-16T13:14:02.630 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2023-10-16T13:14:02.630 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2023-10-16T13:14:02.630 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2023-10-16T13:14:02.631 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2023-10-16T13:14:02.631 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2023-10-16T13:14:02.631 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2023-10-16T13:14:02.631 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2023-10-16T13:14:02.631 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2023-10-16T13:14:02.631 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2023-10-16T13:14:02.632 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2023-10-16T13:14:02.632 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2023-10-16T13:14:02.632 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2023-10-16T13:14:02.647 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2023-10-16T13:14:02.649 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2023-10-16T13:14:02.649 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2023-10-16T13:14:02.649 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2023-10-16T13:14:02.650 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2023-10-16T13:14:02.651 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2023-10-16T13:14:02.654 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2023-10-16T13:14:02.654 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2023-10-16T13:14:02.655 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2023-10-16T13:14:02.655 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2023-10-16T13:14:02.656 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2023-10-16T13:14:02.656 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2023-10-16T13:14:02.656 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2023-10-16T13:14:02.657 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/digsig.txt 2023-10-16T13:14:02.657 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2023-10-16T13:14:02.658 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dmaengine/ 2023-10-16T13:14:02.662 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2023-10-16T13:14:02.664 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2023-10-16T13:14:02.664 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2023-10-16T13:14:02.665 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2023-10-16T13:14:02.665 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dontdiff 2023-10-16T13:14:02.665 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/driver-model/ 2023-10-16T13:14:02.668 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2023-10-16T13:14:02.670 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2023-10-16T13:14:02.670 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2023-10-16T13:14:02.671 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2023-10-16T13:14:02.671 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2023-10-16T13:14:02.671 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2023-10-16T13:14:02.671 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2023-10-16T13:14:02.671 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2023-10-16T13:14:02.672 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2023-10-16T13:14:02.672 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2023-10-16T13:14:02.672 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dvb/ 2023-10-16T13:14:02.676 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2023-10-16T13:14:02.678 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2023-10-16T13:14:02.678 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2023-10-16T13:14:02.679 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2023-10-16T13:14:02.679 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2023-10-16T13:14:02.679 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2023-10-16T13:14:02.680 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2023-10-16T13:14:02.680 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2023-10-16T13:14:02.681 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2023-10-16T13:14:02.681 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2023-10-16T13:14:02.681 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2023-10-16T13:14:02.681 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2023-10-16T13:14:02.682 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2023-10-16T13:14:02.682 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2023-10-16T13:14:02.683 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2023-10-16T13:14:02.683 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/early-userspace/ 2023-10-16T13:14:02.688 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/early-userspace/README 2023-10-16T13:14:02.691 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2023-10-16T13:14:02.691 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/edac.txt 2023-10-16T13:14:02.691 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/efi-stub.txt 2023-10-16T13:14:02.692 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/eisa.txt 2023-10-16T13:14:02.692 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/email-clients.txt 2023-10-16T13:14:02.692 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/extcon/ 2023-10-16T13:14:02.695 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2023-10-16T13:14:02.696 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fault-injection/ 2023-10-16T13:14:02.697 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2023-10-16T13:14:02.699 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2023-10-16T13:14:02.699 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2023-10-16T13:14:02.699 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/ 2023-10-16T13:14:02.701 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2023-10-16T13:14:02.706 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/api.txt 2023-10-16T13:14:02.706 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2023-10-16T13:14:02.706 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2023-10-16T13:14:02.706 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2023-10-16T13:14:02.707 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2023-10-16T13:14:02.707 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2023-10-16T13:14:02.707 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2023-10-16T13:14:02.707 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2023-10-16T13:14:02.707 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2023-10-16T13:14:02.708 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2023-10-16T13:14:02.708 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2023-10-16T13:14:02.708 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2023-10-16T13:14:02.708 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2023-10-16T13:14:02.708 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/internals.txt 2023-10-16T13:14:02.708 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2023-10-16T13:14:02.709 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2023-10-16T13:14:02.709 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2023-10-16T13:14:02.709 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2023-10-16T13:14:02.709 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2023-10-16T13:14:02.709 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2023-10-16T13:14:02.709 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2023-10-16T13:14:02.710 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2023-10-16T13:14:02.710 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2023-10-16T13:14:02.710 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2023-10-16T13:14:02.710 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2023-10-16T13:14:02.710 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2023-10-16T13:14:02.711 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2023-10-16T13:14:02.711 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2023-10-16T13:14:02.711 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2023-10-16T13:14:02.711 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2023-10-16T13:14:02.711 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2023-10-16T13:14:02.712 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2023-10-16T13:14:02.712 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2023-10-16T13:14:02.712 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2023-10-16T13:14:02.712 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/ 2023-10-16T13:14:02.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:02 smithi092 ceph-mon[99542]: pgmap v328: 97 pgs: 97 active+clean; 3.0 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 205 KiB/s wr, 16 op/s 2023-10-16T13:14:02.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:02 smithi118 ceph-mon[103969]: pgmap v328: 97 pgs: 97 active+clean; 3.0 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 205 KiB/s wr, 16 op/s 2023-10-16T13:14:02.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:02 smithi152 ceph-mon[104423]: pgmap v328: 97 pgs: 97 active+clean; 3.0 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 205 KiB/s wr, 16 op/s 2023-10-16T13:14:03.169 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2023-10-16T13:14:03.171 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2023-10-16T13:14:03.171 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2023-10-16T13:14:03.171 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/Locking 2023-10-16T13:14:03.171 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2023-10-16T13:14:03.171 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2023-10-16T13:14:03.172 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2023-10-16T13:14:03.172 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2023-10-16T13:14:03.172 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2023-10-16T13:14:03.172 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2023-10-16T13:14:03.172 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2023-10-16T13:14:03.172 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2023-10-16T13:14:03.173 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2023-10-16T13:14:03.173 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2023-10-16T13:14:03.173 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2023-10-16T13:14:03.177 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2023-10-16T13:14:03.179 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2023-10-16T13:14:03.179 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2023-10-16T13:14:03.179 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2023-10-16T13:14:03.179 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2023-10-16T13:14:03.179 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2023-10-16T13:14:03.180 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2023-10-16T13:14:03.180 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2023-10-16T13:14:03.181 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2023-10-16T13:14:03.182 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2023-10-16T13:14:03.182 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2023-10-16T13:14:03.183 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2023-10-16T13:14:03.184 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2023-10-16T13:14:03.184 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2023-10-16T13:14:03.184 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2023-10-16T13:14:03.184 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2023-10-16T13:14:03.186 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2023-10-16T13:14:03.188 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2023-10-16T13:14:03.188 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2023-10-16T13:14:03.189 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2023-10-16T13:14:03.189 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2023-10-16T13:14:03.189 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2023-10-16T13:14:03.189 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2023-10-16T13:14:03.189 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2023-10-16T13:14:03.190 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2023-10-16T13:14:03.190 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2023-10-16T13:14:03.190 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2023-10-16T13:14:03.190 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2023-10-16T13:14:03.190 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2023-10-16T13:14:03.191 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2023-10-16T13:14:03.191 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2023-10-16T13:14:03.191 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2023-10-16T13:14:03.191 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2023-10-16T13:14:03.191 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2023-10-16T13:14:03.191 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2023-10-16T13:14:03.193 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2023-10-16T13:14:03.193 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2023-10-16T13:14:03.194 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2023-10-16T13:14:03.194 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2023-10-16T13:14:03.194 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2023-10-16T13:14:03.194 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2023-10-16T13:14:03.194 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2023-10-16T13:14:03.195 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2023-10-16T13:14:03.195 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2023-10-16T13:14:03.195 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2023-10-16T13:14:03.195 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2023-10-16T13:14:03.195 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2023-10-16T13:14:03.196 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2023-10-16T13:14:03.196 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2023-10-16T13:14:03.196 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2023-10-16T13:14:03.196 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2023-10-16T13:14:03.196 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2023-10-16T13:14:03.207 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2023-10-16T13:14:03.208 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2023-10-16T13:14:03.208 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2023-10-16T13:14:03.208 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2023-10-16T13:14:03.208 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2023-10-16T13:14:03.209 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2023-10-16T13:14:03.209 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2023-10-16T13:14:03.209 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2023-10-16T13:14:03.209 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2023-10-16T13:14:03.209 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2023-10-16T13:14:03.210 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2023-10-16T13:14:03.210 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2023-10-16T13:14:03.210 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2023-10-16T13:14:03.210 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2023-10-16T13:14:03.211 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2023-10-16T13:14:03.211 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2023-10-16T13:14:03.211 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2023-10-16T13:14:03.211 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2023-10-16T13:14:03.211 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2023-10-16T13:14:03.212 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2023-10-16T13:14:03.212 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2023-10-16T13:14:03.215 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2023-10-16T13:14:03.216 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2023-10-16T13:14:03.217 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2023-10-16T13:14:03.217 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/porting 2023-10-16T13:14:03.217 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2023-10-16T13:14:03.218 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2023-10-16T13:14:03.218 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2023-10-16T13:14:03.218 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2023-10-16T13:14:03.218 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2023-10-16T13:14:03.219 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2023-10-16T13:14:03.220 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2023-10-16T13:14:03.220 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2023-10-16T13:14:03.221 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2023-10-16T13:14:03.221 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2023-10-16T13:14:03.221 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2023-10-16T13:14:03.221 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2023-10-16T13:14:03.221 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2023-10-16T13:14:03.222 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2023-10-16T13:14:03.222 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2023-10-16T13:14:03.222 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2023-10-16T13:14:03.222 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2023-10-16T13:14:03.222 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2023-10-16T13:14:03.223 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2023-10-16T13:14:03.223 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2023-10-16T13:14:03.223 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2023-10-16T13:14:03.224 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2023-10-16T13:14:03.224 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2023-10-16T13:14:03.224 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/firmware_class/ 2023-10-16T13:14:03.229 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/firmware_class/README 2023-10-16T13:14:03.231 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2023-10-16T13:14:03.231 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2023-10-16T13:14:03.231 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fmc/ 2023-10-16T13:14:03.232 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2023-10-16T13:14:03.234 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fmc/API.txt 2023-10-16T13:14:03.234 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2023-10-16T13:14:03.234 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2023-10-16T13:14:03.234 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2023-10-16T13:14:03.235 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2023-10-16T13:14:03.235 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2023-10-16T13:14:03.235 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2023-10-16T13:14:03.235 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2023-10-16T13:14:03.235 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2023-10-16T13:14:03.236 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2023-10-16T13:14:03.236 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/frv/ 2023-10-16T13:14:03.239 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/frv/README.txt 2023-10-16T13:14:03.241 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2023-10-16T13:14:03.241 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/frv/booting.txt 2023-10-16T13:14:03.241 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/frv/clock.txt 2023-10-16T13:14:03.241 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2023-10-16T13:14:03.241 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/frv/features.txt 2023-10-16T13:14:03.242 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/frv/gdbinit 2023-10-16T13:14:03.242 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2023-10-16T13:14:03.242 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2023-10-16T13:14:03.242 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2023-10-16T13:14:03.242 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2023-10-16T13:14:03.243 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/gcov.txt 2023-10-16T13:14:03.243 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2023-10-16T13:14:03.243 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/gpio/ 2023-10-16T13:14:03.247 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2023-10-16T13:14:03.248 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/gpio/board.txt 2023-10-16T13:14:03.249 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2023-10-16T13:14:03.249 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2023-10-16T13:14:03.249 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2023-10-16T13:14:03.249 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2023-10-16T13:14:03.249 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2023-10-16T13:14:03.250 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hid/ 2023-10-16T13:14:03.252 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2023-10-16T13:14:03.254 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2023-10-16T13:14:03.254 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2023-10-16T13:14:03.254 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2023-10-16T13:14:03.254 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2023-10-16T13:14:03.255 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/highuid.txt 2023-10-16T13:14:03.255 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hsi.txt 2023-10-16T13:14:03.255 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hw_random.txt 2023-10-16T13:14:03.255 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ 2023-10-16T13:14:03.258 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2023-10-16T13:14:03.270 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2023-10-16T13:14:03.270 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2023-10-16T13:14:03.270 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2023-10-16T13:14:03.270 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/abx500 2023-10-16T13:14:03.271 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2023-10-16T13:14:03.271 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2023-10-16T13:14:03.271 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2023-10-16T13:14:03.271 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2023-10-16T13:14:03.271 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2023-10-16T13:14:03.272 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2023-10-16T13:14:03.272 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2023-10-16T13:14:03.272 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2023-10-16T13:14:03.272 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2023-10-16T13:14:03.272 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2023-10-16T13:14:03.272 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2023-10-16T13:14:03.273 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2023-10-16T13:14:03.273 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2023-10-16T13:14:03.273 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2023-10-16T13:14:03.273 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2023-10-16T13:14:03.273 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2023-10-16T13:14:03.274 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2023-10-16T13:14:03.274 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/asb100 2023-10-16T13:14:03.274 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2023-10-16T13:14:03.274 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2023-10-16T13:14:03.274 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/da9052 2023-10-16T13:14:03.274 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/da9055 2023-10-16T13:14:03.275 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2023-10-16T13:14:03.275 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2023-10-16T13:14:03.275 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ds620 2023-10-16T13:14:03.275 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2023-10-16T13:14:03.275 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2023-10-16T13:14:03.275 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2023-10-16T13:14:03.276 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2023-10-16T13:14:03.276 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2023-10-16T13:14:03.276 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2023-10-16T13:14:03.276 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/g760a 2023-10-16T13:14:03.276 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/g762 2023-10-16T13:14:03.276 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2023-10-16T13:14:03.277 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2023-10-16T13:14:03.277 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/htu21 2023-10-16T13:14:03.277 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2023-10-16T13:14:03.277 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2023-10-16T13:14:03.277 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2023-10-16T13:14:03.277 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ina209 2023-10-16T13:14:03.278 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2023-10-16T13:14:03.278 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/it87 2023-10-16T13:14:03.278 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/jc42 2023-10-16T13:14:03.278 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2023-10-16T13:14:03.278 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2023-10-16T13:14:03.279 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2023-10-16T13:14:03.279 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2023-10-16T13:14:03.279 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/lm63 2023-10-16T13:14:03.279 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/lm70 2023-10-16T13:14:03.279 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/lm73 2023-10-16T13:14:03.279 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/lm75 2023-10-16T13:14:03.280 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/lm77 2023-10-16T13:14:03.280 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/lm78 2023-10-16T13:14:03.280 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/lm80 2023-10-16T13:14:03.280 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/lm83 2023-10-16T13:14:03.280 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/lm85 2023-10-16T13:14:03.281 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/lm87 2023-10-16T13:14:03.281 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/lm90 2023-10-16T13:14:03.281 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/lm92 2023-10-16T13:14:03.281 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/lm93 2023-10-16T13:14:03.281 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2023-10-16T13:14:03.281 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2023-10-16T13:14:03.282 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2023-10-16T13:14:03.282 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2023-10-16T13:14:03.282 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2023-10-16T13:14:03.282 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2023-10-16T13:14:03.282 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2023-10-16T13:14:03.283 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2023-10-16T13:14:03.283 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2023-10-16T13:14:03.283 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/max16064 2023-10-16T13:14:03.283 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/max16065 2023-10-16T13:14:03.283 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/max1619 2023-10-16T13:14:03.283 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/max1668 2023-10-16T13:14:03.284 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/max197 2023-10-16T13:14:03.284 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/max34440 2023-10-16T13:14:03.284 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/max6639 2023-10-16T13:14:03.284 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/max6642 2023-10-16T13:14:03.284 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/max6650 2023-10-16T13:14:03.284 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/max6697 2023-10-16T13:14:03.285 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/max8688 2023-10-16T13:14:03.285 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2023-10-16T13:14:03.285 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2023-10-16T13:14:03.285 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2023-10-16T13:14:03.285 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2023-10-16T13:14:03.285 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2023-10-16T13:14:03.286 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2023-10-16T13:14:03.286 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2023-10-16T13:14:03.286 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2023-10-16T13:14:03.286 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2023-10-16T13:14:03.286 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2023-10-16T13:14:03.287 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2023-10-16T13:14:03.287 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2023-10-16T13:14:03.287 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2023-10-16T13:14:03.287 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2023-10-16T13:14:03.287 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2023-10-16T13:14:03.287 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2023-10-16T13:14:03.288 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/sht15 2023-10-16T13:14:03.288 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/sht21 2023-10-16T13:14:03.288 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2023-10-16T13:14:03.288 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2023-10-16T13:14:03.288 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/smm665 2023-10-16T13:14:03.288 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2023-10-16T13:14:03.289 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2023-10-16T13:14:03.289 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2023-10-16T13:14:03.289 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2023-10-16T13:14:03.289 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2023-10-16T13:14:03.289 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2023-10-16T13:14:03.289 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2023-10-16T13:14:03.290 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2023-10-16T13:14:03.290 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2023-10-16T13:14:03.290 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2023-10-16T13:14:03.290 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2023-10-16T13:14:03.290 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2023-10-16T13:14:03.291 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2023-10-16T13:14:03.291 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2023-10-16T13:14:03.291 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2023-10-16T13:14:03.291 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2023-10-16T13:14:03.291 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/via686a 2023-10-16T13:14:03.291 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2023-10-16T13:14:03.292 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2023-10-16T13:14:03.292 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2023-10-16T13:14:03.292 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2023-10-16T13:14:03.292 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2023-10-16T13:14:03.292 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2023-10-16T13:14:03.293 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/w83793 2023-10-16T13:14:03.293 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/w83795 2023-10-16T13:14:03.293 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2023-10-16T13:14:03.293 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2023-10-16T13:14:03.293 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2023-10-16T13:14:03.293 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2023-10-16T13:14:03.294 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2023-10-16T13:14:03.294 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2023-10-16T13:14:03.294 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/ 2023-10-16T13:14:03.322 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/ 2023-10-16T13:14:03.323 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2023-10-16T13:14:03.326 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2023-10-16T13:14:03.326 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2023-10-16T13:14:03.326 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2023-10-16T13:14:03.326 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2023-10-16T13:14:03.327 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2023-10-16T13:14:03.327 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2023-10-16T13:14:03.327 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2023-10-16T13:14:03.327 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2023-10-16T13:14:03.327 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2023-10-16T13:14:03.327 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2023-10-16T13:14:03.328 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2023-10-16T13:14:03.328 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2023-10-16T13:14:03.328 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2023-10-16T13:14:03.328 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2023-10-16T13:14:03.328 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2023-10-16T13:14:03.329 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2023-10-16T13:14:03.329 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2023-10-16T13:14:03.329 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2023-10-16T13:14:03.329 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2023-10-16T13:14:03.329 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2023-10-16T13:14:03.329 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2023-10-16T13:14:03.335 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2023-10-16T13:14:03.335 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/functionality 2023-10-16T13:14:03.336 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2023-10-16T13:14:03.336 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2023-10-16T13:14:03.336 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2023-10-16T13:14:03.336 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2023-10-16T13:14:03.338 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2023-10-16T13:14:03.340 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2023-10-16T13:14:03.340 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2023-10-16T13:14:03.340 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/summary 2023-10-16T13:14:03.340 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2023-10-16T13:14:03.341 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2023-10-16T13:14:03.341 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2023-10-16T13:14:03.341 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2o/ 2023-10-16T13:14:03.343 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2o/README 2023-10-16T13:14:03.344 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/i2o/ioctl 2023-10-16T13:14:03.345 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ia64/ 2023-10-16T13:14:03.346 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2023-10-16T13:14:03.348 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2023-10-16T13:14:03.348 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ia64/Makefile 2023-10-16T13:14:03.348 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ia64/README 2023-10-16T13:14:03.349 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2023-10-16T13:14:03.349 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2023-10-16T13:14:03.349 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2023-10-16T13:14:03.349 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2023-10-16T13:14:03.349 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2023-10-16T13:14:03.350 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2023-10-16T13:14:03.350 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2023-10-16T13:14:03.350 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2023-10-16T13:14:03.350 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ide/ 2023-10-16T13:14:03.353 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2023-10-16T13:14:03.355 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2023-10-16T13:14:03.355 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2023-10-16T13:14:03.355 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2023-10-16T13:14:03.355 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2023-10-16T13:14:03.356 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ide/ide.txt 2023-10-16T13:14:03.356 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2023-10-16T13:14:03.356 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/infiniband/ 2023-10-16T13:14:03.358 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2023-10-16T13:14:03.359 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2023-10-16T13:14:03.360 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2023-10-16T13:14:03.360 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2023-10-16T13:14:03.360 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2023-10-16T13:14:03.360 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/init.txt 2023-10-16T13:14:03.360 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/initrd.txt 2023-10-16T13:14:03.361 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/ 2023-10-16T13:14:03.363 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/alps.txt 2023-10-16T13:14:03.366 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2023-10-16T13:14:03.366 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2023-10-16T13:14:03.366 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2023-10-16T13:14:03.366 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2023-10-16T13:14:03.366 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/cd32.txt 2023-10-16T13:14:03.367 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2023-10-16T13:14:03.367 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2023-10-16T13:14:03.367 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2023-10-16T13:14:03.367 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/elantech.txt 2023-10-16T13:14:03.367 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2023-10-16T13:14:03.367 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/ff.txt 2023-10-16T13:14:03.368 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2023-10-16T13:14:03.368 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2023-10-16T13:14:03.368 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2023-10-16T13:14:03.368 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2023-10-16T13:14:03.368 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2023-10-16T13:14:03.368 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/input.txt 2023-10-16T13:14:03.369 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/interactive.fig 2023-10-16T13:14:03.369 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2023-10-16T13:14:03.369 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2023-10-16T13:14:03.370 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/joystick.txt 2023-10-16T13:14:03.371 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2023-10-16T13:14:03.371 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/notifier.txt 2023-10-16T13:14:03.371 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2023-10-16T13:14:03.371 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2023-10-16T13:14:03.372 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2023-10-16T13:14:03.372 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/shape.fig 2023-10-16T13:14:03.372 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2023-10-16T13:14:03.372 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/xpad.txt 2023-10-16T13:14:03.372 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/input/yealink.txt 2023-10-16T13:14:03.372 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/intel_txt.txt 2023-10-16T13:14:03.373 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/io-mapping.txt 2023-10-16T13:14:03.373 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/io_ordering.txt 2023-10-16T13:14:03.373 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ioctl/ 2023-10-16T13:14:03.381 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2023-10-16T13:14:03.382 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2023-10-16T13:14:03.382 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2023-10-16T13:14:03.383 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2023-10-16T13:14:03.383 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2023-10-16T13:14:03.383 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2023-10-16T13:14:03.383 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/iostats.txt 2023-10-16T13:14:03.383 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2023-10-16T13:14:03.384 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isapnp.txt 2023-10-16T13:14:03.384 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/ 2023-10-16T13:14:03.387 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2023-10-16T13:14:03.389 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2023-10-16T13:14:03.389 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2023-10-16T13:14:03.389 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2023-10-16T13:14:03.389 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2023-10-16T13:14:03.390 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2023-10-16T13:14:03.390 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/README 2023-10-16T13:14:03.390 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2023-10-16T13:14:03.390 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2023-10-16T13:14:03.390 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2023-10-16T13:14:03.391 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/README.audio 2023-10-16T13:14:03.391 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2023-10-16T13:14:03.391 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/README.concap 2023-10-16T13:14:03.391 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2023-10-16T13:14:03.392 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/README.fax 2023-10-16T13:14:03.392 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2023-10-16T13:14:03.393 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2023-10-16T13:14:03.393 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2023-10-16T13:14:03.393 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/README.icn 2023-10-16T13:14:03.394 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2023-10-16T13:14:03.394 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2023-10-16T13:14:03.394 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/README.sc 2023-10-16T13:14:03.394 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2023-10-16T13:14:03.394 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/README.x25 2023-10-16T13:14:03.395 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2023-10-16T13:14:03.395 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ja_JP/ 2023-10-16T13:14:03.400 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2023-10-16T13:14:03.401 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2023-10-16T13:14:03.401 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2023-10-16T13:14:03.402 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2023-10-16T13:14:03.402 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2023-10-16T13:14:03.403 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/java.txt 2023-10-16T13:14:03.403 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kasan.txt 2023-10-16T13:14:03.403 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kbuild/ 2023-10-16T13:14:03.405 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2023-10-16T13:14:03.406 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2023-10-16T13:14:03.407 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2023-10-16T13:14:03.407 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2023-10-16T13:14:03.407 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2023-10-16T13:14:03.407 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2023-10-16T13:14:03.408 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2023-10-16T13:14:03.408 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kdump/ 2023-10-16T13:14:03.410 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2023-10-16T13:14:03.411 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2023-10-16T13:14:03.411 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2023-10-16T13:14:03.411 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2023-10-16T13:14:03.411 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2023-10-16T13:14:03.414 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2023-10-16T13:14:03.414 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2023-10-16T13:14:03.414 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kmemleak.txt 2023-10-16T13:14:03.415 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ko_KR/ 2023-10-16T13:14:03.416 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2023-10-16T13:14:03.418 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2023-10-16T13:14:03.418 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kobject.txt 2023-10-16T13:14:03.418 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kprobes.txt 2023-10-16T13:14:03.418 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kref.txt 2023-10-16T13:14:03.418 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/kselftest.txt 2023-10-16T13:14:03.419 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/laptops/ 2023-10-16T13:14:03.421 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2023-10-16T13:14:03.423 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2023-10-16T13:14:03.423 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/laptops/Makefile 2023-10-16T13:14:03.423 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2023-10-16T13:14:03.424 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2023-10-16T13:14:03.424 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2023-10-16T13:14:03.424 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2023-10-16T13:14:03.424 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2023-10-16T13:14:03.424 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2023-10-16T13:14:03.424 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2023-10-16T13:14:03.425 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2023-10-16T13:14:03.425 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2023-10-16T13:14:03.425 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ldm.txt 2023-10-16T13:14:03.425 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/leds/ 2023-10-16T13:14:03.429 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2023-10-16T13:14:03.431 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2023-10-16T13:14:03.431 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2023-10-16T13:14:03.431 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2023-10-16T13:14:03.431 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2023-10-16T13:14:03.432 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2023-10-16T13:14:03.432 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2023-10-16T13:14:03.432 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2023-10-16T13:14:03.432 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2023-10-16T13:14:03.432 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2023-10-16T13:14:03.433 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2023-10-16T13:14:03.433 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/local_ops.txt 2023-10-16T13:14:03.433 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/locking/ 2023-10-16T13:14:03.437 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2023-10-16T13:14:03.438 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2023-10-16T13:14:03.439 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2023-10-16T13:14:03.439 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2023-10-16T13:14:03.439 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2023-10-16T13:14:03.439 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2023-10-16T13:14:03.439 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2023-10-16T13:14:03.440 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2023-10-16T13:14:03.440 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2023-10-16T13:14:03.440 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2023-10-16T13:14:03.440 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2023-10-16T13:14:03.441 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/logo.gif 2023-10-16T13:14:03.441 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/logo.txt 2023-10-16T13:14:03.441 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/lzo.txt 2023-10-16T13:14:03.441 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/m68k/ 2023-10-16T13:14:03.445 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2023-10-16T13:14:03.446 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2023-10-16T13:14:03.447 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2023-10-16T13:14:03.447 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/magic-number.txt 2023-10-16T13:14:03.447 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mailbox.txt 2023-10-16T13:14:03.447 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/md.txt 2023-10-16T13:14:03.447 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/media-framework.txt 2023-10-16T13:14:03.448 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2023-10-16T13:14:03.448 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/memory-devices/ 2023-10-16T13:14:04.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:04 smithi092 ceph-mon[99542]: pgmap v329: 97 pgs: 97 active+clean; 42 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 3.5 MiB/s wr, 73 op/s 2023-10-16T13:14:04.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:04 smithi118 ceph-mon[103969]: pgmap v329: 97 pgs: 97 active+clean; 42 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 3.5 MiB/s wr, 73 op/s 2023-10-16T13:14:04.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:04 smithi152 ceph-mon[104423]: pgmap v329: 97 pgs: 97 active+clean; 42 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 3.5 MiB/s wr, 73 op/s 2023-10-16T13:14:06.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:06 smithi092 ceph-mon[99542]: pgmap v330: 97 pgs: 97 active+clean; 70 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 5.9 MiB/s wr, 105 op/s 2023-10-16T13:14:06.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:06 smithi118 ceph-mon[103969]: pgmap v330: 97 pgs: 97 active+clean; 70 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 5.9 MiB/s wr, 105 op/s 2023-10-16T13:14:06.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:06 smithi152 ceph-mon[104423]: pgmap v330: 97 pgs: 97 active+clean; 70 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 5.9 MiB/s wr, 105 op/s 2023-10-16T13:14:07.468 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2023-10-16T13:14:07.470 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2023-10-16T13:14:07.472 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/metag/ 2023-10-16T13:14:07.473 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2023-10-16T13:14:07.474 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2023-10-16T13:14:07.474 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mic/ 2023-10-16T13:14:07.476 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mic/Makefile 2023-10-16T13:14:07.477 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2023-10-16T13:14:07.477 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2023-10-16T13:14:07.478 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2023-10-16T13:14:07.480 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2023-10-16T13:14:07.480 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2023-10-16T13:14:07.481 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2023-10-16T13:14:07.481 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2023-10-16T13:14:07.481 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2023-10-16T13:14:07.481 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2023-10-16T13:14:07.481 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mips/ 2023-10-16T13:14:07.484 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2023-10-16T13:14:07.485 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2023-10-16T13:14:07.486 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/misc-devices/ 2023-10-16T13:14:07.487 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2023-10-16T13:14:07.489 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2023-10-16T13:14:07.489 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2023-10-16T13:14:07.489 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2023-10-16T13:14:07.489 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2023-10-16T13:14:07.490 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2023-10-16T13:14:07.490 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2023-10-16T13:14:07.490 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2023-10-16T13:14:07.490 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2023-10-16T13:14:07.490 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2023-10-16T13:14:07.491 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2023-10-16T13:14:07.494 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2023-10-16T13:14:07.496 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2023-10-16T13:14:07.496 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2023-10-16T13:14:07.496 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2023-10-16T13:14:07.496 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2023-10-16T13:14:07.497 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2023-10-16T13:14:07.497 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2023-10-16T13:14:07.497 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mmc/ 2023-10-16T13:14:07.501 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2023-10-16T13:14:07.502 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2023-10-16T13:14:07.502 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2023-10-16T13:14:07.502 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2023-10-16T13:14:07.502 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mn10300/ 2023-10-16T13:14:07.503 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2023-10-16T13:14:07.505 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2023-10-16T13:14:07.506 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/module-signing.txt 2023-10-16T13:14:07.506 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mono.txt 2023-10-16T13:14:07.506 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mtd/ 2023-10-16T13:14:07.507 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mtd/nand/ 2023-10-16T13:14:07.508 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2023-10-16T13:14:07.509 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2023-10-16T13:14:07.510 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2023-10-16T13:14:07.511 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/namespaces/ 2023-10-16T13:14:07.512 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2023-10-16T13:14:07.513 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2023-10-16T13:14:07.513 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/netlabel/ 2023-10-16T13:14:07.514 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2023-10-16T13:14:07.516 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2023-10-16T13:14:07.516 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2023-10-16T13:14:07.516 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2023-10-16T13:14:07.516 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2023-10-16T13:14:07.517 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/ 2023-10-16T13:14:07.519 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2023-10-16T13:14:07.521 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2023-10-16T13:14:07.521 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2023-10-16T13:14:07.521 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2023-10-16T13:14:07.522 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2023-10-16T13:14:07.522 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2023-10-16T13:14:07.522 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/Makefile 2023-10-16T13:14:07.522 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2023-10-16T13:14:07.522 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2023-10-16T13:14:07.523 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2023-10-16T13:14:07.523 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2023-10-16T13:14:07.523 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/alias.txt 2023-10-16T13:14:07.523 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2023-10-16T13:14:07.524 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2023-10-16T13:14:07.524 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2023-10-16T13:14:07.525 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/atm.txt 2023-10-16T13:14:07.525 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2023-10-16T13:14:07.525 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2023-10-16T13:14:07.525 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2023-10-16T13:14:07.526 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2023-10-16T13:14:07.526 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2023-10-16T13:14:07.526 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/caif/ 2023-10-16T13:14:07.531 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2023-10-16T13:14:07.533 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/caif/README 2023-10-16T13:14:07.533 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2023-10-16T13:14:07.533 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/can.txt 2023-10-16T13:14:07.534 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2023-10-16T13:14:07.534 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/cops.txt 2023-10-16T13:14:07.534 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2023-10-16T13:14:07.536 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2023-10-16T13:14:07.536 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2023-10-16T13:14:07.536 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2023-10-16T13:14:07.537 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2023-10-16T13:14:07.537 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2023-10-16T13:14:07.537 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2023-10-16T13:14:07.537 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2023-10-16T13:14:07.537 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2023-10-16T13:14:07.537 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2023-10-16T13:14:07.538 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2023-10-16T13:14:07.538 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2023-10-16T13:14:07.538 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/driver.txt 2023-10-16T13:14:07.538 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/e100.txt 2023-10-16T13:14:07.538 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2023-10-16T13:14:07.539 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2023-10-16T13:14:07.539 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/eql.txt 2023-10-16T13:14:07.539 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2023-10-16T13:14:07.539 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/filter.txt 2023-10-16T13:14:07.542 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2023-10-16T13:14:07.542 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2023-10-16T13:14:07.542 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2023-10-16T13:14:07.543 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2023-10-16T13:14:07.543 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2023-10-16T13:14:07.543 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2023-10-16T13:14:07.543 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2023-10-16T13:14:07.543 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2023-10-16T13:14:07.544 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2023-10-16T13:14:07.544 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/igb.txt 2023-10-16T13:14:07.544 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2023-10-16T13:14:07.544 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2023-10-16T13:14:07.544 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2023-10-16T13:14:07.545 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2023-10-16T13:14:07.545 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2023-10-16T13:14:07.545 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2023-10-16T13:14:07.545 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2023-10-16T13:14:07.545 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2023-10-16T13:14:07.546 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2023-10-16T13:14:07.546 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/irda.txt 2023-10-16T13:14:07.546 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2023-10-16T13:14:07.546 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2023-10-16T13:14:07.546 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2023-10-16T13:14:07.547 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2023-10-16T13:14:07.547 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2023-10-16T13:14:07.547 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2023-10-16T13:14:07.547 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2023-10-16T13:14:07.547 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2023-10-16T13:14:07.548 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2023-10-16T13:14:07.559 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2023-10-16T13:14:07.562 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2023-10-16T13:14:07.562 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2023-10-16T13:14:07.563 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2023-10-16T13:14:07.563 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2023-10-16T13:14:07.563 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2023-10-16T13:14:07.563 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2023-10-16T13:14:07.563 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2023-10-16T13:14:07.563 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2023-10-16T13:14:07.564 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2023-10-16T13:14:07.564 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2023-10-16T13:14:07.564 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2023-10-16T13:14:07.564 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2023-10-16T13:14:07.564 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2023-10-16T13:14:07.565 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2023-10-16T13:14:07.565 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2023-10-16T13:14:07.565 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/phy.txt 2023-10-16T13:14:07.565 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2023-10-16T13:14:07.565 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2023-10-16T13:14:07.566 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2023-10-16T13:14:07.568 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2023-10-16T13:14:07.568 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2023-10-16T13:14:07.568 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2023-10-16T13:14:07.568 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/rds.txt 2023-10-16T13:14:07.568 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2023-10-16T13:14:07.569 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2023-10-16T13:14:07.569 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2023-10-16T13:14:07.569 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2023-10-16T13:14:07.569 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2023-10-16T13:14:07.569 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/secid.txt 2023-10-16T13:14:07.570 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2023-10-16T13:14:07.570 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2023-10-16T13:14:07.570 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2023-10-16T13:14:07.570 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2023-10-16T13:14:07.570 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2023-10-16T13:14:07.571 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2023-10-16T13:14:07.571 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2023-10-16T13:14:07.571 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2023-10-16T13:14:07.571 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/team.txt 2023-10-16T13:14:07.571 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2023-10-16T13:14:07.572 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2023-10-16T13:14:07.580 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2023-10-16T13:14:07.583 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2023-10-16T13:14:07.583 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2023-10-16T13:14:07.583 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2023-10-16T13:14:07.584 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2023-10-16T13:14:07.584 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2023-10-16T13:14:07.584 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2023-10-16T13:14:07.584 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2023-10-16T13:14:07.584 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2023-10-16T13:14:07.584 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2023-10-16T13:14:07.585 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2023-10-16T13:14:07.585 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2023-10-16T13:14:07.585 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2023-10-16T13:14:07.585 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/x25.txt 2023-10-16T13:14:07.585 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2023-10-16T13:14:07.586 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2023-10-16T13:14:07.586 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2023-10-16T13:14:07.586 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2023-10-16T13:14:07.586 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/nfc/ 2023-10-16T13:14:07.591 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2023-10-16T13:14:07.592 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2023-10-16T13:14:07.592 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/nios2/ 2023-10-16T13:14:07.594 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/nios2/README 2023-10-16T13:14:07.595 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2023-10-16T13:14:07.595 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/numastat.txt 2023-10-16T13:14:07.596 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2023-10-16T13:14:07.596 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/padata.txt 2023-10-16T13:14:07.596 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/parisc/ 2023-10-16T13:14:07.598 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2023-10-16T13:14:07.599 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/parisc/debugging 2023-10-16T13:14:07.600 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/parisc/registers 2023-10-16T13:14:07.600 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2023-10-16T13:14:07.600 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/parport.txt 2023-10-16T13:14:07.600 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/pcmcia/ 2023-10-16T13:14:07.602 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2023-10-16T13:14:07.604 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2023-10-16T13:14:07.604 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2023-10-16T13:14:07.605 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2023-10-16T13:14:07.605 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2023-10-16T13:14:07.605 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2023-10-16T13:14:07.605 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2023-10-16T13:14:07.605 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2023-10-16T13:14:07.606 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/phy.txt 2023-10-16T13:14:07.606 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/phy/ 2023-10-16T13:14:07.609 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2023-10-16T13:14:07.610 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/pi-futex.txt 2023-10-16T13:14:07.610 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/pinctrl.txt 2023-10-16T13:14:07.610 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/platform/ 2023-10-16T13:14:07.612 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2023-10-16T13:14:07.613 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/pnp.txt 2023-10-16T13:14:07.614 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/ 2023-10-16T13:14:07.615 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/00-INDEX 2023-10-16T13:14:07.617 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2023-10-16T13:14:07.617 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2023-10-16T13:14:07.617 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2023-10-16T13:14:07.617 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/devices.txt 2023-10-16T13:14:07.618 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2023-10-16T13:14:07.618 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2023-10-16T13:14:07.618 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/interface.txt 2023-10-16T13:14:07.618 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2023-10-16T13:14:07.618 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/opp.txt 2023-10-16T13:14:07.619 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/pci.txt 2023-10-16T13:14:07.619 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2023-10-16T13:14:07.620 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2023-10-16T13:14:07.620 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/powercap/ 2023-10-16T13:14:07.623 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2023-10-16T13:14:07.624 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/regulator/ 2023-10-16T13:14:07.625 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2023-10-16T13:14:07.628 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2023-10-16T13:14:07.628 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2023-10-16T13:14:07.628 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2023-10-16T13:14:07.628 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2023-10-16T13:14:07.629 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2023-10-16T13:14:07.629 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2023-10-16T13:14:07.629 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/states.txt 2023-10-16T13:14:07.629 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2023-10-16T13:14:07.629 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2023-10-16T13:14:07.629 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2023-10-16T13:14:07.630 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2023-10-16T13:14:07.630 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2023-10-16T13:14:07.630 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/tricks.txt 2023-10-16T13:14:07.630 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2023-10-16T13:14:07.630 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/power/video.txt 2023-10-16T13:14:07.631 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/powerpc/ 2023-10-16T13:14:07.635 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2023-10-16T13:14:07.637 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2023-10-16T13:14:07.637 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2023-10-16T13:14:07.637 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2023-10-16T13:14:07.638 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2023-10-16T13:14:07.638 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2023-10-16T13:14:07.638 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2023-10-16T13:14:07.638 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2023-10-16T13:14:07.639 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2023-10-16T13:14:07.639 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2023-10-16T13:14:07.639 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2023-10-16T13:14:07.639 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2023-10-16T13:14:07.639 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2023-10-16T13:14:07.639 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/pps/ 2023-10-16T13:14:07.643 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/pps/pps.txt 2023-10-16T13:14:07.644 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/prctl/ 2023-10-16T13:14:07.645 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2023-10-16T13:14:07.647 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/prctl/Makefile 2023-10-16T13:14:07.647 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2023-10-16T13:14:07.647 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2023-10-16T13:14:07.647 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2023-10-16T13:14:07.647 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2023-10-16T13:14:07.648 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2023-10-16T13:14:07.648 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2023-10-16T13:14:07.648 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/printk-formats.txt 2023-10-16T13:14:07.648 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/pti/ 2023-10-16T13:14:07.651 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2023-10-16T13:14:07.652 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ptp/ 2023-10-16T13:14:07.653 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2023-10-16T13:14:07.655 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ptp/Makefile 2023-10-16T13:14:07.655 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2023-10-16T13:14:07.655 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2023-10-16T13:14:07.656 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2023-10-16T13:14:07.656 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/pwm.txt 2023-10-16T13:14:07.656 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/ramoops.txt 2023-10-16T13:14:07.656 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/rapidio/ 2023-10-16T13:14:07.659 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2023-10-16T13:14:07.660 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2023-10-16T13:14:07.661 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2023-10-16T13:14:07.661 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/rbtree.txt 2023-10-16T13:14:07.661 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/remoteproc.txt 2023-10-16T13:14:07.661 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/rfkill.txt 2023-10-16T13:14:07.662 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2023-10-16T13:14:07.662 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2023-10-16T13:14:07.662 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/rpmsg.txt 2023-10-16T13:14:07.662 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/rtc.txt 2023-10-16T13:14:07.663 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/s390/ 2023-10-16T13:14:07.666 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2023-10-16T13:14:07.667 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2023-10-16T13:14:07.668 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/s390/3270.txt 2023-10-16T13:14:07.668 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/s390/CommonIO 2023-10-16T13:14:07.668 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/s390/DASD 2023-10-16T13:14:07.668 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2023-10-16T13:14:07.669 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/s390/cds.txt 2023-10-16T13:14:07.670 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2023-10-16T13:14:07.670 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2023-10-16T13:14:07.670 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2023-10-16T13:14:07.670 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2023-10-16T13:14:07.670 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2023-10-16T13:14:07.671 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2023-10-16T13:14:07.671 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2023-10-16T13:14:07.671 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scheduler/ 2023-10-16T13:14:07.674 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2023-10-16T13:14:07.676 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2023-10-16T13:14:07.676 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2023-10-16T13:14:07.676 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2023-10-16T13:14:07.677 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2023-10-16T13:14:07.677 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2023-10-16T13:14:07.677 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2023-10-16T13:14:07.677 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2023-10-16T13:14:07.678 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2023-10-16T13:14:07.678 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2023-10-16T13:14:07.678 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/ 2023-10-16T13:14:07.681 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2023-10-16T13:14:07.682 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2023-10-16T13:14:07.682 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2023-10-16T13:14:07.683 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2023-10-16T13:14:07.683 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2023-10-16T13:14:07.683 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2023-10-16T13:14:07.684 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2023-10-16T13:14:07.684 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2023-10-16T13:14:07.685 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2023-10-16T13:14:07.685 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2023-10-16T13:14:07.686 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2023-10-16T13:14:07.687 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2023-10-16T13:14:07.688 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2023-10-16T13:14:07.688 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2023-10-16T13:14:07.688 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2023-10-16T13:14:07.688 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2023-10-16T13:14:07.688 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2023-10-16T13:14:07.689 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2023-10-16T13:14:07.689 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2023-10-16T13:14:07.689 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2023-10-16T13:14:07.689 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2023-10-16T13:14:07.689 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2023-10-16T13:14:07.692 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2023-10-16T13:14:07.692 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2023-10-16T13:14:07.693 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2023-10-16T13:14:07.693 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2023-10-16T13:14:07.693 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2023-10-16T13:14:07.693 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2023-10-16T13:14:07.693 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2023-10-16T13:14:07.694 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2023-10-16T13:14:07.694 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2023-10-16T13:14:07.694 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2023-10-16T13:14:07.694 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2023-10-16T13:14:07.694 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2023-10-16T13:14:07.695 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2023-10-16T13:14:07.695 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2023-10-16T13:14:07.695 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2023-10-16T13:14:07.695 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2023-10-16T13:14:07.695 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2023-10-16T13:14:07.696 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2023-10-16T13:14:07.696 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2023-10-16T13:14:07.696 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2023-10-16T13:14:07.696 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2023-10-16T13:14:07.696 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2023-10-16T13:14:07.697 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2023-10-16T13:14:07.697 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2023-10-16T13:14:07.697 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2023-10-16T13:14:07.697 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2023-10-16T13:14:07.697 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2023-10-16T13:14:07.698 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2023-10-16T13:14:07.698 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2023-10-16T13:14:07.707 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2023-10-16T13:14:07.708 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2023-10-16T13:14:07.708 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/st.txt 2023-10-16T13:14:07.708 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2023-10-16T13:14:07.708 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2023-10-16T13:14:07.709 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2023-10-16T13:14:07.709 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2023-10-16T13:14:07.709 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2023-10-16T13:14:07.709 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/security/ 2023-10-16T13:14:07.711 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/security/00-INDEX 2023-10-16T13:14:07.713 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2023-10-16T13:14:07.713 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/security/LSM.txt 2023-10-16T13:14:07.713 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2023-10-16T13:14:07.714 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/security/Smack.txt 2023-10-16T13:14:07.714 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/security/Yama.txt 2023-10-16T13:14:07.714 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2023-10-16T13:14:07.714 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/security/credentials.txt 2023-10-16T13:14:07.715 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2023-10-16T13:14:07.715 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2023-10-16T13:14:07.715 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2023-10-16T13:14:07.715 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/security/keys.txt 2023-10-16T13:14:07.715 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2023-10-16T13:14:07.716 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/serial-console.txt 2023-10-16T13:14:07.716 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/serial/ 2023-10-16T13:14:07.719 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2023-10-16T13:14:07.721 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2023-10-16T13:14:07.721 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/serial/driver 2023-10-16T13:14:07.721 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2023-10-16T13:14:07.722 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2023-10-16T13:14:07.722 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2023-10-16T13:14:07.722 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2023-10-16T13:14:07.722 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/serial/tty.txt 2023-10-16T13:14:07.722 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2023-10-16T13:14:07.723 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sh/ 2023-10-16T13:14:07.725 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2023-10-16T13:14:07.727 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2023-10-16T13:14:07.727 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2023-10-16T13:14:07.727 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/ 2023-10-16T13:14:07.729 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/ 2023-10-16T13:14:07.730 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2023-10-16T13:14:07.731 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2023-10-16T13:14:07.731 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2023-10-16T13:14:07.732 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2023-10-16T13:14:07.733 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2023-10-16T13:14:07.733 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2023-10-16T13:14:07.733 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2023-10-16T13:14:07.733 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2023-10-16T13:14:07.733 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2023-10-16T13:14:07.734 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2023-10-16T13:14:07.735 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2023-10-16T13:14:07.736 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2023-10-16T13:14:07.736 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2023-10-16T13:14:07.736 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2023-10-16T13:14:07.736 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2023-10-16T13:14:07.736 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2023-10-16T13:14:07.737 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2023-10-16T13:14:07.737 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2023-10-16T13:14:07.737 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2023-10-16T13:14:07.737 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2023-10-16T13:14:07.737 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2023-10-16T13:14:07.738 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2023-10-16T13:14:07.738 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2023-10-16T13:14:07.738 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2023-10-16T13:14:07.738 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2023-10-16T13:14:07.738 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2023-10-16T13:14:07.743 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2023-10-16T13:14:07.745 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2023-10-16T13:14:07.745 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2023-10-16T13:14:07.745 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2023-10-16T13:14:07.745 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2023-10-16T13:14:07.746 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2023-10-16T13:14:07.746 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2023-10-16T13:14:07.746 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2023-10-16T13:14:07.746 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2023-10-16T13:14:07.746 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2023-10-16T13:14:07.747 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/ 2023-10-16T13:14:07.749 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2023-10-16T13:14:07.751 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2023-10-16T13:14:07.752 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2023-10-16T13:14:07.752 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2023-10-16T13:14:07.752 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2023-10-16T13:14:07.752 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2023-10-16T13:14:07.752 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2023-10-16T13:14:07.753 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2023-10-16T13:14:07.753 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2023-10-16T13:14:07.753 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2023-10-16T13:14:07.753 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2023-10-16T13:14:07.753 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2023-10-16T13:14:07.754 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2023-10-16T13:14:07.755 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2023-10-16T13:14:07.755 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2023-10-16T13:14:07.756 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2023-10-16T13:14:07.756 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2023-10-16T13:14:07.756 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2023-10-16T13:14:07.756 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2023-10-16T13:14:07.756 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2023-10-16T13:14:07.756 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2023-10-16T13:14:07.757 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2023-10-16T13:14:07.757 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2023-10-16T13:14:07.757 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2023-10-16T13:14:07.757 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sparse.txt 2023-10-16T13:14:07.757 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/spi/ 2023-10-16T13:14:07.763 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/spi/.gitignore 2023-10-16T13:14:07.765 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2023-10-16T13:14:07.765 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/spi/Makefile 2023-10-16T13:14:07.766 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/spi/butterfly 2023-10-16T13:14:07.766 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2023-10-16T13:14:07.766 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2023-10-16T13:14:07.766 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2023-10-16T13:14:07.766 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2023-10-16T13:14:07.766 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/spi/spi-summary 2023-10-16T13:14:07.767 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/spi/spidev 2023-10-16T13:14:07.767 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2023-10-16T13:14:07.767 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2023-10-16T13:14:07.767 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2023-10-16T13:14:07.767 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2023-10-16T13:14:07.767 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/static-keys.txt 2023-10-16T13:14:07.768 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/svga.txt 2023-10-16T13:14:07.768 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sysctl/ 2023-10-16T13:14:07.773 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2023-10-16T13:14:07.775 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sysctl/README 2023-10-16T13:14:07.775 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2023-10-16T13:14:07.775 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2023-10-16T13:14:07.775 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2023-10-16T13:14:07.776 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2023-10-16T13:14:07.776 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2023-10-16T13:14:07.776 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2023-10-16T13:14:07.776 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2023-10-16T13:14:07.776 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/sysrq.txt 2023-10-16T13:14:07.776 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/target/ 2023-10-16T13:14:07.779 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2023-10-16T13:14:07.781 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2023-10-16T13:14:07.781 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2023-10-16T13:14:07.781 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/thermal/ 2023-10-16T13:14:07.783 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2023-10-16T13:14:07.784 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2023-10-16T13:14:07.785 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2023-10-16T13:14:07.785 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2023-10-16T13:14:07.785 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2023-10-16T13:14:07.785 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2023-10-16T13:14:07.785 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2023-10-16T13:14:07.786 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2023-10-16T13:14:07.786 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/timers/ 2023-10-16T13:14:07.788 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/timers/.gitignore 2023-10-16T13:14:07.791 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2023-10-16T13:14:07.791 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/timers/Makefile 2023-10-16T13:14:07.791 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2023-10-16T13:14:07.791 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/timers/highres.txt 2023-10-16T13:14:07.791 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2023-10-16T13:14:07.792 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2023-10-16T13:14:07.792 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2023-10-16T13:14:07.792 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2023-10-16T13:14:07.792 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2023-10-16T13:14:07.792 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2023-10-16T13:14:07.793 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/tpm/ 2023-10-16T13:14:07.796 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2023-10-16T13:14:07.797 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/trace/ 2023-10-16T13:14:07.798 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2023-10-16T13:14:07.799 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2023-10-16T13:14:07.800 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2023-10-16T13:14:07.800 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2023-10-16T13:14:07.800 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/trace/events.txt 2023-10-16T13:14:07.800 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2023-10-16T13:14:07.800 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2023-10-16T13:14:07.801 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2023-10-16T13:14:07.801 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2023-10-16T13:14:07.802 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2023-10-16T13:14:07.802 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2023-10-16T13:14:07.804 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2023-10-16T13:14:07.805 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2023-10-16T13:14:07.806 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2023-10-16T13:14:07.807 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2023-10-16T13:14:07.807 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2023-10-16T13:14:07.807 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2023-10-16T13:14:07.807 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2023-10-16T13:14:07.807 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/unicode.txt 2023-10-16T13:14:07.808 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/unshare.txt 2023-10-16T13:14:07.808 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/ 2023-10-16T13:14:07.811 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/CREDITS 2023-10-16T13:14:07.813 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/URB.txt 2023-10-16T13:14:07.813 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2023-10-16T13:14:07.813 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/acm.txt 2023-10-16T13:14:07.814 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2023-10-16T13:14:07.814 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2023-10-16T13:14:07.814 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2023-10-16T13:14:07.814 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2023-10-16T13:14:07.814 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2023-10-16T13:14:07.815 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/dma.txt 2023-10-16T13:14:07.815 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2023-10-16T13:14:07.815 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2023-10-16T13:14:07.815 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2023-10-16T13:14:07.815 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2023-10-16T13:14:07.816 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2023-10-16T13:14:07.816 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2023-10-16T13:14:07.816 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2023-10-16T13:14:07.816 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2023-10-16T13:14:07.816 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2023-10-16T13:14:07.817 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2023-10-16T13:14:07.818 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2023-10-16T13:14:07.818 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2023-10-16T13:14:07.819 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2023-10-16T13:14:07.819 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/linux.inf 2023-10-16T13:14:07.819 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2023-10-16T13:14:07.819 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2023-10-16T13:14:07.820 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2023-10-16T13:14:07.820 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2023-10-16T13:14:07.820 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/persist.txt 2023-10-16T13:14:07.820 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2023-10-16T13:14:07.820 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2023-10-16T13:14:07.820 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/rio.txt 2023-10-16T13:14:07.821 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2023-10-16T13:14:07.821 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2023-10-16T13:14:07.821 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2023-10-16T13:14:07.821 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2023-10-16T13:14:07.821 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vDSO/ 2023-10-16T13:14:07.829 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2023-10-16T13:14:07.831 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2023-10-16T13:14:07.831 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2023-10-16T13:14:07.831 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2023-10-16T13:14:07.832 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2023-10-16T13:14:07.832 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vfio.txt 2023-10-16T13:14:07.832 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2023-10-16T13:14:07.832 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video-output.txt 2023-10-16T13:14:07.832 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/ 2023-10-16T13:14:07.835 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2023-10-16T13:14:07.838 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/API.html 2023-10-16T13:14:07.838 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2023-10-16T13:14:07.838 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2023-10-16T13:14:07.839 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2023-10-16T13:14:07.839 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2023-10-16T13:14:07.839 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2023-10-16T13:14:07.839 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2023-10-16T13:14:07.839 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2023-10-16T13:14:07.839 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2023-10-16T13:14:07.840 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2023-10-16T13:14:07.840 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2023-10-16T13:14:07.840 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2023-10-16T13:14:07.840 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2023-10-16T13:14:07.840 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2023-10-16T13:14:07.841 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2023-10-16T13:14:07.841 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2023-10-16T13:14:07.841 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2023-10-16T13:14:07.841 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2023-10-16T13:14:07.841 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2023-10-16T13:14:07.842 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2023-10-16T13:14:07.842 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2023-10-16T13:14:07.842 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2023-10-16T13:14:07.848 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2023-10-16T13:14:07.850 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2023-10-16T13:14:07.851 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2023-10-16T13:14:07.851 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2023-10-16T13:14:07.851 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2023-10-16T13:14:07.851 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2023-10-16T13:14:07.852 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2023-10-16T13:14:07.852 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2023-10-16T13:14:07.852 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2023-10-16T13:14:07.852 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2023-10-16T13:14:07.852 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2023-10-16T13:14:07.853 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2023-10-16T13:14:07.853 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2023-10-16T13:14:07.853 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2023-10-16T13:14:07.853 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2023-10-16T13:14:07.853 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2023-10-16T13:14:07.853 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2023-10-16T13:14:07.854 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2023-10-16T13:14:07.854 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2023-10-16T13:14:07.854 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2023-10-16T13:14:07.859 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2023-10-16T13:14:07.861 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2023-10-16T13:14:07.861 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2023-10-16T13:14:07.861 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2023-10-16T13:14:07.861 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2023-10-16T13:14:07.862 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2023-10-16T13:14:07.862 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2023-10-16T13:14:07.862 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2023-10-16T13:14:07.862 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2023-10-16T13:14:07.862 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2023-10-16T13:14:07.863 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2023-10-16T13:14:07.865 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2023-10-16T13:14:07.868 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2023-10-16T13:14:07.868 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2023-10-16T13:14:07.868 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2023-10-16T13:14:07.868 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2023-10-16T13:14:07.868 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2023-10-16T13:14:07.869 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2023-10-16T13:14:07.869 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2023-10-16T13:14:07.869 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2023-10-16T13:14:07.869 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2023-10-16T13:14:07.869 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2023-10-16T13:14:07.870 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2023-10-16T13:14:07.870 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2023-10-16T13:14:07.870 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2023-10-16T13:14:07.870 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2023-10-16T13:14:07.870 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2023-10-16T13:14:07.871 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2023-10-16T13:14:07.871 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2023-10-16T13:14:07.871 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2023-10-16T13:14:07.872 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2023-10-16T13:14:07.872 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2023-10-16T13:14:07.872 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2023-10-16T13:14:07.872 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2023-10-16T13:14:07.872 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2023-10-16T13:14:07.873 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/ 2023-10-16T13:14:07.878 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2023-10-16T13:14:07.880 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2023-10-16T13:14:07.881 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2023-10-16T13:14:07.882 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2023-10-16T13:14:07.883 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2023-10-16T13:14:07.883 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2023-10-16T13:14:07.884 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2023-10-16T13:14:07.887 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2023-10-16T13:14:07.887 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2023-10-16T13:14:07.887 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2023-10-16T13:14:07.887 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2023-10-16T13:14:07.887 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2023-10-16T13:14:07.887 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2023-10-16T13:14:07.888 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2023-10-16T13:14:07.888 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2023-10-16T13:14:07.888 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2023-10-16T13:14:07.888 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2023-10-16T13:14:07.888 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2023-10-16T13:14:07.888 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2023-10-16T13:14:07.889 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2023-10-16T13:14:07.889 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2023-10-16T13:14:07.889 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2023-10-16T13:14:07.889 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2023-10-16T13:14:07.889 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/uml/ 2023-10-16T13:14:07.894 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2023-10-16T13:14:07.896 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/ 2023-10-16T13:14:07.897 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/.gitignore 2023-10-16T13:14:07.899 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2023-10-16T13:14:07.899 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2023-10-16T13:14:07.900 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/balance 2023-10-16T13:14:07.900 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2023-10-16T13:14:07.900 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2023-10-16T13:14:07.900 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2023-10-16T13:14:07.900 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2023-10-16T13:14:07.901 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2023-10-16T13:14:07.901 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2023-10-16T13:14:07.901 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/numa 2023-10-16T13:14:07.901 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2023-10-16T13:14:07.901 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2023-10-16T13:14:07.902 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/page_migration 2023-10-16T13:14:07.902 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2023-10-16T13:14:07.902 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2023-10-16T13:14:07.902 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2023-10-16T13:14:07.902 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/slub.txt 2023-10-16T13:14:07.902 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2023-10-16T13:14:07.903 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2023-10-16T13:14:07.903 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2023-10-16T13:14:07.903 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2023-10-16T13:14:07.904 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2023-10-16T13:14:07.904 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/vme_api.txt 2023-10-16T13:14:07.904 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2023-10-16T13:14:07.904 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/w1/ 2023-10-16T13:14:07.910 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2023-10-16T13:14:07.911 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/w1/masters/ 2023-10-16T13:14:07.912 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2023-10-16T13:14:07.914 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2023-10-16T13:14:07.914 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2023-10-16T13:14:07.914 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2023-10-16T13:14:07.914 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2023-10-16T13:14:07.914 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2023-10-16T13:14:07.915 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/w1/slaves/ 2023-10-16T13:14:07.916 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2023-10-16T13:14:07.918 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2023-10-16T13:14:07.918 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2023-10-16T13:14:07.918 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2023-10-16T13:14:07.919 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2023-10-16T13:14:07.919 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/w1/w1.generic 2023-10-16T13:14:07.919 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2023-10-16T13:14:07.919 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/watchdog/ 2023-10-16T13:14:07.922 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2023-10-16T13:14:07.923 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2023-10-16T13:14:07.923 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2023-10-16T13:14:07.924 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2023-10-16T13:14:07.924 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/watchdog/src/ 2023-10-16T13:14:07.925 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2023-10-16T13:14:07.927 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2023-10-16T13:14:07.927 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2023-10-16T13:14:07.927 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2023-10-16T13:14:07.928 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2023-10-16T13:14:07.928 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2023-10-16T13:14:07.928 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2023-10-16T13:14:07.928 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2023-10-16T13:14:07.928 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/wimax/ 2023-10-16T13:14:08.135 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2023-10-16T13:14:08.136 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2023-10-16T13:14:08.137 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/workqueue.txt 2023-10-16T13:14:08.137 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/ 2023-10-16T13:14:08.138 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2023-10-16T13:14:08.139 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/boot.txt 2023-10-16T13:14:08.140 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2023-10-16T13:14:08.140 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2023-10-16T13:14:08.140 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2023-10-16T13:14:08.140 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2023-10-16T13:14:08.141 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/i386/ 2023-10-16T13:14:08.143 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2023-10-16T13:14:08.144 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2023-10-16T13:14:08.144 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2023-10-16T13:14:08.145 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/pat.txt 2023-10-16T13:14:08.145 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2023-10-16T13:14:08.145 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2023-10-16T13:14:08.145 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2023-10-16T13:14:08.147 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2023-10-16T13:14:08.149 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2023-10-16T13:14:08.149 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2023-10-16T13:14:08.149 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2023-10-16T13:14:08.150 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2023-10-16T13:14:08.150 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2023-10-16T13:14:08.150 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2023-10-16T13:14:08.150 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2023-10-16T13:14:08.150 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2023-10-16T13:14:08.151 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/xillybus.txt 2023-10-16T13:14:08.151 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/xtensa/ 2023-10-16T13:14:08.154 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2023-10-16T13:14:08.155 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2023-10-16T13:14:08.155 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/xz.txt 2023-10-16T13:14:08.156 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/ 2023-10-16T13:14:08.157 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2023-10-16T13:14:08.159 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2023-10-16T13:14:08.159 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2023-10-16T13:14:08.159 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2023-10-16T13:14:08.160 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2023-10-16T13:14:08.160 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2023-10-16T13:14:08.160 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2023-10-16T13:14:08.162 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2023-10-16T13:14:08.163 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2023-10-16T13:14:08.163 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2023-10-16T13:14:08.165 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2023-10-16T13:14:08.166 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2023-10-16T13:14:08.166 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2023-10-16T13:14:08.166 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2023-10-16T13:14:08.167 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2023-10-16T13:14:08.167 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2023-10-16T13:14:08.168 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2023-10-16T13:14:08.170 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2023-10-16T13:14:08.170 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2023-10-16T13:14:08.171 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2023-10-16T13:14:08.171 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2023-10-16T13:14:08.171 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2023-10-16T13:14:08.171 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2023-10-16T13:14:08.171 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2023-10-16T13:14:08.172 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2023-10-16T13:14:08.174 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2023-10-16T13:14:08.175 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2023-10-16T13:14:08.176 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2023-10-16T13:14:08.176 INFO:tasks.workunit.client.0.smithi092.stdout:linux-4.0.5/Documentation/zorro.txt 2023-10-16T13:14:08.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:08 smithi092 ceph-mon[99542]: pgmap v331: 97 pgs: 97 active+clean; 94 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 7.9 MiB/s wr, 161 op/s 2023-10-16T13:14:08.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:08 smithi118 ceph-mon[103969]: pgmap v331: 97 pgs: 97 active+clean; 94 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 7.9 MiB/s wr, 161 op/s 2023-10-16T13:14:08.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:08 smithi152 ceph-mon[104423]: pgmap v331: 97 pgs: 97 active+clean; 94 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 7.9 MiB/s wr, 161 op/s 2023-10-16T13:14:10.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:10 smithi092 ceph-mon[99542]: pgmap v332: 97 pgs: 97 active+clean; 96 MiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 8.1 MiB/s wr, 161 op/s 2023-10-16T13:14:10.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:10 smithi118 ceph-mon[103969]: pgmap v332: 97 pgs: 97 active+clean; 96 MiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 8.1 MiB/s wr, 161 op/s 2023-10-16T13:14:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.783+0000 7f5992d64700 1 -- 172.21.15.92:0/2165037512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f598c101980 msgr2=0x7f598c103d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:10.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.783+0000 7f5992d64700 1 --2- 172.21.15.92:0/2165037512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f598c101980 0x7f598c103d70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5980009990 tx=0x7f5980009ca0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.783+0000 7f5992d64700 1 -- 172.21.15.92:0/2165037512 shutdown_connections 2023-10-16T13:14:10.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.783+0000 7f5992d64700 1 --2- 172.21.15.92:0/2165037512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f598c101980 0x7f598c103d70 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.783+0000 7f5992d64700 1 --2- 172.21.15.92:0/2165037512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f598c106be0 0x7f598c109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.783+0000 7f5992d64700 1 --2- 172.21.15.92:0/2165037512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f598c1042b0 0x7f598c1066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.783+0000 7f5992d64700 1 -- 172.21.15.92:0/2165037512 >> 172.21.15.92:0/2165037512 conn(0x7f598c0fb330 msgr2=0x7f598c0fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:10.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.783+0000 7f5992d64700 1 -- 172.21.15.92:0/2165037512 shutdown_connections 2023-10-16T13:14:10.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.783+0000 7f5992d64700 1 -- 172.21.15.92:0/2165037512 wait complete. 2023-10-16T13:14:10.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.783+0000 7f5992d64700 1 Processor -- start 2023-10-16T13:14:10.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.783+0000 7f5992d64700 1 -- start start 2023-10-16T13:14:10.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5992d64700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f598c101980 0x7f598c196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:10.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5992d64700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f598c1042b0 0x7f598c197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:10.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5992d64700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f598c106be0 0x7f598c198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:10.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5992d64700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c1987e0 con 0x7f598c106be0 2023-10-16T13:14:10.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5992d64700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c198950 con 0x7f598c101980 2023-10-16T13:14:10.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5992d64700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c198b10 con 0x7f598c1042b0 2023-10-16T13:14:10.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5991301700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f598c106be0 0x7f598c198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:10.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5991301700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f598c106be0 0x7f598c198100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37558/0 (socket says 172.21.15.92:37558) 2023-10-16T13:14:10.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5991301700 1 -- 172.21.15.92:0/366033458 learned_addr learned my addr 172.21.15.92:0/366033458 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f598bfff700 1 --2- 172.21.15.92:0/366033458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f598c1042b0 0x7f598c197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5990b00700 1 --2- 172.21.15.92:0/366033458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f598c101980 0x7f598c196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5991301700 1 -- 172.21.15.92:0/366033458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f598c1042b0 msgr2=0x7f598c197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5991301700 1 --2- 172.21.15.92:0/366033458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f598c1042b0 0x7f598c197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5991301700 1 -- 172.21.15.92:0/366033458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f598c101980 msgr2=0x7f598c196df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:10.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5991301700 1 --2- 172.21.15.92:0/366033458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f598c101980 0x7f598c196df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5991301700 1 -- 172.21.15.92:0/366033458 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59800095f0 con 0x7f598c106be0 2023-10-16T13:14:10.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5991301700 1 --2- 172.21.15.92:0/366033458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f598c106be0 0x7f598c198100 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5984007ee0 tx=0x7f598400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:10.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5989ffb700 1 -- 172.21.15.92:0/366033458 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598400dd20 con 0x7f598c106be0 2023-10-16T13:14:10.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5989ffb700 1 -- 172.21.15.92:0/366033458 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f598400f040 con 0x7f598c106be0 2023-10-16T13:14:10.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5992d64700 1 -- 172.21.15.92:0/366033458 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598c198df0 con 0x7f598c106be0 2023-10-16T13:14:10.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.784+0000 7f5989ffb700 1 -- 172.21.15.92:0/366033458 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984015400 con 0x7f598c106be0 2023-10-16T13:14:10.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.785+0000 7f5992d64700 1 -- 172.21.15.92:0/366033458 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f598c19f530 con 0x7f598c106be0 2023-10-16T13:14:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.787+0000 7f5989ffb700 1 -- 172.21.15.92:0/366033458 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5984003a00 con 0x7f598c106be0 2023-10-16T13:14:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.787+0000 7f5989ffb700 1 --2- 172.21.15.92:0/366033458 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f597c0a1480 0x7f597c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.787+0000 7f5989ffb700 1 -- 172.21.15.92:0/366033458 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f59840cc4e0 con 0x7f598c106be0 2023-10-16T13:14:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.787+0000 7f5990b00700 1 --2- 172.21.15.92:0/366033458 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f597c0a1480 0x7f597c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.788+0000 7f5990b00700 1 --2- 172.21.15.92:0/366033458 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f597c0a1480 0x7f597c0a3940 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5980006010 tx=0x7f598000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.788+0000 7f599ef4eb80 1 Processor -- start 2023-10-16T13:14:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.788+0000 7f599ef4eb80 1 -- start start 2023-10-16T13:14:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f599ef4eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d3919850 0x5594d3919c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f599ef4eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d391a1b0 0x5594d391aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f599ef4eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d391b0a0 0x5594d391b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f599ef4eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d388ec10 con 0x5594d3919850 2023-10-16T13:14:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f599ef4eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d3873c00 con 0x5594d391a1b0 2023-10-16T13:14:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f599ef4eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d3871520 con 0x5594d391b0a0 2023-10-16T13:14:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f5990b00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d3919850 0x5594d3919c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f5990b00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d3919850 0x5594d3919c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37562/0 (socket says 172.21.15.92:37562) 2023-10-16T13:14:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f5990b00700 1 -- 172.21.15.92:0/706761035 learned_addr learned my addr 172.21.15.92:0/706761035 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f5991301700 1 --2- 172.21.15.92:0/706761035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d391b0a0 0x5594d391b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f598bfff700 1 --2- 172.21.15.92:0/706761035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d391a1b0 0x5594d391aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f5990b00700 1 -- 172.21.15.92:0/706761035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d391b0a0 msgr2=0x5594d391b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f5990b00700 1 --2- 172.21.15.92:0/706761035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d391b0a0 0x5594d391b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f5990b00700 1 -- 172.21.15.92:0/706761035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d391a1b0 msgr2=0x5594d391aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f5990b00700 1 --2- 172.21.15.92:0/706761035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d391a1b0 0x5594d391aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f5990b00700 1 -- 172.21.15.92:0/706761035 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594d382a390 con 0x5594d3919850 2023-10-16T13:14:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f5991301700 1 --2- 172.21.15.92:0/706761035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d391b0a0 0x5594d391b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:14:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f5990b00700 1 --2- 172.21.15.92:0/706761035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d3919850 0x5594d3919c70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5980015000 tx=0x7f5980020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd52dc58c0e0a10 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f5976ffd700 1 -- 172.21.15.92:0/706761035 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598002b070 con 0x5594d3919850 2023-10-16T13:14:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f5976ffd700 1 -- 172.21.15.92:0/706761035 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f598001e040 con 0x5594d3919850 2023-10-16T13:14:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.789+0000 7f5976ffd700 1 -- 172.21.15.92:0/706761035 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5980024dd0 con 0x5594d3919850 2023-10-16T13:14:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.790+0000 7f599ef4eb80 1 -- 172.21.15.92:0/706761035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d3919850 msgr2=0x5594d3919c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.790+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/706761035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d3919850 0x5594d3919c70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5980015000 tx=0x7f5980020000 comp rx=0 tx=0).stop 2023-10-16T13:14:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.790+0000 7f599ef4eb80 1 -- 172.21.15.92:0/706761035 shutdown_connections 2023-10-16T13:14:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.790+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/706761035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d3919850 0x5594d3919c70 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.790+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/706761035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d391b0a0 0x5594d391b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.790+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/706761035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d391a1b0 0x5594d391aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.790+0000 7f599ef4eb80 1 -- 172.21.15.92:0/706761035 >> 172.21.15.92:0/706761035 conn(0x5594d3847d70 msgr2=0x5594d3914c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.790+0000 7f599ef4eb80 1 -- 172.21.15.92:0/706761035 shutdown_connections 2023-10-16T13:14:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.790+0000 7f599ef4eb80 1 -- 172.21.15.92:0/706761035 wait complete. 2023-10-16T13:14:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f599ef4eb80 1 -- start start 2023-10-16T13:14:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f599ef4eb80 1 Processor -- start 2023-10-16T13:14:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f599ef4eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d3919850 0x5594d39236d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f599ef4eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391a1b0 0x5594d3923c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f599ef4eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d391b0a0 0x5594d392ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f599ef4eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d386ce10 con 0x5594d391a1b0 2023-10-16T13:14:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f599ef4eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d38096b0 con 0x5594d3919850 2023-10-16T13:14:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f599ef4eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d3809350 con 0x5594d391b0a0 2023-10-16T13:14:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f599ef4eb80 10 client.0 _ll_register_callbacks cb 0x5594d36667a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f598bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391a1b0 0x5594d3923c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f598bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391a1b0 0x5594d3923c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37570/0 (socket says 172.21.15.92:37570) 2023-10-16T13:14:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f598bfff700 1 -- 172.21.15.92:0/1596011933 learned_addr learned my addr 172.21.15.92:0/1596011933 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f5990b00700 1 --2- 172.21.15.92:0/1596011933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d3919850 0x5594d39236d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:10.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f5991301700 1 --2- 172.21.15.92:0/1596011933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d391b0a0 0x5594d392ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:10.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f598bfff700 1 -- 172.21.15.92:0/1596011933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d391b0a0 msgr2=0x5594d392ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:10.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f598bfff700 1 --2- 172.21.15.92:0/1596011933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d391b0a0 0x5594d392ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f598bfff700 1 -- 172.21.15.92:0/1596011933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d3919850 msgr2=0x5594d39236d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:10.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f598bfff700 1 --2- 172.21.15.92:0/1596011933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d3919850 0x5594d39236d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f598bfff700 1 -- 172.21.15.92:0/1596011933 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f598c109c40 con 0x5594d391a1b0 2023-10-16T13:14:10.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.791+0000 7f5990b00700 1 --2- 172.21.15.92:0/1596011933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d3919850 0x5594d39236d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:14:10.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.792+0000 7f598bfff700 1 --2- 172.21.15.92:0/1596011933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391a1b0 0x5594d3923c10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5978007db0 tx=0x7f59780116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba38d29ae85b755 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:10.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.792+0000 7f596bfff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:10.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.792+0000 7f596bfff700 1 -- 172.21.15.92:0/1596011933 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978012450 con 0x5594d391a1b0 2023-10-16T13:14:10.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.792+0000 7f596bfff700 1 -- 172.21.15.92:0/1596011933 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f59780125b0 con 0x5594d391a1b0 2023-10-16T13:14:10.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.792+0000 7f599ef4eb80 1 -- 172.21.15.92:0/1596011933 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594d3871e90 con 0x5594d391a1b0 2023-10-16T13:14:10.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.792+0000 7f596bfff700 1 -- 172.21.15.92:0/1596011933 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5978012770 con 0x5594d391a1b0 2023-10-16T13:14:10.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.792+0000 7f599ef4eb80 10 client.15678 fetch_fsmap learned FSMap version 27 2023-10-16T13:14:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.792+0000 7f599ef4eb80 1 -- 172.21.15.92:0/1596011933 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5594d3697d80 con 0x5594d391a1b0 2023-10-16T13:14:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.792+0000 7f596bfff700 1 -- 172.21.15.92:0/1596011933 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5594d3871e90 con 0x5594d391a1b0 2023-10-16T13:14:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.792+0000 7f596bfff700 1 -- 172.21.15.92:0/1596011933 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f597801ba40 con 0x5594d391a1b0 2023-10-16T13:14:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.792+0000 7f599ef4eb80 10 client.15678 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:14:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.792+0000 7f599ef4eb80 10 client.15678 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.792+0000 7f599ef4eb80 20 client.15678 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.792+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/1596011933 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5594d392f520 0x5594d3931940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.792+0000 7f599ef4eb80 4 client.15678 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:14:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.792+0000 7f599ef4eb80 1 -- 172.21.15.92:0/1596011933 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594d38e9bb0 con 0x5594d392f520 2023-10-16T13:14:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.793+0000 7f5990b00700 1 --2- 172.21.15.92:0/1596011933 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5594d392f520 0x5594d3931940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.793+0000 7f596bfff700 10 client.15678 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.793+0000 7f5990b00700 1 --2- 172.21.15.92:0/1596011933 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5594d392f520 0x5594d3931940 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cda22c83edabcd93 server_cookie=11959c24a42623bd in_seq=0 out_seq=0 2023-10-16T13:14:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.794+0000 7f596bfff700 1 -- 172.21.15.92:0/1596011933 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5594d38e9bb0 con 0x5594d392f520 2023-10-16T13:14:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.794+0000 7f596bfff700 10 client.15678 handle_command_reply: tid=0 2023-10-16T13:14:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.794+0000 7f599ef4eb80 1 client.15678 shutdown 2023-10-16T13:14:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.794+0000 7f599ef4eb80 1 -- 172.21.15.92:0/1596011933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391a1b0 msgr2=0x5594d3923c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.794+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/1596011933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391a1b0 0x5594d3923c10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5978007db0 tx=0x7f59780116c0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.794+0000 7f599ef4eb80 1 -- 172.21.15.92:0/1596011933 shutdown_connections 2023-10-16T13:14:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.794+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/1596011933 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5594d392f520 0x5594d3931940 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.794+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/1596011933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d391b0a0 0x5594d392ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.794+0000 7f596bfff700 0 client.15678 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.794+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/1596011933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d3919850 0x5594d39236d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.794+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/1596011933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391a1b0 0x5594d3923c10 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.794+0000 7f599ef4eb80 1 -- 172.21.15.92:0/1596011933 >> 172.21.15.92:0/1596011933 conn(0x5594d3847d70 msgr2=0x5594d3914830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.794+0000 7f599ef4eb80 1 -- 172.21.15.92:0/1596011933 shutdown_connections 2023-10-16T13:14:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.794+0000 7f599ef4eb80 1 -- 172.21.15.92:0/1596011933 wait complete. 2023-10-16T13:14:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.794+0000 7f599ef4eb80 20 client.15678 trim_cache size 0 max 16384 2023-10-16T13:14:10.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.809+0000 7f599ef4eb80 1 Processor -- start 2023-10-16T13:14:10.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.809+0000 7f599ef4eb80 1 -- start start 2023-10-16T13:14:10.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.809+0000 7f599ef4eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d3919850 0x5594d39236d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:10.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.809+0000 7f599ef4eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d391a1b0 0x5594d3923c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:10.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.809+0000 7f599ef4eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391b0a0 0x5594d392ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:10.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.809+0000 7f599ef4eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d36ed8c0 con 0x5594d391b0a0 2023-10-16T13:14:10.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.809+0000 7f599ef4eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d391b920 con 0x5594d3919850 2023-10-16T13:14:10.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.809+0000 7f599ef4eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d3919490 con 0x5594d391a1b0 2023-10-16T13:14:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.809+0000 7f5991301700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391b0a0 0x5594d392ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.809+0000 7f5991301700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391b0a0 0x5594d392ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37580/0 (socket says 172.21.15.92:37580) 2023-10-16T13:14:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.809+0000 7f5991301700 1 -- 172.21.15.92:0/656119745 learned_addr learned my addr 172.21.15.92:0/656119745 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.809+0000 7f5990b00700 1 --2- 172.21.15.92:0/656119745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d3919850 0x5594d39236d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.809+0000 7f598bfff700 1 --2- 172.21.15.92:0/656119745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d391a1b0 0x5594d3923c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.809+0000 7f5991301700 1 -- 172.21.15.92:0/656119745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d391a1b0 msgr2=0x5594d3923c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.809+0000 7f5991301700 1 --2- 172.21.15.92:0/656119745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d391a1b0 0x5594d3923c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.809+0000 7f5991301700 1 -- 172.21.15.92:0/656119745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d3919850 msgr2=0x5594d39236d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.809+0000 7f5991301700 1 --2- 172.21.15.92:0/656119745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d3919850 0x5594d39236d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.809+0000 7f5991301700 1 -- 172.21.15.92:0/656119745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594d3680c00 con 0x5594d391b0a0 2023-10-16T13:14:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.809+0000 7f5991301700 1 --2- 172.21.15.92:0/656119745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391b0a0 0x5594d392ac10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5984095d00 tx=0x7f5984099340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d275b1a313428c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.810+0000 7f59777fe700 1 -- 172.21.15.92:0/656119745 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984099f00 con 0x5594d391b0a0 2023-10-16T13:14:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.810+0000 7f59777fe700 1 -- 172.21.15.92:0/656119745 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5984099800 con 0x5594d391b0a0 2023-10-16T13:14:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.810+0000 7f59777fe700 1 -- 172.21.15.92:0/656119745 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984095f10 con 0x5594d391b0a0 2023-10-16T13:14:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.810+0000 7f599ef4eb80 1 -- 172.21.15.92:0/656119745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391b0a0 msgr2=0x5594d392ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.810+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/656119745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391b0a0 0x5594d392ac10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5984095d00 tx=0x7f5984099340 comp rx=0 tx=0).stop 2023-10-16T13:14:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.810+0000 7f599ef4eb80 1 -- 172.21.15.92:0/656119745 shutdown_connections 2023-10-16T13:14:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.810+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/656119745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391b0a0 0x5594d392ac10 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.810+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/656119745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d3919850 0x5594d39236d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.810+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/656119745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d391a1b0 0x5594d3923c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.810+0000 7f599ef4eb80 1 -- 172.21.15.92:0/656119745 >> 172.21.15.92:0/656119745 conn(0x5594d3847d70 msgr2=0x5594d39214b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.810+0000 7f599ef4eb80 1 -- 172.21.15.92:0/656119745 shutdown_connections 2023-10-16T13:14:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.810+0000 7f599ef4eb80 1 -- 172.21.15.92:0/656119745 wait complete. 2023-10-16T13:14:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.811+0000 7f599ef4eb80 1 -- start start 2023-10-16T13:14:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.811+0000 7f599ef4eb80 1 Processor -- start 2023-10-16T13:14:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.811+0000 7f599ef4eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d3919850 0x5594d39287c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.811+0000 7f599ef4eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d391a1b0 0x5594d3928d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.811+0000 7f599ef4eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391b0a0 0x5594d3929d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.811+0000 7f599ef4eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d392a250 con 0x5594d391b0a0 2023-10-16T13:14:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.811+0000 7f599ef4eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d392a3c0 con 0x5594d391a1b0 2023-10-16T13:14:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.811+0000 7f599ef4eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d392a580 con 0x5594d3919850 2023-10-16T13:14:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.811+0000 7f599ef4eb80 10 client.0 _ll_register_callbacks cb 0x7f5978007890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.811+0000 7f5991301700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391b0a0 0x5594d3929d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.812+0000 7f5991301700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391b0a0 0x5594d3929d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37586/0 (socket says 172.21.15.92:37586) 2023-10-16T13:14:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.812+0000 7f5991301700 1 -- 172.21.15.92:0/2211931326 learned_addr learned my addr 172.21.15.92:0/2211931326 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:10.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.812+0000 7f598bfff700 1 --2- 172.21.15.92:0/2211931326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d391a1b0 0x5594d3928d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:10.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.812+0000 7f5990b00700 1 --2- 172.21.15.92:0/2211931326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d3919850 0x5594d39287c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:10.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.812+0000 7f5991301700 1 -- 172.21.15.92:0/2211931326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d3919850 msgr2=0x5594d39287c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:10.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.812+0000 7f5991301700 1 --2- 172.21.15.92:0/2211931326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d3919850 0x5594d39287c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.812+0000 7f5991301700 1 -- 172.21.15.92:0/2211931326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d391a1b0 msgr2=0x5594d3928d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:10.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.812+0000 7f5991301700 1 --2- 172.21.15.92:0/2211931326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d391a1b0 0x5594d3928d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:10.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.812+0000 7f5991301700 1 -- 172.21.15.92:0/2211931326 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f598c19f530 con 0x5594d391b0a0 2023-10-16T13:14:10.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.812+0000 7f598bfff700 1 --2- 172.21.15.92:0/2211931326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d391a1b0 0x5594d3928d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:10.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.812+0000 7f5991301700 1 --2- 172.21.15.92:0/2211931326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391b0a0 0x5594d3929d10 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5984099500 tx=0x7f5984007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69c100aa555d1a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:10.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.812+0000 7f596bfff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:10.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.812+0000 7f596bfff700 1 -- 172.21.15.92:0/2211931326 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59840a1b90 con 0x5594d391b0a0 2023-10-16T13:14:10.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.812+0000 7f596bfff700 1 -- 172.21.15.92:0/2211931326 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f598409d950 con 0x5594d391b0a0 2023-10-16T13:14:10.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.812+0000 7f599ef4eb80 1 -- 172.21.15.92:0/2211931326 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f598001e040 con 0x5594d391b0a0 2023-10-16T13:14:10.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.812+0000 7f596bfff700 1 -- 172.21.15.92:0/2211931326 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59840840e0 con 0x5594d391b0a0 2023-10-16T13:14:10.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.812+0000 7f599ef4eb80 10 client.15684 fetch_fsmap learned FSMap version 27 2023-10-16T13:14:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.812+0000 7f599ef4eb80 1 -- 172.21.15.92:0/2211931326 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5594d36be1f0 con 0x5594d391b0a0 2023-10-16T13:14:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.812+0000 7f596bfff700 1 -- 172.21.15.92:0/2211931326 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f598001e040 con 0x5594d391b0a0 2023-10-16T13:14:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.813+0000 7f596bfff700 1 -- 172.21.15.92:0/2211931326 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5984099a60 con 0x5594d391b0a0 2023-10-16T13:14:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.813+0000 7f599ef4eb80 10 client.15684 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:14:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.813+0000 7f599ef4eb80 10 client.15684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.813+0000 7f599ef4eb80 20 client.15684 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.813+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/2211931326 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5594d3983d80 0x5594d39861a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.813+0000 7f599ef4eb80 4 client.15684 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-16T13:14:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.813+0000 7f599ef4eb80 1 -- 172.21.15.92:0/2211931326 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5594d3865df0 con 0x5594d3983d80 2023-10-16T13:14:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.813+0000 7f5990b00700 1 --2- 172.21.15.92:0/2211931326 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5594d3983d80 0x5594d39861a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.813+0000 7f596bfff700 10 client.15684 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:10.813+0000 7f5990b00700 1 --2- 172.21.15.92:0/2211931326 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5594d3983d80 0x5594d39861a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78a74487786ce9ac server_cookie=3876a81b8a5367aa in_seq=0 out_seq=0 2023-10-16T13:14:10.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:10 smithi152 ceph-mon[104423]: pgmap v332: 97 pgs: 97 active+clean; 96 MiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 8.1 MiB/s wr, 161 op/s 2023-10-16T13:14:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.541+0000 7f596bfff700 1 -- 172.21.15.92:0/2211931326 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5594d3865df0 con 0x5594d3983d80 2023-10-16T13:14:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.541+0000 7f596bfff700 10 client.15684 handle_command_reply: tid=0 2023-10-16T13:14:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.541+0000 7f599ef4eb80 1 client.15684 shutdown 2023-10-16T13:14:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.541+0000 7f599ef4eb80 1 -- 172.21.15.92:0/2211931326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391b0a0 msgr2=0x5594d3929d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.541+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/2211931326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391b0a0 0x5594d3929d10 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5984099500 tx=0x7f5984007420 comp rx=0 tx=0).stop 2023-10-16T13:14:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.541+0000 7f599ef4eb80 1 -- 172.21.15.92:0/2211931326 shutdown_connections 2023-10-16T13:14:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.541+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/2211931326 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5594d3983d80 0x5594d39861a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.541+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/2211931326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594d391b0a0 0x5594d3929d10 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.541+0000 7f596bfff700 0 client.15684 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.541+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/2211931326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5594d3919850 0x5594d39287c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.541+0000 7f599ef4eb80 1 --2- 172.21.15.92:0/2211931326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594d391a1b0 0x5594d3928d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.541+0000 7f599ef4eb80 1 -- 172.21.15.92:0/2211931326 >> 172.21.15.92:0/2211931326 conn(0x5594d3847d70 msgr2=0x5594d39214b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.541+0000 7f599ef4eb80 1 -- 172.21.15.92:0/2211931326 shutdown_connections 2023-10-16T13:14:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.541+0000 7f599ef4eb80 1 -- 172.21.15.92:0/2211931326 wait complete. 2023-10-16T13:14:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.541+0000 7f599ef4eb80 20 client.15684 trim_cache size 0 max 16384 2023-10-16T13:14:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2023-10-16T13:14:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2023-10-16T13:14:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2023-10-16T13:14:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2023-10-16T13:14:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.542+0000 7f5992d64700 1 -- 172.21.15.92:0/366033458 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f597c0a1480 msgr2=0x7f597c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.542+0000 7f5992d64700 1 --2- 172.21.15.92:0/366033458 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f597c0a1480 0x7f597c0a3940 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5980006010 tx=0x7f598000b540 comp rx=0 tx=0).stop 2023-10-16T13:14:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.542+0000 7f5992d64700 1 -- 172.21.15.92:0/366033458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f598c106be0 msgr2=0x7f598c198100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.542+0000 7f5992d64700 1 --2- 172.21.15.92:0/366033458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f598c106be0 0x7f598c198100 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5984007ee0 tx=0x7f598400d3b0 comp rx=0 tx=0).stop 2023-10-16T13:14:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.542+0000 7f5992d64700 1 -- 172.21.15.92:0/366033458 shutdown_connections 2023-10-16T13:14:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.542+0000 7f5992d64700 1 --2- 172.21.15.92:0/366033458 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f597c0a1480 0x7f597c0a3940 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.542+0000 7f5992d64700 1 --2- 172.21.15.92:0/366033458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f598c106be0 0x7f598c198100 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.542+0000 7f5992d64700 1 --2- 172.21.15.92:0/366033458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f598c101980 0x7f598c196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.542+0000 7f5992d64700 1 --2- 172.21.15.92:0/366033458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f598c1042b0 0x7f598c197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.542+0000 7f5992d64700 1 -- 172.21.15.92:0/366033458 >> 172.21.15.92:0/366033458 conn(0x7f598c0fb330 msgr2=0x7f598c1025f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.542+0000 7f5992d64700 1 -- 172.21.15.92:0/366033458 shutdown_connections 2023-10-16T13:14:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:11.542+0000 7f5992d64700 1 -- 172.21.15.92:0/366033458 wait complete. 2023-10-16T13:14:12.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:12 smithi092 ceph-mon[99542]: pgmap v333: 97 pgs: 97 active+clean; 96 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 8.1 MiB/s wr, 165 op/s 2023-10-16T13:14:12.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:12 smithi118 ceph-mon[103969]: pgmap v333: 97 pgs: 97 active+clean; 96 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 8.1 MiB/s wr, 165 op/s 2023-10-16T13:14:12.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:12 smithi152 ceph-mon[104423]: pgmap v333: 97 pgs: 97 active+clean; 96 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 8.1 MiB/s wr, 165 op/s 2023-10-16T13:14:13.101 INFO:tasks.workunit.client.0.smithi092.stderr:+ tar cf doc.tar linux-4.0.5 2023-10-16T13:14:14.002 INFO:tasks.workunit.client.0.smithi092.stderr:+ tar xf doc.tar 2023-10-16T13:14:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:14 smithi092 ceph-mon[99542]: pgmap v334: 97 pgs: 97 active+clean; 98 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 8.2 MiB/s wr, 595 op/s 2023-10-16T13:14:14.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:14 smithi118 ceph-mon[103969]: pgmap v334: 97 pgs: 97 active+clean; 98 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 8.2 MiB/s wr, 595 op/s 2023-10-16T13:14:14.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:14 smithi152 ceph-mon[104423]: pgmap v334: 97 pgs: 97 active+clean; 98 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 8.2 MiB/s wr, 595 op/s 2023-10-16T13:14:16.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:16 smithi092 ceph-mon[99542]: pgmap v335: 97 pgs: 97 active+clean; 95 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 5.0 MiB/s wr, 707 op/s 2023-10-16T13:14:16.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:16 smithi118 ceph-mon[103969]: pgmap v335: 97 pgs: 97 active+clean; 95 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 5.0 MiB/s wr, 707 op/s 2023-10-16T13:14:16.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:16 smithi152 ceph-mon[104423]: pgmap v335: 97 pgs: 97 active+clean; 95 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 5.0 MiB/s wr, 707 op/s 2023-10-16T13:14:18.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:18 smithi092 ceph-mon[99542]: pgmap v336: 97 pgs: 97 active+clean; 91 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 2.7 MiB/s wr, 834 op/s 2023-10-16T13:14:18.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:18 smithi118 ceph-mon[103969]: pgmap v336: 97 pgs: 97 active+clean; 91 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 2.7 MiB/s wr, 834 op/s 2023-10-16T13:14:18.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:18 smithi152 ceph-mon[104423]: pgmap v336: 97 pgs: 97 active+clean; 91 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 2.7 MiB/s wr, 834 op/s 2023-10-16T13:14:20.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:20 smithi092 ceph-mon[99542]: pgmap v337: 97 pgs: 97 active+clean; 91 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 638 KiB/s wr, 786 op/s 2023-10-16T13:14:20.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:20 smithi118 ceph-mon[103969]: pgmap v337: 97 pgs: 97 active+clean; 91 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 638 KiB/s wr, 786 op/s 2023-10-16T13:14:20.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:20 smithi152 ceph-mon[104423]: pgmap v337: 97 pgs: 97 active+clean; 91 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 638 KiB/s wr, 786 op/s 2023-10-16T13:14:21.613 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-16T13:14:21.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.741+0000 7fe4dacc0700 1 -- 172.21.15.92:0/1226643067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4d4101940 msgr2=0x7fe4d41081f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:21.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.741+0000 7fe4dacc0700 1 --2- 172.21.15.92:0/1226643067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4d4101940 0x7fe4d41081f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00b0d0 tx=0x7fe4cc00b3e0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.742+0000 7fe4dacc0700 1 -- 172.21.15.92:0/1226643067 shutdown_connections 2023-10-16T13:14:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.742+0000 7fe4dacc0700 1 --2- 172.21.15.92:0/1226643067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4d4101940 0x7fe4d41081f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.742+0000 7fe4dacc0700 1 --2- 172.21.15.92:0/1226643067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4d40ffdb0 0x7fe4d41001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.742+0000 7fe4dacc0700 1 --2- 172.21.15.92:0/1226643067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4d4100fa0 0x7fe4d4101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.742+0000 7fe4dacc0700 1 -- 172.21.15.92:0/1226643067 >> 172.21.15.92:0/1226643067 conn(0x7fe4d40fb320 msgr2=0x7fe4d40fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.742+0000 7fe4dacc0700 1 -- 172.21.15.92:0/1226643067 shutdown_connections 2023-10-16T13:14:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.742+0000 7fe4dacc0700 1 -- 172.21.15.92:0/1226643067 wait complete. 2023-10-16T13:14:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.742+0000 7fe4dacc0700 1 Processor -- start 2023-10-16T13:14:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.742+0000 7fe4dacc0700 1 -- start start 2023-10-16T13:14:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.742+0000 7fe4dacc0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4d40ffdb0 0x7fe4d4196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.742+0000 7fe4dacc0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4d4100fa0 0x7fe4d4197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.742+0000 7fe4dacc0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4d4101940 0x7fe4d419e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.742+0000 7fe4dacc0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d419e870 con 0x7fe4d4101940 2023-10-16T13:14:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.742+0000 7fe4dacc0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d419e9e0 con 0x7fe4d40ffdb0 2023-10-16T13:14:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.742+0000 7fe4dacc0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d419eba0 con 0x7fe4d4100fa0 2023-10-16T13:14:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.743+0000 7fe4d925d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4d4101940 0x7fe4d419e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.743+0000 7fe4d925d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4d4101940 0x7fe4d419e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37600/0 (socket says 172.21.15.92:37600) 2023-10-16T13:14:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.743+0000 7fe4d925d700 1 -- 172.21.15.92:0/650226940 learned_addr learned my addr 172.21.15.92:0/650226940 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.743+0000 7fe4d8a5c700 1 --2- 172.21.15.92:0/650226940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4d40ffdb0 0x7fe4d4196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.743+0000 7fe4d3fff700 1 --2- 172.21.15.92:0/650226940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4d4100fa0 0x7fe4d4197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.743+0000 7fe4d8a5c700 1 -- 172.21.15.92:0/650226940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4d4100fa0 msgr2=0x7fe4d4197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.743+0000 7fe4d8a5c700 1 --2- 172.21.15.92:0/650226940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4d4100fa0 0x7fe4d4197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.743+0000 7fe4d8a5c700 1 -- 172.21.15.92:0/650226940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4d4101940 msgr2=0x7fe4d419e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.743+0000 7fe4d8a5c700 1 --2- 172.21.15.92:0/650226940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4d4101940 0x7fe4d419e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.743+0000 7fe4d8a5c700 1 -- 172.21.15.92:0/650226940 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc009d00 con 0x7fe4d40ffdb0 2023-10-16T13:14:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.743+0000 7fe4d925d700 1 --2- 172.21.15.92:0/650226940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4d4101940 0x7fe4d419e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:21.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.743+0000 7fe4d8a5c700 1 --2- 172.21.15.92:0/650226940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4d40ffdb0 0x7fe4d4196d30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800e9c0 tx=0x7fe4c800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:21.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.743+0000 7fe4d1ffb700 1 -- 172.21.15.92:0/650226940 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8004220 con 0x7fe4d40ffdb0 2023-10-16T13:14:21.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.743+0000 7fe4dacc0700 1 -- 172.21.15.92:0/650226940 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d419ee80 con 0x7fe4d40ffdb0 2023-10-16T13:14:21.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.743+0000 7fe4d1ffb700 1 -- 172.21.15.92:0/650226940 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe4c800cca0 con 0x7fe4d40ffdb0 2023-10-16T13:14:21.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.743+0000 7fe4d1ffb700 1 -- 172.21.15.92:0/650226940 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8003c50 con 0x7fe4d40ffdb0 2023-10-16T13:14:21.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.743+0000 7fe4dacc0700 1 -- 172.21.15.92:0/650226940 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d419f2b0 con 0x7fe4d40ffdb0 2023-10-16T13:14:21.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.745+0000 7fe4d1ffb700 1 -- 172.21.15.92:0/650226940 <== mon.2 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe4c8004380 con 0x7fe4d40ffdb0 2023-10-16T13:14:21.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.746+0000 7fe4d1ffb700 1 --2- 172.21.15.92:0/650226940 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe4c40a1480 0x7fe4c40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.746+0000 7fe4d3fff700 1 --2- 172.21.15.92:0/650226940 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe4c40a1480 0x7fe4c40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.746+0000 7fe4d1ffb700 1 -- 172.21.15.92:0/650226940 <== mon.2 v2:172.21.15.118:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe4c8014070 con 0x7fe4d40ffdb0 2023-10-16T13:14:21.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.747+0000 7fe4d3fff700 1 --2- 172.21.15.92:0/650226940 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe4c40a1480 0x7fe4c40a3940 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000ac50 tx=0x7fe4c000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:21.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.747+0000 7fe4e6eaab80 1 Processor -- start 2023-10-16T13:14:21.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.747+0000 7fe4e6eaab80 1 -- start start 2023-10-16T13:14:21.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.747+0000 7fe4e6eaab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d3ee20 0x55b7f3d3f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.747+0000 7fe4e6eaab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3f780 0x55b7f3d40040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.747+0000 7fe4e6eaab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 0x55b7f3d40aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.747+0000 7fe4e6eaab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f3cb3c70 con 0x55b7f3d40620 2023-10-16T13:14:21.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.747+0000 7fe4e6eaab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f3c98c60 con 0x55b7f3d3ee20 2023-10-16T13:14:21.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.747+0000 7fe4e6eaab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f3c96580 con 0x55b7f3d3f780 2023-10-16T13:14:21.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.748+0000 7fe4d925d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 0x55b7f3d40aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.748+0000 7fe4d8a5c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d3ee20 0x55b7f3d3f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.748+0000 7fe4d8a5c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d3ee20 0x55b7f3d3f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:38412/0 (socket says 172.21.15.92:38412) 2023-10-16T13:14:21.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.748+0000 7fe4d8a5c700 1 -- 172.21.15.92:0/2065538613 learned_addr learned my addr 172.21.15.92:0/2065538613 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:21.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.748+0000 7fe4d3fff700 1 --2- 172.21.15.92:0/2065538613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3f780 0x55b7f3d40040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.748+0000 7fe4d8a5c700 1 -- 172.21.15.92:0/2065538613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3f780 msgr2=0x55b7f3d40040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:21.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.748+0000 7fe4d8a5c700 1 --2- 172.21.15.92:0/2065538613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3f780 0x55b7f3d40040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.748+0000 7fe4d8a5c700 1 -- 172.21.15.92:0/2065538613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 msgr2=0x55b7f3d40aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:21.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.748+0000 7fe4d8a5c700 1 --2- 172.21.15.92:0/2065538613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 0x55b7f3d40aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.748+0000 7fe4d8a5c700 1 -- 172.21.15.92:0/2065538613 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7f3c4f3f0 con 0x55b7f3d3ee20 2023-10-16T13:14:21.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.748+0000 7fe4d925d700 1 --2- 172.21.15.92:0/2065538613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 0x55b7f3d40aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:21.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.748+0000 7fe4d8a5c700 1 --2- 172.21.15.92:0/2065538613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d3ee20 0x55b7f3d3f240 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe4c80a2090 tx=0x7fe4c8099c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec996090e0c3e1be server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:21.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.748+0000 7fe4beffd700 1 -- 172.21.15.92:0/2065538613 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c809e170 con 0x55b7f3d3ee20 2023-10-16T13:14:21.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.748+0000 7fe4beffd700 1 -- 172.21.15.92:0/2065538613 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe4c809e380 con 0x55b7f3d3ee20 2023-10-16T13:14:21.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.748+0000 7fe4beffd700 1 -- 172.21.15.92:0/2065538613 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c80985d0 con 0x55b7f3d3ee20 2023-10-16T13:14:21.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.749+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/2065538613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d3ee20 msgr2=0x55b7f3d3f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:21.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.749+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/2065538613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d3ee20 0x55b7f3d3f240 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe4c80a2090 tx=0x7fe4c8099c10 comp rx=0 tx=0).stop 2023-10-16T13:14:21.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.749+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/2065538613 shutdown_connections 2023-10-16T13:14:21.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.749+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/2065538613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 0x55b7f3d40aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.749+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/2065538613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d3ee20 0x55b7f3d3f240 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.749+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/2065538613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3f780 0x55b7f3d40040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.749+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/2065538613 >> 172.21.15.92:0/2065538613 conn(0x55b7f3c6cdd0 msgr2=0x55b7f3d39fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:21.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.749+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/2065538613 shutdown_connections 2023-10-16T13:14:21.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.749+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/2065538613 wait complete. 2023-10-16T13:14:21.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.749+0000 7fe4e6eaab80 1 -- start start 2023-10-16T13:14:21.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.749+0000 7fe4e6eaab80 1 Processor -- start 2023-10-16T13:14:21.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4e6eaab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d3ee20 0x55b7f3d48d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4e6eaab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3f780 0x55b7f3d492a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4e6eaab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d40620 0x55b7f3d502e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4e6eaab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f3c91e70 con 0x55b7f3d3ee20 2023-10-16T13:14:21.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4e6eaab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f3c2e710 con 0x55b7f3d40620 2023-10-16T13:14:21.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4e6eaab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f3c2e3b0 con 0x55b7f3d3f780 2023-10-16T13:14:21.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4e6eaab80 10 client.0 _ll_register_callbacks cb 0x55b7f3a8b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:21.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4d8a5c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d3ee20 0x55b7f3d48d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4d8a5c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d3ee20 0x55b7f3d48d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37610/0 (socket says 172.21.15.92:37610) 2023-10-16T13:14:21.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4d8a5c700 1 -- 172.21.15.92:0/3492009907 learned_addr learned my addr 172.21.15.92:0/3492009907 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:21.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4d925d700 1 --2- 172.21.15.92:0/3492009907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d40620 0x55b7f3d502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4d3fff700 1 --2- 172.21.15.92:0/3492009907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3f780 0x55b7f3d492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4d8a5c700 1 -- 172.21.15.92:0/3492009907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3f780 msgr2=0x55b7f3d492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:21.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4d8a5c700 1 --2- 172.21.15.92:0/3492009907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3f780 0x55b7f3d492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4d8a5c700 1 -- 172.21.15.92:0/3492009907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d40620 msgr2=0x55b7f3d502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:21.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4d8a5c700 1 --2- 172.21.15.92:0/3492009907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d40620 0x55b7f3d502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4d8a5c700 1 -- 172.21.15.92:0/3492009907 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d4108b40 con 0x55b7f3d3ee20 2023-10-16T13:14:21.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4d8a5c700 1 --2- 172.21.15.92:0/3492009907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d3ee20 0x55b7f3d48d60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009f90 tx=0x7fe4c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad20990fb9fca54 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:21.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4b3fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:21.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4b3fff700 1 -- 172.21.15.92:0/3492009907 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c809e170 con 0x55b7f3d3ee20 2023-10-16T13:14:21.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4b3fff700 1 -- 172.21.15.92:0/3492009907 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe4c8094e40 con 0x55b7f3d3ee20 2023-10-16T13:14:21.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.750+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/3492009907 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7f3c96ef0 con 0x55b7f3d3ee20 2023-10-16T13:14:21.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.751+0000 7fe4b3fff700 1 -- 172.21.15.92:0/3492009907 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4c800ce10 con 0x55b7f3d3ee20 2023-10-16T13:14:21.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.751+0000 7fe4e6eaab80 10 client.15696 fetch_fsmap learned FSMap version 27 2023-10-16T13:14:21.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.751+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/3492009907 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fe4d419f2b0 con 0x55b7f3d3ee20 2023-10-16T13:14:21.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.751+0000 7fe4b3fff700 1 -- 172.21.15.92:0/3492009907 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe4c807a020 con 0x55b7f3d3ee20 2023-10-16T13:14:21.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.751+0000 7fe4b3fff700 1 -- 172.21.15.92:0/3492009907 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe4c80833c0 con 0x55b7f3d3ee20 2023-10-16T13:14:21.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.751+0000 7fe4e6eaab80 10 client.15696 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:14:21.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.751+0000 7fe4e6eaab80 10 client.15696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:21.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.751+0000 7fe4e6eaab80 20 client.15696 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:21.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.751+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/3492009907 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55b7f3d54720 0x55b7f3d56b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.751+0000 7fe4e6eaab80 4 client.15696 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:14:21.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.751+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/3492009907 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b7f3d0ec10 con 0x55b7f3d54720 2023-10-16T13:14:21.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.751+0000 7fe4d3fff700 1 --2- 172.21.15.92:0/3492009907 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55b7f3d54720 0x55b7f3d56b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.751+0000 7fe4b3fff700 10 client.15696 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:21.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.751+0000 7fe4d3fff700 1 --2- 172.21.15.92:0/3492009907 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55b7f3d54720 0x55b7f3d56b10 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42fe979125284e3b server_cookie=9c912a1d0a856f86 in_seq=0 out_seq=0 2023-10-16T13:14:21.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.753+0000 7fe4b3fff700 1 -- 172.21.15.92:0/3492009907 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b7f3d0ec10 con 0x55b7f3d54720 2023-10-16T13:14:21.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.753+0000 7fe4b3fff700 10 client.15696 handle_command_reply: tid=0 2023-10-16T13:14:21.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.753+0000 7fe4e6eaab80 1 client.15696 shutdown 2023-10-16T13:14:21.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.754+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/3492009907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d3ee20 msgr2=0x55b7f3d48d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:21.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.754+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/3492009907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d3ee20 0x55b7f3d48d60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009f90 tx=0x7fe4c8004750 comp rx=0 tx=0).stop 2023-10-16T13:14:21.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.754+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/3492009907 shutdown_connections 2023-10-16T13:14:21.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.754+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/3492009907 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55b7f3d54720 0x55b7f3d56b10 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.754+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/3492009907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d3ee20 0x55b7f3d48d60 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.754+0000 7fe4b3fff700 0 client.15696 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:21.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.754+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/3492009907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d40620 0x55b7f3d502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.754+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/3492009907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3f780 0x55b7f3d492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.754+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/3492009907 >> 172.21.15.92:0/3492009907 conn(0x55b7f3c6cdd0 msgr2=0x55b7f3d39bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:21.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.754+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/3492009907 shutdown_connections 2023-10-16T13:14:21.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.754+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/3492009907 wait complete. 2023-10-16T13:14:21.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.754+0000 7fe4e6eaab80 20 client.15696 trim_cache size 0 max 16384 2023-10-16T13:14:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.771+0000 7fe4e6eaab80 1 Processor -- start 2023-10-16T13:14:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.771+0000 7fe4e6eaab80 1 -- start start 2023-10-16T13:14:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.771+0000 7fe4e6eaab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3ee20 0x55b7f3d46ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.771+0000 7fe4e6eaab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d3f780 0x55b7f3d39b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.771+0000 7fe4e6eaab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 0x55b7f3d3a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.771+0000 7fe4e6eaab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f3b12920 con 0x55b7f3d40620 2023-10-16T13:14:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.771+0000 7fe4e6eaab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f3d48210 con 0x55b7f3d3f780 2023-10-16T13:14:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.771+0000 7fe4e6eaab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f3d39950 con 0x55b7f3d3ee20 2023-10-16T13:14:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.772+0000 7fe4d925d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 0x55b7f3d3a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.772+0000 7fe4d925d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 0x55b7f3d3a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37622/0 (socket says 172.21.15.92:37622) 2023-10-16T13:14:21.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.772+0000 7fe4d3fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d3f780 0x55b7f3d39b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.772+0000 7fe4d925d700 1 -- 172.21.15.92:0/1808482826 learned_addr learned my addr 172.21.15.92:0/1808482826 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:21.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.772+0000 7fe4d8a5c700 1 --2- 172.21.15.92:0/1808482826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3ee20 0x55b7f3d46ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.772+0000 7fe4d925d700 1 -- 172.21.15.92:0/1808482826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3ee20 msgr2=0x55b7f3d46ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:21.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.772+0000 7fe4d925d700 1 --2- 172.21.15.92:0/1808482826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3ee20 0x55b7f3d46ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.772+0000 7fe4d925d700 1 -- 172.21.15.92:0/1808482826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d3f780 msgr2=0x55b7f3d39b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.772+0000 7fe4d925d700 1 --2- 172.21.15.92:0/1808482826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d3f780 0x55b7f3d39b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.772+0000 7fe4d925d700 1 -- 172.21.15.92:0/1808482826 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7f3abcde0 con 0x55b7f3d40620 2023-10-16T13:14:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.772+0000 7fe4d925d700 1 --2- 172.21.15.92:0/1808482826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 0x55b7f3d3a040 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00d010 tx=0x7fe4cc00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53513dc8281a8fdf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.772+0000 7fe4bf7fe700 1 -- 172.21.15.92:0/1808482826 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc00e040 con 0x55b7f3d40620 2023-10-16T13:14:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.772+0000 7fe4bf7fe700 1 -- 172.21.15.92:0/1808482826 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe4cc005110 con 0x55b7f3d40620 2023-10-16T13:14:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.772+0000 7fe4bf7fe700 1 -- 172.21.15.92:0/1808482826 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc01d680 con 0x55b7f3d40620 2023-10-16T13:14:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.773+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/1808482826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 msgr2=0x55b7f3d3a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.773+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/1808482826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 0x55b7f3d3a040 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00d010 tx=0x7fe4cc00bce0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.773+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/1808482826 shutdown_connections 2023-10-16T13:14:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.773+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/1808482826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 0x55b7f3d3a040 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.773+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/1808482826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3ee20 0x55b7f3d46ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.773+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/1808482826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d3f780 0x55b7f3d39b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.773+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/1808482826 >> 172.21.15.92:0/1808482826 conn(0x55b7f3c6cdd0 msgr2=0x55b7f3d39240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.773+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/1808482826 shutdown_connections 2023-10-16T13:14:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.773+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/1808482826 wait complete. 2023-10-16T13:14:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.773+0000 7fe4e6eaab80 1 -- start start 2023-10-16T13:14:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.773+0000 7fe4e6eaab80 1 Processor -- start 2023-10-16T13:14:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4e6eaab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d3ee20 0x55b7f3da4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4e6eaab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3f780 0x55b7f3da5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4e6eaab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 0x55b7f3dac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4e6eaab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f3dac800 con 0x55b7f3d40620 2023-10-16T13:14:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4e6eaab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f3dac940 con 0x55b7f3d3ee20 2023-10-16T13:14:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4e6eaab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f3dacad0 con 0x55b7f3d3f780 2023-10-16T13:14:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4e6eaab80 10 client.0 _ll_register_callbacks cb 0x7fe4c8005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4d8a5c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d3ee20 0x55b7f3da4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4d925d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 0x55b7f3dac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4d8a5c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d3ee20 0x55b7f3da4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:38432/0 (socket says 172.21.15.92:38432) 2023-10-16T13:14:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4d8a5c700 1 -- 172.21.15.92:0/289216571 learned_addr learned my addr 172.21.15.92:0/289216571 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4d925d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 0x55b7f3dac2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37628/0 (socket says 172.21.15.92:37628) 2023-10-16T13:14:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4d3fff700 1 --2- 172.21.15.92:0/289216571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3f780 0x55b7f3da5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4d925d700 1 -- 172.21.15.92:0/289216571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3f780 msgr2=0x55b7f3da5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:21.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4d925d700 1 --2- 172.21.15.92:0/289216571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3f780 0x55b7f3da5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4d925d700 1 -- 172.21.15.92:0/289216571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d3ee20 msgr2=0x55b7f3da4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:21.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4d925d700 1 --2- 172.21.15.92:0/289216571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d3ee20 0x55b7f3da4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4d925d700 1 -- 172.21.15.92:0/289216571 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4cc00baa0 con 0x55b7f3d40620 2023-10-16T13:14:21.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4d8a5c700 1 --2- 172.21.15.92:0/289216571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d3ee20 0x55b7f3da4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:21.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4d925d700 1 --2- 172.21.15.92:0/289216571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 0x55b7f3dac2c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc007a30 tx=0x7fe4cc009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2310858a971d20cd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:21.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4b3fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:21.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4b3fff700 1 -- 172.21.15.92:0/289216571 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc00e040 con 0x55b7f3d40620 2023-10-16T13:14:21.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/289216571 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe4c809e380 con 0x55b7f3d40620 2023-10-16T13:14:21.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.774+0000 7fe4b3fff700 1 -- 172.21.15.92:0/289216571 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe4cc027430 con 0x55b7f3d40620 2023-10-16T13:14:21.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.775+0000 7fe4b3fff700 1 -- 172.21.15.92:0/289216571 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4cc0275f0 con 0x55b7f3d40620 2023-10-16T13:14:21.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.775+0000 7fe4e6eaab80 10 client.15702 fetch_fsmap learned FSMap version 27 2023-10-16T13:14:21.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.775+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/289216571 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b7f3aa5c60 con 0x55b7f3d40620 2023-10-16T13:14:21.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.775+0000 7fe4b3fff700 1 -- 172.21.15.92:0/289216571 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe4cc03b080 con 0x55b7f3d40620 2023-10-16T13:14:21.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.775+0000 7fe4b3fff700 1 -- 172.21.15.92:0/289216571 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe4cc019050 con 0x55b7f3d40620 2023-10-16T13:14:21.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.775+0000 7fe4e6eaab80 10 client.15702 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:14:21.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.775+0000 7fe4e6eaab80 10 client.15702 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:21.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.775+0000 7fe4e6eaab80 20 client.15702 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:21.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.775+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/289216571 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55b7f3dae200 0x55b7f3db05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.775+0000 7fe4e6eaab80 4 client.15702 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-16T13:14:21.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.775+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/289216571 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b7f3c8ae50 con 0x55b7f3dae200 2023-10-16T13:14:21.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.775+0000 7fe4d8a5c700 1 --2- 172.21.15.92:0/289216571 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55b7f3dae200 0x55b7f3db05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.776+0000 7fe4b3fff700 10 client.15702 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:21.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.776+0000 7fe4d8a5c700 1 --2- 172.21.15.92:0/289216571 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55b7f3dae200 0x55b7f3db05f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f849b05b7aa6b3 server_cookie=82e396184b99fcbd in_seq=0 out_seq=0 2023-10-16T13:14:21.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.777+0000 7fe4b3fff700 1 -- 172.21.15.92:0/289216571 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b7f3c8ae50 con 0x55b7f3dae200 2023-10-16T13:14:21.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.777+0000 7fe4b3fff700 10 client.15702 handle_command_reply: tid=0 2023-10-16T13:14:21.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.777+0000 7fe4e6eaab80 1 client.15702 shutdown 2023-10-16T13:14:21.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.777+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/289216571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 msgr2=0x55b7f3dac2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:21.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.777+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/289216571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 0x55b7f3dac2c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc007a30 tx=0x7fe4cc009510 comp rx=0 tx=0).stop 2023-10-16T13:14:21.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.777+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/289216571 shutdown_connections 2023-10-16T13:14:21.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.777+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/289216571 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55b7f3dae200 0x55b7f3db05f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.777+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/289216571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7f3d40620 0x55b7f3dac2c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.777+0000 7fe4b3fff700 0 client.15702 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:21.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.777+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/289216571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7f3d3ee20 0x55b7f3da4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.777+0000 7fe4e6eaab80 1 --2- 172.21.15.92:0/289216571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7f3d3f780 0x55b7f3da5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.777+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/289216571 >> 172.21.15.92:0/289216571 conn(0x55b7f3c6cdd0 msgr2=0x55b7f3d46ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:21.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.777+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/289216571 shutdown_connections 2023-10-16T13:14:21.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.777+0000 7fe4e6eaab80 1 -- 172.21.15.92:0/289216571 wait complete. 2023-10-16T13:14:21.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.778+0000 7fe4e6eaab80 20 client.15702 trim_cache size 0 max 16384 2023-10-16T13:14:21.797 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:14:21.797 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2023-10-16T13:14:21.798 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2023-10-16T13:14:21.798 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:14:21.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.778+0000 7fe4dacc0700 1 -- 172.21.15.92:0/650226940 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe4c40a1480 msgr2=0x7fe4c40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:21.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.778+0000 7fe4dacc0700 1 --2- 172.21.15.92:0/650226940 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe4c40a1480 0x7fe4c40a3940 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000ac50 tx=0x7fe4c000a380 comp rx=0 tx=0).stop 2023-10-16T13:14:21.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.778+0000 7fe4dacc0700 1 -- 172.21.15.92:0/650226940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4d40ffdb0 msgr2=0x7fe4d4196d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:21.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.778+0000 7fe4dacc0700 1 --2- 172.21.15.92:0/650226940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4d40ffdb0 0x7fe4d4196d30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800e9c0 tx=0x7fe4c800ecd0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.778+0000 7fe4dacc0700 1 -- 172.21.15.92:0/650226940 shutdown_connections 2023-10-16T13:14:21.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.778+0000 7fe4dacc0700 1 --2- 172.21.15.92:0/650226940 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe4c40a1480 0x7fe4c40a3940 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.778+0000 7fe4dacc0700 1 --2- 172.21.15.92:0/650226940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4d4101940 0x7fe4d419e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.778+0000 7fe4dacc0700 1 --2- 172.21.15.92:0/650226940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4d40ffdb0 0x7fe4d4196d30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.778+0000 7fe4dacc0700 1 --2- 172.21.15.92:0/650226940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4d4100fa0 0x7fe4d4197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.778+0000 7fe4dacc0700 1 -- 172.21.15.92:0/650226940 >> 172.21.15.92:0/650226940 conn(0x7fe4d40fb320 msgr2=0x7fe4d40fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:21.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.778+0000 7fe4dacc0700 1 -- 172.21.15.92:0/650226940 shutdown_connections 2023-10-16T13:14:21.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.778+0000 7fe4dacc0700 1 -- 172.21.15.92:0/650226940 wait complete. 2023-10-16T13:14:21.802 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-16T13:14:21.802 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:14:21.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.922+0000 7f7812bfd700 1 -- 172.21.15.92:0/1782402239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f780c102b10 msgr2=0x7f780c1093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:21.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.922+0000 7f7812bfd700 1 --2- 172.21.15.92:0/1782402239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f780c102b10 0x7f780c1093c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f780400b0a0 tx=0x7f780400b3b0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.922+0000 7f7812bfd700 1 -- 172.21.15.92:0/1782402239 shutdown_connections 2023-10-16T13:14:21.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.922+0000 7f7812bfd700 1 --2- 172.21.15.92:0/1782402239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f780c102b10 0x7f780c1093c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.922+0000 7f7812bfd700 1 --2- 172.21.15.92:0/1782402239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f780c0ff1a0 0x7f780c0ff5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.922+0000 7f7812bfd700 1 --2- 172.21.15.92:0/1782402239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f780c102170 0x7f780c1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.922+0000 7f7812bfd700 1 -- 172.21.15.92:0/1782402239 >> 172.21.15.92:0/1782402239 conn(0x7f780c0faab0 msgr2=0x7f780c0fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:21.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.922+0000 7f7812bfd700 1 -- 172.21.15.92:0/1782402239 shutdown_connections 2023-10-16T13:14:21.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.922+0000 7f7812bfd700 1 -- 172.21.15.92:0/1782402239 wait complete. 2023-10-16T13:14:21.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.923+0000 7f7812bfd700 1 Processor -- start 2023-10-16T13:14:21.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.923+0000 7f7812bfd700 1 -- start start 2023-10-16T13:14:21.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.923+0000 7f7812bfd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f780c0ff1a0 0x7f780c196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.923+0000 7f7812bfd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f780c102170 0x7f780c1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.923+0000 7f7812bfd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f780c102b10 0x7f780c19e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.923+0000 7f7812bfd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c19e810 con 0x7f780c102b10 2023-10-16T13:14:21.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.923+0000 7f7812bfd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c19e980 con 0x7f780c0ff1a0 2023-10-16T13:14:21.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.923+0000 7f7812bfd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c19eb40 con 0x7f780c102170 2023-10-16T13:14:21.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.923+0000 7f781119a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f780c102b10 0x7f780c19e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.923+0000 7f781119a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f780c102b10 0x7f780c19e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37642/0 (socket says 172.21.15.92:37642) 2023-10-16T13:14:21.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.923+0000 7f781119a700 1 -- 172.21.15.92:0/1358694789 learned_addr learned my addr 172.21.15.92:0/1358694789 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:21.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.923+0000 7f7810999700 1 --2- 172.21.15.92:0/1358694789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f780c0ff1a0 0x7f780c196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.923+0000 7f780bfff700 1 --2- 172.21.15.92:0/1358694789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f780c102170 0x7f780c1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.924+0000 7f781119a700 1 -- 172.21.15.92:0/1358694789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f780c102170 msgr2=0x7f780c1971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:21.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.924+0000 7f781119a700 1 --2- 172.21.15.92:0/1358694789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f780c102170 0x7f780c1971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.924+0000 7f781119a700 1 -- 172.21.15.92:0/1358694789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f780c0ff1a0 msgr2=0x7f780c196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:21.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.924+0000 7f781119a700 1 --2- 172.21.15.92:0/1358694789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f780c0ff1a0 0x7f780c196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:21.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.924+0000 7f781119a700 1 -- 172.21.15.92:0/1358694789 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7804009d00 con 0x7f780c102b10 2023-10-16T13:14:21.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.924+0000 7f781119a700 1 --2- 172.21.15.92:0/1358694789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f780c102b10 0x7f780c19e240 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f78040062a0 tx=0x7f78040094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:21.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.924+0000 7f7809ffb700 1 -- 172.21.15.92:0/1358694789 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780400e040 con 0x7f780c102b10 2023-10-16T13:14:21.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.924+0000 7f7812bfd700 1 -- 172.21.15.92:0/1358694789 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780c19edc0 con 0x7f780c102b10 2023-10-16T13:14:21.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.924+0000 7f7809ffb700 1 -- 172.21.15.92:0/1358694789 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7804004de0 con 0x7f780c102b10 2023-10-16T13:14:21.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.924+0000 7f7809ffb700 1 -- 172.21.15.92:0/1358694789 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780401d6e0 con 0x7f780c102b10 2023-10-16T13:14:21.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.924+0000 7f7812bfd700 1 -- 172.21.15.92:0/1358694789 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c19f1e0 con 0x7f780c102b10 2023-10-16T13:14:21.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.925+0000 7f7812bfd700 1 -- 172.21.15.92:0/1358694789 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780c10c820 con 0x7f780c102b10 2023-10-16T13:14:21.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.926+0000 7f7809ffb700 1 -- 172.21.15.92:0/1358694789 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f78040041b0 con 0x7f780c102b10 2023-10-16T13:14:21.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.927+0000 7f7809ffb700 1 --2- 172.21.15.92:0/1358694789 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77fc0a1520 0x7f77fc0a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:21.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.927+0000 7f7810999700 1 --2- 172.21.15.92:0/1358694789 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77fc0a1520 0x7f77fc0a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:21.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.927+0000 7f7809ffb700 1 -- 172.21.15.92:0/1358694789 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f78040ce430 con 0x7f780c102b10 2023-10-16T13:14:21.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.927+0000 7f7810999700 1 --2- 172.21.15.92:0/1358694789 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77fc0a1520 0x7f77fc0a39e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f780c197b70 tx=0x7f780000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:21.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:21.931+0000 7f7809ffb700 1 -- 172.21.15.92:0/1358694789 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7804097b20 con 0x7f780c102b10 2023-10-16T13:14:22.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.182+0000 7f7812bfd700 1 -- 172.21.15.92:0/1358694789 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f780c107ce0 con 0x7f780c102b10 2023-10-16T13:14:22.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.183+0000 7f7809ffb700 1 -- 172.21.15.92:0/1358694789 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11379 (secure 0 0 0) 0x7f780409b140 con 0x7f780c102b10 2023-10-16T13:14:22.186 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:14:22.186 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-16T13:11:40.343309+0000","modified":"2023-10-16T13:11:48.346678+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24460,"mds_3":24428,"mds_4":24412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1790514945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1790514945},{"type":"v1","addr":"172.21.15.92:6839","nonce":1790514945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/1016260236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1016260236},{"type":"v1","addr":"172.21.15.92:6841","nonce":1016260236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24410":{"gid":24410,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/2133613540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":2133613540},{"type":"v1","addr":"172.21.15.118:6837","nonce":2133613540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6837/2403096460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":2403096460},{"type":"v1","addr":"172.21.15.152:6837","nonce":2403096460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1821921588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1821921588},{"type":"v1","addr":"172.21.15.152:6839","nonce":1821921588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6839/1577355936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":1577355936},{"type":"v1","addr":"172.21.15.118:6839","nonce":1577355936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:14:22.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.185+0000 7f7812bfd700 1 -- 172.21.15.92:0/1358694789 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77fc0a1520 msgr2=0x7f77fc0a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.185+0000 7f7812bfd700 1 --2- 172.21.15.92:0/1358694789 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77fc0a1520 0x7f77fc0a39e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f780c197b70 tx=0x7f780000a380 comp rx=0 tx=0).stop 2023-10-16T13:14:22.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.185+0000 7f7812bfd700 1 -- 172.21.15.92:0/1358694789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f780c102b10 msgr2=0x7f780c19e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.185+0000 7f7812bfd700 1 --2- 172.21.15.92:0/1358694789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f780c102b10 0x7f780c19e240 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f78040062a0 tx=0x7f78040094c0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.185+0000 7f7812bfd700 1 -- 172.21.15.92:0/1358694789 shutdown_connections 2023-10-16T13:14:22.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.185+0000 7f7812bfd700 1 --2- 172.21.15.92:0/1358694789 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f77fc0a1520 0x7f77fc0a39e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.185+0000 7f7812bfd700 1 --2- 172.21.15.92:0/1358694789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f780c102b10 0x7f780c19e240 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.185+0000 7f7812bfd700 1 --2- 172.21.15.92:0/1358694789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f780c0ff1a0 0x7f780c196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.185+0000 7f7812bfd700 1 --2- 172.21.15.92:0/1358694789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f780c102170 0x7f780c1971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.185+0000 7f7812bfd700 1 -- 172.21.15.92:0/1358694789 >> 172.21.15.92:0/1358694789 conn(0x7f780c0faab0 msgr2=0x7f780c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.185+0000 7f7812bfd700 1 -- 172.21.15.92:0/1358694789 shutdown_connections 2023-10-16T13:14:22.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.185+0000 7f7812bfd700 1 -- 172.21.15.92:0/1358694789 wait complete. 2023-10-16T13:14:22.191 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 27 2023-10-16T13:14:22.201 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-16T13:14:22.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.326+0000 7f7257c38700 1 -- 172.21.15.92:0/2079055356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72500ffdb0 msgr2=0x7f72501001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.326+0000 7f7257c38700 1 --2- 172.21.15.92:0/2079055356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72500ffdb0 0x7f72501001d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f724c0099c0 tx=0x7f724c009cd0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.326+0000 7f7257c38700 1 -- 172.21.15.92:0/2079055356 shutdown_connections 2023-10-16T13:14:22.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.326+0000 7f7257c38700 1 --2- 172.21.15.92:0/2079055356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72500ffdb0 0x7f72501001d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.326+0000 7f7257c38700 1 --2- 172.21.15.92:0/2079055356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7250101940 0x7f72501081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.326+0000 7f7257c38700 1 --2- 172.21.15.92:0/2079055356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7250100fa0 0x7f7250101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.326+0000 7f7257c38700 1 -- 172.21.15.92:0/2079055356 >> 172.21.15.92:0/2079055356 conn(0x7f72500fb320 msgr2=0x7f72500fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.327+0000 7f7257c38700 1 -- 172.21.15.92:0/2079055356 shutdown_connections 2023-10-16T13:14:22.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.327+0000 7f7257c38700 1 -- 172.21.15.92:0/2079055356 wait complete. 2023-10-16T13:14:22.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.327+0000 7f7257c38700 1 Processor -- start 2023-10-16T13:14:22.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.327+0000 7f7257c38700 1 -- start start 2023-10-16T13:14:22.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.327+0000 7f7257c38700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72500ffdb0 0x7f7250198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.327+0000 7f7257c38700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7250100fa0 0x7f72501993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.327+0000 7f7257c38700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7250101940 0x7f72501a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.327+0000 7f7257c38700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72501a0a00 con 0x7f7250101940 2023-10-16T13:14:22.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.327+0000 7f7257c38700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72501a0b40 con 0x7f7250100fa0 2023-10-16T13:14:22.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.327+0000 7f7257c38700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72501a0cd0 con 0x7f72500ffdb0 2023-10-16T13:14:22.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.327+0000 7f72561d5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7250101940 0x7f72501a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.327+0000 7f72551d3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7250100fa0 0x7f72501993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.327+0000 7f72561d5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7250101940 0x7f72501a0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37656/0 (socket says 172.21.15.92:37656) 2023-10-16T13:14:22.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.327+0000 7f72561d5700 1 -- 172.21.15.92:0/3860337395 learned_addr learned my addr 172.21.15.92:0/3860337395 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.327+0000 7f72559d4700 1 --2- 172.21.15.92:0/3860337395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72500ffdb0 0x7f7250198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.328+0000 7f72561d5700 1 -- 172.21.15.92:0/3860337395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72500ffdb0 msgr2=0x7f7250198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.328+0000 7f72561d5700 1 --2- 172.21.15.92:0/3860337395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72500ffdb0 0x7f7250198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.328+0000 7f72561d5700 1 -- 172.21.15.92:0/3860337395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7250100fa0 msgr2=0x7f72501993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.328+0000 7f72561d5700 1 --2- 172.21.15.92:0/3860337395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7250100fa0 0x7f72501993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.328+0000 7f72561d5700 1 -- 172.21.15.92:0/3860337395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724c0095f0 con 0x7f7250101940 2023-10-16T13:14:22.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.328+0000 7f72551d3700 1 --2- 172.21.15.92:0/3860337395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7250100fa0 0x7f72501993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:22.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.328+0000 7f72561d5700 1 --2- 172.21.15.92:0/3860337395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7250101940 0x7f72501a0430 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f724800ef30 tx=0x7f724800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.328+0000 7f7246ffd700 1 -- 172.21.15.92:0/3860337395 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248018070 con 0x7f7250101940 2023-10-16T13:14:22.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.328+0000 7f7246ffd700 1 -- 172.21.15.92:0/3860337395 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f724800f040 con 0x7f7250101940 2023-10-16T13:14:22.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.328+0000 7f7257c38700 1 -- 172.21.15.92:0/3860337395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72501a0f50 con 0x7f7250101940 2023-10-16T13:14:22.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.328+0000 7f7246ffd700 1 -- 172.21.15.92:0/3860337395 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800ce00 con 0x7f7250101940 2023-10-16T13:14:22.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.328+0000 7f7257c38700 1 -- 172.21.15.92:0/3860337395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72501a1380 con 0x7f7250101940 2023-10-16T13:14:22.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.330+0000 7f7246ffd700 1 -- 172.21.15.92:0/3860337395 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7248003a00 con 0x7f7250101940 2023-10-16T13:14:22.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.331+0000 7f7246ffd700 1 --2- 172.21.15.92:0/3860337395 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f723c0a1480 0x7f723c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.331+0000 7f72559d4700 1 --2- 172.21.15.92:0/3860337395 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f723c0a1480 0x7f723c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.331+0000 7f7246ffd700 1 -- 172.21.15.92:0/3860337395 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f72480cc930 con 0x7f7250101940 2023-10-16T13:14:22.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.331+0000 7f72559d4700 1 --2- 172.21.15.92:0/3860337395 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f723c0a1480 0x7f723c0a3940 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f724c00b580 tx=0x7f724c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.332+0000 7f7263e22b80 1 Processor -- start 2023-10-16T13:14:22.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.332+0000 7f7263e22b80 1 -- start start 2023-10-16T13:14:22.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.333+0000 7f7263e22b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f6e20 0x55c8200f7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.333+0000 7f7263e22b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 0x55c8200f8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.333+0000 7f7263e22b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f8620 0x55c8200f8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.333+0000 7f7263e22b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c82006bc70 con 0x55c8200f7780 2023-10-16T13:14:22.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.333+0000 7f7263e22b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c820050c60 con 0x55c8200f6e20 2023-10-16T13:14:22.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.333+0000 7f7263e22b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c82004e580 con 0x55c8200f8620 2023-10-16T13:14:22.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.333+0000 7f72551d3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 0x55c8200f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.333+0000 7f72551d3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 0x55c8200f8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37662/0 (socket says 172.21.15.92:37662) 2023-10-16T13:14:22.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.333+0000 7f72559d4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f6e20 0x55c8200f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.333+0000 7f72551d3700 1 -- 172.21.15.92:0/2511720344 learned_addr learned my addr 172.21.15.92:0/2511720344 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.333+0000 7f72551d3700 1 -- 172.21.15.92:0/2511720344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f8620 msgr2=0x55c8200f8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.333+0000 7f72561d5700 1 --2- 172.21.15.92:0/2511720344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f8620 0x55c8200f8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.333+0000 7f72551d3700 1 --2- 172.21.15.92:0/2511720344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f8620 0x55c8200f8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.333+0000 7f72551d3700 1 -- 172.21.15.92:0/2511720344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f6e20 msgr2=0x55c8200f7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.333+0000 7f72551d3700 1 --2- 172.21.15.92:0/2511720344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f6e20 0x55c8200f7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.333+0000 7f72551d3700 1 -- 172.21.15.92:0/2511720344 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8200073f0 con 0x55c8200f7780 2023-10-16T13:14:22.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.333+0000 7f72559d4700 1 --2- 172.21.15.92:0/2511720344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f6e20 0x55c8200f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:22.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.333+0000 7f72561d5700 1 --2- 172.21.15.92:0/2511720344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f8620 0x55c8200f8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:14:22.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.333+0000 7f72551d3700 1 --2- 172.21.15.92:0/2511720344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 0x55c8200f8040 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f72400115f0 tx=0x7f7240011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662e54883ea7b85e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.334+0000 7f723bfff700 1 -- 172.21.15.92:0/2511720344 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7240019630 con 0x55c8200f7780 2023-10-16T13:14:22.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.334+0000 7f723bfff700 1 -- 172.21.15.92:0/2511720344 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7240019c70 con 0x55c8200f7780 2023-10-16T13:14:22.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.334+0000 7f723bfff700 1 -- 172.21.15.92:0/2511720344 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724000ec70 con 0x55c8200f7780 2023-10-16T13:14:22.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.334+0000 7f7263e22b80 1 -- 172.21.15.92:0/2511720344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 msgr2=0x55c8200f8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.334+0000 7f7263e22b80 1 --2- 172.21.15.92:0/2511720344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 0x55c8200f8040 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f72400115f0 tx=0x7f7240011900 comp rx=0 tx=0).stop 2023-10-16T13:14:22.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.334+0000 7f7263e22b80 1 -- 172.21.15.92:0/2511720344 shutdown_connections 2023-10-16T13:14:22.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.334+0000 7f7263e22b80 1 --2- 172.21.15.92:0/2511720344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f8620 0x55c8200f8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.334+0000 7f7263e22b80 1 --2- 172.21.15.92:0/2511720344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f6e20 0x55c8200f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.334+0000 7f7263e22b80 1 --2- 172.21.15.92:0/2511720344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 0x55c8200f8040 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.334+0000 7f7263e22b80 1 -- 172.21.15.92:0/2511720344 >> 172.21.15.92:0/2511720344 conn(0x55c820024dd0 msgr2=0x55c8200f1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.334+0000 7f7263e22b80 1 -- 172.21.15.92:0/2511720344 shutdown_connections 2023-10-16T13:14:22.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.334+0000 7f7263e22b80 1 -- 172.21.15.92:0/2511720344 wait complete. 2023-10-16T13:14:22.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.335+0000 7f7263e22b80 1 -- start start 2023-10-16T13:14:22.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.335+0000 7f7263e22b80 1 Processor -- start 2023-10-16T13:14:22.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.335+0000 7f7263e22b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f6e20 0x55c820100cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.335+0000 7f7263e22b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 0x55c820101210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.335+0000 7f7263e22b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f8620 0x55c820108250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.335+0000 7f7263e22b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c820049e70 con 0x55c8200f7780 2023-10-16T13:14:22.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.335+0000 7f7263e22b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c81ffe6710 con 0x55c8200f8620 2023-10-16T13:14:22.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.335+0000 7f7263e22b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c81ffe63b0 con 0x55c8200f6e20 2023-10-16T13:14:22.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.335+0000 7f7263e22b80 10 client.0 _ll_register_callbacks cb 0x55c81fe43800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:22.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.335+0000 7f72551d3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 0x55c820101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.335+0000 7f72551d3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 0x55c820101210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37668/0 (socket says 172.21.15.92:37668) 2023-10-16T13:14:22.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.335+0000 7f72551d3700 1 -- 172.21.15.92:0/983246571 learned_addr learned my addr 172.21.15.92:0/983246571 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.335+0000 7f72561d5700 1 --2- 172.21.15.92:0/983246571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f8620 0x55c820108250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.335+0000 7f72559d4700 1 --2- 172.21.15.92:0/983246571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f6e20 0x55c820100cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.336+0000 7f72561d5700 1 -- 172.21.15.92:0/983246571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f6e20 msgr2=0x55c820100cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.336+0000 7f72561d5700 1 --2- 172.21.15.92:0/983246571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f6e20 0x55c820100cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.336+0000 7f72561d5700 1 -- 172.21.15.92:0/983246571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 msgr2=0x55c820101210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.336+0000 7f72561d5700 1 --2- 172.21.15.92:0/983246571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 0x55c820101210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.336+0000 7f72561d5700 1 -- 172.21.15.92:0/983246571 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7250108b40 con 0x55c8200f8620 2023-10-16T13:14:22.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.336+0000 7f72551d3700 1 --2- 172.21.15.92:0/983246571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 0x55c820101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:22.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.336+0000 7f72559d4700 1 --2- 172.21.15.92:0/983246571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f6e20 0x55c820100cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:22.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.336+0000 7f72561d5700 1 --2- 172.21.15.92:0/983246571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f8620 0x55c820108250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55c8200f7e00 tx=0x7f724809a3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3152e36d2c573a66 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.336+0000 7f72397fa700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-16T13:14:22.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.336+0000 7f72397fa700 1 -- 172.21.15.92:0/983246571 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724809de30 con 0x55c8200f8620 2023-10-16T13:14:22.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.336+0000 7f7263e22b80 1 -- 172.21.15.92:0/983246571 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c82004eef0 con 0x55c8200f8620 2023-10-16T13:14:22.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.336+0000 7f72397fa700 1 -- 172.21.15.92:0/983246571 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f72480a1fe0 con 0x55c8200f8620 2023-10-16T13:14:22.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.336+0000 7f72397fa700 1 -- 172.21.15.92:0/983246571 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7248099f40 con 0x55c8200f8620 2023-10-16T13:14:22.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.336+0000 7f7263e22b80 10 client.25280 fetch_fsmap learned FSMap version 27 2023-10-16T13:14:22.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.336+0000 7f7263e22b80 1 -- 172.21.15.92:0/983246571 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f7240009dd0 con 0x55c8200f8620 2023-10-16T13:14:22.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.336+0000 7f72397fa700 1 -- 172.21.15.92:0/983246571 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55c82004eef0 con 0x55c8200f8620 2023-10-16T13:14:22.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.337+0000 7f72397fa700 1 -- 172.21.15.92:0/983246571 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f72480991d0 con 0x55c8200f8620 2023-10-16T13:14:22.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.337+0000 7f7263e22b80 10 client.25280 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:14:22.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.337+0000 7f7263e22b80 10 client.25280 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2023-10-16T13:14:22.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.337+0000 7f7263e22b80 20 client.25280 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:22.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.337+0000 7f7263e22b80 1 --2- 172.21.15.92:0/983246571 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c82010ca20 0x55c82010ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.337+0000 7f7263e22b80 4 client.25280 mds_command: new command op to 24412 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:14:22.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.337+0000 7f7263e22b80 1 -- 172.21.15.92:0/983246571 --> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8200c6c10 con 0x55c82010ca20 2023-10-16T13:14:22.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.337+0000 7f72559d4700 1 --2- 172.21.15.92:0/983246571 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c82010ca20 0x55c82010ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.337+0000 7f72559d4700 1 --2- 172.21.15.92:0/983246571 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c82010ca20 0x55c82010ee40 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7acce2fa57631d server_cookie=b89b5be2dcf0832b in_seq=0 out_seq=0 2023-10-16T13:14:22.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.337+0000 7f72397fa700 10 client.25280 ms_handle_connect on v2:172.21.15.152:6832/1273074399 2023-10-16T13:14:22.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.338+0000 7f72397fa700 1 -- 172.21.15.92:0/983246571 <== mds.4 v2:172.21.15.152:6832/1273074399 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c8200c6c10 con 0x55c82010ca20 2023-10-16T13:14:22.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.338+0000 7f72397fa700 10 client.25280 handle_command_reply: tid=0 2023-10-16T13:14:22.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.338+0000 7f7263e22b80 1 client.25280 shutdown 2023-10-16T13:14:22.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.338+0000 7f7263e22b80 1 -- 172.21.15.92:0/983246571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f8620 msgr2=0x55c820108250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.338+0000 7f7263e22b80 1 --2- 172.21.15.92:0/983246571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f8620 0x55c820108250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55c8200f7e00 tx=0x7f724809a3e0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.338+0000 7f7263e22b80 1 -- 172.21.15.92:0/983246571 shutdown_connections 2023-10-16T13:14:22.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.338+0000 7f7263e22b80 1 --2- 172.21.15.92:0/983246571 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c82010ca20 0x55c82010ee40 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.338+0000 7f7263e22b80 1 --2- 172.21.15.92:0/983246571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f8620 0x55c820108250 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.338+0000 7f7263e22b80 1 --2- 172.21.15.92:0/983246571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f6e20 0x55c820100cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.338+0000 7f7263e22b80 1 --2- 172.21.15.92:0/983246571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 0x55c820101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.338+0000 7f72397fa700 0 client.25280 ms_handle_reset on v2:172.21.15.152:6832/1273074399 2023-10-16T13:14:22.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.338+0000 7f7263e22b80 1 -- 172.21.15.92:0/983246571 >> 172.21.15.92:0/983246571 conn(0x55c820024dd0 msgr2=0x55c8200f1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.338+0000 7f7263e22b80 1 -- 172.21.15.92:0/983246571 shutdown_connections 2023-10-16T13:14:22.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.338+0000 7f7263e22b80 1 -- 172.21.15.92:0/983246571 wait complete. 2023-10-16T13:14:22.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.338+0000 7f7263e22b80 20 client.25280 trim_cache size 0 max 16384 2023-10-16T13:14:22.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.351+0000 7f7263e22b80 1 Processor -- start 2023-10-16T13:14:22.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.351+0000 7f7263e22b80 1 -- start start 2023-10-16T13:14:22.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.351+0000 7f7263e22b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f6e20 0x55c8200fea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.351+0000 7f7263e22b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 0x55c820108210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.351+0000 7f7263e22b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f8620 0x55c8200f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.351+0000 7f7263e22b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c81feca920 con 0x55c8200f7780 2023-10-16T13:14:22.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.351+0000 7f7263e22b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8200f1950 con 0x55c8200f8620 2023-10-16T13:14:22.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.351+0000 7f7263e22b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c820100840 con 0x55c8200f6e20 2023-10-16T13:14:22.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.351+0000 7f72551d3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 0x55c820108210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.352+0000 7f72551d3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 0x55c820108210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37676/0 (socket says 172.21.15.92:37676) 2023-10-16T13:14:22.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.352+0000 7f72561d5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f8620 0x55c8200f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.352+0000 7f72551d3700 1 -- 172.21.15.92:0/2145305953 learned_addr learned my addr 172.21.15.92:0/2145305953 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.352+0000 7f72559d4700 1 --2- 172.21.15.92:0/2145305953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f6e20 0x55c8200fea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.352+0000 7f72551d3700 1 -- 172.21.15.92:0/2145305953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f6e20 msgr2=0x55c8200fea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.352+0000 7f72551d3700 1 --2- 172.21.15.92:0/2145305953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f6e20 0x55c8200fea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.352+0000 7f72551d3700 1 -- 172.21.15.92:0/2145305953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f8620 msgr2=0x55c8200f1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.352+0000 7f72551d3700 1 --2- 172.21.15.92:0/2145305953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f8620 0x55c8200f1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.352+0000 7f72551d3700 1 -- 172.21.15.92:0/2145305953 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c81fe74de0 con 0x55c8200f7780 2023-10-16T13:14:22.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.352+0000 7f72561d5700 1 --2- 172.21.15.92:0/2145305953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f8620 0x55c8200f1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:22.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.352+0000 7f72551d3700 1 --2- 172.21.15.92:0/2145305953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 0x55c820108210 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f724001c040 tx=0x7f72400058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8650358fe1f138 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.370 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.352+0000 7f7244d82700 1 -- 172.21.15.92:0/2145305953 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7240005ce0 con 0x55c8200f7780 2023-10-16T13:14:22.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.352+0000 7f7244d82700 1 -- 172.21.15.92:0/2145305953 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f72400055a0 con 0x55c8200f7780 2023-10-16T13:14:22.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.352+0000 7f7244d82700 1 -- 172.21.15.92:0/2145305953 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72400199f0 con 0x55c8200f7780 2023-10-16T13:14:22.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.353+0000 7f7263e22b80 1 -- 172.21.15.92:0/2145305953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 msgr2=0x55c820108210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.353+0000 7f7263e22b80 1 --2- 172.21.15.92:0/2145305953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 0x55c820108210 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f724001c040 tx=0x7f72400058e0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.371 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.353+0000 7f7263e22b80 1 -- 172.21.15.92:0/2145305953 shutdown_connections 2023-10-16T13:14:22.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.353+0000 7f7263e22b80 1 --2- 172.21.15.92:0/2145305953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f8620 0x55c8200f1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.353+0000 7f7263e22b80 1 --2- 172.21.15.92:0/2145305953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f6e20 0x55c8200fea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.353+0000 7f7263e22b80 1 --2- 172.21.15.92:0/2145305953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f7780 0x55c820108210 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.353+0000 7f7263e22b80 1 -- 172.21.15.92:0/2145305953 >> 172.21.15.92:0/2145305953 conn(0x55c820024dd0 msgr2=0x55c8200f1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.353+0000 7f7263e22b80 1 -- 172.21.15.92:0/2145305953 shutdown_connections 2023-10-16T13:14:22.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.353+0000 7f7263e22b80 1 -- 172.21.15.92:0/2145305953 wait complete. 2023-10-16T13:14:22.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.353+0000 7f7263e22b80 1 -- start start 2023-10-16T13:14:22.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.353+0000 7f7263e22b80 1 Processor -- start 2023-10-16T13:14:22.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.353+0000 7f7263e22b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f6e20 0x55c820105d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.353+0000 7f7263e22b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f7780 0x55c820106270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.353+0000 7f7263e22b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f8620 0x55c820107280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.353+0000 7f7263e22b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8201077c0 con 0x55c8200f6e20 2023-10-16T13:14:22.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.353+0000 7f7263e22b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c820107930 con 0x55c8200f7780 2023-10-16T13:14:22.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.353+0000 7f7263e22b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c820107af0 con 0x55c8200f8620 2023-10-16T13:14:22.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f7263e22b80 10 client.0 _ll_register_callbacks cb 0x7f7248099820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:22.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f72559d4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f6e20 0x55c820105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f72559d4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f6e20 0x55c820105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37680/0 (socket says 172.21.15.92:37680) 2023-10-16T13:14:22.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f72559d4700 1 -- 172.21.15.92:0/3274804386 learned_addr learned my addr 172.21.15.92:0/3274804386 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f72551d3700 1 --2- 172.21.15.92:0/3274804386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f7780 0x55c820106270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f72561d5700 1 --2- 172.21.15.92:0/3274804386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f8620 0x55c820107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f72559d4700 1 -- 172.21.15.92:0/3274804386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f8620 msgr2=0x55c820107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f72559d4700 1 --2- 172.21.15.92:0/3274804386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f8620 0x55c820107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f72559d4700 1 -- 172.21.15.92:0/3274804386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f7780 msgr2=0x55c820106270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f72559d4700 1 --2- 172.21.15.92:0/3274804386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f7780 0x55c820106270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f72559d4700 1 -- 172.21.15.92:0/3274804386 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7240009dd0 con 0x55c8200f6e20 2023-10-16T13:14:22.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f72551d3700 1 --2- 172.21.15.92:0/3274804386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f7780 0x55c820106270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:14:22.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f72559d4700 1 --2- 172.21.15.92:0/3274804386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f6e20 0x55c820105d30 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f724c0099c0 tx=0x7f724c009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546da19c0164e84b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f72397fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:22.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f72397fa700 1 -- 172.21.15.92:0/3274804386 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c02b040 con 0x55c8200f6e20 2023-10-16T13:14:22.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f72397fa700 1 -- 172.21.15.92:0/3274804386 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f724c026a30 con 0x55c8200f6e20 2023-10-16T13:14:22.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f7263e22b80 1 -- 172.21.15.92:0/3274804386 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7240019c70 con 0x55c8200f6e20 2023-10-16T13:14:22.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f72397fa700 1 -- 172.21.15.92:0/3274804386 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f724c035e80 con 0x55c8200f6e20 2023-10-16T13:14:22.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f7263e22b80 10 client.15726 fetch_fsmap learned FSMap version 27 2023-10-16T13:14:22.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f7263e22b80 1 -- 172.21.15.92:0/3274804386 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c8200073f0 con 0x55c8200f6e20 2023-10-16T13:14:22.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.354+0000 7f72397fa700 1 -- 172.21.15.92:0/3274804386 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7240019c70 con 0x55c8200f6e20 2023-10-16T13:14:22.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.355+0000 7f72397fa700 1 -- 172.21.15.92:0/3274804386 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f724c03e690 con 0x55c8200f6e20 2023-10-16T13:14:22.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.355+0000 7f7263e22b80 10 client.15726 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:14:22.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.355+0000 7f7263e22b80 10 client.15726 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2023-10-16T13:14:22.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.355+0000 7f7263e22b80 20 client.15726 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:22.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.355+0000 7f7263e22b80 1 --2- 172.21.15.92:0/3274804386 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c820161610 0x55c820163a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.355+0000 7f7263e22b80 4 client.15726 mds_command: new command op to 24412 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-16T13:14:22.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.355+0000 7f7263e22b80 1 -- 172.21.15.92:0/3274804386 --> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c820042e50 con 0x55c820161610 2023-10-16T13:14:22.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.355+0000 7f72551d3700 1 --2- 172.21.15.92:0/3274804386 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c820161610 0x55c820163a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.355+0000 7f72397fa700 10 client.15726 ms_handle_connect on v2:172.21.15.152:6832/1273074399 2023-10-16T13:14:22.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.355+0000 7f72551d3700 1 --2- 172.21.15.92:0/3274804386 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c820161610 0x55c820163a30 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a65b989a7593e3fe server_cookie=7b0e8721015ab902 in_seq=0 out_seq=0 2023-10-16T13:14:22.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.355+0000 7f72397fa700 1 -- 172.21.15.92:0/3274804386 <== mds.4 v2:172.21.15.152:6832/1273074399 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c820042e50 con 0x55c820161610 2023-10-16T13:14:22.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.355+0000 7f72397fa700 10 client.15726 handle_command_reply: tid=0 2023-10-16T13:14:22.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.355+0000 7f7263e22b80 1 client.15726 shutdown 2023-10-16T13:14:22.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7263e22b80 1 -- 172.21.15.92:0/3274804386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f6e20 msgr2=0x55c820105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7263e22b80 1 --2- 172.21.15.92:0/3274804386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f6e20 0x55c820105d30 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f724c0099c0 tx=0x7f724c009cd0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7263e22b80 1 -- 172.21.15.92:0/3274804386 shutdown_connections 2023-10-16T13:14:22.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7263e22b80 1 --2- 172.21.15.92:0/3274804386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8200f6e20 0x55c820105d30 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7263e22b80 1 --2- 172.21.15.92:0/3274804386 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x55c820161610 0x55c820163a30 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7263e22b80 1 --2- 172.21.15.92:0/3274804386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8200f8620 0x55c820107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7263e22b80 1 --2- 172.21.15.92:0/3274804386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8200f7780 0x55c820106270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f72397fa700 0 client.15726 ms_handle_reset on v2:172.21.15.152:6832/1273074399 2023-10-16T13:14:22.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7263e22b80 1 -- 172.21.15.92:0/3274804386 >> 172.21.15.92:0/3274804386 conn(0x55c820024dd0 msgr2=0x55c8200fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7263e22b80 1 -- 172.21.15.92:0/3274804386 shutdown_connections 2023-10-16T13:14:22.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7263e22b80 1 -- 172.21.15.92:0/3274804386 wait complete. 2023-10-16T13:14:22.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7263e22b80 20 client.15726 trim_cache size 0 max 16384 2023-10-16T13:14:22.384 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2023-10-16T13:14:22.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7257c38700 1 -- 172.21.15.92:0/3860337395 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f723c0a1480 msgr2=0x7f723c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7257c38700 1 --2- 172.21.15.92:0/3860337395 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f723c0a1480 0x7f723c0a3940 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f724c00b580 tx=0x7f724c005fb0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7257c38700 1 -- 172.21.15.92:0/3860337395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7250101940 msgr2=0x7f72501a0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7257c38700 1 --2- 172.21.15.92:0/3860337395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7250101940 0x7f72501a0430 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f724800ef30 tx=0x7f724800c3a0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7257c38700 1 -- 172.21.15.92:0/3860337395 shutdown_connections 2023-10-16T13:14:22.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7257c38700 1 --2- 172.21.15.92:0/3860337395 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f723c0a1480 0x7f723c0a3940 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7257c38700 1 --2- 172.21.15.92:0/3860337395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7250101940 0x7f72501a0430 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7257c38700 1 --2- 172.21.15.92:0/3860337395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72500ffdb0 0x7f7250198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7257c38700 1 --2- 172.21.15.92:0/3860337395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7250100fa0 0x7f72501993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7257c38700 1 -- 172.21.15.92:0/3860337395 >> 172.21.15.92:0/3860337395 conn(0x7f72500fb320 msgr2=0x7f7250068060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7257c38700 1 -- 172.21.15.92:0/3860337395 shutdown_connections 2023-10-16T13:14:22.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.356+0000 7f7257c38700 1 -- 172.21.15.92:0/3860337395 wait complete. 2023-10-16T13:14:22.388 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-16T13:14:22.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.521+0000 7fd2b06be700 1 -- 172.21.15.92:0/1110211613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2a8101940 msgr2=0x7fd2a81081f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.521+0000 7fd2b06be700 1 --2- 172.21.15.92:0/1110211613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2a8101940 0x7fd2a81081f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000b0d0 tx=0x7fd2a000b3e0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.521+0000 7fd2b06be700 1 -- 172.21.15.92:0/1110211613 shutdown_connections 2023-10-16T13:14:22.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.521+0000 7fd2b06be700 1 --2- 172.21.15.92:0/1110211613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2a8101940 0x7fd2a81081f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.521+0000 7fd2b06be700 1 --2- 172.21.15.92:0/1110211613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2a80ffdb0 0x7fd2a81001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.521+0000 7fd2b06be700 1 --2- 172.21.15.92:0/1110211613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2a8100fa0 0x7fd2a8101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.521+0000 7fd2b06be700 1 -- 172.21.15.92:0/1110211613 >> 172.21.15.92:0/1110211613 conn(0x7fd2a80fb320 msgr2=0x7fd2a80fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.522+0000 7fd2b06be700 1 -- 172.21.15.92:0/1110211613 shutdown_connections 2023-10-16T13:14:22.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.522+0000 7fd2b06be700 1 -- 172.21.15.92:0/1110211613 wait complete. 2023-10-16T13:14:22.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.522+0000 7fd2b06be700 1 Processor -- start 2023-10-16T13:14:22.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.522+0000 7fd2b06be700 1 -- start start 2023-10-16T13:14:22.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.522+0000 7fd2b06be700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2a80ffdb0 0x7fd2a8196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.522+0000 7fd2b06be700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2a8100fa0 0x7fd2a81972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.522+0000 7fd2b06be700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2a8101940 0x7fd2a819e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.522+0000 7fd2b06be700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a819e8f0 con 0x7fd2a80ffdb0 2023-10-16T13:14:22.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.522+0000 7fd2b06be700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a819ea60 con 0x7fd2a8101940 2023-10-16T13:14:22.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.522+0000 7fd2b06be700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a819ec20 con 0x7fd2a8100fa0 2023-10-16T13:14:22.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.522+0000 7fd2ae45a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2a80ffdb0 0x7fd2a8196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.522+0000 7fd2ae45a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2a80ffdb0 0x7fd2a8196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37694/0 (socket says 172.21.15.92:37694) 2023-10-16T13:14:22.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.522+0000 7fd2ae45a700 1 -- 172.21.15.92:0/2124890660 learned_addr learned my addr 172.21.15.92:0/2124890660 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.523+0000 7fd2aec5b700 1 --2- 172.21.15.92:0/2124890660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2a8101940 0x7fd2a819e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.523+0000 7fd2adc59700 1 --2- 172.21.15.92:0/2124890660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2a8100fa0 0x7fd2a81972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.523+0000 7fd2ae45a700 1 -- 172.21.15.92:0/2124890660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2a8100fa0 msgr2=0x7fd2a81972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.523+0000 7fd2ae45a700 1 --2- 172.21.15.92:0/2124890660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2a8100fa0 0x7fd2a81972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.523+0000 7fd2ae45a700 1 -- 172.21.15.92:0/2124890660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2a8101940 msgr2=0x7fd2a819e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.523+0000 7fd2ae45a700 1 --2- 172.21.15.92:0/2124890660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2a8101940 0x7fd2a819e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.523+0000 7fd2ae45a700 1 -- 172.21.15.92:0/2124890660 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a0009d00 con 0x7fd2a80ffdb0 2023-10-16T13:14:22.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.523+0000 7fd2ae45a700 1 --2- 172.21.15.92:0/2124890660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2a80ffdb0 0x7fd2a8196db0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400e970 tx=0x7fd2a400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.523+0000 7fd29b7fe700 1 -- 172.21.15.92:0/2124890660 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4009790 con 0x7fd2a80ffdb0 2023-10-16T13:14:22.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.523+0000 7fd29b7fe700 1 -- 172.21.15.92:0/2124890660 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd2a400ccc0 con 0x7fd2a80ffdb0 2023-10-16T13:14:22.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.523+0000 7fd2b06be700 1 -- 172.21.15.92:0/2124890660 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a819ef00 con 0x7fd2a80ffdb0 2023-10-16T13:14:22.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.523+0000 7fd29b7fe700 1 -- 172.21.15.92:0/2124890660 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4003d80 con 0x7fd2a80ffdb0 2023-10-16T13:14:22.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.523+0000 7fd2b06be700 1 -- 172.21.15.92:0/2124890660 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a819f320 con 0x7fd2a80ffdb0 2023-10-16T13:14:22.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.525+0000 7fd29b7fe700 1 -- 172.21.15.92:0/2124890660 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd2a400c7e0 con 0x7fd2a80ffdb0 2023-10-16T13:14:22.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.526+0000 7fd29b7fe700 1 --2- 172.21.15.92:0/2124890660 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd2940a1480 0x7fd2940a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.526+0000 7fd2adc59700 1 --2- 172.21.15.92:0/2124890660 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd2940a1480 0x7fd2940a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.526+0000 7fd29b7fe700 1 -- 172.21.15.92:0/2124890660 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd2a4014070 con 0x7fd2a80ffdb0 2023-10-16T13:14:22.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.526+0000 7fd2adc59700 1 --2- 172.21.15.92:0/2124890660 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd2940a1480 0x7fd2940a3940 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009c60 tx=0x7fd29c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.527+0000 7fd2bc8a8b80 1 Processor -- start 2023-10-16T13:14:22.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.527+0000 7fd2bc8a8b80 1 -- start start 2023-10-16T13:14:22.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.527+0000 7fd2bc8a8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 0x559a0c45e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.527+0000 7fd2bc8a8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45e780 0x559a0c45f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.527+0000 7fd2bc8a8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45f620 0x559a0c45faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.527+0000 7fd2bc8a8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0c3d2c70 con 0x559a0c45de20 2023-10-16T13:14:22.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.527+0000 7fd2bc8a8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0c3b7c60 con 0x559a0c45f620 2023-10-16T13:14:22.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.527+0000 7fd2bc8a8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0c3b5580 con 0x559a0c45e780 2023-10-16T13:14:22.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.527+0000 7fd2ae45a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 0x559a0c45e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.527+0000 7fd2ae45a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 0x559a0c45e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37702/0 (socket says 172.21.15.92:37702) 2023-10-16T13:14:22.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.527+0000 7fd2ae45a700 1 -- 172.21.15.92:0/3902605113 learned_addr learned my addr 172.21.15.92:0/3902605113 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.527+0000 7fd2aec5b700 1 --2- 172.21.15.92:0/3902605113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45f620 0x559a0c45faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.527+0000 7fd2adc59700 1 --2- 172.21.15.92:0/3902605113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45e780 0x559a0c45f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.527+0000 7fd2ae45a700 1 -- 172.21.15.92:0/3902605113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45e780 msgr2=0x559a0c45f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.527+0000 7fd2ae45a700 1 --2- 172.21.15.92:0/3902605113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45e780 0x559a0c45f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.528+0000 7fd2ae45a700 1 -- 172.21.15.92:0/3902605113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45f620 msgr2=0x559a0c45faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.528+0000 7fd2ae45a700 1 --2- 172.21.15.92:0/3902605113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45f620 0x559a0c45faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.528+0000 7fd2ae45a700 1 -- 172.21.15.92:0/3902605113 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a0c36e3f0 con 0x559a0c45de20 2023-10-16T13:14:22.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.528+0000 7fd2ae45a700 1 --2- 172.21.15.92:0/3902605113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 0x559a0c45e240 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40a1ff0 tx=0x7fd2a4099d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67629a89d796ba89 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.528+0000 7fd298ff9700 1 -- 172.21.15.92:0/3902605113 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a409a890 con 0x559a0c45de20 2023-10-16T13:14:22.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.528+0000 7fd298ff9700 1 -- 172.21.15.92:0/3902605113 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd2a409a190 con 0x559a0c45de20 2023-10-16T13:14:22.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.528+0000 7fd298ff9700 1 -- 172.21.15.92:0/3902605113 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4004440 con 0x559a0c45de20 2023-10-16T13:14:22.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.528+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/3902605113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 msgr2=0x559a0c45e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.528+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/3902605113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 0x559a0c45e240 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40a1ff0 tx=0x7fd2a4099d50 comp rx=0 tx=0).stop 2023-10-16T13:14:22.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/3902605113 shutdown_connections 2023-10-16T13:14:22.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/3902605113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 0x559a0c45e240 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/3902605113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45f620 0x559a0c45faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/3902605113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45e780 0x559a0c45f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/3902605113 >> 172.21.15.92:0/3902605113 conn(0x559a0c38bdd0 msgr2=0x559a0c458fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/3902605113 shutdown_connections 2023-10-16T13:14:22.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/3902605113 wait complete. 2023-10-16T13:14:22.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2bc8a8b80 1 -- start start 2023-10-16T13:14:22.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2bc8a8b80 1 Processor -- start 2023-10-16T13:14:22.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2bc8a8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45de20 0x559a0c467c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2bc8a8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45e780 0x559a0c4681b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2bc8a8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45f620 0x559a0c46f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2bc8a8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0c3b0e70 con 0x559a0c45f620 2023-10-16T13:14:22.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2bc8a8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0c34d710 con 0x559a0c45de20 2023-10-16T13:14:22.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2bc8a8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0c34d3b0 con 0x559a0c45e780 2023-10-16T13:14:22.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2bc8a8b80 10 client.0 _ll_register_callbacks cb 0x559a0c1aa800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:22.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2aec5b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45f620 0x559a0c46f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2aec5b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45f620 0x559a0c46f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37712/0 (socket says 172.21.15.92:37712) 2023-10-16T13:14:22.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2ae45a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45de20 0x559a0c467c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.529+0000 7fd2aec5b700 1 -- 172.21.15.92:0/1018485402 learned_addr learned my addr 172.21.15.92:0/1018485402 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.530+0000 7fd2adc59700 1 --2- 172.21.15.92:0/1018485402 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45e780 0x559a0c4681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.530+0000 7fd2ae45a700 1 -- 172.21.15.92:0/1018485402 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45e780 msgr2=0x559a0c4681b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.530+0000 7fd2ae45a700 1 --2- 172.21.15.92:0/1018485402 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45e780 0x559a0c4681b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.530+0000 7fd2ae45a700 1 -- 172.21.15.92:0/1018485402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45f620 msgr2=0x559a0c46f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.530+0000 7fd2ae45a700 1 --2- 172.21.15.92:0/1018485402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45f620 0x559a0c46f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.530+0000 7fd2ae45a700 1 -- 172.21.15.92:0/1018485402 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a819f320 con 0x559a0c45de20 2023-10-16T13:14:22.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.530+0000 7fd2aec5b700 1 --2- 172.21.15.92:0/1018485402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45f620 0x559a0c46f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:22.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.530+0000 7fd2adc59700 1 --2- 172.21.15.92:0/1018485402 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45e780 0x559a0c4681b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:14:22.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.530+0000 7fd2ae45a700 1 --2- 172.21.15.92:0/1018485402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45de20 0x559a0c467c70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4099e90 tx=0x7fd2a4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d964d1936e667e9e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.530+0000 7fd291ffb700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-16T13:14:22.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.530+0000 7fd291ffb700 1 -- 172.21.15.92:0/1018485402 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a409a890 con 0x559a0c45de20 2023-10-16T13:14:22.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.530+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/1018485402 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a0c3b5ef0 con 0x559a0c45de20 2023-10-16T13:14:22.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.530+0000 7fd291ffb700 1 -- 172.21.15.92:0/1018485402 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd2a4098530 con 0x559a0c45de20 2023-10-16T13:14:22.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.530+0000 7fd291ffb700 1 -- 172.21.15.92:0/1018485402 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2a4099680 con 0x559a0c45de20 2023-10-16T13:14:22.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.530+0000 7fd2bc8a8b80 10 client.25298 fetch_fsmap learned FSMap version 27 2023-10-16T13:14:22.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.530+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/1018485402 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559a0c1dbde0 con 0x559a0c45de20 2023-10-16T13:14:22.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.530+0000 7fd291ffb700 1 -- 172.21.15.92:0/1018485402 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x559a0c3b5ef0 con 0x559a0c45de20 2023-10-16T13:14:22.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.530+0000 7fd291ffb700 1 -- 172.21.15.92:0/1018485402 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd2a40b81b0 con 0x559a0c45de20 2023-10-16T13:14:22.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.531+0000 7fd2bc8a8b80 10 client.25298 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:14:22.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.531+0000 7fd2bc8a8b80 10 client.25298 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-10-16T13:14:22.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.531+0000 7fd2bc8a8b80 20 client.25298 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:22.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.531+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/1018485402 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x559a0c473680 0x559a0c475aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.531+0000 7fd2bc8a8b80 4 client.25298 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:14:22.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.531+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/1018485402 --> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559a0c42dc10 con 0x559a0c473680 2023-10-16T13:14:22.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.531+0000 7fd2adc59700 1 --2- 172.21.15.92:0/1018485402 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x559a0c473680 0x559a0c475aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.531+0000 7fd2adc59700 1 --2- 172.21.15.92:0/1018485402 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x559a0c473680 0x559a0c475aa0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cc7a748e450dbd47 server_cookie=cc0a89765f66c18a in_seq=0 out_seq=0 2023-10-16T13:14:22.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.531+0000 7fd291ffb700 10 client.25298 ms_handle_connect on v2:172.21.15.118:6834/2381374755 2023-10-16T13:14:22.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.532+0000 7fd291ffb700 1 -- 172.21.15.92:0/1018485402 <== mds.3 v2:172.21.15.118:6834/2381374755 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559a0c42dc10 con 0x559a0c473680 2023-10-16T13:14:22.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.532+0000 7fd291ffb700 10 client.25298 handle_command_reply: tid=0 2023-10-16T13:14:22.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.532+0000 7fd2bc8a8b80 1 client.25298 shutdown 2023-10-16T13:14:22.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.532+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/1018485402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45de20 msgr2=0x559a0c467c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.532+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/1018485402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45de20 0x559a0c467c70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4099e90 tx=0x7fd2a4004750 comp rx=0 tx=0).stop 2023-10-16T13:14:22.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.532+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/1018485402 shutdown_connections 2023-10-16T13:14:22.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.532+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/1018485402 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x559a0c473680 0x559a0c475aa0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.532+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/1018485402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45f620 0x559a0c46f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.532+0000 7fd291ffb700 0 client.25298 ms_handle_reset on v2:172.21.15.118:6834/2381374755 2023-10-16T13:14:22.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.532+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/1018485402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45de20 0x559a0c467c70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.532+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/1018485402 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45e780 0x559a0c4681b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.532+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/1018485402 >> 172.21.15.92:0/1018485402 conn(0x559a0c38bdd0 msgr2=0x559a0c458bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.532+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/1018485402 shutdown_connections 2023-10-16T13:14:22.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.532+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/1018485402 wait complete. 2023-10-16T13:14:22.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.532+0000 7fd2bc8a8b80 20 client.25298 trim_cache size 0 max 16384 2023-10-16T13:14:22.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.545+0000 7fd2bc8a8b80 1 Processor -- start 2023-10-16T13:14:22.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.545+0000 7fd2bc8a8b80 1 -- start start 2023-10-16T13:14:22.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.545+0000 7fd2bc8a8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 0x559a0c46fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.545+0000 7fd2bc8a8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45e780 0x559a0c46f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.545+0000 7fd2bc8a8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45f620 0x559a0c4659f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.545+0000 7fd2bc8a8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0c231920 con 0x559a0c45de20 2023-10-16T13:14:22.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.545+0000 7fd2bc8a8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0c45f4d0 con 0x559a0c45e780 2023-10-16T13:14:22.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.545+0000 7fd2bc8a8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0c459580 con 0x559a0c45f620 2023-10-16T13:14:22.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.545+0000 7fd2ae45a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 0x559a0c46fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.545+0000 7fd2ae45a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 0x559a0c46fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37716/0 (socket says 172.21.15.92:37716) 2023-10-16T13:14:22.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.545+0000 7fd2ae45a700 1 -- 172.21.15.92:0/4085862819 learned_addr learned my addr 172.21.15.92:0/4085862819 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.545+0000 7fd2adc59700 1 --2- 172.21.15.92:0/4085862819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45e780 0x559a0c46f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.545+0000 7fd2aec5b700 1 --2- 172.21.15.92:0/4085862819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45f620 0x559a0c4659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.545+0000 7fd2ae45a700 1 -- 172.21.15.92:0/4085862819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45f620 msgr2=0x559a0c4659f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.545+0000 7fd2ae45a700 1 --2- 172.21.15.92:0/4085862819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45f620 0x559a0c4659f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.545+0000 7fd2ae45a700 1 -- 172.21.15.92:0/4085862819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45e780 msgr2=0x559a0c46f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.545+0000 7fd2ae45a700 1 --2- 172.21.15.92:0/4085862819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45e780 0x559a0c46f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.545+0000 7fd2ae45a700 1 -- 172.21.15.92:0/4085862819 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a0c1c4c60 con 0x559a0c45de20 2023-10-16T13:14:22.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.545+0000 7fd2ae45a700 1 --2- 172.21.15.92:0/4085862819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 0x559a0c46fae0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40984e0 tx=0x7fd2a4099d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386c4e493b5efaec server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.546+0000 7fd2997fa700 1 -- 172.21.15.92:0/4085862819 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a409a890 con 0x559a0c45de20 2023-10-16T13:14:22.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.546+0000 7fd2997fa700 1 -- 172.21.15.92:0/4085862819 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd2a40a2520 con 0x559a0c45de20 2023-10-16T13:14:22.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.546+0000 7fd2997fa700 1 -- 172.21.15.92:0/4085862819 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a40a2090 con 0x559a0c45de20 2023-10-16T13:14:22.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.546+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/4085862819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 msgr2=0x559a0c46fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.546+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/4085862819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 0x559a0c46fae0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40984e0 tx=0x7fd2a4099d50 comp rx=0 tx=0).stop 2023-10-16T13:14:22.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.546+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/4085862819 shutdown_connections 2023-10-16T13:14:22.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.546+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/4085862819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 0x559a0c46fae0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.546+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/4085862819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45f620 0x559a0c4659f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.546+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/4085862819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45e780 0x559a0c46f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.546+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/4085862819 >> 172.21.15.92:0/4085862819 conn(0x559a0c38bdd0 msgr2=0x559a0c4577a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.546+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/4085862819 shutdown_connections 2023-10-16T13:14:22.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.546+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/4085862819 wait complete. 2023-10-16T13:14:22.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.546+0000 7fd2bc8a8b80 1 -- start start 2023-10-16T13:14:22.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.546+0000 7fd2bc8a8b80 1 Processor -- start 2023-10-16T13:14:22.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2bc8a8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 0x559a0c46af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2bc8a8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45e780 0x559a0c46b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2bc8a8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45f620 0x559a0c46e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2bc8a8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0c46ea20 con 0x559a0c45de20 2023-10-16T13:14:22.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2bc8a8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0c46eb90 con 0x559a0c45f620 2023-10-16T13:14:22.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2bc8a8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0c46ed50 con 0x559a0c45e780 2023-10-16T13:14:22.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2bc8a8b80 10 client.0 _ll_register_callbacks cb 0x559a0c1aa800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:22.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2ae45a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 0x559a0c46af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2ae45a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 0x559a0c46af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37722/0 (socket says 172.21.15.92:37722) 2023-10-16T13:14:22.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2ae45a700 1 -- 172.21.15.92:0/1515085317 learned_addr learned my addr 172.21.15.92:0/1515085317 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2aec5b700 1 --2- 172.21.15.92:0/1515085317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45f620 0x559a0c46e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2adc59700 1 --2- 172.21.15.92:0/1515085317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45e780 0x559a0c46b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2ae45a700 1 -- 172.21.15.92:0/1515085317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45e780 msgr2=0x559a0c46b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2ae45a700 1 --2- 172.21.15.92:0/1515085317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45e780 0x559a0c46b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2ae45a700 1 -- 172.21.15.92:0/1515085317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45f620 msgr2=0x559a0c46e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.574 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2ae45a700 1 --2- 172.21.15.92:0/1515085317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45f620 0x559a0c46e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.574 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2ae45a700 1 -- 172.21.15.92:0/1515085317 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559a0c1dbde0 con 0x559a0c45de20 2023-10-16T13:14:22.574 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2aec5b700 1 --2- 172.21.15.92:0/1515085317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45f620 0x559a0c46e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:14:22.574 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2ae45a700 1 --2- 172.21.15.92:0/1515085317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 0x559a0c46af80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4096c00 tx=0x7fd2a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c3b3d6a39b78c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.574 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd291ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:22.575 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd291ffb700 1 -- 172.21.15.92:0/1515085317 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a409a890 con 0x559a0c45de20 2023-10-16T13:14:22.575 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd291ffb700 1 -- 172.21.15.92:0/1515085317 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd2a40a2090 con 0x559a0c45de20 2023-10-16T13:14:22.575 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/1515085317 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd2a409a190 con 0x559a0c45de20 2023-10-16T13:14:22.575 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.547+0000 7fd291ffb700 1 -- 172.21.15.92:0/1515085317 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2a407b020 con 0x559a0c45de20 2023-10-16T13:14:22.575 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.548+0000 7fd2bc8a8b80 10 client.15744 fetch_fsmap learned FSMap version 27 2023-10-16T13:14:22.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.548+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/1515085317 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559a0c202250 con 0x559a0c45de20 2023-10-16T13:14:22.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.548+0000 7fd291ffb700 1 -- 172.21.15.92:0/1515085317 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd2a409a190 con 0x559a0c45de20 2023-10-16T13:14:22.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.548+0000 7fd291ffb700 1 -- 172.21.15.92:0/1515085317 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd2a409f140 con 0x559a0c45de20 2023-10-16T13:14:22.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.548+0000 7fd2bc8a8b80 10 client.15744 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:14:22.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.548+0000 7fd2bc8a8b80 10 client.15744 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-10-16T13:14:22.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.548+0000 7fd2bc8a8b80 20 client.15744 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:22.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.548+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/1515085317 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x559a0c4c7c10 0x559a0c4ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.548+0000 7fd2bc8a8b80 4 client.15744 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-16T13:14:22.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.548+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/1515085317 --> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559a0c3a9e50 con 0x559a0c4c7c10 2023-10-16T13:14:22.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.548+0000 7fd2adc59700 1 --2- 172.21.15.92:0/1515085317 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x559a0c4c7c10 0x559a0c4ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.548+0000 7fd291ffb700 10 client.15744 ms_handle_connect on v2:172.21.15.118:6834/2381374755 2023-10-16T13:14:22.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.548+0000 7fd2adc59700 1 --2- 172.21.15.92:0/1515085317 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x559a0c4c7c10 0x559a0c4ca000 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=907b2d83cbe813e7 server_cookie=30f972cecddbd25f in_seq=0 out_seq=0 2023-10-16T13:14:22.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd291ffb700 1 -- 172.21.15.92:0/1515085317 <== mds.3 v2:172.21.15.118:6834/2381374755 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559a0c3a9e50 con 0x559a0c4c7c10 2023-10-16T13:14:22.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd291ffb700 10 client.15744 handle_command_reply: tid=0 2023-10-16T13:14:22.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2bc8a8b80 1 client.15744 shutdown 2023-10-16T13:14:22.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/1515085317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 msgr2=0x559a0c46af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/1515085317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 0x559a0c46af80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4096c00 tx=0x7fd2a4004750 comp rx=0 tx=0).stop 2023-10-16T13:14:22.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/1515085317 shutdown_connections 2023-10-16T13:14:22.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/1515085317 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x559a0c4c7c10 0x559a0c4ca000 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/1515085317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a0c45de20 0x559a0c46af80 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd291ffb700 0 client.15744 ms_handle_reset on v2:172.21.15.118:6834/2381374755 2023-10-16T13:14:22.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/1515085317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a0c45f620 0x559a0c46e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2bc8a8b80 1 --2- 172.21.15.92:0/1515085317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a0c45e780 0x559a0c46b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/1515085317 >> 172.21.15.92:0/1515085317 conn(0x559a0c38bdd0 msgr2=0x559a0c46fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/1515085317 shutdown_connections 2023-10-16T13:14:22.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2bc8a8b80 1 -- 172.21.15.92:0/1515085317 wait complete. 2023-10-16T13:14:22.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2bc8a8b80 20 client.15744 trim_cache size 0 max 16384 2023-10-16T13:14:22.581 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2023-10-16T13:14:22.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2b06be700 1 -- 172.21.15.92:0/2124890660 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd2940a1480 msgr2=0x7fd2940a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2b06be700 1 --2- 172.21.15.92:0/2124890660 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd2940a1480 0x7fd2940a3940 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009c60 tx=0x7fd29c009260 comp rx=0 tx=0).stop 2023-10-16T13:14:22.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2b06be700 1 -- 172.21.15.92:0/2124890660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2a80ffdb0 msgr2=0x7fd2a8196db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2b06be700 1 --2- 172.21.15.92:0/2124890660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2a80ffdb0 0x7fd2a8196db0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400e970 tx=0x7fd2a400ec80 comp rx=0 tx=0).stop 2023-10-16T13:14:22.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2b06be700 1 -- 172.21.15.92:0/2124890660 shutdown_connections 2023-10-16T13:14:22.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2b06be700 1 --2- 172.21.15.92:0/2124890660 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd2940a1480 0x7fd2940a3940 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2b06be700 1 --2- 172.21.15.92:0/2124890660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2a80ffdb0 0x7fd2a8196db0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2b06be700 1 --2- 172.21.15.92:0/2124890660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2a8101940 0x7fd2a819e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2b06be700 1 --2- 172.21.15.92:0/2124890660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2a8100fa0 0x7fd2a81972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2b06be700 1 -- 172.21.15.92:0/2124890660 >> 172.21.15.92:0/2124890660 conn(0x7fd2a80fb320 msgr2=0x7fd2a80fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2b06be700 1 -- 172.21.15.92:0/2124890660 shutdown_connections 2023-10-16T13:14:22.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.549+0000 7fd2b06be700 1 -- 172.21.15.92:0/2124890660 wait complete. 2023-10-16T13:14:22.585 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-16T13:14:22.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.706+0000 7f1cfcb99700 1 -- 172.21.15.92:0/1777261001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf80ffa10 msgr2=0x7f1cf80ffe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.706+0000 7f1cfcb99700 1 --2- 172.21.15.92:0/1777261001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf80ffa10 0x7f1cf80ffe70 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8009990 tx=0x7f1ce8009ca0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.706+0000 7f1cfcb99700 1 -- 172.21.15.92:0/1777261001 shutdown_connections 2023-10-16T13:14:22.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.706+0000 7f1cfcb99700 1 --2- 172.21.15.92:0/1777261001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf81003b0 0x7f1cf8108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.706+0000 7f1cfcb99700 1 --2- 172.21.15.92:0/1777261001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1cf81014e0 0x7f1cf8101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.706+0000 7f1cfcb99700 1 --2- 172.21.15.92:0/1777261001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf80ffa10 0x7f1cf80ffe70 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.706+0000 7f1cfcb99700 1 -- 172.21.15.92:0/1777261001 >> 172.21.15.92:0/1777261001 conn(0x7f1cf80fb330 msgr2=0x7f1cf80fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.706+0000 7f1cfcb99700 1 -- 172.21.15.92:0/1777261001 shutdown_connections 2023-10-16T13:14:22.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.706+0000 7f1cfcb99700 1 -- 172.21.15.92:0/1777261001 wait complete. 2023-10-16T13:14:22.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.707+0000 7f1cfcb99700 1 Processor -- start 2023-10-16T13:14:22.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.707+0000 7f1cfcb99700 1 -- start start 2023-10-16T13:14:22.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.707+0000 7f1cfcb99700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf80ffa10 0x7f1cf8103d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.707+0000 7f1cfcb99700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1cf81003b0 0x7f1cf81023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.707+0000 7f1cfcb99700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf81014e0 0x7f1cf8102910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.707+0000 7f1cfcb99700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf81030b0 con 0x7f1cf81014e0 2023-10-16T13:14:22.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.707+0000 7f1cfcb99700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf8103220 con 0x7f1cf81003b0 2023-10-16T13:14:22.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.707+0000 7f1cfcb99700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf81a0e10 con 0x7f1cf80ffa10 2023-10-16T13:14:22.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.707+0000 7f1cf6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf81014e0 0x7f1cf8102910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.707+0000 7f1cf6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf81014e0 0x7f1cf8102910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37738/0 (socket says 172.21.15.92:37738) 2023-10-16T13:14:22.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.707+0000 7f1cf6d9d700 1 -- 172.21.15.92:0/4238303219 learned_addr learned my addr 172.21.15.92:0/4238303219 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.707+0000 7f1cf659c700 1 --2- 172.21.15.92:0/4238303219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf80ffa10 0x7f1cf8103d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.707+0000 7f1cf5d9b700 1 --2- 172.21.15.92:0/4238303219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1cf81003b0 0x7f1cf81023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.707+0000 7f1cf6d9d700 1 -- 172.21.15.92:0/4238303219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf80ffa10 msgr2=0x7f1cf8103d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.707+0000 7f1cf6d9d700 1 --2- 172.21.15.92:0/4238303219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf80ffa10 0x7f1cf8103d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.707+0000 7f1cf6d9d700 1 -- 172.21.15.92:0/4238303219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1cf81003b0 msgr2=0x7f1cf81023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.707+0000 7f1cf6d9d700 1 --2- 172.21.15.92:0/4238303219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1cf81003b0 0x7f1cf81023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.708+0000 7f1cf6d9d700 1 -- 172.21.15.92:0/4238303219 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce80095f0 con 0x7f1cf81014e0 2023-10-16T13:14:22.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.708+0000 7f1cf6d9d700 1 --2- 172.21.15.92:0/4238303219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf81014e0 0x7f1cf8102910 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000ef30 tx=0x7f1cf000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.708+0000 7f1ce77fe700 1 -- 172.21.15.92:0/4238303219 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0018070 con 0x7f1cf81014e0 2023-10-16T13:14:22.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.708+0000 7f1ce77fe700 1 -- 172.21.15.92:0/4238303219 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1cf000f040 con 0x7f1cf81014e0 2023-10-16T13:14:22.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.708+0000 7f1cfcb99700 1 -- 172.21.15.92:0/4238303219 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf81a1090 con 0x7f1cf81014e0 2023-10-16T13:14:22.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.708+0000 7f1ce77fe700 1 -- 172.21.15.92:0/4238303219 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf000cd50 con 0x7f1cf81014e0 2023-10-16T13:14:22.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.708+0000 7f1cfcb99700 1 -- 172.21.15.92:0/4238303219 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf81a15f0 con 0x7f1cf81014e0 2023-10-16T13:14:22.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.710+0000 7f1ce77fe700 1 -- 172.21.15.92:0/4238303219 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f1cf0003a00 con 0x7f1cf81014e0 2023-10-16T13:14:22.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.711+0000 7f1ce77fe700 1 --2- 172.21.15.92:0/4238303219 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1ce00a1500 0x7f1ce00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.711+0000 7f1cf659c700 1 --2- 172.21.15.92:0/4238303219 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1ce00a1500 0x7f1ce00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.711+0000 7f1ce77fe700 1 -- 172.21.15.92:0/4238303219 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1cf00cc760 con 0x7f1cf81014e0 2023-10-16T13:14:22.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.711+0000 7f1cf659c700 1 --2- 172.21.15.92:0/4238303219 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1ce00a1500 0x7f1ce00a39c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8100e50 tx=0x7f1cec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.711+0000 7f1d08d83b80 1 Processor -- start 2023-10-16T13:14:22.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.712+0000 7f1d08d83b80 1 -- start start 2023-10-16T13:14:22.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.712+0000 7f1d08d83b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c1e20 0x5575f96c2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.712+0000 7f1d08d83b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c2780 0x5575f96c3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.725 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.712+0000 7f1d08d83b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 0x5575f96c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.712+0000 7f1d08d83b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f9636c70 con 0x5575f96c3620 2023-10-16T13:14:22.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.712+0000 7f1d08d83b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f961bc60 con 0x5575f96c1e20 2023-10-16T13:14:22.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.712+0000 7f1d08d83b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f9619580 con 0x5575f96c2780 2023-10-16T13:14:22.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.712+0000 7f1cf6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 0x5575f96c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.712+0000 7f1cf6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 0x5575f96c3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37746/0 (socket says 172.21.15.92:37746) 2023-10-16T13:14:22.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.712+0000 7f1cf5d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c2780 0x5575f96c3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.712+0000 7f1cf6d9d700 1 -- 172.21.15.92:0/1797251122 learned_addr learned my addr 172.21.15.92:0/1797251122 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.712+0000 7f1cf659c700 1 --2- 172.21.15.92:0/1797251122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c1e20 0x5575f96c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.712+0000 7f1cf6d9d700 1 -- 172.21.15.92:0/1797251122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c2780 msgr2=0x5575f96c3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.712+0000 7f1cf6d9d700 1 --2- 172.21.15.92:0/1797251122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c2780 0x5575f96c3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.712+0000 7f1cf6d9d700 1 -- 172.21.15.92:0/1797251122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c1e20 msgr2=0x5575f96c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.712+0000 7f1cf6d9d700 1 --2- 172.21.15.92:0/1797251122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c1e20 0x5575f96c2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.712+0000 7f1cf6d9d700 1 -- 172.21.15.92:0/1797251122 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575f95d23f0 con 0x5575f96c3620 2023-10-16T13:14:22.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.712+0000 7f1cf5d9b700 1 --2- 172.21.15.92:0/1797251122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c2780 0x5575f96c3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:22.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.713+0000 7f1cf6d9d700 1 --2- 172.21.15.92:0/1797251122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 0x5575f96c3aa0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0096010 tx=0x7f1cf0095f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a779b9a1b34d007 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.713+0000 7f1ce4ff9700 1 -- 172.21.15.92:0/1797251122 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf009a210 con 0x5575f96c3620 2023-10-16T13:14:22.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.713+0000 7f1ce4ff9700 1 -- 172.21.15.92:0/1797251122 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1cf0084040 con 0x5575f96c3620 2023-10-16T13:14:22.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.713+0000 7f1ce4ff9700 1 -- 172.21.15.92:0/1797251122 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0099d70 con 0x5575f96c3620 2023-10-16T13:14:22.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.713+0000 7f1d08d83b80 1 -- 172.21.15.92:0/1797251122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 msgr2=0x5575f96c3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.713+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/1797251122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 0x5575f96c3aa0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0096010 tx=0x7f1cf0095f80 comp rx=0 tx=0).stop 2023-10-16T13:14:22.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.713+0000 7f1d08d83b80 1 -- 172.21.15.92:0/1797251122 shutdown_connections 2023-10-16T13:14:22.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.713+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/1797251122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 0x5575f96c3aa0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.713+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/1797251122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c1e20 0x5575f96c2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.713+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/1797251122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c2780 0x5575f96c3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.713+0000 7f1d08d83b80 1 -- 172.21.15.92:0/1797251122 >> 172.21.15.92:0/1797251122 conn(0x5575f95efdd0 msgr2=0x5575f96bcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.714+0000 7f1d08d83b80 1 -- 172.21.15.92:0/1797251122 shutdown_connections 2023-10-16T13:14:22.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.714+0000 7f1d08d83b80 1 -- 172.21.15.92:0/1797251122 wait complete. 2023-10-16T13:14:22.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.714+0000 7f1d08d83b80 1 -- start start 2023-10-16T13:14:22.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.714+0000 7f1d08d83b80 1 Processor -- start 2023-10-16T13:14:22.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.714+0000 7f1d08d83b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c1e20 0x5575f96cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.714+0000 7f1d08d83b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c2780 0x5575f96cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.714+0000 7f1d08d83b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 0x5575f96d3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.714+0000 7f1d08d83b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f9614e70 con 0x5575f96c3620 2023-10-16T13:14:22.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.714+0000 7f1d08d83b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f95b1710 con 0x5575f96c2780 2023-10-16T13:14:22.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.714+0000 7f1d08d83b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f95b13b0 con 0x5575f96c1e20 2023-10-16T13:14:22.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.714+0000 7f1d08d83b80 10 client.0 _ll_register_callbacks cb 0x5575f940e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:22.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.714+0000 7f1cf6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 0x5575f96d3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.714+0000 7f1cf6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 0x5575f96d3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37752/0 (socket says 172.21.15.92:37752) 2023-10-16T13:14:22.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.714+0000 7f1cf6d9d700 1 -- 172.21.15.92:0/1653809666 learned_addr learned my addr 172.21.15.92:0/1653809666 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.714+0000 7f1cf659c700 1 --2- 172.21.15.92:0/1653809666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c1e20 0x5575f96cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.714+0000 7f1cf5d9b700 1 --2- 172.21.15.92:0/1653809666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c2780 0x5575f96cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1cf6d9d700 1 -- 172.21.15.92:0/1653809666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c1e20 msgr2=0x5575f96cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1cf6d9d700 1 --2- 172.21.15.92:0/1653809666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c1e20 0x5575f96cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1cf6d9d700 1 -- 172.21.15.92:0/1653809666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c2780 msgr2=0x5575f96cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1cf6d9d700 1 --2- 172.21.15.92:0/1653809666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c2780 0x5575f96cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1cf6d9d700 1 -- 172.21.15.92:0/1653809666 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf8108c70 con 0x5575f96c3620 2023-10-16T13:14:22.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1cf6d9d700 1 --2- 172.21.15.92:0/1653809666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 0x5575f96d3270 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0096580 tx=0x7f1cf00995a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f473fd998450a7c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1cddffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:22.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1cddffb700 1 -- 172.21.15.92:0/1653809666 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0099b10 con 0x5575f96c3620 2023-10-16T13:14:22.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1cddffb700 1 -- 172.21.15.92:0/1653809666 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1cf009ae40 con 0x5575f96c3620 2023-10-16T13:14:22.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1d08d83b80 1 -- 172.21.15.92:0/1653809666 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575f9619ef0 con 0x5575f96c3620 2023-10-16T13:14:22.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1cddffb700 1 -- 172.21.15.92:0/1653809666 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cf009dc60 con 0x5575f96c3620 2023-10-16T13:14:22.735 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1d08d83b80 10 client.15756 fetch_fsmap learned FSMap version 27 2023-10-16T13:14:22.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1d08d83b80 1 -- 172.21.15.92:0/1653809666 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f1cf81a15f0 con 0x5575f96c3620 2023-10-16T13:14:22.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1cddffb700 1 -- 172.21.15.92:0/1653809666 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5575f9619ef0 con 0x5575f96c3620 2023-10-16T13:14:22.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1cddffb700 1 -- 172.21.15.92:0/1653809666 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1cf00b90b0 con 0x5575f96c3620 2023-10-16T13:14:22.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1d08d83b80 10 client.15756 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:14:22.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1d08d83b80 10 client.15756 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-10-16T13:14:22.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1d08d83b80 20 client.15756 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:22.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/1653809666 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x5575f96d7610 0x5575f96d9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1d08d83b80 4 client.15756 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:14:22.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.715+0000 7f1d08d83b80 1 -- 172.21.15.92:0/1653809666 --> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5575f9691c10 con 0x5575f96d7610 2023-10-16T13:14:22.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.716+0000 7f1cf659c700 1 --2- 172.21.15.92:0/1653809666 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x5575f96d7610 0x5575f96d9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.716+0000 7f1cddffb700 10 client.15756 ms_handle_connect on v2:172.21.15.152:6834/1393840132 2023-10-16T13:14:22.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.716+0000 7f1cf659c700 1 --2- 172.21.15.92:0/1653809666 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x5575f96d7610 0x5575f96d9a00 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=613e3f73f6781de0 server_cookie=e3a46027eabbbd8e in_seq=0 out_seq=0 2023-10-16T13:14:22.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.717+0000 7f1cddffb700 1 -- 172.21.15.92:0/1653809666 <== mds.2 v2:172.21.15.152:6834/1393840132 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5575f9691c10 con 0x5575f96d7610 2023-10-16T13:14:22.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.717+0000 7f1cddffb700 10 client.15756 handle_command_reply: tid=0 2023-10-16T13:14:22.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.717+0000 7f1d08d83b80 1 client.15756 shutdown 2023-10-16T13:14:22.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.717+0000 7f1d08d83b80 1 -- 172.21.15.92:0/1653809666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 msgr2=0x5575f96d3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.717+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/1653809666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 0x5575f96d3270 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0096580 tx=0x7f1cf00995a0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.717+0000 7f1d08d83b80 1 -- 172.21.15.92:0/1653809666 shutdown_connections 2023-10-16T13:14:22.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.717+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/1653809666 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x5575f96d7610 0x5575f96d9a00 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.717+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/1653809666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 0x5575f96d3270 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.717+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/1653809666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c1e20 0x5575f96cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.717+0000 7f1cddffb700 0 client.15756 ms_handle_reset on v2:172.21.15.152:6834/1393840132 2023-10-16T13:14:22.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.717+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/1653809666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c2780 0x5575f96cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.717+0000 7f1d08d83b80 1 -- 172.21.15.92:0/1653809666 >> 172.21.15.92:0/1653809666 conn(0x5575f95efdd0 msgr2=0x5575f96bcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.717+0000 7f1d08d83b80 1 -- 172.21.15.92:0/1653809666 shutdown_connections 2023-10-16T13:14:22.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.717+0000 7f1d08d83b80 1 -- 172.21.15.92:0/1653809666 wait complete. 2023-10-16T13:14:22.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.717+0000 7f1d08d83b80 20 client.15756 trim_cache size 0 max 16384 2023-10-16T13:14:22.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.730+0000 7f1d08d83b80 1 Processor -- start 2023-10-16T13:14:22.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.730+0000 7f1d08d83b80 1 -- start start 2023-10-16T13:14:22.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.730+0000 7f1d08d83b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c1e20 0x5575f96c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.730+0000 7f1d08d83b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c2780 0x5575f96d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.730+0000 7f1d08d83b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c3620 0x5575f96ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.730+0000 7f1d08d83b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f9495920 con 0x5575f96c2780 2023-10-16T13:14:22.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.730+0000 7f1d08d83b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f9691c10 con 0x5575f96c1e20 2023-10-16T13:14:22.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.730+0000 7f1d08d83b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f96c34a0 con 0x5575f96c3620 2023-10-16T13:14:22.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.730+0000 7f1cf5d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c2780 0x5575f96d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.730+0000 7f1cf5d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c2780 0x5575f96d3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37758/0 (socket says 172.21.15.92:37758) 2023-10-16T13:14:22.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.730+0000 7f1cf5d9b700 1 -- 172.21.15.92:0/2181799681 learned_addr learned my addr 172.21.15.92:0/2181799681 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.730+0000 7f1cf659c700 1 --2- 172.21.15.92:0/2181799681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c1e20 0x5575f96c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.731+0000 7f1cf6d9d700 1 --2- 172.21.15.92:0/2181799681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c3620 0x5575f96ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.731+0000 7f1cf5d9b700 1 -- 172.21.15.92:0/2181799681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c3620 msgr2=0x5575f96ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.731+0000 7f1cf5d9b700 1 --2- 172.21.15.92:0/2181799681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c3620 0x5575f96ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.731+0000 7f1cf5d9b700 1 -- 172.21.15.92:0/2181799681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c1e20 msgr2=0x5575f96c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.731+0000 7f1cf5d9b700 1 --2- 172.21.15.92:0/2181799681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c1e20 0x5575f96c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.731+0000 7f1cf5d9b700 1 -- 172.21.15.92:0/2181799681 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575f943fde0 con 0x5575f96c2780 2023-10-16T13:14:22.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.731+0000 7f1cf6d9d700 1 --2- 172.21.15.92:0/2181799681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c3620 0x5575f96ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:14:22.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.731+0000 7f1cf5d9b700 1 --2- 172.21.15.92:0/2181799681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c2780 0x5575f96d3230 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80098e0 tx=0x7f1ce8005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4b84b9dcc15488 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.731+0000 7f1ce57fa700 1 -- 172.21.15.92:0/2181799681 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce801d070 con 0x5575f96c2780 2023-10-16T13:14:22.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.731+0000 7f1ce57fa700 1 -- 172.21.15.92:0/2181799681 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1ce801e040 con 0x5575f96c2780 2023-10-16T13:14:22.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.731+0000 7f1ce57fa700 1 -- 172.21.15.92:0/2181799681 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8004bf0 con 0x5575f96c2780 2023-10-16T13:14:22.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1d08d83b80 1 -- 172.21.15.92:0/2181799681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c2780 msgr2=0x5575f96d3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/2181799681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c2780 0x5575f96d3230 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80098e0 tx=0x7f1ce8005fb0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1d08d83b80 1 -- 172.21.15.92:0/2181799681 shutdown_connections 2023-10-16T13:14:22.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/2181799681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c3620 0x5575f96ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/2181799681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c1e20 0x5575f96c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/2181799681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c2780 0x5575f96d3230 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1d08d83b80 1 -- 172.21.15.92:0/2181799681 >> 172.21.15.92:0/2181799681 conn(0x5575f95efdd0 msgr2=0x5575f96de320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1d08d83b80 1 -- 172.21.15.92:0/2181799681 shutdown_connections 2023-10-16T13:14:22.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1d08d83b80 1 -- 172.21.15.92:0/2181799681 wait complete. 2023-10-16T13:14:22.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1d08d83b80 1 -- start start 2023-10-16T13:14:22.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1d08d83b80 1 Processor -- start 2023-10-16T13:14:22.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1d08d83b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c1e20 0x5575f96d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1d08d83b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c2780 0x5575f96d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1d08d83b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 0x5575f96d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1d08d83b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f96d2c70 con 0x5575f96c3620 2023-10-16T13:14:22.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1d08d83b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f96d2de0 con 0x5575f96c2780 2023-10-16T13:14:22.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1d08d83b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f96d2fa0 con 0x5575f96c1e20 2023-10-16T13:14:22.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1d08d83b80 10 client.0 _ll_register_callbacks cb 0x7f1cec011a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:22.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1cf6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 0x5575f96d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1cf6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 0x5575f96d2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37766/0 (socket says 172.21.15.92:37766) 2023-10-16T13:14:22.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1cf6d9d700 1 -- 172.21.15.92:0/2944141024 learned_addr learned my addr 172.21.15.92:0/2944141024 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1cf5d9b700 1 --2- 172.21.15.92:0/2944141024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c2780 0x5575f96d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.732+0000 7f1cf659c700 1 --2- 172.21.15.92:0/2944141024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c1e20 0x5575f96d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1cf6d9d700 1 -- 172.21.15.92:0/2944141024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c1e20 msgr2=0x5575f96d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1cf6d9d700 1 --2- 172.21.15.92:0/2944141024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c1e20 0x5575f96d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1cf6d9d700 1 -- 172.21.15.92:0/2944141024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c2780 msgr2=0x5575f96d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1cf6d9d700 1 --2- 172.21.15.92:0/2944141024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c2780 0x5575f96d1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1cf6d9d700 1 -- 172.21.15.92:0/2944141024 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce800b950 con 0x5575f96c3620 2023-10-16T13:14:22.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1cf6d9d700 1 --2- 172.21.15.92:0/2944141024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 0x5575f96d2730 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000ef00 tx=0x7f1cf0097c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2e93c06f138df0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1cddffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:22.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1cddffb700 1 -- 172.21.15.92:0/2944141024 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf009a210 con 0x5575f96c3620 2023-10-16T13:14:22.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1cddffb700 1 -- 172.21.15.92:0/2944141024 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1cf009ae40 con 0x5575f96c3620 2023-10-16T13:14:22.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1d08d83b80 1 -- 172.21.15.92:0/2944141024 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1cf0084040 con 0x5575f96c3620 2023-10-16T13:14:22.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1cddffb700 1 -- 172.21.15.92:0/2944141024 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cf0097d30 con 0x5575f96c3620 2023-10-16T13:14:22.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1d08d83b80 10 client.15762 fetch_fsmap learned FSMap version 27 2023-10-16T13:14:22.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1d08d83b80 1 -- 172.21.15.92:0/2944141024 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5575f9428c60 con 0x5575f96c3620 2023-10-16T13:14:22.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1cddffb700 1 -- 172.21.15.92:0/2944141024 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1cf0084040 con 0x5575f96c3620 2023-10-16T13:14:22.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1cddffb700 1 -- 172.21.15.92:0/2944141024 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1cf0099d70 con 0x5575f96c3620 2023-10-16T13:14:22.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1d08d83b80 10 client.15762 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:14:22.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1d08d83b80 10 client.15762 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-10-16T13:14:22.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1d08d83b80 20 client.15762 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:22.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/2944141024 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x5575f96d7610 0x5575f972e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1d08d83b80 4 client.15762 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-16T13:14:22.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.733+0000 7f1d08d83b80 1 -- 172.21.15.92:0/2944141024 --> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5575f960de50 con 0x5575f96d7610 2023-10-16T13:14:22.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.734+0000 7f1cf659c700 1 --2- 172.21.15.92:0/2944141024 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x5575f96d7610 0x5575f972e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.734+0000 7f1cddffb700 10 client.15762 ms_handle_connect on v2:172.21.15.152:6834/1393840132 2023-10-16T13:14:22.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.734+0000 7f1cf659c700 1 --2- 172.21.15.92:0/2944141024 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x5575f96d7610 0x5575f972e160 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4401d8979a5f6ea6 server_cookie=b320b2ab02e3eb5c in_seq=0 out_seq=0 2023-10-16T13:14:22.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.734+0000 7f1cddffb700 1 -- 172.21.15.92:0/2944141024 <== mds.2 v2:172.21.15.152:6834/1393840132 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5575f960de50 con 0x5575f96d7610 2023-10-16T13:14:22.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.734+0000 7f1cddffb700 10 client.15762 handle_command_reply: tid=0 2023-10-16T13:14:22.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.734+0000 7f1d08d83b80 1 client.15762 shutdown 2023-10-16T13:14:22.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.734+0000 7f1d08d83b80 1 -- 172.21.15.92:0/2944141024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 msgr2=0x5575f96d2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.734+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/2944141024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 0x5575f96d2730 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000ef00 tx=0x7f1cf0097c50 comp rx=0 tx=0).stop 2023-10-16T13:14:22.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.734+0000 7f1d08d83b80 1 -- 172.21.15.92:0/2944141024 shutdown_connections 2023-10-16T13:14:22.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.734+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/2944141024 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x5575f96d7610 0x5575f972e160 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.734+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/2944141024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575f96c3620 0x5575f96d2730 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.734+0000 7f1cddffb700 0 client.15762 ms_handle_reset on v2:172.21.15.152:6834/1393840132 2023-10-16T13:14:22.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.734+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/2944141024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575f96c1e20 0x5575f96d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.734+0000 7f1d08d83b80 1 --2- 172.21.15.92:0/2944141024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5575f96c2780 0x5575f96d1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.734+0000 7f1d08d83b80 1 -- 172.21.15.92:0/2944141024 >> 172.21.15.92:0/2944141024 conn(0x5575f95efdd0 msgr2=0x5575f96ca920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.734+0000 7f1d08d83b80 1 -- 172.21.15.92:0/2944141024 shutdown_connections 2023-10-16T13:14:22.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.734+0000 7f1d08d83b80 1 -- 172.21.15.92:0/2944141024 wait complete. 2023-10-16T13:14:22.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.735+0000 7f1d08d83b80 20 client.15762 trim_cache size 0 max 16384 2023-10-16T13:14:22.762 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2023-10-16T13:14:22.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.735+0000 7f1cfcb99700 1 -- 172.21.15.92:0/4238303219 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1ce00a1500 msgr2=0x7f1ce00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.735+0000 7f1cfcb99700 1 --2- 172.21.15.92:0/4238303219 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1ce00a1500 0x7f1ce00a39c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8100e50 tx=0x7f1cec009260 comp rx=0 tx=0).stop 2023-10-16T13:14:22.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.735+0000 7f1cfcb99700 1 -- 172.21.15.92:0/4238303219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf81014e0 msgr2=0x7f1cf8102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.735+0000 7f1cfcb99700 1 --2- 172.21.15.92:0/4238303219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf81014e0 0x7f1cf8102910 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000ef30 tx=0x7f1cf000c3a0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.735+0000 7f1cfcb99700 1 -- 172.21.15.92:0/4238303219 shutdown_connections 2023-10-16T13:14:22.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.735+0000 7f1cfcb99700 1 --2- 172.21.15.92:0/4238303219 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1ce00a1500 0x7f1ce00a39c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.735+0000 7f1cfcb99700 1 --2- 172.21.15.92:0/4238303219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf81014e0 0x7f1cf8102910 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.735+0000 7f1cfcb99700 1 --2- 172.21.15.92:0/4238303219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf80ffa10 0x7f1cf8103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.735+0000 7f1cfcb99700 1 --2- 172.21.15.92:0/4238303219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1cf81003b0 0x7f1cf81023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.735+0000 7f1cfcb99700 1 -- 172.21.15.92:0/4238303219 >> 172.21.15.92:0/4238303219 conn(0x7f1cf80fb330 msgr2=0x7f1cf8069040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.735+0000 7f1cfcb99700 1 -- 172.21.15.92:0/4238303219 shutdown_connections 2023-10-16T13:14:22.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.735+0000 7f1cfcb99700 1 -- 172.21.15.92:0/4238303219 wait complete. 2023-10-16T13:14:22.765 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:22 smithi092 ceph-mon[99542]: pgmap v338: 97 pgs: 97 active+clean; 98 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 1.1 MiB/s wr, 805 op/s 2023-10-16T13:14:22.765 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:22 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1358694789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:14:22.766 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-16T13:14:22.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:22 smithi118 ceph-mon[103969]: pgmap v338: 97 pgs: 97 active+clean; 98 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 1.1 MiB/s wr, 805 op/s 2023-10-16T13:14:22.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:22 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1358694789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:14:22.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.891+0000 7f626cc99700 1 -- 172.21.15.92:0/1874065723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62681009c0 msgr2=0x7f6268108260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.891+0000 7f626cc99700 1 --2- 172.21.15.92:0/1874065723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62681009c0 0x7f6268108260 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f626000b0a0 tx=0x7f626000b3b0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.892+0000 7f626cc99700 1 -- 172.21.15.92:0/1874065723 shutdown_connections 2023-10-16T13:14:22.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.892+0000 7f626cc99700 1 --2- 172.21.15.92:0/1874065723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62681009c0 0x7f6268108260 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.892+0000 7f626cc99700 1 --2- 172.21.15.92:0/1874065723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6268101440 0x7f6268101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.892+0000 7f626cc99700 1 --2- 172.21.15.92:0/1874065723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6268100000 0x7f6268100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.892+0000 7f626cc99700 1 -- 172.21.15.92:0/1874065723 >> 172.21.15.92:0/1874065723 conn(0x7f62680faa90 msgr2=0x7f62680fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.892+0000 7f626cc99700 1 -- 172.21.15.92:0/1874065723 shutdown_connections 2023-10-16T13:14:22.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.892+0000 7f626cc99700 1 -- 172.21.15.92:0/1874065723 wait complete. 2023-10-16T13:14:22.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.892+0000 7f626cc99700 1 Processor -- start 2023-10-16T13:14:22.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.892+0000 7f626cc99700 1 -- start start 2023-10-16T13:14:22.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f626cc99700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6268100000 0x7f62680ffa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f626cc99700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62681009c0 0x7f626819bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f626cc99700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6268101440 0x7f626819e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f626cc99700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626819e8a0 con 0x7f6268100000 2023-10-16T13:14:22.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f626cc99700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626819ea10 con 0x7f6268101440 2023-10-16T13:14:22.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f626cc99700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626819ebd0 con 0x7f62681009c0 2023-10-16T13:14:22.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f626659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6268100000 0x7f62680ffa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f626659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6268100000 0x7f62680ffa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37776/0 (socket says 172.21.15.92:37776) 2023-10-16T13:14:22.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f626659c700 1 -- 172.21.15.92:0/1854584886 learned_addr learned my addr 172.21.15.92:0/1854584886 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f6265d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62681009c0 0x7f626819bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f6266d9d700 1 --2- 172.21.15.92:0/1854584886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6268101440 0x7f626819e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f626659c700 1 -- 172.21.15.92:0/1854584886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62681009c0 msgr2=0x7f626819bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f626659c700 1 --2- 172.21.15.92:0/1854584886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62681009c0 0x7f626819bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f626659c700 1 -- 172.21.15.92:0/1854584886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6268101440 msgr2=0x7f626819e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f626659c700 1 --2- 172.21.15.92:0/1854584886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6268101440 0x7f626819e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f626659c700 1 -- 172.21.15.92:0/1854584886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6260009d00 con 0x7f6268100000 2023-10-16T13:14:22.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f6266d9d700 1 --2- 172.21.15.92:0/1854584886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6268101440 0x7f626819e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:22.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f626659c700 1 --2- 172.21.15.92:0/1854584886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6268100000 0x7f62680ffa60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f625800d950 tx=0x7f625800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f62577fe700 1 -- 172.21.15.92:0/1854584886 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625800f890 con 0x7f6268100000 2023-10-16T13:14:22.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f626cc99700 1 -- 172.21.15.92:0/1854584886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626819eeb0 con 0x7f6268100000 2023-10-16T13:14:22.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f62577fe700 1 -- 172.21.15.92:0/1854584886 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6258010460 con 0x7f6268100000 2023-10-16T13:14:22.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f62577fe700 1 -- 172.21.15.92:0/1854584886 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625800e610 con 0x7f6268100000 2023-10-16T13:14:22.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.893+0000 7f626cc99700 1 -- 172.21.15.92:0/1854584886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626819f2e0 con 0x7f6268100000 2023-10-16T13:14:22.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.896+0000 7f62577fe700 1 -- 172.21.15.92:0/1854584886 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6258010960 con 0x7f6268100000 2023-10-16T13:14:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.896+0000 7f62577fe700 1 --2- 172.21.15.92:0/1854584886 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f62500a1480 0x7f62500a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.896+0000 7f62577fe700 1 -- 172.21.15.92:0/1854584886 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f62580cce10 con 0x7f6268100000 2023-10-16T13:14:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.896+0000 7f6265d9b700 1 --2- 172.21.15.92:0/1854584886 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f62500a1480 0x7f62500a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.897+0000 7f6265d9b700 1 --2- 172.21.15.92:0/1854584886 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f62500a1480 0x7f62500a3940 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f625c009c60 tx=0x7f625c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.898+0000 7f6278e83b80 1 Processor -- start 2023-10-16T13:14:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.898+0000 7f6278e83b80 1 -- start start 2023-10-16T13:14:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.898+0000 7f6278e83b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b2ee20 0x559525b2f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.898+0000 7f6278e83b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2f780 0x559525b30040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.898+0000 7f6278e83b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b30620 0x559525b30aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.898+0000 7f6278e83b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559525aa3c70 con 0x559525b30620 2023-10-16T13:14:22.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.898+0000 7f6278e83b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559525a88c60 con 0x559525b2ee20 2023-10-16T13:14:22.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.898+0000 7f6278e83b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559525a86580 con 0x559525b2f780 2023-10-16T13:14:22.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.898+0000 7f6266d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b30620 0x559525b30aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.898+0000 7f6266d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b30620 0x559525b30aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37788/0 (socket says 172.21.15.92:37788) 2023-10-16T13:14:22.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.898+0000 7f6266d9d700 1 -- 172.21.15.92:0/853982871 learned_addr learned my addr 172.21.15.92:0/853982871 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.898+0000 7f626659c700 1 --2- 172.21.15.92:0/853982871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b2ee20 0x559525b2f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.899+0000 7f6265d9b700 1 --2- 172.21.15.92:0/853982871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2f780 0x559525b30040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.899+0000 7f6266d9d700 1 -- 172.21.15.92:0/853982871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2f780 msgr2=0x559525b30040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.899+0000 7f6266d9d700 1 --2- 172.21.15.92:0/853982871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2f780 0x559525b30040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.899+0000 7f6266d9d700 1 -- 172.21.15.92:0/853982871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b2ee20 msgr2=0x559525b2f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.899+0000 7f6266d9d700 1 --2- 172.21.15.92:0/853982871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b2ee20 0x559525b2f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.899+0000 7f6266d9d700 1 -- 172.21.15.92:0/853982871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559525a3f3f0 con 0x559525b30620 2023-10-16T13:14:22.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.899+0000 7f626659c700 1 --2- 172.21.15.92:0/853982871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b2ee20 0x559525b2f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:22.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.899+0000 7f6266d9d700 1 --2- 172.21.15.92:0/853982871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b30620 0x559525b30aa0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6260009360 tx=0x7f6260009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127fbb78b5db2ef5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.899+0000 7f6254ff9700 1 -- 172.21.15.92:0/853982871 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626000e040 con 0x559525b30620 2023-10-16T13:14:22.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.899+0000 7f6254ff9700 1 -- 172.21.15.92:0/853982871 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f626000bcb0 con 0x559525b30620 2023-10-16T13:14:22.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.899+0000 7f6254ff9700 1 -- 172.21.15.92:0/853982871 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260005280 con 0x559525b30620 2023-10-16T13:14:22.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.900+0000 7f6278e83b80 1 -- 172.21.15.92:0/853982871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b30620 msgr2=0x559525b30aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.900+0000 7f6278e83b80 1 --2- 172.21.15.92:0/853982871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b30620 0x559525b30aa0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6260009360 tx=0x7f6260009390 comp rx=0 tx=0).stop 2023-10-16T13:14:22.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.900+0000 7f6278e83b80 1 -- 172.21.15.92:0/853982871 shutdown_connections 2023-10-16T13:14:22.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.900+0000 7f6278e83b80 1 --2- 172.21.15.92:0/853982871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b30620 0x559525b30aa0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.900+0000 7f6278e83b80 1 --2- 172.21.15.92:0/853982871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b2ee20 0x559525b2f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.900+0000 7f6278e83b80 1 --2- 172.21.15.92:0/853982871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2f780 0x559525b30040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.900+0000 7f6278e83b80 1 -- 172.21.15.92:0/853982871 >> 172.21.15.92:0/853982871 conn(0x559525a5cdd0 msgr2=0x559525b29fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.900+0000 7f6278e83b80 1 -- 172.21.15.92:0/853982871 shutdown_connections 2023-10-16T13:14:22.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.900+0000 7f6278e83b80 1 -- 172.21.15.92:0/853982871 wait complete. 2023-10-16T13:14:22.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.900+0000 7f6278e83b80 1 -- start start 2023-10-16T13:14:22.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.900+0000 7f6278e83b80 1 Processor -- start 2023-10-16T13:14:22.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f6278e83b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2ee20 0x559525b38c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f6278e83b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b2f780 0x559525b39150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f6278e83b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b30620 0x559525b40190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f6278e83b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559525a81e70 con 0x559525b2f780 2023-10-16T13:14:22.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f6278e83b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559525a1e710 con 0x559525b30620 2023-10-16T13:14:22.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f6278e83b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559525a1e3b0 con 0x559525b2ee20 2023-10-16T13:14:22.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f6278e83b80 10 client.0 _ll_register_callbacks cb 0x55952587b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:22.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f6265d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b2f780 0x559525b39150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f6265d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b2f780 0x559525b39150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37792/0 (socket says 172.21.15.92:37792) 2023-10-16T13:14:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f6265d9b700 1 -- 172.21.15.92:0/3266841383 learned_addr learned my addr 172.21.15.92:0/3266841383 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f6266d9d700 1 --2- 172.21.15.92:0/3266841383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b30620 0x559525b40190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f626659c700 1 --2- 172.21.15.92:0/3266841383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2ee20 0x559525b38c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f6265d9b700 1 -- 172.21.15.92:0/3266841383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2ee20 msgr2=0x559525b38c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f6265d9b700 1 --2- 172.21.15.92:0/3266841383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2ee20 0x559525b38c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f6265d9b700 1 -- 172.21.15.92:0/3266841383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b30620 msgr2=0x559525b40190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f6265d9b700 1 --2- 172.21.15.92:0/3266841383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b30620 0x559525b40190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f6265d9b700 1 -- 172.21.15.92:0/3266841383 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626819f2e0 con 0x559525b2f780 2023-10-16T13:14:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f6266d9d700 1 --2- 172.21.15.92:0/3266841383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b30620 0x559525b40190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f6265d9b700 1 --2- 172.21.15.92:0/3266841383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b2f780 0x559525b39150 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f625c01ec10 tx=0x7f625c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702246d27427eb9d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.901+0000 7f624dffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:22.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.902+0000 7f624dffb700 1 -- 172.21.15.92:0/3266841383 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c00ea50 con 0x559525b2f780 2023-10-16T13:14:22.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.902+0000 7f624dffb700 1 -- 172.21.15.92:0/3266841383 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f625c00ebb0 con 0x559525b2f780 2023-10-16T13:14:22.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.902+0000 7f6278e83b80 1 -- 172.21.15.92:0/3266841383 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559525a86ef0 con 0x559525b2f780 2023-10-16T13:14:22.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.902+0000 7f624dffb700 1 -- 172.21.15.92:0/3266841383 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f625c00ed70 con 0x559525b2f780 2023-10-16T13:14:22.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.902+0000 7f6278e83b80 10 client.15774 fetch_fsmap learned FSMap version 27 2023-10-16T13:14:22.922 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.902+0000 7f6278e83b80 1 -- 172.21.15.92:0/3266841383 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f6268108c10 con 0x559525b2f780 2023-10-16T13:14:22.922 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.902+0000 7f624dffb700 1 -- 172.21.15.92:0/3266841383 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x559525a86ef0 con 0x559525b2f780 2023-10-16T13:14:22.922 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.902+0000 7f624dffb700 1 -- 172.21.15.92:0/3266841383 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f625c031520 con 0x559525b2f780 2023-10-16T13:14:22.922 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.902+0000 7f6278e83b80 10 client.15774 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:14:22.922 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.902+0000 7f6278e83b80 10 client.15774 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-16T13:14:22.923 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.902+0000 7f6278e83b80 20 client.15774 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:22.923 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.902+0000 7f6278e83b80 1 --2- 172.21.15.92:0/3266841383 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x559525b44ae0 0x559525b46f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.923 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.902+0000 7f6278e83b80 4 client.15774 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:14:22.923 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.902+0000 7f6278e83b80 1 -- 172.21.15.92:0/3266841383 --> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559525afec10 con 0x559525b44ae0 2023-10-16T13:14:22.923 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.902+0000 7f626659c700 1 --2- 172.21.15.92:0/3266841383 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x559525b44ae0 0x559525b46f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.923 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.903+0000 7f626659c700 1 --2- 172.21.15.92:0/3266841383 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x559525b44ae0 0x559525b46f00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cfdb331ac086badb server_cookie=e05bb528c839cf7a in_seq=0 out_seq=0 2023-10-16T13:14:22.924 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.903+0000 7f624dffb700 10 client.15774 ms_handle_connect on v2:172.21.15.152:6838/1821921588 2023-10-16T13:14:22.924 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.903+0000 7f624dffb700 1 -- 172.21.15.92:0/3266841383 <== mds.1 v2:172.21.15.152:6838/1821921588 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559525afec10 con 0x559525b44ae0 2023-10-16T13:14:22.924 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.903+0000 7f624dffb700 10 client.15774 handle_command_reply: tid=0 2023-10-16T13:14:22.924 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.903+0000 7f6278e83b80 1 client.15774 shutdown 2023-10-16T13:14:22.924 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.903+0000 7f6278e83b80 1 -- 172.21.15.92:0/3266841383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b2f780 msgr2=0x559525b39150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.904+0000 7f6278e83b80 1 --2- 172.21.15.92:0/3266841383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b2f780 0x559525b39150 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f625c01ec10 tx=0x7f625c0047c0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.904+0000 7f6278e83b80 1 -- 172.21.15.92:0/3266841383 shutdown_connections 2023-10-16T13:14:22.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.904+0000 7f6278e83b80 1 --2- 172.21.15.92:0/3266841383 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x559525b44ae0 0x559525b46f00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.904+0000 7f6278e83b80 1 --2- 172.21.15.92:0/3266841383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b30620 0x559525b40190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.904+0000 7f624dffb700 0 client.15774 ms_handle_reset on v2:172.21.15.152:6838/1821921588 2023-10-16T13:14:22.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.904+0000 7f6278e83b80 1 --2- 172.21.15.92:0/3266841383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2ee20 0x559525b38c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.904+0000 7f6278e83b80 1 --2- 172.21.15.92:0/3266841383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b2f780 0x559525b39150 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.904+0000 7f6278e83b80 1 -- 172.21.15.92:0/3266841383 >> 172.21.15.92:0/3266841383 conn(0x559525a5cdd0 msgr2=0x559525b29bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.904+0000 7f6278e83b80 1 -- 172.21.15.92:0/3266841383 shutdown_connections 2023-10-16T13:14:22.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.904+0000 7f6278e83b80 1 -- 172.21.15.92:0/3266841383 wait complete. 2023-10-16T13:14:22.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.904+0000 7f6278e83b80 20 client.15774 trim_cache size 0 max 16384 2023-10-16T13:14:22.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.917+0000 7f6278e83b80 1 Processor -- start 2023-10-16T13:14:22.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.917+0000 7f6278e83b80 1 -- start start 2023-10-16T13:14:22.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.917+0000 7f6278e83b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2ee20 0x559525b33550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.917+0000 7f6278e83b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b2f780 0x559525b33a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.917+0000 7f6278e83b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b30620 0x559525b40150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.917+0000 7f6278e83b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559525902920 con 0x559525b30620 2023-10-16T13:14:22.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.917+0000 7f6278e83b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559525b380c0 con 0x559525b2f780 2023-10-16T13:14:22.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.917+0000 7f6278e83b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559525b38780 con 0x559525b2ee20 2023-10-16T13:14:22.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.917+0000 7f6266d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b30620 0x559525b40150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.917+0000 7f6266d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b30620 0x559525b40150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37802/0 (socket says 172.21.15.92:37802) 2023-10-16T13:14:22.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.917+0000 7f6266d9d700 1 -- 172.21.15.92:0/918485449 learned_addr learned my addr 172.21.15.92:0/918485449 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.917+0000 7f6265d9b700 1 --2- 172.21.15.92:0/918485449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b2f780 0x559525b33a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.917+0000 7f626659c700 1 --2- 172.21.15.92:0/918485449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2ee20 0x559525b33550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.917+0000 7f6266d9d700 1 -- 172.21.15.92:0/918485449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2ee20 msgr2=0x559525b33550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.917+0000 7f6266d9d700 1 --2- 172.21.15.92:0/918485449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2ee20 0x559525b33550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.917+0000 7f6266d9d700 1 -- 172.21.15.92:0/918485449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b2f780 msgr2=0x559525b33a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.917+0000 7f6266d9d700 1 --2- 172.21.15.92:0/918485449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b2f780 0x559525b33a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.917+0000 7f6266d9d700 1 -- 172.21.15.92:0/918485449 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595258acde0 con 0x559525b30620 2023-10-16T13:14:22.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.918+0000 7f6266d9d700 1 --2- 172.21.15.92:0/918485449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b30620 0x559525b40150 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6260009400 tx=0x7f62600099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5d42e3b6326ede server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.918+0000 7f62557fa700 1 -- 172.21.15.92:0/918485449 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626000e070 con 0x559525b30620 2023-10-16T13:14:22.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.918+0000 7f62557fa700 1 -- 172.21.15.92:0/918485449 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f626000f040 con 0x559525b30620 2023-10-16T13:14:22.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.918+0000 7f62557fa700 1 -- 172.21.15.92:0/918485449 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260005990 con 0x559525b30620 2023-10-16T13:14:22.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.918+0000 7f6278e83b80 1 -- 172.21.15.92:0/918485449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b30620 msgr2=0x559525b40150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.918+0000 7f6278e83b80 1 --2- 172.21.15.92:0/918485449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b30620 0x559525b40150 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6260009400 tx=0x7f62600099e0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.918+0000 7f6278e83b80 1 -- 172.21.15.92:0/918485449 shutdown_connections 2023-10-16T13:14:22.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.918+0000 7f6278e83b80 1 --2- 172.21.15.92:0/918485449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b30620 0x559525b40150 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.918+0000 7f6278e83b80 1 --2- 172.21.15.92:0/918485449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2ee20 0x559525b33550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.918+0000 7f6278e83b80 1 --2- 172.21.15.92:0/918485449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b2f780 0x559525b33a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.918+0000 7f6278e83b80 1 -- 172.21.15.92:0/918485449 >> 172.21.15.92:0/918485449 conn(0x559525a5cdd0 msgr2=0x559525b369f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.918+0000 7f6278e83b80 1 -- 172.21.15.92:0/918485449 shutdown_connections 2023-10-16T13:14:22.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.918+0000 7f6278e83b80 1 -- 172.21.15.92:0/918485449 wait complete. 2023-10-16T13:14:22.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f6278e83b80 1 -- start start 2023-10-16T13:14:22.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f6278e83b80 1 Processor -- start 2023-10-16T13:14:22.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f6278e83b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b2ee20 0x559525b3b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f6278e83b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2f780 0x559525b3be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f6278e83b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b30620 0x559525b3ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f6278e83b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559525b3f390 con 0x559525b2ee20 2023-10-16T13:14:22.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f6278e83b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559525b3f500 con 0x559525b30620 2023-10-16T13:14:22.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f6278e83b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559525b3f6c0 con 0x559525b2f780 2023-10-16T13:14:22.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f6278e83b80 10 client.0 _ll_register_callbacks cb 0x7f625c01e7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:22.939 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f626659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b2ee20 0x559525b3b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.939 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f626659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b2ee20 0x559525b3b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37804/0 (socket says 172.21.15.92:37804) 2023-10-16T13:14:22.939 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f626659c700 1 -- 172.21.15.92:0/3865954981 learned_addr learned my addr 172.21.15.92:0/3865954981 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:22.939 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f6266d9d700 1 --2- 172.21.15.92:0/3865954981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b30620 0x559525b3ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.939 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f6265d9b700 1 --2- 172.21.15.92:0/3865954981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2f780 0x559525b3be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f626659c700 1 -- 172.21.15.92:0/3865954981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2f780 msgr2=0x559525b3be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f626659c700 1 --2- 172.21.15.92:0/3865954981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2f780 0x559525b3be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f626659c700 1 -- 172.21.15.92:0/3865954981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b30620 msgr2=0x559525b3ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:22.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f626659c700 1 --2- 172.21.15.92:0/3865954981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b30620 0x559525b3ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f626659c700 1 -- 172.21.15.92:0/3865954981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559525a3f3f0 con 0x559525b2ee20 2023-10-16T13:14:22.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f626659c700 1 --2- 172.21.15.92:0/3865954981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b2ee20 0x559525b3b8f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f625809a0c0 tx=0x7f62580cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f08d854ff436fa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:22.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.919+0000 7f624dffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:22.942 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.920+0000 7f624dffb700 1 -- 172.21.15.92:0/3865954981 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62580105d0 con 0x559525b2ee20 2023-10-16T13:14:22.942 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.920+0000 7f624dffb700 1 -- 172.21.15.92:0/3865954981 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6258010730 con 0x559525b2ee20 2023-10-16T13:14:22.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.920+0000 7f6278e83b80 1 -- 172.21.15.92:0/3865954981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f626000bcb0 con 0x559525b2ee20 2023-10-16T13:14:22.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.920+0000 7f624dffb700 1 -- 172.21.15.92:0/3865954981 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f625809a390 con 0x559525b2ee20 2023-10-16T13:14:22.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.920+0000 7f6278e83b80 10 client.15780 fetch_fsmap learned FSMap version 27 2023-10-16T13:14:22.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.920+0000 7f6278e83b80 1 -- 172.21.15.92:0/3865954981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559525895c60 con 0x559525b2ee20 2023-10-16T13:14:22.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.920+0000 7f624dffb700 1 -- 172.21.15.92:0/3865954981 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f625807d080 con 0x559525b2ee20 2023-10-16T13:14:22.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.920+0000 7f624dffb700 1 -- 172.21.15.92:0/3865954981 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f62580a2030 con 0x559525b2ee20 2023-10-16T13:14:22.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.920+0000 7f6278e83b80 10 client.15780 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:14:22.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.920+0000 7f6278e83b80 10 client.15780 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-16T13:14:22.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.920+0000 7f6278e83b80 20 client.15780 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:22.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.920+0000 7f6278e83b80 1 --2- 172.21.15.92:0/3865954981 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x559525b99090 0x559525b9b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:22.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.920+0000 7f6278e83b80 4 client.15780 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-16T13:14:22.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.920+0000 7f6278e83b80 1 -- 172.21.15.92:0/3865954981 --> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559525a7ae50 con 0x559525b99090 2023-10-16T13:14:22.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.920+0000 7f6265d9b700 1 --2- 172.21.15.92:0/3865954981 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x559525b99090 0x559525b9b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:22.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.921+0000 7f624dffb700 10 client.15780 ms_handle_connect on v2:172.21.15.152:6838/1821921588 2023-10-16T13:14:22.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.921+0000 7f6265d9b700 1 --2- 172.21.15.92:0/3865954981 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x559525b99090 0x559525b9b4b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=58a43928a8b9e260 server_cookie=f8e035eeac6cb582 in_seq=0 out_seq=0 2023-10-16T13:14:22.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.921+0000 7f624dffb700 1 -- 172.21.15.92:0/3865954981 <== mds.1 v2:172.21.15.152:6838/1821921588 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559525a7ae50 con 0x559525b99090 2023-10-16T13:14:22.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.921+0000 7f624dffb700 10 client.15780 handle_command_reply: tid=0 2023-10-16T13:14:22.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.921+0000 7f6278e83b80 1 client.15780 shutdown 2023-10-16T13:14:22.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.921+0000 7f6278e83b80 1 -- 172.21.15.92:0/3865954981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b2ee20 msgr2=0x559525b3b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.921+0000 7f6278e83b80 1 --2- 172.21.15.92:0/3865954981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b2ee20 0x559525b3b8f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f625809a0c0 tx=0x7f62580cc040 comp rx=0 tx=0).stop 2023-10-16T13:14:22.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.921+0000 7f6278e83b80 1 -- 172.21.15.92:0/3865954981 shutdown_connections 2023-10-16T13:14:22.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.921+0000 7f6278e83b80 1 --2- 172.21.15.92:0/3865954981 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x559525b99090 0x559525b9b4b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.921+0000 7f6278e83b80 1 --2- 172.21.15.92:0/3865954981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559525b2ee20 0x559525b3b8f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.921+0000 7f6278e83b80 1 --2- 172.21.15.92:0/3865954981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559525b30620 0x559525b3ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.921+0000 7f6278e83b80 1 --2- 172.21.15.92:0/3865954981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559525b2f780 0x559525b3be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.921+0000 7f624dffb700 0 client.15780 ms_handle_reset on v2:172.21.15.152:6838/1821921588 2023-10-16T13:14:22.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.921+0000 7f6278e83b80 1 -- 172.21.15.92:0/3865954981 >> 172.21.15.92:0/3865954981 conn(0x559525a5cdd0 msgr2=0x559525b33550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.921+0000 7f6278e83b80 1 -- 172.21.15.92:0/3865954981 shutdown_connections 2023-10-16T13:14:22.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.921+0000 7f6278e83b80 1 -- 172.21.15.92:0/3865954981 wait complete. 2023-10-16T13:14:22.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.921+0000 7f6278e83b80 20 client.15780 trim_cache size 0 max 16384 2023-10-16T13:14:22.952 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2023-10-16T13:14:22.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.922+0000 7f626cc99700 1 -- 172.21.15.92:0/1854584886 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f62500a1480 msgr2=0x7f62500a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.922+0000 7f626cc99700 1 --2- 172.21.15.92:0/1854584886 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f62500a1480 0x7f62500a3940 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f625c009c60 tx=0x7f625c009260 comp rx=0 tx=0).stop 2023-10-16T13:14:22.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.922+0000 7f626cc99700 1 -- 172.21.15.92:0/1854584886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6268100000 msgr2=0x7f62680ffa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:22.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.922+0000 7f626cc99700 1 --2- 172.21.15.92:0/1854584886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6268100000 0x7f62680ffa60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f625800d950 tx=0x7f625800dc60 comp rx=0 tx=0).stop 2023-10-16T13:14:22.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.922+0000 7f626cc99700 1 -- 172.21.15.92:0/1854584886 shutdown_connections 2023-10-16T13:14:22.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.922+0000 7f626cc99700 1 --2- 172.21.15.92:0/1854584886 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f62500a1480 0x7f62500a3940 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.922+0000 7f626cc99700 1 --2- 172.21.15.92:0/1854584886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6268100000 0x7f62680ffa60 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.922+0000 7f626cc99700 1 --2- 172.21.15.92:0/1854584886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6268101440 0x7f626819e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.955 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.922+0000 7f626cc99700 1 --2- 172.21.15.92:0/1854584886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62681009c0 0x7f626819bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:22.955 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.922+0000 7f626cc99700 1 -- 172.21.15.92:0/1854584886 >> 172.21.15.92:0/1854584886 conn(0x7f62680faa90 msgr2=0x7f6268104480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:22.955 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.922+0000 7f626cc99700 1 -- 172.21.15.92:0/1854584886 shutdown_connections 2023-10-16T13:14:22.955 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:22.922+0000 7f626cc99700 1 -- 172.21.15.92:0/1854584886 wait complete. 2023-10-16T13:14:22.956 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-16T13:14:22.956 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:22 smithi152 ceph-mon[104423]: pgmap v338: 97 pgs: 97 active+clean; 98 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 1.1 MiB/s wr, 805 op/s 2023-10-16T13:14:22.957 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:22 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1358694789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:14:23.086 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.082+0000 7ff249f22700 1 -- 172.21.15.92:0/2944568121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff244100fa0 msgr2=0x7ff244101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:23.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.082+0000 7ff249f22700 1 --2- 172.21.15.92:0/2944568121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff244100fa0 0x7ff244101400 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0099c0 tx=0x7ff22c009cd0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.082+0000 7ff249f22700 1 -- 172.21.15.92:0/2944568121 shutdown_connections 2023-10-16T13:14:23.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.082+0000 7ff249f22700 1 --2- 172.21.15.92:0/2944568121 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff244101940 0x7ff2441081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.082+0000 7ff249f22700 1 --2- 172.21.15.92:0/2944568121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2440ffdb0 0x7ff2441001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.088 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.082+0000 7ff249f22700 1 --2- 172.21.15.92:0/2944568121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff244100fa0 0x7ff244101400 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.088 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.082+0000 7ff249f22700 1 -- 172.21.15.92:0/2944568121 >> 172.21.15.92:0/2944568121 conn(0x7ff2440fb320 msgr2=0x7ff2440fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:23.088 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.082+0000 7ff249f22700 1 -- 172.21.15.92:0/2944568121 shutdown_connections 2023-10-16T13:14:23.088 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.082+0000 7ff249f22700 1 -- 172.21.15.92:0/2944568121 wait complete. 2023-10-16T13:14:23.088 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.082+0000 7ff249f22700 1 Processor -- start 2023-10-16T13:14:23.088 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.083+0000 7ff249f22700 1 -- start start 2023-10-16T13:14:23.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.083+0000 7ff249f22700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2440ffdb0 0x7ff244103d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:23.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.083+0000 7ff249f22700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff244100fa0 0x7ff244102380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:23.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.083+0000 7ff249f22700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff244101940 0x7ff2441028c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:23.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.083+0000 7ff249f22700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff244103060 con 0x7ff244100fa0 2023-10-16T13:14:23.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.083+0000 7ff249f22700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2441031d0 con 0x7ff244101940 2023-10-16T13:14:23.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.083+0000 7ff249f22700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2441a0cd0 con 0x7ff2440ffdb0 2023-10-16T13:14:23.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.083+0000 7ff242ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff244100fa0 0x7ff244102380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:23.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.083+0000 7ff242ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff244100fa0 0x7ff244102380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37820/0 (socket says 172.21.15.92:37820) 2023-10-16T13:14:23.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.083+0000 7ff242ffd700 1 -- 172.21.15.92:0/1034593287 learned_addr learned my addr 172.21.15.92:0/1034593287 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:23.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.083+0000 7ff243fff700 1 --2- 172.21.15.92:0/1034593287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff244101940 0x7ff2441028c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:23.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.083+0000 7ff2437fe700 1 --2- 172.21.15.92:0/1034593287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2440ffdb0 0x7ff244103d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:23.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.083+0000 7ff242ffd700 1 -- 172.21.15.92:0/1034593287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2440ffdb0 msgr2=0x7ff244103d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:23.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.083+0000 7ff242ffd700 1 --2- 172.21.15.92:0/1034593287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2440ffdb0 0x7ff244103d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.083+0000 7ff242ffd700 1 -- 172.21.15.92:0/1034593287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff244101940 msgr2=0x7ff2441028c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:23.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.083+0000 7ff242ffd700 1 --2- 172.21.15.92:0/1034593287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff244101940 0x7ff2441028c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.083+0000 7ff242ffd700 1 -- 172.21.15.92:0/1034593287 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c0095f0 con 0x7ff244100fa0 2023-10-16T13:14:23.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.083+0000 7ff242ffd700 1 --2- 172.21.15.92:0/1034593287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff244100fa0 0x7ff244102380 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff22c00c010 tx=0x7ff22c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:23.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.083+0000 7ff240ff9700 1 -- 172.21.15.92:0/1034593287 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c01d070 con 0x7ff244100fa0 2023-10-16T13:14:23.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.084+0000 7ff249f22700 1 -- 172.21.15.92:0/1034593287 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2441a0f50 con 0x7ff244100fa0 2023-10-16T13:14:23.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.084+0000 7ff240ff9700 1 -- 172.21.15.92:0/1034593287 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff22c00fb40 con 0x7ff244100fa0 2023-10-16T13:14:23.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.084+0000 7ff240ff9700 1 -- 172.21.15.92:0/1034593287 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0173f0 con 0x7ff244100fa0 2023-10-16T13:14:23.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.084+0000 7ff249f22700 1 -- 172.21.15.92:0/1034593287 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2441a1310 con 0x7ff244100fa0 2023-10-16T13:14:23.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.086+0000 7ff240ff9700 1 -- 172.21.15.92:0/1034593287 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff22c00fcb0 con 0x7ff244100fa0 2023-10-16T13:14:23.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.086+0000 7ff240ff9700 1 --2- 172.21.15.92:0/1034593287 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff2300a1480 0x7ff2300a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:23.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.087+0000 7ff2437fe700 1 --2- 172.21.15.92:0/1034593287 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff2300a1480 0x7ff2300a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:23.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.087+0000 7ff240ff9700 1 -- 172.21.15.92:0/1034593287 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff22c0cdec0 con 0x7ff244100fa0 2023-10-16T13:14:23.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.087+0000 7ff2437fe700 1 --2- 172.21.15.92:0/1034593287 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff2300a1480 0x7ff2300a3940 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff244100e00 tx=0x7ff234009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:23.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff25610cb80 1 Processor -- start 2023-10-16T13:14:23.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff25610cb80 1 -- start start 2023-10-16T13:14:23.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff25610cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 0x55b84f906240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:23.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff25610cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 0x55b84f907040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:23.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff25610cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f907620 0x55b84f907aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:23.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff25610cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84f87ac70 con 0x55b84f905e20 2023-10-16T13:14:23.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff25610cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84f85fc60 con 0x55b84f907620 2023-10-16T13:14:23.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff25610cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84f85d580 con 0x55b84f906780 2023-10-16T13:14:23.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff2437fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 0x55b84f906240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:23.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff2437fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 0x55b84f906240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37826/0 (socket says 172.21.15.92:37826) 2023-10-16T13:14:23.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff2437fe700 1 -- 172.21.15.92:0/2763354934 learned_addr learned my addr 172.21.15.92:0/2763354934 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:23.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff243fff700 1 --2- 172.21.15.92:0/2763354934 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f907620 0x55b84f907aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:23.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff242ffd700 1 --2- 172.21.15.92:0/2763354934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 0x55b84f907040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:23.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff2437fe700 1 -- 172.21.15.92:0/2763354934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 msgr2=0x55b84f907040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:23.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff2437fe700 1 --2- 172.21.15.92:0/2763354934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 0x55b84f907040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff2437fe700 1 -- 172.21.15.92:0/2763354934 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f907620 msgr2=0x55b84f907aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:23.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff2437fe700 1 --2- 172.21.15.92:0/2763354934 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f907620 0x55b84f907aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff2437fe700 1 -- 172.21.15.92:0/2763354934 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b84f8163f0 con 0x55b84f905e20 2023-10-16T13:14:23.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff242ffd700 1 --2- 172.21.15.92:0/2763354934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 0x55b84f907040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:14:23.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.088+0000 7ff2437fe700 1 --2- 172.21.15.92:0/2763354934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 0x55b84f906240 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff234011e20 tx=0x7ff234014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e035eaa6e6acbfbf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:23.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.089+0000 7ff239ffb700 1 -- 172.21.15.92:0/2763354934 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff234012dc0 con 0x55b84f905e20 2023-10-16T13:14:23.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.089+0000 7ff239ffb700 1 -- 172.21.15.92:0/2763354934 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff234016070 con 0x55b84f905e20 2023-10-16T13:14:23.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.089+0000 7ff239ffb700 1 -- 172.21.15.92:0/2763354934 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23401d610 con 0x55b84f905e20 2023-10-16T13:14:23.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.089+0000 7ff25610cb80 1 -- 172.21.15.92:0/2763354934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 msgr2=0x55b84f906240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:23.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.089+0000 7ff25610cb80 1 --2- 172.21.15.92:0/2763354934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 0x55b84f906240 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff234011e20 tx=0x7ff234014000 comp rx=0 tx=0).stop 2023-10-16T13:14:23.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.089+0000 7ff25610cb80 1 -- 172.21.15.92:0/2763354934 shutdown_connections 2023-10-16T13:14:23.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.089+0000 7ff25610cb80 1 --2- 172.21.15.92:0/2763354934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 0x55b84f906240 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.089+0000 7ff25610cb80 1 --2- 172.21.15.92:0/2763354934 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f907620 0x55b84f907aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.089+0000 7ff25610cb80 1 --2- 172.21.15.92:0/2763354934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 0x55b84f907040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.089+0000 7ff25610cb80 1 -- 172.21.15.92:0/2763354934 >> 172.21.15.92:0/2763354934 conn(0x55b84f833dd0 msgr2=0x55b84f900fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:23.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.089+0000 7ff25610cb80 1 -- 172.21.15.92:0/2763354934 shutdown_connections 2023-10-16T13:14:23.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.089+0000 7ff25610cb80 1 -- 172.21.15.92:0/2763354934 wait complete. 2023-10-16T13:14:23.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.090+0000 7ff25610cb80 1 -- start start 2023-10-16T13:14:23.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.090+0000 7ff25610cb80 1 Processor -- start 2023-10-16T13:14:23.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.090+0000 7ff25610cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f905e20 0x55b84f90fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:23.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.090+0000 7ff25610cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 0x55b84f910200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:23.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.090+0000 7ff25610cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f907620 0x55b84f917240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:23.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.090+0000 7ff25610cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84f858e70 con 0x55b84f907620 2023-10-16T13:14:23.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.090+0000 7ff25610cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84f7f5710 con 0x55b84f905e20 2023-10-16T13:14:23.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.090+0000 7ff25610cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84f7f53b0 con 0x55b84f906780 2023-10-16T13:14:23.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.090+0000 7ff25610cb80 10 client.0 _ll_register_callbacks cb 0x55b84f652800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:23.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.090+0000 7ff243fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f907620 0x55b84f917240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:23.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.090+0000 7ff2437fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f905e20 0x55b84f90fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:23.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.090+0000 7ff243fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f907620 0x55b84f917240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37836/0 (socket says 172.21.15.92:37836) 2023-10-16T13:14:23.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.090+0000 7ff2437fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f905e20 0x55b84f90fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:38640/0 (socket says 172.21.15.92:38640) 2023-10-16T13:14:23.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.090+0000 7ff243fff700 1 -- 172.21.15.92:0/1954693196 learned_addr learned my addr 172.21.15.92:0/1954693196 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:23.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.090+0000 7ff242ffd700 1 --2- 172.21.15.92:0/1954693196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 0x55b84f910200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:23.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff243fff700 1 -- 172.21.15.92:0/1954693196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 msgr2=0x55b84f910200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:23.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff243fff700 1 --2- 172.21.15.92:0/1954693196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 0x55b84f910200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff243fff700 1 -- 172.21.15.92:0/1954693196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f905e20 msgr2=0x55b84f90fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:23.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff243fff700 1 --2- 172.21.15.92:0/1954693196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f905e20 0x55b84f90fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff243fff700 1 -- 172.21.15.92:0/1954693196 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff234011ad0 con 0x55b84f907620 2023-10-16T13:14:23.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff243fff700 1 --2- 172.21.15.92:0/1954693196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f907620 0x55b84f917240 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0040c0 tx=0x7ff23c0040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbfcbd34abe39e57 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:23.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff222ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:23.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff222ffd700 1 -- 172.21.15.92:0/1954693196 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c004db0 con 0x55b84f907620 2023-10-16T13:14:23.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff25610cb80 1 -- 172.21.15.92:0/1954693196 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b84f85def0 con 0x55b84f907620 2023-10-16T13:14:23.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff222ffd700 1 -- 172.21.15.92:0/1954693196 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff23c007500 con 0x55b84f907620 2023-10-16T13:14:23.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff222ffd700 1 -- 172.21.15.92:0/1954693196 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff23c0076c0 con 0x55b84f907620 2023-10-16T13:14:23.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff25610cb80 10 client.15792 fetch_fsmap learned FSMap version 27 2023-10-16T13:14:23.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff25610cb80 1 -- 172.21.15.92:0/1954693196 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b84f683de0 con 0x55b84f907620 2023-10-16T13:14:23.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff222ffd700 1 -- 172.21.15.92:0/1954693196 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55b84f85def0 con 0x55b84f907620 2023-10-16T13:14:23.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff222ffd700 1 -- 172.21.15.92:0/1954693196 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff23c016a30 con 0x55b84f907620 2023-10-16T13:14:23.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff25610cb80 10 client.15792 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:14:23.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff25610cb80 10 client.15792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:23.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff25610cb80 20 client.15792 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:23.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff25610cb80 1 --2- 172.21.15.92:0/1954693196 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55b84f91bab0 0x55b84f91ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:23.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff25610cb80 4 client.15792 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:14:23.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.091+0000 7ff25610cb80 1 -- 172.21.15.92:0/1954693196 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b84f8d5c10 con 0x55b84f91bab0 2023-10-16T13:14:23.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.092+0000 7ff2437fe700 1 --2- 172.21.15.92:0/1954693196 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55b84f91bab0 0x55b84f91ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:23.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.092+0000 7ff222ffd700 10 client.15792 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:23.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.092+0000 7ff2437fe700 1 --2- 172.21.15.92:0/1954693196 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55b84f91bab0 0x55b84f91ded0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4caca60482dda00c server_cookie=1c53ba0488647182 in_seq=0 out_seq=0 2023-10-16T13:14:23.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.093+0000 7ff222ffd700 1 -- 172.21.15.92:0/1954693196 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b84f8d5c10 con 0x55b84f91bab0 2023-10-16T13:14:23.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.093+0000 7ff222ffd700 10 client.15792 handle_command_reply: tid=0 2023-10-16T13:14:23.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.094+0000 7ff25610cb80 1 client.15792 shutdown 2023-10-16T13:14:23.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.094+0000 7ff25610cb80 1 -- 172.21.15.92:0/1954693196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f907620 msgr2=0x55b84f917240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:23.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.094+0000 7ff25610cb80 1 --2- 172.21.15.92:0/1954693196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f907620 0x55b84f917240 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0040c0 tx=0x7ff23c0040f0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.094+0000 7ff25610cb80 1 -- 172.21.15.92:0/1954693196 shutdown_connections 2023-10-16T13:14:23.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.094+0000 7ff25610cb80 1 --2- 172.21.15.92:0/1954693196 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55b84f91bab0 0x55b84f91ded0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.094+0000 7ff25610cb80 1 --2- 172.21.15.92:0/1954693196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f907620 0x55b84f917240 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.094+0000 7ff222ffd700 0 client.15792 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:23.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.094+0000 7ff25610cb80 1 --2- 172.21.15.92:0/1954693196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f905e20 0x55b84f90fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.094+0000 7ff25610cb80 1 --2- 172.21.15.92:0/1954693196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 0x55b84f910200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.094+0000 7ff25610cb80 1 -- 172.21.15.92:0/1954693196 >> 172.21.15.92:0/1954693196 conn(0x55b84f833dd0 msgr2=0x55b84f900bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:23.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.094+0000 7ff25610cb80 1 -- 172.21.15.92:0/1954693196 shutdown_connections 2023-10-16T13:14:23.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.094+0000 7ff25610cb80 1 -- 172.21.15.92:0/1954693196 wait complete. 2023-10-16T13:14:23.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.094+0000 7ff25610cb80 20 client.15792 trim_cache size 0 max 16384 2023-10-16T13:14:23.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff25610cb80 1 Processor -- start 2023-10-16T13:14:23.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff25610cb80 1 -- start start 2023-10-16T13:14:23.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff25610cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 0x55b84f907a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:23.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff25610cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 0x55b84f917160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:23.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff25610cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f907620 0x55b84f8ff7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:23.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff25610cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84f6d9920 con 0x55b84f905e20 2023-10-16T13:14:23.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff25610cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84f9074a0 con 0x55b84f907620 2023-10-16T13:14:23.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff25610cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84f90f170 con 0x55b84f906780 2023-10-16T13:14:23.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff2437fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 0x55b84f907a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:23.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff2437fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 0x55b84f907a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37840/0 (socket says 172.21.15.92:37840) 2023-10-16T13:14:23.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff2437fe700 1 -- 172.21.15.92:0/1288417206 learned_addr learned my addr 172.21.15.92:0/1288417206 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:23.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff243fff700 1 --2- 172.21.15.92:0/1288417206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f907620 0x55b84f8ff7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:23.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff2437fe700 1 -- 172.21.15.92:0/1288417206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 msgr2=0x55b84f917160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:23.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff2437fe700 1 --2- 172.21.15.92:0/1288417206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 0x55b84f917160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff2437fe700 1 -- 172.21.15.92:0/1288417206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f907620 msgr2=0x55b84f8ff7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:23.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff2437fe700 1 --2- 172.21.15.92:0/1288417206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f907620 0x55b84f8ff7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff2437fe700 1 -- 172.21.15.92:0/1288417206 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b84f66cc60 con 0x55b84f905e20 2023-10-16T13:14:23.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff243fff700 1 --2- 172.21.15.92:0/1288417206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f907620 0x55b84f8ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:14:23.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff2437fe700 1 --2- 172.21.15.92:0/1288417206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 0x55b84f907a00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff23401fe60 tx=0x7ff234017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17341d8a602ec2fd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:23.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.107+0000 7ff23a7fc700 1 -- 172.21.15.92:0/1288417206 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23403a070 con 0x55b84f905e20 2023-10-16T13:14:23.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.108+0000 7ff23a7fc700 1 -- 172.21.15.92:0/1288417206 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff23401fe90 con 0x55b84f905e20 2023-10-16T13:14:23.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.108+0000 7ff23a7fc700 1 -- 172.21.15.92:0/1288417206 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23402d070 con 0x55b84f905e20 2023-10-16T13:14:23.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.108+0000 7ff25610cb80 1 -- 172.21.15.92:0/1288417206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 msgr2=0x55b84f907a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:23.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.108+0000 7ff25610cb80 1 --2- 172.21.15.92:0/1288417206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 0x55b84f907a00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff23401fe60 tx=0x7ff234017000 comp rx=0 tx=0).stop 2023-10-16T13:14:23.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.108+0000 7ff25610cb80 1 -- 172.21.15.92:0/1288417206 shutdown_connections 2023-10-16T13:14:23.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.108+0000 7ff25610cb80 1 --2- 172.21.15.92:0/1288417206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 0x55b84f907a00 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.108+0000 7ff25610cb80 1 --2- 172.21.15.92:0/1288417206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f907620 0x55b84f8ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.108+0000 7ff25610cb80 1 --2- 172.21.15.92:0/1288417206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 0x55b84f917160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.108+0000 7ff25610cb80 1 -- 172.21.15.92:0/1288417206 >> 172.21.15.92:0/1288417206 conn(0x55b84f833dd0 msgr2=0x55b84f90e950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:23.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.108+0000 7ff25610cb80 1 -- 172.21.15.92:0/1288417206 shutdown_connections 2023-10-16T13:14:23.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.108+0000 7ff25610cb80 1 -- 172.21.15.92:0/1288417206 wait complete. 2023-10-16T13:14:23.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.108+0000 7ff25610cb80 1 -- start start 2023-10-16T13:14:23.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff25610cb80 1 Processor -- start 2023-10-16T13:14:23.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff25610cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 0x55b84f916b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:23.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff25610cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 0x55b84f917080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:23.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff25610cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f907620 0x55b84f915150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:23.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff25610cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84f915860 con 0x55b84f905e20 2023-10-16T13:14:23.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff25610cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84f9159d0 con 0x55b84f907620 2023-10-16T13:14:23.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff25610cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84f915b90 con 0x55b84f906780 2023-10-16T13:14:23.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff25610cb80 10 client.0 _ll_register_callbacks cb 0x55b84f652800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:23.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff2437fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 0x55b84f916b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:23.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff2437fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 0x55b84f916b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37846/0 (socket says 172.21.15.92:37846) 2023-10-16T13:14:23.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff2437fe700 1 -- 172.21.15.92:0/3280544487 learned_addr learned my addr 172.21.15.92:0/3280544487 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:23.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff242ffd700 1 --2- 172.21.15.92:0/3280544487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 0x55b84f917080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:23.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff243fff700 1 --2- 172.21.15.92:0/3280544487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f907620 0x55b84f915150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:23.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff2437fe700 1 -- 172.21.15.92:0/3280544487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 msgr2=0x55b84f917080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:23.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff2437fe700 1 --2- 172.21.15.92:0/3280544487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 0x55b84f917080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff2437fe700 1 -- 172.21.15.92:0/3280544487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f907620 msgr2=0x55b84f915150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:23.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff2437fe700 1 --2- 172.21.15.92:0/3280544487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f907620 0x55b84f915150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff2437fe700 1 -- 172.21.15.92:0/3280544487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b84f8163f0 con 0x55b84f905e20 2023-10-16T13:14:23.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff2437fe700 1 --2- 172.21.15.92:0/3280544487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 0x55b84f916b40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff234011770 tx=0x7ff234012ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec361721757c989d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:23.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.109+0000 7ff222ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:23.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.110+0000 7ff222ffd700 1 -- 172.21.15.92:0/3280544487 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23402d070 con 0x55b84f905e20 2023-10-16T13:14:23.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.110+0000 7ff222ffd700 1 -- 172.21.15.92:0/3280544487 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff234018070 con 0x55b84f905e20 2023-10-16T13:14:23.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.110+0000 7ff25610cb80 1 -- 172.21.15.92:0/3280544487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff234016070 con 0x55b84f905e20 2023-10-16T13:14:23.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.110+0000 7ff222ffd700 1 -- 172.21.15.92:0/3280544487 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff23403a040 con 0x55b84f905e20 2023-10-16T13:14:23.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.110+0000 7ff25610cb80 10 client.15798 fetch_fsmap learned FSMap version 27 2023-10-16T13:14:23.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.110+0000 7ff25610cb80 1 -- 172.21.15.92:0/3280544487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b84f6aa250 con 0x55b84f905e20 2023-10-16T13:14:23.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.110+0000 7ff222ffd700 1 -- 172.21.15.92:0/3280544487 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff234016070 con 0x55b84f905e20 2023-10-16T13:14:23.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.110+0000 7ff222ffd700 1 -- 172.21.15.92:0/3280544487 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff234005460 con 0x55b84f905e20 2023-10-16T13:14:23.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.110+0000 7ff25610cb80 10 client.15798 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:14:23.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.110+0000 7ff25610cb80 10 client.15798 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:23.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.110+0000 7ff25610cb80 20 client.15798 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:23.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.110+0000 7ff25610cb80 1 --2- 172.21.15.92:0/3280544487 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55b84f9708a0 0x55b84f972c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:23.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.110+0000 7ff25610cb80 4 client.15798 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-16T13:14:23.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.110+0000 7ff25610cb80 1 -- 172.21.15.92:0/3280544487 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b84f851e50 con 0x55b84f9708a0 2023-10-16T13:14:23.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.110+0000 7ff242ffd700 1 --2- 172.21.15.92:0/3280544487 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55b84f9708a0 0x55b84f972c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:23.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.111+0000 7ff222ffd700 10 client.15798 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:23.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.111+0000 7ff242ffd700 1 --2- 172.21.15.92:0/3280544487 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55b84f9708a0 0x55b84f972c90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d06243e1852769ec server_cookie=3a8a8504ce1cc1cb in_seq=0 out_seq=0 2023-10-16T13:14:23.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.113+0000 7ff222ffd700 1 -- 172.21.15.92:0/3280544487 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b84f851e50 con 0x55b84f9708a0 2023-10-16T13:14:23.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.113+0000 7ff222ffd700 10 client.15798 handle_command_reply: tid=0 2023-10-16T13:14:23.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.113+0000 7ff25610cb80 1 client.15798 shutdown 2023-10-16T13:14:23.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.113+0000 7ff25610cb80 1 -- 172.21.15.92:0/3280544487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 msgr2=0x55b84f916b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:23.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.113+0000 7ff25610cb80 1 --2- 172.21.15.92:0/3280544487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 0x55b84f916b40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff234011770 tx=0x7ff234012ed0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.113+0000 7ff25610cb80 1 -- 172.21.15.92:0/3280544487 shutdown_connections 2023-10-16T13:14:23.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.113+0000 7ff25610cb80 1 --2- 172.21.15.92:0/3280544487 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55b84f9708a0 0x55b84f972c90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.113+0000 7ff25610cb80 1 --2- 172.21.15.92:0/3280544487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84f905e20 0x55b84f916b40 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.113+0000 7ff25610cb80 1 --2- 172.21.15.92:0/3280544487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b84f907620 0x55b84f915150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.113+0000 7ff222ffd700 0 client.15798 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:23.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.113+0000 7ff25610cb80 1 --2- 172.21.15.92:0/3280544487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84f906780 0x55b84f917080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.113+0000 7ff25610cb80 1 -- 172.21.15.92:0/3280544487 >> 172.21.15.92:0/3280544487 conn(0x55b84f833dd0 msgr2=0x55b84f8ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:23.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.114+0000 7ff25610cb80 1 -- 172.21.15.92:0/3280544487 shutdown_connections 2023-10-16T13:14:23.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.114+0000 7ff25610cb80 1 -- 172.21.15.92:0/3280544487 wait complete. 2023-10-16T13:14:23.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.114+0000 7ff25610cb80 20 client.15798 trim_cache size 0 max 16384 2023-10-16T13:14:23.137 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2023-10-16T13:14:23.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.114+0000 7ff249f22700 1 -- 172.21.15.92:0/1034593287 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff2300a1480 msgr2=0x7ff2300a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:23.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.114+0000 7ff249f22700 1 --2- 172.21.15.92:0/1034593287 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff2300a1480 0x7ff2300a3940 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff244100e00 tx=0x7ff234009260 comp rx=0 tx=0).stop 2023-10-16T13:14:23.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.114+0000 7ff249f22700 1 -- 172.21.15.92:0/1034593287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff244100fa0 msgr2=0x7ff244102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:23.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.114+0000 7ff249f22700 1 --2- 172.21.15.92:0/1034593287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff244100fa0 0x7ff244102380 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff22c00c010 tx=0x7ff22c009580 comp rx=0 tx=0).stop 2023-10-16T13:14:23.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.114+0000 7ff249f22700 1 -- 172.21.15.92:0/1034593287 shutdown_connections 2023-10-16T13:14:23.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.114+0000 7ff249f22700 1 --2- 172.21.15.92:0/1034593287 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff2300a1480 0x7ff2300a3940 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.114+0000 7ff249f22700 1 --2- 172.21.15.92:0/1034593287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff244101940 0x7ff2441028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.114+0000 7ff249f22700 1 --2- 172.21.15.92:0/1034593287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2440ffdb0 0x7ff244103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.139 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.114+0000 7ff249f22700 1 --2- 172.21.15.92:0/1034593287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff244100fa0 0x7ff244102380 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:23.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.114+0000 7ff249f22700 1 -- 172.21.15.92:0/1034593287 >> 172.21.15.92:0/1034593287 conn(0x7ff2440fb320 msgr2=0x7ff244068040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:23.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.114+0000 7ff249f22700 1 -- 172.21.15.92:0/1034593287 shutdown_connections 2023-10-16T13:14:23.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:23.114+0000 7ff249f22700 1 -- 172.21.15.92:0/1034593287 wait complete. 2023-10-16T13:14:24.141 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-16T13:14:24.141 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-16T13:14:24.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.267+0000 7fa1c3f22700 1 -- 172.21.15.92:0/73544018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1bc100fa0 msgr2=0x7fa1bc101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.267+0000 7fa1c3f22700 1 --2- 172.21.15.92:0/73544018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1bc100fa0 0x7fa1bc101400 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac0099c0 tx=0x7fa1ac009cd0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.267+0000 7fa1c3f22700 1 -- 172.21.15.92:0/73544018 shutdown_connections 2023-10-16T13:14:24.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.267+0000 7fa1c3f22700 1 --2- 172.21.15.92:0/73544018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1bc101940 0x7fa1bc1081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.267+0000 7fa1c3f22700 1 --2- 172.21.15.92:0/73544018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1bc0ffdb0 0x7fa1bc1001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.267+0000 7fa1c3f22700 1 --2- 172.21.15.92:0/73544018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1bc100fa0 0x7fa1bc101400 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.267+0000 7fa1c3f22700 1 -- 172.21.15.92:0/73544018 >> 172.21.15.92:0/73544018 conn(0x7fa1bc0fb320 msgr2=0x7fa1bc0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:24.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.267+0000 7fa1c3f22700 1 -- 172.21.15.92:0/73544018 shutdown_connections 2023-10-16T13:14:24.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.267+0000 7fa1c3f22700 1 -- 172.21.15.92:0/73544018 wait complete. 2023-10-16T13:14:24.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c3f22700 1 Processor -- start 2023-10-16T13:14:24.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c3f22700 1 -- start start 2023-10-16T13:14:24.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c3f22700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1bc0ffdb0 0x7fa1bc195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c3f22700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1bc100fa0 0x7fa1bc1960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c3f22700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1bc101940 0x7fa1bc19d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c3f22700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc19d710 con 0x7fa1bc101940 2023-10-16T13:14:24.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c3f22700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc19d850 con 0x7fa1bc0ffdb0 2023-10-16T13:14:24.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c3f22700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc19d9e0 con 0x7fa1bc100fa0 2023-10-16T13:14:24.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c24bf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1bc101940 0x7fa1bc19d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c1cbe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1bc0ffdb0 0x7fa1bc195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c24bf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1bc101940 0x7fa1bc19d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37864/0 (socket says 172.21.15.92:37864) 2023-10-16T13:14:24.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c24bf700 1 -- 172.21.15.92:0/3470246439 learned_addr learned my addr 172.21.15.92:0/3470246439 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:24.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c14bd700 1 --2- 172.21.15.92:0/3470246439 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1bc100fa0 0x7fa1bc1960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c24bf700 1 -- 172.21.15.92:0/3470246439 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1bc100fa0 msgr2=0x7fa1bc1960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c24bf700 1 --2- 172.21.15.92:0/3470246439 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1bc100fa0 0x7fa1bc1960d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c24bf700 1 -- 172.21.15.92:0/3470246439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1bc0ffdb0 msgr2=0x7fa1bc195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c24bf700 1 --2- 172.21.15.92:0/3470246439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1bc0ffdb0 0x7fa1bc195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c24bf700 1 -- 172.21.15.92:0/3470246439 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac0095f0 con 0x7fa1bc101940 2023-10-16T13:14:24.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c14bd700 1 --2- 172.21.15.92:0/3470246439 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1bc100fa0 0x7fa1bc1960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:14:24.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.268+0000 7fa1c24bf700 1 --2- 172.21.15.92:0/3470246439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1bc101940 0x7fa1bc19d140 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400b970 tx=0x7fa1b400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:24.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.269+0000 7fa1b2ffd700 1 -- 172.21.15.92:0/3470246439 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b400c930 con 0x7fa1bc101940 2023-10-16T13:14:24.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.269+0000 7fa1c3f22700 1 -- 172.21.15.92:0/3470246439 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1bc19dcc0 con 0x7fa1bc101940 2023-10-16T13:14:24.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.269+0000 7fa1b2ffd700 1 -- 172.21.15.92:0/3470246439 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa1b4014440 con 0x7fa1bc101940 2023-10-16T13:14:24.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.269+0000 7fa1b2ffd700 1 -- 172.21.15.92:0/3470246439 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b40075d0 con 0x7fa1bc101940 2023-10-16T13:14:24.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.269+0000 7fa1c3f22700 1 -- 172.21.15.92:0/3470246439 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1bc19e1d0 con 0x7fa1bc101940 2023-10-16T13:14:24.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.272+0000 7fa1b2ffd700 1 -- 172.21.15.92:0/3470246439 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa1b40145b0 con 0x7fa1bc101940 2023-10-16T13:14:24.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.272+0000 7fa1b2ffd700 1 --2- 172.21.15.92:0/3470246439 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa1a80a1480 0x7fa1a80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.272+0000 7fa1c1cbe700 1 --2- 172.21.15.92:0/3470246439 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa1a80a1480 0x7fa1a80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.272+0000 7fa1b2ffd700 1 -- 172.21.15.92:0/3470246439 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa1b4006e40 con 0x7fa1bc101940 2023-10-16T13:14:24.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1d010cb80 1 Processor -- start 2023-10-16T13:14:24.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1c1cbe700 1 --2- 172.21.15.92:0/3470246439 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa1a80a1480 0x7fa1a80a3940 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc100e00 tx=0x7fa1b8007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:24.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1d010cb80 1 -- start start 2023-10-16T13:14:24.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1d010cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e94ea0 0x563f31e952c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1d010cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e95800 0x563f31e960c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1d010cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e966a0 0x563f31e96b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1d010cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f31e09cf0 con 0x563f31e966a0 2023-10-16T13:14:24.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1d010cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f31deece0 con 0x563f31e94ea0 2023-10-16T13:14:24.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1d010cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f31dec600 con 0x563f31e95800 2023-10-16T13:14:24.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1c24bf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e966a0 0x563f31e96b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1c24bf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e966a0 0x563f31e96b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37872/0 (socket says 172.21.15.92:37872) 2023-10-16T13:14:24.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1c24bf700 1 -- 172.21.15.92:0/1009908603 learned_addr learned my addr 172.21.15.92:0/1009908603 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:24.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1c1cbe700 1 --2- 172.21.15.92:0/1009908603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e94ea0 0x563f31e952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1c14bd700 1 --2- 172.21.15.92:0/1009908603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e95800 0x563f31e960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1c24bf700 1 -- 172.21.15.92:0/1009908603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e95800 msgr2=0x563f31e960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1c24bf700 1 --2- 172.21.15.92:0/1009908603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e95800 0x563f31e960c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1c24bf700 1 -- 172.21.15.92:0/1009908603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e94ea0 msgr2=0x563f31e952c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1c24bf700 1 --2- 172.21.15.92:0/1009908603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e94ea0 0x563f31e952c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1c24bf700 1 -- 172.21.15.92:0/1009908603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f31da5470 con 0x563f31e966a0 2023-10-16T13:14:24.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.273+0000 7fa1c1cbe700 1 --2- 172.21.15.92:0/1009908603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e94ea0 0x563f31e952c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:24.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.274+0000 7fa1c24bf700 1 --2- 172.21.15.92:0/1009908603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e966a0 0x563f31e96b20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4099650 tx=0x7fa1b4014d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3927970c47bdcd0a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:24.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.274+0000 7fa1a7fff700 1 -- 172.21.15.92:0/1009908603 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b40b9070 con 0x563f31e966a0 2023-10-16T13:14:24.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.274+0000 7fa1a7fff700 1 -- 172.21.15.92:0/1009908603 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa1b4099dc0 con 0x563f31e966a0 2023-10-16T13:14:24.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.274+0000 7fa1a7fff700 1 -- 172.21.15.92:0/1009908603 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b40840b0 con 0x563f31e966a0 2023-10-16T13:14:24.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.274+0000 7fa1d010cb80 1 -- 172.21.15.92:0/1009908603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e966a0 msgr2=0x563f31e96b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.274+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/1009908603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e966a0 0x563f31e96b20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4099650 tx=0x7fa1b4014d30 comp rx=0 tx=0).stop 2023-10-16T13:14:24.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.274+0000 7fa1d010cb80 1 -- 172.21.15.92:0/1009908603 shutdown_connections 2023-10-16T13:14:24.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.274+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/1009908603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e966a0 0x563f31e96b20 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.274+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/1009908603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e94ea0 0x563f31e952c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.274+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/1009908603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e95800 0x563f31e960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.274+0000 7fa1d010cb80 1 -- 172.21.15.92:0/1009908603 >> 172.21.15.92:0/1009908603 conn(0x563f31dc2e50 msgr2=0x563f31e90060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:24.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.275+0000 7fa1d010cb80 1 -- 172.21.15.92:0/1009908603 shutdown_connections 2023-10-16T13:14:24.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.275+0000 7fa1d010cb80 1 -- 172.21.15.92:0/1009908603 wait complete. 2023-10-16T13:14:24.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.275+0000 7fa1d010cb80 1 -- start start 2023-10-16T13:14:24.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.275+0000 7fa1d010cb80 1 Processor -- start 2023-10-16T13:14:24.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.275+0000 7fa1d010cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e94ea0 0x563f31e9ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.275+0000 7fa1d010cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e95800 0x563f31e9f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.275+0000 7fa1d010cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e966a0 0x563f31ea62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.275+0000 7fa1d010cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f31de7ef0 con 0x563f31e95800 2023-10-16T13:14:24.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.275+0000 7fa1d010cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f31d84790 con 0x563f31e94ea0 2023-10-16T13:14:24.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.275+0000 7fa1d010cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f31d84430 con 0x563f31e966a0 2023-10-16T13:14:24.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.275+0000 7fa1d010cb80 10 client.0 _ll_register_callbacks cb 0x563f31be1880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:24.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.275+0000 7fa1c14bd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e95800 0x563f31e9f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.275+0000 7fa1c1cbe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e94ea0 0x563f31e9ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.276+0000 7fa1c14bd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e95800 0x563f31e9f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37876/0 (socket says 172.21.15.92:37876) 2023-10-16T13:14:24.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.276+0000 7fa1c14bd700 1 -- 172.21.15.92:0/49974249 learned_addr learned my addr 172.21.15.92:0/49974249 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:24.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.276+0000 7fa1c24bf700 1 --2- 172.21.15.92:0/49974249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e966a0 0x563f31ea62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.276+0000 7fa1c1cbe700 1 -- 172.21.15.92:0/49974249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e966a0 msgr2=0x563f31ea62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.276+0000 7fa1c1cbe700 1 --2- 172.21.15.92:0/49974249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e966a0 0x563f31ea62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.276+0000 7fa1c1cbe700 1 -- 172.21.15.92:0/49974249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e95800 msgr2=0x563f31e9f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.276+0000 7fa1c1cbe700 1 --2- 172.21.15.92:0/49974249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e95800 0x563f31e9f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.276+0000 7fa1c1cbe700 1 -- 172.21.15.92:0/49974249 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b8010a70 con 0x563f31e94ea0 2023-10-16T13:14:24.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.276+0000 7fa1c14bd700 1 --2- 172.21.15.92:0/49974249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e95800 0x563f31e9f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:24.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.276+0000 7fa1c1cbe700 1 --2- 172.21.15.92:0/49974249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e94ea0 0x563f31e9ed20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80116c0 tx=0x7fa1b80047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3e1a975b8f5c7f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:24.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.276+0000 7fa1a57fa700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-16T13:14:24.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.276+0000 7fa1a57fa700 1 -- 172.21.15.92:0/49974249 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8004050 con 0x563f31e94ea0 2023-10-16T13:14:24.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.276+0000 7fa1d010cb80 1 -- 172.21.15.92:0/49974249 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f31decf70 con 0x563f31e94ea0 2023-10-16T13:14:24.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.276+0000 7fa1a57fa700 1 -- 172.21.15.92:0/49974249 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa1b8017070 con 0x563f31e94ea0 2023-10-16T13:14:24.296 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.276+0000 7fa1a57fa700 1 -- 172.21.15.92:0/49974249 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1b80041b0 con 0x563f31e94ea0 2023-10-16T13:14:24.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.276+0000 7fa1d010cb80 10 client.25370 fetch_fsmap learned FSMap version 27 2023-10-16T13:14:24.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.276+0000 7fa1d010cb80 1 -- 172.21.15.92:0/49974249 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fa1bc19e1d0 con 0x563f31e94ea0 2023-10-16T13:14:24.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.278+0000 7fa1a57fa700 1 -- 172.21.15.92:0/49974249 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x563f31decf70 con 0x563f31e94ea0 2023-10-16T13:14:24.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.278+0000 7fa1a57fa700 1 -- 172.21.15.92:0/49974249 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa1b801f4c0 con 0x563f31e94ea0 2023-10-16T13:14:24.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.278+0000 7fa1d010cb80 10 client.25370 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:14:24.297 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.278+0000 7fa1d010cb80 10 client.25370 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:24.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.278+0000 7fa1d010cb80 20 client.25370 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:24.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.278+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/49974249 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563f31eaabd0 0x563f31eacff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.278+0000 7fa1d010cb80 4 client.25370 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:14:24.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.278+0000 7fa1d010cb80 1 -- 172.21.15.92:0/49974249 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f31e64c90 con 0x563f31eaabd0 2023-10-16T13:14:24.298 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.278+0000 7fa1c14bd700 1 --2- 172.21.15.92:0/49974249 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563f31eaabd0 0x563f31eacff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.278+0000 7fa1a57fa700 10 client.25370 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:24.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.278+0000 7fa1c14bd700 1 --2- 172.21.15.92:0/49974249 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563f31eaabd0 0x563f31eacff0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2de34a1c12a07276 server_cookie=7450aeeee8d89da4 in_seq=0 out_seq=0 2023-10-16T13:14:24.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.281+0000 7fa1a57fa700 1 -- 172.21.15.92:0/49974249 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563f31e64c90 con 0x563f31eaabd0 2023-10-16T13:14:24.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.281+0000 7fa1a57fa700 10 client.25370 handle_command_reply: tid=0 2023-10-16T13:14:24.299 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.281+0000 7fa1d010cb80 1 client.25370 shutdown 2023-10-16T13:14:24.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.281+0000 7fa1d010cb80 1 -- 172.21.15.92:0/49974249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e94ea0 msgr2=0x563f31e9ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.281+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/49974249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e94ea0 0x563f31e9ed20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80116c0 tx=0x7fa1b80047c0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.281+0000 7fa1d010cb80 1 -- 172.21.15.92:0/49974249 shutdown_connections 2023-10-16T13:14:24.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.281+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/49974249 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563f31eaabd0 0x563f31eacff0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.281+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/49974249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e966a0 0x563f31ea62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.281+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/49974249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e94ea0 0x563f31e9ed20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.281+0000 7fa1a57fa700 0 client.25370 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:24.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.281+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/49974249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e95800 0x563f31e9f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.281+0000 7fa1d010cb80 1 -- 172.21.15.92:0/49974249 >> 172.21.15.92:0/49974249 conn(0x563f31dc2e50 msgr2=0x563f31e8fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:24.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.281+0000 7fa1d010cb80 1 -- 172.21.15.92:0/49974249 shutdown_connections 2023-10-16T13:14:24.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.281+0000 7fa1d010cb80 1 -- 172.21.15.92:0/49974249 wait complete. 2023-10-16T13:14:24.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.281+0000 7fa1d010cb80 20 client.25370 trim_cache size 0 max 16384 2023-10-16T13:14:24.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.298+0000 7fa1d010cb80 1 Processor -- start 2023-10-16T13:14:24.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.298+0000 7fa1d010cb80 1 -- start start 2023-10-16T13:14:24.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.298+0000 7fa1d010cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e94ea0 0x563f31e9f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.298+0000 7fa1d010cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e95800 0x563f31e90c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.298+0000 7fa1d010cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e966a0 0x563f31e91190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.298+0000 7fa1d010cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f31c689a0 con 0x563f31e94ea0 2023-10-16T13:14:24.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.298+0000 7fa1d010cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f31e9e1d0 con 0x563f31e966a0 2023-10-16T13:14:24.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.298+0000 7fa1d010cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f31e9e890 con 0x563f31e95800 2023-10-16T13:14:24.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.299+0000 7fa1c1cbe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e94ea0 0x563f31e9f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.299+0000 7fa1c1cbe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e94ea0 0x563f31e9f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37882/0 (socket says 172.21.15.92:37882) 2023-10-16T13:14:24.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.299+0000 7fa1c1cbe700 1 -- 172.21.15.92:0/3638332577 learned_addr learned my addr 172.21.15.92:0/3638332577 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:24.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.299+0000 7fa1c24bf700 1 --2- 172.21.15.92:0/3638332577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e966a0 0x563f31e91190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.299+0000 7fa1c1cbe700 1 -- 172.21.15.92:0/3638332577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e95800 msgr2=0x563f31e90c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.299+0000 7fa1c1cbe700 1 --2- 172.21.15.92:0/3638332577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e95800 0x563f31e90c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.299+0000 7fa1c1cbe700 1 -- 172.21.15.92:0/3638332577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e966a0 msgr2=0x563f31e91190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.299+0000 7fa1c1cbe700 1 --2- 172.21.15.92:0/3638332577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e966a0 0x563f31e91190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.299+0000 7fa1c1cbe700 1 -- 172.21.15.92:0/3638332577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f31eb1c20 con 0x563f31e94ea0 2023-10-16T13:14:24.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.299+0000 7fa1c1cbe700 1 --2- 172.21.15.92:0/3638332577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e94ea0 0x563f31e9f1e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8000c00 tx=0x7fa1b8004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b93b2630d348c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:24.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.299+0000 7fa1b0ff9700 1 -- 172.21.15.92:0/3638332577 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b801fce0 con 0x563f31e94ea0 2023-10-16T13:14:24.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.299+0000 7fa1b0ff9700 1 -- 172.21.15.92:0/3638332577 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa1b8015070 con 0x563f31e94ea0 2023-10-16T13:14:24.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.299+0000 7fa1b0ff9700 1 -- 172.21.15.92:0/3638332577 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8028420 con 0x563f31e94ea0 2023-10-16T13:14:24.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.300+0000 7fa1d010cb80 1 -- 172.21.15.92:0/3638332577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e94ea0 msgr2=0x563f31e9f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.300+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/3638332577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e94ea0 0x563f31e9f1e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8000c00 tx=0x7fa1b8004690 comp rx=0 tx=0).stop 2023-10-16T13:14:24.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.300+0000 7fa1d010cb80 1 -- 172.21.15.92:0/3638332577 shutdown_connections 2023-10-16T13:14:24.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.300+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/3638332577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e94ea0 0x563f31e9f1e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.300+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/3638332577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e966a0 0x563f31e91190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.300+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/3638332577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e95800 0x563f31e90c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.300+0000 7fa1d010cb80 1 -- 172.21.15.92:0/3638332577 >> 172.21.15.92:0/3638332577 conn(0x563f31dc2e50 msgr2=0x563f31e9ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:24.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.300+0000 7fa1d010cb80 1 -- 172.21.15.92:0/3638332577 shutdown_connections 2023-10-16T13:14:24.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.300+0000 7fa1d010cb80 1 -- 172.21.15.92:0/3638332577 wait complete. 2023-10-16T13:14:24.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.300+0000 7fa1d010cb80 1 -- start start 2023-10-16T13:14:24.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.300+0000 7fa1d010cb80 1 Processor -- start 2023-10-16T13:14:24.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1d010cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e94ea0 0x563f31efb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1d010cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e95800 0x563f31efbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1d010cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e966a0 0x563f31f02ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1d010cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f31f03400 con 0x563f31e95800 2023-10-16T13:14:24.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1d010cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f31f03540 con 0x563f31e94ea0 2023-10-16T13:14:24.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1d010cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f31f036d0 con 0x563f31e966a0 2023-10-16T13:14:24.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1d010cb80 10 client.0 _ll_register_callbacks cb 0x7fa1b8010de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:24.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1c14bd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e95800 0x563f31efbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.314 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1c14bd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e95800 0x563f31efbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37890/0 (socket says 172.21.15.92:37890) 2023-10-16T13:14:24.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1c14bd700 1 -- 172.21.15.92:0/1230187194 learned_addr learned my addr 172.21.15.92:0/1230187194 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:24.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1c1cbe700 1 --2- 172.21.15.92:0/1230187194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e94ea0 0x563f31efb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1c24bf700 1 --2- 172.21.15.92:0/1230187194 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e966a0 0x563f31f02ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1c14bd700 1 -- 172.21.15.92:0/1230187194 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e966a0 msgr2=0x563f31f02ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1c14bd700 1 --2- 172.21.15.92:0/1230187194 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e966a0 0x563f31f02ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1c14bd700 1 -- 172.21.15.92:0/1230187194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e94ea0 msgr2=0x563f31efb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1c14bd700 1 --2- 172.21.15.92:0/1230187194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e94ea0 0x563f31efb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1c14bd700 1 -- 172.21.15.92:0/1230187194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1bc19e1d0 con 0x563f31e95800 2023-10-16T13:14:24.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1c24bf700 1 --2- 172.21.15.92:0/1230187194 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e966a0 0x563f31f02ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:14:24.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1c14bd700 1 --2- 172.21.15.92:0/1230187194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e95800 0x563f31efbe80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac003760 tx=0x7fa1ac005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b823a16979c378 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:24.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1a57fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:24.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1a57fa700 1 -- 172.21.15.92:0/1230187194 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac026040 con 0x563f31e95800 2023-10-16T13:14:24.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1a57fa700 1 -- 172.21.15.92:0/1230187194 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa1ac02cb70 con 0x563f31e95800 2023-10-16T13:14:24.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.301+0000 7fa1d010cb80 1 -- 172.21.15.92:0/1230187194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f31e9e030 con 0x563f31e95800 2023-10-16T13:14:24.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.302+0000 7fa1a57fa700 1 -- 172.21.15.92:0/1230187194 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1ac02cd30 con 0x563f31e95800 2023-10-16T13:14:24.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.302+0000 7fa1d010cb80 10 client.15816 fetch_fsmap learned FSMap version 27 2023-10-16T13:14:24.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.302+0000 7fa1d010cb80 1 -- 172.21.15.92:0/1230187194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563f31c12e60 con 0x563f31e95800 2023-10-16T13:14:24.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.302+0000 7fa1a57fa700 1 -- 172.21.15.92:0/1230187194 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x563f31e9e030 con 0x563f31e95800 2023-10-16T13:14:24.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.302+0000 7fa1a57fa700 1 -- 172.21.15.92:0/1230187194 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa1ac003c80 con 0x563f31e95800 2023-10-16T13:14:24.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.302+0000 7fa1d010cb80 10 client.15816 fetch_fsmap finished waiting for FSMap version 27 2023-10-16T13:14:24.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.302+0000 7fa1d010cb80 10 client.15816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:24.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.302+0000 7fa1d010cb80 20 client.15816 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:24.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.302+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/1230187194 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563f31f051e0 0x563f31f07600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.302+0000 7fa1d010cb80 4 client.15816 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-16T13:14:24.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.302+0000 7fa1d010cb80 1 -- 172.21.15.92:0/1230187194 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x7fa1b4099dc0 con 0x563f31f051e0 2023-10-16T13:14:24.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.302+0000 7fa1c1cbe700 1 --2- 172.21.15.92:0/1230187194 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563f31f051e0 0x563f31f07600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.302+0000 7fa1a57fa700 10 client.15816 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:24.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.302+0000 7fa1c1cbe700 1 --2- 172.21.15.92:0/1230187194 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563f31f051e0 0x563f31f07600 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc6b173c63dc0f29 server_cookie=c4747850e33f52c5 in_seq=0 out_seq=0 2023-10-16T13:14:24.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.396+0000 7fa1a57fa700 1 -- 172.21.15.92:0/1230187194 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7fa1b4099dc0 con 0x563f31f051e0 2023-10-16T13:14:24.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.396+0000 7fa1a57fa700 10 client.15816 handle_command_reply: tid=0 2023-10-16T13:14:24.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.396+0000 7fa1d010cb80 1 client.15816 shutdown 2023-10-16T13:14:24.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.396+0000 7fa1d010cb80 1 -- 172.21.15.92:0/1230187194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e95800 msgr2=0x563f31efbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.396+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/1230187194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e95800 0x563f31efbe80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac003760 tx=0x7fa1ac005670 comp rx=0 tx=0).stop 2023-10-16T13:14:24.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.396+0000 7fa1d010cb80 1 -- 172.21.15.92:0/1230187194 shutdown_connections 2023-10-16T13:14:24.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.396+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/1230187194 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x563f31f051e0 0x563f31f07600 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.396+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/1230187194 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f31e966a0 0x563f31f02ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.396+0000 7fa1a57fa700 0 client.15816 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:24.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.396+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/1230187194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f31e94ea0 0x563f31efb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.396+0000 7fa1d010cb80 1 --2- 172.21.15.92:0/1230187194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f31e95800 0x563f31efbe80 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.396+0000 7fa1d010cb80 1 -- 172.21.15.92:0/1230187194 >> 172.21.15.92:0/1230187194 conn(0x563f31dc2e50 msgr2=0x563f31e8f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:24.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.396+0000 7fa1d010cb80 1 -- 172.21.15.92:0/1230187194 shutdown_connections 2023-10-16T13:14:24.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.396+0000 7fa1d010cb80 1 -- 172.21.15.92:0/1230187194 wait complete. 2023-10-16T13:14:24.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.396+0000 7fa1d010cb80 20 client.15816 trim_cache size 0 max 16384 2023-10-16T13:14:24.401 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:14:24.402 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2023-10-16T13:14:24.402 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "cb764e24-079a-42f5-86d8-d08ead707f00", 2023-10-16T13:14:24.402 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2023-10-16T13:14:24.402 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:14:24.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.397+0000 7fa1c3f22700 1 -- 172.21.15.92:0/3470246439 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa1a80a1480 msgr2=0x7fa1a80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.397+0000 7fa1c3f22700 1 --2- 172.21.15.92:0/3470246439 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa1a80a1480 0x7fa1a80a3940 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc100e00 tx=0x7fa1b8007400 comp rx=0 tx=0).stop 2023-10-16T13:14:24.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.397+0000 7fa1c3f22700 1 -- 172.21.15.92:0/3470246439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1bc101940 msgr2=0x7fa1bc19d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.397+0000 7fa1c3f22700 1 --2- 172.21.15.92:0/3470246439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1bc101940 0x7fa1bc19d140 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400b970 tx=0x7fa1b400bc80 comp rx=0 tx=0).stop 2023-10-16T13:14:24.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.397+0000 7fa1c3f22700 1 -- 172.21.15.92:0/3470246439 shutdown_connections 2023-10-16T13:14:24.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.397+0000 7fa1c3f22700 1 --2- 172.21.15.92:0/3470246439 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fa1a80a1480 0x7fa1a80a3940 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.397+0000 7fa1c3f22700 1 --2- 172.21.15.92:0/3470246439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1bc101940 0x7fa1bc19d140 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.397+0000 7fa1c3f22700 1 --2- 172.21.15.92:0/3470246439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1bc0ffdb0 0x7fa1bc195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.397+0000 7fa1c3f22700 1 --2- 172.21.15.92:0/3470246439 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1bc100fa0 0x7fa1bc1960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.397+0000 7fa1c3f22700 1 -- 172.21.15.92:0/3470246439 >> 172.21.15.92:0/3470246439 conn(0x7fa1bc0fb320 msgr2=0x7fa1bc0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:24.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.397+0000 7fa1c3f22700 1 -- 172.21.15.92:0/3470246439 shutdown_connections 2023-10-16T13:14:24.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.397+0000 7fa1c3f22700 1 -- 172.21.15.92:0/3470246439 wait complete. 2023-10-16T13:14:24.411 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-16T13:14:24.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.539+0000 7f6f881bd700 1 -- 172.21.15.92:0/2467481073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f800ffe00 msgr2=0x7f6f80100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.539+0000 7f6f881bd700 1 --2- 172.21.15.92:0/2467481073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f800ffe00 0x7f6f80100220 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6f700099c0 tx=0x7f6f70009cd0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.539+0000 7f6f881bd700 1 -- 172.21.15.92:0/2467481073 shutdown_connections 2023-10-16T13:14:24.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.539+0000 7f6f881bd700 1 --2- 172.21.15.92:0/2467481073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f800ffe00 0x7f6f80100220 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.539+0000 7f6f881bd700 1 --2- 172.21.15.92:0/2467481073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f80101990 0x7f6f80108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.539+0000 7f6f881bd700 1 --2- 172.21.15.92:0/2467481073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f80100ff0 0x7f6f80101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.539+0000 7f6f881bd700 1 -- 172.21.15.92:0/2467481073 >> 172.21.15.92:0/2467481073 conn(0x7f6f800fb370 msgr2=0x7f6f800fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:24.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.539+0000 7f6f881bd700 1 -- 172.21.15.92:0/2467481073 shutdown_connections 2023-10-16T13:14:24.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.539+0000 7f6f881bd700 1 -- 172.21.15.92:0/2467481073 wait complete. 2023-10-16T13:14:24.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.539+0000 7f6f881bd700 1 Processor -- start 2023-10-16T13:14:24.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.539+0000 7f6f881bd700 1 -- start start 2023-10-16T13:14:24.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.539+0000 7f6f881bd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f800ffe00 0x7f6f80194c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.539+0000 7f6f881bd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f80100ff0 0x7f6f80195190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.539+0000 7f6f881bd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f80101990 0x7f6f8019c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.539+0000 7f6f881bd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8019c790 con 0x7f6f800ffe00 2023-10-16T13:14:24.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.540+0000 7f6f881bd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8019c900 con 0x7f6f80101990 2023-10-16T13:14:24.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.540+0000 7f6f881bd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8019cac0 con 0x7f6f80100ff0 2023-10-16T13:14:24.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.540+0000 7f6f85f59700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f800ffe00 0x7f6f80194c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.540+0000 7f6f85f59700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f800ffe00 0x7f6f80194c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37902/0 (socket says 172.21.15.92:37902) 2023-10-16T13:14:24.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.540+0000 7f6f85f59700 1 -- 172.21.15.92:0/229882628 learned_addr learned my addr 172.21.15.92:0/229882628 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:24.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.540+0000 7f6f8675a700 1 --2- 172.21.15.92:0/229882628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f80101990 0x7f6f8019c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.540+0000 7f6f85758700 1 --2- 172.21.15.92:0/229882628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f80100ff0 0x7f6f80195190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.540+0000 7f6f85f59700 1 -- 172.21.15.92:0/229882628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f80100ff0 msgr2=0x7f6f80195190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.540+0000 7f6f85f59700 1 --2- 172.21.15.92:0/229882628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f80100ff0 0x7f6f80195190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.540+0000 7f6f85f59700 1 -- 172.21.15.92:0/229882628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f80101990 msgr2=0x7f6f8019c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.540+0000 7f6f85f59700 1 --2- 172.21.15.92:0/229882628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f80101990 0x7f6f8019c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.540+0000 7f6f85f59700 1 -- 172.21.15.92:0/229882628 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f700095f0 con 0x7f6f800ffe00 2023-10-16T13:14:24.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.540+0000 7f6f85f59700 1 --2- 172.21.15.92:0/229882628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f800ffe00 0x7f6f80194c50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6f70018040 tx=0x7f6f70005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:24.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.540+0000 7f6f76ffd700 1 -- 172.21.15.92:0/229882628 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f700040a0 con 0x7f6f800ffe00 2023-10-16T13:14:24.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.540+0000 7f6f881bd700 1 -- 172.21.15.92:0/229882628 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8019cd40 con 0x7f6f800ffe00 2023-10-16T13:14:24.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.540+0000 7f6f76ffd700 1 -- 172.21.15.92:0/229882628 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6f70015450 con 0x7f6f800ffe00 2023-10-16T13:14:24.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.540+0000 7f6f76ffd700 1 -- 172.21.15.92:0/229882628 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7001e690 con 0x7f6f800ffe00 2023-10-16T13:14:24.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.540+0000 7f6f881bd700 1 -- 172.21.15.92:0/229882628 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8019d160 con 0x7f6f800ffe00 2023-10-16T13:14:24.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.542+0000 7f6f76ffd700 1 -- 172.21.15.92:0/229882628 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6f7001c040 con 0x7f6f800ffe00 2023-10-16T13:14:24.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.543+0000 7f6f76ffd700 1 --2- 172.21.15.92:0/229882628 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6f6c0a1480 0x7f6f6c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.543+0000 7f6f85758700 1 --2- 172.21.15.92:0/229882628 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6f6c0a1480 0x7f6f6c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.543+0000 7f6f76ffd700 1 -- 172.21.15.92:0/229882628 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6f700cf620 con 0x7f6f800ffe00 2023-10-16T13:14:24.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.543+0000 7f6f85758700 1 --2- 172.21.15.92:0/229882628 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6f6c0a1480 0x7f6f6c0a3940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009bf0 tx=0x7f6f7c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:24.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.544+0000 7f6f943a7b80 1 Processor -- start 2023-10-16T13:14:24.556 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.544+0000 7f6f943a7b80 1 -- start start 2023-10-16T13:14:24.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.544+0000 7f6f943a7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d111e20 0x55ac7d112240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.544+0000 7f6f943a7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 0x55ac7d113040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.544+0000 7f6f943a7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d113620 0x55ac7d113aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.544+0000 7f6f943a7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7d086c70 con 0x55ac7d112780 2023-10-16T13:14:24.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.544+0000 7f6f943a7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7d06bc60 con 0x55ac7d113620 2023-10-16T13:14:24.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.544+0000 7f6f943a7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7d069580 con 0x55ac7d111e20 2023-10-16T13:14:24.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.544+0000 7f6f85758700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 0x55ac7d113040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.544+0000 7f6f85758700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 0x55ac7d113040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37912/0 (socket says 172.21.15.92:37912) 2023-10-16T13:14:24.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.544+0000 7f6f85758700 1 -- 172.21.15.92:0/2963251152 learned_addr learned my addr 172.21.15.92:0/2963251152 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:24.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.544+0000 7f6f85f59700 1 --2- 172.21.15.92:0/2963251152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d111e20 0x55ac7d112240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.544+0000 7f6f8675a700 1 --2- 172.21.15.92:0/2963251152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d113620 0x55ac7d113aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.545+0000 7f6f85758700 1 -- 172.21.15.92:0/2963251152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d111e20 msgr2=0x55ac7d112240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.545+0000 7f6f85758700 1 --2- 172.21.15.92:0/2963251152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d111e20 0x55ac7d112240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.545+0000 7f6f85758700 1 -- 172.21.15.92:0/2963251152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d113620 msgr2=0x55ac7d113aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.545+0000 7f6f85758700 1 --2- 172.21.15.92:0/2963251152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d113620 0x55ac7d113aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.545+0000 7f6f85758700 1 -- 172.21.15.92:0/2963251152 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac7d0223f0 con 0x55ac7d112780 2023-10-16T13:14:24.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.545+0000 7f6f85758700 1 --2- 172.21.15.92:0/2963251152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 0x55ac7d113040 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c011e40 tx=0x7f6f7c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b834e537d098b454 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:24.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.545+0000 7f6f6bfff700 1 -- 172.21.15.92:0/2963251152 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c012dc0 con 0x55ac7d112780 2023-10-16T13:14:24.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.545+0000 7f6f6bfff700 1 -- 172.21.15.92:0/2963251152 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6f7c016070 con 0x55ac7d112780 2023-10-16T13:14:24.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.545+0000 7f6f6bfff700 1 -- 172.21.15.92:0/2963251152 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c003e30 con 0x55ac7d112780 2023-10-16T13:14:24.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.546+0000 7f6f943a7b80 1 -- 172.21.15.92:0/2963251152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 msgr2=0x55ac7d113040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.546+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/2963251152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 0x55ac7d113040 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c011e40 tx=0x7f6f7c014000 comp rx=0 tx=0).stop 2023-10-16T13:14:24.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.546+0000 7f6f943a7b80 1 -- 172.21.15.92:0/2963251152 shutdown_connections 2023-10-16T13:14:24.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.546+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/2963251152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d113620 0x55ac7d113aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.546+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/2963251152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d111e20 0x55ac7d112240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.546+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/2963251152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 0x55ac7d113040 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.546+0000 7f6f943a7b80 1 -- 172.21.15.92:0/2963251152 >> 172.21.15.92:0/2963251152 conn(0x55ac7d03fdd0 msgr2=0x55ac7d10cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:24.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.546+0000 7f6f943a7b80 1 -- 172.21.15.92:0/2963251152 shutdown_connections 2023-10-16T13:14:24.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.546+0000 7f6f943a7b80 1 -- 172.21.15.92:0/2963251152 wait complete. 2023-10-16T13:14:24.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.546+0000 7f6f943a7b80 1 -- start start 2023-10-16T13:14:24.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.546+0000 7f6f943a7b80 1 Processor -- start 2023-10-16T13:14:24.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f943a7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d111e20 0x55ac7d11bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f943a7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 0x55ac7d11c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f943a7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d113620 0x55ac7d123220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f943a7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7d064e70 con 0x55ac7d112780 2023-10-16T13:14:24.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f943a7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7d001710 con 0x55ac7d113620 2023-10-16T13:14:24.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f943a7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7d0013b0 con 0x55ac7d111e20 2023-10-16T13:14:24.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f943a7b80 10 client.0 _ll_register_callbacks cb 0x55ac7ce5e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:24.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f85758700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 0x55ac7d11c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f85758700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 0x55ac7d11c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37918/0 (socket says 172.21.15.92:37918) 2023-10-16T13:14:24.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f85758700 1 -- 172.21.15.92:0/349022198 learned_addr learned my addr 172.21.15.92:0/349022198 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:24.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f8675a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d113620 0x55ac7d123220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f85f59700 1 --2- 172.21.15.92:0/349022198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d111e20 0x55ac7d11bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f85758700 1 -- 172.21.15.92:0/349022198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d111e20 msgr2=0x55ac7d11bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f85758700 1 --2- 172.21.15.92:0/349022198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d111e20 0x55ac7d11bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f85758700 1 -- 172.21.15.92:0/349022198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d113620 msgr2=0x55ac7d123220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f85758700 1 --2- 172.21.15.92:0/349022198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d113620 0x55ac7d123220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f85758700 1 -- 172.21.15.92:0/349022198 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7c011b20 con 0x55ac7d112780 2023-10-16T13:14:24.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f8675a700 1 --2- 172.21.15.92:0/349022198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d113620 0x55ac7d123220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:24.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f85758700 1 --2- 172.21.15.92:0/349022198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 0x55ac7d11c1e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0097d0 tx=0x7f6f7c003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c459e57ac27e0a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:24.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f697fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:24.566 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f697fa700 1 -- 172.21.15.92:0/349022198 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c02d070 con 0x55ac7d112780 2023-10-16T13:14:24.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f697fa700 1 -- 172.21.15.92:0/349022198 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6f7c018070 con 0x55ac7d112780 2023-10-16T13:14:24.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.547+0000 7f6f943a7b80 1 -- 172.21.15.92:0/349022198 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ac7d069ef0 con 0x55ac7d112780 2023-10-16T13:14:24.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.548+0000 7f6f697fa700 1 -- 172.21.15.92:0/349022198 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f7c003790 con 0x55ac7d112780 2023-10-16T13:14:24.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.548+0000 7f6f943a7b80 10 client.15828 fetch_fsmap learned FSMap version 28 2023-10-16T13:14:24.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.548+0000 7f6f943a7b80 1 -- 172.21.15.92:0/349022198 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55ac7ce8fde0 con 0x55ac7d112780 2023-10-16T13:14:24.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.548+0000 7f6f697fa700 1 -- 172.21.15.92:0/349022198 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55ac7d069ef0 con 0x55ac7d112780 2023-10-16T13:14:24.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.548+0000 7f6f697fa700 1 -- 172.21.15.92:0/349022198 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f6f7c025070 con 0x55ac7d112780 2023-10-16T13:14:24.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.548+0000 7f6f943a7b80 10 client.15828 fetch_fsmap finished waiting for FSMap version 28 2023-10-16T13:14:24.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.548+0000 7f6f943a7b80 10 client.15828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:24.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.548+0000 7f6f943a7b80 20 client.15828 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:24.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.548+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/349022198 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55ac7d127a30 0x55ac7d129e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.548+0000 7f6f943a7b80 4 client.15828 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:14:24.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.548+0000 7f6f943a7b80 1 -- 172.21.15.92:0/349022198 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ac7d0e1c10 con 0x55ac7d127a30 2023-10-16T13:14:24.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.548+0000 7f6f85f59700 1 --2- 172.21.15.92:0/349022198 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55ac7d127a30 0x55ac7d129e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.549+0000 7f6f697fa700 10 client.15828 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:24.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.549+0000 7f6f85f59700 1 --2- 172.21.15.92:0/349022198 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55ac7d127a30 0x55ac7d129e50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29916c246e609dfd server_cookie=b1233483380ef9c1 in_seq=0 out_seq=0 2023-10-16T13:14:24.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.551+0000 7f6f697fa700 1 -- 172.21.15.92:0/349022198 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ac7d0e1c10 con 0x55ac7d127a30 2023-10-16T13:14:24.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.551+0000 7f6f697fa700 10 client.15828 handle_command_reply: tid=0 2023-10-16T13:14:24.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.551+0000 7f6f943a7b80 1 client.15828 shutdown 2023-10-16T13:14:24.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.551+0000 7f6f943a7b80 1 -- 172.21.15.92:0/349022198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 msgr2=0x55ac7d11c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.551+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/349022198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 0x55ac7d11c1e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0097d0 tx=0x7f6f7c003da0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.551+0000 7f6f943a7b80 1 -- 172.21.15.92:0/349022198 shutdown_connections 2023-10-16T13:14:24.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.551+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/349022198 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55ac7d127a30 0x55ac7d129e50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.551+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/349022198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d113620 0x55ac7d123220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.551+0000 7f6f697fa700 0 client.15828 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:24.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.551+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/349022198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d111e20 0x55ac7d11bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.551+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/349022198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 0x55ac7d11c1e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.551+0000 7f6f943a7b80 1 -- 172.21.15.92:0/349022198 >> 172.21.15.92:0/349022198 conn(0x55ac7d03fdd0 msgr2=0x55ac7d10cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:24.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.551+0000 7f6f943a7b80 1 -- 172.21.15.92:0/349022198 shutdown_connections 2023-10-16T13:14:24.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.551+0000 7f6f943a7b80 1 -- 172.21.15.92:0/349022198 wait complete. 2023-10-16T13:14:24.572 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.552+0000 7f6f943a7b80 20 client.15828 trim_cache size 0 max 16384 2023-10-16T13:14:24.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.569+0000 7f6f943a7b80 1 Processor -- start 2023-10-16T13:14:24.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.569+0000 7f6f943a7b80 1 -- start start 2023-10-16T13:14:24.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.569+0000 7f6f943a7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d111e20 0x55ac7d119a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.569+0000 7f6f943a7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d112780 0x55ac7d1231e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.569+0000 7f6f943a7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d113620 0x55ac7d10cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.569+0000 7f6f943a7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7d11b870 con 0x55ac7d113620 2023-10-16T13:14:24.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.569+0000 7f6f943a7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7cee5920 con 0x55ac7d111e20 2023-10-16T13:14:24.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.569+0000 7f6f943a7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7d10be20 con 0x55ac7d112780 2023-10-16T13:14:24.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.569+0000 7f6f8675a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d113620 0x55ac7d10cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.569+0000 7f6f85f59700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d111e20 0x55ac7d119a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.569+0000 7f6f8675a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d113620 0x55ac7d10cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37926/0 (socket says 172.21.15.92:37926) 2023-10-16T13:14:24.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.569+0000 7f6f85f59700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d111e20 0x55ac7d119a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:38732/0 (socket says 172.21.15.92:38732) 2023-10-16T13:14:24.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.569+0000 7f6f8675a700 1 -- 172.21.15.92:0/1277714269 learned_addr learned my addr 172.21.15.92:0/1277714269 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:24.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.569+0000 7f6f85758700 1 --2- 172.21.15.92:0/1277714269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d112780 0x55ac7d1231e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.570+0000 7f6f85f59700 1 -- 172.21.15.92:0/1277714269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d112780 msgr2=0x55ac7d1231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.570+0000 7f6f85f59700 1 --2- 172.21.15.92:0/1277714269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d112780 0x55ac7d1231e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.570+0000 7f6f85f59700 1 -- 172.21.15.92:0/1277714269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d113620 msgr2=0x55ac7d10cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.570+0000 7f6f85f59700 1 --2- 172.21.15.92:0/1277714269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d113620 0x55ac7d10cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.570+0000 7f6f85f59700 1 -- 172.21.15.92:0/1277714269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac7ce78c60 con 0x55ac7d111e20 2023-10-16T13:14:24.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.570+0000 7f6f8675a700 1 --2- 172.21.15.92:0/1277714269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d113620 0x55ac7d10cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:24.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.570+0000 7f6f85f59700 1 --2- 172.21.15.92:0/1277714269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d111e20 0x55ac7d119a20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6f700cd0e0 tx=0x7f6f700bc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7baf75ce8a02804e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:24.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.570+0000 7f6f74ff9700 1 -- 172.21.15.92:0/1277714269 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7009c990 con 0x55ac7d111e20 2023-10-16T13:14:24.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.570+0000 7f6f74ff9700 1 -- 172.21.15.92:0/1277714269 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6f700a0ae0 con 0x55ac7d111e20 2023-10-16T13:14:24.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.570+0000 7f6f74ff9700 1 -- 172.21.15.92:0/1277714269 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f70015930 con 0x55ac7d111e20 2023-10-16T13:14:24.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.571+0000 7f6f943a7b80 1 -- 172.21.15.92:0/1277714269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d111e20 msgr2=0x55ac7d119a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.571+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/1277714269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d111e20 0x55ac7d119a20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6f700cd0e0 tx=0x7f6f700bc040 comp rx=0 tx=0).stop 2023-10-16T13:14:24.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.571+0000 7f6f943a7b80 1 -- 172.21.15.92:0/1277714269 shutdown_connections 2023-10-16T13:14:24.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.571+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/1277714269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d113620 0x55ac7d10cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.571+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/1277714269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d111e20 0x55ac7d119a20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.571+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/1277714269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d112780 0x55ac7d1231e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.571+0000 7f6f943a7b80 1 -- 172.21.15.92:0/1277714269 >> 172.21.15.92:0/1277714269 conn(0x55ac7d03fdd0 msgr2=0x55ac7d11a920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:24.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.571+0000 7f6f943a7b80 1 -- 172.21.15.92:0/1277714269 shutdown_connections 2023-10-16T13:14:24.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.571+0000 7f6f943a7b80 1 -- 172.21.15.92:0/1277714269 wait complete. 2023-10-16T13:14:24.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.571+0000 7f6f943a7b80 1 -- start start 2023-10-16T13:14:24.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.571+0000 7f6f943a7b80 1 Processor -- start 2023-10-16T13:14:24.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.572+0000 7f6f943a7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d111e20 0x55ac7d120fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.572+0000 7f6f943a7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 0x55ac7d1214f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.572+0000 7f6f943a7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d113620 0x55ac7d122500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.572+0000 7f6f943a7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7d122a40 con 0x55ac7d112780 2023-10-16T13:14:24.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.572+0000 7f6f943a7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7d122bb0 con 0x55ac7d111e20 2023-10-16T13:14:24.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.572+0000 7f6f943a7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7d122d70 con 0x55ac7d113620 2023-10-16T13:14:24.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.572+0000 7f6f943a7b80 10 client.0 _ll_register_callbacks cb 0x55ac7ce5e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:24.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.572+0000 7f6f85758700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 0x55ac7d1214f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.572+0000 7f6f85f59700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d111e20 0x55ac7d120fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.572+0000 7f6f85f59700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d111e20 0x55ac7d120fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:38736/0 (socket says 172.21.15.92:38736) 2023-10-16T13:14:24.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.572+0000 7f6f85f59700 1 -- 172.21.15.92:0/2984413244 learned_addr learned my addr 172.21.15.92:0/2984413244 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:24.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.572+0000 7f6f8675a700 1 --2- 172.21.15.92:0/2984413244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d113620 0x55ac7d122500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.572+0000 7f6f85758700 1 -- 172.21.15.92:0/2984413244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d113620 msgr2=0x55ac7d122500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.572+0000 7f6f85758700 1 --2- 172.21.15.92:0/2984413244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d113620 0x55ac7d122500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.572+0000 7f6f85758700 1 -- 172.21.15.92:0/2984413244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d111e20 msgr2=0x55ac7d120fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.572+0000 7f6f85758700 1 --2- 172.21.15.92:0/2984413244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d111e20 0x55ac7d120fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.572+0000 7f6f85758700 1 -- 172.21.15.92:0/2984413244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f780117e0 con 0x55ac7d112780 2023-10-16T13:14:24.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.572+0000 7f6f85758700 1 --2- 172.21.15.92:0/2984413244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 0x55ac7d1214f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c011770 tx=0x7f6f7c009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cc46a13d33daf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:24.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.572+0000 7f6f697fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:24.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.573+0000 7f6f697fa700 1 -- 172.21.15.92:0/2984413244 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c02d030 con 0x55ac7d112780 2023-10-16T13:14:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.573+0000 7f6f697fa700 1 -- 172.21.15.92:0/2984413244 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6f7c02e070 con 0x55ac7d112780 2023-10-16T13:14:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.573+0000 7f6f943a7b80 1 -- 172.21.15.92:0/2984413244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6f7c016070 con 0x55ac7d112780 2023-10-16T13:14:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.573+0000 7f6f697fa700 1 -- 172.21.15.92:0/2984413244 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f7c0039c0 con 0x55ac7d112780 2023-10-16T13:14:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.573+0000 7f6f943a7b80 10 client.15834 fetch_fsmap learned FSMap version 28 2023-10-16T13:14:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.573+0000 7f6f943a7b80 1 -- 172.21.15.92:0/2984413244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f6f8019d160 con 0x55ac7d112780 2023-10-16T13:14:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.573+0000 7f6f697fa700 1 -- 172.21.15.92:0/2984413244 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6f7c016070 con 0x55ac7d112780 2023-10-16T13:14:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.573+0000 7f6f697fa700 1 -- 172.21.15.92:0/2984413244 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f6f7c012730 con 0x55ac7d112780 2023-10-16T13:14:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.573+0000 7f6f943a7b80 10 client.15834 fetch_fsmap finished waiting for FSMap version 28 2023-10-16T13:14:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.573+0000 7f6f943a7b80 10 client.15834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.573+0000 7f6f943a7b80 20 client.15834 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.573+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/2984413244 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55ac7d127a30 0x55ac7d182790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.573+0000 7f6f943a7b80 4 client.15834 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-16T13:14:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.573+0000 7f6f943a7b80 1 -- 172.21.15.92:0/2984413244 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ac7d05de50 con 0x55ac7d127a30 2023-10-16T13:14:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.573+0000 7f6f85f59700 1 --2- 172.21.15.92:0/2984413244 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55ac7d127a30 0x55ac7d182790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.574+0000 7f6f697fa700 10 client.15834 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.574+0000 7f6f85f59700 1 --2- 172.21.15.92:0/2984413244 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55ac7d127a30 0x55ac7d182790 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70bf5e63049fad83 server_cookie=c07bd1577fed9fb9 in_seq=0 out_seq=0 2023-10-16T13:14:24.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.577+0000 7f6f697fa700 1 -- 172.21.15.92:0/2984413244 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55ac7d05de50 con 0x55ac7d127a30 2023-10-16T13:14:24.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.577+0000 7f6f697fa700 10 client.15834 handle_command_reply: tid=0 2023-10-16T13:14:24.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.577+0000 7f6f943a7b80 1 client.15834 shutdown 2023-10-16T13:14:24.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.577+0000 7f6f943a7b80 1 -- 172.21.15.92:0/2984413244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 msgr2=0x55ac7d1214f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.577+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/2984413244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 0x55ac7d1214f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c011770 tx=0x7f6f7c009620 comp rx=0 tx=0).stop 2023-10-16T13:14:24.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.577+0000 7f6f943a7b80 1 -- 172.21.15.92:0/2984413244 shutdown_connections 2023-10-16T13:14:24.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.577+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/2984413244 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55ac7d127a30 0x55ac7d182790 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.577+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/2984413244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7d113620 0x55ac7d122500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.577+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/2984413244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ac7d111e20 0x55ac7d120fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.577+0000 7f6f697fa700 0 client.15834 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:24.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.577+0000 7f6f943a7b80 1 --2- 172.21.15.92:0/2984413244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac7d112780 0x55ac7d1214f0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.577+0000 7f6f943a7b80 1 -- 172.21.15.92:0/2984413244 >> 172.21.15.92:0/2984413244 conn(0x55ac7d03fdd0 msgr2=0x55ac7d10cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:24.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.577+0000 7f6f943a7b80 1 -- 172.21.15.92:0/2984413244 shutdown_connections 2023-10-16T13:14:24.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.577+0000 7f6f943a7b80 1 -- 172.21.15.92:0/2984413244 wait complete. 2023-10-16T13:14:24.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.578+0000 7f6f943a7b80 20 client.15834 trim_cache size 0 max 16384 2023-10-16T13:14:24.595 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:14:24.595 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "scrub active (2 inodes in the stack)", 2023-10-16T13:14:24.595 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2023-10-16T13:14:24.595 INFO:teuthology.orchestra.run.smithi092.stdout: "cb764e24-079a-42f5-86d8-d08ead707f00": { 2023-10-16T13:14:24.595 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2023-10-16T13:14:24.596 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "cb764e24-079a-42f5-86d8-d08ead707f00", 2023-10-16T13:14:24.596 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2023-10-16T13:14:24.596 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:14:24.596 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:14:24.596 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:14:24.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.578+0000 7f6f881bd700 1 -- 172.21.15.92:0/229882628 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6f6c0a1480 msgr2=0x7f6f6c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.578+0000 7f6f881bd700 1 --2- 172.21.15.92:0/229882628 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6f6c0a1480 0x7f6f6c0a3940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009bf0 tx=0x7f6f7c009260 comp rx=0 tx=0).stop 2023-10-16T13:14:24.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.578+0000 7f6f881bd700 1 -- 172.21.15.92:0/229882628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f800ffe00 msgr2=0x7f6f80194c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.578+0000 7f6f881bd700 1 --2- 172.21.15.92:0/229882628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f800ffe00 0x7f6f80194c50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6f70018040 tx=0x7f6f70005e80 comp rx=0 tx=0).stop 2023-10-16T13:14:24.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.578+0000 7f6f881bd700 1 -- 172.21.15.92:0/229882628 shutdown_connections 2023-10-16T13:14:24.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.578+0000 7f6f881bd700 1 --2- 172.21.15.92:0/229882628 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f6f6c0a1480 0x7f6f6c0a3940 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.578+0000 7f6f881bd700 1 --2- 172.21.15.92:0/229882628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f800ffe00 0x7f6f80194c50 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.578+0000 7f6f881bd700 1 --2- 172.21.15.92:0/229882628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f80101990 0x7f6f8019c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.578+0000 7f6f881bd700 1 --2- 172.21.15.92:0/229882628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f80100ff0 0x7f6f80195190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.578+0000 7f6f881bd700 1 -- 172.21.15.92:0/229882628 >> 172.21.15.92:0/229882628 conn(0x7f6f800fb370 msgr2=0x7f6f800fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:24.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.578+0000 7f6f881bd700 1 -- 172.21.15.92:0/229882628 shutdown_connections 2023-10-16T13:14:24.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:24.578+0000 7f6f881bd700 1 -- 172.21.15.92:0/229882628 wait complete. 2023-10-16T13:14:24.600 INFO:tasks.cephfs.filesystem:scrub status for tag:cb764e24-079a-42f5-86d8-d08ead707f00 - {'path': '/', 'tag': 'cb764e24-079a-42f5-86d8-d08ead707f00', 'options': 'recursive,force'} 2023-10-16T13:14:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.672+0000 7f857c0d3700 1 -- 172.21.15.92:0/68158449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8574100f70 msgr2=0x7f85741013f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.672+0000 7f857c0d3700 1 --2- 172.21.15.92:0/68158449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8574100f70 0x7f85741013f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8564009990 tx=0x7f8564009ca0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.672+0000 7f857c0d3700 1 -- 172.21.15.92:0/68158449 shutdown_connections 2023-10-16T13:14:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.672+0000 7f857c0d3700 1 --2- 172.21.15.92:0/68158449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8574101930 0x7f8574108250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.672+0000 7f857c0d3700 1 --2- 172.21.15.92:0/68158449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85740ffe20 0x7f8574100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.672+0000 7f857c0d3700 1 --2- 172.21.15.92:0/68158449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8574100f70 0x7f85741013f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.672+0000 7f857c0d3700 1 -- 172.21.15.92:0/68158449 >> 172.21.15.92:0/68158449 conn(0x7f85740fb3b0 msgr2=0x7f85740fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.672+0000 7f857c0d3700 1 -- 172.21.15.92:0/68158449 shutdown_connections 2023-10-16T13:14:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.672+0000 7f857c0d3700 1 -- 172.21.15.92:0/68158449 wait complete. 2023-10-16T13:14:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.673+0000 7f857c0d3700 1 Processor -- start 2023-10-16T13:14:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.673+0000 7f857c0d3700 1 -- start start 2023-10-16T13:14:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.673+0000 7f857c0d3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85740ffe20 0x7f8574195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.673+0000 7f857c0d3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8574100f70 0x7f85741962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.673+0000 7f857c0d3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8574101930 0x7f8574197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.673+0000 7f857c0d3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8574197770 con 0x7f8574100f70 2023-10-16T13:14:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.673+0000 7f857c0d3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85741978e0 con 0x7f85740ffe20 2023-10-16T13:14:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.673+0000 7f857c0d3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8574197aa0 con 0x7f8574101930 2023-10-16T13:14:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.673+0000 7f857966e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8574100f70 0x7f85741962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.673+0000 7f857966e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8574100f70 0x7f85741962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37944/0 (socket says 172.21.15.92:37944) 2023-10-16T13:14:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.673+0000 7f857966e700 1 -- 172.21.15.92:0/656589045 learned_addr learned my addr 172.21.15.92:0/656589045 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.673+0000 7f8579e6f700 1 --2- 172.21.15.92:0/656589045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85740ffe20 0x7f8574195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.673+0000 7f857a670700 1 --2- 172.21.15.92:0/656589045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8574101930 0x7f8574197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.674+0000 7f857966e700 1 -- 172.21.15.92:0/656589045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8574101930 msgr2=0x7f8574197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.674+0000 7f857966e700 1 --2- 172.21.15.92:0/656589045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8574101930 0x7f8574197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.674+0000 7f857966e700 1 -- 172.21.15.92:0/656589045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85740ffe20 msgr2=0x7f8574195d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.674+0000 7f857966e700 1 --2- 172.21.15.92:0/656589045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85740ffe20 0x7f8574195d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.674+0000 7f857966e700 1 -- 172.21.15.92:0/656589045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85640095f0 con 0x7f8574100f70 2023-10-16T13:14:24.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.674+0000 7f857966e700 1 --2- 172.21.15.92:0/656589045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8574100f70 0x7f85741962c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f856400f690 tx=0x7f8564009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.674+0000 7f856affd700 1 -- 172.21.15.92:0/656589045 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856401d070 con 0x7f8574100f70 2023-10-16T13:14:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.674+0000 7f856affd700 1 -- 172.21.15.92:0/656589045 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f856400be70 con 0x7f8574100f70 2023-10-16T13:14:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.674+0000 7f856affd700 1 -- 172.21.15.92:0/656589045 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85640054f0 con 0x7f8574100f70 2023-10-16T13:14:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.674+0000 7f857c0d3700 1 -- 172.21.15.92:0/656589045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8574197d20 con 0x7f8574100f70 2023-10-16T13:14:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.674+0000 7f857c0d3700 1 -- 172.21.15.92:0/656589045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857419e490 con 0x7f8574100f70 2023-10-16T13:14:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.676+0000 7f856affd700 1 -- 172.21.15.92:0/656589045 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8564004800 con 0x7f8574100f70 2023-10-16T13:14:24.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.677+0000 7f856affd700 1 --2- 172.21.15.92:0/656589045 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f85600a1500 0x7f85600a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.677+0000 7f8579e6f700 1 --2- 172.21.15.92:0/656589045 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f85600a1500 0x7f85600a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.677+0000 7f856affd700 1 -- 172.21.15.92:0/656589045 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f85640cde90 con 0x7f8574100f70 2023-10-16T13:14:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.677+0000 7f8579e6f700 1 --2- 172.21.15.92:0/656589045 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f85600a1500 0x7f85600a39c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8574195ad0 tx=0x7f857000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.678+0000 7f85882bdb80 1 Processor -- start 2023-10-16T13:14:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.678+0000 7f85882bdb80 1 -- start start 2023-10-16T13:14:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.678+0000 7f85882bdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e416850 0x55940e416c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.678+0000 7f85882bdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 0x55940e417ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.678+0000 7f85882bdb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e4180a0 0x55940e418520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.678+0000 7f85882bdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940e38bc10 con 0x55940e416850 2023-10-16T13:14:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.678+0000 7f85882bdb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940e370c00 con 0x55940e4180a0 2023-10-16T13:14:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.678+0000 7f85882bdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940e36e520 con 0x55940e4171b0 2023-10-16T13:14:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.678+0000 7f8579e6f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e416850 0x55940e416c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.678+0000 7f8579e6f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e416850 0x55940e416c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37950/0 (socket says 172.21.15.92:37950) 2023-10-16T13:14:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.678+0000 7f8579e6f700 1 -- 172.21.15.92:0/4154284365 learned_addr learned my addr 172.21.15.92:0/4154284365 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.678+0000 7f857a670700 1 --2- 172.21.15.92:0/4154284365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e4180a0 0x55940e418520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.679+0000 7f857966e700 1 --2- 172.21.15.92:0/4154284365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 0x55940e417ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.679+0000 7f8579e6f700 1 -- 172.21.15.92:0/4154284365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 msgr2=0x55940e417ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.679+0000 7f8579e6f700 1 --2- 172.21.15.92:0/4154284365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 0x55940e417ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.679+0000 7f8579e6f700 1 -- 172.21.15.92:0/4154284365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e4180a0 msgr2=0x55940e418520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.679+0000 7f8579e6f700 1 --2- 172.21.15.92:0/4154284365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e4180a0 0x55940e418520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.679+0000 7f8579e6f700 1 -- 172.21.15.92:0/4154284365 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55940e327390 con 0x55940e416850 2023-10-16T13:14:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.679+0000 7f8579e6f700 1 --2- 172.21.15.92:0/4154284365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e416850 0x55940e416c70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8570010f70 tx=0x7f8570013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843b658d9e251695 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.679+0000 7f855ffff700 1 -- 172.21.15.92:0/4154284365 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570011db0 con 0x55940e416850 2023-10-16T13:14:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.679+0000 7f855ffff700 1 -- 172.21.15.92:0/4154284365 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8570015070 con 0x55940e416850 2023-10-16T13:14:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.679+0000 7f855ffff700 1 -- 172.21.15.92:0/4154284365 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857001c610 con 0x55940e416850 2023-10-16T13:14:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.680+0000 7f85882bdb80 1 -- 172.21.15.92:0/4154284365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e416850 msgr2=0x55940e416c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.680+0000 7f85882bdb80 1 --2- 172.21.15.92:0/4154284365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e416850 0x55940e416c70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8570010f70 tx=0x7f8570013000 comp rx=0 tx=0).stop 2023-10-16T13:14:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.680+0000 7f85882bdb80 1 -- 172.21.15.92:0/4154284365 shutdown_connections 2023-10-16T13:14:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.680+0000 7f85882bdb80 1 --2- 172.21.15.92:0/4154284365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e416850 0x55940e416c70 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.680+0000 7f85882bdb80 1 --2- 172.21.15.92:0/4154284365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e4180a0 0x55940e418520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.680+0000 7f85882bdb80 1 --2- 172.21.15.92:0/4154284365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 0x55940e417ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.680+0000 7f85882bdb80 1 -- 172.21.15.92:0/4154284365 >> 172.21.15.92:0/4154284365 conn(0x55940e344d70 msgr2=0x55940e411c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.680+0000 7f85882bdb80 1 -- 172.21.15.92:0/4154284365 shutdown_connections 2023-10-16T13:14:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.680+0000 7f85882bdb80 1 -- 172.21.15.92:0/4154284365 wait complete. 2023-10-16T13:14:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.680+0000 7f85882bdb80 1 -- start start 2023-10-16T13:14:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.680+0000 7f85882bdb80 1 Processor -- start 2023-10-16T13:14:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f85882bdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e416850 0x55940e420730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f85882bdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 0x55940e420c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f85882bdb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e4180a0 0x55940e427cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f85882bdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940e369e10 con 0x55940e416850 2023-10-16T13:14:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f85882bdb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940e3066b0 con 0x55940e4180a0 2023-10-16T13:14:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f85882bdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940e306350 con 0x55940e4171b0 2023-10-16T13:14:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f85882bdb80 10 client.0 _ll_register_callbacks cb 0x55940e1637a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f8579e6f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e416850 0x55940e420730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f8579e6f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e416850 0x55940e420730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37956/0 (socket says 172.21.15.92:37956) 2023-10-16T13:14:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f8579e6f700 1 -- 172.21.15.92:0/1705006403 learned_addr learned my addr 172.21.15.92:0/1705006403 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f857a670700 1 --2- 172.21.15.92:0/1705006403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e4180a0 0x55940e427cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f857966e700 1 --2- 172.21.15.92:0/1705006403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 0x55940e420c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f8579e6f700 1 -- 172.21.15.92:0/1705006403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 msgr2=0x55940e420c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f8579e6f700 1 --2- 172.21.15.92:0/1705006403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 0x55940e420c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f8579e6f700 1 -- 172.21.15.92:0/1705006403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e4180a0 msgr2=0x55940e427cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f8579e6f700 1 --2- 172.21.15.92:0/1705006403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e4180a0 0x55940e427cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f8579e6f700 1 -- 172.21.15.92:0/1705006403 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8570010c20 con 0x55940e416850 2023-10-16T13:14:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f857a670700 1 --2- 172.21.15.92:0/1705006403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e4180a0 0x55940e427cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f8579e6f700 1 --2- 172.21.15.92:0/1705006403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e416850 0x55940e420730 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8570011de0 tx=0x7f8570011e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fa63ab27651cd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f855d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f855d7fa700 1 -- 172.21.15.92:0/1705006403 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857002c070 con 0x55940e416850 2023-10-16T13:14:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f855d7fa700 1 -- 172.21.15.92:0/1705006403 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f8570017070 con 0x55940e416850 2023-10-16T13:14:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f85882bdb80 1 -- 172.21.15.92:0/1705006403 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55940e36ee90 con 0x55940e416850 2023-10-16T13:14:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.681+0000 7f855d7fa700 1 -- 172.21.15.92:0/1705006403 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f857001e6e0 con 0x55940e416850 2023-10-16T13:14:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.682+0000 7f85882bdb80 10 client.15846 fetch_fsmap learned FSMap version 28 2023-10-16T13:14:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.682+0000 7f85882bdb80 1 -- 172.21.15.92:0/1705006403 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55940e194d80 con 0x55940e416850 2023-10-16T13:14:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.682+0000 7f855d7fa700 1 -- 172.21.15.92:0/1705006403 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55940e36ee90 con 0x55940e416850 2023-10-16T13:14:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.682+0000 7f855d7fa700 1 -- 172.21.15.92:0/1705006403 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f85700049f0 con 0x55940e416850 2023-10-16T13:14:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.682+0000 7f85882bdb80 10 client.15846 fetch_fsmap finished waiting for FSMap version 28 2023-10-16T13:14:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.682+0000 7f85882bdb80 10 client.15846 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.682+0000 7f85882bdb80 20 client.15846 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:24.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.682+0000 7f85882bdb80 1 --2- 172.21.15.92:0/1705006403 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55940e42e670 0x55940e430a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.682+0000 7f85882bdb80 4 client.15846 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:14:24.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.682+0000 7f85882bdb80 1 -- 172.21.15.92:0/1705006403 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55940e3e6bb0 con 0x55940e42e670 2023-10-16T13:14:24.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.682+0000 7f857966e700 1 --2- 172.21.15.92:0/1705006403 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55940e42e670 0x55940e430a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.682+0000 7f855d7fa700 10 client.15846 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:24.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.682+0000 7f857966e700 1 --2- 172.21.15.92:0/1705006403 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55940e42e670 0x55940e430a90 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74146c48815225c5 server_cookie=c42f2f5adae25962 in_seq=0 out_seq=0 2023-10-16T13:14:24.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.684+0000 7f855d7fa700 1 -- 172.21.15.92:0/1705006403 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55940e3e6bb0 con 0x55940e42e670 2023-10-16T13:14:24.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.684+0000 7f855d7fa700 10 client.15846 handle_command_reply: tid=0 2023-10-16T13:14:24.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.684+0000 7f85882bdb80 1 client.15846 shutdown 2023-10-16T13:14:24.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.684+0000 7f85882bdb80 1 -- 172.21.15.92:0/1705006403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e416850 msgr2=0x55940e420730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.684+0000 7f85882bdb80 1 --2- 172.21.15.92:0/1705006403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e416850 0x55940e420730 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8570011de0 tx=0x7f8570011e10 comp rx=0 tx=0).stop 2023-10-16T13:14:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.684+0000 7f85882bdb80 1 -- 172.21.15.92:0/1705006403 shutdown_connections 2023-10-16T13:14:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.684+0000 7f85882bdb80 1 --2- 172.21.15.92:0/1705006403 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55940e42e670 0x55940e430a90 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.684+0000 7f85882bdb80 1 --2- 172.21.15.92:0/1705006403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e416850 0x55940e420730 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.684+0000 7f855d7fa700 0 client.15846 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.684+0000 7f85882bdb80 1 --2- 172.21.15.92:0/1705006403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e4180a0 0x55940e427cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.684+0000 7f85882bdb80 1 --2- 172.21.15.92:0/1705006403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 0x55940e420c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.684+0000 7f85882bdb80 1 -- 172.21.15.92:0/1705006403 >> 172.21.15.92:0/1705006403 conn(0x55940e344d70 msgr2=0x55940e411830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.684+0000 7f85882bdb80 1 -- 172.21.15.92:0/1705006403 shutdown_connections 2023-10-16T13:14:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.684+0000 7f85882bdb80 1 -- 172.21.15.92:0/1705006403 wait complete. 2023-10-16T13:14:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.684+0000 7f85882bdb80 20 client.15846 trim_cache size 0 max 16384 2023-10-16T13:14:24.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.699+0000 7f85882bdb80 1 Processor -- start 2023-10-16T13:14:24.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.699+0000 7f85882bdb80 1 -- start start 2023-10-16T13:14:24.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f85882bdb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e416850 0x55940e416c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f85882bdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 0x55940e427c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f85882bdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e4180a0 0x55940e41e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f85882bdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940e1ea8c0 con 0x55940e4180a0 2023-10-16T13:14:24.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f85882bdb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940e417f20 con 0x55940e416850 2023-10-16T13:14:24.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f85882bdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940e41fbe0 con 0x55940e4171b0 2023-10-16T13:14:24.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f857a670700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e4180a0 0x55940e41e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f857a670700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e4180a0 0x55940e41e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37968/0 (socket says 172.21.15.92:37968) 2023-10-16T13:14:24.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f857a670700 1 -- 172.21.15.92:0/1991482812 learned_addr learned my addr 172.21.15.92:0/1991482812 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f8579e6f700 1 --2- 172.21.15.92:0/1991482812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e416850 0x55940e416c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f857966e700 1 --2- 172.21.15.92:0/1991482812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 0x55940e427c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f857a670700 1 -- 172.21.15.92:0/1991482812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 msgr2=0x55940e427c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f857a670700 1 --2- 172.21.15.92:0/1991482812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 0x55940e427c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f857a670700 1 -- 172.21.15.92:0/1991482812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e416850 msgr2=0x55940e416c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f857a670700 1 --2- 172.21.15.92:0/1991482812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e416850 0x55940e416c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f857a670700 1 -- 172.21.15.92:0/1991482812 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55940e17dc00 con 0x55940e4180a0 2023-10-16T13:14:24.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f857966e700 1 --2- 172.21.15.92:0/1991482812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 0x55940e427c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:14:24.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f8579e6f700 1 --2- 172.21.15.92:0/1991482812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e416850 0x55940e416c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:14:24.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f857a670700 1 --2- 172.21.15.92:0/1991482812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e4180a0 0x55940e41e480 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f856c011b60 tx=0x7f856c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f6687430af906c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f8568ff9700 1 -- 172.21.15.92:0/1991482812 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c00e040 con 0x55940e4180a0 2023-10-16T13:14:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f8568ff9700 1 -- 172.21.15.92:0/1991482812 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f856c00f040 con 0x55940e4180a0 2023-10-16T13:14:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.700+0000 7f8568ff9700 1 -- 172.21.15.92:0/1991482812 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c004050 con 0x55940e4180a0 2023-10-16T13:14:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.701+0000 7f85882bdb80 1 -- 172.21.15.92:0/1991482812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e4180a0 msgr2=0x55940e41e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.701+0000 7f85882bdb80 1 --2- 172.21.15.92:0/1991482812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e4180a0 0x55940e41e480 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f856c011b60 tx=0x7f856c009920 comp rx=0 tx=0).stop 2023-10-16T13:14:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.701+0000 7f85882bdb80 1 -- 172.21.15.92:0/1991482812 shutdown_connections 2023-10-16T13:14:24.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.701+0000 7f85882bdb80 1 --2- 172.21.15.92:0/1991482812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e4180a0 0x55940e41e480 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.701+0000 7f85882bdb80 1 --2- 172.21.15.92:0/1991482812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e416850 0x55940e416c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.701+0000 7f85882bdb80 1 --2- 172.21.15.92:0/1991482812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 0x55940e427c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.701+0000 7f85882bdb80 1 -- 172.21.15.92:0/1991482812 >> 172.21.15.92:0/1991482812 conn(0x55940e344d70 msgr2=0x55940e41f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.701+0000 7f85882bdb80 1 -- 172.21.15.92:0/1991482812 shutdown_connections 2023-10-16T13:14:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.701+0000 7f85882bdb80 1 -- 172.21.15.92:0/1991482812 wait complete. 2023-10-16T13:14:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.701+0000 7f85882bdb80 1 -- start start 2023-10-16T13:14:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.701+0000 7f85882bdb80 1 Processor -- start 2023-10-16T13:14:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.702+0000 7f85882bdb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e416850 0x55940e4236d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.702+0000 7f85882bdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 0x55940e423c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.702+0000 7f85882bdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e4180a0 0x55940e426c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.702+0000 7f85882bdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940e427170 con 0x55940e4180a0 2023-10-16T13:14:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.702+0000 7f85882bdb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940e4272e0 con 0x55940e416850 2023-10-16T13:14:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.702+0000 7f85882bdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940e4274a0 con 0x55940e4171b0 2023-10-16T13:14:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.702+0000 7f85882bdb80 10 client.0 _ll_register_callbacks cb 0x7f8574196970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.702+0000 7f857a670700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e4180a0 0x55940e426c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.702+0000 7f8579e6f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e416850 0x55940e4236d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.702+0000 7f857a670700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e4180a0 0x55940e426c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37974/0 (socket says 172.21.15.92:37974) 2023-10-16T13:14:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.702+0000 7f8579e6f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e416850 0x55940e4236d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:38778/0 (socket says 172.21.15.92:38778) 2023-10-16T13:14:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.702+0000 7f857a670700 1 -- 172.21.15.92:0/1064018538 learned_addr learned my addr 172.21.15.92:0/1064018538 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.702+0000 7f857966e700 1 --2- 172.21.15.92:0/1064018538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 0x55940e423c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.702+0000 7f857a670700 1 -- 172.21.15.92:0/1064018538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 msgr2=0x55940e423c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.702+0000 7f857a670700 1 --2- 172.21.15.92:0/1064018538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 0x55940e423c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.702+0000 7f857a670700 1 -- 172.21.15.92:0/1064018538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e416850 msgr2=0x55940e4236d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.702+0000 7f857a670700 1 --2- 172.21.15.92:0/1064018538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e416850 0x55940e4236d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.702+0000 7f857a670700 1 -- 172.21.15.92:0/1064018538 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856c0117e0 con 0x55940e4180a0 2023-10-16T13:14:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.702+0000 7f857a670700 1 --2- 172.21.15.92:0/1064018538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e4180a0 0x55940e426c30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f856c0176f0 tx=0x7f856c003cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70af774b5cc5da28 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.703+0000 7f855d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.703+0000 7f855d7fa700 1 -- 172.21.15.92:0/1064018538 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c00e050 con 0x55940e4180a0 2023-10-16T13:14:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.703+0000 7f855d7fa700 1 -- 172.21.15.92:0/1064018538 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f856c0093a0 con 0x55940e4180a0 2023-10-16T13:14:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.703+0000 7f85882bdb80 1 -- 172.21.15.92:0/1064018538 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8570015070 con 0x55940e4180a0 2023-10-16T13:14:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.703+0000 7f855d7fa700 1 -- 172.21.15.92:0/1064018538 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f856c003ea0 con 0x55940e4180a0 2023-10-16T13:14:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.703+0000 7f85882bdb80 10 client.15852 fetch_fsmap learned FSMap version 28 2023-10-16T13:14:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.703+0000 7f85882bdb80 1 -- 172.21.15.92:0/1064018538 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55940e1bb1f0 con 0x55940e4180a0 2023-10-16T13:14:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.703+0000 7f855d7fa700 1 -- 172.21.15.92:0/1064018538 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8570015070 con 0x55940e4180a0 2023-10-16T13:14:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.703+0000 7f855d7fa700 1 -- 172.21.15.92:0/1064018538 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f856c007b00 con 0x55940e4180a0 2023-10-16T13:14:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.703+0000 7f85882bdb80 10 client.15852 fetch_fsmap finished waiting for FSMap version 28 2023-10-16T13:14:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.703+0000 7f85882bdb80 10 client.15852 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.703+0000 7f85882bdb80 20 client.15852 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.703+0000 7f85882bdb80 1 --2- 172.21.15.92:0/1064018538 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55940e4830e0 0x55940e485500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.703+0000 7f85882bdb80 4 client.15852 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-16T13:14:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.703+0000 7f85882bdb80 1 -- 172.21.15.92:0/1064018538 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55940e362df0 con 0x55940e4830e0 2023-10-16T13:14:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.703+0000 7f8579e6f700 1 --2- 172.21.15.92:0/1064018538 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55940e4830e0 0x55940e485500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.704+0000 7f855d7fa700 10 client.15852 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:24.704+0000 7f8579e6f700 1 --2- 172.21.15.92:0/1064018538 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55940e4830e0 0x55940e485500 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae11056e06b59b89 server_cookie=154b9ddbd9a558b in_seq=0 out_seq=0 2023-10-16T13:14:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:24 smithi092 ceph-mon[99542]: pgmap v339: 97 pgs: 97 active+clean; 109 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 850 op/s 2023-10-16T13:14:24.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:24 smithi118 ceph-mon[103969]: pgmap v339: 97 pgs: 97 active+clean; 109 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 850 op/s 2023-10-16T13:14:24.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:24 smithi152 ceph-mon[104423]: pgmap v339: 97 pgs: 97 active+clean; 109 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 850 op/s 2023-10-16T13:14:25.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:25 smithi118 ceph-mon[103969]: scrub queued for path: / 2023-10-16T13:14:25.788 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:25 smithi118 ceph-mon[103969]: scrub summary: idle+waiting paths [/] 2023-10-16T13:14:25.788 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:25 smithi118 ceph-mon[103969]: scrub summary: active paths [/] 2023-10-16T13:14:25.788 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:25 smithi118 ceph-mon[103969]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:25.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:25 smithi152 ceph-mon[104423]: scrub queued for path: / 2023-10-16T13:14:25.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:25 smithi152 ceph-mon[104423]: scrub summary: idle+waiting paths [/] 2023-10-16T13:14:25.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:25 smithi152 ceph-mon[104423]: scrub summary: active paths [/] 2023-10-16T13:14:25.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:25 smithi152 ceph-mon[104423]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:25.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:25 smithi092 ceph-mon[99542]: scrub queued for path: / 2023-10-16T13:14:25.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:25 smithi092 ceph-mon[99542]: scrub summary: idle+waiting paths [/] 2023-10-16T13:14:25.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:25 smithi092 ceph-mon[99542]: scrub summary: active paths [/] 2023-10-16T13:14:25.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:25 smithi092 ceph-mon[99542]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.019+0000 7f855d7fa700 1 -- 172.21.15.92:0/1064018538 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55940e362df0 con 0x55940e4830e0 2023-10-16T13:14:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.019+0000 7f855d7fa700 10 client.15852 handle_command_reply: tid=0 2023-10-16T13:14:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.019+0000 7f85882bdb80 1 client.15852 shutdown 2023-10-16T13:14:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.020+0000 7f85882bdb80 1 -- 172.21.15.92:0/1064018538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e4180a0 msgr2=0x55940e426c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.020+0000 7f85882bdb80 1 --2- 172.21.15.92:0/1064018538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e4180a0 0x55940e426c30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f856c0176f0 tx=0x7f856c003cb0 comp rx=0 tx=0).stop 2023-10-16T13:14:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.020+0000 7f85882bdb80 1 -- 172.21.15.92:0/1064018538 shutdown_connections 2023-10-16T13:14:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.020+0000 7f85882bdb80 1 --2- 172.21.15.92:0/1064018538 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55940e4830e0 0x55940e485500 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.020+0000 7f85882bdb80 1 --2- 172.21.15.92:0/1064018538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55940e4180a0 0x55940e426c30 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.020+0000 7f85882bdb80 1 --2- 172.21.15.92:0/1064018538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55940e416850 0x55940e4236d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.020+0000 7f855d7fa700 0 client.15852 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.020+0000 7f85882bdb80 1 --2- 172.21.15.92:0/1064018538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940e4171b0 0x55940e423c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.020+0000 7f85882bdb80 1 -- 172.21.15.92:0/1064018538 >> 172.21.15.92:0/1064018538 conn(0x55940e344d70 msgr2=0x55940e41e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.020+0000 7f85882bdb80 1 -- 172.21.15.92:0/1064018538 shutdown_connections 2023-10-16T13:14:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.020+0000 7f85882bdb80 1 -- 172.21.15.92:0/1064018538 wait complete. 2023-10-16T13:14:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.020+0000 7f85882bdb80 20 client.15852 trim_cache size 0 max 16384 2023-10-16T13:14:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2023-10-16T13:14:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2023-10-16T13:14:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2023-10-16T13:14:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2023-10-16T13:14:26.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.021+0000 7f857c0d3700 1 -- 172.21.15.92:0/656589045 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f85600a1500 msgr2=0x7f85600a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:26.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.021+0000 7f857c0d3700 1 --2- 172.21.15.92:0/656589045 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f85600a1500 0x7f85600a39c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8574195ad0 tx=0x7f857000b410 comp rx=0 tx=0).stop 2023-10-16T13:14:26.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.021+0000 7f857c0d3700 1 -- 172.21.15.92:0/656589045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8574100f70 msgr2=0x7f85741962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:26.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.021+0000 7f857c0d3700 1 --2- 172.21.15.92:0/656589045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8574100f70 0x7f85741962c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f856400f690 tx=0x7f8564009580 comp rx=0 tx=0).stop 2023-10-16T13:14:26.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.021+0000 7f857c0d3700 1 -- 172.21.15.92:0/656589045 shutdown_connections 2023-10-16T13:14:26.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.021+0000 7f857c0d3700 1 --2- 172.21.15.92:0/656589045 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f85600a1500 0x7f85600a39c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:26.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.021+0000 7f857c0d3700 1 --2- 172.21.15.92:0/656589045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8574101930 0x7f8574197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:26.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.021+0000 7f857c0d3700 1 --2- 172.21.15.92:0/656589045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85740ffe20 0x7f8574195d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:26.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.021+0000 7f857c0d3700 1 --2- 172.21.15.92:0/656589045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8574100f70 0x7f85741962c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:26.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.021+0000 7f857c0d3700 1 -- 172.21.15.92:0/656589045 >> 172.21.15.92:0/656589045 conn(0x7f85740fb3b0 msgr2=0x7f8574104490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:26.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.021+0000 7f857c0d3700 1 -- 172.21.15.92:0/656589045 shutdown_connections 2023-10-16T13:14:26.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:26.021+0000 7f857c0d3700 1 -- 172.21.15.92:0/656589045 wait complete. 2023-10-16T13:14:26.343 INFO:tasks.workunit.client.0.smithi092.stderr:+ sync 2023-10-16T13:14:26.696 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: pgmap v340: 97 pgs: 97 active+clean; 109 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 426 op/s 2023-10-16T13:14:26.696 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: scrub summary: active paths [/] 2023-10-16T13:14:26.696 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000012ef (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.697 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010e6 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.697 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010e7 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.697 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010e8 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.697 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010e9 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.698 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010ea (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.698 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010eb (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.698 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010ec (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.698 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010ed (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.698 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010ee (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.699 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010ef (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.699 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010f0 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.699 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010f1 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.699 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.331+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ef [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt auth v353 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011a4dd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ef:[<0x100000007f0/smsc911x.txt v353>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000012ef:[<0x100000007f0/smsc911x.txt v353>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.700 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.331+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e6 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt auth v357 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011aca6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e6:[<0x100000007f0/qca-qca7000-spi.txt v357>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010e6:[<0x100000007f0/qca-qca7000-spi.txt v357>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.700 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.331+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e7 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt auth v361 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011aca6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e7:[<0x100000007f0/cavium-pip.txt v361>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010e7:[<0x100000007f0/cavium-pip.txt v361>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.700 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.331+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e8 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt auth v365 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011aca6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e8:[<0x100000007f0/broadcom-bcmgenet.txt v365>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010e8:[<0x100000007f0/broadcom-bcmgenet.txt v365>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.700 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.331+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e9 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt auth v369 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011aca7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e9:[<0x100000007f0/marvell-armada-370-neta.txt v369>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010e9:[<0x100000007f0/marvell-armada-370-neta.txt v369>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.701 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.331+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ea [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt auth v373 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011aca7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ea:[<0x100000007f0/mdio-mux-gpio.txt v373>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010ea:[<0x100000007f0/mdio-mux-gpio.txt v373>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.701 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.332+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010eb [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt auth v377 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011aca7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010eb:[<0x100000007f0/keystone-netcp.txt v377>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010eb:[<0x100000007f0/keystone-netcp.txt v377>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.701 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.332+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ec [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt auth v381 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011aca8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ec:[<0x100000007f0/davinci_emac.txt v381>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010ec:[<0x100000007f0/davinci_emac.txt v381>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.702 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010f2 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.702 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010f3 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.702 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010f4 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.702 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010f7 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.703 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010f8 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.703 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010f9 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.703 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010fb (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.703 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010fa (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.703 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010fc (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.704 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010fd (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.704 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010fe (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.704 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010ff (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.704 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001100 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.704 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001101 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.705 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x1000000110c (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.705 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.332+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ed [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt auth v385 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011aca8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ed:[<0x100000007f0/calxeda-xgmac.txt v385>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010ed:[<0x100000007f0/calxeda-xgmac.txt v385>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.705 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.332+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ee [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt auth v389 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011aca8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ee:[<0x100000007f0/opencores-ethoc.txt v389>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010ee:[<0x100000007f0/opencores-ethoc.txt v389>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.706 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.332+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ef [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt auth v393 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011aca9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ef:[<0x100000007f0/marvell-orion-net.txt v393>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010ef:[<0x100000007f0/marvell-orion-net.txt v393>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.706 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.333+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f0 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt auth v397 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011aca9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f0:[<0x100000007f0/marvell-pp2.txt v397>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010f0:[<0x100000007f0/marvell-pp2.txt v397>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.706 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.333+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f1 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt auth v401 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acac000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f1:[<0x100000007f0/cpsw.txt v401>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010f1:[<0x100000007f0/cpsw.txt v401>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.706 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.333+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f2 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt auth v405 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acac580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f2:[<0x100000007f0/ethernet.txt v405>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010f2:[<0x100000007f0/ethernet.txt v405>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.707 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.333+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f3 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt auth v413 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acad080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f3:[<0x100000007f0/allwinner,sun4i-emac.txt v413>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010f3:[<0x100000007f0/allwinner,sun4i-emac.txt v413>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.707 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.333+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f4 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt auth v417 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acad600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f4:[<0x100000007f0/moxa,moxart-mac.txt v417>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010f4:[<0x100000007f0/moxa,moxart-mac.txt v417>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.707 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.334+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f7 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt auth v433 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acae100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f7:[<0x100000007f0/samsung-sxgbe.txt v433>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010f7:[<0x100000007f0/samsung-sxgbe.txt v433>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.707 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.334+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f8 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt auth v437 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acae680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f8:[<0x100000007f0/macb.txt v437>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010f8:[<0x100000007f0/macb.txt v437>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.707 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.334+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f9 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt auth v441 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acaec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f9:[<0x100000007f0/phy.txt v441>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010f9:[<0x100000007f0/phy.txt v441>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.707 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.334+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010fb [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt auth v449 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acaf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010fb:[<0x100000007f0/mdio-mux.txt v449>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010fb:[<0x100000007f0/mdio-mux.txt v449>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.708 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.334+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010fa [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt auth v445 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acaf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010fa:[<0x100000007f0/fsl-fec.txt v445>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010fa:[<0x100000007f0/fsl-fec.txt v445>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.708 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.334+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010fc [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt auth v453 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acb6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010fc:[<0x100000007f0/broadcom-sf2.txt v453>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010fc:[<0x100000007f0/broadcom-sf2.txt v453>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.708 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.335+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010fd [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt auth v457 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acb6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010fd:[<0x100000007f0/mdio-mux-mmioreg.txt v457>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010fd:[<0x100000007f0/mdio-mux-mmioreg.txt v457>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.708 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.335+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010fe [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt auth v461 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acb6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010fe:[<0x100000007f0/micrel-ksz90x1.txt v461>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010fe:[<0x100000007f0/micrel-ksz90x1.txt v461>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.709 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.335+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ff [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt auth v465 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acb7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ff:[<0x100000007f0/stmmac.txt v465>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010ff:[<0x100000007f0/stmmac.txt v465>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.709 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.335+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001100 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt auth v469 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acb7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001100:[<0x100000007f0/via-rhine.txt v469>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001100:[<0x100000007f0/via-rhine.txt v469>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.709 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x1000000110d (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.709 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x1000000110e (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.710 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x1000000110f (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.710 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001110 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.710 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001111 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.710 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001112 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.710 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001113 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.711 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001114 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.711 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001115 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.711 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001116 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.711 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001117 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.711 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001118 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.712 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001119 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.712 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x1000000111a (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.712 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x1000000111b (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.712 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.335+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001101 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt auth v473 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acb7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001101:[<0x100000007f0/rockchip-dwmac.txt v473>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001101:[<0x100000007f0/rockchip-dwmac.txt v473>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.713 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.336+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110c [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt auth v521 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acb8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000110c:[<0x100000007f0/micrel-ks8851.txt v521>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x1000000110c:[<0x100000007f0/micrel-ks8851.txt v521>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.713 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.336+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110d [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt auth v525 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acb8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000110d:[<0x100000007f0/lpc-eth.txt v525>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x1000000110d:[<0x100000007f0/lpc-eth.txt v525>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.713 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.336+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110e [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt auth v529 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acb9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000110e:[<0x100000007f0/micrel.txt v529>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x1000000110e:[<0x100000007f0/micrel.txt v529>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.713 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.336+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110f [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt auth v533 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acb9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000110f:[<0x100000007f0/via-velocity.txt v533>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x1000000110f:[<0x100000007f0/via-velocity.txt v533>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.713 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.336+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001110 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt auth v537 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acbe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001110:[<0x100000007f0/cavium-mdio.txt v537>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001110:[<0x100000007f0/cavium-mdio.txt v537>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.713 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.336+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001111 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt auth v541 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acbe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001111:[<0x100000007f0/fsl-tsec-phy.txt v541>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001111:[<0x100000007f0/fsl-tsec-phy.txt v541>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.714 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.336+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001112 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt auth v545 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acbeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001112:[<0x100000007f0/arc_emac.txt v545>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001112:[<0x100000007f0/arc_emac.txt v545>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.714 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x1000000111c (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.714 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x1000000111d (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.715 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x1000000111e (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.715 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x1000000111f (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.715 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001120 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.715 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001121 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.715 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001122 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.715 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001123 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.716 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001125 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.716 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001124 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.716 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001126 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.716 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001127 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.716 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001128 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.716 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001129 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.717 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x1000000112a (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.717 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x1000000112b (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.717 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x1000000112d (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.717 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001131 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.718 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.337+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001113 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt auth v549 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acbf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001113:[<0x100000007f0/cdns-emac.txt v549>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001113:[<0x100000007f0/cdns-emac.txt v549>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.718 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.337+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001114 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt auth v553 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acbf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001114:[<0x100000007f0/mdio-gpio.txt v553>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001114:[<0x100000007f0/mdio-gpio.txt v553>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.718 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.337+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001115 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt auth v557 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acbfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001115:[<0x100000007f0/apm-xgene-enet.txt v557>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001115:[<0x100000007f0/apm-xgene-enet.txt v557>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.719 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.337+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001116 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt auth v561 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acc0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001116:[<0x100000007f0/davinci-mdio.txt v561>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001116:[<0x100000007f0/davinci-mdio.txt v561>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.719 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.337+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001117 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt auth v565 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acc0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001117:[<0x100000007f0/davicom-dm9000.txt v565>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001117:[<0x100000007f0/davicom-dm9000.txt v565>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.719 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.337+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001118 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt auth v569 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acc0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001118:[<0x100000007f0/meson-dwmac.txt v569>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001118:[<0x100000007f0/meson-dwmac.txt v569>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.719 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.337+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001119 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt auth v573 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acc1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001119:[<0x100000007f0/emac_rockchip.txt v573>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001119:[<0x100000007f0/emac_rockchip.txt v573>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.719 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.338+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111a [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt auth v577 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acc1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111a:[<0x100000007f0/gpmc-eth.txt v577>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x1000000111a:[<0x100000007f0/gpmc-eth.txt v577>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.720 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.338+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111b [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt auth v581 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acc8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111b:[<0x100000007f0/smsc-lan91c111.txt v581>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x1000000111b:[<0x100000007f0/smsc-lan91c111.txt v581>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.720 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.338+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111c [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt auth v585 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acc8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111c:[<0x100000007f0/cpsw-phy-sel.txt v585>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x1000000111c:[<0x100000007f0/cpsw-phy-sel.txt v585>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.720 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.338+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111d [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt auth v589 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acc8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111d:[<0x100000007f0/hisilicon-hix5hd2-gmac.txt v589>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x1000000111d:[<0x100000007f0/hisilicon-hix5hd2-gmac.txt v589>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.720 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.338+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111e [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt auth v593 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acc9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111e:[<0x100000007f0/amd-xgbe.txt v593>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x1000000111e:[<0x100000007f0/amd-xgbe.txt v593>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.721 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.338+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111f [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt auth v597 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acc9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111f:[<0x100000007f0/sti-dwmac.txt v597>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x1000000111f:[<0x100000007f0/sti-dwmac.txt v597>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.721 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.338+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001120 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt auth v601 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acc9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001120:[<0x100000007f0/marvell-pxa168.txt v601>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001120:[<0x100000007f0/marvell-pxa168.txt v601>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.721 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.339+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001121 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt auth v605 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acca100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001121:[<0x100000007f0/amd-xgbe-phy.txt v605>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001121:[<0x100000007f0/amd-xgbe-phy.txt v605>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.721 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.339+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001122 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt auth v609 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acca680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001122:[<0x100000007f0/allwinner,sun7i-a20-gmac.txt v609>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001122:[<0x100000007f0/allwinner,sun7i-a20-gmac.txt v609>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.722 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.339+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001123 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt auth v613 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011accac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001123:[<0x100000007f0/sh_eth.txt v613>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001123:[<0x100000007f0/sh_eth.txt v613>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.722 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.339+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001125 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt auth v621 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011accb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001125:[<0x100000007f0/broadcom-systemport.txt v621>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001125:[<0x100000007f0/broadcom-systemport.txt v621>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.722 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.339+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001124 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt auth v617 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011accb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001124:[<0x100000007f0/allwinner,sun4i-mdio.txt v617>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001124:[<0x100000007f0/allwinner,sun4i-mdio.txt v617>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.722 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.339+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001126 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt auth v625 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acd2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001126:[<0x100000007f0/fixed-link.txt v625>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001126:[<0x100000007f0/fixed-link.txt v625>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.722 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.340+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001127 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt auth v629 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acd2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001127:[<0x100000007f0/hisilicon-hip04-net.txt v629>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001127:[<0x100000007f0/hisilicon-hip04-net.txt v629>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.723 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.340+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001128 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt auth v633 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acd2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001128:[<0x100000007f0/broadcom-bcm87xx.txt v633>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001128:[<0x100000007f0/broadcom-bcm87xx.txt v633>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.723 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.340+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001129 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt auth v637 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acd3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001129:[<0x100000007f0/socfpga-dwmac.txt v637>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001129:[<0x100000007f0/socfpga-dwmac.txt v637>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.723 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.340+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112a [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt auth v641 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acd3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112a:[<0x100000007f0/broadcom-mdio-unimac.txt v641>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x1000000112a:[<0x100000007f0/broadcom-mdio-unimac.txt v641>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.723 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.340+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112b [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt auth v645 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acd3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112b:[<0x100000007f0/altera_tse.txt v645>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x1000000112b:[<0x100000007f0/altera_tse.txt v645>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.723 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.341+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112d [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt auth v657 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acd4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112d:[<0x100000007f0/cavium-mix.txt v657>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x1000000112d:[<0x100000007f0/cavium-mix.txt v657>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.724 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:26.341+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001131 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt auth v677 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acd5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001131:[<0x100000007f0/marvell-orion-mdio.txt v677>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001131:[<0x100000007f0/marvell-orion-mdio.txt v677>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1518>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:26.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: pgmap v340: 97 pgs: 97 active+clean; 109 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 426 op/s 2023-10-16T13:14:26.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: scrub summary: active paths [/] 2023-10-16T13:14:26.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000012ef (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010e6 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010e7 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010e8 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010e9 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010ea (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010eb (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010ec (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010ed (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010ee (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010ef (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010f0 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010f1 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010f2 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010f3 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010f4 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010f7 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010f8 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010f9 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010fb (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010fa (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010fc (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010fd (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010fe (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010ff (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001100 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001101 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x1000000110c (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x1000000110d (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x1000000110e (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x1000000110f (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001110 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001111 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001112 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001113 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001114 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.006 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001115 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.006 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001116 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.006 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001117 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.006 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001118 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.006 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001119 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.007 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x1000000111a (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.007 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x1000000111b (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.007 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x1000000111c (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.008 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x1000000111d (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.008 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x1000000111e (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.008 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x1000000111f (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.008 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001120 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.008 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001121 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.009 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001122 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.009 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001123 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.009 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001125 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.009 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001124 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.009 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001126 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.010 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001127 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.010 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001128 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.010 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001129 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.010 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x1000000112a (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.011 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x1000000112b (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.011 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x1000000112d (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.011 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:26 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001131 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: pgmap v340: 97 pgs: 97 active+clean; 109 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 426 op/s 2023-10-16T13:14:27.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: scrub summary: active paths [/] 2023-10-16T13:14:27.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000012ef (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010e6 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010e7 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010e8 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010e9 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010ea (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010eb (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010ec (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010ed (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010ee (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010ef (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010f0 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010f1 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.039 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010f2 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.039 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010f3 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.039 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010f4 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.039 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010f7 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.040 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010f8 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.040 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010f9 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.040 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010fb (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.040 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010fa (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.040 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010fc (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.041 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010fd (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.041 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010fe (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.041 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010ff (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.041 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001100 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.041 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001101 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.041 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x1000000110c (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.042 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x1000000110d (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.042 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x1000000110e (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.042 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x1000000110f (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.042 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001110 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.042 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001111 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.043 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001112 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.043 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001113 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.043 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001114 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.043 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001115 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.043 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001116 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.044 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001117 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.044 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001118 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.044 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001119 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.044 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x1000000111a (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.044 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x1000000111b (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.045 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x1000000111c (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.045 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x1000000111d (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.045 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x1000000111e (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.045 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x1000000111f (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.045 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001120 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.045 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001121 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.046 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001122 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.046 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001123 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.046 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001125 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.046 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001124 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.046 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001126 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.047 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001127 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.047 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001128 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.047 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001129 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.047 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x1000000112a (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.047 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x1000000112b (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.048 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x1000000112d (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.048 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:26 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001131 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.574 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.204+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f0 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt auth v8 pv10 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2023-10-16T13:14:14.649652+0000 b3369 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acd5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f0:[<0x100000007f4/dsa.txt v8>,<0x100000007f0/dsa v409>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000012f0:[<0x100000007f4/dsa.txt v8>,<0x100000007f0/dsa v680>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.575 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.204+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f1 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt auth v16 pv30 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2023-10-16T13:14:14.655651+0000 b628 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acda000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f1:[<0x100000008f5/qcom,ath10k.txt v16>,<0x100000007f0/wireless v429>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000012f1:[<0x100000008f5/qcom,ath10k.txt v16>,<0x100000007f0/wireless v682>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.575 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.205+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f5 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt auth v20 pv26 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2015-06-06T15:21:22.000000+0000 b1252 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acda580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f5:[<0x100000008f5/ti,wl1251.txt v20>,<0x100000007f0/wireless v429>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010f5:[<0x100000008f5/ti,wl1251.txt v20>,<0x100000007f0/wireless v682>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.576 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.206+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f6 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt auth v24 pv28 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2015-06-06T15:21:22.000000+0000 b1163 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acdab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f6:[<0x100000008f5/brcm,bcm43xx-fmac.txt v24>,<0x100000007f0/wireless v429>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000010f6:[<0x100000008f5/brcm,bcm43xx-fmac.txt v24>,<0x100000007f0/wireless v682>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.576 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.206+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f2 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt auth v48 pv106 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2023-10-16T13:14:14.685651+0000 b1625 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acdb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f2:[<0x100000007f2/cc770.txt v48>,<0x100000007f0/can v517>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000012f2:[<0x100000007f2/cc770.txt v48>,<0x100000007f0/can v684>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.577 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.207+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001102 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt auth v52 pv100 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2015-06-06T15:21:22.000000+0000 b957 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acdb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001102:[<0x100000007f2/grcan.txt v52>,<0x100000007f0/can v517>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001102:[<0x100000007f2/grcan.txt v52>,<0x100000007f0/can v684>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.577 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.207+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001103 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt auth v56 pv108 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2015-06-06T15:21:22.000000+0000 b2531 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acdbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001103:[<0x100000007f2/m_can.txt v56>,<0x100000007f0/can v517>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001103:[<0x100000007f2/m_can.txt v56>,<0x100000007f0/can v684>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.577 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.208+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001104 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt auth v60 pv96 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2015-06-06T15:21:22.000000+0000 b757 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acdc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001104:[<0x100000007f2/microchip,mcp251x.txt v60>,<0x100000007f0/can v517>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001104:[<0x100000007f2/microchip,mcp251x.txt v60>,<0x100000007f0/can v684>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.578 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.209+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001105 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt auth v64 pv98 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2015-06-06T15:21:22.000000+0000 b764 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acdc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001105:[<0x100000007f2/fsl-flexcan.txt v64>,<0x100000007f0/can v517>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001105:[<0x100000007f2/fsl-flexcan.txt v64>,<0x100000007f0/can v684>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.578 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.209+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001106 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt auth v68 pv90 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2015-06-06T15:21:22.000000+0000 b371 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acdcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001106:[<0x100000007f2/atmel-can.txt v68>,<0x100000007f0/can v517>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001106:[<0x100000007f2/atmel-can.txt v68>,<0x100000007f0/can v684>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.579 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.210+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001107 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt auth v72 pv94 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2015-06-06T15:21:22.000000+0000 b1712 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acdd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001107:[<0x100000007f2/sja1000.txt v72>,<0x100000007f0/can v517>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001107:[<0x100000007f2/sja1000.txt v72>,<0x100000007f0/can v684>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.579 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.210+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001108 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt auth v76 pv102 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2015-06-06T15:21:22.000000+0000 b1482 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011acdd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001108:[<0x100000007f2/c_can.txt v76>,<0x100000007f0/can v517>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001108:[<0x100000007f2/c_can.txt v76>,<0x100000007f0/can v684>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.579 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.211+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001109 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt auth v80 pv104 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2015-06-06T15:21:22.000000+0000 b1677 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011ace6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001109:[<0x100000007f2/mpc5xxx-mscan.txt v80>,<0x100000007f0/can v517>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001109:[<0x100000007f2/mpc5xxx-mscan.txt v80>,<0x100000007f0/can v684>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.580 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.212+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110a [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt auth v84 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15324 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011ace6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000110a:[<0x100000007f2/rcar_can.txt v84>,<0x100000007f0/can v517>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x1000000110a:[<0x100000007f2/rcar_can.txt v84>,<0x100000007f0/can v684>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.580 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.212+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110b [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt auth v88 pv92 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2015-06-06T15:21:22.000000+0000 b1418 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011ace6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000110b:[<0x100000007f2/xilinx_can.txt v88>,<0x100000007f0/can v517>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x1000000110b:[<0x100000007f2/xilinx_can.txt v88>,<0x100000007f0/can v684>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.581 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.213+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f3 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt auth v12 pv18 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2023-10-16T13:14:14.765648+0000 b626 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011ace7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f3:[<0x100000007f6/at86rf230.txt v12>,<0x100000007f0/ieee802154 v653>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000012f3:[<0x100000007f6/at86rf230.txt v12>,<0x100000007f0/ieee802154 v686>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.581 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.213+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112c [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt auth v16 pv20 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2015-06-06T15:21:22.000000+0000 b955 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011ace7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112c:[<0x100000007f6/cc2520.txt v16>,<0x100000007f0/ieee802154 v653>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x1000000112c:[<0x100000007f6/cc2520.txt v16>,<0x100000007f0/ieee802154 v686>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.581 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.214+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f4 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt auth v20 pv34 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2023-10-16T13:14:14.772648+0000 b1080 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011ace7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f4:[<0x100000008f3/st21nfca.txt v20>,<0x100000007f0/nfc v673>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x100000012f4:[<0x100000008f3/st21nfca.txt v20>,<0x100000007f0/nfc v688>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.582 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.215+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112e [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt auth v24 pv38 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2015-06-06T15:21:22.000000+0000 b953 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011ace8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112e:[<0x100000008f3/pn544.txt v24>,<0x100000007f0/nfc v673>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x1000000112e:[<0x100000008f3/pn544.txt v24>,<0x100000007f0/nfc v688>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.582 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.215+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112f [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt auth v28 pv36 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2015-06-06T15:21:22.000000+0000 b1419 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011ace8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112f:[<0x100000008f3/trf7970a.txt v28>,<0x100000007f0/nfc v673>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x1000000112f:[<0x100000008f3/trf7970a.txt v28>,<0x100000007f0/nfc v688>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.583 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:14:27.216+0000 7fbc5967c700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001130 [2,head] /volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt auth v32 pv40 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2015-06-06T15:21:22.000000+0000 b847 1=1+0) (ifile excl w=1) (iversion lock) cr={15324=0-4194304@1} caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56011ace8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001130:[<0x100000008f3/st21nfcb.txt v32>,<0x100000007f0/nfc v673>,<0x1000000053b/net v10088>,<0x10000000539/bindings v498>,<0x10000000203/devicetree v3184>,<0x10000000202/Documentation v1480>,<0x10000000201/linux-4.0.5 v57>,<0x10000000006/untar_tar v77>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v68>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v69>,<0x1/volumes v60>]//[]","memoryvalue":"(3)0x10000001130:[<0x100000008f3/st21nfcb.txt v32>,<0x100000007f0/nfc v688>,<0x1000000053b/net v10141>,<0x10000000539/bindings v502>,<0x10000000203/devicetree v3210>,<0x10000000202/Documentation v1522>,<0x10000000201/linux-4.0.5 v63>,<0x10000000006/untar_tar v80>,<0x10000000005/tmp v62>,<0x100000001fb/client.0 v54>,<0x100000001fa/092061c0-acab-4491-9dc4-d5fd37348927 v70>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v66>,<0x1/volumes v62>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-16T13:14:27.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000012f0 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000012f1 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010f5 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000010f6 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000012f2 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001102 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001103 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001104 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001105 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001106 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001107 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001108 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001109 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x1000000110a (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x1000000110b (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000012f3 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x1000000112c (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x100000012f4 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x1000000112e (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x1000000112f (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: Scrub error on inode 0x10000001130 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: scrub summary: idle+waiting paths [/] 2023-10-16T13:14:27.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:27 smithi152 ceph-mon[104423]: scrub summary: idle+waiting paths [/] 2023-10-16T13:14:27.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000012f0 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000012f1 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010f5 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000010f6 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000012f2 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001102 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001103 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001104 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001105 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001106 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:27.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001107 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001108 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001109 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x1000000110a (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x1000000110b (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000012f3 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x1000000112c (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x100000012f4 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x1000000112e (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x1000000112f (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: Scrub error on inode 0x10000001130 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: scrub summary: idle+waiting paths [/] 2023-10-16T13:14:28.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:27 smithi092 ceph-mon[99542]: scrub summary: idle+waiting paths [/] 2023-10-16T13:14:28.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000012f0 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000012f1 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010f5 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000010f6 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000012f2 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001102 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001103 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001104 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001105 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.035 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001106 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001107 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001108 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001109 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x1000000110a (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.036 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x1000000110b (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000012f3 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x1000000112c (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x100000012f4 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.037 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x1000000112e (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.038 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x1000000112f (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.038 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: Scrub error on inode 0x10000001130 (/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt) see mds.i log and `damage ls` output for details 2023-10-16T13:14:28.038 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: scrub summary: idle+waiting paths [/] 2023-10-16T13:14:28.038 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:27 smithi118 ceph-mon[103969]: scrub summary: idle+waiting paths [/] 2023-10-16T13:14:28.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:28 smithi152 ceph-mon[104423]: pgmap v341: 97 pgs: 97 active+clean; 111 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 819 op/s 2023-10-16T13:14:28.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:28 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mon-a[99518]: 2023-10-16T13:14:28.569+0000 7f1a19dfc700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-16T13:14:28.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:28 smithi092 ceph-mon[99542]: pgmap v341: 97 pgs: 97 active+clean; 111 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 819 op/s 2023-10-16T13:14:29.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:28 smithi118 ceph-mon[103969]: pgmap v341: 97 pgs: 97 active+clean; 111 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 819 op/s 2023-10-16T13:14:29.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:29 smithi152 ceph-mon[104423]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-16T13:14:29.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:29 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] up:active 2023-10-16T13:14:29.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:29 smithi152 ceph-mon[104423]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:29 smithi092 ceph-mon[99542]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-16T13:14:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:29 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] up:active 2023-10-16T13:14:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:29 smithi092 ceph-mon[99542]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:30.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:29 smithi118 ceph-mon[103969]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-16T13:14:30.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:29 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] up:active 2023-10-16T13:14:30.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:29 smithi118 ceph-mon[103969]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:30.563 INFO:tasks.workunit.client.0.smithi092.stderr:+ tar c linux-4.0.5 2023-10-16T13:14:30.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:30 smithi152 ceph-mon[104423]: pgmap v342: 97 pgs: 97 active+clean; 122 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 1.27k op/s 2023-10-16T13:14:30.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:30 smithi092 ceph-mon[99542]: pgmap v342: 97 pgs: 97 active+clean; 122 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 1.27k op/s 2023-10-16T13:14:31.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:30 smithi118 ceph-mon[103969]: pgmap v342: 97 pgs: 97 active+clean; 122 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 1.27k op/s 2023-10-16T13:14:31.265 INFO:tasks.workunit.client.0.smithi092.stderr:+ rm -rf linux-4.0.5 2023-10-16T13:14:32.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:32 smithi152 ceph-mon[104423]: pgmap v343: 97 pgs: 97 active+clean; 132 MiB data, 809 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.7 MiB/s wr, 1.70k op/s 2023-10-16T13:14:32.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:32 smithi092 ceph-mon[99542]: pgmap v343: 97 pgs: 97 active+clean; 132 MiB data, 809 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.7 MiB/s wr, 1.70k op/s 2023-10-16T13:14:33.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:32 smithi118 ceph-mon[103969]: pgmap v343: 97 pgs: 97 active+clean; 132 MiB data, 809 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.7 MiB/s wr, 1.70k op/s 2023-10-16T13:14:33.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:33 smithi152 ceph-mon[104423]: scrub summary: idle 2023-10-16T13:14:33.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:33 smithi092 ceph-mon[99542]: scrub summary: idle 2023-10-16T13:14:34.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:33 smithi118 ceph-mon[103969]: scrub summary: idle 2023-10-16T13:14:34.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:34 smithi152 ceph-mon[104423]: pgmap v344: 97 pgs: 97 active+clean; 143 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.7 MiB/s wr, 1.93k op/s 2023-10-16T13:14:34.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:34 smithi152 ceph-mon[104423]: scrub summary: idle 2023-10-16T13:14:34.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:34 smithi152 ceph-mon[104423]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:34.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:34 smithi092 ceph-mon[99542]: pgmap v344: 97 pgs: 97 active+clean; 143 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.7 MiB/s wr, 1.93k op/s 2023-10-16T13:14:34.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:34 smithi092 ceph-mon[99542]: scrub summary: idle 2023-10-16T13:14:34.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:34 smithi092 ceph-mon[99542]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:35.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:34 smithi118 ceph-mon[103969]: pgmap v344: 97 pgs: 97 active+clean; 143 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.7 MiB/s wr, 1.93k op/s 2023-10-16T13:14:35.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:34 smithi118 ceph-mon[103969]: scrub summary: idle 2023-10-16T13:14:35.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:34 smithi118 ceph-mon[103969]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:35.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:35 smithi152 ceph-mon[104423]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:35.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:35 smithi092 ceph-mon[99542]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:36.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:35 smithi118 ceph-mon[103969]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:36.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:36 smithi152 ceph-mon[104423]: pgmap v345: 97 pgs: 97 active+clean; 145 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.0 MiB/s wr, 1.93k op/s 2023-10-16T13:14:36.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:36 smithi092 ceph-mon[99542]: pgmap v345: 97 pgs: 97 active+clean; 145 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.0 MiB/s wr, 1.93k op/s 2023-10-16T13:14:37.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:36 smithi118 ceph-mon[103969]: pgmap v345: 97 pgs: 97 active+clean; 145 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.0 MiB/s wr, 1.93k op/s 2023-10-16T13:14:37.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:37 smithi152 ceph-mon[104423]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:37.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:37 smithi092 ceph-mon[99542]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:38.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:37 smithi118 ceph-mon[103969]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:38.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:38 smithi152 ceph-mon[104423]: pgmap v346: 97 pgs: 97 active+clean; 144 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.1 MiB/s wr, 2.00k op/s 2023-10-16T13:14:38.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:38 smithi092 ceph-mon[99542]: pgmap v346: 97 pgs: 97 active+clean; 144 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.1 MiB/s wr, 2.00k op/s 2023-10-16T13:14:39.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:38 smithi118 ceph-mon[103969]: pgmap v346: 97 pgs: 97 active+clean; 144 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.1 MiB/s wr, 2.00k op/s 2023-10-16T13:14:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.131+0000 7f872d40d700 1 -- 172.21.15.92:0/2430069884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8728100a00 msgr2=0x7f87281082a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.132+0000 7f872d40d700 1 --2- 172.21.15.92:0/2430069884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8728100a00 0x7f87281082a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f872000b0a0 tx=0x7f872000b3b0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.132+0000 7f872d40d700 1 -- 172.21.15.92:0/2430069884 shutdown_connections 2023-10-16T13:14:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.132+0000 7f872d40d700 1 --2- 172.21.15.92:0/2430069884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8728100a00 0x7f87281082a0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.132+0000 7f872d40d700 1 --2- 172.21.15.92:0/2430069884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87281013f0 0x7f8728101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.132+0000 7f872d40d700 1 --2- 172.21.15.92:0/2430069884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8728100040 0x7f87281004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.132+0000 7f872d40d700 1 -- 172.21.15.92:0/2430069884 >> 172.21.15.92:0/2430069884 conn(0x7f87280fab50 msgr2=0x7f87280fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.132+0000 7f872d40d700 1 -- 172.21.15.92:0/2430069884 shutdown_connections 2023-10-16T13:14:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.132+0000 7f872d40d700 1 -- 172.21.15.92:0/2430069884 wait complete. 2023-10-16T13:14:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.132+0000 7f872d40d700 1 Processor -- start 2023-10-16T13:14:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.133+0000 7f872d40d700 1 -- start start 2023-10-16T13:14:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.133+0000 7f872d40d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8728100040 0x7f8728195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.133+0000 7f872d40d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8728100a00 0x7f87281962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.133+0000 7f872d40d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87281013f0 0x7f8728197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.133+0000 7f872d40d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8728197770 con 0x7f8728100040 2023-10-16T13:14:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.133+0000 7f872d40d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87281978e0 con 0x7f8728100a00 2023-10-16T13:14:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.133+0000 7f872d40d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8728197aa0 con 0x7f87281013f0 2023-10-16T13:14:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.133+0000 7f8726ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8728100040 0x7f8728195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.133+0000 7f8726ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8728100040 0x7f8728195d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37986/0 (socket says 172.21.15.92:37986) 2023-10-16T13:14:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.133+0000 7f8726ffd700 1 -- 172.21.15.92:0/2935674070 learned_addr learned my addr 172.21.15.92:0/2935674070 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.133+0000 7f87277fe700 1 --2- 172.21.15.92:0/2935674070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87281013f0 0x7f8728197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.133+0000 7f87267fc700 1 --2- 172.21.15.92:0/2935674070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8728100a00 0x7f87281962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.133+0000 7f8726ffd700 1 -- 172.21.15.92:0/2935674070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87281013f0 msgr2=0x7f8728197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.133+0000 7f8726ffd700 1 --2- 172.21.15.92:0/2935674070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87281013f0 0x7f8728197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.133+0000 7f8726ffd700 1 -- 172.21.15.92:0/2935674070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8728100a00 msgr2=0x7f87281962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.133+0000 7f8726ffd700 1 --2- 172.21.15.92:0/2935674070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8728100a00 0x7f87281962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.133+0000 7f8726ffd700 1 -- 172.21.15.92:0/2935674070 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8720009d00 con 0x7f8728100040 2023-10-16T13:14:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.134+0000 7f8726ffd700 1 --2- 172.21.15.92:0/2935674070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8728100040 0x7f8728195d80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f871c00d980 tx=0x7f871c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.134+0000 7f870ffff700 1 -- 172.21.15.92:0/2935674070 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c004220 con 0x7f8728100040 2023-10-16T13:14:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.134+0000 7f870ffff700 1 -- 172.21.15.92:0/2935674070 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f871c007640 con 0x7f8728100040 2023-10-16T13:14:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.134+0000 7f870ffff700 1 -- 172.21.15.92:0/2935674070 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c00f690 con 0x7f8728100040 2023-10-16T13:14:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.134+0000 7f872d40d700 1 -- 172.21.15.92:0/2935674070 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8728197d80 con 0x7f8728100040 2023-10-16T13:14:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.134+0000 7f872d40d700 1 -- 172.21.15.92:0/2935674070 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872819e490 con 0x7f8728100040 2023-10-16T13:14:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.136+0000 7f870ffff700 1 -- 172.21.15.92:0/2935674070 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f871c004410 con 0x7f8728100040 2023-10-16T13:14:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.136+0000 7f870ffff700 1 --2- 172.21.15.92:0/2935674070 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f87100a1480 0x7f87100a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.136+0000 7f87267fc700 1 --2- 172.21.15.92:0/2935674070 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f87100a1480 0x7f87100a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.136+0000 7f870ffff700 1 -- 172.21.15.92:0/2935674070 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f871c0ccad0 con 0x7f8728100040 2023-10-16T13:14:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.137+0000 7f87267fc700 1 --2- 172.21.15.92:0/2935674070 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f87100a1480 0x7f87100a3940 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f871800ac50 tx=0x7f871800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.137+0000 7f87395f7b80 1 Processor -- start 2023-10-16T13:14:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.137+0000 7f87395f7b80 1 -- start start 2023-10-16T13:14:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.137+0000 7f87395f7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a97fa60 0x55e47a97fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.137+0000 7f87395f7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a9803c0 0x55e47a980cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.137+0000 7f87395f7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a9812b0 0x55e47a981730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.137+0000 7f87395f7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47a8f2c10 con 0x55e47a9812b0 2023-10-16T13:14:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.137+0000 7f87395f7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47a8d7c00 con 0x55e47a97fa60 2023-10-16T13:14:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.137+0000 7f87395f7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47a8d5520 con 0x55e47a9803c0 2023-10-16T13:14:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.137+0000 7f87277fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a9812b0 0x55e47a981730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.137+0000 7f87267fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a9803c0 0x55e47a980cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.137+0000 7f8726ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a97fa60 0x55e47a97fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.137+0000 7f87277fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a9812b0 0x55e47a981730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37998/0 (socket says 172.21.15.92:37998) 2023-10-16T13:14:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.137+0000 7f87277fe700 1 -- 172.21.15.92:0/1525210021 learned_addr learned my addr 172.21.15.92:0/1525210021 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.138+0000 7f8726ffd700 1 -- 172.21.15.92:0/1525210021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a9803c0 msgr2=0x55e47a980cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.138+0000 7f8726ffd700 1 --2- 172.21.15.92:0/1525210021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a9803c0 0x55e47a980cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.138+0000 7f8726ffd700 1 -- 172.21.15.92:0/1525210021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a9812b0 msgr2=0x55e47a981730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.138+0000 7f8726ffd700 1 --2- 172.21.15.92:0/1525210021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a9812b0 0x55e47a981730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.138+0000 7f8726ffd700 1 -- 172.21.15.92:0/1525210021 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e47a88e390 con 0x55e47a97fa60 2023-10-16T13:14:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.138+0000 7f87267fc700 1 --2- 172.21.15.92:0/1525210021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a9803c0 0x55e47a980cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.138+0000 7f87277fe700 1 --2- 172.21.15.92:0/1525210021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a9812b0 0x55e47a981730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.138+0000 7f8726ffd700 1 --2- 172.21.15.92:0/1525210021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a97fa60 0x55e47a97fe80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f871c0ca5d0 tx=0x7f871c099a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2142fb1de3dd5471 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.138+0000 7f870d7fa700 1 -- 172.21.15.92:0/1525210021 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c099df0 con 0x55e47a97fa60 2023-10-16T13:14:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.138+0000 7f870d7fa700 1 -- 172.21.15.92:0/1525210021 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f871c09df40 con 0x55e47a97fa60 2023-10-16T13:14:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.138+0000 7f870d7fa700 1 -- 172.21.15.92:0/1525210021 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c0adbd0 con 0x55e47a97fa60 2023-10-16T13:14:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.139+0000 7f87395f7b80 1 -- 172.21.15.92:0/1525210021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a97fa60 msgr2=0x55e47a97fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.139+0000 7f87395f7b80 1 --2- 172.21.15.92:0/1525210021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a97fa60 0x55e47a97fe80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f871c0ca5d0 tx=0x7f871c099a00 comp rx=0 tx=0).stop 2023-10-16T13:14:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.139+0000 7f87395f7b80 1 -- 172.21.15.92:0/1525210021 shutdown_connections 2023-10-16T13:14:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.139+0000 7f87395f7b80 1 --2- 172.21.15.92:0/1525210021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a9812b0 0x55e47a981730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.139+0000 7f87395f7b80 1 --2- 172.21.15.92:0/1525210021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a97fa60 0x55e47a97fe80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.139+0000 7f87395f7b80 1 --2- 172.21.15.92:0/1525210021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a9803c0 0x55e47a980cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.139+0000 7f87395f7b80 1 -- 172.21.15.92:0/1525210021 >> 172.21.15.92:0/1525210021 conn(0x55e47a8abd70 msgr2=0x55e47a978c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.139+0000 7f87395f7b80 1 -- 172.21.15.92:0/1525210021 shutdown_connections 2023-10-16T13:14:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.139+0000 7f87395f7b80 1 -- 172.21.15.92:0/1525210021 wait complete. 2023-10-16T13:14:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.139+0000 7f87395f7b80 1 -- start start 2023-10-16T13:14:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.139+0000 7f87395f7b80 1 Processor -- start 2023-10-16T13:14:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.139+0000 7f87395f7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97fa60 0x55e47a9899f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.139+0000 7f87395f7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a9803c0 0x55e47a989f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.139+0000 7f87395f7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a9812b0 0x55e47a990f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.139+0000 7f87395f7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47a8d0e10 con 0x55e47a97fa60 2023-10-16T13:14:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.139+0000 7f87395f7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47a86d6b0 con 0x55e47a9812b0 2023-10-16T13:14:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.139+0000 7f87395f7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47a86d350 con 0x55e47a9803c0 2023-10-16T13:14:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.139+0000 7f87395f7b80 10 client.0 _ll_register_callbacks cb 0x55e47a6ca7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.139+0000 7f8726ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97fa60 0x55e47a9899f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:39.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.140+0000 7f87277fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a9812b0 0x55e47a990f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:39.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.140+0000 7f8726ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97fa60 0x55e47a9899f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38000/0 (socket says 172.21.15.92:38000) 2023-10-16T13:14:39.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.140+0000 7f87267fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a9803c0 0x55e47a989f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:39.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.140+0000 7f8726ffd700 1 -- 172.21.15.92:0/4292215433 learned_addr learned my addr 172.21.15.92:0/4292215433 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:39.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.140+0000 7f87277fe700 1 -- 172.21.15.92:0/4292215433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a9803c0 msgr2=0x55e47a989f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:39.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.140+0000 7f87277fe700 1 --2- 172.21.15.92:0/4292215433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a9803c0 0x55e47a989f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.140+0000 7f87277fe700 1 -- 172.21.15.92:0/4292215433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97fa60 msgr2=0x55e47a9899f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:39.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.140+0000 7f87277fe700 1 --2- 172.21.15.92:0/4292215433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97fa60 0x55e47a9899f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.163 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.140+0000 7f87277fe700 1 -- 172.21.15.92:0/4292215433 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8728108bd0 con 0x55e47a9812b0 2023-10-16T13:14:39.163 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.140+0000 7f8726ffd700 1 --2- 172.21.15.92:0/4292215433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97fa60 0x55e47a9899f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:39.163 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.140+0000 7f87277fe700 1 --2- 172.21.15.92:0/4292215433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a9812b0 0x55e47a990f70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f872000b0a0 tx=0x7f8720007830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c43ef0f26f811763 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:39.163 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.140+0000 7f870aff5700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-16T13:14:39.163 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.140+0000 7f870aff5700 1 -- 172.21.15.92:0/4292215433 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872000e040 con 0x55e47a9812b0 2023-10-16T13:14:39.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.140+0000 7f870aff5700 1 -- 172.21.15.92:0/4292215433 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f8720026460 con 0x55e47a9812b0 2023-10-16T13:14:39.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.140+0000 7f87395f7b80 1 -- 172.21.15.92:0/4292215433 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e47a8d5e90 con 0x55e47a9812b0 2023-10-16T13:14:39.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.140+0000 7f870aff5700 1 -- 172.21.15.92:0/4292215433 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8720026620 con 0x55e47a9812b0 2023-10-16T13:14:39.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.140+0000 7f87395f7b80 10 client.25421 fetch_fsmap learned FSMap version 33 2023-10-16T13:14:39.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.140+0000 7f87395f7b80 1 -- 172.21.15.92:0/4292215433 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f872819e490 con 0x55e47a9812b0 2023-10-16T13:14:39.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.140+0000 7f870aff5700 1 -- 172.21.15.92:0/4292215433 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55e47a8d5e90 con 0x55e47a9812b0 2023-10-16T13:14:39.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.141+0000 7f870aff5700 1 -- 172.21.15.92:0/4292215433 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 33) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f872000b0d0 con 0x55e47a9812b0 2023-10-16T13:14:39.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.141+0000 7f87395f7b80 10 client.25421 fetch_fsmap finished waiting for FSMap version 33 2023-10-16T13:14:39.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.141+0000 7f87395f7b80 10 client.25421 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:39.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.141+0000 7f87395f7b80 20 client.25421 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.141+0000 7f87395f7b80 1 --2- 172.21.15.92:0/4292215433 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e47a97ef00 0x55e47a995eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.141+0000 7f87395f7b80 4 client.25421 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:14:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.141+0000 7f87395f7b80 1 -- 172.21.15.92:0/4292215433 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e47a94dbb0 con 0x55e47a97ef00 2023-10-16T13:14:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.141+0000 7f8726ffd700 1 --2- 172.21.15.92:0/4292215433 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e47a97ef00 0x55e47a995eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.141+0000 7f870aff5700 10 client.25421 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.141+0000 7f8726ffd700 1 --2- 172.21.15.92:0/4292215433 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e47a97ef00 0x55e47a995eb0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62b97c01741657b server_cookie=ec66297b1cc5b32d in_seq=0 out_seq=0 2023-10-16T13:14:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.142+0000 7f870aff5700 1 -- 172.21.15.92:0/4292215433 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e47a94dbb0 con 0x55e47a97ef00 2023-10-16T13:14:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.142+0000 7f870aff5700 10 client.25421 handle_command_reply: tid=0 2023-10-16T13:14:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.142+0000 7f87395f7b80 1 client.25421 shutdown 2023-10-16T13:14:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.142+0000 7f87395f7b80 1 -- 172.21.15.92:0/4292215433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a9812b0 msgr2=0x55e47a990f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.142+0000 7f87395f7b80 1 --2- 172.21.15.92:0/4292215433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a9812b0 0x55e47a990f70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f872000b0a0 tx=0x7f8720007830 comp rx=0 tx=0).stop 2023-10-16T13:14:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.142+0000 7f87395f7b80 1 -- 172.21.15.92:0/4292215433 shutdown_connections 2023-10-16T13:14:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.142+0000 7f87395f7b80 1 --2- 172.21.15.92:0/4292215433 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e47a97ef00 0x55e47a995eb0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.142+0000 7f87395f7b80 1 --2- 172.21.15.92:0/4292215433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97fa60 0x55e47a9899f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.142+0000 7f87395f7b80 1 --2- 172.21.15.92:0/4292215433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a9812b0 0x55e47a990f70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.142+0000 7f870aff5700 0 client.25421 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.142+0000 7f87395f7b80 1 --2- 172.21.15.92:0/4292215433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a9803c0 0x55e47a989f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.142+0000 7f87395f7b80 1 -- 172.21.15.92:0/4292215433 >> 172.21.15.92:0/4292215433 conn(0x55e47a8abd70 msgr2=0x55e47a978830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.142+0000 7f87395f7b80 1 -- 172.21.15.92:0/4292215433 shutdown_connections 2023-10-16T13:14:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.142+0000 7f87395f7b80 1 -- 172.21.15.92:0/4292215433 wait complete. 2023-10-16T13:14:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.142+0000 7f87395f7b80 20 client.25421 trim_cache size 0 max 16384 2023-10-16T13:14:39.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.157+0000 7f87395f7b80 1 Processor -- start 2023-10-16T13:14:39.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.157+0000 7f87395f7b80 1 -- start start 2023-10-16T13:14:39.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.157+0000 7f87395f7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97ef00 0x55e47a984290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:39.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.157+0000 7f87395f7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a97fa60 0x55e47a9847d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:39.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.157+0000 7f87395f7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a9803c0 0x55e47a990f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:39.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.157+0000 7f87395f7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47a7518c0 con 0x55e47a97ef00 2023-10-16T13:14:39.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.157+0000 7f87395f7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47a94dbb0 con 0x55e47a97fa60 2023-10-16T13:14:39.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.157+0000 7f87395f7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47a97ecc0 con 0x55e47a9803c0 2023-10-16T13:14:39.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.157+0000 7f8726ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97ef00 0x55e47a984290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:39.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.157+0000 7f8726ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97ef00 0x55e47a984290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38008/0 (socket says 172.21.15.92:38008) 2023-10-16T13:14:39.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.157+0000 7f8726ffd700 1 -- 172.21.15.92:0/1906787352 learned_addr learned my addr 172.21.15.92:0/1906787352 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:39.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.157+0000 7f87277fe700 1 --2- 172.21.15.92:0/1906787352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a9803c0 0x55e47a990f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:39.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.157+0000 7f87267fc700 1 --2- 172.21.15.92:0/1906787352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a97fa60 0x55e47a9847d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:39.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.157+0000 7f8726ffd700 1 -- 172.21.15.92:0/1906787352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a9803c0 msgr2=0x55e47a990f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:39.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.157+0000 7f8726ffd700 1 --2- 172.21.15.92:0/1906787352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a9803c0 0x55e47a990f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.157+0000 7f8726ffd700 1 -- 172.21.15.92:0/1906787352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a97fa60 msgr2=0x55e47a9847d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:39.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.157+0000 7f8726ffd700 1 --2- 172.21.15.92:0/1906787352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a97fa60 0x55e47a9847d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.157+0000 7f8726ffd700 1 -- 172.21.15.92:0/1906787352 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e47a6fbd80 con 0x55e47a97ef00 2023-10-16T13:14:39.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.157+0000 7f8726ffd700 1 --2- 172.21.15.92:0/1906787352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97ef00 0x55e47a984290 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f871c099fb0 tx=0x7f871c0cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f929e85a7a7c16 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:39.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.158+0000 7f870dffb700 1 -- 172.21.15.92:0/1906787352 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c099930 con 0x55e47a97ef00 2023-10-16T13:14:39.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.158+0000 7f870dffb700 1 -- 172.21.15.92:0/1906787352 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f871c099520 con 0x55e47a97ef00 2023-10-16T13:14:39.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.158+0000 7f870dffb700 1 -- 172.21.15.92:0/1906787352 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c0a1f50 con 0x55e47a97ef00 2023-10-16T13:14:39.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.158+0000 7f87395f7b80 1 -- 172.21.15.92:0/1906787352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97ef00 msgr2=0x55e47a984290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:39.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.158+0000 7f87395f7b80 1 --2- 172.21.15.92:0/1906787352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97ef00 0x55e47a984290 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f871c099fb0 tx=0x7f871c0cc040 comp rx=0 tx=0).stop 2023-10-16T13:14:39.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.158+0000 7f87395f7b80 1 -- 172.21.15.92:0/1906787352 shutdown_connections 2023-10-16T13:14:39.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.158+0000 7f87395f7b80 1 --2- 172.21.15.92:0/1906787352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97ef00 0x55e47a984290 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.158+0000 7f87395f7b80 1 --2- 172.21.15.92:0/1906787352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a9803c0 0x55e47a990f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.158+0000 7f87395f7b80 1 --2- 172.21.15.92:0/1906787352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a97fa60 0x55e47a9847d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.158+0000 7f87395f7b80 1 -- 172.21.15.92:0/1906787352 >> 172.21.15.92:0/1906787352 conn(0x55e47a8abd70 msgr2=0x55e47a9885b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:39.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.158+0000 7f87395f7b80 1 -- 172.21.15.92:0/1906787352 shutdown_connections 2023-10-16T13:14:39.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.158+0000 7f87395f7b80 1 -- 172.21.15.92:0/1906787352 wait complete. 2023-10-16T13:14:39.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.159+0000 7f87395f7b80 1 -- start start 2023-10-16T13:14:39.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.159+0000 7f87395f7b80 1 Processor -- start 2023-10-16T13:14:39.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.159+0000 7f87395f7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97ef00 0x55e47a98e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:39.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.159+0000 7f87395f7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a97fa60 0x55e47a98eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.159+0000 7f87395f7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a9803c0 0x55e47a98fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.159+0000 7f87395f7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47a990060 con 0x55e47a97ef00 2023-10-16T13:14:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.159+0000 7f87395f7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47a9901d0 con 0x55e47a9803c0 2023-10-16T13:14:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.159+0000 7f87395f7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47a990390 con 0x55e47a97fa60 2023-10-16T13:14:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.159+0000 7f87395f7b80 10 client.0 _ll_register_callbacks cb 0x7f87200094e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.159+0000 7f8726ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97ef00 0x55e47a98e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.159+0000 7f8726ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97ef00 0x55e47a98e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38014/0 (socket says 172.21.15.92:38014) 2023-10-16T13:14:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.159+0000 7f8726ffd700 1 -- 172.21.15.92:0/3285291594 learned_addr learned my addr 172.21.15.92:0/3285291594 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.159+0000 7f87267fc700 1 --2- 172.21.15.92:0/3285291594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a97fa60 0x55e47a98eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.159+0000 7f87277fe700 1 --2- 172.21.15.92:0/3285291594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a9803c0 0x55e47a98fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.159+0000 7f8726ffd700 1 -- 172.21.15.92:0/3285291594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a97fa60 msgr2=0x55e47a98eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.159+0000 7f8726ffd700 1 --2- 172.21.15.92:0/3285291594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a97fa60 0x55e47a98eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.159+0000 7f8726ffd700 1 -- 172.21.15.92:0/3285291594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a9803c0 msgr2=0x55e47a98fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.159+0000 7f8726ffd700 1 --2- 172.21.15.92:0/3285291594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a9803c0 0x55e47a98fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.159+0000 7f8726ffd700 1 -- 172.21.15.92:0/3285291594 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e47a88e390 con 0x55e47a97ef00 2023-10-16T13:14:39.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.160+0000 7f8726ffd700 1 --2- 172.21.15.92:0/3285291594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97ef00 0x55e47a98e5d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f871c099d80 tx=0x7f871c09a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba41902d63ea20 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:39.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.160+0000 7f870aff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:39.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.160+0000 7f870aff5700 1 -- 172.21.15.92:0/3285291594 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c0993c0 con 0x55e47a97ef00 2023-10-16T13:14:39.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.160+0000 7f87395f7b80 1 -- 172.21.15.92:0/3285291594 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f871c09df40 con 0x55e47a97ef00 2023-10-16T13:14:39.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.160+0000 7f870aff5700 1 -- 172.21.15.92:0/3285291594 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f871c0a1cf0 con 0x55e47a97ef00 2023-10-16T13:14:39.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.160+0000 7f870aff5700 1 -- 172.21.15.92:0/3285291594 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f871c099930 con 0x55e47a97ef00 2023-10-16T13:14:39.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.160+0000 7f87395f7b80 10 client.15870 fetch_fsmap learned FSMap version 33 2023-10-16T13:14:39.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.160+0000 7f87395f7b80 1 -- 172.21.15.92:0/3285291594 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55e47a6e4c00 con 0x55e47a97ef00 2023-10-16T13:14:39.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.160+0000 7f870aff5700 1 -- 172.21.15.92:0/3285291594 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f871c09df40 con 0x55e47a97ef00 2023-10-16T13:14:39.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.160+0000 7f870aff5700 1 -- 172.21.15.92:0/3285291594 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 33) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f871c098f50 con 0x55e47a97ef00 2023-10-16T13:14:39.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.160+0000 7f87395f7b80 10 client.15870 fetch_fsmap finished waiting for FSMap version 33 2023-10-16T13:14:39.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.160+0000 7f87395f7b80 10 client.15870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.160+0000 7f87395f7b80 20 client.15870 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.160+0000 7f87395f7b80 1 --2- 172.21.15.92:0/3285291594 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e47a9812b0 0x55e47a9e9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.160+0000 7f87395f7b80 4 client.15870 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-16T13:14:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.160+0000 7f87395f7b80 1 -- 172.21.15.92:0/3285291594 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e47a8c9df0 con 0x55e47a9812b0 2023-10-16T13:14:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.160+0000 7f87267fc700 1 --2- 172.21.15.92:0/3285291594 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e47a9812b0 0x55e47a9e9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.161+0000 7f87267fc700 1 --2- 172.21.15.92:0/3285291594 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e47a9812b0 0x55e47a9e9a60 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e7061582e4d827e server_cookie=13f6dc57181c8c47 in_seq=0 out_seq=0 2023-10-16T13:14:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.161+0000 7f870aff5700 10 client.15870 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.269+0000 7f870aff5700 1 -- 172.21.15.92:0/3285291594 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e47a8c9df0 con 0x55e47a9812b0 2023-10-16T13:14:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.269+0000 7f870aff5700 10 client.15870 handle_command_reply: tid=0 2023-10-16T13:14:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.269+0000 7f87395f7b80 1 client.15870 shutdown 2023-10-16T13:14:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.270+0000 7f87395f7b80 1 -- 172.21.15.92:0/3285291594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97ef00 msgr2=0x55e47a98e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.270+0000 7f87395f7b80 1 --2- 172.21.15.92:0/3285291594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97ef00 0x55e47a98e5d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f871c099d80 tx=0x7f871c09a5d0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.270+0000 7f87395f7b80 1 -- 172.21.15.92:0/3285291594 shutdown_connections 2023-10-16T13:14:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.270+0000 7f87395f7b80 1 --2- 172.21.15.92:0/3285291594 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e47a9812b0 0x55e47a9e9a60 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.270+0000 7f87395f7b80 1 --2- 172.21.15.92:0/3285291594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e47a97ef00 0x55e47a98e5d0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.270+0000 7f87395f7b80 1 --2- 172.21.15.92:0/3285291594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e47a9803c0 0x55e47a98fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.270+0000 7f87395f7b80 1 --2- 172.21.15.92:0/3285291594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47a97fa60 0x55e47a98eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.270+0000 7f870aff5700 0 client.15870 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.270+0000 7f87395f7b80 1 -- 172.21.15.92:0/3285291594 >> 172.21.15.92:0/3285291594 conn(0x55e47a8abd70 msgr2=0x55e47a9885b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.270+0000 7f87395f7b80 1 -- 172.21.15.92:0/3285291594 shutdown_connections 2023-10-16T13:14:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.270+0000 7f87395f7b80 1 -- 172.21.15.92:0/3285291594 wait complete. 2023-10-16T13:14:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.270+0000 7f87395f7b80 20 client.15870 trim_cache size 0 max 16384 2023-10-16T13:14:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2023-10-16T13:14:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2023-10-16T13:14:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2023-10-16T13:14:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2023-10-16T13:14:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.271+0000 7f872d40d700 1 -- 172.21.15.92:0/2935674070 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f87100a1480 msgr2=0x7f87100a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.271+0000 7f872d40d700 1 --2- 172.21.15.92:0/2935674070 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f87100a1480 0x7f87100a3940 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f871800ac50 tx=0x7f871800a380 comp rx=0 tx=0).stop 2023-10-16T13:14:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.271+0000 7f872d40d700 1 -- 172.21.15.92:0/2935674070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8728100040 msgr2=0x7f8728195d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.271+0000 7f872d40d700 1 --2- 172.21.15.92:0/2935674070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8728100040 0x7f8728195d80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f871c00d980 tx=0x7f871c00dc90 comp rx=0 tx=0).stop 2023-10-16T13:14:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.271+0000 7f872d40d700 1 -- 172.21.15.92:0/2935674070 shutdown_connections 2023-10-16T13:14:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.271+0000 7f872d40d700 1 --2- 172.21.15.92:0/2935674070 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f87100a1480 0x7f87100a3940 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.271+0000 7f872d40d700 1 --2- 172.21.15.92:0/2935674070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8728100040 0x7f8728195d80 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.271+0000 7f872d40d700 1 --2- 172.21.15.92:0/2935674070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87281013f0 0x7f8728197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.271+0000 7f872d40d700 1 --2- 172.21.15.92:0/2935674070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8728100a00 0x7f87281962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.271+0000 7f872d40d700 1 -- 172.21.15.92:0/2935674070 >> 172.21.15.92:0/2935674070 conn(0x7f87280fab50 msgr2=0x7f87281043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.271+0000 7f872d40d700 1 -- 172.21.15.92:0/2935674070 shutdown_connections 2023-10-16T13:14:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:39.271+0000 7f872d40d700 1 -- 172.21.15.92:0/2935674070 wait complete. 2023-10-16T13:14:39.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:39 smithi152 ceph-mon[104423]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:39.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:39 smithi092 ceph-mon[99542]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:40.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:39 smithi118 ceph-mon[103969]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:40.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:40 smithi152 ceph-mon[104423]: pgmap v347: 97 pgs: 97 active+clean; 147 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.7 MiB/s wr, 1.51k op/s 2023-10-16T13:14:40.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:40 smithi092 ceph-mon[99542]: pgmap v347: 97 pgs: 97 active+clean; 147 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.7 MiB/s wr, 1.51k op/s 2023-10-16T13:14:41.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:40 smithi118 ceph-mon[103969]: pgmap v347: 97 pgs: 97 active+clean; 147 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.7 MiB/s wr, 1.51k op/s 2023-10-16T13:14:41.590 INFO:tasks.workunit.client.0.smithi092.stderr:+ tar xf doc.tar 2023-10-16T13:14:42.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:42 smithi152 ceph-mon[104423]: pgmap v348: 97 pgs: 97 active+clean; 139 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 965 op/s 2023-10-16T13:14:42.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:42 smithi092 ceph-mon[99542]: pgmap v348: 97 pgs: 97 active+clean; 139 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 965 op/s 2023-10-16T13:14:43.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:42 smithi118 ceph-mon[103969]: pgmap v348: 97 pgs: 97 active+clean; 139 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 965 op/s 2023-10-16T13:14:43.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:43 smithi152 ceph-mon[104423]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:43.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:43 smithi092 ceph-mon[99542]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:44.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:43 smithi118 ceph-mon[103969]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:44.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:44 smithi152 ceph-mon[104423]: pgmap v349: 97 pgs: 97 active+clean; 120 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 643 op/s 2023-10-16T13:14:44.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:44 smithi152 ceph-mon[104423]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:44.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:44 smithi092 ceph-mon[99542]: pgmap v349: 97 pgs: 97 active+clean; 120 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 643 op/s 2023-10-16T13:14:44.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:44 smithi092 ceph-mon[99542]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:45.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:44 smithi118 ceph-mon[103969]: pgmap v349: 97 pgs: 97 active+clean; 120 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 643 op/s 2023-10-16T13:14:45.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:44 smithi118 ceph-mon[103969]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:14:45.446 INFO:tasks.workunit.client.0.smithi092.stderr:+ sync 2023-10-16T13:14:46.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:46 smithi152 ceph-mon[104423]: pgmap v350: 97 pgs: 97 active+clean; 124 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 427 op/s 2023-10-16T13:14:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:46 smithi092 ceph-mon[99542]: pgmap v350: 97 pgs: 97 active+clean; 124 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 427 op/s 2023-10-16T13:14:46.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:46 smithi118 ceph-mon[103969]: pgmap v350: 97 pgs: 97 active+clean; 124 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 427 op/s 2023-10-16T13:14:47.596 INFO:tasks.workunit.client.0.smithi092.stderr:+ tar c linux-4.0.5 2023-10-16T13:14:47.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:47 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:14:47.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:47 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:14:47.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:47 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:14:48.088 INFO:tasks.workunit.client.0.smithi092.stderr:+ echo Ok 2023-10-16T13:14:48.089 INFO:tasks.workunit.client.0.smithi092.stdout:Ok 2023-10-16T13:14:48.090 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-16T13:14:48.090 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-16T13:14:48.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:48 smithi092 ceph-mon[99542]: pgmap v351: 97 pgs: 97 active+clean; 133 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 539 op/s 2023-10-16T13:14:48.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:48 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:14:48.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:48 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:14:48.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:48 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:14:48.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:48 smithi152 ceph-mon[104423]: pgmap v351: 97 pgs: 97 active+clean; 133 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 539 op/s 2023-10-16T13:14:48.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:48 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:14:48.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:48 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:14:48.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:48 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:14:48.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:48 smithi118 ceph-mon[103969]: pgmap v351: 97 pgs: 97 active+clean; 133 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 539 op/s 2023-10-16T13:14:48.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:48 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-16T13:14:48.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:48 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-16T13:14:48.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:48 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' 2023-10-16T13:14:50.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:50 smithi152 ceph-mon[104423]: pgmap v352: 97 pgs: 97 active+clean; 148 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 589 op/s 2023-10-16T13:14:50.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:50 smithi092 ceph-mon[99542]: pgmap v352: 97 pgs: 97 active+clean; 148 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 589 op/s 2023-10-16T13:14:50.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:50 smithi118 ceph-mon[103969]: pgmap v352: 97 pgs: 97 active+clean; 148 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 589 op/s 2023-10-16T13:14:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.387+0000 7f534c362700 1 -- 172.21.15.92:0/4129254164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5344100fe0 msgr2=0x7f5344101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.387+0000 7f534c362700 1 --2- 172.21.15.92:0/4129254164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5344100fe0 0x7f5344101440 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f53400099c0 tx=0x7f5340009cd0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.387+0000 7f534c362700 1 -- 172.21.15.92:0/4129254164 shutdown_connections 2023-10-16T13:14:52.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.387+0000 7f534c362700 1 --2- 172.21.15.92:0/4129254164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5344101980 0x7f5344108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.387+0000 7f534c362700 1 --2- 172.21.15.92:0/4129254164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53440ffdf0 0x7f5344100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.387+0000 7f534c362700 1 --2- 172.21.15.92:0/4129254164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5344100fe0 0x7f5344101440 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.387+0000 7f534c362700 1 -- 172.21.15.92:0/4129254164 >> 172.21.15.92:0/4129254164 conn(0x7f53440fb340 msgr2=0x7f53440fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:52.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.387+0000 7f534c362700 1 -- 172.21.15.92:0/4129254164 shutdown_connections 2023-10-16T13:14:52.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.387+0000 7f534c362700 1 -- 172.21.15.92:0/4129254164 wait complete. 2023-10-16T13:14:52.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.387+0000 7f534c362700 1 Processor -- start 2023-10-16T13:14:52.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f534c362700 1 -- start start 2023-10-16T13:14:52.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f534c362700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53440ffdf0 0x7f5344196de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:52.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f534c362700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5344100fe0 0x7f5344197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:52.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f534c362700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5344101980 0x7f53441980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:52.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f534c362700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53441987d0 con 0x7f5344100fe0 2023-10-16T13:14:52.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f534c362700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5344198940 con 0x7f5344101980 2023-10-16T13:14:52.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f534c362700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5344198b00 con 0x7f53440ffdf0 2023-10-16T13:14:52.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f53498fd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5344100fe0 0x7f5344197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:52.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f53498fd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5344100fe0 0x7f5344197320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38030/0 (socket says 172.21.15.92:38030) 2023-10-16T13:14:52.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f53498fd700 1 -- 172.21.15.92:0/4133299197 learned_addr learned my addr 172.21.15.92:0/4133299197 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:52.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f534a8ff700 1 --2- 172.21.15.92:0/4133299197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5344101980 0x7f53441980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:52.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f534a0fe700 1 --2- 172.21.15.92:0/4133299197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53440ffdf0 0x7f5344196de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:52.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f53498fd700 1 -- 172.21.15.92:0/4133299197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53440ffdf0 msgr2=0x7f5344196de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:52.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f53498fd700 1 --2- 172.21.15.92:0/4133299197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53440ffdf0 0x7f5344196de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f53498fd700 1 -- 172.21.15.92:0/4133299197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5344101980 msgr2=0x7f53441980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:52.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f53498fd700 1 --2- 172.21.15.92:0/4133299197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5344101980 0x7f53441980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f53498fd700 1 -- 172.21.15.92:0/4133299197 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53400095f0 con 0x7f5344100fe0 2023-10-16T13:14:52.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f534a8ff700 1 --2- 172.21.15.92:0/4133299197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5344101980 0x7f53441980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:14:52.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f53498fd700 1 --2- 172.21.15.92:0/4133299197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5344100fe0 0x7f5344197320 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5340009990 tx=0x7f534000f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:52.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f533b7fe700 1 -- 172.21.15.92:0/4133299197 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534001d070 con 0x7f5344100fe0 2023-10-16T13:14:52.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f533b7fe700 1 -- 172.21.15.92:0/4133299197 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5340005530 con 0x7f5344100fe0 2023-10-16T13:14:52.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f534c362700 1 -- 172.21.15.92:0/4133299197 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5344198d80 con 0x7f5344100fe0 2023-10-16T13:14:52.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.388+0000 7f533b7fe700 1 -- 172.21.15.92:0/4133299197 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340004c30 con 0x7f5344100fe0 2023-10-16T13:14:52.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.389+0000 7f534c362700 1 -- 172.21.15.92:0/4133299197 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534419f520 con 0x7f5344100fe0 2023-10-16T13:14:52.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.390+0000 7f533b7fe700 1 -- 172.21.15.92:0/4133299197 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f534000fc30 con 0x7f5344100fe0 2023-10-16T13:14:52.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.391+0000 7f533b7fe700 1 --2- 172.21.15.92:0/4133299197 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f53300a1480 0x7f53300a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:52.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.391+0000 7f534a0fe700 1 --2- 172.21.15.92:0/4133299197 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f53300a1480 0x7f53300a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:52.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.391+0000 7f533b7fe700 1 -- 172.21.15.92:0/4133299197 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f53400cdc90 con 0x7f5344100fe0 2023-10-16T13:14:52.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.392+0000 7f534a0fe700 1 --2- 172.21.15.92:0/4133299197 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f53300a1480 0x7f53300a3940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5344197b80 tx=0x7f5334009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:52.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.392+0000 7f535854cb80 1 Processor -- start 2023-10-16T13:14:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.392+0000 7f535854cb80 1 -- start start 2023-10-16T13:14:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f535854cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e97a913850 0x55e97a913c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f535854cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e97a9141b0 0x55e97a914ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f535854cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a9150a0 0x55e97a915520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f535854cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97a888c10 con 0x55e97a9150a0 2023-10-16T13:14:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f535854cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97a86dc00 con 0x55e97a9141b0 2023-10-16T13:14:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f535854cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97a86b520 con 0x55e97a913850 2023-10-16T13:14:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f534a8ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a9150a0 0x55e97a915520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f534a8ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a9150a0 0x55e97a915520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38040/0 (socket says 172.21.15.92:38040) 2023-10-16T13:14:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f534a8ff700 1 -- 172.21.15.92:0/2098263136 learned_addr learned my addr 172.21.15.92:0/2098263136 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f53498fd700 1 --2- 172.21.15.92:0/2098263136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e97a9141b0 0x55e97a914ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f534a0fe700 1 --2- 172.21.15.92:0/2098263136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e97a913850 0x55e97a913c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f534a8ff700 1 -- 172.21.15.92:0/2098263136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e97a913850 msgr2=0x55e97a913c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f534a8ff700 1 --2- 172.21.15.92:0/2098263136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e97a913850 0x55e97a913c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f534a8ff700 1 -- 172.21.15.92:0/2098263136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e97a9141b0 msgr2=0x55e97a914ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f534a8ff700 1 --2- 172.21.15.92:0/2098263136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e97a9141b0 0x55e97a914ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f534a8ff700 1 -- 172.21.15.92:0/2098263136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e97a824390 con 0x55e97a9150a0 2023-10-16T13:14:52.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f53498fd700 1 --2- 172.21.15.92:0/2098263136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e97a9141b0 0x55e97a914ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:14:52.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f534a8ff700 1 --2- 172.21.15.92:0/2098263136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a9150a0 0x55e97a915520 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f533c009d50 tx=0x7f533c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b84c61ce5c3c19 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:52.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f5338d82700 1 -- 172.21.15.92:0/2098263136 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c014600 con 0x55e97a9150a0 2023-10-16T13:14:52.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f5338d82700 1 -- 172.21.15.92:0/2098263136 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f533c014c40 con 0x55e97a9150a0 2023-10-16T13:14:52.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.393+0000 7f5338d82700 1 -- 172.21.15.92:0/2098263136 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c013bb0 con 0x55e97a9150a0 2023-10-16T13:14:52.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.394+0000 7f535854cb80 1 -- 172.21.15.92:0/2098263136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a9150a0 msgr2=0x55e97a915520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:52.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.394+0000 7f535854cb80 1 --2- 172.21.15.92:0/2098263136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a9150a0 0x55e97a915520 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f533c009d50 tx=0x7f533c0077e0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.394+0000 7f535854cb80 1 -- 172.21.15.92:0/2098263136 shutdown_connections 2023-10-16T13:14:52.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.394+0000 7f535854cb80 1 --2- 172.21.15.92:0/2098263136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a9150a0 0x55e97a915520 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.394+0000 7f535854cb80 1 --2- 172.21.15.92:0/2098263136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e97a913850 0x55e97a913c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.394+0000 7f535854cb80 1 --2- 172.21.15.92:0/2098263136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e97a9141b0 0x55e97a914ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.394+0000 7f535854cb80 1 -- 172.21.15.92:0/2098263136 >> 172.21.15.92:0/2098263136 conn(0x55e97a841d70 msgr2=0x55e97a90ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.394+0000 7f535854cb80 1 -- 172.21.15.92:0/2098263136 shutdown_connections 2023-10-16T13:14:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.394+0000 7f535854cb80 1 -- 172.21.15.92:0/2098263136 wait complete. 2023-10-16T13:14:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.394+0000 7f535854cb80 1 -- start start 2023-10-16T13:14:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f535854cb80 1 Processor -- start 2023-10-16T13:14:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f535854cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a913850 0x55e97a91d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f535854cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e97a9141b0 0x55e97a91dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f535854cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e97a9150a0 0x55e97a924cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f535854cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97a866e10 con 0x55e97a913850 2023-10-16T13:14:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f535854cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97a8036b0 con 0x55e97a9150a0 2023-10-16T13:14:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f535854cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97a803350 con 0x55e97a9141b0 2023-10-16T13:14:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f535854cb80 10 client.0 _ll_register_callbacks cb 0x55e97a6607a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f534a0fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a913850 0x55e97a91d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f534a0fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a913850 0x55e97a91d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38042/0 (socket says 172.21.15.92:38042) 2023-10-16T13:14:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f534a0fe700 1 -- 172.21.15.92:0/893418015 learned_addr learned my addr 172.21.15.92:0/893418015 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f53498fd700 1 --2- 172.21.15.92:0/893418015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e97a9141b0 0x55e97a91dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f534a0fe700 1 -- 172.21.15.92:0/893418015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e97a9141b0 msgr2=0x55e97a91dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f534a0fe700 1 --2- 172.21.15.92:0/893418015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e97a9141b0 0x55e97a91dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f534a0fe700 1 -- 172.21.15.92:0/893418015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e97a9150a0 msgr2=0x55e97a924cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f534a0fe700 1 --2- 172.21.15.92:0/893418015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e97a9150a0 0x55e97a924cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f534a0fe700 1 -- 172.21.15.92:0/893418015 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533c009980 con 0x55e97a913850 2023-10-16T13:14:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f534a0fe700 1 --2- 172.21.15.92:0/893418015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a913850 0x55e97a91d750 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f5334010db0 tx=0x7f53340047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8324e18dcacde1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f532dffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f532dffb700 1 -- 172.21.15.92:0/893418015 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533401f620 con 0x55e97a913850 2023-10-16T13:14:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f535854cb80 1 -- 172.21.15.92:0/893418015 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e97a86be90 con 0x55e97a913850 2023-10-16T13:14:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.395+0000 7f532dffb700 1 -- 172.21.15.92:0/893418015 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f533401f780 con 0x55e97a913850 2023-10-16T13:14:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.396+0000 7f532dffb700 1 -- 172.21.15.92:0/893418015 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5334012e80 con 0x55e97a913850 2023-10-16T13:14:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.396+0000 7f535854cb80 10 client.15882 fetch_fsmap learned FSMap version 35 2023-10-16T13:14:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.396+0000 7f535854cb80 1 -- 172.21.15.92:0/893418015 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55e97a691d80 con 0x55e97a913850 2023-10-16T13:14:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.396+0000 7f532dffb700 1 -- 172.21.15.92:0/893418015 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55e97a86be90 con 0x55e97a913850 2023-10-16T13:14:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.396+0000 7f532dffb700 1 -- 172.21.15.92:0/893418015 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 35) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f5334025020 con 0x55e97a913850 2023-10-16T13:14:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.396+0000 7f535854cb80 10 client.15882 fetch_fsmap finished waiting for FSMap version 35 2023-10-16T13:14:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.396+0000 7f535854cb80 10 client.15882 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.396+0000 7f535854cb80 20 client.15882 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.396+0000 7f535854cb80 1 --2- 172.21.15.92:0/893418015 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e97a929620 0x55e97a92ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.396+0000 7f535854cb80 4 client.15882 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:14:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.396+0000 7f535854cb80 1 -- 172.21.15.92:0/893418015 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e97a8e3bb0 con 0x55e97a929620 2023-10-16T13:14:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.396+0000 7f53498fd700 1 --2- 172.21.15.92:0/893418015 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e97a929620 0x55e97a92ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.397+0000 7f53498fd700 1 --2- 172.21.15.92:0/893418015 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e97a929620 0x55e97a92ba40 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d05a7a1a06a5ffb9 server_cookie=a9eddb4cd5fc451b in_seq=0 out_seq=0 2023-10-16T13:14:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.397+0000 7f532dffb700 10 client.15882 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.397+0000 7f532dffb700 1 -- 172.21.15.92:0/893418015 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e97a8e3bb0 con 0x55e97a929620 2023-10-16T13:14:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.397+0000 7f532dffb700 10 client.15882 handle_command_reply: tid=0 2023-10-16T13:14:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.397+0000 7f535854cb80 1 client.15882 shutdown 2023-10-16T13:14:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.397+0000 7f535854cb80 1 -- 172.21.15.92:0/893418015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a913850 msgr2=0x55e97a91d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.397+0000 7f535854cb80 1 --2- 172.21.15.92:0/893418015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a913850 0x55e97a91d750 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f5334010db0 tx=0x7f53340047c0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.397+0000 7f535854cb80 1 -- 172.21.15.92:0/893418015 shutdown_connections 2023-10-16T13:14:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.397+0000 7f535854cb80 1 --2- 172.21.15.92:0/893418015 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e97a929620 0x55e97a92ba40 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.398+0000 7f535854cb80 1 --2- 172.21.15.92:0/893418015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a913850 0x55e97a91d750 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.398+0000 7f532dffb700 0 client.15882 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.398+0000 7f535854cb80 1 --2- 172.21.15.92:0/893418015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e97a9150a0 0x55e97a924cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.398+0000 7f535854cb80 1 --2- 172.21.15.92:0/893418015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e97a9141b0 0x55e97a91dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.398+0000 7f535854cb80 1 -- 172.21.15.92:0/893418015 >> 172.21.15.92:0/893418015 conn(0x55e97a841d70 msgr2=0x55e97a90e830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.398+0000 7f535854cb80 1 -- 172.21.15.92:0/893418015 shutdown_connections 2023-10-16T13:14:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.398+0000 7f535854cb80 1 -- 172.21.15.92:0/893418015 wait complete. 2023-10-16T13:14:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.398+0000 7f535854cb80 20 client.15882 trim_cache size 0 max 16384 2023-10-16T13:14:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.412+0000 7f535854cb80 1 Processor -- start 2023-10-16T13:14:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.412+0000 7f535854cb80 1 -- start start 2023-10-16T13:14:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.412+0000 7f535854cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a913850 0x55e97a913c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.412+0000 7f535854cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e97a9141b0 0x55e97a924c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:52.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.412+0000 7f535854cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e97a9150a0 0x55e97a91c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:52.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.413+0000 7f535854cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97a6e78c0 con 0x55e97a913850 2023-10-16T13:14:52.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.413+0000 7f535854cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97a910a60 con 0x55e97a9150a0 2023-10-16T13:14:52.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.413+0000 7f535854cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97a91d2c0 con 0x55e97a9141b0 2023-10-16T13:14:52.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.413+0000 7f534a0fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a913850 0x55e97a913c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.413+0000 7f534a0fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a913850 0x55e97a913c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38050/0 (socket says 172.21.15.92:38050) 2023-10-16T13:14:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.413+0000 7f534a0fe700 1 -- 172.21.15.92:0/812052882 learned_addr learned my addr 172.21.15.92:0/812052882 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.413+0000 7f534a0fe700 1 -- 172.21.15.92:0/812052882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e97a9141b0 msgr2=0x55e97a924c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.413+0000 7f534a0fe700 1 --2- 172.21.15.92:0/812052882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e97a9141b0 0x55e97a924c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.413+0000 7f534a0fe700 1 -- 172.21.15.92:0/812052882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e97a9150a0 msgr2=0x55e97a91c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.413+0000 7f534a0fe700 1 --2- 172.21.15.92:0/812052882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e97a9150a0 0x55e97a91c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.413+0000 7f534a0fe700 1 -- 172.21.15.92:0/812052882 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e97a67ac00 con 0x55e97a913850 2023-10-16T13:14:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.413+0000 7f534a0fe700 1 --2- 172.21.15.92:0/812052882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a913850 0x55e97a913c30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5334011aa0 tx=0x7f5334009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21774acb37c2254e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.413+0000 7f5339583700 1 -- 172.21.15.92:0/812052882 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5334011e90 con 0x55e97a913850 2023-10-16T13:14:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.413+0000 7f5339583700 1 -- 172.21.15.92:0/812052882 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f533402d030 con 0x55e97a913850 2023-10-16T13:14:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.413+0000 7f5339583700 1 -- 172.21.15.92:0/812052882 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5334004a90 con 0x55e97a913850 2023-10-16T13:14:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f535854cb80 1 -- 172.21.15.92:0/812052882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a913850 msgr2=0x55e97a913c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f535854cb80 1 --2- 172.21.15.92:0/812052882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a913850 0x55e97a913c30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5334011aa0 tx=0x7f5334009940 comp rx=0 tx=0).stop 2023-10-16T13:14:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f535854cb80 1 -- 172.21.15.92:0/812052882 shutdown_connections 2023-10-16T13:14:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f535854cb80 1 --2- 172.21.15.92:0/812052882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a913850 0x55e97a913c30 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f535854cb80 1 --2- 172.21.15.92:0/812052882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e97a9150a0 0x55e97a91c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f535854cb80 1 --2- 172.21.15.92:0/812052882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e97a9141b0 0x55e97a924c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f535854cb80 1 -- 172.21.15.92:0/812052882 >> 172.21.15.92:0/812052882 conn(0x55e97a841d70 msgr2=0x55e97a91b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f535854cb80 1 -- 172.21.15.92:0/812052882 shutdown_connections 2023-10-16T13:14:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f535854cb80 1 -- 172.21.15.92:0/812052882 wait complete. 2023-10-16T13:14:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f535854cb80 1 -- start start 2023-10-16T13:14:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f535854cb80 1 Processor -- start 2023-10-16T13:14:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f535854cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e97a913850 0x55e97a922b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f535854cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e97a9141b0 0x55e97a9230a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f535854cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a9150a0 0x55e97a9240b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f535854cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97a9245f0 con 0x55e97a9150a0 2023-10-16T13:14:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f535854cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97a924760 con 0x55e97a913850 2023-10-16T13:14:52.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f535854cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97a924920 con 0x55e97a9141b0 2023-10-16T13:14:52.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f535854cb80 10 client.0 _ll_register_callbacks cb 0x7f5334010960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:52.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f534a8ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a9150a0 0x55e97a9240b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:52.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f534a8ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a9150a0 0x55e97a9240b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38060/0 (socket says 172.21.15.92:38060) 2023-10-16T13:14:52.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.414+0000 7f534a8ff700 1 -- 172.21.15.92:0/2167634280 learned_addr learned my addr 172.21.15.92:0/2167634280 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:52.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.415+0000 7f534a0fe700 1 --2- 172.21.15.92:0/2167634280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e97a913850 0x55e97a922b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:52.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.415+0000 7f53498fd700 1 --2- 172.21.15.92:0/2167634280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e97a9141b0 0x55e97a9230a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:52.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.415+0000 7f534a8ff700 1 -- 172.21.15.92:0/2167634280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e97a9141b0 msgr2=0x55e97a9230a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:52.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.415+0000 7f534a8ff700 1 --2- 172.21.15.92:0/2167634280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e97a9141b0 0x55e97a9230a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.415+0000 7f534a8ff700 1 -- 172.21.15.92:0/2167634280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e97a913850 msgr2=0x55e97a922b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:52.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.415+0000 7f534a8ff700 1 --2- 172.21.15.92:0/2167634280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e97a913850 0x55e97a922b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.415+0000 7f534a8ff700 1 -- 172.21.15.92:0/2167634280 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e97a691d80 con 0x55e97a9150a0 2023-10-16T13:14:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.415+0000 7f534a8ff700 1 --2- 172.21.15.92:0/2167634280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a9150a0 0x55e97a9240b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f533c007820 tx=0x7f533c004e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb388d940ece761 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.415+0000 7f532dffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.415+0000 7f532dffb700 1 -- 172.21.15.92:0/2167634280 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c006000 con 0x55e97a9150a0 2023-10-16T13:14:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.415+0000 7f532dffb700 1 -- 172.21.15.92:0/2167634280 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f533c014810 con 0x55e97a9150a0 2023-10-16T13:14:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.415+0000 7f535854cb80 1 -- 172.21.15.92:0/2167634280 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f533c014c40 con 0x55e97a9150a0 2023-10-16T13:14:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.415+0000 7f532dffb700 1 -- 172.21.15.92:0/2167634280 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f533c0149d0 con 0x55e97a9150a0 2023-10-16T13:14:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.415+0000 7f535854cb80 10 client.15888 fetch_fsmap learned FSMap version 35 2023-10-16T13:14:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.415+0000 7f535854cb80 1 -- 172.21.15.92:0/2167634280 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55e97a6b81f0 con 0x55e97a9150a0 2023-10-16T13:14:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.415+0000 7f532dffb700 1 -- 172.21.15.92:0/2167634280 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f533c014c40 con 0x55e97a9150a0 2023-10-16T13:14:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.415+0000 7f532dffb700 1 -- 172.21.15.92:0/2167634280 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 35) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f533c01d690 con 0x55e97a9150a0 2023-10-16T13:14:52.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.415+0000 7f535854cb80 10 client.15888 fetch_fsmap finished waiting for FSMap version 35 2023-10-16T13:14:52.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.416+0000 7f535854cb80 10 client.15888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:52.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.416+0000 7f535854cb80 20 client.15888 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:52.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.416+0000 7f535854cb80 1 --2- 172.21.15.92:0/2167634280 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e97a929620 0x55e97a9805f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:52.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.416+0000 7f535854cb80 4 client.15888 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-16T13:14:52.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.416+0000 7f535854cb80 1 -- 172.21.15.92:0/2167634280 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e97a85fdf0 con 0x55e97a929620 2023-10-16T13:14:52.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.416+0000 7f534a0fe700 1 --2- 172.21.15.92:0/2167634280 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e97a929620 0x55e97a9805f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:52.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.416+0000 7f532dffb700 10 client.15888 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:52.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:52.416+0000 7f534a0fe700 1 --2- 172.21.15.92:0/2167634280 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e97a929620 0x55e97a9805f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53000a850366752e server_cookie=50eab93e80a5e12a in_seq=0 out_seq=0 2023-10-16T13:14:52.694 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:52 smithi152 ceph-mon[104423]: pgmap v353: 97 pgs: 97 active+clean; 125 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 592 op/s 2023-10-16T13:14:52.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:52 smithi092 ceph-mon[99542]: pgmap v353: 97 pgs: 97 active+clean; 125 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 592 op/s 2023-10-16T13:14:52.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:52 smithi118 ceph-mon[103969]: pgmap v353: 97 pgs: 97 active+clean; 125 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 592 op/s 2023-10-16T13:14:53.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.261+0000 7f532dffb700 1 -- 172.21.15.92:0/2167634280 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e97a85fdf0 con 0x55e97a929620 2023-10-16T13:14:53.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.261+0000 7f532dffb700 10 client.15888 handle_command_reply: tid=0 2023-10-16T13:14:53.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.261+0000 7f535854cb80 1 client.15888 shutdown 2023-10-16T13:14:53.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.261+0000 7f535854cb80 1 -- 172.21.15.92:0/2167634280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a9150a0 msgr2=0x55e97a9240b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:53.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.261+0000 7f535854cb80 1 --2- 172.21.15.92:0/2167634280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a9150a0 0x55e97a9240b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f533c007820 tx=0x7f533c004e80 comp rx=0 tx=0).stop 2023-10-16T13:14:53.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.261+0000 7f535854cb80 1 -- 172.21.15.92:0/2167634280 shutdown_connections 2023-10-16T13:14:53.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.261+0000 7f535854cb80 1 --2- 172.21.15.92:0/2167634280 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x55e97a929620 0x55e97a9805f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.261+0000 7f535854cb80 1 --2- 172.21.15.92:0/2167634280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e97a9150a0 0x55e97a9240b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.261+0000 7f532dffb700 0 client.15888 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.261+0000 7f535854cb80 1 --2- 172.21.15.92:0/2167634280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e97a913850 0x55e97a922b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.261+0000 7f535854cb80 1 --2- 172.21.15.92:0/2167634280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e97a9141b0 0x55e97a9230a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.261+0000 7f535854cb80 1 -- 172.21.15.92:0/2167634280 >> 172.21.15.92:0/2167634280 conn(0x55e97a841d70 msgr2=0x55e97a91c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.261+0000 7f535854cb80 1 -- 172.21.15.92:0/2167634280 shutdown_connections 2023-10-16T13:14:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.261+0000 7f535854cb80 1 -- 172.21.15.92:0/2167634280 wait complete. 2023-10-16T13:14:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.261+0000 7f535854cb80 20 client.15888 trim_cache size 0 max 16384 2023-10-16T13:14:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2023-10-16T13:14:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2023-10-16T13:14:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2023-10-16T13:14:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2023-10-16T13:14:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.262+0000 7f534c362700 1 -- 172.21.15.92:0/4133299197 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f53300a1480 msgr2=0x7f53300a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.262+0000 7f534c362700 1 --2- 172.21.15.92:0/4133299197 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f53300a1480 0x7f53300a3940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5344197b80 tx=0x7f5334009260 comp rx=0 tx=0).stop 2023-10-16T13:14:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.262+0000 7f534c362700 1 -- 172.21.15.92:0/4133299197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5344100fe0 msgr2=0x7f5344197320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.262+0000 7f534c362700 1 --2- 172.21.15.92:0/4133299197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5344100fe0 0x7f5344197320 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5340009990 tx=0x7f534000f740 comp rx=0 tx=0).stop 2023-10-16T13:14:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.262+0000 7f534c362700 1 -- 172.21.15.92:0/4133299197 shutdown_connections 2023-10-16T13:14:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.262+0000 7f534c362700 1 --2- 172.21.15.92:0/4133299197 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f53300a1480 0x7f53300a3940 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.262+0000 7f534c362700 1 --2- 172.21.15.92:0/4133299197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5344101980 0x7f53441980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.262+0000 7f534c362700 1 --2- 172.21.15.92:0/4133299197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53440ffdf0 0x7f5344196de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.262+0000 7f534c362700 1 --2- 172.21.15.92:0/4133299197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5344100fe0 0x7f5344197320 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.262+0000 7f534c362700 1 -- 172.21.15.92:0/4133299197 >> 172.21.15.92:0/4133299197 conn(0x7f53440fb340 msgr2=0x7f53440fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.262+0000 7f534c362700 1 -- 172.21.15.92:0/4133299197 shutdown_connections 2023-10-16T13:14:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2023-10-16T13:14:53.262+0000 7f534c362700 1 -- 172.21.15.92:0/4133299197 wait complete. 2023-10-16T13:14:54.602 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-16T13:14:54.626 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:54 smithi092 ceph-mon[99542]: pgmap v354: 97 pgs: 97 active+clean; 58 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.8 MiB/s wr, 603 op/s 2023-10-16T13:14:54.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:54 smithi152 ceph-mon[104423]: pgmap v354: 97 pgs: 97 active+clean; 58 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.8 MiB/s wr, 603 op/s 2023-10-16T13:14:54.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.729+0000 7f100d3c3700 1 -- 172.21.15.92:0/3977231680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1008100060 msgr2=0x7f10081004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:54.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.729+0000 7f100d3c3700 1 --2- 172.21.15.92:0/3977231680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1008100060 0x7f10081004e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009990 tx=0x7f0ff8009ca0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.729+0000 7f100d3c3700 1 -- 172.21.15.92:0/3977231680 shutdown_connections 2023-10-16T13:14:54.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.729+0000 7f100d3c3700 1 --2- 172.21.15.92:0/3977231680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1008100a20 0x7f10081082c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.729+0000 7f100d3c3700 1 --2- 172.21.15.92:0/3977231680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10081013c0 0x7f10081017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.729+0000 7f100d3c3700 1 --2- 172.21.15.92:0/3977231680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1008100060 0x7f10081004e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.729+0000 7f100d3c3700 1 -- 172.21.15.92:0/3977231680 >> 172.21.15.92:0/3977231680 conn(0x7f10080faa90 msgr2=0x7f10080fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:54.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.729+0000 7f100d3c3700 1 -- 172.21.15.92:0/3977231680 shutdown_connections 2023-10-16T13:14:54.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.729+0000 7f100d3c3700 1 -- 172.21.15.92:0/3977231680 wait complete. 2023-10-16T13:14:54.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.730+0000 7f100d3c3700 1 Processor -- start 2023-10-16T13:14:54.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.730+0000 7f100d3c3700 1 -- start start 2023-10-16T13:14:54.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.730+0000 7f100d3c3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1008100060 0x7f10080ffac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.730+0000 7f100d3c3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1008100a20 0x7f100819ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.730+0000 7f100d3c3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10081013c0 0x7f100819e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.730+0000 7f100d3c3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100819e840 con 0x7f1008100060 2023-10-16T13:14:54.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.730+0000 7f100d3c3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100819e9b0 con 0x7f1008100a20 2023-10-16T13:14:54.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.730+0000 7f100d3c3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100819eb70 con 0x7f10081013c0 2023-10-16T13:14:54.737 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.730+0000 7f1006ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1008100060 0x7f10080ffac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.730+0000 7f1006ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1008100060 0x7f10080ffac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38070/0 (socket says 172.21.15.92:38070) 2023-10-16T13:14:54.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.730+0000 7f1006ffd700 1 -- 172.21.15.92:0/2074148624 learned_addr learned my addr 172.21.15.92:0/2074148624 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:54.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.730+0000 7f10067fc700 1 --2- 172.21.15.92:0/2074148624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1008100a20 0x7f100819ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.730+0000 7f10077fe700 1 --2- 172.21.15.92:0/2074148624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10081013c0 0x7f100819e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.730+0000 7f1006ffd700 1 -- 172.21.15.92:0/2074148624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10081013c0 msgr2=0x7f100819e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:54.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.730+0000 7f1006ffd700 1 --2- 172.21.15.92:0/2074148624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10081013c0 0x7f100819e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.730+0000 7f1006ffd700 1 -- 172.21.15.92:0/2074148624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1008100a20 msgr2=0x7f100819ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:54.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.730+0000 7f1006ffd700 1 --2- 172.21.15.92:0/2074148624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1008100a20 0x7f100819ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.731+0000 7f1006ffd700 1 -- 172.21.15.92:0/2074148624 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80095f0 con 0x7f1008100060 2023-10-16T13:14:54.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.731+0000 7f1006ffd700 1 --2- 172.21.15.92:0/2074148624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1008100060 0x7f10080ffac0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000d980 tx=0x7f0ff000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:54.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.731+0000 7f0ffffff700 1 -- 172.21.15.92:0/2074148624 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0004020 con 0x7f1008100060 2023-10-16T13:14:54.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.731+0000 7f100d3c3700 1 -- 172.21.15.92:0/2074148624 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100819ee50 con 0x7f1008100060 2023-10-16T13:14:54.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.731+0000 7f0ffffff700 1 -- 172.21.15.92:0/2074148624 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0ff000f690 con 0x7f1008100060 2023-10-16T13:14:54.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.731+0000 7f0ffffff700 1 -- 172.21.15.92:0/2074148624 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0003b40 con 0x7f1008100060 2023-10-16T13:14:54.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.731+0000 7f100d3c3700 1 -- 172.21.15.92:0/2074148624 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100819f280 con 0x7f1008100060 2023-10-16T13:14:54.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.734+0000 7f0ffffff700 1 -- 172.21.15.92:0/2074148624 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0ff000fb20 con 0x7f1008100060 2023-10-16T13:14:54.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.734+0000 7f0ffffff700 1 --2- 172.21.15.92:0/2074148624 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0ff40a1480 0x7f0ff40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.735+0000 7f10067fc700 1 --2- 172.21.15.92:0/2074148624 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0ff40a1480 0x7f0ff40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.735+0000 7f0ffffff700 1 -- 172.21.15.92:0/2074148624 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f0ff00cc030 con 0x7f1008100060 2023-10-16T13:14:54.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.735+0000 7f10067fc700 1 --2- 172.21.15.92:0/2074148624 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0ff40a1480 0x7f0ff40a3940 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8000c00 tx=0x7f0ff8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:54.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.735+0000 7f10195adb80 1 Processor -- start 2023-10-16T13:14:54.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.735+0000 7f10195adb80 1 -- start start 2023-10-16T13:14:54.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.735+0000 7f10195adb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aa230 0x5581ea9aa650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.735+0000 7f10195adb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aab90 0x5581ea9ab450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f10195adb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aba30 0x5581ea9abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f10195adb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ea91ac70 con 0x5581ea9aba30 2023-10-16T13:14:54.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f10195adb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ea8ffc60 con 0x5581ea9aa230 2023-10-16T13:14:54.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f10195adb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ea8fd580 con 0x5581ea9aab90 2023-10-16T13:14:54.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f10077fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aba30 0x5581ea9abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f1006ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aa230 0x5581ea9aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f10067fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aab90 0x5581ea9ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f1006ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aa230 0x5581ea9aa650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:38886/0 (socket says 172.21.15.92:38886) 2023-10-16T13:14:54.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f10077fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aba30 0x5581ea9abeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38082/0 (socket says 172.21.15.92:38082) 2023-10-16T13:14:54.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f10067fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aab90 0x5581ea9ab450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.92:44910/0 (socket says 172.21.15.92:44910) 2023-10-16T13:14:54.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f1006ffd700 1 -- 172.21.15.92:0/3302880936 learned_addr learned my addr 172.21.15.92:0/3302880936 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:54.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f1006ffd700 1 -- 172.21.15.92:0/3302880936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aab90 msgr2=0x5581ea9ab450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:54.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f1006ffd700 1 --2- 172.21.15.92:0/3302880936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aab90 0x5581ea9ab450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f1006ffd700 1 -- 172.21.15.92:0/3302880936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aba30 msgr2=0x5581ea9abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:54.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f1006ffd700 1 --2- 172.21.15.92:0/3302880936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aba30 0x5581ea9abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f1006ffd700 1 -- 172.21.15.92:0/3302880936 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581ea8b63f0 con 0x5581ea9aa230 2023-10-16T13:14:54.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f10077fe700 1 --2- 172.21.15.92:0/3302880936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aba30 0x5581ea9abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:54.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f1006ffd700 1 --2- 172.21.15.92:0/3302880936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aa230 0x5581ea9aa650 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0099050 tx=0x7f0ff000ff20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1553bd2e8403d278 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:54.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f0ffd7fa700 1 -- 172.21.15.92:0/3302880936 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff00ae030 con 0x5581ea9aa230 2023-10-16T13:14:54.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f0ffd7fa700 1 -- 172.21.15.92:0/3302880936 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0ff0099350 con 0x5581ea9aa230 2023-10-16T13:14:54.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.736+0000 7f0ffd7fa700 1 -- 172.21.15.92:0/3302880936 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0018270 con 0x5581ea9aa230 2023-10-16T13:14:54.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.737+0000 7f10195adb80 1 -- 172.21.15.92:0/3302880936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aa230 msgr2=0x5581ea9aa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:54.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.737+0000 7f10195adb80 1 --2- 172.21.15.92:0/3302880936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aa230 0x5581ea9aa650 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0099050 tx=0x7f0ff000ff20 comp rx=0 tx=0).stop 2023-10-16T13:14:54.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.737+0000 7f10195adb80 1 -- 172.21.15.92:0/3302880936 shutdown_connections 2023-10-16T13:14:54.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.737+0000 7f10195adb80 1 --2- 172.21.15.92:0/3302880936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aba30 0x5581ea9abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.737+0000 7f10195adb80 1 --2- 172.21.15.92:0/3302880936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aa230 0x5581ea9aa650 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.737+0000 7f10195adb80 1 --2- 172.21.15.92:0/3302880936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aab90 0x5581ea9ab450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.737+0000 7f10195adb80 1 -- 172.21.15.92:0/3302880936 >> 172.21.15.92:0/3302880936 conn(0x5581ea8d3dd0 msgr2=0x5581ea9a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:54.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.737+0000 7f10195adb80 1 -- 172.21.15.92:0/3302880936 shutdown_connections 2023-10-16T13:14:54.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.737+0000 7f10195adb80 1 -- 172.21.15.92:0/3302880936 wait complete. 2023-10-16T13:14:54.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.737+0000 7f10195adb80 1 -- start start 2023-10-16T13:14:54.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f10195adb80 1 Processor -- start 2023-10-16T13:14:54.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f10195adb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aa230 0x5581ea9b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f10195adb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aab90 0x5581ea9b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f10195adb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aba30 0x5581ea9bb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f10195adb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ea8f8e70 con 0x5581ea9aab90 2023-10-16T13:14:54.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f10195adb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ea895710 con 0x5581ea9aba30 2023-10-16T13:14:54.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f10195adb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ea8953b0 con 0x5581ea9aa230 2023-10-16T13:14:54.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f10195adb80 10 client.0 _ll_register_callbacks cb 0x5581ea6f2800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:54.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f10067fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aab90 0x5581ea9b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f10067fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aab90 0x5581ea9b4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38086/0 (socket says 172.21.15.92:38086) 2023-10-16T13:14:54.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f10067fc700 1 -- 172.21.15.92:0/1135751855 learned_addr learned my addr 172.21.15.92:0/1135751855 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:54.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f1006ffd700 1 --2- 172.21.15.92:0/1135751855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aa230 0x5581ea9b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f10077fe700 1 --2- 172.21.15.92:0/1135751855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aba30 0x5581ea9bb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f10067fc700 1 -- 172.21.15.92:0/1135751855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aa230 msgr2=0x5581ea9b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:54.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f10067fc700 1 --2- 172.21.15.92:0/1135751855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aa230 0x5581ea9b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f10067fc700 1 -- 172.21.15.92:0/1135751855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aba30 msgr2=0x5581ea9bb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:54.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f10067fc700 1 --2- 172.21.15.92:0/1135751855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aba30 0x5581ea9bb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f10067fc700 1 -- 172.21.15.92:0/1135751855 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1000003ac0 con 0x5581ea9aab90 2023-10-16T13:14:54.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f10067fc700 1 --2- 172.21.15.92:0/1135751855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aab90 0x5581ea9b4650 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8015000 tx=0x7f0ff801a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7243b1ababb53fa server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:54.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f0fee7fc700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:54.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f0fee7fc700 1 -- 172.21.15.92:0/1135751855 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff802b050 con 0x5581ea9aab90 2023-10-16T13:14:54.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f0fee7fc700 1 -- 172.21.15.92:0/1135751855 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f0ff80266b0 con 0x5581ea9aab90 2023-10-16T13:14:54.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.738+0000 7f10195adb80 1 -- 172.21.15.92:0/1135751855 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5581ea8fdef0 con 0x5581ea9aab90 2023-10-16T13:14:54.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.739+0000 7f0fee7fc700 1 -- 172.21.15.92:0/1135751855 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ff80268b0 con 0x5581ea9aab90 2023-10-16T13:14:54.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.739+0000 7f10195adb80 10 client.15900 fetch_fsmap learned FSMap version 35 2023-10-16T13:14:54.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.739+0000 7f10195adb80 1 -- 172.21.15.92:0/1135751855 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7f100819f280 con 0x5581ea9aab90 2023-10-16T13:14:54.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.739+0000 7f0fee7fc700 1 -- 172.21.15.92:0/1135751855 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0ff803f020 con 0x5581ea9aab90 2023-10-16T13:14:54.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.739+0000 7f0fee7fc700 1 -- 172.21.15.92:0/1135751855 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 35) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f0ff8024a60 con 0x5581ea9aab90 2023-10-16T13:14:54.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.739+0000 7f10195adb80 10 client.15900 fetch_fsmap finished waiting for FSMap version 35 2023-10-16T13:14:54.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.739+0000 7f10195adb80 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:54.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.739+0000 7f10195adb80 20 client.15900 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:54.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.739+0000 7f10195adb80 1 --2- 172.21.15.92:0/1135751855 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5581ea9c00a0 0x5581ea9c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.739+0000 7f10195adb80 4 client.15900 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:14:54.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.739+0000 7f10195adb80 1 -- 172.21.15.92:0/1135751855 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5581ea975c10 con 0x5581ea9c00a0 2023-10-16T13:14:54.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.739+0000 7f1006ffd700 1 --2- 172.21.15.92:0/1135751855 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5581ea9c00a0 0x5581ea9c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.740+0000 7f0fee7fc700 10 client.15900 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:54.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.740+0000 7f1006ffd700 1 --2- 172.21.15.92:0/1135751855 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5581ea9c00a0 0x5581ea9c24c0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d04b4874bbd9f552 server_cookie=25ae057571195e6a in_seq=0 out_seq=0 2023-10-16T13:14:54.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.740+0000 7f0fee7fc700 1 -- 172.21.15.92:0/1135751855 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5581ea975c10 con 0x5581ea9c00a0 2023-10-16T13:14:54.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.740+0000 7f0fee7fc700 10 client.15900 handle_command_reply: tid=0 2023-10-16T13:14:54.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.740+0000 7f10195adb80 1 client.15900 shutdown 2023-10-16T13:14:54.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.740+0000 7f10195adb80 1 -- 172.21.15.92:0/1135751855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aab90 msgr2=0x5581ea9b4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:54.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.740+0000 7f10195adb80 1 --2- 172.21.15.92:0/1135751855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aab90 0x5581ea9b4650 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8015000 tx=0x7f0ff801a050 comp rx=0 tx=0).stop 2023-10-16T13:14:54.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.740+0000 7f10195adb80 1 -- 172.21.15.92:0/1135751855 shutdown_connections 2023-10-16T13:14:54.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.740+0000 7f10195adb80 1 --2- 172.21.15.92:0/1135751855 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5581ea9c00a0 0x5581ea9c24c0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.740+0000 7f10195adb80 1 --2- 172.21.15.92:0/1135751855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aba30 0x5581ea9bb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.740+0000 7f0fee7fc700 0 client.15900 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:54.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.740+0000 7f10195adb80 1 --2- 172.21.15.92:0/1135751855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aa230 0x5581ea9b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.740+0000 7f10195adb80 1 --2- 172.21.15.92:0/1135751855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aab90 0x5581ea9b4650 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.740+0000 7f10195adb80 1 -- 172.21.15.92:0/1135751855 >> 172.21.15.92:0/1135751855 conn(0x5581ea8d3dd0 msgr2=0x5581ea9a0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:54.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.740+0000 7f10195adb80 1 -- 172.21.15.92:0/1135751855 shutdown_connections 2023-10-16T13:14:54.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.740+0000 7f10195adb80 1 -- 172.21.15.92:0/1135751855 wait complete. 2023-10-16T13:14:54.763 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.741+0000 7f10195adb80 20 client.15900 trim_cache size 0 max 16384 2023-10-16T13:14:54.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.763+0000 7f10195adb80 1 Processor -- start 2023-10-16T13:14:54.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.763+0000 7f10195adb80 1 -- start start 2023-10-16T13:14:54.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.764+0000 7f10195adb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aa230 0x5581ea9ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.764+0000 7f10195adb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aab90 0x5581ea9aef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.764+0000 7f10195adb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aba30 0x5581ea9bb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.764+0000 7f10195adb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ea779920 con 0x5581ea9aab90 2023-10-16T13:14:54.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.764+0000 7f10195adb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ea9ab8e0 con 0x5581ea9aa230 2023-10-16T13:14:54.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.764+0000 7f10195adb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ea9b3c80 con 0x5581ea9aba30 2023-10-16T13:14:54.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.764+0000 7f10067fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aab90 0x5581ea9aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.764+0000 7f1006ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aa230 0x5581ea9ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.764+0000 7f10067fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aab90 0x5581ea9aef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38094/0 (socket says 172.21.15.92:38094) 2023-10-16T13:14:54.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.764+0000 7f1006ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aa230 0x5581ea9ae9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:38900/0 (socket says 172.21.15.92:38900) 2023-10-16T13:14:54.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.764+0000 7f10067fc700 1 -- 172.21.15.92:0/3763265707 learned_addr learned my addr 172.21.15.92:0/3763265707 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:54.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.764+0000 7f10077fe700 1 --2- 172.21.15.92:0/3763265707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aba30 0x5581ea9bb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.764+0000 7f10067fc700 1 -- 172.21.15.92:0/3763265707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aba30 msgr2=0x5581ea9bb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:54.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.764+0000 7f10067fc700 1 --2- 172.21.15.92:0/3763265707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aba30 0x5581ea9bb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.764+0000 7f10067fc700 1 -- 172.21.15.92:0/3763265707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aa230 msgr2=0x5581ea9ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:54.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.764+0000 7f10067fc700 1 --2- 172.21.15.92:0/3763265707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aa230 0x5581ea9ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.764+0000 7f10067fc700 1 -- 172.21.15.92:0/3763265707 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581ea723de0 con 0x5581ea9aab90 2023-10-16T13:14:54.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.765+0000 7f10067fc700 1 --2- 172.21.15.92:0/3763265707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aab90 0x5581ea9aef10 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800b840 tx=0x7f0ff8005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c082e355a02dcd2c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:54.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.765+0000 7f0ffdffb700 1 -- 172.21.15.92:0/3763265707 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff802b040 con 0x5581ea9aab90 2023-10-16T13:14:54.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.765+0000 7f0ffdffb700 1 -- 172.21.15.92:0/3763265707 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0ff803f030 con 0x5581ea9aab90 2023-10-16T13:14:54.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.765+0000 7f0ffdffb700 1 -- 172.21.15.92:0/3763265707 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8045430 con 0x5581ea9aab90 2023-10-16T13:14:54.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.766+0000 7f10195adb80 1 -- 172.21.15.92:0/3763265707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aab90 msgr2=0x5581ea9aef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:54.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.766+0000 7f10195adb80 1 --2- 172.21.15.92:0/3763265707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aab90 0x5581ea9aef10 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800b840 tx=0x7f0ff8005900 comp rx=0 tx=0).stop 2023-10-16T13:14:54.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.766+0000 7f10195adb80 1 -- 172.21.15.92:0/3763265707 shutdown_connections 2023-10-16T13:14:54.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.766+0000 7f10195adb80 1 --2- 172.21.15.92:0/3763265707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aba30 0x5581ea9bb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.766+0000 7f10195adb80 1 --2- 172.21.15.92:0/3763265707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aa230 0x5581ea9ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.766+0000 7f10195adb80 1 --2- 172.21.15.92:0/3763265707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aab90 0x5581ea9aef10 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.766+0000 7f10195adb80 1 -- 172.21.15.92:0/3763265707 >> 172.21.15.92:0/3763265707 conn(0x5581ea8d3dd0 msgr2=0x5581ea9b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:54.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.766+0000 7f10195adb80 1 -- 172.21.15.92:0/3763265707 shutdown_connections 2023-10-16T13:14:54.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.766+0000 7f10195adb80 1 -- 172.21.15.92:0/3763265707 wait complete. 2023-10-16T13:14:54.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.766+0000 7f10195adb80 1 -- start start 2023-10-16T13:14:54.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.767+0000 7f10195adb80 1 Processor -- start 2023-10-16T13:14:54.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.767+0000 7f10195adb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aa230 0x5581ea9b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.767+0000 7f10195adb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aab90 0x5581ea9b9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.767+0000 7f10195adb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aba30 0x5581ea9ba400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.767+0000 7f10195adb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ea9bab40 con 0x5581ea9aa230 2023-10-16T13:14:54.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.767+0000 7f10195adb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ea9bacb0 con 0x5581ea9aba30 2023-10-16T13:14:54.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.767+0000 7f10195adb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ea9bae70 con 0x5581ea9aab90 2023-10-16T13:14:54.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.767+0000 7f10195adb80 10 client.0 _ll_register_callbacks cb 0x7f0ff800f770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:54.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.767+0000 7f1006ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aa230 0x5581ea9b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.767+0000 7f10067fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aab90 0x5581ea9b9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.767+0000 7f1006ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aa230 0x5581ea9b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38098/0 (socket says 172.21.15.92:38098) 2023-10-16T13:14:54.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.767+0000 7f1006ffd700 1 -- 172.21.15.92:0/2095923961 learned_addr learned my addr 172.21.15.92:0/2095923961 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:54.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.767+0000 7f10077fe700 1 --2- 172.21.15.92:0/2095923961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aba30 0x5581ea9ba400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.767+0000 7f1006ffd700 1 -- 172.21.15.92:0/2095923961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aab90 msgr2=0x5581ea9b9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:54.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.767+0000 7f1006ffd700 1 --2- 172.21.15.92:0/2095923961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aab90 0x5581ea9b9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.767+0000 7f1006ffd700 1 -- 172.21.15.92:0/2095923961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aba30 msgr2=0x5581ea9ba400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:54.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.767+0000 7f1006ffd700 1 --2- 172.21.15.92:0/2095923961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aba30 0x5581ea9ba400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.767+0000 7f1006ffd700 1 -- 172.21.15.92:0/2095923961 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100819f280 con 0x5581ea9aa230 2023-10-16T13:14:54.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.768+0000 7f1006ffd700 1 --2- 172.21.15.92:0/2095923961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aa230 0x5581ea9b7880 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00a18a0 tx=0x7f0ff0005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd516d1fe46d37a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:54.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.768+0000 7f0fee7fc700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:54.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.768+0000 7f0fee7fc700 1 -- 172.21.15.92:0/2095923961 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff00ae040 con 0x5581ea9aa230 2023-10-16T13:14:54.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.768+0000 7f0fee7fc700 1 -- 172.21.15.92:0/2095923961 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f0ff00af070 con 0x5581ea9aa230 2023-10-16T13:14:54.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.768+0000 7f10195adb80 1 -- 172.21.15.92:0/2095923961 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0ff0099350 con 0x5581ea9aa230 2023-10-16T13:14:54.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.768+0000 7f0fee7fc700 1 -- 172.21.15.92:0/2095923961 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ff009d4a0 con 0x5581ea9aa230 2023-10-16T13:14:54.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.768+0000 7f10195adb80 10 client.15906 fetch_fsmap learned FSMap version 35 2023-10-16T13:14:54.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.768+0000 7f10195adb80 1 -- 172.21.15.92:0/2095923961 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x5581ea70cc60 con 0x5581ea9aa230 2023-10-16T13:14:54.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.768+0000 7f0fee7fc700 1 -- 172.21.15.92:0/2095923961 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0ff0099350 con 0x5581ea9aa230 2023-10-16T13:14:54.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.769+0000 7f0fee7fc700 1 -- 172.21.15.92:0/2095923961 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 35) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f0ff007a080 con 0x5581ea9aa230 2023-10-16T13:14:54.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.769+0000 7f10195adb80 10 client.15906 fetch_fsmap finished waiting for FSMap version 35 2023-10-16T13:14:54.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.769+0000 7f10195adb80 10 client.15906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:54.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.769+0000 7f10195adb80 20 client.15906 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:54.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.769+0000 7f10195adb80 1 --2- 172.21.15.92:0/2095923961 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5581ea9c00a0 0x5581eaa1afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.769+0000 7f10195adb80 4 client.15906 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-16T13:14:54.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.769+0000 7f10195adb80 1 -- 172.21.15.92:0/2095923961 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5581ea8f1e50 con 0x5581ea9c00a0 2023-10-16T13:14:54.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.769+0000 7f10067fc700 1 --2- 172.21.15.92:0/2095923961 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5581ea9c00a0 0x5581eaa1afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.770+0000 7f10067fc700 1 --2- 172.21.15.92:0/2095923961 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5581ea9c00a0 0x5581eaa1afa0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22a09e42338976 server_cookie=905c55347a4cde4c in_seq=0 out_seq=0 2023-10-16T13:14:54.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.770+0000 7f0fee7fc700 10 client.15906 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:54.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.770+0000 7f0fee7fc700 1 -- 172.21.15.92:0/2095923961 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5581ea8f1e50 con 0x5581ea9c00a0 2023-10-16T13:14:54.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.770+0000 7f0fee7fc700 10 client.15906 handle_command_reply: tid=0 2023-10-16T13:14:54.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.770+0000 7f10195adb80 1 client.15906 shutdown 2023-10-16T13:14:54.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.770+0000 7f10195adb80 1 -- 172.21.15.92:0/2095923961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aa230 msgr2=0x5581ea9b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:54.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.770+0000 7f10195adb80 1 --2- 172.21.15.92:0/2095923961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aa230 0x5581ea9b7880 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00a18a0 tx=0x7f0ff0005c60 comp rx=0 tx=0).stop 2023-10-16T13:14:54.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.770+0000 7f10195adb80 1 -- 172.21.15.92:0/2095923961 shutdown_connections 2023-10-16T13:14:54.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.771+0000 7f10195adb80 1 --2- 172.21.15.92:0/2095923961 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x5581ea9c00a0 0x5581eaa1afa0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.771+0000 7f10195adb80 1 --2- 172.21.15.92:0/2095923961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581ea9aa230 0x5581ea9b7880 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.771+0000 7f10195adb80 1 --2- 172.21.15.92:0/2095923961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581ea9aba30 0x5581ea9ba400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.771+0000 7f10195adb80 1 --2- 172.21.15.92:0/2095923961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581ea9aab90 0x5581ea9b9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.771+0000 7f10195adb80 1 -- 172.21.15.92:0/2095923961 >> 172.21.15.92:0/2095923961 conn(0x5581ea8d3dd0 msgr2=0x5581ea9ae9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:54.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.771+0000 7f0fee7fc700 0 client.15906 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:54.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.771+0000 7f10195adb80 1 -- 172.21.15.92:0/2095923961 shutdown_connections 2023-10-16T13:14:54.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.771+0000 7f10195adb80 1 -- 172.21.15.92:0/2095923961 wait complete. 2023-10-16T13:14:54.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.771+0000 7f10195adb80 20 client.15906 trim_cache size 0 max 16384 2023-10-16T13:14:54.789 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:14:54.790 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2023-10-16T13:14:54.790 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2023-10-16T13:14:54.790 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:14:54.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.772+0000 7f100d3c3700 1 -- 172.21.15.92:0/2074148624 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0ff40a1480 msgr2=0x7f0ff40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:54.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.772+0000 7f100d3c3700 1 --2- 172.21.15.92:0/2074148624 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0ff40a1480 0x7f0ff40a3940 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8000c00 tx=0x7f0ff8005fb0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.772+0000 7f100d3c3700 1 -- 172.21.15.92:0/2074148624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1008100060 msgr2=0x7f10080ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:54.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.772+0000 7f100d3c3700 1 --2- 172.21.15.92:0/2074148624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1008100060 0x7f10080ffac0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000d980 tx=0x7f0ff000dc90 comp rx=0 tx=0).stop 2023-10-16T13:14:54.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.772+0000 7f100d3c3700 1 -- 172.21.15.92:0/2074148624 shutdown_connections 2023-10-16T13:14:54.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.772+0000 7f100d3c3700 1 --2- 172.21.15.92:0/2074148624 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f0ff40a1480 0x7f0ff40a3940 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.772+0000 7f100d3c3700 1 --2- 172.21.15.92:0/2074148624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1008100060 0x7f10080ffac0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.772+0000 7f100d3c3700 1 --2- 172.21.15.92:0/2074148624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10081013c0 0x7f100819e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.772+0000 7f100d3c3700 1 --2- 172.21.15.92:0/2074148624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1008100a20 0x7f100819ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.772+0000 7f100d3c3700 1 -- 172.21.15.92:0/2074148624 >> 172.21.15.92:0/2074148624 conn(0x7f10080faa90 msgr2=0x7f1008104550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:54.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.773+0000 7f100d3c3700 1 -- 172.21.15.92:0/2074148624 shutdown_connections 2023-10-16T13:14:54.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.774+0000 7f100d3c3700 1 -- 172.21.15.92:0/2074148624 wait complete. 2023-10-16T13:14:54.793 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:54 smithi118 ceph-mon[103969]: pgmap v354: 97 pgs: 97 active+clean; 58 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.8 MiB/s wr, 603 op/s 2023-10-16T13:14:54.794 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-16T13:14:54.794 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:14:54.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.965+0000 7fd89ab93700 1 -- 172.21.15.92:0/1597790841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd894104380 msgr2=0x7fd894106770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:54.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.965+0000 7fd89ab93700 1 --2- 172.21.15.92:0/1597790841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd894104380 0x7fd894106770 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd880009990 tx=0x7fd880009ca0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.965+0000 7fd89ab93700 1 -- 172.21.15.92:0/1597790841 shutdown_connections 2023-10-16T13:14:54.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.965+0000 7fd89ab93700 1 --2- 172.21.15.92:0/1597790841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd894106cb0 0x7fd8941090a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.965+0000 7fd89ab93700 1 --2- 172.21.15.92:0/1597790841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd894101a50 0x7fd894103e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.965+0000 7fd89ab93700 1 --2- 172.21.15.92:0/1597790841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd894104380 0x7fd894106770 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.965+0000 7fd89ab93700 1 -- 172.21.15.92:0/1597790841 >> 172.21.15.92:0/1597790841 conn(0x7fd8940fb380 msgr2=0x7fd8940fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:54.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.965+0000 7fd89ab93700 1 -- 172.21.15.92:0/1597790841 shutdown_connections 2023-10-16T13:14:54.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.965+0000 7fd89ab93700 1 -- 172.21.15.92:0/1597790841 wait complete. 2023-10-16T13:14:54.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.965+0000 7fd89ab93700 1 Processor -- start 2023-10-16T13:14:54.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.965+0000 7fd89ab93700 1 -- start start 2023-10-16T13:14:54.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd89ab93700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd894101a50 0x7fd894196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd89ab93700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd894104380 0x7fd894197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd89ab93700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd894106cb0 0x7fd89419e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd89ab93700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89419e770 con 0x7fd894106cb0 2023-10-16T13:14:54.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd89ab93700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89419e8b0 con 0x7fd894104380 2023-10-16T13:14:54.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd89ab93700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89419ea40 con 0x7fd894101a50 2023-10-16T13:14:54.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd899130700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd894106cb0 0x7fd89419e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd893fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd894104380 0x7fd894197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd899130700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd894106cb0 0x7fd89419e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38116/0 (socket says 172.21.15.92:38116) 2023-10-16T13:14:54.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd899130700 1 -- 172.21.15.92:0/1509396393 learned_addr learned my addr 172.21.15.92:0/1509396393 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:54.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd89892f700 1 --2- 172.21.15.92:0/1509396393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd894101a50 0x7fd894196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd893fff700 1 -- 172.21.15.92:0/1509396393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd894101a50 msgr2=0x7fd894196bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:54.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd893fff700 1 --2- 172.21.15.92:0/1509396393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd894101a50 0x7fd894196bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd893fff700 1 -- 172.21.15.92:0/1509396393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd894106cb0 msgr2=0x7fd89419e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:54.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd893fff700 1 --2- 172.21.15.92:0/1509396393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd894106cb0 0x7fd89419e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:54.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd893fff700 1 -- 172.21.15.92:0/1509396393 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8800095f0 con 0x7fd894104380 2023-10-16T13:14:54.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd89892f700 1 --2- 172.21.15.92:0/1509396393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd894101a50 0x7fd894196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:14:54.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd899130700 1 --2- 172.21.15.92:0/1509396393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd894106cb0 0x7fd89419e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:54.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd893fff700 1 --2- 172.21.15.92:0/1509396393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd894104380 0x7fd894197130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd88000b780 tx=0x7fd880009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:54.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd891ffb700 1 -- 172.21.15.92:0/1509396393 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88001d070 con 0x7fd894104380 2023-10-16T13:14:54.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.966+0000 7fd89ab93700 1 -- 172.21.15.92:0/1509396393 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89419ecc0 con 0x7fd894104380 2023-10-16T13:14:54.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.967+0000 7fd89ab93700 1 -- 172.21.15.92:0/1509396393 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89419f140 con 0x7fd894104380 2023-10-16T13:14:54.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.967+0000 7fd891ffb700 1 -- 172.21.15.92:0/1509396393 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd88000bed0 con 0x7fd894104380 2023-10-16T13:14:54.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.967+0000 7fd891ffb700 1 -- 172.21.15.92:0/1509396393 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd880017650 con 0x7fd894104380 2023-10-16T13:14:54.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.968+0000 7fd89ab93700 1 -- 172.21.15.92:0/1509396393 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8940fcf00 con 0x7fd894104380 2023-10-16T13:14:54.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.969+0000 7fd891ffb700 1 -- 172.21.15.92:0/1509396393 <== mon.2 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd880021410 con 0x7fd894104380 2023-10-16T13:14:54.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.969+0000 7fd891ffb700 1 --2- 172.21.15.92:0/1509396393 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd8840a1520 0x7fd8840a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:54.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.969+0000 7fd891ffb700 1 -- 172.21.15.92:0/1509396393 <== mon.2 v2:172.21.15.118:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd8800ce3a0 con 0x7fd894104380 2023-10-16T13:14:54.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.970+0000 7fd89892f700 1 --2- 172.21.15.92:0/1509396393 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd8840a1520 0x7fd8840a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:54.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.970+0000 7fd89892f700 1 --2- 172.21.15.92:0/1509396393 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd8840a1520 0x7fd8840a39e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd888005d90 tx=0x7fd888005d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:54.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:54.976+0000 7fd891ffb700 1 -- 172.21.15.92:0/1509396393 <== mon.2 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd880097a90 con 0x7fd894104380 2023-10-16T13:14:55.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.232+0000 7fd89ab93700 1 -- 172.21.15.92:0/1509396393 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd89410c8b0 con 0x7fd894104380 2023-10-16T13:14:55.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.233+0000 7fd891ffb700 1 -- 172.21.15.92:0/1509396393 <== mon.2 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+11391 (secure 0 0 0) 0x7fd89410c8b0 con 0x7fd894104380 2023-10-16T13:14:55.236 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:14:55.236 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-16T13:11:40.343309+0000","modified":"2023-10-16T13:14:43.250951+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24460,"mds_3":24428,"mds_4":24412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1790514945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1790514945},{"type":"v1","addr":"172.21.15.92:6839","nonce":1790514945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/1016260236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1016260236},{"type":"v1","addr":"172.21.15.92:6841","nonce":1016260236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24410":{"gid":24410,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/2133613540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":2133613540},{"type":"v1","addr":"172.21.15.118:6837","nonce":2133613540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6837/2403096460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":2403096460},{"type":"v1","addr":"172.21.15.152:6837","nonce":2403096460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":47,"addr":"172.21.15.152:6839/1821921588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1821921588},{"type":"v1","addr":"172.21.15.152:6839","nonce":1821921588}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6839/1577355936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":1577355936},{"type":"v1","addr":"172.21.15.118:6839","nonce":1577355936}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:14:55.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.235+0000 7fd89ab93700 1 -- 172.21.15.92:0/1509396393 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd8840a1520 msgr2=0x7fd8840a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.235+0000 7fd89ab93700 1 --2- 172.21.15.92:0/1509396393 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd8840a1520 0x7fd8840a39e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd888005d90 tx=0x7fd888005d20 comp rx=0 tx=0).stop 2023-10-16T13:14:55.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.235+0000 7fd89ab93700 1 -- 172.21.15.92:0/1509396393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd894104380 msgr2=0x7fd894197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.235+0000 7fd89ab93700 1 --2- 172.21.15.92:0/1509396393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd894104380 0x7fd894197130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd88000b780 tx=0x7fd880009580 comp rx=0 tx=0).stop 2023-10-16T13:14:55.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.235+0000 7fd89ab93700 1 -- 172.21.15.92:0/1509396393 shutdown_connections 2023-10-16T13:14:55.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.235+0000 7fd89ab93700 1 --2- 172.21.15.92:0/1509396393 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fd8840a1520 0x7fd8840a39e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.235+0000 7fd89ab93700 1 --2- 172.21.15.92:0/1509396393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd894106cb0 0x7fd89419e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.235+0000 7fd89ab93700 1 --2- 172.21.15.92:0/1509396393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd894101a50 0x7fd894196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.235+0000 7fd89ab93700 1 --2- 172.21.15.92:0/1509396393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd894104380 0x7fd894197130 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.235+0000 7fd89ab93700 1 -- 172.21.15.92:0/1509396393 >> 172.21.15.92:0/1509396393 conn(0x7fd8940fb380 msgr2=0x7fd8941026c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.235+0000 7fd89ab93700 1 -- 172.21.15.92:0/1509396393 shutdown_connections 2023-10-16T13:14:55.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.235+0000 7fd89ab93700 1 -- 172.21.15.92:0/1509396393 wait complete. 2023-10-16T13:14:55.240 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 35 2023-10-16T13:14:55.250 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-16T13:14:55.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.378+0000 7f381fef3700 1 -- 172.21.15.92:0/1500448627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3818100fb0 msgr2=0x7f3818101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.378+0000 7f381fef3700 1 --2- 172.21.15.92:0/1500448627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3818100fb0 0x7f3818101410 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f38080099c0 tx=0x7f3808009cd0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.378+0000 7f381fef3700 1 -- 172.21.15.92:0/1500448627 shutdown_connections 2023-10-16T13:14:55.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.378+0000 7f381fef3700 1 --2- 172.21.15.92:0/1500448627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3818101950 0x7f3818108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.378+0000 7f381fef3700 1 --2- 172.21.15.92:0/1500448627 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38180ffdc0 0x7f38181001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.378+0000 7f381fef3700 1 --2- 172.21.15.92:0/1500448627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3818100fb0 0x7f3818101410 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.378+0000 7f381fef3700 1 -- 172.21.15.92:0/1500448627 >> 172.21.15.92:0/1500448627 conn(0x7f38180fb2f0 msgr2=0x7f38180fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.378+0000 7f381fef3700 1 -- 172.21.15.92:0/1500448627 shutdown_connections 2023-10-16T13:14:55.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.378+0000 7f381fef3700 1 -- 172.21.15.92:0/1500448627 wait complete. 2023-10-16T13:14:55.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.378+0000 7f381fef3700 1 Processor -- start 2023-10-16T13:14:55.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.379+0000 7f381fef3700 1 -- start start 2023-10-16T13:14:55.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.379+0000 7f381fef3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38180ffdc0 0x7f3818103d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.379+0000 7f381fef3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3818100fb0 0x7f3818102390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.379+0000 7f381fef3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3818101950 0x7f38181028d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.379+0000 7f381fef3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3818103070 con 0x7f3818101950 2023-10-16T13:14:55.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.379+0000 7f381fef3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38181031e0 con 0x7f3818100fb0 2023-10-16T13:14:55.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.379+0000 7f381fef3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38181a0c90 con 0x7f38180ffdc0 2023-10-16T13:14:55.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.379+0000 7f381e490700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3818101950 0x7f38181028d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.379+0000 7f381e490700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3818101950 0x7f38181028d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38130/0 (socket says 172.21.15.92:38130) 2023-10-16T13:14:55.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.379+0000 7f381e490700 1 -- 172.21.15.92:0/1519985278 learned_addr learned my addr 172.21.15.92:0/1519985278 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.379+0000 7f381d48e700 1 --2- 172.21.15.92:0/1519985278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3818100fb0 0x7f3818102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.379+0000 7f381dc8f700 1 --2- 172.21.15.92:0/1519985278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38180ffdc0 0x7f3818103d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.379+0000 7f381e490700 1 -- 172.21.15.92:0/1519985278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38180ffdc0 msgr2=0x7f3818103d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.379+0000 7f381e490700 1 --2- 172.21.15.92:0/1519985278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38180ffdc0 0x7f3818103d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.379+0000 7f381e490700 1 -- 172.21.15.92:0/1519985278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3818100fb0 msgr2=0x7f3818102390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.379+0000 7f381e490700 1 --2- 172.21.15.92:0/1519985278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3818100fb0 0x7f3818102390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.379+0000 7f381e490700 1 -- 172.21.15.92:0/1519985278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38080095f0 con 0x7f3818101950 2023-10-16T13:14:55.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.379+0000 7f381e490700 1 --2- 172.21.15.92:0/1519985278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3818101950 0x7f38181028d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f381000ef30 tx=0x7f381000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.379+0000 7f380effd700 1 -- 172.21.15.92:0/1519985278 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810018070 con 0x7f3818101950 2023-10-16T13:14:55.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.380+0000 7f381fef3700 1 -- 172.21.15.92:0/1519985278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38181a0f10 con 0x7f3818101950 2023-10-16T13:14:55.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.380+0000 7f380effd700 1 -- 172.21.15.92:0/1519985278 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f381000f040 con 0x7f3818101950 2023-10-16T13:14:55.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.380+0000 7f380effd700 1 -- 172.21.15.92:0/1519985278 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381000cd50 con 0x7f3818101950 2023-10-16T13:14:55.388 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.380+0000 7f381fef3700 1 -- 172.21.15.92:0/1519985278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38181a1340 con 0x7f3818101950 2023-10-16T13:14:55.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.382+0000 7f380effd700 1 -- 172.21.15.92:0/1519985278 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3810003a00 con 0x7f3818101950 2023-10-16T13:14:55.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.382+0000 7f380effd700 1 --2- 172.21.15.92:0/1519985278 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f38040a1480 0x7f38040a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.383+0000 7f381dc8f700 1 --2- 172.21.15.92:0/1519985278 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f38040a1480 0x7f38040a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.383+0000 7f380effd700 1 -- 172.21.15.92:0/1519985278 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f38100cc830 con 0x7f3818101950 2023-10-16T13:14:55.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.383+0000 7f381dc8f700 1 --2- 172.21.15.92:0/1519985278 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f38040a1480 0x7f38040a3940 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3818100e10 tx=0x7f3814009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.383+0000 7f382c0ddb80 1 Processor -- start 2023-10-16T13:14:55.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.384+0000 7f382c0ddb80 1 -- start start 2023-10-16T13:14:55.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.384+0000 7f382c0ddb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 0x564ffe1d6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.384+0000 7f382c0ddb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d6780 0x564ffe1d7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.384+0000 7f382c0ddb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d7620 0x564ffe1d7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.384+0000 7f382c0ddb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe14ac70 con 0x564ffe1d5e20 2023-10-16T13:14:55.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.384+0000 7f382c0ddb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe12fc60 con 0x564ffe1d6780 2023-10-16T13:14:55.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.384+0000 7f382c0ddb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe12d580 con 0x564ffe1d7620 2023-10-16T13:14:55.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.384+0000 7f381dc8f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 0x564ffe1d6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.384+0000 7f381dc8f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 0x564ffe1d6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38134/0 (socket says 172.21.15.92:38134) 2023-10-16T13:14:55.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.384+0000 7f381dc8f700 1 -- 172.21.15.92:0/3157988886 learned_addr learned my addr 172.21.15.92:0/3157988886 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.384+0000 7f381d48e700 1 --2- 172.21.15.92:0/3157988886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d6780 0x564ffe1d7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.384+0000 7f381e490700 1 --2- 172.21.15.92:0/3157988886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d7620 0x564ffe1d7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.384+0000 7f381dc8f700 1 -- 172.21.15.92:0/3157988886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d7620 msgr2=0x564ffe1d7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.384+0000 7f381dc8f700 1 --2- 172.21.15.92:0/3157988886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d7620 0x564ffe1d7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.384+0000 7f381dc8f700 1 -- 172.21.15.92:0/3157988886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d6780 msgr2=0x564ffe1d7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.384+0000 7f381dc8f700 1 --2- 172.21.15.92:0/3157988886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d6780 0x564ffe1d7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.384+0000 7f381dc8f700 1 -- 172.21.15.92:0/3157988886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ffe0e63f0 con 0x564ffe1d5e20 2023-10-16T13:14:55.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.384+0000 7f381dc8f700 1 --2- 172.21.15.92:0/3157988886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 0x564ffe1d6240 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3814011d50 tx=0x7f3814014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64616de8dfa4691 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.384+0000 7f3803fff700 1 -- 172.21.15.92:0/3157988886 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381400ed20 con 0x564ffe1d5e20 2023-10-16T13:14:55.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.385+0000 7f3803fff700 1 -- 172.21.15.92:0/3157988886 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3814021070 con 0x564ffe1d5e20 2023-10-16T13:14:55.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.385+0000 7f3803fff700 1 -- 172.21.15.92:0/3157988886 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381401d670 con 0x564ffe1d5e20 2023-10-16T13:14:55.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.385+0000 7f382c0ddb80 1 -- 172.21.15.92:0/3157988886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 msgr2=0x564ffe1d6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.385+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/3157988886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 0x564ffe1d6240 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3814011d50 tx=0x7f3814014000 comp rx=0 tx=0).stop 2023-10-16T13:14:55.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.385+0000 7f382c0ddb80 1 -- 172.21.15.92:0/3157988886 shutdown_connections 2023-10-16T13:14:55.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.385+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/3157988886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 0x564ffe1d6240 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.385+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/3157988886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d7620 0x564ffe1d7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.385+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/3157988886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d6780 0x564ffe1d7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.385+0000 7f382c0ddb80 1 -- 172.21.15.92:0/3157988886 >> 172.21.15.92:0/3157988886 conn(0x564ffe103dd0 msgr2=0x564ffe1d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.385+0000 7f382c0ddb80 1 -- 172.21.15.92:0/3157988886 shutdown_connections 2023-10-16T13:14:55.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.385+0000 7f382c0ddb80 1 -- 172.21.15.92:0/3157988886 wait complete. 2023-10-16T13:14:55.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.386+0000 7f382c0ddb80 1 -- start start 2023-10-16T13:14:55.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.386+0000 7f382c0ddb80 1 Processor -- start 2023-10-16T13:14:55.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.386+0000 7f382c0ddb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d5e20 0x564ffe1dfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.386+0000 7f382c0ddb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d6780 0x564ffe1e0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.386+0000 7f382c0ddb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d7620 0x564ffe1e71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.386+0000 7f382c0ddb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe128e70 con 0x564ffe1d7620 2023-10-16T13:14:55.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.386+0000 7f382c0ddb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe0c5710 con 0x564ffe1d5e20 2023-10-16T13:14:55.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.386+0000 7f382c0ddb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe0c53b0 con 0x564ffe1d6780 2023-10-16T13:14:55.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.386+0000 7f382c0ddb80 10 client.0 _ll_register_callbacks cb 0x564ffdf22800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:55.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.386+0000 7f381e490700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d7620 0x564ffe1e71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.386+0000 7f381e490700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d7620 0x564ffe1e71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38144/0 (socket says 172.21.15.92:38144) 2023-10-16T13:14:55.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.386+0000 7f381dc8f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d5e20 0x564ffe1dfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.386+0000 7f381e490700 1 -- 172.21.15.92:0/2969337486 learned_addr learned my addr 172.21.15.92:0/2969337486 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.387+0000 7f381d48e700 1 --2- 172.21.15.92:0/2969337486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d6780 0x564ffe1e0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.387+0000 7f381e490700 1 -- 172.21.15.92:0/2969337486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d6780 msgr2=0x564ffe1e0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.387+0000 7f381e490700 1 --2- 172.21.15.92:0/2969337486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d6780 0x564ffe1e0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.387+0000 7f381e490700 1 -- 172.21.15.92:0/2969337486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d5e20 msgr2=0x564ffe1dfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.387+0000 7f381e490700 1 --2- 172.21.15.92:0/2969337486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d5e20 0x564ffe1dfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.387+0000 7f381e490700 1 -- 172.21.15.92:0/2969337486 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3814017070 con 0x564ffe1d7620 2023-10-16T13:14:55.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.387+0000 7f381dc8f700 1 --2- 172.21.15.92:0/2969337486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d5e20 0x564ffe1dfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:55.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.387+0000 7f381e490700 1 --2- 172.21.15.92:0/2969337486 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d7620 0x564ffe1e71b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f38100ca330 tx=0x7f3810099540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af84be03a9ae23f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.387+0000 7f38017fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:55.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.387+0000 7f38017fa700 1 -- 172.21.15.92:0/2969337486 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381009a2e0 con 0x564ffe1d7620 2023-10-16T13:14:55.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.387+0000 7f38017fa700 1 -- 172.21.15.92:0/2969337486 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3810099be0 con 0x564ffe1d7620 2023-10-16T13:14:55.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.387+0000 7f382c0ddb80 1 -- 172.21.15.92:0/2969337486 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564ffe12def0 con 0x564ffe1d7620 2023-10-16T13:14:55.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.387+0000 7f38017fa700 1 -- 172.21.15.92:0/2969337486 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f381009dd30 con 0x564ffe1d7620 2023-10-16T13:14:55.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.387+0000 7f382c0ddb80 10 client.15924 fetch_fsmap learned FSMap version 35 2023-10-16T13:14:55.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.387+0000 7f382c0ddb80 1 -- 172.21.15.92:0/2969337486 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x564ffdf53de0 con 0x564ffe1d7620 2023-10-16T13:14:55.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.387+0000 7f38017fa700 1 -- 172.21.15.92:0/2969337486 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3810063020 con 0x564ffe1d7620 2023-10-16T13:14:55.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.387+0000 7f38017fa700 1 -- 172.21.15.92:0/2969337486 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 35) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f38100a1a50 con 0x564ffe1d7620 2023-10-16T13:14:55.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.388+0000 7f382c0ddb80 10 client.15924 fetch_fsmap finished waiting for FSMap version 35 2023-10-16T13:14:55.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.388+0000 7f382c0ddb80 10 client.15924 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2023-10-16T13:14:55.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.388+0000 7f382c0ddb80 20 client.15924 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:55.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.388+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/2969337486 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x564ffe1eb920 0x564ffe1edd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.388+0000 7f382c0ddb80 4 client.15924 mds_command: new command op to 24412 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:14:55.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.388+0000 7f382c0ddb80 1 -- 172.21.15.92:0/2969337486 --> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564ffe1a5c10 con 0x564ffe1eb920 2023-10-16T13:14:55.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.388+0000 7f381dc8f700 1 --2- 172.21.15.92:0/2969337486 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x564ffe1eb920 0x564ffe1edd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.388+0000 7f38017fa700 10 client.15924 ms_handle_connect on v2:172.21.15.152:6832/1273074399 2023-10-16T13:14:55.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.388+0000 7f381dc8f700 1 --2- 172.21.15.92:0/2969337486 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x564ffe1eb920 0x564ffe1edd40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=37b12defc3b9d3cd server_cookie=9978615f76a26d12 in_seq=0 out_seq=0 2023-10-16T13:14:55.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.389+0000 7f38017fa700 1 -- 172.21.15.92:0/2969337486 <== mds.4 v2:172.21.15.152:6832/1273074399 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564ffe1a5c10 con 0x564ffe1eb920 2023-10-16T13:14:55.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.389+0000 7f38017fa700 10 client.15924 handle_command_reply: tid=0 2023-10-16T13:14:55.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.389+0000 7f382c0ddb80 1 client.15924 shutdown 2023-10-16T13:14:55.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.389+0000 7f382c0ddb80 1 -- 172.21.15.92:0/2969337486 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d7620 msgr2=0x564ffe1e71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.389+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/2969337486 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d7620 0x564ffe1e71b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f38100ca330 tx=0x7f3810099540 comp rx=0 tx=0).stop 2023-10-16T13:14:55.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.389+0000 7f382c0ddb80 1 -- 172.21.15.92:0/2969337486 shutdown_connections 2023-10-16T13:14:55.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.389+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/2969337486 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d7620 0x564ffe1e71b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.389+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/2969337486 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x564ffe1eb920 0x564ffe1edd40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.389+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/2969337486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d5e20 0x564ffe1dfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.389+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/2969337486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d6780 0x564ffe1e0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.389+0000 7f38017fa700 0 client.15924 ms_handle_reset on v2:172.21.15.152:6832/1273074399 2023-10-16T13:14:55.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.389+0000 7f382c0ddb80 1 -- 172.21.15.92:0/2969337486 >> 172.21.15.92:0/2969337486 conn(0x564ffe103dd0 msgr2=0x564ffe1d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.389+0000 7f382c0ddb80 1 -- 172.21.15.92:0/2969337486 shutdown_connections 2023-10-16T13:14:55.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.389+0000 7f382c0ddb80 1 -- 172.21.15.92:0/2969337486 wait complete. 2023-10-16T13:14:55.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.389+0000 7f382c0ddb80 20 client.15924 trim_cache size 0 max 16384 2023-10-16T13:14:55.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.402+0000 7f382c0ddb80 1 Processor -- start 2023-10-16T13:14:55.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.402+0000 7f382c0ddb80 1 -- start start 2023-10-16T13:14:55.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.402+0000 7f382c0ddb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 0x564ffe1d6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.402+0000 7f382c0ddb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d6780 0x564ffe1e7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.402+0000 7f382c0ddb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d7620 0x564ffe1dd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.402+0000 7f382c0ddb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffdfa9920 con 0x564ffe1d5e20 2023-10-16T13:14:55.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.402+0000 7f382c0ddb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe1df800 con 0x564ffe1d6780 2023-10-16T13:14:55.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.402+0000 7f382c0ddb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe1cbc80 con 0x564ffe1d7620 2023-10-16T13:14:55.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.402+0000 7f381dc8f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 0x564ffe1d6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.402+0000 7f381dc8f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 0x564ffe1d6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38148/0 (socket says 172.21.15.92:38148) 2023-10-16T13:14:55.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.402+0000 7f381dc8f700 1 -- 172.21.15.92:0/3228014573 learned_addr learned my addr 172.21.15.92:0/3228014573 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.402+0000 7f381d48e700 1 --2- 172.21.15.92:0/3228014573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d6780 0x564ffe1e7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.402+0000 7f381e490700 1 --2- 172.21.15.92:0/3228014573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d7620 0x564ffe1dd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.403+0000 7f381dc8f700 1 -- 172.21.15.92:0/3228014573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d7620 msgr2=0x564ffe1dd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.403+0000 7f381dc8f700 1 --2- 172.21.15.92:0/3228014573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d7620 0x564ffe1dd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.403+0000 7f381dc8f700 1 -- 172.21.15.92:0/3228014573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d6780 msgr2=0x564ffe1e7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.403+0000 7f381dc8f700 1 --2- 172.21.15.92:0/3228014573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d6780 0x564ffe1e7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.418 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.403+0000 7f381dc8f700 1 -- 172.21.15.92:0/3228014573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ffdf3cc60 con 0x564ffe1d5e20 2023-10-16T13:14:55.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.403+0000 7f381dc8f700 1 --2- 172.21.15.92:0/3228014573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 0x564ffe1d6200 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f38140117d0 tx=0x7f381401cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f62dbcea910e5df server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.403+0000 7f380cff9700 1 -- 172.21.15.92:0/3228014573 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814005b00 con 0x564ffe1d5e20 2023-10-16T13:14:55.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.403+0000 7f380cff9700 1 -- 172.21.15.92:0/3228014573 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f38140320d0 con 0x564ffe1d5e20 2023-10-16T13:14:55.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.403+0000 7f380cff9700 1 -- 172.21.15.92:0/3228014573 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814004400 con 0x564ffe1d5e20 2023-10-16T13:14:55.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.403+0000 7f382c0ddb80 1 -- 172.21.15.92:0/3228014573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 msgr2=0x564ffe1d6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.403+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/3228014573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 0x564ffe1d6200 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f38140117d0 tx=0x7f381401cf00 comp rx=0 tx=0).stop 2023-10-16T13:14:55.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.403+0000 7f382c0ddb80 1 -- 172.21.15.92:0/3228014573 shutdown_connections 2023-10-16T13:14:55.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.403+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/3228014573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 0x564ffe1d6200 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.403+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/3228014573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d7620 0x564ffe1dd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.404+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/3228014573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d6780 0x564ffe1e7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.404+0000 7f382c0ddb80 1 -- 172.21.15.92:0/3228014573 >> 172.21.15.92:0/3228014573 conn(0x564ffe103dd0 msgr2=0x564ffe1d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.404+0000 7f382c0ddb80 1 -- 172.21.15.92:0/3228014573 shutdown_connections 2023-10-16T13:14:55.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.404+0000 7f382c0ddb80 1 -- 172.21.15.92:0/3228014573 wait complete. 2023-10-16T13:14:55.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.404+0000 7f382c0ddb80 1 -- start start 2023-10-16T13:14:55.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.404+0000 7f382c0ddb80 1 Processor -- start 2023-10-16T13:14:55.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.404+0000 7f382c0ddb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 0x564ffe1e3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.404+0000 7f382c0ddb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d6780 0x564ffe1e35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.404+0000 7f382c0ddb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d7620 0x564ffe1e65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.404+0000 7f382c0ddb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe1e6b10 con 0x564ffe1d5e20 2023-10-16T13:14:55.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.404+0000 7f382c0ddb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe1e6c80 con 0x564ffe1d7620 2023-10-16T13:14:55.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.404+0000 7f382c0ddb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe1e6e40 con 0x564ffe1d6780 2023-10-16T13:14:55.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.404+0000 7f382c0ddb80 10 client.0 _ll_register_callbacks cb 0x7f38100999b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:55.423 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.404+0000 7f381dc8f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 0x564ffe1e3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.404+0000 7f381dc8f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 0x564ffe1e3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38152/0 (socket says 172.21.15.92:38152) 2023-10-16T13:14:55.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.404+0000 7f381dc8f700 1 -- 172.21.15.92:0/3134265951 learned_addr learned my addr 172.21.15.92:0/3134265951 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.425 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.404+0000 7f381d48e700 1 --2- 172.21.15.92:0/3134265951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d6780 0x564ffe1e35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.404+0000 7f381e490700 1 --2- 172.21.15.92:0/3134265951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d7620 0x564ffe1e65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.405+0000 7f381dc8f700 1 -- 172.21.15.92:0/3134265951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d6780 msgr2=0x564ffe1e35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.405+0000 7f381dc8f700 1 --2- 172.21.15.92:0/3134265951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d6780 0x564ffe1e35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.405+0000 7f381dc8f700 1 -- 172.21.15.92:0/3134265951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d7620 msgr2=0x564ffe1e65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.405+0000 7f381dc8f700 1 --2- 172.21.15.92:0/3134265951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d7620 0x564ffe1e65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.405+0000 7f381dc8f700 1 -- 172.21.15.92:0/3134265951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381402a040 con 0x564ffe1d5e20 2023-10-16T13:14:55.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.405+0000 7f381e490700 1 --2- 172.21.15.92:0/3134265951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d7620 0x564ffe1e65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:14:55.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.405+0000 7f381dc8f700 1 --2- 172.21.15.92:0/3134265951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 0x564ffe1e3070 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3814005920 tx=0x7f381400ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c442269394dffaf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.405+0000 7f38017fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:55.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.405+0000 7f38017fa700 1 -- 172.21.15.92:0/3134265951 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814032c20 con 0x564ffe1d5e20 2023-10-16T13:14:55.427 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.405+0000 7f38017fa700 1 -- 172.21.15.92:0/3134265951 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3814032240 con 0x564ffe1d5e20 2023-10-16T13:14:55.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.405+0000 7f382c0ddb80 1 -- 172.21.15.92:0/3134265951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3814021070 con 0x564ffe1d5e20 2023-10-16T13:14:55.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.405+0000 7f38017fa700 1 -- 172.21.15.92:0/3134265951 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3814032d80 con 0x564ffe1d5e20 2023-10-16T13:14:55.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.405+0000 7f382c0ddb80 10 client.15930 fetch_fsmap learned FSMap version 35 2023-10-16T13:14:55.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.405+0000 7f382c0ddb80 1 -- 172.21.15.92:0/3134265951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x564ffdf7a250 con 0x564ffe1d5e20 2023-10-16T13:14:55.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.405+0000 7f38017fa700 1 -- 172.21.15.92:0/3134265951 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3814021070 con 0x564ffe1d5e20 2023-10-16T13:14:55.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.405+0000 7f38017fa700 1 -- 172.21.15.92:0/3134265951 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 35) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f3814005560 con 0x564ffe1d5e20 2023-10-16T13:14:55.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.406+0000 7f382c0ddb80 10 client.15930 fetch_fsmap finished waiting for FSMap version 35 2023-10-16T13:14:55.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.406+0000 7f382c0ddb80 10 client.15930 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2023-10-16T13:14:55.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.406+0000 7f382c0ddb80 20 client.15930 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:55.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.406+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/3134265951 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x564ffe2406b0 0x564ffe242ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.406+0000 7f382c0ddb80 4 client.15930 mds_command: new command op to 24412 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-16T13:14:55.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.406+0000 7f382c0ddb80 1 -- 172.21.15.92:0/3134265951 --> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564ffe121e50 con 0x564ffe2406b0 2023-10-16T13:14:55.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.406+0000 7f381d48e700 1 --2- 172.21.15.92:0/3134265951 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x564ffe2406b0 0x564ffe242ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.406+0000 7f38017fa700 10 client.15930 ms_handle_connect on v2:172.21.15.152:6832/1273074399 2023-10-16T13:14:55.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.406+0000 7f381d48e700 1 --2- 172.21.15.92:0/3134265951 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x564ffe2406b0 0x564ffe242ad0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=133a551e686b8bb1 server_cookie=ea3493481a942d2f in_seq=0 out_seq=0 2023-10-16T13:14:55.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.406+0000 7f38017fa700 1 -- 172.21.15.92:0/3134265951 <== mds.4 v2:172.21.15.152:6832/1273074399 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564ffe121e50 con 0x564ffe2406b0 2023-10-16T13:14:55.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.406+0000 7f38017fa700 10 client.15930 handle_command_reply: tid=0 2023-10-16T13:14:55.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.406+0000 7f382c0ddb80 1 client.15930 shutdown 2023-10-16T13:14:55.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.406+0000 7f382c0ddb80 1 -- 172.21.15.92:0/3134265951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 msgr2=0x564ffe1e3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.406+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/3134265951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 0x564ffe1e3070 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3814005920 tx=0x7f381400ea80 comp rx=0 tx=0).stop 2023-10-16T13:14:55.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f382c0ddb80 1 -- 172.21.15.92:0/3134265951 shutdown_connections 2023-10-16T13:14:55.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/3134265951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ffe1d5e20 0x564ffe1e3070 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/3134265951 >> [v2:172.21.15.152:6832/1273074399,v1:172.21.15.152:6833/1273074399] conn(0x564ffe2406b0 0x564ffe242ad0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/3134265951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe1d7620 0x564ffe1e65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f38017fa700 0 client.15930 ms_handle_reset on v2:172.21.15.152:6832/1273074399 2023-10-16T13:14:55.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f382c0ddb80 1 --2- 172.21.15.92:0/3134265951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ffe1d6780 0x564ffe1e35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f382c0ddb80 1 -- 172.21.15.92:0/3134265951 >> 172.21.15.92:0/3134265951 conn(0x564ffe103dd0 msgr2=0x564ffe1dd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f382c0ddb80 1 -- 172.21.15.92:0/3134265951 shutdown_connections 2023-10-16T13:14:55.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f382c0ddb80 1 -- 172.21.15.92:0/3134265951 wait complete. 2023-10-16T13:14:55.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f382c0ddb80 20 client.15930 trim_cache size 0 max 16384 2023-10-16T13:14:55.433 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2023-10-16T13:14:55.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f381fef3700 1 -- 172.21.15.92:0/1519985278 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f38040a1480 msgr2=0x7f38040a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f381fef3700 1 --2- 172.21.15.92:0/1519985278 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f38040a1480 0x7f38040a3940 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3818100e10 tx=0x7f3814009260 comp rx=0 tx=0).stop 2023-10-16T13:14:55.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f381fef3700 1 -- 172.21.15.92:0/1519985278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3818101950 msgr2=0x7f38181028d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f381fef3700 1 --2- 172.21.15.92:0/1519985278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3818101950 0x7f38181028d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f381000ef30 tx=0x7f381000c3a0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f381fef3700 1 -- 172.21.15.92:0/1519985278 shutdown_connections 2023-10-16T13:14:55.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f381fef3700 1 --2- 172.21.15.92:0/1519985278 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f38040a1480 0x7f38040a3940 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f381fef3700 1 --2- 172.21.15.92:0/1519985278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3818101950 0x7f38181028d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f381fef3700 1 --2- 172.21.15.92:0/1519985278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38180ffdc0 0x7f3818103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f381fef3700 1 --2- 172.21.15.92:0/1519985278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3818100fb0 0x7f3818102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f381fef3700 1 -- 172.21.15.92:0/1519985278 >> 172.21.15.92:0/1519985278 conn(0x7f38180fb2f0 msgr2=0x7f3818069040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f381fef3700 1 -- 172.21.15.92:0/1519985278 shutdown_connections 2023-10-16T13:14:55.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.407+0000 7f381fef3700 1 -- 172.21.15.92:0/1519985278 wait complete. 2023-10-16T13:14:55.437 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-16T13:14:55.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.575+0000 7fb40e5f5700 1 -- 172.21.15.92:0/3959827686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4080ffe20 msgr2=0x7fb408100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.575+0000 7fb40e5f5700 1 --2- 172.21.15.92:0/3959827686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4080ffe20 0x7fb408100240 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009990 tx=0x7fb3f8009ca0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.575+0000 7fb40e5f5700 1 -- 172.21.15.92:0/3959827686 shutdown_connections 2023-10-16T13:14:55.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.575+0000 7fb40e5f5700 1 --2- 172.21.15.92:0/3959827686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4080ffe20 0x7fb408100240 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.575+0000 7fb40e5f5700 1 --2- 172.21.15.92:0/3959827686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb408101930 0x7fb408108250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.575+0000 7fb40e5f5700 1 --2- 172.21.15.92:0/3959827686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb408100f70 0x7fb4081013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.575+0000 7fb40e5f5700 1 -- 172.21.15.92:0/3959827686 >> 172.21.15.92:0/3959827686 conn(0x7fb4080fb3b0 msgr2=0x7fb4080fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.575+0000 7fb40e5f5700 1 -- 172.21.15.92:0/3959827686 shutdown_connections 2023-10-16T13:14:55.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.575+0000 7fb40e5f5700 1 -- 172.21.15.92:0/3959827686 wait complete. 2023-10-16T13:14:55.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.575+0000 7fb40e5f5700 1 Processor -- start 2023-10-16T13:14:55.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.576+0000 7fb40e5f5700 1 -- start start 2023-10-16T13:14:55.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.576+0000 7fb40e5f5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4080ffe20 0x7fb408195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.576+0000 7fb40e5f5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb408100f70 0x7fb4081960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.576+0000 7fb40e5f5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb408101930 0x7fb40819d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.576+0000 7fb40e5f5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40819d710 con 0x7fb408101930 2023-10-16T13:14:55.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.576+0000 7fb40e5f5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40819d850 con 0x7fb4080ffe20 2023-10-16T13:14:55.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.576+0000 7fb40e5f5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40819d9e0 con 0x7fb408100f70 2023-10-16T13:14:55.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.576+0000 7fb40cb92700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb408101930 0x7fb40819d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.576+0000 7fb4077fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb408100f70 0x7fb4081960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.576+0000 7fb40cb92700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb408101930 0x7fb40819d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38168/0 (socket says 172.21.15.92:38168) 2023-10-16T13:14:55.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.576+0000 7fb40cb92700 1 -- 172.21.15.92:0/3112947196 learned_addr learned my addr 172.21.15.92:0/3112947196 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.576+0000 7fb407fff700 1 --2- 172.21.15.92:0/3112947196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4080ffe20 0x7fb408195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.576+0000 7fb40cb92700 1 -- 172.21.15.92:0/3112947196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb408100f70 msgr2=0x7fb4081960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.576+0000 7fb40cb92700 1 --2- 172.21.15.92:0/3112947196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb408100f70 0x7fb4081960d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.576+0000 7fb40cb92700 1 -- 172.21.15.92:0/3112947196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4080ffe20 msgr2=0x7fb408195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.576+0000 7fb40cb92700 1 --2- 172.21.15.92:0/3112947196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4080ffe20 0x7fb408195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.576+0000 7fb40cb92700 1 -- 172.21.15.92:0/3112947196 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f80095f0 con 0x7fb408101930 2023-10-16T13:14:55.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.576+0000 7fb4077fe700 1 --2- 172.21.15.92:0/3112947196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb408100f70 0x7fb4081960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:55.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.576+0000 7fb407fff700 1 --2- 172.21.15.92:0/3112947196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4080ffe20 0x7fb408195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:14:55.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.577+0000 7fb40cb92700 1 --2- 172.21.15.92:0/3112947196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb408101930 0x7fb40819d140 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb400007ee0 tx=0x7fb40000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.577+0000 7fb4057fa700 1 -- 172.21.15.92:0/3112947196 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400017070 con 0x7fb408101930 2023-10-16T13:14:55.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.577+0000 7fb40e5f5700 1 -- 172.21.15.92:0/3112947196 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40819dcc0 con 0x7fb408101930 2023-10-16T13:14:55.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.577+0000 7fb4057fa700 1 -- 172.21.15.92:0/3112947196 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb40000f040 con 0x7fb408101930 2023-10-16T13:14:55.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.577+0000 7fb4057fa700 1 -- 172.21.15.92:0/3112947196 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400005760 con 0x7fb408101930 2023-10-16T13:14:55.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.577+0000 7fb40e5f5700 1 -- 172.21.15.92:0/3112947196 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40819e180 con 0x7fb408101930 2023-10-16T13:14:55.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.579+0000 7fb4057fa700 1 -- 172.21.15.92:0/3112947196 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb4000058c0 con 0x7fb408101930 2023-10-16T13:14:55.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.580+0000 7fb4057fa700 1 --2- 172.21.15.92:0/3112947196 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb3f00a1480 0x7fb3f00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.580+0000 7fb407fff700 1 --2- 172.21.15.92:0/3112947196 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb3f00a1480 0x7fb3f00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.580+0000 7fb4057fa700 1 -- 172.21.15.92:0/3112947196 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb4000cc490 con 0x7fb408101930 2023-10-16T13:14:55.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.580+0000 7fb407fff700 1 --2- 172.21.15.92:0/3112947196 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb3f00a1480 0x7fb3f00a3940 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800b2e0 tx=0x7fb3f8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.581+0000 7fb41a7dfb80 1 Processor -- start 2023-10-16T13:14:55.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.581+0000 7fb41a7dfb80 1 -- start start 2023-10-16T13:14:55.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.581+0000 7fb41a7dfb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a20b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.581+0000 7fb41a7dfb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20b780 0x56461a20c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.581+0000 7fb41a7dfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20c620 0x56461a20caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.581+0000 7fb41a7dfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56461a17fc70 con 0x56461a20c620 2023-10-16T13:14:55.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.581+0000 7fb41a7dfb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56461a164c60 con 0x56461a20ae20 2023-10-16T13:14:55.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.581+0000 7fb41a7dfb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56461a162580 con 0x56461a20b780 2023-10-16T13:14:55.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.581+0000 7fb40cb92700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20c620 0x56461a20caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.581+0000 7fb4077fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20b780 0x56461a20c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.581+0000 7fb40cb92700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20c620 0x56461a20caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38176/0 (socket says 172.21.15.92:38176) 2023-10-16T13:14:55.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.581+0000 7fb40cb92700 1 -- 172.21.15.92:0/2208237396 learned_addr learned my addr 172.21.15.92:0/2208237396 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.581+0000 7fb407fff700 1 --2- 172.21.15.92:0/2208237396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a20b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.581+0000 7fb4077fe700 1 -- 172.21.15.92:0/2208237396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 msgr2=0x56461a20b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.581+0000 7fb4077fe700 1 --2- 172.21.15.92:0/2208237396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a20b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.581+0000 7fb4077fe700 1 -- 172.21.15.92:0/2208237396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20c620 msgr2=0x56461a20caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.581+0000 7fb4077fe700 1 --2- 172.21.15.92:0/2208237396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20c620 0x56461a20caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.581+0000 7fb4077fe700 1 -- 172.21.15.92:0/2208237396 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56461a11b3f0 con 0x56461a20b780 2023-10-16T13:14:55.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.581+0000 7fb40cb92700 1 --2- 172.21.15.92:0/2208237396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20c620 0x56461a20caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:55.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.582+0000 7fb4077fe700 1 --2- 172.21.15.92:0/2208237396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20b780 0x56461a20c040 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc0114f0 tx=0x7fb3fc011800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa13917d2d1dc0c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.582+0000 7fb3ee7fc700 1 -- 172.21.15.92:0/2208237396 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc004230 con 0x56461a20b780 2023-10-16T13:14:55.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.582+0000 7fb3ee7fc700 1 -- 172.21.15.92:0/2208237396 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb3fc004d10 con 0x56461a20b780 2023-10-16T13:14:55.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.582+0000 7fb3ee7fc700 1 -- 172.21.15.92:0/2208237396 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc005690 con 0x56461a20b780 2023-10-16T13:14:55.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.582+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/2208237396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20b780 msgr2=0x56461a20c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.598 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.582+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/2208237396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20b780 0x56461a20c040 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc0114f0 tx=0x7fb3fc011800 comp rx=0 tx=0).stop 2023-10-16T13:14:55.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.583+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/2208237396 shutdown_connections 2023-10-16T13:14:55.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.583+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/2208237396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20c620 0x56461a20caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.583+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/2208237396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a20b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.583+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/2208237396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20b780 0x56461a20c040 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.599 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.583+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/2208237396 >> 172.21.15.92:0/2208237396 conn(0x56461a138dd0 msgr2=0x56461a205fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.583+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/2208237396 shutdown_connections 2023-10-16T13:14:55.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.583+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/2208237396 wait complete. 2023-10-16T13:14:55.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.583+0000 7fb41a7dfb80 1 -- start start 2023-10-16T13:14:55.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.583+0000 7fb41a7dfb80 1 Processor -- start 2023-10-16T13:14:55.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.583+0000 7fb41a7dfb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a214c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.583+0000 7fb41a7dfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20b780 0x56461a215140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.583+0000 7fb41a7dfb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20c620 0x56461a21c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.583+0000 7fb41a7dfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56461a15de70 con 0x56461a20b780 2023-10-16T13:14:55.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.583+0000 7fb41a7dfb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56461a0fa710 con 0x56461a20ae20 2023-10-16T13:14:55.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.583+0000 7fb41a7dfb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56461a0fa3b0 con 0x56461a20c620 2023-10-16T13:14:55.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.583+0000 7fb41a7dfb80 10 client.0 _ll_register_callbacks cb 0x564619f57800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:55.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.583+0000 7fb4077fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20b780 0x56461a215140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.583+0000 7fb407fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a214c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.584+0000 7fb407fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a214c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:38986/0 (socket says 172.21.15.92:38986) 2023-10-16T13:14:55.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.584+0000 7fb4077fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20b780 0x56461a215140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38180/0 (socket says 172.21.15.92:38180) 2023-10-16T13:14:55.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.584+0000 7fb407fff700 1 -- 172.21.15.92:0/1093555941 learned_addr learned my addr 172.21.15.92:0/1093555941 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.584+0000 7fb40cb92700 1 --2- 172.21.15.92:0/1093555941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20c620 0x56461a21c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.584+0000 7fb407fff700 1 -- 172.21.15.92:0/1093555941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20c620 msgr2=0x56461a21c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.584+0000 7fb407fff700 1 --2- 172.21.15.92:0/1093555941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20c620 0x56461a21c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.584+0000 7fb407fff700 1 -- 172.21.15.92:0/1093555941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20b780 msgr2=0x56461a215140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.584+0000 7fb407fff700 1 --2- 172.21.15.92:0/1093555941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20b780 0x56461a215140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.584+0000 7fb407fff700 1 -- 172.21.15.92:0/1093555941 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40819e180 con 0x56461a20ae20 2023-10-16T13:14:55.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.584+0000 7fb407fff700 1 --2- 172.21.15.92:0/1093555941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a214c00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800fb70 tx=0x7fb3f801a050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b69f52aa5163d34 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.584+0000 7fb3e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-16T13:14:55.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.584+0000 7fb3e77fe700 1 -- 172.21.15.92:0/1093555941 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f802b070 con 0x56461a20ae20 2023-10-16T13:14:55.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.584+0000 7fb3e77fe700 1 -- 172.21.15.92:0/1093555941 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb3f8005250 con 0x56461a20ae20 2023-10-16T13:14:55.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.584+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/1093555941 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56461a162ef0 con 0x56461a20ae20 2023-10-16T13:14:55.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.584+0000 7fb3e77fe700 1 -- 172.21.15.92:0/1093555941 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3f8005410 con 0x56461a20ae20 2023-10-16T13:14:55.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.584+0000 7fb41a7dfb80 10 client.25487 fetch_fsmap learned FSMap version 35 2023-10-16T13:14:55.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.584+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/1093555941 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7fb3fc009c90 con 0x56461a20ae20 2023-10-16T13:14:55.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.584+0000 7fb3e77fe700 1 -- 172.21.15.92:0/1093555941 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x56461a162ef0 con 0x56461a20ae20 2023-10-16T13:14:55.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.585+0000 7fb3e77fe700 1 -- 172.21.15.92:0/1093555941 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 35) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fb3f8024710 con 0x56461a20ae20 2023-10-16T13:14:55.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.585+0000 7fb41a7dfb80 10 client.25487 fetch_fsmap finished waiting for FSMap version 35 2023-10-16T13:14:55.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.585+0000 7fb41a7dfb80 10 client.25487 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-10-16T13:14:55.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.585+0000 7fb41a7dfb80 20 client.25487 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:55.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.585+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/1093555941 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x56461a220a50 0x56461a222e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.606 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.585+0000 7fb41a7dfb80 4 client.25487 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:14:55.607 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.585+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/1093555941 --> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56461a1dac10 con 0x56461a220a50 2023-10-16T13:14:55.607 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.585+0000 7fb4077fe700 1 --2- 172.21.15.92:0/1093555941 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x56461a220a50 0x56461a222e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.607 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.585+0000 7fb4077fe700 1 --2- 172.21.15.92:0/1093555941 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x56461a220a50 0x56461a222e70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7374ea36b3a79793 server_cookie=94476f2bea8c0a5c in_seq=0 out_seq=0 2023-10-16T13:14:55.607 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.585+0000 7fb3e77fe700 10 client.25487 ms_handle_connect on v2:172.21.15.118:6834/2381374755 2023-10-16T13:14:55.607 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.586+0000 7fb3e77fe700 1 -- 172.21.15.92:0/1093555941 <== mds.3 v2:172.21.15.118:6834/2381374755 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56461a1dac10 con 0x56461a220a50 2023-10-16T13:14:55.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.586+0000 7fb3e77fe700 10 client.25487 handle_command_reply: tid=0 2023-10-16T13:14:55.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.586+0000 7fb41a7dfb80 1 client.25487 shutdown 2023-10-16T13:14:55.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.586+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/1093555941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 msgr2=0x56461a214c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.586+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/1093555941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a214c00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800fb70 tx=0x7fb3f801a050 comp rx=0 tx=0).stop 2023-10-16T13:14:55.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.586+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/1093555941 shutdown_connections 2023-10-16T13:14:55.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.586+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/1093555941 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x56461a220a50 0x56461a222e70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.586+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/1093555941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20c620 0x56461a21c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.586+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/1093555941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a214c00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.586+0000 7fb3e77fe700 0 client.25487 ms_handle_reset on v2:172.21.15.118:6834/2381374755 2023-10-16T13:14:55.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.586+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/1093555941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20b780 0x56461a215140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.586+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/1093555941 >> 172.21.15.92:0/1093555941 conn(0x56461a138dd0 msgr2=0x56461a205bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.586+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/1093555941 shutdown_connections 2023-10-16T13:14:55.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.586+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/1093555941 wait complete. 2023-10-16T13:14:55.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.586+0000 7fb41a7dfb80 20 client.25487 trim_cache size 0 max 16384 2023-10-16T13:14:55.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.599+0000 7fb41a7dfb80 1 Processor -- start 2023-10-16T13:14:55.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.599+0000 7fb41a7dfb80 1 -- start start 2023-10-16T13:14:55.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.599+0000 7fb41a7dfb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a20ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.599+0000 7fb41a7dfb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20b780 0x56461a21c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.599+0000 7fb41a7dfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20c620 0x56461a2047a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.599+0000 7fb41a7dfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564619fde920 con 0x56461a20c620 2023-10-16T13:14:55.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.599+0000 7fb41a7dfb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56461a2140b0 con 0x56461a20ae20 2023-10-16T13:14:55.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.599+0000 7fb41a7dfb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56461a214770 con 0x56461a20b780 2023-10-16T13:14:55.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.600+0000 7fb407fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a20ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.600+0000 7fb4077fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20b780 0x56461a21c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.600+0000 7fb407fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a20ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:38994/0 (socket says 172.21.15.92:38994) 2023-10-16T13:14:55.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.600+0000 7fb40cb92700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20c620 0x56461a2047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.600+0000 7fb407fff700 1 -- 172.21.15.92:0/2967806147 learned_addr learned my addr 172.21.15.92:0/2967806147 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.600+0000 7fb407fff700 1 -- 172.21.15.92:0/2967806147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20b780 msgr2=0x56461a21c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.600+0000 7fb407fff700 1 --2- 172.21.15.92:0/2967806147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20b780 0x56461a21c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.600+0000 7fb407fff700 1 -- 172.21.15.92:0/2967806147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20c620 msgr2=0x56461a2047a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.600+0000 7fb407fff700 1 --2- 172.21.15.92:0/2967806147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20c620 0x56461a2047a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.600+0000 7fb407fff700 1 -- 172.21.15.92:0/2967806147 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564619f88de0 con 0x56461a20ae20 2023-10-16T13:14:55.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.600+0000 7fb407fff700 1 --2- 172.21.15.92:0/2967806147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a20ca00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009990 tx=0x7fb3f800ff60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b10eb19db35e60 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.600+0000 7fb3eeffd700 1 -- 172.21.15.92:0/2967806147 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f802b070 con 0x56461a20ae20 2023-10-16T13:14:55.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.600+0000 7fb3eeffd700 1 -- 172.21.15.92:0/2967806147 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb3f802c040 con 0x56461a20ae20 2023-10-16T13:14:55.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.600+0000 7fb3eeffd700 1 -- 172.21.15.92:0/2967806147 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8004880 con 0x56461a20ae20 2023-10-16T13:14:55.619 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.601+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/2967806147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 msgr2=0x56461a20ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.601+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/2967806147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a20ca00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009990 tx=0x7fb3f800ff60 comp rx=0 tx=0).stop 2023-10-16T13:14:55.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.601+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/2967806147 shutdown_connections 2023-10-16T13:14:55.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.601+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/2967806147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20c620 0x56461a2047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.601+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/2967806147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a20ca00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.601+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/2967806147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20b780 0x56461a21c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.601+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/2967806147 >> 172.21.15.92:0/2967806147 conn(0x56461a138dd0 msgr2=0x56461a213920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.601+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/2967806147 shutdown_connections 2023-10-16T13:14:55.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.601+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/2967806147 wait complete. 2023-10-16T13:14:55.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.601+0000 7fb41a7dfb80 1 -- start start 2023-10-16T13:14:55.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.601+0000 7fb41a7dfb80 1 Processor -- start 2023-10-16T13:14:55.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.601+0000 7fb41a7dfb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a217dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.601+0000 7fb41a7dfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20b780 0x56461a218300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.601+0000 7fb41a7dfb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20c620 0x56461a21b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.601+0000 7fb41a7dfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56461a21b860 con 0x56461a20b780 2023-10-16T13:14:55.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.601+0000 7fb41a7dfb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56461a21b9d0 con 0x56461a20ae20 2023-10-16T13:14:55.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb41a7dfb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56461a21bb90 con 0x56461a20c620 2023-10-16T13:14:55.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb41a7dfb80 10 client.0 _ll_register_callbacks cb 0x564619f57800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:55.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb4077fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20b780 0x56461a218300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb4077fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20b780 0x56461a218300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38194/0 (socket says 172.21.15.92:38194) 2023-10-16T13:14:55.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb4077fe700 1 -- 172.21.15.92:0/1775217348 learned_addr learned my addr 172.21.15.92:0/1775217348 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb40cb92700 1 --2- 172.21.15.92:0/1775217348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20c620 0x56461a21b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb407fff700 1 --2- 172.21.15.92:0/1775217348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a217dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb4077fe700 1 -- 172.21.15.92:0/1775217348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20c620 msgr2=0x56461a21b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb4077fe700 1 --2- 172.21.15.92:0/1775217348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20c620 0x56461a21b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb4077fe700 1 -- 172.21.15.92:0/1775217348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 msgr2=0x56461a217dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb4077fe700 1 --2- 172.21.15.92:0/1775217348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a217dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb4077fe700 1 -- 172.21.15.92:0/1775217348 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3fc009c90 con 0x56461a20b780 2023-10-16T13:14:55.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb4077fe700 1 --2- 172.21.15.92:0/1775217348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20b780 0x56461a218300 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x56461a206f70 tx=0x7fb3fc0092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629c437e77b6eb76 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb3e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:55.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb3e77fe700 1 -- 172.21.15.92:0/1775217348 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc02c070 con 0x56461a20b780 2023-10-16T13:14:55.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb3e77fe700 1 -- 172.21.15.92:0/1775217348 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb3fc005690 con 0x56461a20b780 2023-10-16T13:14:55.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/1775217348 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb3fc004d10 con 0x56461a20b780 2023-10-16T13:14:55.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb3e77fe700 1 -- 172.21.15.92:0/1775217348 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3fc004fc0 con 0x56461a20b780 2023-10-16T13:14:55.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb41a7dfb80 10 client.15948 fetch_fsmap learned FSMap version 35 2023-10-16T13:14:55.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.602+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/1775217348 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x564619f71c60 con 0x56461a20b780 2023-10-16T13:14:55.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.603+0000 7fb3e77fe700 1 -- 172.21.15.92:0/1775217348 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb3fc004d10 con 0x56461a20b780 2023-10-16T13:14:55.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.603+0000 7fb3e77fe700 1 -- 172.21.15.92:0/1775217348 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 35) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fb3fc019910 con 0x56461a20b780 2023-10-16T13:14:55.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.603+0000 7fb41a7dfb80 10 client.15948 fetch_fsmap finished waiting for FSMap version 35 2023-10-16T13:14:55.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.603+0000 7fb41a7dfb80 10 client.15948 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-10-16T13:14:55.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.603+0000 7fb41a7dfb80 20 client.15948 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:55.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.603+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/1775217348 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x56461a220a50 0x56461a277710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.603+0000 7fb41a7dfb80 4 client.15948 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-16T13:14:55.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.603+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/1775217348 --> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56461a156e50 con 0x56461a220a50 2023-10-16T13:14:55.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.603+0000 7fb407fff700 1 --2- 172.21.15.92:0/1775217348 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x56461a220a50 0x56461a277710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.603+0000 7fb3e77fe700 10 client.15948 ms_handle_connect on v2:172.21.15.118:6834/2381374755 2023-10-16T13:14:55.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.603+0000 7fb407fff700 1 --2- 172.21.15.92:0/1775217348 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x56461a220a50 0x56461a277710 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=816dcf799aeb75ed server_cookie=2a400302f80c1681 in_seq=0 out_seq=0 2023-10-16T13:14:55.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.603+0000 7fb3e77fe700 1 -- 172.21.15.92:0/1775217348 <== mds.3 v2:172.21.15.118:6834/2381374755 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56461a156e50 con 0x56461a220a50 2023-10-16T13:14:55.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.603+0000 7fb3e77fe700 10 client.15948 handle_command_reply: tid=0 2023-10-16T13:14:55.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.603+0000 7fb41a7dfb80 1 client.15948 shutdown 2023-10-16T13:14:55.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/1775217348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20b780 msgr2=0x56461a218300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/1775217348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20b780 0x56461a218300 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x56461a206f70 tx=0x7fb3fc0092b0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/1775217348 shutdown_connections 2023-10-16T13:14:55.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/1775217348 >> [v2:172.21.15.118:6834/2381374755,v1:172.21.15.118:6835/2381374755] conn(0x56461a220a50 0x56461a277710 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/1775217348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56461a20c620 0x56461a21b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/1775217348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56461a20ae20 0x56461a217dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb3e77fe700 0 client.15948 ms_handle_reset on v2:172.21.15.118:6834/2381374755 2023-10-16T13:14:55.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb41a7dfb80 1 --2- 172.21.15.92:0/1775217348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56461a20b780 0x56461a218300 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/1775217348 >> 172.21.15.92:0/1775217348 conn(0x56461a138dd0 msgr2=0x56461a2047a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/1775217348 shutdown_connections 2023-10-16T13:14:55.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb41a7dfb80 1 -- 172.21.15.92:0/1775217348 wait complete. 2023-10-16T13:14:55.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb41a7dfb80 20 client.15948 trim_cache size 0 max 16384 2023-10-16T13:14:55.633 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2023-10-16T13:14:55.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb40e5f5700 1 -- 172.21.15.92:0/3112947196 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb3f00a1480 msgr2=0x7fb3f00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb40e5f5700 1 --2- 172.21.15.92:0/3112947196 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb3f00a1480 0x7fb3f00a3940 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800b2e0 tx=0x7fb3f8005fd0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb40e5f5700 1 -- 172.21.15.92:0/3112947196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb408101930 msgr2=0x7fb40819d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb40e5f5700 1 --2- 172.21.15.92:0/3112947196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb408101930 0x7fb40819d140 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb400007ee0 tx=0x7fb40000d3b0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb40e5f5700 1 -- 172.21.15.92:0/3112947196 shutdown_connections 2023-10-16T13:14:55.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb40e5f5700 1 --2- 172.21.15.92:0/3112947196 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb3f00a1480 0x7fb3f00a3940 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb40e5f5700 1 --2- 172.21.15.92:0/3112947196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb408101930 0x7fb40819d140 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb40e5f5700 1 --2- 172.21.15.92:0/3112947196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4080ffe20 0x7fb408195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb40e5f5700 1 --2- 172.21.15.92:0/3112947196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb408100f70 0x7fb4081960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb40e5f5700 1 -- 172.21.15.92:0/3112947196 >> 172.21.15.92:0/3112947196 conn(0x7fb4080fb3b0 msgr2=0x7fb4080fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb40e5f5700 1 -- 172.21.15.92:0/3112947196 shutdown_connections 2023-10-16T13:14:55.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.604+0000 7fb40e5f5700 1 -- 172.21.15.92:0/3112947196 wait complete. 2023-10-16T13:14:55.636 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:55 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1509396393' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:14:55.637 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-16T13:14:55.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:55 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1509396393' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:14:55.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.769+0000 7ff4242b0700 1 -- 172.21.15.92:0/3213436020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c106bf0 msgr2=0x7ff41c109000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.769+0000 7ff4242b0700 1 --2- 172.21.15.92:0/3213436020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c106bf0 0x7ff41c109000 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff41400b0a0 tx=0x7ff41400b3b0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.769+0000 7ff4242b0700 1 -- 172.21.15.92:0/3213436020 shutdown_connections 2023-10-16T13:14:55.772 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.769+0000 7ff4242b0700 1 --2- 172.21.15.92:0/3213436020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c106bf0 0x7ff41c109000 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.769+0000 7ff4242b0700 1 --2- 172.21.15.92:0/3213436020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff41c101990 0x7ff41c103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.769+0000 7ff4242b0700 1 --2- 172.21.15.92:0/3213436020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff41c1042c0 0x7ff41c1066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.769+0000 7ff4242b0700 1 -- 172.21.15.92:0/3213436020 >> 172.21.15.92:0/3213436020 conn(0x7ff41c0fb320 msgr2=0x7ff41c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.769+0000 7ff4242b0700 1 -- 172.21.15.92:0/3213436020 shutdown_connections 2023-10-16T13:14:55.773 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.769+0000 7ff4242b0700 1 -- 172.21.15.92:0/3213436020 wait complete. 2023-10-16T13:14:55.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.770+0000 7ff4242b0700 1 Processor -- start 2023-10-16T13:14:55.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.770+0000 7ff4242b0700 1 -- start start 2023-10-16T13:14:55.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.770+0000 7ff4242b0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff41c101990 0x7ff41c196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.770+0000 7ff4242b0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c1042c0 0x7ff41c197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.770+0000 7ff4242b0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff41c106bf0 0x7ff41c19e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.770+0000 7ff4242b0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c19e890 con 0x7ff41c1042c0 2023-10-16T13:14:55.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.770+0000 7ff4242b0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c19ea00 con 0x7ff41c101990 2023-10-16T13:14:55.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.770+0000 7ff4242b0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c19ebc0 con 0x7ff41c106bf0 2023-10-16T13:14:55.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.770+0000 7ff42184b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c1042c0 0x7ff41c197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.770+0000 7ff42184b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c1042c0 0x7ff41c197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38208/0 (socket says 172.21.15.92:38208) 2023-10-16T13:14:55.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.770+0000 7ff42204c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff41c101990 0x7ff41c196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.770+0000 7ff42184b700 1 -- 172.21.15.92:0/4104153519 learned_addr learned my addr 172.21.15.92:0/4104153519 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.770+0000 7ff42284d700 1 --2- 172.21.15.92:0/4104153519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff41c106bf0 0x7ff41c19e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.770+0000 7ff42184b700 1 -- 172.21.15.92:0/4104153519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff41c106bf0 msgr2=0x7ff41c19e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.770+0000 7ff42184b700 1 --2- 172.21.15.92:0/4104153519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff41c106bf0 0x7ff41c19e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.770+0000 7ff42184b700 1 -- 172.21.15.92:0/4104153519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff41c101990 msgr2=0x7ff41c196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.770+0000 7ff42184b700 1 --2- 172.21.15.92:0/4104153519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff41c101990 0x7ff41c196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.770+0000 7ff42184b700 1 -- 172.21.15.92:0/4104153519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff418009520 con 0x7ff41c1042c0 2023-10-16T13:14:55.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.770+0000 7ff42204c700 1 --2- 172.21.15.92:0/4104153519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff41c101990 0x7ff41c196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:55.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.771+0000 7ff42184b700 1 --2- 172.21.15.92:0/4104153519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c1042c0 0x7ff41c197290 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00e9a0 tx=0x7ff40c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.771+0000 7ff4137fe700 1 -- 172.21.15.92:0/4104153519 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c009790 con 0x7ff41c1042c0 2023-10-16T13:14:55.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.771+0000 7ff4137fe700 1 -- 172.21.15.92:0/4104153519 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff40c010430 con 0x7ff41c1042c0 2023-10-16T13:14:55.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.771+0000 7ff4242b0700 1 -- 172.21.15.92:0/4104153519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff414009d00 con 0x7ff41c1042c0 2023-10-16T13:14:55.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.771+0000 7ff4137fe700 1 -- 172.21.15.92:0/4104153519 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c018680 con 0x7ff41c1042c0 2023-10-16T13:14:55.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.771+0000 7ff4242b0700 1 -- 172.21.15.92:0/4104153519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41c19f1d0 con 0x7ff41c1042c0 2023-10-16T13:14:55.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.773+0000 7ff4137fe700 1 -- 172.21.15.92:0/4104153519 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff40c010910 con 0x7ff41c1042c0 2023-10-16T13:14:55.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.773+0000 7ff4137fe700 1 --2- 172.21.15.92:0/4104153519 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff4080a1480 0x7ff4080a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.774+0000 7ff4137fe700 1 -- 172.21.15.92:0/4104153519 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff40c014070 con 0x7ff41c1042c0 2023-10-16T13:14:55.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.774+0000 7ff42204c700 1 --2- 172.21.15.92:0/4104153519 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff4080a1480 0x7ff4080a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.774+0000 7ff42204c700 1 --2- 172.21.15.92:0/4104153519 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff4080a1480 0x7ff4080a3940 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff418009fd0 tx=0x7ff418009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.774+0000 7ff43049ab80 1 Processor -- start 2023-10-16T13:14:55.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.775+0000 7ff43049ab80 1 -- start start 2023-10-16T13:14:55.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.775+0000 7ff43049ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100230 0x562ab8100650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.775+0000 7ff43049ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ab8100b90 0x562ab8101450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.775+0000 7ff43049ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8101a30 0x562ab8101eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.775+0000 7ff43049ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab8070c70 con 0x562ab8100230 2023-10-16T13:14:55.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.775+0000 7ff43049ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab8055c60 con 0x562ab8101a30 2023-10-16T13:14:55.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.775+0000 7ff43049ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab8053580 con 0x562ab8100b90 2023-10-16T13:14:55.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.775+0000 7ff42204c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100230 0x562ab8100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.775+0000 7ff42204c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100230 0x562ab8100650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38214/0 (socket says 172.21.15.92:38214) 2023-10-16T13:14:55.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.775+0000 7ff42204c700 1 -- 172.21.15.92:0/3652374109 learned_addr learned my addr 172.21.15.92:0/3652374109 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.788 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.775+0000 7ff42284d700 1 --2- 172.21.15.92:0/3652374109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8101a30 0x562ab8101eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.775+0000 7ff42184b700 1 --2- 172.21.15.92:0/3652374109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ab8100b90 0x562ab8101450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.775+0000 7ff42204c700 1 -- 172.21.15.92:0/3652374109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ab8100b90 msgr2=0x562ab8101450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.775+0000 7ff42204c700 1 --2- 172.21.15.92:0/3652374109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ab8100b90 0x562ab8101450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.775+0000 7ff42204c700 1 -- 172.21.15.92:0/3652374109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8101a30 msgr2=0x562ab8101eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.775+0000 7ff42204c700 1 --2- 172.21.15.92:0/3652374109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8101a30 0x562ab8101eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.775+0000 7ff42204c700 1 -- 172.21.15.92:0/3652374109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ab800c3f0 con 0x562ab8100230 2023-10-16T13:14:55.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.775+0000 7ff42204c700 1 --2- 172.21.15.92:0/3652374109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100230 0x562ab8100650 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff4180043d0 tx=0x7ff418014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ef7dff12b7a193 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.775+0000 7ff410d82700 1 -- 172.21.15.92:0/3652374109 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418003d10 con 0x562ab8100230 2023-10-16T13:14:55.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.776+0000 7ff410d82700 1 -- 172.21.15.92:0/3652374109 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff418003e70 con 0x562ab8100230 2023-10-16T13:14:55.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.776+0000 7ff410d82700 1 -- 172.21.15.92:0/3652374109 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41801e660 con 0x562ab8100230 2023-10-16T13:14:55.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.776+0000 7ff43049ab80 1 -- 172.21.15.92:0/3652374109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100230 msgr2=0x562ab8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.776+0000 7ff43049ab80 1 --2- 172.21.15.92:0/3652374109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100230 0x562ab8100650 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff4180043d0 tx=0x7ff418014000 comp rx=0 tx=0).stop 2023-10-16T13:14:55.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.776+0000 7ff43049ab80 1 -- 172.21.15.92:0/3652374109 shutdown_connections 2023-10-16T13:14:55.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.776+0000 7ff43049ab80 1 --2- 172.21.15.92:0/3652374109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100230 0x562ab8100650 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.776+0000 7ff43049ab80 1 --2- 172.21.15.92:0/3652374109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8101a30 0x562ab8101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.776+0000 7ff43049ab80 1 --2- 172.21.15.92:0/3652374109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ab8100b90 0x562ab8101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.776+0000 7ff43049ab80 1 -- 172.21.15.92:0/3652374109 >> 172.21.15.92:0/3652374109 conn(0x562ab8029dd0 msgr2=0x562ab80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.776+0000 7ff43049ab80 1 -- 172.21.15.92:0/3652374109 shutdown_connections 2023-10-16T13:14:55.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.776+0000 7ff43049ab80 1 -- 172.21.15.92:0/3652374109 wait complete. 2023-10-16T13:14:55.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff43049ab80 1 -- start start 2023-10-16T13:14:55.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff43049ab80 1 Processor -- start 2023-10-16T13:14:55.792 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff43049ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8100230 0x562ab810a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff43049ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ab8100b90 0x562ab810a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff43049ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8101a30 0x562ab8111650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff43049ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab804ee70 con 0x562ab8101a30 2023-10-16T13:14:55.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff43049ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab7feb710 con 0x562ab8100230 2023-10-16T13:14:55.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff43049ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab7feb3b0 con 0x562ab8100b90 2023-10-16T13:14:55.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff43049ab80 10 client.0 _ll_register_callbacks cb 0x562ab7e48800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:55.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff42284d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8101a30 0x562ab8111650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff42204c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8100230 0x562ab810a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff42184b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ab8100b90 0x562ab810a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff42284d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8101a30 0x562ab8111650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38224/0 (socket says 172.21.15.92:38224) 2023-10-16T13:14:55.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff42284d700 1 -- 172.21.15.92:0/2831011293 learned_addr learned my addr 172.21.15.92:0/2831011293 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff42204c700 1 -- 172.21.15.92:0/2831011293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ab8100b90 msgr2=0x562ab810a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff42204c700 1 --2- 172.21.15.92:0/2831011293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ab8100b90 0x562ab810a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff42204c700 1 -- 172.21.15.92:0/2831011293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8101a30 msgr2=0x562ab8111650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff42204c700 1 --2- 172.21.15.92:0/2831011293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8101a30 0x562ab8111650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff42204c700 1 -- 172.21.15.92:0/2831011293 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff418017050 con 0x562ab8100230 2023-10-16T13:14:55.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.777+0000 7ff42284d700 1 --2- 172.21.15.92:0/2831011293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8101a30 0x562ab8111650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:55.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.778+0000 7ff42204c700 1 --2- 172.21.15.92:0/2831011293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8100230 0x562ab810a0d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4180043a0 tx=0x7ff4180053d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4aa1dae9e5d058cb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.778+0000 7ff405ffb700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-16T13:14:55.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.778+0000 7ff405ffb700 1 -- 172.21.15.92:0/2831011293 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41802d070 con 0x562ab8100230 2023-10-16T13:14:55.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.778+0000 7ff43049ab80 1 -- 172.21.15.92:0/2831011293 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562ab8053ef0 con 0x562ab8100230 2023-10-16T13:14:55.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.778+0000 7ff405ffb700 1 -- 172.21.15.92:0/2831011293 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff4180050c0 con 0x562ab8100230 2023-10-16T13:14:55.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.778+0000 7ff405ffb700 1 -- 172.21.15.92:0/2831011293 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff418004710 con 0x562ab8100230 2023-10-16T13:14:55.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.778+0000 7ff43049ab80 10 client.25505 fetch_fsmap learned FSMap version 35 2023-10-16T13:14:55.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.778+0000 7ff43049ab80 1 -- 172.21.15.92:0/2831011293 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x562ab7e79de0 con 0x562ab8100230 2023-10-16T13:14:55.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.778+0000 7ff405ffb700 1 -- 172.21.15.92:0/2831011293 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x562ab8053ef0 con 0x562ab8100230 2023-10-16T13:14:55.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.778+0000 7ff405ffb700 1 -- 172.21.15.92:0/2831011293 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 35) v1 ==== 7914+0+0 (secure 0 0 0) 0x7ff4180328e0 con 0x562ab8100230 2023-10-16T13:14:55.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.778+0000 7ff43049ab80 10 client.25505 fetch_fsmap finished waiting for FSMap version 35 2023-10-16T13:14:55.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.778+0000 7ff43049ab80 10 client.25505 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-10-16T13:14:55.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.778+0000 7ff43049ab80 20 client.25505 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:55.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.778+0000 7ff43049ab80 1 --2- 172.21.15.92:0/2831011293 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x562ab8115df0 0x562ab8118210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.778+0000 7ff43049ab80 4 client.25505 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:14:55.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.778+0000 7ff43049ab80 1 -- 172.21.15.92:0/2831011293 --> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562ab80cbc10 con 0x562ab8115df0 2023-10-16T13:14:55.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.779+0000 7ff42184b700 1 --2- 172.21.15.92:0/2831011293 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x562ab8115df0 0x562ab8118210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.779+0000 7ff42184b700 1 --2- 172.21.15.92:0/2831011293 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x562ab8115df0 0x562ab8118210 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d9b58c1f55320f69 server_cookie=b7c2e7c2daf2910d in_seq=0 out_seq=0 2023-10-16T13:14:55.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.779+0000 7ff405ffb700 10 client.25505 ms_handle_connect on v2:172.21.15.152:6834/1393840132 2023-10-16T13:14:55.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.780+0000 7ff405ffb700 1 -- 172.21.15.92:0/2831011293 <== mds.2 v2:172.21.15.152:6834/1393840132 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562ab80cbc10 con 0x562ab8115df0 2023-10-16T13:14:55.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.780+0000 7ff405ffb700 10 client.25505 handle_command_reply: tid=0 2023-10-16T13:14:55.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.780+0000 7ff43049ab80 1 client.25505 shutdown 2023-10-16T13:14:55.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.780+0000 7ff43049ab80 1 -- 172.21.15.92:0/2831011293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8100230 msgr2=0x562ab810a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.780+0000 7ff43049ab80 1 --2- 172.21.15.92:0/2831011293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8100230 0x562ab810a0d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4180043a0 tx=0x7ff4180053d0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.780+0000 7ff43049ab80 1 -- 172.21.15.92:0/2831011293 shutdown_connections 2023-10-16T13:14:55.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.780+0000 7ff43049ab80 1 --2- 172.21.15.92:0/2831011293 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x562ab8115df0 0x562ab8118210 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.800 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.780+0000 7ff43049ab80 1 --2- 172.21.15.92:0/2831011293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8101a30 0x562ab8111650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.780+0000 7ff405ffb700 0 client.25505 ms_handle_reset on v2:172.21.15.152:6834/1393840132 2023-10-16T13:14:55.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.780+0000 7ff43049ab80 1 --2- 172.21.15.92:0/2831011293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8100230 0x562ab810a0d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.780+0000 7ff43049ab80 1 --2- 172.21.15.92:0/2831011293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ab8100b90 0x562ab810a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.780+0000 7ff43049ab80 1 -- 172.21.15.92:0/2831011293 >> 172.21.15.92:0/2831011293 conn(0x562ab8029dd0 msgr2=0x562ab80f6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.780+0000 7ff43049ab80 1 -- 172.21.15.92:0/2831011293 shutdown_connections 2023-10-16T13:14:55.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.780+0000 7ff43049ab80 1 -- 172.21.15.92:0/2831011293 wait complete. 2023-10-16T13:14:55.802 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.780+0000 7ff43049ab80 20 client.25505 trim_cache size 0 max 16384 2023-10-16T13:14:55.802 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:55 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1509396393' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:14:55.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff43049ab80 1 Processor -- start 2023-10-16T13:14:55.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff43049ab80 1 -- start start 2023-10-16T13:14:55.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff43049ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8100230 0x562ab8101e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff43049ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100b90 0x562ab8111610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff43049ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ab8101a30 0x562ab8111f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff43049ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab7ecf920 con 0x562ab8100b90 2023-10-16T13:14:55.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff43049ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab8109580 con 0x562ab8100230 2023-10-16T13:14:55.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff43049ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab8109c40 con 0x562ab8101a30 2023-10-16T13:14:55.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff42184b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100b90 0x562ab8111610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff42184b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100b90 0x562ab8111610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38230/0 (socket says 172.21.15.92:38230) 2023-10-16T13:14:55.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff42184b700 1 -- 172.21.15.92:0/3546377435 learned_addr learned my addr 172.21.15.92:0/3546377435 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff42204c700 1 --2- 172.21.15.92:0/3546377435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8100230 0x562ab8101e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff42184b700 1 -- 172.21.15.92:0/3546377435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ab8101a30 msgr2=0x562ab8111f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff42184b700 1 --2- 172.21.15.92:0/3546377435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ab8101a30 0x562ab8111f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff42184b700 1 -- 172.21.15.92:0/3546377435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8100230 msgr2=0x562ab8101e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff42184b700 1 --2- 172.21.15.92:0/3546377435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8100230 0x562ab8101e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff42184b700 1 -- 172.21.15.92:0/3546377435 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ab7e62c60 con 0x562ab8100b90 2023-10-16T13:14:55.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff42204c700 1 --2- 172.21.15.92:0/3546377435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8100230 0x562ab8101e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:14:55.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff42184b700 1 --2- 172.21.15.92:0/3546377435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100b90 0x562ab8111610 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff40c096cc0 tx=0x7ff40c0cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b2f0c8f6f225aa server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff411583700 1 -- 172.21.15.92:0/3546377435 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c09e3a0 con 0x562ab8100b90 2023-10-16T13:14:55.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff411583700 1 -- 172.21.15.92:0/3546377435 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff40c0a25e0 con 0x562ab8100b90 2023-10-16T13:14:55.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.793+0000 7ff411583700 1 -- 172.21.15.92:0/3546377435 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c0999a0 con 0x562ab8100b90 2023-10-16T13:14:55.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.794+0000 7ff43049ab80 1 -- 172.21.15.92:0/3546377435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100b90 msgr2=0x562ab8111610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.794+0000 7ff43049ab80 1 --2- 172.21.15.92:0/3546377435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100b90 0x562ab8111610 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff40c096cc0 tx=0x7ff40c0cc040 comp rx=0 tx=0).stop 2023-10-16T13:14:55.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.794+0000 7ff43049ab80 1 -- 172.21.15.92:0/3546377435 shutdown_connections 2023-10-16T13:14:55.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.794+0000 7ff43049ab80 1 --2- 172.21.15.92:0/3546377435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ab8101a30 0x562ab8111f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.794+0000 7ff43049ab80 1 --2- 172.21.15.92:0/3546377435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8100230 0x562ab8101e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.794+0000 7ff43049ab80 1 --2- 172.21.15.92:0/3546377435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100b90 0x562ab8111610 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.794+0000 7ff43049ab80 1 -- 172.21.15.92:0/3546377435 >> 172.21.15.92:0/3546377435 conn(0x562ab8029dd0 msgr2=0x562ab8108d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.794+0000 7ff43049ab80 1 -- 172.21.15.92:0/3546377435 shutdown_connections 2023-10-16T13:14:55.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.794+0000 7ff43049ab80 1 -- 172.21.15.92:0/3546377435 wait complete. 2023-10-16T13:14:55.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.794+0000 7ff43049ab80 1 -- start start 2023-10-16T13:14:55.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.794+0000 7ff43049ab80 1 Processor -- start 2023-10-16T13:14:55.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.794+0000 7ff43049ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ab8100230 0x562ab810d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.794+0000 7ff43049ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100b90 0x562ab810faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff43049ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8101a30 0x562ab810ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff43049ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab8110630 con 0x562ab8100b90 2023-10-16T13:14:55.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff43049ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab81107a0 con 0x562ab8101a30 2023-10-16T13:14:55.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff43049ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab8110960 con 0x562ab8100230 2023-10-16T13:14:55.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff43049ab80 10 client.0 _ll_register_callbacks cb 0x7ff418005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:55.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff42184b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100b90 0x562ab810faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff42184b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100b90 0x562ab810faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38236/0 (socket says 172.21.15.92:38236) 2023-10-16T13:14:55.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff42184b700 1 -- 172.21.15.92:0/3866050924 learned_addr learned my addr 172.21.15.92:0/3866050924 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff42284d700 1 --2- 172.21.15.92:0/3866050924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8101a30 0x562ab810ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff42204c700 1 --2- 172.21.15.92:0/3866050924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ab8100230 0x562ab810d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff42184b700 1 -- 172.21.15.92:0/3866050924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ab8100230 msgr2=0x562ab810d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff42184b700 1 --2- 172.21.15.92:0/3866050924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ab8100230 0x562ab810d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff42184b700 1 -- 172.21.15.92:0/3866050924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8101a30 msgr2=0x562ab810ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff42184b700 1 --2- 172.21.15.92:0/3866050924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8101a30 0x562ab810ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff42184b700 1 -- 172.21.15.92:0/3866050924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41c19f1d0 con 0x562ab8100b90 2023-10-16T13:14:55.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff42184b700 1 --2- 172.21.15.92:0/3866050924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100b90 0x562ab810faa0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff40c010690 tx=0x7ff40c09e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e300d8d510b182 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff405ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:55.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff405ffb700 1 -- 172.21.15.92:0/3866050924 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c09e160 con 0x562ab8100b90 2023-10-16T13:14:55.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff405ffb700 1 -- 172.21.15.92:0/3866050924 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff40c0b8300 con 0x562ab8100b90 2023-10-16T13:14:55.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff43049ab80 1 -- 172.21.15.92:0/3866050924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff418003e70 con 0x562ab8100b90 2023-10-16T13:14:55.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff405ffb700 1 -- 172.21.15.92:0/3866050924 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff40c0b84c0 con 0x562ab8100b90 2023-10-16T13:14:55.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff43049ab80 10 client.15966 fetch_fsmap learned FSMap version 35 2023-10-16T13:14:55.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.795+0000 7ff43049ab80 1 -- 172.21.15.92:0/3866050924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x562ab7ea0250 con 0x562ab8100b90 2023-10-16T13:14:55.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.796+0000 7ff405ffb700 1 -- 172.21.15.92:0/3866050924 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff418003e70 con 0x562ab8100b90 2023-10-16T13:14:55.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.796+0000 7ff405ffb700 1 -- 172.21.15.92:0/3866050924 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 35) v1 ==== 7914+0+0 (secure 0 0 0) 0x7ff40c09f0e0 con 0x562ab8100b90 2023-10-16T13:14:55.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.796+0000 7ff43049ab80 10 client.15966 fetch_fsmap finished waiting for FSMap version 35 2023-10-16T13:14:55.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.796+0000 7ff43049ab80 10 client.15966 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-10-16T13:14:55.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.796+0000 7ff43049ab80 20 client.15966 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:55.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.796+0000 7ff43049ab80 1 --2- 172.21.15.92:0/3866050924 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x562ab816e880 0x562ab8170c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.796+0000 7ff43049ab80 4 client.15966 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-16T13:14:55.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.796+0000 7ff43049ab80 1 -- 172.21.15.92:0/3866050924 --> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562ab8047e50 con 0x562ab816e880 2023-10-16T13:14:55.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.796+0000 7ff42204c700 1 --2- 172.21.15.92:0/3866050924 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x562ab816e880 0x562ab8170c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.796+0000 7ff405ffb700 10 client.15966 ms_handle_connect on v2:172.21.15.152:6834/1393840132 2023-10-16T13:14:55.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.796+0000 7ff42204c700 1 --2- 172.21.15.92:0/3866050924 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x562ab816e880 0x562ab8170c70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=921e72fa51a5cd56 server_cookie=d20b0a4b5d790444 in_seq=0 out_seq=0 2023-10-16T13:14:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.796+0000 7ff405ffb700 1 -- 172.21.15.92:0/3866050924 <== mds.2 v2:172.21.15.152:6834/1393840132 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562ab8047e50 con 0x562ab816e880 2023-10-16T13:14:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.796+0000 7ff405ffb700 10 client.15966 handle_command_reply: tid=0 2023-10-16T13:14:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.796+0000 7ff43049ab80 1 client.15966 shutdown 2023-10-16T13:14:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff43049ab80 1 -- 172.21.15.92:0/3866050924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100b90 msgr2=0x562ab810faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff43049ab80 1 --2- 172.21.15.92:0/3866050924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100b90 0x562ab810faa0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff40c010690 tx=0x7ff40c09e420 comp rx=0 tx=0).stop 2023-10-16T13:14:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff43049ab80 1 -- 172.21.15.92:0/3866050924 shutdown_connections 2023-10-16T13:14:55.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff43049ab80 1 --2- 172.21.15.92:0/3866050924 >> [v2:172.21.15.152:6834/1393840132,v1:172.21.15.152:6835/1393840132] conn(0x562ab816e880 0x562ab8170c70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff43049ab80 1 --2- 172.21.15.92:0/3866050924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562ab8101a30 0x562ab810ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff43049ab80 1 --2- 172.21.15.92:0/3866050924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ab8100230 0x562ab810d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff405ffb700 0 client.15966 ms_handle_reset on v2:172.21.15.152:6834/1393840132 2023-10-16T13:14:55.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff43049ab80 1 --2- 172.21.15.92:0/3866050924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ab8100b90 0x562ab810faa0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff43049ab80 1 -- 172.21.15.92:0/3866050924 >> 172.21.15.92:0/3866050924 conn(0x562ab8029dd0 msgr2=0x562ab8107e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff43049ab80 1 -- 172.21.15.92:0/3866050924 shutdown_connections 2023-10-16T13:14:55.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff43049ab80 1 -- 172.21.15.92:0/3866050924 wait complete. 2023-10-16T13:14:55.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff43049ab80 20 client.15966 trim_cache size 0 max 16384 2023-10-16T13:14:55.823 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2023-10-16T13:14:55.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff4242b0700 1 -- 172.21.15.92:0/4104153519 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff4080a1480 msgr2=0x7ff4080a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff4242b0700 1 --2- 172.21.15.92:0/4104153519 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff4080a1480 0x7ff4080a3940 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff418009fd0 tx=0x7ff418009260 comp rx=0 tx=0).stop 2023-10-16T13:14:55.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff4242b0700 1 -- 172.21.15.92:0/4104153519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c1042c0 msgr2=0x7ff41c197290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff4242b0700 1 --2- 172.21.15.92:0/4104153519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c1042c0 0x7ff41c197290 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00e9a0 tx=0x7ff40c00ecb0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.826 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff4242b0700 1 -- 172.21.15.92:0/4104153519 shutdown_connections 2023-10-16T13:14:55.826 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff4242b0700 1 --2- 172.21.15.92:0/4104153519 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7ff4080a1480 0x7ff4080a3940 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.826 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff4242b0700 1 --2- 172.21.15.92:0/4104153519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff41c106bf0 0x7ff41c19e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.826 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff4242b0700 1 --2- 172.21.15.92:0/4104153519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff41c101990 0x7ff41c196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.826 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff4242b0700 1 --2- 172.21.15.92:0/4104153519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c1042c0 0x7ff41c197290 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff4242b0700 1 -- 172.21.15.92:0/4104153519 >> 172.21.15.92:0/4104153519 conn(0x7ff41c0fb320 msgr2=0x7ff41c102600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff4242b0700 1 -- 172.21.15.92:0/4104153519 shutdown_connections 2023-10-16T13:14:55.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.797+0000 7ff4242b0700 1 -- 172.21.15.92:0/4104153519 wait complete. 2023-10-16T13:14:55.827 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-16T13:14:55.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.950+0000 7faaaccd8700 1 -- 172.21.15.92:0/912283857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaa8106cb0 msgr2=0x7faaa8109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.950+0000 7faaaccd8700 1 --2- 172.21.15.92:0/912283857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaa8106cb0 0x7faaa8109140 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7faaa000b0a0 tx=0x7faaa000b3b0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.950+0000 7faaaccd8700 1 -- 172.21.15.92:0/912283857 shutdown_connections 2023-10-16T13:14:55.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.950+0000 7faaaccd8700 1 --2- 172.21.15.92:0/912283857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaa8106cb0 0x7faaa8109140 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.950+0000 7faaaccd8700 1 --2- 172.21.15.92:0/912283857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaa8101970 0x7faaa8103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.955 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.950+0000 7faaaccd8700 1 --2- 172.21.15.92:0/912283857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaa81042a0 0x7faaa8106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.955 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.950+0000 7faaaccd8700 1 -- 172.21.15.92:0/912283857 >> 172.21.15.92:0/912283857 conn(0x7faaa80fb320 msgr2=0x7faaa80fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.955 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.950+0000 7faaaccd8700 1 -- 172.21.15.92:0/912283857 shutdown_connections 2023-10-16T13:14:55.955 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.950+0000 7faaaccd8700 1 -- 172.21.15.92:0/912283857 wait complete. 2023-10-16T13:14:55.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.951+0000 7faaaccd8700 1 Processor -- start 2023-10-16T13:14:55.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.951+0000 7faaaccd8700 1 -- start start 2023-10-16T13:14:55.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faaaccd8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaa8101970 0x7faaa8196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.957 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faaaccd8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaa81042a0 0x7faaa81973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faaaccd8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaa8106cb0 0x7faaa819e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faaaccd8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa819e9f0 con 0x7faaa8106cb0 2023-10-16T13:14:55.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faaaccd8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa819eb30 con 0x7faaa81042a0 2023-10-16T13:14:55.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faaaccd8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa819ecc0 con 0x7faaa8101970 2023-10-16T13:14:55.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faaa6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaa8106cb0 0x7faaa819e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faaa659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaa8101970 0x7faaa8196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faaa6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaa8106cb0 0x7faaa819e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38250/0 (socket says 172.21.15.92:38250) 2023-10-16T13:14:55.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faaa6d9d700 1 -- 172.21.15.92:0/1887516654 learned_addr learned my addr 172.21.15.92:0/1887516654 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faaa5d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaa81042a0 0x7faaa81973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faaa6d9d700 1 -- 172.21.15.92:0/1887516654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaa8101970 msgr2=0x7faaa8196e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faaa6d9d700 1 --2- 172.21.15.92:0/1887516654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaa8101970 0x7faaa8196e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faaa6d9d700 1 -- 172.21.15.92:0/1887516654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaa81042a0 msgr2=0x7faaa81973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faaa6d9d700 1 --2- 172.21.15.92:0/1887516654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaa81042a0 0x7faaa81973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faaa6d9d700 1 -- 172.21.15.92:0/1887516654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa0009d00 con 0x7faaa8106cb0 2023-10-16T13:14:55.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faaa6d9d700 1 --2- 172.21.15.92:0/1887516654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaa8106cb0 0x7faaa819e420 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7faaa000b780 tx=0x7faaa000bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faa977fe700 1 -- 172.21.15.92:0/1887516654 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa000e040 con 0x7faaa8106cb0 2023-10-16T13:14:55.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faa977fe700 1 -- 172.21.15.92:0/1887516654 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faaa0004e60 con 0x7faaa8106cb0 2023-10-16T13:14:55.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faaaccd8700 1 -- 172.21.15.92:0/1887516654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa819ef40 con 0x7faaa8106cb0 2023-10-16T13:14:55.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.952+0000 7faa977fe700 1 -- 172.21.15.92:0/1887516654 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa00053b0 con 0x7faaa8106cb0 2023-10-16T13:14:55.961 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.953+0000 7faaaccd8700 1 -- 172.21.15.92:0/1887516654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa819f310 con 0x7faaa8106cb0 2023-10-16T13:14:55.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.955+0000 7faa977fe700 1 -- 172.21.15.92:0/1887516654 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7faaa001d470 con 0x7faaa8106cb0 2023-10-16T13:14:55.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.955+0000 7faa977fe700 1 --2- 172.21.15.92:0/1887516654 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faa900a1480 0x7faa900a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.955+0000 7faaa659c700 1 --2- 172.21.15.92:0/1887516654 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faa900a1480 0x7faa900a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.955+0000 7faa977fe700 1 -- 172.21.15.92:0/1887516654 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7faaa00ce410 con 0x7faaa8106cb0 2023-10-16T13:14:55.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.956+0000 7faaa659c700 1 --2- 172.21.15.92:0/1887516654 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faa900a1480 0x7faa900a3940 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7faa9c005950 tx=0x7faa9c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.956+0000 7faab8ec2b80 1 Processor -- start 2023-10-16T13:14:55.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.956+0000 7faab8ec2b80 1 -- start start 2023-10-16T13:14:55.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.956+0000 7faab8ec2b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c1e20 0x55629c2c2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.956+0000 7faab8ec2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 0x55629c2c3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.956+0000 7faab8ec2b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c3620 0x55629c2c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.956+0000 7faab8ec2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55629c236c70 con 0x55629c2c2780 2023-10-16T13:14:55.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.957+0000 7faab8ec2b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55629c21bc60 con 0x55629c2c1e20 2023-10-16T13:14:55.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.957+0000 7faab8ec2b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55629c219580 con 0x55629c2c3620 2023-10-16T13:14:55.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.957+0000 7faaa659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c1e20 0x55629c2c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.957+0000 7faaa5d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 0x55629c2c3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.957+0000 7faaa659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c1e20 0x55629c2c2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:39062/0 (socket says 172.21.15.92:39062) 2023-10-16T13:14:55.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.957+0000 7faaa659c700 1 -- 172.21.15.92:0/3165181885 learned_addr learned my addr 172.21.15.92:0/3165181885 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.957+0000 7faaa6d9d700 1 --2- 172.21.15.92:0/3165181885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c3620 0x55629c2c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.957+0000 7faaa5d9b700 1 -- 172.21.15.92:0/3165181885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c3620 msgr2=0x55629c2c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.957+0000 7faaa5d9b700 1 --2- 172.21.15.92:0/3165181885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c3620 0x55629c2c3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.957+0000 7faaa5d9b700 1 -- 172.21.15.92:0/3165181885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c1e20 msgr2=0x55629c2c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.957+0000 7faaa5d9b700 1 --2- 172.21.15.92:0/3165181885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c1e20 0x55629c2c2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.957+0000 7faaa5d9b700 1 -- 172.21.15.92:0/3165181885 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55629c1d23f0 con 0x55629c2c2780 2023-10-16T13:14:55.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.957+0000 7faaa659c700 1 --2- 172.21.15.92:0/3165181885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c1e20 0x55629c2c2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:55.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.957+0000 7faaa5d9b700 1 --2- 172.21.15.92:0/3165181885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 0x55629c2c3040 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7faa98009cb0 tx=0x7faa98011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21de44c40770d2b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.957+0000 7faa94ff9700 1 -- 172.21.15.92:0/3165181885 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa98011d20 con 0x55629c2c2780 2023-10-16T13:14:55.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.957+0000 7faa94ff9700 1 -- 172.21.15.92:0/3165181885 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faa98011e80 con 0x55629c2c2780 2023-10-16T13:14:55.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.957+0000 7faa94ff9700 1 -- 172.21.15.92:0/3165181885 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa98005280 con 0x55629c2c2780 2023-10-16T13:14:55.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.958+0000 7faab8ec2b80 1 -- 172.21.15.92:0/3165181885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 msgr2=0x55629c2c3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.958+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/3165181885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 0x55629c2c3040 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7faa98009cb0 tx=0x7faa98011440 comp rx=0 tx=0).stop 2023-10-16T13:14:55.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.958+0000 7faab8ec2b80 1 -- 172.21.15.92:0/3165181885 shutdown_connections 2023-10-16T13:14:55.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.958+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/3165181885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c3620 0x55629c2c3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.958+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/3165181885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c1e20 0x55629c2c2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.958+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/3165181885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 0x55629c2c3040 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.958+0000 7faab8ec2b80 1 -- 172.21.15.92:0/3165181885 >> 172.21.15.92:0/3165181885 conn(0x55629c1efdd0 msgr2=0x55629c2bcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.958+0000 7faab8ec2b80 1 -- 172.21.15.92:0/3165181885 shutdown_connections 2023-10-16T13:14:55.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.958+0000 7faab8ec2b80 1 -- 172.21.15.92:0/3165181885 wait complete. 2023-10-16T13:14:55.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.958+0000 7faab8ec2b80 1 -- start start 2023-10-16T13:14:55.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faab8ec2b80 1 Processor -- start 2023-10-16T13:14:55.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faab8ec2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c1e20 0x55629c2cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faab8ec2b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c2780 0x55629c2cc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faab8ec2b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c3620 0x55629c2d31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faab8ec2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55629c214e70 con 0x55629c2c1e20 2023-10-16T13:14:55.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faab8ec2b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55629c1b1710 con 0x55629c2c3620 2023-10-16T13:14:55.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faab8ec2b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55629c1b13b0 con 0x55629c2c2780 2023-10-16T13:14:55.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faab8ec2b80 10 client.0 _ll_register_callbacks cb 0x55629c00e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:55.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faaa659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c1e20 0x55629c2cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faaa659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c1e20 0x55629c2cbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38260/0 (socket says 172.21.15.92:38260) 2023-10-16T13:14:55.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faaa659c700 1 -- 172.21.15.92:0/3767742123 learned_addr learned my addr 172.21.15.92:0/3767742123 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faaa6d9d700 1 --2- 172.21.15.92:0/3767742123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c3620 0x55629c2d31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faaa5d9b700 1 --2- 172.21.15.92:0/3767742123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c2780 0x55629c2cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faaa659c700 1 -- 172.21.15.92:0/3767742123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c2780 msgr2=0x55629c2cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faaa659c700 1 --2- 172.21.15.92:0/3767742123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c2780 0x55629c2cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faaa659c700 1 -- 172.21.15.92:0/3767742123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c3620 msgr2=0x55629c2d31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faaa659c700 1 --2- 172.21.15.92:0/3767742123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c3620 0x55629c2d31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faaa659c700 1 -- 172.21.15.92:0/3767742123 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa9c010c50 con 0x55629c2c1e20 2023-10-16T13:14:55.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faaa5d9b700 1 --2- 172.21.15.92:0/3767742123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c2780 0x55629c2cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:14:55.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faaa659c700 1 --2- 172.21.15.92:0/3767742123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c1e20 0x55629c2cbc40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7faa9c011890 tx=0x7faa9c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26518ccd4ea044dc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faa8dffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:55.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.959+0000 7faa8dffb700 1 -- 172.21.15.92:0/3767742123 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c004a30 con 0x55629c2c1e20 2023-10-16T13:14:55.978 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.960+0000 7faa8dffb700 1 -- 172.21.15.92:0/3767742123 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7faa9c017070 con 0x55629c2c1e20 2023-10-16T13:14:55.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.960+0000 7faab8ec2b80 1 -- 172.21.15.92:0/3767742123 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55629c291c10 con 0x55629c2c1e20 2023-10-16T13:14:55.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.960+0000 7faa8dffb700 1 -- 172.21.15.92:0/3767742123 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa9c004b90 con 0x55629c2c1e20 2023-10-16T13:14:55.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.960+0000 7faab8ec2b80 10 client.15978 fetch_fsmap learned FSMap version 35 2023-10-16T13:14:55.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.960+0000 7faab8ec2b80 1 -- 172.21.15.92:0/3767742123 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7faa980098e0 con 0x55629c2c1e20 2023-10-16T13:14:55.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.960+0000 7faa8dffb700 1 -- 172.21.15.92:0/3767742123 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55629c291c10 con 0x55629c2c1e20 2023-10-16T13:14:55.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.960+0000 7faa8dffb700 1 -- 172.21.15.92:0/3767742123 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 35) v1 ==== 7914+0+0 (secure 0 0 0) 0x7faa9c004fc0 con 0x55629c2c1e20 2023-10-16T13:14:55.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.960+0000 7faab8ec2b80 10 client.15978 fetch_fsmap finished waiting for FSMap version 35 2023-10-16T13:14:55.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.960+0000 7faab8ec2b80 10 client.15978 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-16T13:14:55.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.960+0000 7faab8ec2b80 20 client.15978 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:55.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.960+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/3767742123 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55629c2d7ac0 0x55629c2d9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.960+0000 7faab8ec2b80 4 client.15978 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:14:55.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.960+0000 7faab8ec2b80 1 -- 172.21.15.92:0/3767742123 --> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55629c20de50 con 0x55629c2d7ac0 2023-10-16T13:14:55.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.960+0000 7faaa5d9b700 1 --2- 172.21.15.92:0/3767742123 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55629c2d7ac0 0x55629c2d9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.961+0000 7faa8dffb700 10 client.15978 ms_handle_connect on v2:172.21.15.152:6838/1821921588 2023-10-16T13:14:55.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.961+0000 7faaa5d9b700 1 --2- 172.21.15.92:0/3767742123 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55629c2d7ac0 0x55629c2d9ee0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6e06f40fdce875bb server_cookie=d555bbb089d6fdd6 in_seq=0 out_seq=0 2023-10-16T13:14:55.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.961+0000 7faa8dffb700 1 -- 172.21.15.92:0/3767742123 <== mds.1 v2:172.21.15.152:6838/1821921588 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55629c20de50 con 0x55629c2d7ac0 2023-10-16T13:14:55.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.961+0000 7faa8dffb700 10 client.15978 handle_command_reply: tid=0 2023-10-16T13:14:55.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.962+0000 7faab8ec2b80 1 client.15978 shutdown 2023-10-16T13:14:55.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.962+0000 7faab8ec2b80 1 -- 172.21.15.92:0/3767742123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c1e20 msgr2=0x55629c2cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.962+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/3767742123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c1e20 0x55629c2cbc40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7faa9c011890 tx=0x7faa9c0047c0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.962+0000 7faab8ec2b80 1 -- 172.21.15.92:0/3767742123 shutdown_connections 2023-10-16T13:14:55.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.962+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/3767742123 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55629c2d7ac0 0x55629c2d9ee0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.962+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/3767742123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c1e20 0x55629c2cbc40 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.962+0000 7faa8dffb700 0 client.15978 ms_handle_reset on v2:172.21.15.152:6838/1821921588 2023-10-16T13:14:55.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.962+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/3767742123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c3620 0x55629c2d31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.962+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/3767742123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c2780 0x55629c2cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.962+0000 7faab8ec2b80 1 -- 172.21.15.92:0/3767742123 >> 172.21.15.92:0/3767742123 conn(0x55629c1efdd0 msgr2=0x55629c2bcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.962+0000 7faab8ec2b80 1 -- 172.21.15.92:0/3767742123 shutdown_connections 2023-10-16T13:14:55.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.962+0000 7faab8ec2b80 1 -- 172.21.15.92:0/3767742123 wait complete. 2023-10-16T13:14:55.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.962+0000 7faab8ec2b80 20 client.15978 trim_cache size 0 max 16384 2023-10-16T13:14:55.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.975+0000 7faab8ec2b80 1 Processor -- start 2023-10-16T13:14:55.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.975+0000 7faab8ec2b80 1 -- start start 2023-10-16T13:14:55.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.975+0000 7faab8ec2b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c1e20 0x55629c2c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.975+0000 7faab8ec2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 0x55629c2d3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.975+0000 7faab8ec2b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c3620 0x55629c2bb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.975+0000 7faab8ec2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55629c095920 con 0x55629c2c2780 2023-10-16T13:14:55.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.975+0000 7faab8ec2b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55629c2cb810 con 0x55629c2c1e20 2023-10-16T13:14:55.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.975+0000 7faab8ec2b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55629c2befb0 con 0x55629c2c3620 2023-10-16T13:14:55.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.975+0000 7faaa5d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 0x55629c2d3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.975+0000 7faaa5d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 0x55629c2d3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38270/0 (socket says 172.21.15.92:38270) 2023-10-16T13:14:55.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.975+0000 7faaa5d9b700 1 -- 172.21.15.92:0/2492504653 learned_addr learned my addr 172.21.15.92:0/2492504653 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.975+0000 7faaa659c700 1 --2- 172.21.15.92:0/2492504653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c1e20 0x55629c2c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.976+0000 7faaa6d9d700 1 --2- 172.21.15.92:0/2492504653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c3620 0x55629c2bb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.976+0000 7faaa5d9b700 1 -- 172.21.15.92:0/2492504653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c3620 msgr2=0x55629c2bb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.976+0000 7faaa5d9b700 1 --2- 172.21.15.92:0/2492504653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c3620 0x55629c2bb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.976+0000 7faaa5d9b700 1 -- 172.21.15.92:0/2492504653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c1e20 msgr2=0x55629c2c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.976+0000 7faaa5d9b700 1 --2- 172.21.15.92:0/2492504653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c1e20 0x55629c2c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.976+0000 7faaa5d9b700 1 -- 172.21.15.92:0/2492504653 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55629c03fde0 con 0x55629c2c2780 2023-10-16T13:14:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.976+0000 7faaa659c700 1 --2- 172.21.15.92:0/2492504653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c1e20 0x55629c2c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.976+0000 7faaa5d9b700 1 --2- 172.21.15.92:0/2492504653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 0x55629c2d3180 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x55629c2bdf70 tx=0x7faa98005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb8ddd784f980e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.976+0000 7faa957fa700 1 -- 172.21.15.92:0/2492504653 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa98004c50 con 0x55629c2c2780 2023-10-16T13:14:55.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.976+0000 7faa957fa700 1 -- 172.21.15.92:0/2492504653 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faa98004db0 con 0x55629c2c2780 2023-10-16T13:14:55.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.976+0000 7faa957fa700 1 -- 172.21.15.92:0/2492504653 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa980285b0 con 0x55629c2c2780 2023-10-16T13:14:55.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.977+0000 7faab8ec2b80 1 -- 172.21.15.92:0/2492504653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 msgr2=0x55629c2d3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:55.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.977+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/2492504653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 0x55629c2d3180 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x55629c2bdf70 tx=0x7faa98005e20 comp rx=0 tx=0).stop 2023-10-16T13:14:55.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.977+0000 7faab8ec2b80 1 -- 172.21.15.92:0/2492504653 shutdown_connections 2023-10-16T13:14:55.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.977+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/2492504653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c3620 0x55629c2bb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.977+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/2492504653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c1e20 0x55629c2c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.977+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/2492504653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 0x55629c2d3180 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.977+0000 7faab8ec2b80 1 -- 172.21.15.92:0/2492504653 >> 172.21.15.92:0/2492504653 conn(0x55629c1efdd0 msgr2=0x55629c2ca920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.977+0000 7faab8ec2b80 1 -- 172.21.15.92:0/2492504653 shutdown_connections 2023-10-16T13:14:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.977+0000 7faab8ec2b80 1 -- 172.21.15.92:0/2492504653 wait complete. 2023-10-16T13:14:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.977+0000 7faab8ec2b80 1 -- start start 2023-10-16T13:14:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.977+0000 7faab8ec2b80 1 Processor -- start 2023-10-16T13:14:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.977+0000 7faab8ec2b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c1e20 0x55629c2ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.977+0000 7faab8ec2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 0x55629c2cf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.977+0000 7faab8ec2b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c3620 0x55629c2d2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:55.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.977+0000 7faab8ec2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55629c2d2990 con 0x55629c2c2780 2023-10-16T13:14:55.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.977+0000 7faab8ec2b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55629c2d2b00 con 0x55629c2c1e20 2023-10-16T13:14:55.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.977+0000 7faab8ec2b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55629c2d2cc0 con 0x55629c2c3620 2023-10-16T13:14:55.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.978+0000 7faab8ec2b80 10 client.0 _ll_register_callbacks cb 0x7faa9c011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:55.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.978+0000 7faaa5d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 0x55629c2cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.978+0000 7faaa5d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 0x55629c2cf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38276/0 (socket says 172.21.15.92:38276) 2023-10-16T13:14:55.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.978+0000 7faaa5d9b700 1 -- 172.21.15.92:0/2964092668 learned_addr learned my addr 172.21.15.92:0/2964092668 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:55.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.978+0000 7faaa659c700 1 --2- 172.21.15.92:0/2964092668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c1e20 0x55629c2ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.978+0000 7faaa6d9d700 1 --2- 172.21.15.92:0/2964092668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c3620 0x55629c2d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:55.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.978+0000 7faaa5d9b700 1 -- 172.21.15.92:0/2964092668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c3620 msgr2=0x55629c2d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.978+0000 7faaa5d9b700 1 --2- 172.21.15.92:0/2964092668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c3620 0x55629c2d2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:55.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.978+0000 7faaa5d9b700 1 -- 172.21.15.92:0/2964092668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c1e20 msgr2=0x55629c2ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:55.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.978+0000 7faaa5d9b700 1 --2- 172.21.15.92:0/2964092668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c1e20 0x55629c2ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.978+0000 7faaa5d9b700 1 -- 172.21.15.92:0/2964092668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa980098e0 con 0x55629c2c2780 2023-10-16T13:14:56.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.978+0000 7faaa659c700 1 --2- 172.21.15.92:0/2964092668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c1e20 0x55629c2ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:56.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.978+0000 7faaa5d9b700 1 --2- 172.21.15.92:0/2964092668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 0x55629c2cf430 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7faa98011810 tx=0x7faa98009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8b1652d8a25077 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:56.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.978+0000 7faa8dffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:56.000 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.978+0000 7faa8dffb700 1 -- 172.21.15.92:0/2964092668 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa98028530 con 0x55629c2c2780 2023-10-16T13:14:56.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.978+0000 7faab8ec2b80 1 -- 172.21.15.92:0/2964092668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55629c219ef0 con 0x55629c2c2780 2023-10-16T13:14:56.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.978+0000 7faa8dffb700 1 -- 172.21.15.92:0/2964092668 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7faa98011ba0 con 0x55629c2c2780 2023-10-16T13:14:56.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.979+0000 7faa8dffb700 1 -- 172.21.15.92:0/2964092668 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa98011d60 con 0x55629c2c2780 2023-10-16T13:14:56.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.979+0000 7faab8ec2b80 10 client.15984 fetch_fsmap learned FSMap version 35 2023-10-16T13:14:56.001 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.979+0000 7faab8ec2b80 1 -- 172.21.15.92:0/2964092668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7faa9801d040 con 0x55629c2c2780 2023-10-16T13:14:56.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.979+0000 7faa8dffb700 1 -- 172.21.15.92:0/2964092668 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55629c219ef0 con 0x55629c2c2780 2023-10-16T13:14:56.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.979+0000 7faa8dffb700 1 -- 172.21.15.92:0/2964092668 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 35) v1 ==== 7914+0+0 (secure 0 0 0) 0x7faa98004f20 con 0x55629c2c2780 2023-10-16T13:14:56.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.979+0000 7faab8ec2b80 10 client.15984 fetch_fsmap finished waiting for FSMap version 35 2023-10-16T13:14:56.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.979+0000 7faab8ec2b80 10 client.15984 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-16T13:14:56.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.979+0000 7faab8ec2b80 20 client.15984 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:56.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.979+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/2964092668 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55629c32c4a0 0x55629c32e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:56.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.979+0000 7faab8ec2b80 4 client.15984 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-16T13:14:56.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.979+0000 7faab8ec2b80 1 -- 172.21.15.92:0/2964092668 --> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55629c20db70 con 0x55629c32c4a0 2023-10-16T13:14:56.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.979+0000 7faaa659c700 1 --2- 172.21.15.92:0/2964092668 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55629c32c4a0 0x55629c32e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:56.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.980+0000 7faa8dffb700 10 client.15984 ms_handle_connect on v2:172.21.15.152:6838/1821921588 2023-10-16T13:14:56.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.980+0000 7faaa659c700 1 --2- 172.21.15.92:0/2964092668 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55629c32c4a0 0x55629c32e890 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b5c3437675f9eb63 server_cookie=8fbafc45bb26db90 in_seq=0 out_seq=0 2023-10-16T13:14:56.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.980+0000 7faa8dffb700 1 -- 172.21.15.92:0/2964092668 <== mds.1 v2:172.21.15.152:6838/1821921588 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+22434 (crc 0 0 0) 0x55629c20db70 con 0x55629c32c4a0 2023-10-16T13:14:56.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.980+0000 7faa8dffb700 10 client.15984 handle_command_reply: tid=0 2023-10-16T13:14:56.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.980+0000 7faab8ec2b80 1 client.15984 shutdown 2023-10-16T13:14:56.004 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.980+0000 7faab8ec2b80 1 -- 172.21.15.92:0/2964092668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 msgr2=0x55629c2cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:56.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.980+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/2964092668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 0x55629c2cf430 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7faa98011810 tx=0x7faa98009780 comp rx=0 tx=0).stop 2023-10-16T13:14:56.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faab8ec2b80 1 -- 172.21.15.92:0/2964092668 shutdown_connections 2023-10-16T13:14:56.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/2964092668 >> [v2:172.21.15.152:6838/1821921588,v1:172.21.15.152:6839/1821921588] conn(0x55629c32c4a0 0x55629c32e890 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/2964092668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55629c2c3620 0x55629c2d2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faa8dffb700 0 client.15984 ms_handle_reset on v2:172.21.15.152:6838/1821921588 2023-10-16T13:14:56.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/2964092668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55629c2c1e20 0x55629c2ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faab8ec2b80 1 --2- 172.21.15.92:0/2964092668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629c2c2780 0x55629c2cf430 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faab8ec2b80 1 -- 172.21.15.92:0/2964092668 >> 172.21.15.92:0/2964092668 conn(0x55629c1efdd0 msgr2=0x55629c2bb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:56.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faab8ec2b80 1 -- 172.21.15.92:0/2964092668 shutdown_connections 2023-10-16T13:14:56.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faab8ec2b80 1 -- 172.21.15.92:0/2964092668 wait complete. 2023-10-16T13:14:56.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faab8ec2b80 20 client.15984 trim_cache size 0 max 16384 2023-10-16T13:14:56.007 INFO:teuthology.orchestra.run.smithi092.stdout:[ 2023-10-16T13:14:56.008 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.008 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.008 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 42263757, 2023-10-16T13:14:56.008 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632117, 2023-10-16T13:14:56.008 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt" 2023-10-16T13:14:56.009 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.009 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.009 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.009 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 79193863, 2023-10-16T13:14:56.009 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632175, 2023-10-16T13:14:56.010 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt" 2023-10-16T13:14:56.010 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.010 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.010 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.010 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 121960522, 2023-10-16T13:14:56.011 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632159, 2023-10-16T13:14:56.011 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt" 2023-10-16T13:14:56.011 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.011 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.011 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.012 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 232918545, 2023-10-16T13:14:56.012 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632130, 2023-10-16T13:14:56.012 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt" 2023-10-16T13:14:56.012 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.012 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.012 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.013 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 275383553, 2023-10-16T13:14:56.013 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632119, 2023-10-16T13:14:56.013 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt" 2023-10-16T13:14:56.013 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.013 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.014 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.014 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 323546307, 2023-10-16T13:14:56.014 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632134, 2023-10-16T13:14:56.014 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt" 2023-10-16T13:14:56.014 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.015 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.015 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.015 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 359895822, 2023-10-16T13:14:56.015 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632172, 2023-10-16T13:14:56.015 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt" 2023-10-16T13:14:56.015 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.016 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.016 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.016 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 367493939, 2023-10-16T13:14:56.016 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632176, 2023-10-16T13:14:56.016 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt" 2023-10-16T13:14:56.017 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.017 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.017 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.017 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 528826317, 2023-10-16T13:14:56.017 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632163, 2023-10-16T13:14:56.017 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt" 2023-10-16T13:14:56.018 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.018 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.018 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.018 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 561930813, 2023-10-16T13:14:56.018 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632102, 2023-10-16T13:14:56.019 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt" 2023-10-16T13:14:56.019 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.019 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.019 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.019 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 593504649, 2023-10-16T13:14:56.019 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632625, 2023-10-16T13:14:56.020 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt" 2023-10-16T13:14:56.020 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.020 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.020 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.020 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 599291543, 2023-10-16T13:14:56.021 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632133, 2023-10-16T13:14:56.021 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt" 2023-10-16T13:14:56.021 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.021 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.021 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.021 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 642387858, 2023-10-16T13:14:56.022 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632177, 2023-10-16T13:14:56.022 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt" 2023-10-16T13:14:56.022 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.022 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.022 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.023 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 656447024, 2023-10-16T13:14:56.023 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632154, 2023-10-16T13:14:56.023 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt" 2023-10-16T13:14:56.023 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.023 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.023 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.024 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 671908726, 2023-10-16T13:14:56.024 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632131, 2023-10-16T13:14:56.024 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt" 2023-10-16T13:14:56.024 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.024 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.025 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.025 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 798108690, 2023-10-16T13:14:56.025 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632121, 2023-10-16T13:14:56.025 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt" 2023-10-16T13:14:56.025 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.025 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.026 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.026 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 991054217, 2023-10-16T13:14:56.026 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632156, 2023-10-16T13:14:56.026 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt" 2023-10-16T13:14:56.026 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.027 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.027 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.027 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1017254855, 2023-10-16T13:14:56.027 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632146, 2023-10-16T13:14:56.027 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt" 2023-10-16T13:14:56.027 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.028 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.028 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.028 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1068031716, 2023-10-16T13:14:56.028 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632138, 2023-10-16T13:14:56.028 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt" 2023-10-16T13:14:56.028 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.029 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.029 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.029 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1085340842, 2023-10-16T13:14:56.029 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632112, 2023-10-16T13:14:56.029 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt" 2023-10-16T13:14:56.029 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.030 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.030 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.030 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1172224687, 2023-10-16T13:14:56.030 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632125, 2023-10-16T13:14:56.030 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt" 2023-10-16T13:14:56.031 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.031 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.031 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.031 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1254483024, 2023-10-16T13:14:56.031 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632120, 2023-10-16T13:14:56.031 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt" 2023-10-16T13:14:56.032 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.032 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.032 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.032 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1278789926, 2023-10-16T13:14:56.032 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632137, 2023-10-16T13:14:56.032 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt" 2023-10-16T13:14:56.033 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.033 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.033 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.033 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1333898767, 2023-10-16T13:14:56.033 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632167, 2023-10-16T13:14:56.034 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt" 2023-10-16T13:14:56.034 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.034 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.034 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.034 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1377794587, 2023-10-16T13:14:56.034 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632166, 2023-10-16T13:14:56.035 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt" 2023-10-16T13:14:56.035 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.035 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.035 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.035 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1430939537, 2023-10-16T13:14:56.036 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632126, 2023-10-16T13:14:56.036 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt" 2023-10-16T13:14:56.036 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.036 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.036 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.036 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1462743461, 2023-10-16T13:14:56.037 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632162, 2023-10-16T13:14:56.037 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt" 2023-10-16T13:14:56.037 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.037 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.037 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.037 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1480582501, 2023-10-16T13:14:56.038 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632141, 2023-10-16T13:14:56.038 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt" 2023-10-16T13:14:56.038 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.038 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.038 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.039 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1498188431, 2023-10-16T13:14:56.041 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632628, 2023-10-16T13:14:56.041 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt" 2023-10-16T13:14:56.041 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.042 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.042 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.042 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1538044136, 2023-10-16T13:14:56.042 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632135, 2023-10-16T13:14:56.042 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt" 2023-10-16T13:14:56.043 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.043 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.043 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.043 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1707516174, 2023-10-16T13:14:56.043 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632127, 2023-10-16T13:14:56.043 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt" 2023-10-16T13:14:56.044 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.044 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.044 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.044 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1720913004, 2023-10-16T13:14:56.044 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632150, 2023-10-16T13:14:56.045 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt" 2023-10-16T13:14:56.045 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.045 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.045 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.045 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1754033021, 2023-10-16T13:14:56.046 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632108, 2023-10-16T13:14:56.046 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt" 2023-10-16T13:14:56.046 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.046 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.046 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.047 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1820088931, 2023-10-16T13:14:56.047 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632136, 2023-10-16T13:14:56.047 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt" 2023-10-16T13:14:56.047 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.047 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.048 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.048 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1838345992, 2023-10-16T13:14:56.048 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632105, 2023-10-16T13:14:56.048 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt" 2023-10-16T13:14:56.048 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.049 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.049 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.049 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1867579455, 2023-10-16T13:14:56.049 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632113, 2023-10-16T13:14:56.049 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt" 2023-10-16T13:14:56.049 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.050 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.050 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.050 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1941689016, 2023-10-16T13:14:56.050 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632148, 2023-10-16T13:14:56.050 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt" 2023-10-16T13:14:56.051 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.051 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.051 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.051 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 1958457261, 2023-10-16T13:14:56.051 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632123, 2023-10-16T13:14:56.052 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt" 2023-10-16T13:14:56.052 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.052 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.052 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.052 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 2068891910, 2023-10-16T13:14:56.052 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632161, 2023-10-16T13:14:56.053 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt" 2023-10-16T13:14:56.053 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.053 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.053 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.053 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 2191329414, 2023-10-16T13:14:56.054 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632145, 2023-10-16T13:14:56.054 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt" 2023-10-16T13:14:56.054 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.054 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.054 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.055 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 2282447235, 2023-10-16T13:14:56.055 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632626, 2023-10-16T13:14:56.055 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt" 2023-10-16T13:14:56.055 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.055 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.055 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.056 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 2338218011, 2023-10-16T13:14:56.056 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632116, 2023-10-16T13:14:56.056 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt" 2023-10-16T13:14:56.056 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.056 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.056 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.057 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 2368425670, 2023-10-16T13:14:56.057 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632624, 2023-10-16T13:14:56.057 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt" 2023-10-16T13:14:56.057 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.057 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.058 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.058 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 2370227622, 2023-10-16T13:14:56.058 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632158, 2023-10-16T13:14:56.058 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt" 2023-10-16T13:14:56.058 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.059 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.059 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.059 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 2538928543, 2023-10-16T13:14:56.059 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632118, 2023-10-16T13:14:56.059 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt" 2023-10-16T13:14:56.059 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.060 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.060 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.060 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 2599302135, 2023-10-16T13:14:56.060 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632107, 2023-10-16T13:14:56.060 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt" 2023-10-16T13:14:56.060 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.061 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.061 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.061 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 2715513660, 2023-10-16T13:14:56.061 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632151, 2023-10-16T13:14:56.061 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt" 2023-10-16T13:14:56.062 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.062 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.062 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.062 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 2769655608, 2023-10-16T13:14:56.062 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632109, 2023-10-16T13:14:56.062 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt" 2023-10-16T13:14:56.063 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.063 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.063 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.063 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 2787777281, 2023-10-16T13:14:56.063 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632164, 2023-10-16T13:14:56.064 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt" 2023-10-16T13:14:56.064 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.064 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.064 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.064 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 2826579988, 2023-10-16T13:14:56.064 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632153, 2023-10-16T13:14:56.065 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt" 2023-10-16T13:14:56.065 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.065 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.065 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.065 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 2834792501, 2023-10-16T13:14:56.065 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632140, 2023-10-16T13:14:56.066 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt" 2023-10-16T13:14:56.066 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.066 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.066 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.066 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3041698891, 2023-10-16T13:14:56.067 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632122, 2023-10-16T13:14:56.067 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt" 2023-10-16T13:14:56.067 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.067 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.067 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.067 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3084224073, 2023-10-16T13:14:56.068 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632160, 2023-10-16T13:14:56.068 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt" 2023-10-16T13:14:56.068 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.068 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.068 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.068 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3150767744, 2023-10-16T13:14:56.069 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632623, 2023-10-16T13:14:56.069 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt" 2023-10-16T13:14:56.069 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.069 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.069 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.069 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3155339526, 2023-10-16T13:14:56.070 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632171, 2023-10-16T13:14:56.070 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt" 2023-10-16T13:14:56.070 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.070 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.070 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.071 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3170877734, 2023-10-16T13:14:56.071 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632142, 2023-10-16T13:14:56.071 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt" 2023-10-16T13:14:56.071 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.071 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.071 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.072 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3254064669, 2023-10-16T13:14:56.072 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632165, 2023-10-16T13:14:56.072 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt" 2023-10-16T13:14:56.072 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.072 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.073 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.073 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3327771706, 2023-10-16T13:14:56.073 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632168, 2023-10-16T13:14:56.073 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt" 2023-10-16T13:14:56.073 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.073 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.074 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.074 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3345905612, 2023-10-16T13:14:56.074 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632149, 2023-10-16T13:14:56.074 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt" 2023-10-16T13:14:56.074 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.075 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.075 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.075 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3365017589, 2023-10-16T13:14:56.075 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632174, 2023-10-16T13:14:56.075 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt" 2023-10-16T13:14:56.075 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.076 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.076 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.076 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3398902434, 2023-10-16T13:14:56.076 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632124, 2023-10-16T13:14:56.076 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt" 2023-10-16T13:14:56.076 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.077 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.077 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.077 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3521316236, 2023-10-16T13:14:56.077 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632173, 2023-10-16T13:14:56.077 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt" 2023-10-16T13:14:56.078 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.078 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.078 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.078 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3654290787, 2023-10-16T13:14:56.078 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632155, 2023-10-16T13:14:56.078 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt" 2023-10-16T13:14:56.079 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.079 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.079 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.079 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3708517984, 2023-10-16T13:14:56.079 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632627, 2023-10-16T13:14:56.079 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt" 2023-10-16T13:14:56.080 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.080 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.080 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.080 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3728321698, 2023-10-16T13:14:56.080 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632147, 2023-10-16T13:14:56.081 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt" 2023-10-16T13:14:56.081 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.081 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.081 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.081 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3781874547, 2023-10-16T13:14:56.082 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632106, 2023-10-16T13:14:56.082 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt" 2023-10-16T13:14:56.082 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.082 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.082 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.082 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3791758814, 2023-10-16T13:14:56.083 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632157, 2023-10-16T13:14:56.083 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt" 2023-10-16T13:14:56.083 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.083 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.083 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.084 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3805404463, 2023-10-16T13:14:56.084 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632152, 2023-10-16T13:14:56.084 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt" 2023-10-16T13:14:56.084 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.084 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.084 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.085 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3830403279, 2023-10-16T13:14:56.085 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632132, 2023-10-16T13:14:56.085 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt" 2023-10-16T13:14:56.085 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.085 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.085 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.086 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3878616342, 2023-10-16T13:14:56.086 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632103, 2023-10-16T13:14:56.086 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt" 2023-10-16T13:14:56.086 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.086 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.086 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.087 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3916704499, 2023-10-16T13:14:56.087 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632114, 2023-10-16T13:14:56.087 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt" 2023-10-16T13:14:56.087 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.087 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.088 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.088 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 3989405851, 2023-10-16T13:14:56.088 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632110, 2023-10-16T13:14:56.088 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt" 2023-10-16T13:14:56.088 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.088 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.089 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.089 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4006883688, 2023-10-16T13:14:56.089 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632143, 2023-10-16T13:14:56.089 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt" 2023-10-16T13:14:56.089 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.090 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.090 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.090 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4019925432, 2023-10-16T13:14:56.090 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632115, 2023-10-16T13:14:56.090 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt" 2023-10-16T13:14:56.091 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.091 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.091 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.091 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4033359920, 2023-10-16T13:14:56.091 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632128, 2023-10-16T13:14:56.091 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt" 2023-10-16T13:14:56.092 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.092 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.092 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.092 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4048698505, 2023-10-16T13:14:56.092 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632170, 2023-10-16T13:14:56.092 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt" 2023-10-16T13:14:56.093 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.093 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.093 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.093 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4081245542, 2023-10-16T13:14:56.093 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632139, 2023-10-16T13:14:56.094 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt" 2023-10-16T13:14:56.094 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.094 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.094 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.094 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4099592255, 2023-10-16T13:14:56.094 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632111, 2023-10-16T13:14:56.095 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt" 2023-10-16T13:14:56.095 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.095 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.095 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.095 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4113991274, 2023-10-16T13:14:56.096 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632169, 2023-10-16T13:14:56.096 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt" 2023-10-16T13:14:56.096 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.096 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.096 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.096 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4134278649, 2023-10-16T13:14:56.097 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632129, 2023-10-16T13:14:56.097 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt" 2023-10-16T13:14:56.097 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.097 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.097 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.097 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4143630256, 2023-10-16T13:14:56.098 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632144, 2023-10-16T13:14:56.098 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt" 2023-10-16T13:14:56.098 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:14:56.098 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:14:56.098 INFO:teuthology.orchestra.run.smithi092.stdout: "damage_type": "backtrace", 2023-10-16T13:14:56.099 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4178346043, 2023-10-16T13:14:56.099 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1099511632104, 2023-10-16T13:14:56.099 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt" 2023-10-16T13:14:56.099 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:14:56.099 INFO:teuthology.orchestra.run.smithi092.stdout:] 2023-10-16T13:14:56.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faaaccd8700 1 -- 172.21.15.92:0/1887516654 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faa900a1480 msgr2=0x7faa900a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:56.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faaaccd8700 1 --2- 172.21.15.92:0/1887516654 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faa900a1480 0x7faa900a3940 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7faa9c005950 tx=0x7faa9c00b410 comp rx=0 tx=0).stop 2023-10-16T13:14:56.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faaaccd8700 1 -- 172.21.15.92:0/1887516654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaa8106cb0 msgr2=0x7faaa819e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:56.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faaaccd8700 1 --2- 172.21.15.92:0/1887516654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaa8106cb0 0x7faaa819e420 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7faaa000b780 tx=0x7faaa000bd60 comp rx=0 tx=0).stop 2023-10-16T13:14:56.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faaaccd8700 1 -- 172.21.15.92:0/1887516654 shutdown_connections 2023-10-16T13:14:56.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faaaccd8700 1 --2- 172.21.15.92:0/1887516654 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faa900a1480 0x7faa900a3940 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faaaccd8700 1 --2- 172.21.15.92:0/1887516654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faaa8106cb0 0x7faaa819e420 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faaaccd8700 1 --2- 172.21.15.92:0/1887516654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaa8101970 0x7faaa8196e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faaaccd8700 1 --2- 172.21.15.92:0/1887516654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaa81042a0 0x7faaa81973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faaaccd8700 1 -- 172.21.15.92:0/1887516654 >> 172.21.15.92:0/1887516654 conn(0x7faaa80fb320 msgr2=0x7faaa8102600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:56.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faaaccd8700 1 -- 172.21.15.92:0/1887516654 shutdown_connections 2023-10-16T13:14:56.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:55.981+0000 7faaaccd8700 1 -- 172.21.15.92:0/1887516654 wait complete. 2023-10-16T13:14:56.103 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-16T13:14:56.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.229+0000 7fb1f25d5700 1 -- 172.21.15.92:0/35622045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1ec101990 msgr2=0x7fb1ec108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:56.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.229+0000 7fb1f25d5700 1 --2- 172.21.15.92:0/35622045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1ec101990 0x7fb1ec108240 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb1e400b0d0 tx=0x7fb1e400b3e0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.229+0000 7fb1f25d5700 1 -- 172.21.15.92:0/35622045 shutdown_connections 2023-10-16T13:14:56.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.229+0000 7fb1f25d5700 1 --2- 172.21.15.92:0/35622045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1ec101990 0x7fb1ec108240 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.229+0000 7fb1f25d5700 1 --2- 172.21.15.92:0/35622045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1ec0ffe00 0x7fb1ec100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.229+0000 7fb1f25d5700 1 --2- 172.21.15.92:0/35622045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1ec100ff0 0x7fb1ec101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.229+0000 7fb1f25d5700 1 -- 172.21.15.92:0/35622045 >> 172.21.15.92:0/35622045 conn(0x7fb1ec0fb370 msgr2=0x7fb1ec0fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:56.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.230+0000 7fb1f25d5700 1 -- 172.21.15.92:0/35622045 shutdown_connections 2023-10-16T13:14:56.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.230+0000 7fb1f25d5700 1 -- 172.21.15.92:0/35622045 wait complete. 2023-10-16T13:14:56.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.230+0000 7fb1f25d5700 1 Processor -- start 2023-10-16T13:14:56.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.230+0000 7fb1f25d5700 1 -- start start 2023-10-16T13:14:56.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.230+0000 7fb1f25d5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1ec0ffe00 0x7fb1ec195d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:56.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.230+0000 7fb1f25d5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1ec100ff0 0x7fb1ec196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:56.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.230+0000 7fb1f25d5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1ec101990 0x7fb1ec19d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:56.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.230+0000 7fb1f25d5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec19d870 con 0x7fb1ec0ffe00 2023-10-16T13:14:56.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.230+0000 7fb1f25d5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec19d9e0 con 0x7fb1ec101990 2023-10-16T13:14:56.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.230+0000 7fb1f25d5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec19dba0 con 0x7fb1ec100ff0 2023-10-16T13:14:56.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.230+0000 7fb1ebfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1ec0ffe00 0x7fb1ec195d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:56.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.231+0000 7fb1ebfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1ec0ffe00 0x7fb1ec195d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38288/0 (socket says 172.21.15.92:38288) 2023-10-16T13:14:56.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.231+0000 7fb1ebfff700 1 -- 172.21.15.92:0/2600595113 learned_addr learned my addr 172.21.15.92:0/2600595113 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:56.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.231+0000 7fb1eb7fe700 1 --2- 172.21.15.92:0/2600595113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1ec100ff0 0x7fb1ec196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:56.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.231+0000 7fb1f0b72700 1 --2- 172.21.15.92:0/2600595113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1ec101990 0x7fb1ec19d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:56.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.231+0000 7fb1ebfff700 1 -- 172.21.15.92:0/2600595113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1ec100ff0 msgr2=0x7fb1ec196270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:56.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.231+0000 7fb1ebfff700 1 --2- 172.21.15.92:0/2600595113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1ec100ff0 0x7fb1ec196270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.231+0000 7fb1ebfff700 1 -- 172.21.15.92:0/2600595113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1ec101990 msgr2=0x7fb1ec19d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:56.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.231+0000 7fb1ebfff700 1 --2- 172.21.15.92:0/2600595113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1ec101990 0x7fb1ec19d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.231+0000 7fb1ebfff700 1 -- 172.21.15.92:0/2600595113 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e4009d00 con 0x7fb1ec0ffe00 2023-10-16T13:14:56.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.231+0000 7fb1ebfff700 1 --2- 172.21.15.92:0/2600595113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1ec0ffe00 0x7fb1ec195d30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00e950 tx=0x7fb1dc00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:56.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.231+0000 7fb1e97fa700 1 -- 172.21.15.92:0/2600595113 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc009770 con 0x7fb1ec0ffe00 2023-10-16T13:14:56.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.231+0000 7fb1e97fa700 1 -- 172.21.15.92:0/2600595113 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb1dc00eea0 con 0x7fb1ec0ffe00 2023-10-16T13:14:56.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.231+0000 7fb1f25d5700 1 -- 172.21.15.92:0/2600595113 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ec19de80 con 0x7fb1ec0ffe00 2023-10-16T13:14:56.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.231+0000 7fb1e97fa700 1 -- 172.21.15.92:0/2600595113 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc003d90 con 0x7fb1ec0ffe00 2023-10-16T13:14:56.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.231+0000 7fb1f25d5700 1 -- 172.21.15.92:0/2600595113 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ec19e250 con 0x7fb1ec0ffe00 2023-10-16T13:14:56.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.233+0000 7fb1e97fa700 1 -- 172.21.15.92:0/2600595113 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb1dc004000 con 0x7fb1ec0ffe00 2023-10-16T13:14:56.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.234+0000 7fb1e97fa700 1 --2- 172.21.15.92:0/2600595113 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb1d40a1480 0x7fb1d40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:56.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.234+0000 7fb1eb7fe700 1 --2- 172.21.15.92:0/2600595113 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb1d40a1480 0x7fb1d40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:56.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.234+0000 7fb1e97fa700 1 -- 172.21.15.92:0/2600595113 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb1dc014070 con 0x7fb1ec0ffe00 2023-10-16T13:14:56.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.234+0000 7fb1eb7fe700 1 --2- 172.21.15.92:0/2600595113 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb1d40a1480 0x7fb1d40a3940 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0005950 tx=0x7fb1e000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:56.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1fe7bfb80 1 Processor -- start 2023-10-16T13:14:56.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1fe7bfb80 1 -- start start 2023-10-16T13:14:56.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1fe7bfb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 0x555e1e6f8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:56.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1fe7bfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f8780 0x555e1e6f9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:56.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1fe7bfb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e6f9620 0x555e1e6f9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:56.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1fe7bfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e1e66cc70 con 0x555e1e6f8780 2023-10-16T13:14:56.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1fe7bfb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e1e651c60 con 0x555e1e6f9620 2023-10-16T13:14:56.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1fe7bfb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e1e64f580 con 0x555e1e6f7e20 2023-10-16T13:14:56.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1eb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f8780 0x555e1e6f9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:56.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1ebfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 0x555e1e6f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:56.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1eb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f8780 0x555e1e6f9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38298/0 (socket says 172.21.15.92:38298) 2023-10-16T13:14:56.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1eb7fe700 1 -- 172.21.15.92:0/2559385121 learned_addr learned my addr 172.21.15.92:0/2559385121 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:56.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1f0b72700 1 --2- 172.21.15.92:0/2559385121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e6f9620 0x555e1e6f9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:56.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1eb7fe700 1 -- 172.21.15.92:0/2559385121 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 msgr2=0x555e1e6f8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:56.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1eb7fe700 1 --2- 172.21.15.92:0/2559385121 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 0x555e1e6f8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1eb7fe700 1 -- 172.21.15.92:0/2559385121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e6f9620 msgr2=0x555e1e6f9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:56.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1eb7fe700 1 --2- 172.21.15.92:0/2559385121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e6f9620 0x555e1e6f9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1eb7fe700 1 -- 172.21.15.92:0/2559385121 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e1e6083f0 con 0x555e1e6f8780 2023-10-16T13:14:56.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1f0b72700 1 --2- 172.21.15.92:0/2559385121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e6f9620 0x555e1e6f9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:14:56.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.235+0000 7fb1eb7fe700 1 --2- 172.21.15.92:0/2559385121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f8780 0x555e1e6f9040 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0010fa0 tx=0x7fb1e0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da7b84945c9f65a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:56.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.236+0000 7fb1d27fc700 1 -- 172.21.15.92:0/2559385121 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0011db0 con 0x555e1e6f8780 2023-10-16T13:14:56.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.236+0000 7fb1d27fc700 1 -- 172.21.15.92:0/2559385121 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb1e0015070 con 0x555e1e6f8780 2023-10-16T13:14:56.252 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.236+0000 7fb1d27fc700 1 -- 172.21.15.92:0/2559385121 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e001c650 con 0x555e1e6f8780 2023-10-16T13:14:56.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.236+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/2559385121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f8780 msgr2=0x555e1e6f9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:56.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.236+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/2559385121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f8780 0x555e1e6f9040 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0010fa0 tx=0x7fb1e0013000 comp rx=0 tx=0).stop 2023-10-16T13:14:56.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.236+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/2559385121 shutdown_connections 2023-10-16T13:14:56.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.236+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/2559385121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e6f9620 0x555e1e6f9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.236+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/2559385121 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 0x555e1e6f8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.236+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/2559385121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f8780 0x555e1e6f9040 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.236+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/2559385121 >> 172.21.15.92:0/2559385121 conn(0x555e1e625dd0 msgr2=0x555e1e6f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:56.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.236+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/2559385121 shutdown_connections 2023-10-16T13:14:56.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.236+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/2559385121 wait complete. 2023-10-16T13:14:56.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.237+0000 7fb1fe7bfb80 1 -- start start 2023-10-16T13:14:56.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.237+0000 7fb1fe7bfb80 1 Processor -- start 2023-10-16T13:14:56.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.237+0000 7fb1fe7bfb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 0x555e1e701bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:56.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.237+0000 7fb1fe7bfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f8780 0x555e1e702130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:56.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.237+0000 7fb1fe7bfb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e6f9620 0x555e1e709170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:56.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.237+0000 7fb1fe7bfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e1e64ae70 con 0x555e1e6f8780 2023-10-16T13:14:56.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.237+0000 7fb1fe7bfb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e1e5e7710 con 0x555e1e6f9620 2023-10-16T13:14:56.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.237+0000 7fb1fe7bfb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e1e5e73b0 con 0x555e1e6f7e20 2023-10-16T13:14:56.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.237+0000 7fb1fe7bfb80 10 client.0 _ll_register_callbacks cb 0x555e1e444800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:56.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.238+0000 7fb1eb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f8780 0x555e1e702130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:56.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.238+0000 7fb1ebfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 0x555e1e701bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:56.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.238+0000 7fb1eb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f8780 0x555e1e702130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38304/0 (socket says 172.21.15.92:38304) 2023-10-16T13:14:56.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.238+0000 7fb1eb7fe700 1 -- 172.21.15.92:0/2997682292 learned_addr learned my addr 172.21.15.92:0/2997682292 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:56.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.238+0000 7fb1f0b72700 1 --2- 172.21.15.92:0/2997682292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e6f9620 0x555e1e709170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:56.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.238+0000 7fb1eb7fe700 1 -- 172.21.15.92:0/2997682292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 msgr2=0x555e1e701bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:56.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.238+0000 7fb1eb7fe700 1 --2- 172.21.15.92:0/2997682292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 0x555e1e701bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.238+0000 7fb1eb7fe700 1 -- 172.21.15.92:0/2997682292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e6f9620 msgr2=0x555e1e709170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:56.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.238+0000 7fb1eb7fe700 1 --2- 172.21.15.92:0/2997682292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e6f9620 0x555e1e709170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.238+0000 7fb1eb7fe700 1 -- 172.21.15.92:0/2997682292 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e0010c50 con 0x555e1e6f8780 2023-10-16T13:14:56.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.238+0000 7fb1eb7fe700 1 --2- 172.21.15.92:0/2997682292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f8780 0x555e1e702130 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0005d90 tx=0x7fb1e0011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4bab17986cbe451 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:56.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.238+0000 7fb1cb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-16T13:14:56.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.238+0000 7fb1cb7fe700 1 -- 172.21.15.92:0/2997682292 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e002d070 con 0x555e1e6f8780 2023-10-16T13:14:56.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.238+0000 7fb1cb7fe700 1 -- 172.21.15.92:0/2997682292 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb1e0017070 con 0x555e1e6f8780 2023-10-16T13:14:56.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.238+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/2997682292 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e1e64fef0 con 0x555e1e6f8780 2023-10-16T13:14:56.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.238+0000 7fb1cb7fe700 1 -- 172.21.15.92:0/2997682292 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1e001e630 con 0x555e1e6f8780 2023-10-16T13:14:56.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.238+0000 7fb1fe7bfb80 10 client.15996 fetch_fsmap learned FSMap version 35 2023-10-16T13:14:56.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.238+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/2997682292 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x555e1e475de0 con 0x555e1e6f8780 2023-10-16T13:14:56.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.238+0000 7fb1cb7fe700 1 -- 172.21.15.92:0/2997682292 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x555e1e64fef0 con 0x555e1e6f8780 2023-10-16T13:14:56.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.239+0000 7fb1cb7fe700 1 -- 172.21.15.92:0/2997682292 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 35) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fb1e0004a40 con 0x555e1e6f8780 2023-10-16T13:14:56.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.239+0000 7fb1fe7bfb80 10 client.15996 fetch_fsmap finished waiting for FSMap version 35 2023-10-16T13:14:56.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.239+0000 7fb1fe7bfb80 10 client.15996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:56.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.239+0000 7fb1fe7bfb80 20 client.15996 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:56.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.239+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/2997682292 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x555e1e70d9e0 0x555e1e70fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:56.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.239+0000 7fb1fe7bfb80 4 client.15996 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:14:56.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.239+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/2997682292 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555e1e6c7c10 con 0x555e1e70d9e0 2023-10-16T13:14:56.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.239+0000 7fb1ebfff700 1 --2- 172.21.15.92:0/2997682292 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x555e1e70d9e0 0x555e1e70fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:56.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.239+0000 7fb1cb7fe700 10 client.15996 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:56.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.239+0000 7fb1ebfff700 1 --2- 172.21.15.92:0/2997682292 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x555e1e70d9e0 0x555e1e70fe00 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db60392ca715ff86 server_cookie=bfa2434fed5c36e2 in_seq=0 out_seq=0 2023-10-16T13:14:56.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.240+0000 7fb1cb7fe700 1 -- 172.21.15.92:0/2997682292 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555e1e6c7c10 con 0x555e1e70d9e0 2023-10-16T13:14:56.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.240+0000 7fb1cb7fe700 10 client.15996 handle_command_reply: tid=0 2023-10-16T13:14:56.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.240+0000 7fb1fe7bfb80 1 client.15996 shutdown 2023-10-16T13:14:56.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.240+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/2997682292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f8780 msgr2=0x555e1e702130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:56.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.240+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/2997682292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f8780 0x555e1e702130 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0005d90 tx=0x7fb1e0011de0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.240+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/2997682292 shutdown_connections 2023-10-16T13:14:56.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.240+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/2997682292 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x555e1e70d9e0 0x555e1e70fe00 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.240+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/2997682292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e6f9620 0x555e1e709170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.240+0000 7fb1cb7fe700 0 client.15996 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:56.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.240+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/2997682292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 0x555e1e701bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.240+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/2997682292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f8780 0x555e1e702130 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.240+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/2997682292 >> 172.21.15.92:0/2997682292 conn(0x555e1e625dd0 msgr2=0x555e1e6f2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:56.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.240+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/2997682292 shutdown_connections 2023-10-16T13:14:56.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.240+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/2997682292 wait complete. 2023-10-16T13:14:56.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.240+0000 7fb1fe7bfb80 20 client.15996 trim_cache size 0 max 16384 2023-10-16T13:14:56.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.254+0000 7fb1fe7bfb80 1 Processor -- start 2023-10-16T13:14:56.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.254+0000 7fb1fe7bfb80 1 -- start start 2023-10-16T13:14:56.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.254+0000 7fb1fe7bfb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 0x555e1e6f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:56.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.254+0000 7fb1fe7bfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f9620 0x555e1e6f9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:56.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.254+0000 7fb1fe7bfb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e70d9e0 0x555e1e6f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:56.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.254+0000 7fb1fe7bfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e1e4cb920 con 0x555e1e6f9620 2023-10-16T13:14:56.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.254+0000 7fb1fe7bfb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e1e6f94a0 con 0x555e1e70d9e0 2023-10-16T13:14:56.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.254+0000 7fb1fe7bfb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e1e7010a0 con 0x555e1e6f7e20 2023-10-16T13:14:56.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.254+0000 7fb1eb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f9620 0x555e1e6f9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:56.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.254+0000 7fb1eb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f9620 0x555e1e6f9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38312/0 (socket says 172.21.15.92:38312) 2023-10-16T13:14:56.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.254+0000 7fb1eb7fe700 1 -- 172.21.15.92:0/1135916745 learned_addr learned my addr 172.21.15.92:0/1135916745 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:56.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.254+0000 7fb1ebfff700 1 --2- 172.21.15.92:0/1135916745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 0x555e1e6f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:56.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.254+0000 7fb1f0b72700 1 --2- 172.21.15.92:0/1135916745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e70d9e0 0x555e1e6f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:56.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.254+0000 7fb1eb7fe700 1 -- 172.21.15.92:0/1135916745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 msgr2=0x555e1e6f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:56.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.254+0000 7fb1eb7fe700 1 --2- 172.21.15.92:0/1135916745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 0x555e1e6f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.254+0000 7fb1eb7fe700 1 -- 172.21.15.92:0/1135916745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e70d9e0 msgr2=0x555e1e6f2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:56.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.254+0000 7fb1eb7fe700 1 --2- 172.21.15.92:0/1135916745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e70d9e0 0x555e1e6f2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.254+0000 7fb1eb7fe700 1 -- 172.21.15.92:0/1135916745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e1e45ec60 con 0x555e1e6f9620 2023-10-16T13:14:56.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.254+0000 7fb1eb7fe700 1 --2- 172.21.15.92:0/1135916745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f9620 0x555e1e6f9a00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0010a40 tx=0x7fb1e0011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370c23e09fdefc28 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:56.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.255+0000 7fb1d2ffd700 1 -- 172.21.15.92:0/1135916745 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e002d070 con 0x555e1e6f9620 2023-10-16T13:14:56.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.255+0000 7fb1d2ffd700 1 -- 172.21.15.92:0/1135916745 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb1e001e730 con 0x555e1e6f9620 2023-10-16T13:14:56.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.255+0000 7fb1d2ffd700 1 -- 172.21.15.92:0/1135916745 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e00056f0 con 0x555e1e6f9620 2023-10-16T13:14:56.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.255+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/1135916745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f9620 msgr2=0x555e1e6f9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:56.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.255+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/1135916745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f9620 0x555e1e6f9a00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0010a40 tx=0x7fb1e0011e50 comp rx=0 tx=0).stop 2023-10-16T13:14:56.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.255+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/1135916745 shutdown_connections 2023-10-16T13:14:56.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.255+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/1135916745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e70d9e0 0x555e1e6f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.255+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/1135916745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 0x555e1e6f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.255+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/1135916745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e6f9620 0x555e1e6f9a00 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.255+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/1135916745 >> 172.21.15.92:0/1135916745 conn(0x555e1e625dd0 msgr2=0x555e1e6f17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:56.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.255+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/1135916745 shutdown_connections 2023-10-16T13:14:56.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.255+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/1135916745 wait complete. 2023-10-16T13:14:56.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.256+0000 7fb1fe7bfb80 1 -- start start 2023-10-16T13:14:56.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.256+0000 7fb1fe7bfb80 1 Processor -- start 2023-10-16T13:14:56.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.256+0000 7fb1fe7bfb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 0x555e1e7074d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:56.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.256+0000 7fb1fe7bfb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e6f9620 0x555e1e707a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:56.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.256+0000 7fb1fe7bfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e70d9e0 0x555e1e708570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:56.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.256+0000 7fb1fe7bfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e1e708ab0 con 0x555e1e70d9e0 2023-10-16T13:14:56.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.256+0000 7fb1fe7bfb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e1e708c20 con 0x555e1e6f9620 2023-10-16T13:14:56.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.256+0000 7fb1fe7bfb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e1e708de0 con 0x555e1e6f7e20 2023-10-16T13:14:56.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.256+0000 7fb1fe7bfb80 10 client.0 _ll_register_callbacks cb 0x7fb1dc00cc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:14:56.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.256+0000 7fb1f0b72700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e70d9e0 0x555e1e708570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:56.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.256+0000 7fb1eb7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e6f9620 0x555e1e707a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:56.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.256+0000 7fb1f0b72700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e70d9e0 0x555e1e708570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38320/0 (socket says 172.21.15.92:38320) 2023-10-16T13:14:56.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.256+0000 7fb1ebfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 0x555e1e7074d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:56.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.256+0000 7fb1f0b72700 1 -- 172.21.15.92:0/723386479 learned_addr learned my addr 172.21.15.92:0/723386479 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:14:56.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1eb7fe700 1 -- 172.21.15.92:0/723386479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 msgr2=0x555e1e7074d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:56.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1eb7fe700 1 --2- 172.21.15.92:0/723386479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 0x555e1e7074d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1eb7fe700 1 -- 172.21.15.92:0/723386479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e70d9e0 msgr2=0x555e1e708570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:14:56.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1eb7fe700 1 --2- 172.21.15.92:0/723386479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e70d9e0 0x555e1e708570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1eb7fe700 1 -- 172.21.15.92:0/723386479 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555e1e475de0 con 0x555e1e6f9620 2023-10-16T13:14:56.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1f0b72700 1 --2- 172.21.15.92:0/723386479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e70d9e0 0x555e1e708570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:14:56.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1eb7fe700 1 --2- 172.21.15.92:0/723386479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e6f9620 0x555e1e707a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00052c0 tx=0x7fb1e0005620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2560a9acc4c4fb00 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:14:56.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1cb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-16T13:14:56.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1cb7fe700 1 -- 172.21.15.92:0/723386479 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e002d040 con 0x555e1e6f9620 2023-10-16T13:14:56.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1cb7fe700 1 -- 172.21.15.92:0/723386479 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb1e0017070 con 0x555e1e6f9620 2023-10-16T13:14:56.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/723386479 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb1e0015070 con 0x555e1e6f9620 2023-10-16T13:14:56.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1cb7fe700 1 -- 172.21.15.92:0/723386479 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1e00048a0 con 0x555e1e6f9620 2023-10-16T13:14:56.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1fe7bfb80 10 client.25547 fetch_fsmap learned FSMap version 35 2023-10-16T13:14:56.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/723386479 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x555e1e49c250 con 0x555e1e6f9620 2023-10-16T13:14:56.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1cb7fe700 1 -- 172.21.15.92:0/723386479 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb1e0015070 con 0x555e1e6f9620 2023-10-16T13:14:56.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1cb7fe700 1 -- 172.21.15.92:0/723386479 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 35) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fb1e004f410 con 0x555e1e6f9620 2023-10-16T13:14:56.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1fe7bfb80 10 client.25547 fetch_fsmap finished waiting for FSMap version 35 2023-10-16T13:14:56.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1fe7bfb80 10 client.25547 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-16T13:14:56.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1fe7bfb80 20 client.25547 populate_metadata read hostname 'smithi092' 2023-10-16T13:14:56.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/723386479 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x555e1e7643e0 0x555e1e766800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:14:56.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1fe7bfb80 4 client.25547 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-16T13:14:56.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.257+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/723386479 --> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555e1e643e50 con 0x555e1e7643e0 2023-10-16T13:14:56.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.258+0000 7fb1ebfff700 1 --2- 172.21.15.92:0/723386479 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x555e1e7643e0 0x555e1e766800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:14:56.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.258+0000 7fb1cb7fe700 10 client.25547 ms_handle_connect on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:56.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.258+0000 7fb1ebfff700 1 --2- 172.21.15.92:0/723386479 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x555e1e7643e0 0x555e1e766800 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=402a962f572abf00 server_cookie=27a03175ed9e5a0e in_seq=0 out_seq=0 2023-10-16T13:14:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.258+0000 7fb1cb7fe700 1 -- 172.21.15.92:0/723386479 <== mds.0 v2:172.21.15.118:6838/1577355936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555e1e643e50 con 0x555e1e7643e0 2023-10-16T13:14:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.258+0000 7fb1cb7fe700 10 client.25547 handle_command_reply: tid=0 2023-10-16T13:14:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.258+0000 7fb1fe7bfb80 1 client.25547 shutdown 2023-10-16T13:14:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.258+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/723386479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e6f9620 msgr2=0x555e1e707a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.258+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/723386479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e6f9620 0x555e1e707a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00052c0 tx=0x7fb1e0005620 comp rx=0 tx=0).stop 2023-10-16T13:14:56.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.258+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/723386479 shutdown_connections 2023-10-16T13:14:56.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.258+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/723386479 >> [v2:172.21.15.118:6838/1577355936,v1:172.21.15.118:6839/1577355936] conn(0x555e1e7643e0 0x555e1e766800 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.258+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/723386479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e1e70d9e0 0x555e1e708570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.258+0000 7fb1cb7fe700 0 client.25547 ms_handle_reset on v2:172.21.15.118:6838/1577355936 2023-10-16T13:14:56.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.258+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/723386479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e1e6f7e20 0x555e1e7074d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.258+0000 7fb1fe7bfb80 1 --2- 172.21.15.92:0/723386479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555e1e6f9620 0x555e1e707a10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.258+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/723386479 >> 172.21.15.92:0/723386479 conn(0x555e1e625dd0 msgr2=0x555e1e6f2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:56.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.258+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/723386479 shutdown_connections 2023-10-16T13:14:56.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.258+0000 7fb1fe7bfb80 1 -- 172.21.15.92:0/723386479 wait complete. 2023-10-16T13:14:56.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.259+0000 7fb1fe7bfb80 20 client.25547 trim_cache size 0 max 16384 2023-10-16T13:14:56.285 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2023-10-16T13:14:56.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.259+0000 7fb1f25d5700 1 -- 172.21.15.92:0/2600595113 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb1d40a1480 msgr2=0x7fb1d40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:56.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.259+0000 7fb1f25d5700 1 --2- 172.21.15.92:0/2600595113 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb1d40a1480 0x7fb1d40a3940 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0005950 tx=0x7fb1e000b410 comp rx=0 tx=0).stop 2023-10-16T13:14:56.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.259+0000 7fb1f25d5700 1 -- 172.21.15.92:0/2600595113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1ec0ffe00 msgr2=0x7fb1ec195d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:14:56.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.259+0000 7fb1f25d5700 1 --2- 172.21.15.92:0/2600595113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1ec0ffe00 0x7fb1ec195d30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00e950 tx=0x7fb1dc00ec60 comp rx=0 tx=0).stop 2023-10-16T13:14:56.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.259+0000 7fb1f25d5700 1 -- 172.21.15.92:0/2600595113 shutdown_connections 2023-10-16T13:14:56.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.259+0000 7fb1f25d5700 1 --2- 172.21.15.92:0/2600595113 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb1d40a1480 0x7fb1d40a3940 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.259+0000 7fb1f25d5700 1 --2- 172.21.15.92:0/2600595113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1ec0ffe00 0x7fb1ec195d30 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.259+0000 7fb1f25d5700 1 --2- 172.21.15.92:0/2600595113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1ec101990 0x7fb1ec19d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.259+0000 7fb1f25d5700 1 --2- 172.21.15.92:0/2600595113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1ec100ff0 0x7fb1ec196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:14:56.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.259+0000 7fb1f25d5700 1 -- 172.21.15.92:0/2600595113 >> 172.21.15.92:0/2600595113 conn(0x7fb1ec0fb370 msgr2=0x7fb1ec104440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:14:56.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.259+0000 7fb1f25d5700 1 -- 172.21.15.92:0/2600595113 shutdown_connections 2023-10-16T13:14:56.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:14:56.259+0000 7fb1f25d5700 1 -- 172.21.15.92:0/2600595113 wait complete. 2023-10-16T13:14:56.288 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 42263757, 'ino': 1099511632117, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt'}, {'damage_type': 'backtrace', 'id': 79193863, 'ino': 1099511632175, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt'}, {'damage_type': 'backtrace', 'id': 121960522, 'ino': 1099511632159, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt'}, {'damage_type': 'backtrace', 'id': 232918545, 'ino': 1099511632130, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt'}, {'damage_type': 'backtrace', 'id': 275383553, 'ino': 1099511632119, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt'}, {'damage_type': 'backtrace', 'id': 323546307, 'ino': 1099511632134, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt'}, {'damage_type': 'backtrace', 'id': 359895822, 'ino': 1099511632172, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt'}, {'damage_type': 'backtrace', 'id': 367493939, 'ino': 1099511632176, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt'}, {'damage_type': 'backtrace', 'id': 528826317, 'ino': 1099511632163, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt'}, {'damage_type': 'backtrace', 'id': 561930813, 'ino': 1099511632102, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt'}, {'damage_type': 'backtrace', 'id': 593504649, 'ino': 1099511632625, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt'}, {'damage_type': 'backtrace', 'id': 599291543, 'ino': 1099511632133, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt'}, {'damage_type': 'backtrace', 'id': 642387858, 'ino': 1099511632177, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt'}, {'damage_type': 'backtrace', 'id': 656447024, 'ino': 1099511632154, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt'}, {'damage_type': 'backtrace', 'id': 671908726, 'ino': 1099511632131, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt'}, {'damage_type': 'backtrace', 'id': 798108690, 'ino': 1099511632121, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt'}, {'damage_type': 'backtrace', 'id': 991054217, 'ino': 1099511632156, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt'}, {'damage_type': 'backtrace', 'id': 1017254855, 'ino': 1099511632146, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt'}, {'damage_type': 'backtrace', 'id': 1068031716, 'ino': 1099511632138, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt'}, {'damage_type': 'backtrace', 'id': 1085340842, 'ino': 1099511632112, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt'}, {'damage_type': 'backtrace', 'id': 1172224687, 'ino': 1099511632125, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt'}, {'damage_type': 'backtrace', 'id': 1254483024, 'ino': 1099511632120, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt'}, {'damage_type': 'backtrace', 'id': 1278789926, 'ino': 1099511632137, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt'}, {'damage_type': 'backtrace', 'id': 1333898767, 'ino': 1099511632167, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt'}, {'damage_type': 'backtrace', 'id': 1377794587, 'ino': 1099511632166, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt'}, {'damage_type': 'backtrace', 'id': 1430939537, 'ino': 1099511632126, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt'}, {'damage_type': 'backtrace', 'id': 1462743461, 'ino': 1099511632162, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt'}, {'damage_type': 'backtrace', 'id': 1480582501, 'ino': 1099511632141, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt'}, {'damage_type': 'backtrace', 'id': 1498188431, 'ino': 1099511632628, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt'}, {'damage_type': 'backtrace', 'id': 1538044136, 'ino': 1099511632135, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt'}, {'damage_type': 'backtrace', 'id': 1707516174, 'ino': 1099511632127, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt'}, {'damage_type': 'backtrace', 'id': 1720913004, 'ino': 1099511632150, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt'}, {'damage_type': 'backtrace', 'id': 1754033021, 'ino': 1099511632108, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt'}, {'damage_type': 'backtrace', 'id': 1820088931, 'ino': 1099511632136, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt'}, {'damage_type': 'backtrace', 'id': 1838345992, 'ino': 1099511632105, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt'}, {'damage_type': 'backtrace', 'id': 1867579455, 'ino': 1099511632113, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt'}, {'damage_type': 'backtrace', 'id': 1941689016, 'ino': 1099511632148, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt'}, {'damage_type': 'backtrace', 'id': 1958457261, 'ino': 1099511632123, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt'}, {'damage_type': 'backtrace', 'id': 2068891910, 'ino': 1099511632161, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt'}, {'damage_type': 'backtrace', 'id': 2191329414, 'ino': 1099511632145, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt'}, {'damage_type': 'backtrace', 'id': 2282447235, 'ino': 1099511632626, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt'}, {'damage_type': 'backtrace', 'id': 2338218011, 'ino': 1099511632116, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt'}, {'damage_type': 'backtrace', 'id': 2368425670, 'ino': 1099511632624, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt'}, {'damage_type': 'backtrace', 'id': 2370227622, 'ino': 1099511632158, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt'}, {'damage_type': 'backtrace', 'id': 2538928543, 'ino': 1099511632118, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt'}, {'damage_type': 'backtrace', 'id': 2599302135, 'ino': 1099511632107, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt'}, {'damage_type': 'backtrace', 'id': 2715513660, 'ino': 1099511632151, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt'}, {'damage_type': 'backtrace', 'id': 2769655608, 'ino': 1099511632109, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt'}, {'damage_type': 'backtrace', 'id': 2787777281, 'ino': 1099511632164, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt'}, {'damage_type': 'backtrace', 'id': 2826579988, 'ino': 1099511632153, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt'}, {'damage_type': 'backtrace', 'id': 2834792501, 'ino': 1099511632140, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt'}, {'damage_type': 'backtrace', 'id': 3041698891, 'ino': 1099511632122, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt'}, {'damage_type': 'backtrace', 'id': 3084224073, 'ino': 1099511632160, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt'}, {'damage_type': 'backtrace', 'id': 3150767744, 'ino': 1099511632623, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt'}, {'damage_type': 'backtrace', 'id': 3155339526, 'ino': 1099511632171, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt'}, {'damage_type': 'backtrace', 'id': 3170877734, 'ino': 1099511632142, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt'}, {'damage_type': 'backtrace', 'id': 3254064669, 'ino': 1099511632165, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt'}, {'damage_type': 'backtrace', 'id': 3327771706, 'ino': 1099511632168, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt'}, {'damage_type': 'backtrace', 'id': 3345905612, 'ino': 1099511632149, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt'}, {'damage_type': 'backtrace', 'id': 3365017589, 'ino': 1099511632174, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt'}, {'damage_type': 'backtrace', 'id': 3398902434, 'ino': 1099511632124, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt'}, {'damage_type': 'backtrace', 'id': 3521316236, 'ino': 1099511632173, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt'}, {'damage_type': 'backtrace', 'id': 3654290787, 'ino': 1099511632155, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt'}, {'damage_type': 'backtrace', 'id': 3708517984, 'ino': 1099511632627, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt'}, {'damage_type': 'backtrace', 'id': 3728321698, 'ino': 1099511632147, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt'}, {'damage_type': 'backtrace', 'id': 3781874547, 'ino': 1099511632106, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt'}, {'damage_type': 'backtrace', 'id': 3791758814, 'ino': 1099511632157, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt'}, {'damage_type': 'backtrace', 'id': 3805404463, 'ino': 1099511632152, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt'}, {'damage_type': 'backtrace', 'id': 3830403279, 'ino': 1099511632132, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt'}, {'damage_type': 'backtrace', 'id': 3878616342, 'ino': 1099511632103, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt'}, {'damage_type': 'backtrace', 'id': 3916704499, 'ino': 1099511632114, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt'}, {'damage_type': 'backtrace', 'id': 3989405851, 'ino': 1099511632110, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt'}, {'damage_type': 'backtrace', 'id': 4006883688, 'ino': 1099511632143, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt'}, {'damage_type': 'backtrace', 'id': 4019925432, 'ino': 1099511632115, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt'}, {'damage_type': 'backtrace', 'id': 4033359920, 'ino': 1099511632128, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt'}, {'damage_type': 'backtrace', 'id': 4048698505, 'ino': 1099511632170, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt'}, {'damage_type': 'backtrace', 'id': 4081245542, 'ino': 1099511632139, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt'}, {'damage_type': 'backtrace', 'id': 4099592255, 'ino': 1099511632111, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt'}, {'damage_type': 'backtrace', 'id': 4113991274, 'ino': 1099511632169, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt'}, {'damage_type': 'backtrace', 'id': 4134278649, 'ino': 1099511632129, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt'}, {'damage_type': 'backtrace', 'id': 4143630256, 'ino': 1099511632144, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt'}, {'damage_type': 'backtrace', 'id': 4178346043, 'ino': 1099511632104, 'path': '/volumes/_nogroup/sv_1/092061c0-acab-4491-9dc4-d5fd37348927/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt'}] 2023-10-16T13:14:56.289 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2023-10-16T13:14:56.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:56 smithi152 ceph-mon[104423]: pgmap v355: 97 pgs: 97 active+clean; 48 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 598 op/s 2023-10-16T13:14:56.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:56 smithi092 ceph-mon[99542]: pgmap v355: 97 pgs: 97 active+clean; 48 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 598 op/s 2023-10-16T13:14:56.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:56 smithi118 ceph-mon[103969]: pgmap v355: 97 pgs: 97 active+clean; 48 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 598 op/s 2023-10-16T13:14:58.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:14:58 smithi152 ceph-mon[104423]: pgmap v356: 97 pgs: 97 active+clean; 44 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 833 op/s 2023-10-16T13:14:58.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:14:58 smithi092 ceph-mon[99542]: pgmap v356: 97 pgs: 97 active+clean; 44 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 833 op/s 2023-10-16T13:14:58.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:14:58 smithi118 ceph-mon[103969]: pgmap v356: 97 pgs: 97 active+clean; 44 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 833 op/s 2023-10-16T13:15:00.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:00 smithi152 ceph-mon[104423]: pgmap v357: 97 pgs: 97 active+clean; 42 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 807 op/s 2023-10-16T13:15:00.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:00 smithi092 ceph-mon[99542]: pgmap v357: 97 pgs: 97 active+clean; 42 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 807 op/s 2023-10-16T13:15:00.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:00 smithi118 ceph-mon[103969]: pgmap v357: 97 pgs: 97 active+clean; 42 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 807 op/s 2023-10-16T13:15:02.538 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:02 smithi152 ceph-mon[104423]: pgmap v358: 97 pgs: 97 active+clean; 43 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 1.4 MiB/s wr, 727 op/s 2023-10-16T13:15:02.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:02 smithi092 ceph-mon[99542]: pgmap v358: 97 pgs: 97 active+clean; 43 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 1.4 MiB/s wr, 727 op/s 2023-10-16T13:15:02.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:02 smithi118 ceph-mon[103969]: pgmap v358: 97 pgs: 97 active+clean; 43 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 1.4 MiB/s wr, 727 op/s 2023-10-16T13:15:03.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:03 smithi152 ceph-mon[104423]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:15:03.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:03 smithi092 ceph-mon[99542]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:15:03.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:03 smithi118 ceph-mon[103969]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:15:04.381 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2023-10-16T13:15:04.382 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-16T13:15:04.681 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:04 smithi092 ceph-mon[99542]: pgmap v359: 97 pgs: 97 active+clean; 42 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 741 op/s 2023-10-16T13:15:04.682 DEBUG:teuthology.parallel:result is None 2023-10-16T13:15:04.683 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-10-16T13:15:04.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:04 smithi152 ceph-mon[104423]: pgmap v359: 97 pgs: 97 active+clean; 42 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 741 op/s 2023-10-16T13:15:04.716 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-10-16T13:15:04.716 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2023-10-16T13:15:04.729 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi092.front.sepia.ceph.com 2023-10-16T13:15:04.765 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-10-16T13:15:04.775 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-10-16T13:15:04.776 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-10-16T13:15:04.776 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-10-16T13:15:04.786 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:15:04.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:04 smithi118 ceph-mon[103969]: pgmap v359: 97 pgs: 97 active+clean; 42 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 741 op/s 2023-10-16T13:15:04.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.939+0000 7f1c0ba79700 1 -- 172.21.15.92:0/1740000396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c04104290 msgr2=0x7f1c04106680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:04.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.939+0000 7f1c0ba79700 1 --2- 172.21.15.92:0/1740000396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c04104290 0x7f1c04106680 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4009990 tx=0x7f1bf4009ca0 comp rx=0 tx=0).stop 2023-10-16T13:15:04.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.940+0000 7f1c0ba79700 1 -- 172.21.15.92:0/1740000396 shutdown_connections 2023-10-16T13:15:04.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.940+0000 7f1c0ba79700 1 --2- 172.21.15.92:0/1740000396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c04106bc0 0x7f1c04109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:04.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.940+0000 7f1c0ba79700 1 --2- 172.21.15.92:0/1740000396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c04101960 0x7f1c04103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:04.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.940+0000 7f1c0ba79700 1 --2- 172.21.15.92:0/1740000396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c04104290 0x7f1c04106680 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:04.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.940+0000 7f1c0ba79700 1 -- 172.21.15.92:0/1740000396 >> 172.21.15.92:0/1740000396 conn(0x7f1c040fb310 msgr2=0x7f1c040fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:04.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.940+0000 7f1c0ba79700 1 -- 172.21.15.92:0/1740000396 shutdown_connections 2023-10-16T13:15:04.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.940+0000 7f1c0ba79700 1 -- 172.21.15.92:0/1740000396 wait complete. 2023-10-16T13:15:04.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.940+0000 7f1c0ba79700 1 Processor -- start 2023-10-16T13:15:04.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.940+0000 7f1c0ba79700 1 -- start start 2023-10-16T13:15:04.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.940+0000 7f1c0ba79700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c04101960 0x7f1c04196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:04.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.940+0000 7f1c0ba79700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c04104290 0x7f1c04197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:04.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.940+0000 7f1c0ba79700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c04106bc0 0x7f1c0419e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:04.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.940+0000 7f1c0ba79700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0419e740 con 0x7f1c04106bc0 2023-10-16T13:15:04.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.940+0000 7f1c0ba79700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0419e880 con 0x7f1c04104290 2023-10-16T13:15:04.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.940+0000 7f1c0ba79700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0419ea10 con 0x7f1c04101960 2023-10-16T13:15:04.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.941+0000 7f1c09014700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c04104290 0x7f1c04197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:04.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.941+0000 7f1c0a016700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c04106bc0 0x7f1c0419e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:04.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.941+0000 7f1c09014700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c04104290 0x7f1c04197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.92:39140/0 (socket says 172.21.15.92:39140) 2023-10-16T13:15:04.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.941+0000 7f1c09014700 1 -- 172.21.15.92:0/607764040 learned_addr learned my addr 172.21.15.92:0/607764040 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:15:04.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.941+0000 7f1c09815700 1 --2- 172.21.15.92:0/607764040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c04101960 0x7f1c04196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:04.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.941+0000 7f1c0a016700 1 -- 172.21.15.92:0/607764040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c04101960 msgr2=0x7f1c04196bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:04.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.941+0000 7f1c0a016700 1 --2- 172.21.15.92:0/607764040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c04101960 0x7f1c04196bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:04.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.941+0000 7f1c0a016700 1 -- 172.21.15.92:0/607764040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c04104290 msgr2=0x7f1c04197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:04.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.941+0000 7f1c0a016700 1 --2- 172.21.15.92:0/607764040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c04104290 0x7f1c04197100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:04.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.941+0000 7f1c0a016700 1 -- 172.21.15.92:0/607764040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf40095f0 con 0x7f1c04106bc0 2023-10-16T13:15:04.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.941+0000 7f1c0a016700 1 --2- 172.21.15.92:0/607764040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c04106bc0 0x7f1c0419e170 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00ab40 tx=0x7f1bfc00ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:04.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.941+0000 7f1bfaffd700 1 -- 172.21.15.92:0/607764040 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00f070 con 0x7f1c04106bc0 2023-10-16T13:15:04.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.941+0000 7f1c0ba79700 1 -- 172.21.15.92:0/607764040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0419ecf0 con 0x7f1c04106bc0 2023-10-16T13:15:04.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.941+0000 7f1bfaffd700 1 -- 172.21.15.92:0/607764040 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1bfc007a70 con 0x7f1c04106bc0 2023-10-16T13:15:04.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.941+0000 7f1bfaffd700 1 -- 172.21.15.92:0/607764040 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc005280 con 0x7f1c04106bc0 2023-10-16T13:15:04.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.941+0000 7f1c0ba79700 1 -- 172.21.15.92:0/607764040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0419f1b0 con 0x7f1c04106bc0 2023-10-16T13:15:04.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.942+0000 7f1c0ba79700 1 -- 172.21.15.92:0/607764040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c040fce90 con 0x7f1c04106bc0 2023-10-16T13:15:04.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.943+0000 7f1bfaffd700 1 -- 172.21.15.92:0/607764040 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f1bfc004ad0 con 0x7f1c04106bc0 2023-10-16T13:15:04.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.944+0000 7f1bfaffd700 1 --2- 172.21.15.92:0/607764040 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1bf00a1520 0x7f1bf00a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:04.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.944+0000 7f1c09815700 1 --2- 172.21.15.92:0/607764040 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1bf00a1520 0x7f1bf00a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:04.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.944+0000 7f1bfaffd700 1 -- 172.21.15.92:0/607764040 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1bfc0cc100 con 0x7f1c04106bc0 2023-10-16T13:15:04.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.944+0000 7f1c09815700 1 --2- 172.21.15.92:0/607764040 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1bf00a1520 0x7f1bf00a39e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1c00005950 tx=0x7f1c0000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:04.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:04.948+0000 7f1bfaffd700 1 -- 172.21.15.92:0/607764040 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1bfc0957f0 con 0x7f1c04106bc0 2023-10-16T13:15:05.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.141+0000 7f1c0ba79700 1 -- 172.21.15.92:0/607764040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c0410c860 con 0x7f1c04106bc0 2023-10-16T13:15:05.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.143+0000 7f1bfaffd700 1 -- 172.21.15.92:0/607764040 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22598 (secure 0 0 0) 0x7f1bfc098e10 con 0x7f1c04106bc0 2023-10-16T13:15:05.145 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:15:05.145 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":85,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:12:36.335213+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:11:38.345035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:11:39.549912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:15:05.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.145+0000 7f1c0ba79700 1 -- 172.21.15.92:0/607764040 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1bf00a1520 msgr2=0x7f1bf00a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:05.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.145+0000 7f1c0ba79700 1 --2- 172.21.15.92:0/607764040 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1bf00a1520 0x7f1bf00a39e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1c00005950 tx=0x7f1c0000b410 comp rx=0 tx=0).stop 2023-10-16T13:15:05.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.145+0000 7f1c0ba79700 1 -- 172.21.15.92:0/607764040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c04106bc0 msgr2=0x7f1c0419e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:05.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.145+0000 7f1c0ba79700 1 --2- 172.21.15.92:0/607764040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c04106bc0 0x7f1c0419e170 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00ab40 tx=0x7f1bfc00ae50 comp rx=0 tx=0).stop 2023-10-16T13:15:05.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.145+0000 7f1c0ba79700 1 -- 172.21.15.92:0/607764040 shutdown_connections 2023-10-16T13:15:05.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.145+0000 7f1c0ba79700 1 --2- 172.21.15.92:0/607764040 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f1bf00a1520 0x7f1bf00a39e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.145+0000 7f1c0ba79700 1 --2- 172.21.15.92:0/607764040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c04106bc0 0x7f1c0419e170 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.145+0000 7f1c0ba79700 1 --2- 172.21.15.92:0/607764040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c04101960 0x7f1c04196bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.145+0000 7f1c0ba79700 1 --2- 172.21.15.92:0/607764040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c04104290 0x7f1c04197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.145+0000 7f1c0ba79700 1 -- 172.21.15.92:0/607764040 >> 172.21.15.92:0/607764040 conn(0x7f1c040fb310 msgr2=0x7f1c041025d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:05.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.145+0000 7f1c0ba79700 1 -- 172.21.15.92:0/607764040 shutdown_connections 2023-10-16T13:15:05.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.145+0000 7f1c0ba79700 1 -- 172.21.15.92:0/607764040 wait complete. 2023-10-16T13:15:05.159 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:07:45.516334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:11:38.345035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:11:39.549912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:15:05.160 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:15:05.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.283+0000 7f8f0fbb2700 1 -- 172.21.15.92:0/108603362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f08106b90 msgr2=0x7f8f08109000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:05.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.283+0000 7f8f0fbb2700 1 --2- 172.21.15.92:0/108603362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f08106b90 0x7f8f08109000 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000b0a0 tx=0x7f8f0000b3b0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.283+0000 7f8f0fbb2700 1 -- 172.21.15.92:0/108603362 shutdown_connections 2023-10-16T13:15:05.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.283+0000 7f8f0fbb2700 1 --2- 172.21.15.92:0/108603362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f08106b90 0x7f8f08109000 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.283+0000 7f8f0fbb2700 1 --2- 172.21.15.92:0/108603362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f08101930 0x7f8f08103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.283+0000 7f8f0fbb2700 1 --2- 172.21.15.92:0/108603362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f08104260 0x7f8f08106650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.283+0000 7f8f0fbb2700 1 -- 172.21.15.92:0/108603362 >> 172.21.15.92:0/108603362 conn(0x7f8f080fb320 msgr2=0x7f8f080fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:05.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.283+0000 7f8f0fbb2700 1 -- 172.21.15.92:0/108603362 shutdown_connections 2023-10-16T13:15:05.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.283+0000 7f8f0fbb2700 1 -- 172.21.15.92:0/108603362 wait complete. 2023-10-16T13:15:05.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.283+0000 7f8f0fbb2700 1 Processor -- start 2023-10-16T13:15:05.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0fbb2700 1 -- start start 2023-10-16T13:15:05.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0fbb2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f08101930 0x7f8f08196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:05.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0fbb2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f08104260 0x7f8f08197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:05.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0fbb2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f08106b90 0x7f8f0819e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:05.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0fbb2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0819e8c0 con 0x7f8f08106b90 2023-10-16T13:15:05.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0fbb2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0819ea00 con 0x7f8f08101930 2023-10-16T13:15:05.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0fbb2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0819eb90 con 0x7f8f08104260 2023-10-16T13:15:05.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0e14f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f08106b90 0x7f8f0819e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:05.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0e14f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f08106b90 0x7f8f0819e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38348/0 (socket says 172.21.15.92:38348) 2023-10-16T13:15:05.290 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0e14f700 1 -- 172.21.15.92:0/1673793017 learned_addr learned my addr 172.21.15.92:0/1673793017 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:15:05.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0d14d700 1 --2- 172.21.15.92:0/1673793017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f08104260 0x7f8f08197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:05.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0d94e700 1 --2- 172.21.15.92:0/1673793017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f08101930 0x7f8f08196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:05.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0e14f700 1 -- 172.21.15.92:0/1673793017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f08104260 msgr2=0x7f8f08197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:05.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0e14f700 1 --2- 172.21.15.92:0/1673793017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f08104260 0x7f8f08197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0e14f700 1 -- 172.21.15.92:0/1673793017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f08101930 msgr2=0x7f8f08196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:05.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0e14f700 1 --2- 172.21.15.92:0/1673793017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f08101930 0x7f8f08196d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0e14f700 1 -- 172.21.15.92:0/1673793017 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f00009d00 con 0x7f8f08106b90 2023-10-16T13:15:05.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0d14d700 1 --2- 172.21.15.92:0/1673793017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f08104260 0x7f8f08197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:15:05.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0e14f700 1 --2- 172.21.15.92:0/1673793017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f08106b90 0x7f8f0819e2f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000b780 tx=0x7f8f0000be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:05.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8efeffd700 1 -- 172.21.15.92:0/1673793017 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0000e040 con 0x7f8f08106b90 2023-10-16T13:15:05.292 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8efeffd700 1 -- 172.21.15.92:0/1673793017 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8f00004e60 con 0x7f8f08106b90 2023-10-16T13:15:05.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8f0fbb2700 1 -- 172.21.15.92:0/1673793017 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0819ee10 con 0x7f8f08106b90 2023-10-16T13:15:05.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.284+0000 7f8efeffd700 1 -- 172.21.15.92:0/1673793017 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00005440 con 0x7f8f08106b90 2023-10-16T13:15:05.293 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.285+0000 7f8f0fbb2700 1 -- 172.21.15.92:0/1673793017 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0819f230 con 0x7f8f08106b90 2023-10-16T13:15:05.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.285+0000 7f8f0fbb2700 1 -- 172.21.15.92:0/1673793017 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f080fcea0 con 0x7f8f08106b90 2023-10-16T13:15:05.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.287+0000 7f8efeffd700 1 -- 172.21.15.92:0/1673793017 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8f0001d470 con 0x7f8f08106b90 2023-10-16T13:15:05.294 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.287+0000 7f8efeffd700 1 --2- 172.21.15.92:0/1673793017 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f8ef40a1480 0x7f8ef40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:05.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.287+0000 7f8f0d94e700 1 --2- 172.21.15.92:0/1673793017 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f8ef40a1480 0x7f8ef40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:05.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.287+0000 7f8efeffd700 1 -- 172.21.15.92:0/1673793017 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f8f000ce770 con 0x7f8f08106b90 2023-10-16T13:15:05.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.288+0000 7f8f0d94e700 1 --2- 172.21.15.92:0/1673793017 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f8ef40a1480 0x7f8ef40a3940 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009bf0 tx=0x7f8ef8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:05.295 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.290+0000 7f8efeffd700 1 -- 172.21.15.92:0/1673793017 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8f00097e60 con 0x7f8f08106b90 2023-10-16T13:15:05.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.487+0000 7f8f0fbb2700 1 -- 172.21.15.92:0/1673793017 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8f0802cf70 con 0x7f8f08106b90 2023-10-16T13:15:05.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.488+0000 7f8efeffd700 1 -- 172.21.15.92:0/1673793017 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8f0009b480 con 0x7f8f08106b90 2023-10-16T13:15:05.490 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-10-16T13:15:05.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.490+0000 7f8f0fbb2700 1 -- 172.21.15.92:0/1673793017 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f8ef40a1480 msgr2=0x7f8ef40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:05.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.490+0000 7f8f0fbb2700 1 --2- 172.21.15.92:0/1673793017 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f8ef40a1480 0x7f8ef40a3940 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009bf0 tx=0x7f8ef8009260 comp rx=0 tx=0).stop 2023-10-16T13:15:05.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.490+0000 7f8f0fbb2700 1 -- 172.21.15.92:0/1673793017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f08106b90 msgr2=0x7f8f0819e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:05.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.490+0000 7f8f0fbb2700 1 --2- 172.21.15.92:0/1673793017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f08106b90 0x7f8f0819e2f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000b780 tx=0x7f8f0000be10 comp rx=0 tx=0).stop 2023-10-16T13:15:05.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.490+0000 7f8f0fbb2700 1 -- 172.21.15.92:0/1673793017 shutdown_connections 2023-10-16T13:15:05.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.490+0000 7f8f0fbb2700 1 --2- 172.21.15.92:0/1673793017 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f8ef40a1480 0x7f8ef40a3940 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.490+0000 7f8f0fbb2700 1 --2- 172.21.15.92:0/1673793017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f08106b90 0x7f8f0819e2f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.490+0000 7f8f0fbb2700 1 --2- 172.21.15.92:0/1673793017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f08101930 0x7f8f08196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.490+0000 7f8f0fbb2700 1 --2- 172.21.15.92:0/1673793017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f08104260 0x7f8f08197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.490+0000 7f8f0fbb2700 1 -- 172.21.15.92:0/1673793017 >> 172.21.15.92:0/1673793017 conn(0x7f8f080fb320 msgr2=0x7f8f081025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:05.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.490+0000 7f8f0fbb2700 1 -- 172.21.15.92:0/1673793017 shutdown_connections 2023-10-16T13:15:05.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.490+0000 7f8f0fbb2700 1 -- 172.21.15.92:0/1673793017 wait complete. 2023-10-16T13:15:05.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:05 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/607764040' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:15:05.504 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:15:05.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.626+0000 7fe6b7769700 1 -- 172.21.15.92:0/3782539810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b0100fb0 msgr2=0x7fe6b0101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:05.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.626+0000 7fe6b7769700 1 --2- 172.21.15.92:0/3782539810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b0100fb0 0x7fe6b0101410 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac0099c0 tx=0x7fe6ac009cd0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.626+0000 7fe6b7769700 1 -- 172.21.15.92:0/3782539810 shutdown_connections 2023-10-16T13:15:05.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.626+0000 7fe6b7769700 1 --2- 172.21.15.92:0/3782539810 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6b0101950 0x7fe6b0108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.626+0000 7fe6b7769700 1 --2- 172.21.15.92:0/3782539810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6b00ffdc0 0x7fe6b01001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.626+0000 7fe6b7769700 1 --2- 172.21.15.92:0/3782539810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b0100fb0 0x7fe6b0101410 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.626+0000 7fe6b7769700 1 -- 172.21.15.92:0/3782539810 >> 172.21.15.92:0/3782539810 conn(0x7fe6b00fb2f0 msgr2=0x7fe6b00fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:05.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.626+0000 7fe6b7769700 1 -- 172.21.15.92:0/3782539810 shutdown_connections 2023-10-16T13:15:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.626+0000 7fe6b7769700 1 -- 172.21.15.92:0/3782539810 wait complete. 2023-10-16T13:15:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b7769700 1 Processor -- start 2023-10-16T13:15:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b7769700 1 -- start start 2023-10-16T13:15:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b7769700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6b00ffdc0 0x7fe6b0069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b7769700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6b0100fb0 0x7fe6b019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:05.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b7769700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b0101950 0x7fe6b019e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:05.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b7769700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b019e7f0 con 0x7fe6b0101950 2023-10-16T13:15:05.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b7769700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b019e960 con 0x7fe6b00ffdc0 2023-10-16T13:15:05.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b7769700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b019eb20 con 0x7fe6b0100fb0 2023-10-16T13:15:05.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b5d06700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b0101950 0x7fe6b019e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:05.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b5d06700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b0101950 0x7fe6b019e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38362/0 (socket says 172.21.15.92:38362) 2023-10-16T13:15:05.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b5d06700 1 -- 172.21.15.92:0/3829663211 learned_addr learned my addr 172.21.15.92:0/3829663211 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:15:05.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b4d04700 1 --2- 172.21.15.92:0/3829663211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6b0100fb0 0x7fe6b019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:05.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b5505700 1 --2- 172.21.15.92:0/3829663211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6b00ffdc0 0x7fe6b0069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:05.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b5d06700 1 -- 172.21.15.92:0/3829663211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6b0100fb0 msgr2=0x7fe6b019b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:05.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b5d06700 1 --2- 172.21.15.92:0/3829663211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6b0100fb0 0x7fe6b019b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b5d06700 1 -- 172.21.15.92:0/3829663211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6b00ffdc0 msgr2=0x7fe6b0069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:05.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b5d06700 1 --2- 172.21.15.92:0/3829663211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6b00ffdc0 0x7fe6b0069bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b5d06700 1 -- 172.21.15.92:0/3829663211 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac0095f0 con 0x7fe6b0101950 2023-10-16T13:15:05.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b5505700 1 --2- 172.21.15.92:0/3829663211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6b00ffdc0 0x7fe6b0069bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:15:05.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.627+0000 7fe6b5d06700 1 --2- 172.21.15.92:0/3829663211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b0101950 0x7fe6b019e020 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800ef30 tx=0x7fe6a800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:05.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.628+0000 7fe6a67fc700 1 -- 172.21.15.92:0/3829663211 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8018070 con 0x7fe6b0101950 2023-10-16T13:15:05.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.628+0000 7fe6a67fc700 1 -- 172.21.15.92:0/3829663211 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe6a800f040 con 0x7fe6b0101950 2023-10-16T13:15:05.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.628+0000 7fe6b7769700 1 -- 172.21.15.92:0/3829663211 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b019eda0 con 0x7fe6b0101950 2023-10-16T13:15:05.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.628+0000 7fe6a67fc700 1 -- 172.21.15.92:0/3829663211 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a800ce00 con 0x7fe6b0101950 2023-10-16T13:15:05.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.628+0000 7fe6b7769700 1 -- 172.21.15.92:0/3829663211 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b019f1d0 con 0x7fe6b0101950 2023-10-16T13:15:05.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.628+0000 7fe6b7769700 1 -- 172.21.15.92:0/3829663211 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b010b760 con 0x7fe6b0101950 2023-10-16T13:15:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.630+0000 7fe6a67fc700 1 -- 172.21.15.92:0/3829663211 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe6a8003a00 con 0x7fe6b0101950 2023-10-16T13:15:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.630+0000 7fe6a67fc700 1 --2- 172.21.15.92:0/3829663211 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe69c0a1480 0x7fe69c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.630+0000 7fe6b5505700 1 --2- 172.21.15.92:0/3829663211 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe69c0a1480 0x7fe69c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.630+0000 7fe6a67fc700 1 -- 172.21.15.92:0/3829663211 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe6a80cd280 con 0x7fe6b0101950 2023-10-16T13:15:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.630+0000 7fe6b5505700 1 --2- 172.21.15.92:0/3829663211 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe69c0a1480 0x7fe69c0a3940 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0100e10 tx=0x7fe6a0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.634+0000 7fe6a67fc700 1 -- 172.21.15.92:0/3829663211 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe6a8096970 con 0x7fe6b0101950 2023-10-16T13:15:05.691 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:05 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/607764040' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:15:05.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:05 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/607764040' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:15:05.826 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.825+0000 7fe6b7769700 1 -- 172.21.15.92:0/3829663211 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe6b0106cf0 con 0x7fe6b0101950 2023-10-16T13:15:05.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.825+0000 7fe6a67fc700 1 -- 172.21.15.92:0/3829663211 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe6a8099f90 con 0x7fe6b0101950 2023-10-16T13:15:05.827 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-10-16T13:15:05.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.827+0000 7fe6b7769700 1 -- 172.21.15.92:0/3829663211 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe69c0a1480 msgr2=0x7fe69c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:05.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.827+0000 7fe6b7769700 1 --2- 172.21.15.92:0/3829663211 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe69c0a1480 0x7fe69c0a3940 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0100e10 tx=0x7fe6a0009260 comp rx=0 tx=0).stop 2023-10-16T13:15:05.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.827+0000 7fe6b7769700 1 -- 172.21.15.92:0/3829663211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b0101950 msgr2=0x7fe6b019e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:05.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.827+0000 7fe6b7769700 1 --2- 172.21.15.92:0/3829663211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b0101950 0x7fe6b019e020 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800ef30 tx=0x7fe6a800c3a0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.827+0000 7fe6b7769700 1 -- 172.21.15.92:0/3829663211 shutdown_connections 2023-10-16T13:15:05.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.827+0000 7fe6b7769700 1 --2- 172.21.15.92:0/3829663211 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fe69c0a1480 0x7fe69c0a3940 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.827+0000 7fe6b7769700 1 --2- 172.21.15.92:0/3829663211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b0101950 0x7fe6b019e020 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.827+0000 7fe6b7769700 1 --2- 172.21.15.92:0/3829663211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6b00ffdc0 0x7fe6b0069bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.827+0000 7fe6b7769700 1 --2- 172.21.15.92:0/3829663211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6b0100fb0 0x7fe6b019b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.827+0000 7fe6b7769700 1 -- 172.21.15.92:0/3829663211 >> 172.21.15.92:0/3829663211 conn(0x7fe6b00fb2f0 msgr2=0x7fe6b00fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:05.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.828+0000 7fe6b7769700 1 -- 172.21.15.92:0/3829663211 shutdown_connections 2023-10-16T13:15:05.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.828+0000 7fe6b7769700 1 -- 172.21.15.92:0/3829663211 wait complete. 2023-10-16T13:15:05.842 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:15:05.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.964+0000 7faf177e0700 1 -- 172.21.15.92:0/3161564474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf10100ea0 msgr2=0x7faf101012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:05.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.964+0000 7faf177e0700 1 --2- 172.21.15.92:0/3161564474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf10100ea0 0x7faf101012c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7faf00009990 tx=0x7faf00009ca0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.964+0000 7faf177e0700 1 -- 172.21.15.92:0/3161564474 shutdown_connections 2023-10-16T13:15:05.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.964+0000 7faf177e0700 1 --2- 172.21.15.92:0/3161564474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf10100ea0 0x7faf101012c0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.964+0000 7faf177e0700 1 --2- 172.21.15.92:0/3161564474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf10102a40 0x7faf10109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.964+0000 7faf177e0700 1 --2- 172.21.15.92:0/3161564474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf10102080 0x7faf10102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.964+0000 7faf177e0700 1 -- 172.21.15.92:0/3161564474 >> 172.21.15.92:0/3161564474 conn(0x7faf100fc420 msgr2=0x7faf100fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:05.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.964+0000 7faf177e0700 1 -- 172.21.15.92:0/3161564474 shutdown_connections 2023-10-16T13:15:05.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.964+0000 7faf177e0700 1 -- 172.21.15.92:0/3161564474 wait complete. 2023-10-16T13:15:05.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf177e0700 1 Processor -- start 2023-10-16T13:15:05.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf177e0700 1 -- start start 2023-10-16T13:15:05.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf177e0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf10100ea0 0x7faf10196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:05.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf177e0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf10102080 0x7faf101971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:05.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf177e0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf10102a40 0x7faf1019e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:05.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf177e0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1019e810 con 0x7faf10102a40 2023-10-16T13:15:05.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf177e0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1019e980 con 0x7faf10102080 2023-10-16T13:15:05.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf177e0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1019eb40 con 0x7faf10100ea0 2023-10-16T13:15:05.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf15d7d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf10102a40 0x7faf1019e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:05.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf15d7d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf10102a40 0x7faf1019e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38376/0 (socket says 172.21.15.92:38376) 2023-10-16T13:15:05.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf15d7d700 1 -- 172.21.15.92:0/1515011504 learned_addr learned my addr 172.21.15.92:0/1515011504 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:15:05.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf1557c700 1 --2- 172.21.15.92:0/1515011504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf10100ea0 0x7faf10196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:05.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf14d7b700 1 --2- 172.21.15.92:0/1515011504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf10102080 0x7faf101971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:05.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf15d7d700 1 -- 172.21.15.92:0/1515011504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf10100ea0 msgr2=0x7faf10196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:05.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf15d7d700 1 --2- 172.21.15.92:0/1515011504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf10100ea0 0x7faf10196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf15d7d700 1 -- 172.21.15.92:0/1515011504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf10102080 msgr2=0x7faf101971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:05.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf15d7d700 1 --2- 172.21.15.92:0/1515011504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf10102080 0x7faf101971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:05.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf15d7d700 1 -- 172.21.15.92:0/1515011504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf000095f0 con 0x7faf10102a40 2023-10-16T13:15:05.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf15d7d700 1 --2- 172.21.15.92:0/1515011504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf10102a40 0x7faf1019e240 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7faf08007ee0 tx=0x7faf0800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:05.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.965+0000 7faf067fc700 1 -- 172.21.15.92:0/1515011504 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0800dd20 con 0x7faf10102a40 2023-10-16T13:15:05.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.966+0000 7faf067fc700 1 -- 172.21.15.92:0/1515011504 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faf0800f040 con 0x7faf10102a40 2023-10-16T13:15:05.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.966+0000 7faf177e0700 1 -- 172.21.15.92:0/1515011504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf1019ee20 con 0x7faf10102a40 2023-10-16T13:15:05.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.966+0000 7faf067fc700 1 -- 172.21.15.92:0/1515011504 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf08015400 con 0x7faf10102a40 2023-10-16T13:15:05.974 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.966+0000 7faf177e0700 1 -- 172.21.15.92:0/1515011504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf1019f250 con 0x7faf10102a40 2023-10-16T13:15:05.975 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.966+0000 7faf177e0700 1 -- 172.21.15.92:0/1515011504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf10107e50 con 0x7faf10102a40 2023-10-16T13:15:05.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.968+0000 7faf067fc700 1 -- 172.21.15.92:0/1515011504 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7faf08003a00 con 0x7faf10102a40 2023-10-16T13:15:05.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.968+0000 7faf067fc700 1 --2- 172.21.15.92:0/1515011504 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faefc0a1480 0x7faefc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:05.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.968+0000 7faf1557c700 1 --2- 172.21.15.92:0/1515011504 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faefc0a1480 0x7faefc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:05.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.968+0000 7faf067fc700 1 -- 172.21.15.92:0/1515011504 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7faf080ccd50 con 0x7faf10102a40 2023-10-16T13:15:05.976 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.969+0000 7faf1557c700 1 --2- 172.21.15.92:0/1515011504 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faefc0a1480 0x7faefc0a3940 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faf10197b70 tx=0x7faf00005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:05.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:05.972+0000 7faf067fc700 1 -- 172.21.15.92:0/1515011504 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faf080963b0 con 0x7faf10102a40 2023-10-16T13:15:06.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.163+0000 7faf177e0700 1 -- 172.21.15.92:0/1515011504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf1010c9e0 con 0x7faf10102a40 2023-10-16T13:15:06.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.164+0000 7faf067fc700 1 -- 172.21.15.92:0/1515011504 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf080230a0 con 0x7faf10102a40 2023-10-16T13:15:06.166 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-10-16T13:15:06.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.166+0000 7faf177e0700 1 -- 172.21.15.92:0/1515011504 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faefc0a1480 msgr2=0x7faefc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:06.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.166+0000 7faf177e0700 1 --2- 172.21.15.92:0/1515011504 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faefc0a1480 0x7faefc0a3940 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faf10197b70 tx=0x7faf00005fb0 comp rx=0 tx=0).stop 2023-10-16T13:15:06.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.166+0000 7faf177e0700 1 -- 172.21.15.92:0/1515011504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf10102a40 msgr2=0x7faf1019e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:06.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.166+0000 7faf177e0700 1 --2- 172.21.15.92:0/1515011504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf10102a40 0x7faf1019e240 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7faf08007ee0 tx=0x7faf0800d3b0 comp rx=0 tx=0).stop 2023-10-16T13:15:06.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.166+0000 7faf177e0700 1 -- 172.21.15.92:0/1515011504 shutdown_connections 2023-10-16T13:15:06.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.166+0000 7faf177e0700 1 --2- 172.21.15.92:0/1515011504 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7faefc0a1480 0x7faefc0a3940 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:06.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.166+0000 7faf177e0700 1 --2- 172.21.15.92:0/1515011504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf10102a40 0x7faf1019e240 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:06.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.166+0000 7faf177e0700 1 --2- 172.21.15.92:0/1515011504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf10100ea0 0x7faf10196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:06.169 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.166+0000 7faf177e0700 1 --2- 172.21.15.92:0/1515011504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf10102080 0x7faf101971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:06.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.166+0000 7faf177e0700 1 -- 172.21.15.92:0/1515011504 >> 172.21.15.92:0/1515011504 conn(0x7faf100fc420 msgr2=0x7faf100fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:06.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.166+0000 7faf177e0700 1 -- 172.21.15.92:0/1515011504 shutdown_connections 2023-10-16T13:15:06.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.166+0000 7faf177e0700 1 -- 172.21.15.92:0/1515011504 wait complete. 2023-10-16T13:15:06.180 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-10-16T13:15:06.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.300+0000 7f8704a60700 1 -- 172.21.15.92:0/3886529767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8700102090 msgr2=0x7f8700102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:06.311 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.300+0000 7f8704a60700 1 --2- 172.21.15.92:0/3886529767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8700102090 0x7f8700102510 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009990 tx=0x7f86e8009ca0 comp rx=0 tx=0).stop 2023-10-16T13:15:06.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.300+0000 7f8704a60700 1 -- 172.21.15.92:0/3886529767 shutdown_connections 2023-10-16T13:15:06.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.300+0000 7f8704a60700 1 --2- 172.21.15.92:0/3886529767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8700102a50 0x7f8700109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:06.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.300+0000 7f8704a60700 1 --2- 172.21.15.92:0/3886529767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8700100eb0 0x7f87001012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:06.312 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.300+0000 7f8704a60700 1 --2- 172.21.15.92:0/3886529767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8700102090 0x7f8700102510 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:06.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.300+0000 7f8704a60700 1 -- 172.21.15.92:0/3886529767 >> 172.21.15.92:0/3886529767 conn(0x7f87000fc430 msgr2=0x7f87000fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:06.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.300+0000 7f8704a60700 1 -- 172.21.15.92:0/3886529767 shutdown_connections 2023-10-16T13:15:06.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.300+0000 7f8704a60700 1 -- 172.21.15.92:0/3886529767 wait complete. 2023-10-16T13:15:06.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.301+0000 7f8704a60700 1 Processor -- start 2023-10-16T13:15:06.313 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.301+0000 7f8704a60700 1 -- start start 2023-10-16T13:15:06.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.301+0000 7f8704a60700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8700100eb0 0x7f8700196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:06.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.301+0000 7f8704a60700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8700102090 0x7f8700197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:06.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.301+0000 7f8704a60700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8700102a50 0x7f870019e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:06.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.301+0000 7f8704a60700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870019e770 con 0x7f8700102a50 2023-10-16T13:15:06.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.301+0000 7f8704a60700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870019e8e0 con 0x7f8700102090 2023-10-16T13:15:06.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.301+0000 7f8704a60700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870019eaa0 con 0x7f8700100eb0 2023-10-16T13:15:06.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.302+0000 7f86fed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8700102a50 0x7f870019e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:06.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.302+0000 7f86fe59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8700100eb0 0x7f8700196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:06.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.302+0000 7f86f5d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8700102090 0x7f8700197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:06.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.302+0000 7f86fed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8700102a50 0x7f870019e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38390/0 (socket says 172.21.15.92:38390) 2023-10-16T13:15:06.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.302+0000 7f86fed9d700 1 -- 172.21.15.92:0/1080106705 learned_addr learned my addr 172.21.15.92:0/1080106705 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:15:06.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.302+0000 7f86fe59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8700100eb0 0x7f8700196c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.92:45216/0 (socket says 172.21.15.92:45216) 2023-10-16T13:15:06.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.302+0000 7f86fed9d700 1 -- 172.21.15.92:0/1080106705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8700100eb0 msgr2=0x7f8700196c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:06.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.302+0000 7f86fed9d700 1 --2- 172.21.15.92:0/1080106705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8700100eb0 0x7f8700196c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:06.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.302+0000 7f86fed9d700 1 -- 172.21.15.92:0/1080106705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8700102090 msgr2=0x7f8700197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:06.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.302+0000 7f86fed9d700 1 --2- 172.21.15.92:0/1080106705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8700102090 0x7f8700197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:06.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.302+0000 7f86fed9d700 1 -- 172.21.15.92:0/1080106705 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e80095f0 con 0x7f8700102a50 2023-10-16T13:15:06.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.302+0000 7f86fed9d700 1 --2- 172.21.15.92:0/1080106705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8700102a50 0x7f870019e1a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f86f800ada0 tx=0x7f86f800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:06.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.302+0000 7f86f7fff700 1 -- 172.21.15.92:0/1080106705 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f800f070 con 0x7f8700102a50 2023-10-16T13:15:06.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.302+0000 7f86f7fff700 1 -- 172.21.15.92:0/1080106705 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f86f8007b30 con 0x7f8700102a50 2023-10-16T13:15:06.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.302+0000 7f8704a60700 1 -- 172.21.15.92:0/1080106705 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870019ed80 con 0x7f8700102a50 2023-10-16T13:15:06.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.302+0000 7f86f7fff700 1 -- 172.21.15.92:0/1080106705 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f80053e0 con 0x7f8700102a50 2023-10-16T13:15:06.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.302+0000 7f8704a60700 1 -- 172.21.15.92:0/1080106705 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870019f180 con 0x7f8700102a50 2023-10-16T13:15:06.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.303+0000 7f8704a60700 1 -- 172.21.15.92:0/1080106705 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8700107dc0 con 0x7f8700102a50 2023-10-16T13:15:06.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.304+0000 7f86f7fff700 1 -- 172.21.15.92:0/1080106705 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f86f8005540 con 0x7f8700102a50 2023-10-16T13:15:06.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.305+0000 7f86f7fff700 1 --2- 172.21.15.92:0/1080106705 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f86ec0a1520 0x7f86ec0a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:06.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.305+0000 7f86fe59c700 1 --2- 172.21.15.92:0/1080106705 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f86ec0a1520 0x7f86ec0a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:06.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.305+0000 7f86f7fff700 1 -- 172.21.15.92:0/1080106705 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f86f80cc240 con 0x7f8700102a50 2023-10-16T13:15:06.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.305+0000 7f86fe59c700 1 --2- 172.21.15.92:0/1080106705 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f86ec0a1520 0x7f86ec0a39e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8700198100 tx=0x7f86f000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:06.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.309+0000 7f86f7fff700 1 -- 172.21.15.92:0/1080106705 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f86f8095930 con 0x7f8700102a50 2023-10-16T13:15:06.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:06 smithi092 ceph-mon[99542]: pgmap v360: 97 pgs: 97 active+clean; 42 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 1.2 MiB/s wr, 710 op/s 2023-10-16T13:15:06.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:06 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1673793017' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:15:06.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:06 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3829663211' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:15:06.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:06 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1515011504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:15:06.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.558+0000 7f8704a60700 1 -- 172.21.15.92:0/1080106705 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f870010c890 con 0x7f8700102a50 2023-10-16T13:15:06.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.566+0000 7f86f7fff700 1 -- 172.21.15.92:0/1080106705 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) v1 ==== 81+0+733877 (secure 0 0 0) 0x7f86f8098f50 con 0x7f8700102a50 2023-10-16T13:15:06.577 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:15:06.577 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:15:06.578 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 18, 2023-10-16T13:15:06.578 INFO:teuthology.orchestra.run.smithi092.stdout: "active_gid": 14152, 2023-10-16T13:15:06.578 INFO:teuthology.orchestra.run.smithi092.stdout: "active_name": "x", 2023-10-16T13:15:06.578 INFO:teuthology.orchestra.run.smithi092.stdout: "active_addrs": { 2023-10-16T13:15:06.579 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2023-10-16T13:15:06.579 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:06.579 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2023-10-16T13:15:06.579 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:6800", 2023-10-16T13:15:06.579 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 2605982588 2023-10-16T13:15:06.580 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.580 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:06.580 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2023-10-16T13:15:06.580 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:6801", 2023-10-16T13:15:06.580 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 2605982588 2023-10-16T13:15:06.581 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:06.581 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-10-16T13:15:06.581 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.581 INFO:teuthology.orchestra.run.smithi092.stdout: "active_addr": "172.21.15.92:6801/2605982588", 2023-10-16T13:15:06.581 INFO:teuthology.orchestra.run.smithi092.stdout: "active_change": "2023-10-16T13:05:35.186582+0000", 2023-10-16T13:15:06.582 INFO:teuthology.orchestra.run.smithi092.stdout: "active_mgr_features": 4540138322906710015, 2023-10-16T13:15:06.582 INFO:teuthology.orchestra.run.smithi092.stdout: "available": true, 2023-10-16T13:15:06.582 INFO:teuthology.orchestra.run.smithi092.stdout: "standbys": [ 2023-10-16T13:15:06.582 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:06.582 INFO:teuthology.orchestra.run.smithi092.stdout: "gid": 24106, 2023-10-16T13:15:06.582 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "z", 2023-10-16T13:15:06.583 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr_features": 4540138322906710015, 2023-10-16T13:15:06.583 INFO:teuthology.orchestra.run.smithi092.stdout: "available_modules": [ 2023-10-16T13:15:06.583 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:06.583 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "alerts", 2023-10-16T13:15:06.583 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:06.584 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:06.584 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:06.584 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2023-10-16T13:15:06.584 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2023-10-16T13:15:06.584 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:06.585 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.585 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.585 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2023-10-16T13:15:06.585 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.585 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.585 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.586 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How frequently to reexamine health status", 2023-10-16T13:15:06.586 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.586 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.586 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.586 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.587 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:06.587 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:06.587 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.587 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.587 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.588 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.588 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.588 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.588 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:06.588 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:06.589 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:06.589 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:06.589 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:06.589 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:06.589 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:06.589 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:06.590 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.590 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.590 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.590 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.590 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.591 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:06.591 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:06.591 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.591 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.591 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.591 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.592 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.592 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.592 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.592 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.592 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.593 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.593 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.593 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.593 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:06.593 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:06.593 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.594 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.594 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.594 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:06.594 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.594 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.595 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:06.595 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:06.595 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:06.595 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:06.595 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:06.595 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:06.596 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:06.596 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:06.596 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.596 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.596 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.597 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.597 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.597 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:06.597 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:06.597 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.598 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.598 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.598 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.598 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.598 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.599 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.599 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.599 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.599 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.599 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.600 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.600 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_destination": { 2023-10-16T13:15:06.600 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_destination", 2023-10-16T13:15:06.600 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.600 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.601 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.601 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.601 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.601 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.601 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.602 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email address to send alerts to", 2023-10-16T13:15:06.602 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.602 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.602 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.602 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.603 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_from_name": { 2023-10-16T13:15:06.603 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_from_name", 2023-10-16T13:15:06.603 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.603 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.603 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.604 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "Ceph", 2023-10-16T13:15:06.604 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.604 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.604 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.604 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email From: name", 2023-10-16T13:15:06.605 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.605 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.605 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.605 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.605 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_host": { 2023-10-16T13:15:06.606 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_host", 2023-10-16T13:15:06.606 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.606 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.606 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.606 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.607 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.607 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.607 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.607 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP server", 2023-10-16T13:15:06.607 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.607 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.608 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.608 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.608 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_password": { 2023-10-16T13:15:06.608 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_password", 2023-10-16T13:15:06.608 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.609 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.609 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.609 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.609 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.609 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.610 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.610 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Password to authenticate with", 2023-10-16T13:15:06.610 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.610 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.610 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.610 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.611 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_port": { 2023-10-16T13:15:06.611 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_port", 2023-10-16T13:15:06.611 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:06.611 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.611 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.612 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "465", 2023-10-16T13:15:06.612 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.612 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.612 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.612 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP port", 2023-10-16T13:15:06.612 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.613 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.613 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.613 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.613 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_sender": { 2023-10-16T13:15:06.613 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_sender", 2023-10-16T13:15:06.614 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.614 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.614 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.614 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.614 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.614 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.615 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.615 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP envelope sender", 2023-10-16T13:15:06.615 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.615 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.615 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.616 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.616 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_ssl": { 2023-10-16T13:15:06.616 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_ssl", 2023-10-16T13:15:06.616 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.616 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.617 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.617 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.617 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.617 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.617 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.617 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-16T13:15:06.618 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.618 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.618 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.618 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.618 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_user": { 2023-10-16T13:15:06.619 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_user", 2023-10-16T13:15:06.619 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.619 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.619 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.619 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.620 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.620 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.620 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.620 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "User to authenticate as", 2023-10-16T13:15:06.620 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.621 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.621 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.621 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:06.621 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:06.621 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.621 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:06.622 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "balancer", 2023-10-16T13:15:06.622 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:06.622 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:06.622 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:06.622 INFO:teuthology.orchestra.run.smithi092.stdout: "active": { 2023-10-16T13:15:06.623 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "active", 2023-10-16T13:15:06.623 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.623 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.623 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.623 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.623 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.624 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.624 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.624 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically balance PGs across cluster", 2023-10-16T13:15:06.624 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.624 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.625 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.625 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.625 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_time": { 2023-10-16T13:15:06.625 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_time", 2023-10-16T13:15:06.625 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.625 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.626 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.626 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0000", 2023-10-16T13:15:06.626 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.626 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.626 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.627 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "beginning time of day to automatically balance", 2023-10-16T13:15:06.627 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-16T13:15:06.627 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.627 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.627 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.628 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_weekday": { 2023-10-16T13:15:06.628 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_weekday", 2023-10-16T13:15:06.628 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2023-10-16T13:15:06.628 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.628 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.628 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2023-10-16T13:15:06.629 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2023-10-16T13:15:06.629 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2023-10-16T13:15:06.629 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.629 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-16T13:15:06.629 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-16T13:15:06.630 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.630 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.630 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.630 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_max_iterations": { 2023-10-16T13:15:06.630 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_max_iterations", 2023-10-16T13:15:06.630 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2023-10-16T13:15:06.631 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.631 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.631 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "25", 2023-10-16T13:15:06.631 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2023-10-16T13:15:06.631 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "250", 2023-10-16T13:15:06.632 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.632 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-16T13:15:06.632 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.632 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.632 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.633 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.633 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_metrics": { 2023-10-16T13:15:06.633 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_metrics", 2023-10-16T13:15:06.633 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.633 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.634 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.634 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "pgs,objects,bytes", 2023-10-16T13:15:06.634 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.634 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.634 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.635 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-16T13:15:06.635 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-16T13:15:06.635 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.635 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.635 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.636 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_step": { 2023-10-16T13:15:06.636 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_step", 2023-10-16T13:15:06.636 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:06.636 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.636 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.637 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.5", 2023-10-16T13:15:06.637 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0.001", 2023-10-16T13:15:06.637 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "0.999", 2023-10-16T13:15:06.637 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.637 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "aggressiveness of optimization", 2023-10-16T13:15:06.638 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-16T13:15:06.638 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.638 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.638 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.638 INFO:teuthology.orchestra.run.smithi092.stdout: "end_time": { 2023-10-16T13:15:06.639 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_time", 2023-10-16T13:15:06.639 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.639 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.639 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.639 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2359", 2023-10-16T13:15:06.640 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.640 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.640 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.640 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ending time of day to automatically balance", 2023-10-16T13:15:06.640 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-16T13:15:06.640 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.641 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.641 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.641 INFO:teuthology.orchestra.run.smithi092.stdout: "end_weekday": { 2023-10-16T13:15:06.641 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_weekday", 2023-10-16T13:15:06.641 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2023-10-16T13:15:06.641 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.642 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.642 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2023-10-16T13:15:06.642 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2023-10-16T13:15:06.642 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2023-10-16T13:15:06.642 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.643 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-16T13:15:06.643 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-16T13:15:06.643 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.643 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.643 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.644 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:06.644 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:06.644 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.644 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.644 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.644 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.645 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.645 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.645 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:06.645 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:06.645 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:06.645 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:06.646 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:06.646 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:06.646 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:06.646 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:06.646 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.646 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.647 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.647 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.647 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.647 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:06.647 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:06.647 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.648 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.648 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.648 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.648 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.648 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.649 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.649 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.649 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.649 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.649 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.649 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.650 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:06.650 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:06.650 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.650 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.651 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.651 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:06.651 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.651 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.651 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:06.651 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:06.652 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:06.652 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:06.652 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:06.652 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:06.652 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:06.652 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:06.653 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.653 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.653 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.653 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.653 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.653 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:06.654 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:06.654 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.654 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.654 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.654 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.655 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.655 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.655 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.655 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.655 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.656 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.656 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.656 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.656 INFO:teuthology.orchestra.run.smithi092.stdout: "min_score": { 2023-10-16T13:15:06.656 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_score", 2023-10-16T13:15:06.656 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:06.657 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.657 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.657 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2023-10-16T13:15:06.657 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.657 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.658 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.658 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-16T13:15:06.658 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.658 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.658 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.659 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.659 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2023-10-16T13:15:06.659 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2023-10-16T13:15:06.659 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.659 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.660 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.660 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "upmap", 2023-10-16T13:15:06.660 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.660 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.660 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:06.660 INFO:teuthology.orchestra.run.smithi092.stdout: "crush-compat", 2023-10-16T13:15:06.661 INFO:teuthology.orchestra.run.smithi092.stdout: "none", 2023-10-16T13:15:06.661 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap" 2023-10-16T13:15:06.661 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:06.661 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Balancer mode", 2023-10-16T13:15:06.661 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.662 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.662 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.662 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.662 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_ids": { 2023-10-16T13:15:06.662 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_ids", 2023-10-16T13:15:06.662 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.663 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.663 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.663 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.663 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.663 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.664 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.664 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-16T13:15:06.664 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.664 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.664 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.664 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.665 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2023-10-16T13:15:06.665 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2023-10-16T13:15:06.665 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:06.665 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.665 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.666 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2023-10-16T13:15:06.666 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.666 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.666 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.666 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-16T13:15:06.667 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.667 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.667 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.667 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.667 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_deviation": { 2023-10-16T13:15:06.667 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_deviation", 2023-10-16T13:15:06.668 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:06.668 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.668 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.668 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2023-10-16T13:15:06.668 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2023-10-16T13:15:06.668 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.669 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.669 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-16T13:15:06.669 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-16T13:15:06.669 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.669 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.669 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.670 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_optimizations": { 2023-10-16T13:15:06.670 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_optimizations", 2023-10-16T13:15:06.670 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2023-10-16T13:15:06.670 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.670 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.671 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:06.671 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.671 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.671 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.671 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-16T13:15:06.672 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.672 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.672 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.672 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:06.672 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:06.672 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.673 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:06.673 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm", 2023-10-16T13:15:06.673 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:06.673 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:06.673 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:06.674 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_down_multiplier": { 2023-10-16T13:15:06.674 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_down_multiplier", 2023-10-16T13:15:06.674 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:06.674 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.674 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.675 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2023-10-16T13:15:06.675 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.675 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.675 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.675 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-16T13:15:06.675 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.676 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.676 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.676 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.676 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_refresh_rate": { 2023-10-16T13:15:06.676 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_refresh_rate", 2023-10-16T13:15:06.677 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:06.677 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.677 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.677 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "20", 2023-10-16T13:15:06.677 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.678 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.678 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.678 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-16T13:15:06.678 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.678 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.679 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.679 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.679 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_starting_port": { 2023-10-16T13:15:06.679 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_starting_port", 2023-10-16T13:15:06.679 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:06.680 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.680 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.680 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4721", 2023-10-16T13:15:06.680 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.680 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.681 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.681 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-16T13:15:06.681 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.681 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.682 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.682 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.682 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_ptrace": { 2023-10-16T13:15:06.682 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_ptrace", 2023-10-16T13:15:06.682 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.683 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.683 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.683 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.683 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.683 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.683 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.684 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-16T13:15:06.684 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-16T13:15:06.684 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.684 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.684 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.685 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_interval": { 2023-10-16T13:15:06.685 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_interval", 2023-10-16T13:15:06.685 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:06.685 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.685 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.685 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2023-10-16T13:15:06.686 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.686 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.686 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.686 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-16T13:15:06.686 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.687 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.687 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.687 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.687 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_memory_target_ratio": { 2023-10-16T13:15:06.687 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_memory_target_ratio", 2023-10-16T13:15:06.688 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:06.688 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.688 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.688 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.7", 2023-10-16T13:15:06.688 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.688 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.689 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.689 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-16T13:15:06.689 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.689 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.689 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.689 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.690 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm_log_destination": { 2023-10-16T13:15:06.690 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm_log_destination", 2023-10-16T13:15:06.690 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.690 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.690 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.691 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.691 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.691 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.691 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:06.691 INFO:teuthology.orchestra.run.smithi092.stdout: "file", 2023-10-16T13:15:06.692 INFO:teuthology.orchestra.run.smithi092.stdout: "file,syslog", 2023-10-16T13:15:06.692 INFO:teuthology.orchestra.run.smithi092.stdout: "syslog" 2023-10-16T13:15:06.692 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:06.692 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-16T13:15:06.692 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.693 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.693 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.693 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.693 INFO:teuthology.orchestra.run.smithi092.stdout: "cgroups_split": { 2023-10-16T13:15:06.693 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cgroups_split", 2023-10-16T13:15:06.693 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.694 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.694 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.694 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.694 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.694 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.695 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.695 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-16T13:15:06.695 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.695 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.695 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.695 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.696 INFO:teuthology.orchestra.run.smithi092.stdout: "config_checks_enabled": { 2023-10-16T13:15:06.696 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_checks_enabled", 2023-10-16T13:15:06.696 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.696 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.697 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.697 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.697 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.697 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.697 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.697 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-16T13:15:06.698 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.698 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.698 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.698 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.698 INFO:teuthology.orchestra.run.smithi092.stdout: "config_dashboard": { 2023-10-16T13:15:06.699 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_dashboard", 2023-10-16T13:15:06.699 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.699 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.699 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.699 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.699 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.700 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.700 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.700 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-16T13:15:06.700 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.700 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.701 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.701 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.701 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_alertmanager": { 2023-10-16T13:15:06.701 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_alertmanager", 2023-10-16T13:15:06.701 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.702 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.702 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.702 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-16T13:15:06.702 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.702 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.703 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.703 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2023-10-16T13:15:06.703 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.703 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.703 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.704 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.704 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_base": { 2023-10-16T13:15:06.704 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_base", 2023-10-16T13:15:06.704 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.704 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.704 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.705 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-16T13:15:06.705 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.705 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.705 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.705 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Container image name, without the tag", 2023-10-16T13:15:06.706 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.706 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.706 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.706 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.706 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_elasticsearch": { 2023-10-16T13:15:06.707 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_elasticsearch", 2023-10-16T13:15:06.707 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.707 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.707 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.707 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-16T13:15:06.707 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.708 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.708 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.708 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "elasticsearch container image", 2023-10-16T13:15:06.708 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.709 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.709 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.709 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.709 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_grafana": { 2023-10-16T13:15:06.709 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_grafana", 2023-10-16T13:15:06.709 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.710 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.710 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.710 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-16T13:15:06.710 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.710 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.710 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.711 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2023-10-16T13:15:06.711 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.711 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.711 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.711 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.712 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_haproxy": { 2023-10-16T13:15:06.712 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_haproxy", 2023-10-16T13:15:06.712 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.712 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.712 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.712 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-16T13:15:06.713 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.713 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.713 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.713 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "HAproxy container image", 2023-10-16T13:15:06.713 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.714 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.714 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.714 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.714 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_agent": { 2023-10-16T13:15:06.715 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_agent", 2023-10-16T13:15:06.715 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.715 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.715 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.715 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-16T13:15:06.716 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.716 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.716 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.716 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger agent container image", 2023-10-16T13:15:06.716 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.717 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.717 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.717 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.717 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_collector": { 2023-10-16T13:15:06.717 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_collector", 2023-10-16T13:15:06.718 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.718 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.718 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.718 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-16T13:15:06.718 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.719 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.719 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.719 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger collector container image", 2023-10-16T13:15:06.719 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.719 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.720 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.720 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.720 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_query": { 2023-10-16T13:15:06.720 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_query", 2023-10-16T13:15:06.720 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.721 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.721 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.721 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-16T13:15:06.721 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.721 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.722 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.722 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger query container image", 2023-10-16T13:15:06.722 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.722 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.722 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.723 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.723 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_keepalived": { 2023-10-16T13:15:06.723 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_keepalived", 2023-10-16T13:15:06.723 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.723 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.724 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.724 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-16T13:15:06.724 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.724 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.724 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.725 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Keepalived container image", 2023-10-16T13:15:06.725 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.725 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.725 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.725 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.726 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_loki": { 2023-10-16T13:15:06.726 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_loki", 2023-10-16T13:15:06.726 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.726 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.726 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.727 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-16T13:15:06.727 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.727 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.727 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.727 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Loki container image", 2023-10-16T13:15:06.728 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.728 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.728 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.728 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.728 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_node_exporter": { 2023-10-16T13:15:06.728 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_node_exporter", 2023-10-16T13:15:06.729 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.729 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.729 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.729 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-16T13:15:06.729 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.730 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.730 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.730 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2023-10-16T13:15:06.730 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.730 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.731 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.731 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.731 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_nvmeof": { 2023-10-16T13:15:06.731 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_nvmeof", 2023-10-16T13:15:06.731 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.731 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.732 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.732 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-16T13:15:06.732 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.732 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.732 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.733 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Nvme-of container image", 2023-10-16T13:15:06.733 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.733 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.733 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.733 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.733 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_prometheus": { 2023-10-16T13:15:06.734 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_prometheus", 2023-10-16T13:15:06.734 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.734 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.734 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.734 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-16T13:15:06.735 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.735 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.735 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.735 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2023-10-16T13:15:06.735 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.736 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.736 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.736 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.736 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_promtail": { 2023-10-16T13:15:06.736 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_promtail", 2023-10-16T13:15:06.737 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.737 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.737 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.737 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-16T13:15:06.737 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.738 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.738 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.738 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Promtail container image", 2023-10-16T13:15:06.738 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.738 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.738 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.739 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.739 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_snmp_gateway": { 2023-10-16T13:15:06.739 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_snmp_gateway", 2023-10-16T13:15:06.739 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.739 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.740 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.740 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-16T13:15:06.740 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.740 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.740 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.741 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SNMP Gateway container image", 2023-10-16T13:15:06.741 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.741 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.741 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.741 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.741 INFO:teuthology.orchestra.run.smithi092.stdout: "container_init": { 2023-10-16T13:15:06.742 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_init", 2023-10-16T13:15:06.742 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.742 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.742 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.742 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.742 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.743 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.743 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.743 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Run podman/docker with `--init`", 2023-10-16T13:15:06.743 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.743 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.743 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.744 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.744 INFO:teuthology.orchestra.run.smithi092.stdout: "daemon_cache_timeout": { 2023-10-16T13:15:06.744 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "daemon_cache_timeout", 2023-10-16T13:15:06.744 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:06.744 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.744 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.745 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2023-10-16T13:15:06.745 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.745 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.745 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.745 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-16T13:15:06.746 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.746 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.746 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.746 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.746 INFO:teuthology.orchestra.run.smithi092.stdout: "default_cephadm_command_timeout": { 2023-10-16T13:15:06.747 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_cephadm_command_timeout", 2023-10-16T13:15:06.747 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:06.747 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.747 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.747 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "900", 2023-10-16T13:15:06.748 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.748 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.748 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.748 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-16T13:15:06.748 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.749 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.749 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.749 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.749 INFO:teuthology.orchestra.run.smithi092.stdout: "default_registry": { 2023-10-16T13:15:06.749 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_registry", 2023-10-16T13:15:06.749 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.750 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.750 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.750 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io", 2023-10-16T13:15:06.750 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.750 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.751 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.751 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-16T13:15:06.751 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.751 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.751 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.752 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.752 INFO:teuthology.orchestra.run.smithi092.stdout: "device_cache_timeout": { 2023-10-16T13:15:06.752 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_cache_timeout", 2023-10-16T13:15:06.752 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:06.752 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.752 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.753 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1800", 2023-10-16T13:15:06.753 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.753 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.753 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.753 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache device inventory", 2023-10-16T13:15:06.754 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.754 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.754 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.754 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.754 INFO:teuthology.orchestra.run.smithi092.stdout: "device_enhanced_scan": { 2023-10-16T13:15:06.755 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_enhanced_scan", 2023-10-16T13:15:06.755 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.755 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.755 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.755 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.756 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.756 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.756 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.756 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-16T13:15:06.756 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.756 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.757 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.757 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.757 INFO:teuthology.orchestra.run.smithi092.stdout: "facts_cache_timeout": { 2023-10-16T13:15:06.757 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "facts_cache_timeout", 2023-10-16T13:15:06.757 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:06.758 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.758 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.758 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2023-10-16T13:15:06.758 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.758 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.758 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.759 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache host facts data", 2023-10-16T13:15:06.759 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.759 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.759 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.759 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.760 INFO:teuthology.orchestra.run.smithi092.stdout: "host_check_interval": { 2023-10-16T13:15:06.760 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "host_check_interval", 2023-10-16T13:15:06.760 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:06.760 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.760 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.761 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2023-10-16T13:15:06.761 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.761 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.761 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.761 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to perform a host check", 2023-10-16T13:15:06.762 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.762 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.762 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.762 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.762 INFO:teuthology.orchestra.run.smithi092.stdout: "inventory_list_all": { 2023-10-16T13:15:06.763 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "inventory_list_all", 2023-10-16T13:15:06.763 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.763 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.763 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.763 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.764 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.764 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.764 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.764 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-16T13:15:06.764 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.765 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.765 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.765 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.765 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:06.765 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:06.765 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.766 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.766 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.766 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.766 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.766 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.767 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:06.767 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:06.767 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:06.767 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:06.767 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:06.767 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:06.768 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:06.768 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:06.768 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.768 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.768 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.769 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.769 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.769 INFO:teuthology.orchestra.run.smithi092.stdout: "log_refresh_metadata": { 2023-10-16T13:15:06.769 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_refresh_metadata", 2023-10-16T13:15:06.769 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.769 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.770 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.770 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.770 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.770 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.770 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.771 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-16T13:15:06.771 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.771 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.771 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.771 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.772 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:06.772 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:06.772 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.772 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.772 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.772 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.773 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.773 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.773 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.773 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-16T13:15:06.773 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.773 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.774 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.774 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.774 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:06.774 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:06.774 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.775 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.775 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.775 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:06.775 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.775 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.775 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:06.776 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:06.776 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:06.776 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:06.776 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:06.776 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:06.777 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:06.777 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:06.777 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.777 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.777 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.778 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.778 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.778 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:06.778 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:06.779 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.779 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.779 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.779 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.779 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.780 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.780 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.780 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.780 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.780 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.780 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.781 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.781 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-16T13:15:06.781 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-16T13:15:06.781 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.781 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.781 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.782 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.782 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.782 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.782 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.782 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-16T13:15:06.783 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.783 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.783 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.783 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.783 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-16T13:15:06.783 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-16T13:15:06.784 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.784 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.784 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.784 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "*", 2023-10-16T13:15:06.784 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.785 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.785 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.785 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-16T13:15:06.785 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.785 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.785 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.786 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.786 INFO:teuthology.orchestra.run.smithi092.stdout: "max_count_per_host": { 2023-10-16T13:15:06.786 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_count_per_host", 2023-10-16T13:15:06.786 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:06.786 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.786 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.787 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:06.787 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.787 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.787 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.787 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of daemons per service per host", 2023-10-16T13:15:06.788 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.788 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.788 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.788 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.788 INFO:teuthology.orchestra.run.smithi092.stdout: "max_osd_draining_count": { 2023-10-16T13:15:06.789 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_osd_draining_count", 2023-10-16T13:15:06.789 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:06.789 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.789 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.789 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:06.790 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.790 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.790 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.790 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-16T13:15:06.790 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.791 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.791 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.791 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.791 INFO:teuthology.orchestra.run.smithi092.stdout: "migration_current": { 2023-10-16T13:15:06.792 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "migration_current", 2023-10-16T13:15:06.792 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:06.792 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.792 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.792 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.792 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.793 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.793 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.793 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "internal - do not modify", 2023-10-16T13:15:06.793 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.793 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.794 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.794 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.794 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2023-10-16T13:15:06.794 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2023-10-16T13:15:06.794 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.795 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.795 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.795 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "root", 2023-10-16T13:15:06.795 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.795 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.796 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:06.796 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm-package", 2023-10-16T13:15:06.796 INFO:teuthology.orchestra.run.smithi092.stdout: "root" 2023-10-16T13:15:06.796 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:06.796 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "mode for remote execution of cephadm", 2023-10-16T13:15:06.797 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.797 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.797 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.797 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.797 INFO:teuthology.orchestra.run.smithi092.stdout: "prometheus_alerts_path": { 2023-10-16T13:15:06.797 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus_alerts_path", 2023-10-16T13:15:06.798 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.798 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.798 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.798 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-16T13:15:06.798 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.799 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.799 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.799 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-16T13:15:06.799 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.799 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.800 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.800 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.800 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_insecure": { 2023-10-16T13:15:06.800 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_insecure", 2023-10-16T13:15:06.800 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.801 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.801 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.801 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.801 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.801 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.802 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.802 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-16T13:15:06.802 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.802 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.802 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.803 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.803 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_password": { 2023-10-16T13:15:06.803 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_password", 2023-10-16T13:15:06.803 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.803 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.804 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.804 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.804 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.804 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.804 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.805 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-16T13:15:06.805 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.805 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.805 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.805 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.805 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_url": { 2023-10-16T13:15:06.806 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_url", 2023-10-16T13:15:06.806 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.806 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.806 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.806 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.807 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.807 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.807 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.807 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-16T13:15:06.807 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.808 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.808 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.808 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.808 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_username": { 2023-10-16T13:15:06.808 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_username", 2023-10-16T13:15:06.809 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.809 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.809 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.809 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.809 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.809 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.809 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.810 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-16T13:15:06.810 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.810 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.810 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.811 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.811 INFO:teuthology.orchestra.run.smithi092.stdout: "secure_monitoring_stack": { 2023-10-16T13:15:06.811 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "secure_monitoring_stack", 2023-10-16T13:15:06.811 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.811 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.812 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.812 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.812 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.812 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.812 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.813 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-16T13:15:06.813 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.813 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.813 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.813 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.813 INFO:teuthology.orchestra.run.smithi092.stdout: "service_discovery_port": { 2023-10-16T13:15:06.814 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "service_discovery_port", 2023-10-16T13:15:06.814 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:06.814 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.814 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.814 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8765", 2023-10-16T13:15:06.815 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.815 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.815 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.815 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "cephadm service discovery port", 2023-10-16T13:15:06.815 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.815 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.816 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.816 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.816 INFO:teuthology.orchestra.run.smithi092.stdout: "ssh_config_file": { 2023-10-16T13:15:06.816 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssh_config_file", 2023-10-16T13:15:06.816 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.816 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.817 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.817 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.817 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.817 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.817 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.818 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-16T13:15:06.818 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.818 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.818 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.818 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.819 INFO:teuthology.orchestra.run.smithi092.stdout: "use_agent": { 2023-10-16T13:15:06.819 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_agent", 2023-10-16T13:15:06.819 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.819 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.819 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.819 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.820 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.820 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.820 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.820 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-16T13:15:06.820 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.821 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.821 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.821 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.821 INFO:teuthology.orchestra.run.smithi092.stdout: "use_repo_digest": { 2023-10-16T13:15:06.821 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_repo_digest", 2023-10-16T13:15:06.822 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.822 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.822 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.822 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.822 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.822 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.823 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.823 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-16T13:15:06.823 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.823 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.823 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.824 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.824 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_failed_host_check": { 2023-10-16T13:15:06.824 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_failed_host_check", 2023-10-16T13:15:06.824 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.824 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.825 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.825 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.825 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.825 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.825 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.825 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if the host check fails", 2023-10-16T13:15:06.826 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.826 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.826 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.826 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.826 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_daemons": { 2023-10-16T13:15:06.827 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_daemons", 2023-10-16T13:15:06.827 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.827 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.827 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.827 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.828 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.828 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.828 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.828 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-16T13:15:06.828 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.828 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.829 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.829 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.829 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_hosts": { 2023-10-16T13:15:06.829 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_hosts", 2023-10-16T13:15:06.829 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.830 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.830 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.830 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.830 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.830 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.830 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.831 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-16T13:15:06.831 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.831 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.831 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.831 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:06.832 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:06.832 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.832 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:06.832 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crash", 2023-10-16T13:15:06.832 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:06.832 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:06.833 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:06.833 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:06.833 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:06.833 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.833 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.834 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.834 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.834 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.834 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.834 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:06.834 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:06.835 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:06.835 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:06.835 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:06.835 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:06.835 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:06.836 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:06.836 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.836 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.836 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.836 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.837 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.837 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:06.837 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:06.837 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.837 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.838 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.838 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.838 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.838 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.838 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.838 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.839 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.839 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.839 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.839 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.839 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:06.840 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:06.840 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.840 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.840 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.840 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:06.841 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.841 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.841 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:06.841 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:06.841 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:06.842 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:06.842 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:06.842 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:06.842 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:06.842 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:06.842 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.843 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.843 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.843 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.843 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.843 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:06.844 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:06.844 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.844 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.844 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.844 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.844 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.845 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.845 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.845 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.845 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.845 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.846 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.846 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.846 INFO:teuthology.orchestra.run.smithi092.stdout: "retain_interval": { 2023-10-16T13:15:06.846 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retain_interval", 2023-10-16T13:15:06.846 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:06.847 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.847 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.847 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "31536000", 2023-10-16T13:15:06.847 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.847 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.847 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.848 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-16T13:15:06.848 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.848 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.848 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.848 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.849 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_recent_interval": { 2023-10-16T13:15:06.849 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_recent_interval", 2023-10-16T13:15:06.849 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:06.849 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.849 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.850 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1209600", 2023-10-16T13:15:06.850 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.850 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.850 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.850 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-16T13:15:06.851 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.851 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.851 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.851 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:06.851 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:06.852 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.852 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:06.852 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dashboard", 2023-10-16T13:15:06.852 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:06.852 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:06.852 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:06.853 INFO:teuthology.orchestra.run.smithi092.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-16T13:15:06.853 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-16T13:15:06.853 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:06.853 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.853 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.854 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:06.854 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.854 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.854 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.854 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.855 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.855 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.855 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.855 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.855 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_HOST": { 2023-10-16T13:15:06.856 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-16T13:15:06.856 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.856 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.856 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.856 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.857 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.857 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.857 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.857 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.858 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.858 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.858 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.858 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.858 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-16T13:15:06.859 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-16T13:15:06.859 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.859 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.859 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.859 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.860 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.860 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.860 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.860 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.860 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.861 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.861 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.861 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.861 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_ENABLED": { 2023-10-16T13:15:06.862 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_ENABLED", 2023-10-16T13:15:06.862 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.862 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.862 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.862 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.863 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.863 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.863 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.863 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.863 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.864 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.864 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.864 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.864 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-16T13:15:06.864 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-16T13:15:06.864 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.865 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.865 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.865 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.865 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.865 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.866 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.866 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.866 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.866 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.866 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.867 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.867 INFO:teuthology.orchestra.run.smithi092.stdout: "ENABLE_BROWSABLE_API": { 2023-10-16T13:15:06.867 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-16T13:15:06.867 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.868 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.868 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.868 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.868 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.868 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.868 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.869 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.869 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.869 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.869 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.869 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.870 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-16T13:15:06.870 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-16T13:15:06.870 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.870 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.870 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.870 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.871 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.871 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.871 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.871 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.871 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.872 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.872 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.872 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.872 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-16T13:15:06.872 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-16T13:15:06.872 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.873 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.873 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.873 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.873 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.873 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.873 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.874 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.874 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.874 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.874 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.874 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.874 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-16T13:15:06.875 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-16T13:15:06.875 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.875 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.875 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.875 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.875 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.876 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.876 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.876 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.876 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.876 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.876 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.877 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.877 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-16T13:15:06.877 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-16T13:15:06.877 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.877 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.877 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.878 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.878 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.878 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.878 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.878 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.879 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.879 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.879 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.879 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.879 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-16T13:15:06.880 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-16T13:15:06.880 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.880 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.880 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.880 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.881 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.881 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.881 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.881 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.881 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.882 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.882 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.882 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.882 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-16T13:15:06.882 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-16T13:15:06.882 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.883 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.883 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.883 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.883 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.883 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.883 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.884 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.884 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.884 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.884 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.884 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.885 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-16T13:15:06.885 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-16T13:15:06.885 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.885 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.885 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.886 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.886 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.886 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.886 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.886 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.887 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.887 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.887 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.887 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.887 INFO:teuthology.orchestra.run.smithi092.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-16T13:15:06.888 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-16T13:15:06.888 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.888 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.888 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.888 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.889 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.889 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.889 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.889 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.889 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.890 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.890 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.890 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.890 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_PASSWORD": { 2023-10-16T13:15:06.890 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-16T13:15:06.891 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.891 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.891 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.891 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2023-10-16T13:15:06.891 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.892 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.892 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.892 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.892 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.892 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.893 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.893 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.893 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-16T13:15:06.893 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-16T13:15:06.894 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.894 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.894 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.898 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.899 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.899 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.899 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.899 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.899 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.899 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.900 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.900 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.900 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_URL": { 2023-10-16T13:15:06.900 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_URL", 2023-10-16T13:15:06.900 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.901 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.901 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.901 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.901 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.901 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.902 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.902 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.902 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.902 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.902 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.903 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.903 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_USERNAME": { 2023-10-16T13:15:06.903 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-16T13:15:06.903 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.903 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.903 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.904 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2023-10-16T13:15:06.904 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.904 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.904 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.904 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.904 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.905 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.905 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.905 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.905 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-16T13:15:06.905 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-16T13:15:06.905 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.906 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.906 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.906 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.906 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.906 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.907 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.907 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.907 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.907 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.907 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.907 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.908 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-16T13:15:06.908 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-16T13:15:06.908 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.908 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.908 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.909 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.909 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.909 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.909 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.909 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.910 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.910 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.910 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.910 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.910 INFO:teuthology.orchestra.run.smithi092.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-16T13:15:06.911 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-16T13:15:06.911 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.911 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.911 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.911 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.912 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.912 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.912 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.912 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.912 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.912 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.913 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.913 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.913 INFO:teuthology.orchestra.run.smithi092.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-16T13:15:06.913 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-16T13:15:06.913 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.913 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.914 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.914 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.914 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.914 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.914 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.915 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.915 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.915 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.915 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.915 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.915 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_HOST": { 2023-10-16T13:15:06.916 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-16T13:15:06.916 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.916 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.916 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.916 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.916 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.917 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.917 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.917 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.917 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.917 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.917 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.917 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.918 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-16T13:15:06.918 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-16T13:15:06.918 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.918 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.918 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.919 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.919 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.919 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.919 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.919 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.920 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.920 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.920 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.920 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.920 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-16T13:15:06.920 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-16T13:15:06.921 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.921 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.921 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.921 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.921 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.921 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.922 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.922 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.922 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.922 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.922 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.923 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.923 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-16T13:15:06.923 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-16T13:15:06.923 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.923 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.924 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.924 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.924 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.924 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.924 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.924 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.925 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.925 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.925 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.925 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.925 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-16T13:15:06.925 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-16T13:15:06.926 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.926 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.926 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.926 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.926 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.927 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.927 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.927 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.927 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.927 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.927 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.928 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.928 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-16T13:15:06.928 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-16T13:15:06.928 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.928 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.929 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.929 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.929 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.929 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.929 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.929 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.930 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.930 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.930 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.930 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.930 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-16T13:15:06.931 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-16T13:15:06.931 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.931 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.931 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.931 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.932 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.932 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.932 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.932 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.932 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.932 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.933 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.933 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.933 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-16T13:15:06.933 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-16T13:15:06.933 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.933 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.934 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.934 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.934 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.934 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.934 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.935 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.935 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.935 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.935 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.935 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.936 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-16T13:15:06.936 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-16T13:15:06.936 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.936 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.936 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.936 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.937 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.937 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.937 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.937 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.937 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.938 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.938 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.938 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.938 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_ENABLED": { 2023-10-16T13:15:06.938 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-16T13:15:06.939 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.939 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.939 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.939 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.939 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.940 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.940 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.940 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.940 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.940 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.941 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.941 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.941 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-16T13:15:06.941 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-16T13:15:06.941 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.942 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.942 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.942 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-16T13:15:06.942 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.942 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.943 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.943 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.943 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.943 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.943 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.944 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.944 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-16T13:15:06.944 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-16T13:15:06.944 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:06.944 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.944 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.945 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:06.945 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.945 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.945 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.945 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.946 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.946 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.946 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.946 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.946 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-16T13:15:06.947 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-16T13:15:06.947 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:06.947 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.947 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.947 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8", 2023-10-16T13:15:06.948 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.948 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.948 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.948 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.948 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.948 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.949 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.949 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.949 INFO:teuthology.orchestra.run.smithi092.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-16T13:15:06.949 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-16T13:15:06.949 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:06.949 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.950 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.950 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "45", 2023-10-16T13:15:06.950 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.950 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.950 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.951 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.951 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.951 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.951 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.951 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.952 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ACCESS_KEY": { 2023-10-16T13:15:06.952 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-16T13:15:06.952 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.952 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.952 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.953 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.953 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.953 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.953 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.953 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.953 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.954 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.954 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.954 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.954 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-16T13:15:06.954 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-16T13:15:06.954 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.955 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.955 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.955 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2023-10-16T13:15:06.955 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.955 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.955 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.956 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.956 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.956 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.956 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.956 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.957 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SECRET_KEY": { 2023-10-16T13:15:06.957 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-16T13:15:06.957 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.957 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.957 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.958 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.958 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.958 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.958 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.958 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.959 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.959 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.959 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.959 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.959 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SSL_VERIFY": { 2023-10-16T13:15:06.959 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-16T13:15:06.960 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.960 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.960 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.960 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:06.960 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.961 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.961 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.961 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.961 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.961 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.961 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.962 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.962 INFO:teuthology.orchestra.run.smithi092.stdout: "UNSAFE_TLS_v1_2": { 2023-10-16T13:15:06.962 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-16T13:15:06.962 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.962 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.963 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.963 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.963 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.963 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.963 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.963 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.964 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.964 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.964 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.964 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.964 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-16T13:15:06.964 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-16T13:15:06.965 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:06.965 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.965 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.965 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2023-10-16T13:15:06.965 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.966 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.966 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.966 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.966 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.966 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.966 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.967 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.967 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-16T13:15:06.967 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-16T13:15:06.967 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:06.968 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.968 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.968 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:06.968 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.968 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.969 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.969 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.969 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.969 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.969 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.969 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.970 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-16T13:15:06.970 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-16T13:15:06.970 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:06.970 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.970 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.971 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2023-10-16T13:15:06.971 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.971 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.971 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.971 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.971 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.972 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.972 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.972 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.972 INFO:teuthology.orchestra.run.smithi092.stdout: "cross_origin_url": { 2023-10-16T13:15:06.972 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cross_origin_url", 2023-10-16T13:15:06.972 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.973 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.973 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.973 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.973 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.973 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.974 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.974 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.974 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.974 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.974 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.974 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.975 INFO:teuthology.orchestra.run.smithi092.stdout: "crt_file": { 2023-10-16T13:15:06.975 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crt_file", 2023-10-16T13:15:06.975 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.975 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.975 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.976 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.976 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.976 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.976 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.976 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.976 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.977 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.977 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.977 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.977 INFO:teuthology.orchestra.run.smithi092.stdout: "debug": { 2023-10-16T13:15:06.977 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "debug", 2023-10-16T13:15:06.977 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.978 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.978 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.978 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.978 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.978 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.979 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.979 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable/disable debug options", 2023-10-16T13:15:06.979 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.979 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.979 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.979 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.980 INFO:teuthology.orchestra.run.smithi092.stdout: "jwt_token_ttl": { 2023-10-16T13:15:06.980 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "jwt_token_ttl", 2023-10-16T13:15:06.980 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:06.980 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.980 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.980 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "28800", 2023-10-16T13:15:06.981 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.981 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.981 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.981 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.981 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.981 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.982 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.982 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.982 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2023-10-16T13:15:06.982 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2023-10-16T13:15:06.982 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.982 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.983 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.983 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.983 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.983 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.983 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.983 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.984 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.984 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.984 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.984 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.984 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:06.984 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:06.985 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.985 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.985 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.985 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.985 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.985 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.986 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:06.986 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:06.986 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:06.986 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:06.986 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:06.987 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:06.987 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:06.987 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:06.987 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.987 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.987 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.988 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.988 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.988 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:06.988 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:06.988 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.988 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.989 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.989 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.989 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.989 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.989 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.990 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.990 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.990 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.990 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.990 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.990 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:06.991 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:06.991 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.991 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.991 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.991 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:06.992 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.992 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.992 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:06.992 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:06.992 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:06.993 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:06.993 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:06.993 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:06.993 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:06.993 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:06.993 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.994 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.994 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.994 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.994 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.994 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:06.995 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:06.995 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:06.995 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.995 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:06.995 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:06.995 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.996 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.996 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.996 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:06.996 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.996 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.996 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.997 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.997 INFO:teuthology.orchestra.run.smithi092.stdout: "motd": { 2023-10-16T13:15:06.997 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "motd", 2023-10-16T13:15:06.997 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:06.997 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:06.997 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:06.998 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:06.998 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:06.998 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:06.998 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:06.998 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "The message of the day", 2023-10-16T13:15:06.999 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:06.999 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:06.999 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:06.999 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:06.999 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect_resolve_ip_addr": { 2023-10-16T13:15:06.999 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "redirect_resolve_ip_addr", 2023-10-16T13:15:07.000 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.000 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.000 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.000 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.000 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.000 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.001 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.001 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.001 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.001 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.001 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.001 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.002 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2023-10-16T13:15:07.002 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2023-10-16T13:15:07.002 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.002 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.002 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.003 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2023-10-16T13:15:07.003 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.003 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.003 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.003 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.003 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.004 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.004 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.004 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.004 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2023-10-16T13:15:07.004 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2023-10-16T13:15:07.004 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.005 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.005 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.005 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8080", 2023-10-16T13:15:07.005 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.005 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.005 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.006 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.006 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.006 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.006 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.006 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.007 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2023-10-16T13:15:07.007 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2023-10-16T13:15:07.007 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.007 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.007 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.008 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.008 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.008 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.008 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.008 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.008 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.009 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.009 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.009 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.009 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl_server_port": { 2023-10-16T13:15:07.009 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl_server_port", 2023-10-16T13:15:07.009 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.010 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.010 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.010 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8443", 2023-10-16T13:15:07.010 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.010 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.011 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.011 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.011 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.011 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.011 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.011 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.012 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2023-10-16T13:15:07.012 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2023-10-16T13:15:07.012 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.012 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.012 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.012 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "redirect", 2023-10-16T13:15:07.013 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.013 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.013 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.013 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.013 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect" 2023-10-16T13:15:07.013 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.014 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.014 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.014 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.014 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.014 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.015 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2023-10-16T13:15:07.015 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2023-10-16T13:15:07.015 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.015 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.015 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.015 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2023-10-16T13:15:07.016 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2023-10-16T13:15:07.016 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2023-10-16T13:15:07.016 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.016 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.016 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.016 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.017 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.017 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.017 INFO:teuthology.orchestra.run.smithi092.stdout: "url_prefix": { 2023-10-16T13:15:07.017 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url_prefix", 2023-10-16T13:15:07.017 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.018 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.018 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.018 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.018 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.018 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.019 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.019 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.019 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.019 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.019 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.019 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.020 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.020 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.020 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.020 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "devicehealth", 2023-10-16T13:15:07.020 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.021 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.021 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.021 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_monitoring": { 2023-10-16T13:15:07.021 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_monitoring", 2023-10-16T13:15:07.022 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.022 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.022 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.022 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.022 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.023 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.023 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.023 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "monitor device health metrics", 2023-10-16T13:15:07.023 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.023 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.023 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.024 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.024 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.024 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.024 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.024 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.025 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.025 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.025 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.025 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.025 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.026 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.026 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.026 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.026 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.026 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.027 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.027 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.027 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.027 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.027 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.028 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.028 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.028 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.028 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.028 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.029 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.029 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.029 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.029 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.029 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.029 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.030 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.030 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.030 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.030 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.030 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.031 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.031 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.031 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.031 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.031 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.032 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.032 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.032 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.032 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.032 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.032 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.033 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.033 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.033 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.033 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.033 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.034 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.034 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.034 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.034 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.034 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.034 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.035 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.035 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.035 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.035 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.035 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.036 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.036 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.036 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.036 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.036 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.036 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.037 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.037 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.037 INFO:teuthology.orchestra.run.smithi092.stdout: "mark_out_threshold": { 2023-10-16T13:15:07.037 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mark_out_threshold", 2023-10-16T13:15:07.037 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.038 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.038 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.038 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2419200", 2023-10-16T13:15:07.038 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.038 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.039 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.039 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-16T13:15:07.039 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.039 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.039 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.039 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.040 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_name": { 2023-10-16T13:15:07.040 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_name", 2023-10-16T13:15:07.040 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.040 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.040 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.041 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "device_health_metrics", 2023-10-16T13:15:07.041 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.041 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.041 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.041 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-16T13:15:07.042 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.042 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.042 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.042 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.042 INFO:teuthology.orchestra.run.smithi092.stdout: "retention_period": { 2023-10-16T13:15:07.043 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retention_period", 2023-10-16T13:15:07.043 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.043 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.043 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.044 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15552000", 2023-10-16T13:15:07.044 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.044 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.044 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.044 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain device health metrics", 2023-10-16T13:15:07.045 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.045 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.045 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.045 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.045 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_frequency": { 2023-10-16T13:15:07.046 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_frequency", 2023-10-16T13:15:07.046 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.046 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.046 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.046 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2023-10-16T13:15:07.046 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.047 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.047 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.047 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-16T13:15:07.047 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.047 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.048 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.048 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.048 INFO:teuthology.orchestra.run.smithi092.stdout: "self_heal": { 2023-10-16T13:15:07.048 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "self_heal", 2023-10-16T13:15:07.048 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.048 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.049 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.049 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.049 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.049 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.049 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.050 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-16T13:15:07.050 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.050 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.050 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.050 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.051 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2023-10-16T13:15:07.051 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2023-10-16T13:15:07.051 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.051 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.051 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.051 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2023-10-16T13:15:07.052 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.052 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.052 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.052 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and check device health", 2023-10-16T13:15:07.052 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.053 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.053 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.053 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.053 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_threshold": { 2023-10-16T13:15:07.053 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_threshold", 2023-10-16T13:15:07.053 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.054 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.054 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.054 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7257600", 2023-10-16T13:15:07.054 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.054 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.055 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.055 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-16T13:15:07.055 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.055 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.055 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.056 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.056 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.056 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.056 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.056 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "diskprediction_local", 2023-10-16T13:15:07.057 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.057 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.057 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.057 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.057 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.057 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.058 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.058 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.058 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.058 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.058 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.059 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.059 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.059 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.059 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.059 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.060 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.060 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.060 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.060 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.060 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.060 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.061 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.061 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.061 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.061 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.061 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.062 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.062 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.062 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.062 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.063 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.063 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.063 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.063 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.063 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.063 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.064 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.064 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.064 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.064 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.064 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.065 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.065 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.065 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.065 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.065 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.065 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.066 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.066 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.066 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.066 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.066 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.067 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.067 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.067 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.067 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.067 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.068 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.068 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.068 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.068 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.068 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.068 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.069 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.069 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.069 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.069 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.069 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.070 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.070 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.070 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.070 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.070 INFO:teuthology.orchestra.run.smithi092.stdout: "predict_interval": { 2023-10-16T13:15:07.070 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predict_interval", 2023-10-16T13:15:07.071 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.071 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.071 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.071 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2023-10-16T13:15:07.071 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.072 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.072 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.072 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.072 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.072 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.072 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.073 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.073 INFO:teuthology.orchestra.run.smithi092.stdout: "predictor_model": { 2023-10-16T13:15:07.073 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predictor_model", 2023-10-16T13:15:07.073 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.073 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.074 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.074 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "prophetstor", 2023-10-16T13:15:07.074 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.074 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.074 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.074 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.075 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.075 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.075 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.075 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.075 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2023-10-16T13:15:07.076 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2023-10-16T13:15:07.076 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.076 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.076 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.076 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2023-10-16T13:15:07.077 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.077 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.077 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.077 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.077 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.078 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.078 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.078 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.078 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.078 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.079 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.079 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "influx", 2023-10-16T13:15:07.079 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": false, 2023-10-16T13:15:07.079 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "influxdb python module not found", 2023-10-16T13:15:07.079 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.079 INFO:teuthology.orchestra.run.smithi092.stdout: "batch_size": { 2023-10-16T13:15:07.080 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "batch_size", 2023-10-16T13:15:07.080 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.080 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.080 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.080 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5000", 2023-10-16T13:15:07.081 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.081 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.081 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.081 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-16T13:15:07.081 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.082 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.082 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.082 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.082 INFO:teuthology.orchestra.run.smithi092.stdout: "database": { 2023-10-16T13:15:07.082 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "database", 2023-10-16T13:15:07.083 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.083 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.083 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.083 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "ceph", 2023-10-16T13:15:07.083 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.083 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.084 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.084 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-16T13:15:07.084 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.084 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.084 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.084 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.085 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": { 2023-10-16T13:15:07.085 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hostname", 2023-10-16T13:15:07.085 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.085 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.085 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.086 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.086 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.086 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.086 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.086 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server hostname", 2023-10-16T13:15:07.087 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.087 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.087 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.087 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.087 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2023-10-16T13:15:07.087 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2023-10-16T13:15:07.088 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.088 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.088 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.088 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "30", 2023-10-16T13:15:07.088 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "5", 2023-10-16T13:15:07.088 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.089 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.089 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-16T13:15:07.089 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.089 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.089 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.089 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.090 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.090 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.090 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.090 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.090 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.091 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.091 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.091 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.091 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.091 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.092 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.092 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.092 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.092 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.092 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.093 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.093 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.093 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.093 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.093 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.094 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.094 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.094 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.094 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.094 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.094 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.095 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.097 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.098 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.098 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.098 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.098 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.098 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.099 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.099 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.099 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.099 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.099 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.100 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.100 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.100 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.100 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.100 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.101 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.101 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.101 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.101 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.101 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.102 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.102 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.102 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.102 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.102 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.103 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.103 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.103 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.103 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.103 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.104 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.104 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.104 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.104 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.104 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.105 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.105 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.105 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.105 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.105 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.105 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.106 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.106 INFO:teuthology.orchestra.run.smithi092.stdout: "password": { 2023-10-16T13:15:07.106 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "password", 2023-10-16T13:15:07.106 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.106 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.107 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.107 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.107 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.107 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.107 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.108 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "password of InfluxDB server user", 2023-10-16T13:15:07.108 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.108 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.108 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.108 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.109 INFO:teuthology.orchestra.run.smithi092.stdout: "port": { 2023-10-16T13:15:07.109 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "port", 2023-10-16T13:15:07.109 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.109 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.109 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.110 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8086", 2023-10-16T13:15:07.110 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.110 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.110 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.110 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server port", 2023-10-16T13:15:07.110 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.111 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.111 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.111 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.111 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2023-10-16T13:15:07.111 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2023-10-16T13:15:07.112 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.112 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.112 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.112 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "false", 2023-10-16T13:15:07.112 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.113 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.113 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.113 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-16T13:15:07.113 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.113 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.114 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.114 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.114 INFO:teuthology.orchestra.run.smithi092.stdout: "threads": { 2023-10-16T13:15:07.114 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threads", 2023-10-16T13:15:07.114 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.115 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.115 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.115 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2023-10-16T13:15:07.115 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2023-10-16T13:15:07.115 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "32", 2023-10-16T13:15:07.115 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.116 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-16T13:15:07.116 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.116 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.116 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.116 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.117 INFO:teuthology.orchestra.run.smithi092.stdout: "username": { 2023-10-16T13:15:07.117 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "username", 2023-10-16T13:15:07.117 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.117 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.117 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.118 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.118 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.118 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.118 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.118 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "username of InfluxDB server user", 2023-10-16T13:15:07.119 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.119 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.119 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.119 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.119 INFO:teuthology.orchestra.run.smithi092.stdout: "verify_ssl": { 2023-10-16T13:15:07.119 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "verify_ssl", 2023-10-16T13:15:07.120 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.120 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.120 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.120 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "true", 2023-10-16T13:15:07.120 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.121 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.121 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.121 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-16T13:15:07.121 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.121 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.121 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.122 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.122 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.122 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.122 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.122 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "insights", 2023-10-16T13:15:07.123 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.123 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.123 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.123 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.123 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.124 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.124 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.124 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.124 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.124 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.125 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.125 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.125 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.125 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.125 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.126 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.126 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.126 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.126 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.126 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.127 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.127 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.127 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.127 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.127 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.128 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.128 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.128 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.128 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.129 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.129 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.129 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.129 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.129 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.129 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.130 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.130 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.130 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.130 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.131 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.131 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.131 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.131 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.131 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.132 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.132 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.132 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.132 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.132 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.133 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.133 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.133 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.133 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.133 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.134 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.134 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.134 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.134 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.134 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.135 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.135 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.135 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.135 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.136 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.136 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.136 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.136 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.136 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.136 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.137 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.137 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.137 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.137 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.137 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.138 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.138 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.138 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "iostat", 2023-10-16T13:15:07.138 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.138 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.139 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.139 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.139 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.139 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.139 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.139 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.140 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.140 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.140 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.140 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.140 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.141 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.141 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.141 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.141 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.141 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.141 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.142 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.142 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.142 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.142 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.143 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.143 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.143 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.143 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.143 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.144 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.144 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.144 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.144 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.144 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.145 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.145 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.145 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.145 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.145 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.146 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.146 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.146 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.146 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.146 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.147 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.147 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.147 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.147 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.147 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.147 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.148 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.148 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.148 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.148 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.148 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.149 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.149 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.149 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.149 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.149 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.149 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.150 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.150 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.150 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.150 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.150 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.151 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.151 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.151 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.151 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.151 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.152 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.152 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.152 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.152 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.152 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.152 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.153 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "k8sevents", 2023-10-16T13:15:07.153 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.153 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.153 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.153 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_event_retention_days": { 2023-10-16T13:15:07.153 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ceph_event_retention_days", 2023-10-16T13:15:07.154 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.154 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.154 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.154 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7", 2023-10-16T13:15:07.154 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.155 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.155 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.155 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-16T13:15:07.155 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.155 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.156 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.156 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.156 INFO:teuthology.orchestra.run.smithi092.stdout: "config_check_secs": { 2023-10-16T13:15:07.156 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_check_secs", 2023-10-16T13:15:07.156 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.156 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.157 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.157 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:07.157 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "10", 2023-10-16T13:15:07.157 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.157 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.158 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-16T13:15:07.158 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.158 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.158 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.158 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.159 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.159 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.159 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.159 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.159 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.159 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.160 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.160 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.160 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.160 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.160 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.161 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.161 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.161 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.161 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.162 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.162 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.162 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.162 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.162 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.163 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.163 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.163 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.163 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.163 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.164 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.164 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.164 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.164 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.164 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.164 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.165 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.165 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.165 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.165 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.165 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.166 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.166 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.166 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.166 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.166 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.167 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.167 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.167 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.167 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.167 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.168 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.168 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.168 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.168 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.168 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.169 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.169 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.169 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.169 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.169 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.170 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.170 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.170 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.170 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.170 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.171 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.171 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.171 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.171 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.171 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.172 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.172 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.172 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.172 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.172 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.172 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.173 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.173 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "localpool", 2023-10-16T13:15:07.173 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.173 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.173 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.173 INFO:teuthology.orchestra.run.smithi092.stdout: "failure_domain": { 2023-10-16T13:15:07.174 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "failure_domain", 2023-10-16T13:15:07.174 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.174 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.174 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.174 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "host", 2023-10-16T13:15:07.175 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.175 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.175 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.175 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "failure domain for any created local pool", 2023-10-16T13:15:07.175 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-16T13:15:07.176 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.176 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.176 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.176 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.176 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.177 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.177 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.177 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.177 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.177 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.178 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.178 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.178 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.178 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.178 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.179 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.179 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.179 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.179 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.179 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.180 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.180 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.180 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.180 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.180 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.181 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.181 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.181 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.181 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.181 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.182 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.182 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.182 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.182 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.183 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.183 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.183 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.183 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.183 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.184 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.184 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.184 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.184 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.184 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.185 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.185 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.185 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.185 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.185 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.186 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.186 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.186 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.186 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.186 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.186 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.187 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.187 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.187 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.187 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.187 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.188 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.188 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.188 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.188 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.188 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.189 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.189 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.189 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.189 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.189 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.190 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.190 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.190 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.190 INFO:teuthology.orchestra.run.smithi092.stdout: "min_size": { 2023-10-16T13:15:07.190 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_size", 2023-10-16T13:15:07.191 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.191 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.191 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.191 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.191 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.192 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.192 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.192 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default min_size for any created local pool", 2023-10-16T13:15:07.192 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-16T13:15:07.192 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.193 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.193 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.193 INFO:teuthology.orchestra.run.smithi092.stdout: "num_rep": { 2023-10-16T13:15:07.193 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "num_rep", 2023-10-16T13:15:07.193 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.194 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.194 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.194 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3", 2023-10-16T13:15:07.194 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.194 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.195 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.195 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default replica count for any created local pool", 2023-10-16T13:15:07.195 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.195 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.195 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.195 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.196 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_num": { 2023-10-16T13:15:07.196 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_num", 2023-10-16T13:15:07.196 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.196 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.196 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.197 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "128", 2023-10-16T13:15:07.197 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.197 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.197 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.197 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default pg_num for any created local pool", 2023-10-16T13:15:07.198 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.198 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.198 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.198 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.198 INFO:teuthology.orchestra.run.smithi092.stdout: "prefix": { 2023-10-16T13:15:07.198 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prefix", 2023-10-16T13:15:07.199 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.199 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.199 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.199 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.200 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.200 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.200 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.200 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name prefix for any created local pool", 2023-10-16T13:15:07.200 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.201 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.201 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.201 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.201 INFO:teuthology.orchestra.run.smithi092.stdout: "subtree": { 2023-10-16T13:15:07.201 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "subtree", 2023-10-16T13:15:07.201 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.202 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.202 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.202 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "rack", 2023-10-16T13:15:07.202 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.202 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.203 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.203 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-16T13:15:07.203 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-16T13:15:07.203 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.204 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.204 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.204 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.204 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.205 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.205 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mds_autoscaler", 2023-10-16T13:15:07.205 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.205 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.205 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.206 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.206 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.206 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.206 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.206 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.207 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.207 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.207 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.207 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.207 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.208 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.208 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.208 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.208 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.209 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.209 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.209 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.209 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.209 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.210 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.210 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.210 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.210 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.210 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.211 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.211 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.211 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.211 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.211 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.212 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.212 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.212 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.212 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.213 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.213 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.213 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.213 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.213 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.214 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.214 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.214 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.214 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.214 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.215 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.215 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.215 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.215 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.215 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.215 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.216 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.216 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.216 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.216 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.216 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.217 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.217 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.217 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.217 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.217 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.217 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.218 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.218 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.218 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.218 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.218 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.219 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.219 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.219 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.219 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.219 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.219 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.220 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.220 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.220 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirroring", 2023-10-16T13:15:07.220 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.220 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.221 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.221 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.221 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.221 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.221 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.221 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.222 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.222 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.222 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.222 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.222 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.222 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.223 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.223 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.223 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.223 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.223 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.223 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.224 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.224 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.224 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.224 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.224 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.225 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.225 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.225 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.225 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.225 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.226 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.226 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.226 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.226 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.226 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.227 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.227 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.227 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.227 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.227 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.227 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.228 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.228 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.228 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.228 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.228 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.228 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.229 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.229 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.229 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.229 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.229 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.230 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.230 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.230 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.230 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.230 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.231 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.231 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.231 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.231 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.231 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.232 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.232 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.232 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.232 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.233 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.233 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.233 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.233 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.233 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.233 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.234 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.234 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.234 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.234 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.234 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "nfs", 2023-10-16T13:15:07.235 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.235 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.235 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.235 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.235 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.235 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.236 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.236 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.236 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.236 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.236 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.237 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.237 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.237 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.237 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.237 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.238 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.238 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.238 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.238 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.238 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.239 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.239 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.239 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.239 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.239 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.239 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.240 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.240 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.240 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.240 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.240 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.241 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.241 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.241 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.241 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.241 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.241 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.242 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.242 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.242 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.242 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.242 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.243 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.243 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.243 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.243 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.243 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.244 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.244 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.244 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.244 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.244 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.244 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.245 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.245 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.245 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.245 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.245 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.245 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.246 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.246 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.246 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.246 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.246 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.247 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.247 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.247 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.247 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.247 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.248 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.248 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.248 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.248 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.248 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.249 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.249 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2023-10-16T13:15:07.249 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.249 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.249 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.249 INFO:teuthology.orchestra.run.smithi092.stdout: "fail_fs": { 2023-10-16T13:15:07.250 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "fail_fs", 2023-10-16T13:15:07.250 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.250 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.250 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.250 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.251 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.251 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.251 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.251 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-16T13:15:07.251 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.251 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.252 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.252 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.252 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.252 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.253 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.253 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.253 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.253 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.254 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.254 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.254 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.254 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.254 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.255 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.255 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.255 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.255 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.255 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.256 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.256 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.256 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.256 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.256 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.257 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.257 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.257 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.257 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.257 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.257 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.258 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.258 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.258 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.258 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.258 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.258 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.259 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.259 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.259 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.259 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.259 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.260 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.260 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.260 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.260 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.260 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.260 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.261 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.261 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.261 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.261 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.261 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.261 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.262 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.262 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.262 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.262 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.262 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.263 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.263 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.263 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.263 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.263 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.263 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.264 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.264 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.264 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.264 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.264 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.264 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.264 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.265 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.265 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.265 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator": { 2023-10-16T13:15:07.265 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2023-10-16T13:15:07.265 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.265 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.266 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.266 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.266 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.266 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.266 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.267 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm", 2023-10-16T13:15:07.267 INFO:teuthology.orchestra.run.smithi092.stdout: "rook", 2023-10-16T13:15:07.267 INFO:teuthology.orchestra.run.smithi092.stdout: "test_orchestrator" 2023-10-16T13:15:07.267 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.267 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Orchestrator backend", 2023-10-16T13:15:07.267 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.268 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.268 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.268 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.268 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.268 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.268 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.269 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_perf_query", 2023-10-16T13:15:07.269 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.269 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.269 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.269 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.269 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.270 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.270 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.270 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.270 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.270 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.271 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.271 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.271 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.271 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.271 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.271 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.272 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.272 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.272 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.272 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.272 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.272 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.273 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.273 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.273 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.273 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.273 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.273 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.273 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.274 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.274 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.274 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.274 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.274 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.275 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.275 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.275 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.275 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.275 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.275 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.276 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.276 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.276 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.276 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.276 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.276 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.277 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.277 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.277 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.277 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.277 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.277 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.278 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.278 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.278 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.278 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.278 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.279 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.279 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.279 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.279 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.279 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.280 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.280 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.280 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.280 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.280 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.280 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.281 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.281 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.281 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.281 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.281 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.282 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.282 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.282 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.282 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_support", 2023-10-16T13:15:07.282 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.283 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.283 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.283 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.283 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.283 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.284 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.284 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.284 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.284 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.284 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.285 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.285 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.285 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.285 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.285 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.285 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.286 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.286 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.286 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.286 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.287 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.287 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.287 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.287 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.287 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.288 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.288 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.288 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.288 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.288 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.288 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.289 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.289 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.289 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.289 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.289 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.290 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.290 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.290 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.290 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.290 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.291 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.291 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.291 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.291 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.291 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.292 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.292 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.292 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.292 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.292 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.293 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.293 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.293 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.293 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.293 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.294 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.294 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.294 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.294 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.294 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.295 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.295 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.295 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.295 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.295 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.295 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.296 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.296 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.296 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.296 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.296 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.297 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.297 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.297 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.297 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_autoscaler", 2023-10-16T13:15:07.297 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.298 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.298 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.298 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.298 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.298 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.299 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.299 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.299 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.299 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.299 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.299 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.300 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.300 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.300 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.300 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.300 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.301 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.301 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.301 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.301 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.301 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.302 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.302 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.302 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.302 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.305 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.305 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.305 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.306 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.306 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.306 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.306 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.306 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.306 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.307 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.307 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.307 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.307 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.307 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.308 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.308 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.308 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.308 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.309 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.309 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.309 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.309 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.309 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.309 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.310 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.310 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.310 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.310 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.310 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.311 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.311 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.311 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.311 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.311 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.312 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.312 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.312 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.312 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.312 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.312 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.313 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.313 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.313 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.313 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.313 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.313 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.314 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.314 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2023-10-16T13:15:07.314 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2023-10-16T13:15:07.314 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.314 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.314 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.315 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2023-10-16T13:15:07.315 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.315 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.315 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.315 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.315 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.316 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.316 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.316 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.316 INFO:teuthology.orchestra.run.smithi092.stdout: "threshold": { 2023-10-16T13:15:07.316 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threshold", 2023-10-16T13:15:07.316 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:07.317 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.317 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.317 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2023-10-16T13:15:07.317 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1.0", 2023-10-16T13:15:07.317 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.318 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.318 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "scaling threshold", 2023-10-16T13:15:07.318 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-16T13:15:07.318 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.318 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.318 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.319 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.319 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.319 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.319 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "progress", 2023-10-16T13:15:07.319 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.320 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.320 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.320 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_pg_recovery_event": { 2023-10-16T13:15:07.320 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_pg_recovery_event", 2023-10-16T13:15:07.320 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.321 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.321 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.321 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.321 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.321 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.322 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.322 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-16T13:15:07.322 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.322 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.322 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.322 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.323 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2023-10-16T13:15:07.323 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2023-10-16T13:15:07.323 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.323 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.323 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.323 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.324 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.324 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.324 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.324 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.324 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.324 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.325 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.325 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.325 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.325 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.325 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.326 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.326 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.326 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.326 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.326 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.327 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.327 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.327 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.327 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.327 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.327 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.328 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.328 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.328 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.328 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.328 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.329 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.329 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.329 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.329 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.329 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.329 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.330 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.330 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.330 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.330 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.330 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.331 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.331 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.331 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.331 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.331 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.331 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.332 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.332 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.332 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.332 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.332 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.333 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.333 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.333 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.333 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.333 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.333 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.334 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.334 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.334 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.334 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.334 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.334 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.335 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.335 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.335 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.335 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.335 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.336 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.336 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.336 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.336 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.336 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.337 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.337 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.337 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.337 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.337 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.337 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.338 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.338 INFO:teuthology.orchestra.run.smithi092.stdout: "max_completed_events": { 2023-10-16T13:15:07.338 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_completed_events", 2023-10-16T13:15:07.338 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.338 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.339 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.339 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "50", 2023-10-16T13:15:07.339 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.339 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.339 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.339 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "number of past completed events to remember", 2023-10-16T13:15:07.340 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.340 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.340 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.340 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.340 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2023-10-16T13:15:07.341 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2023-10-16T13:15:07.341 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.341 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.341 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.341 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2023-10-16T13:15:07.341 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.342 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.342 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.342 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long the module is going to sleep", 2023-10-16T13:15:07.342 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.342 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.342 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.343 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.343 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.343 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.343 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.343 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus", 2023-10-16T13:15:07.343 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.344 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.344 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.344 INFO:teuthology.orchestra.run.smithi092.stdout: "cache": { 2023-10-16T13:15:07.344 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cache", 2023-10-16T13:15:07.344 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.344 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.345 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.345 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.345 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.345 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.345 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.345 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.346 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.346 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.346 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.346 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.346 INFO:teuthology.orchestra.run.smithi092.stdout: "exclude_perf_counters": { 2023-10-16T13:15:07.347 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "exclude_perf_counters", 2023-10-16T13:15:07.347 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.347 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.347 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.347 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.347 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.348 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.348 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.348 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-16T13:15:07.348 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-16T13:15:07.348 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.348 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.349 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.349 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.349 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.349 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.349 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.349 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.350 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.350 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.350 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.350 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.351 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.351 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.351 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.351 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.351 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.351 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.352 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.352 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.352 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.352 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.352 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.352 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.353 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.353 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.353 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.353 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.353 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.353 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.354 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.354 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.354 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.354 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.354 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.354 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.355 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.355 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.355 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.355 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.355 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.355 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.356 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.356 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.356 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.356 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.356 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.357 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.357 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.357 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.357 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.357 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.357 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.358 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.358 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.358 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.358 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.358 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.359 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.359 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.359 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.359 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.359 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.359 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.360 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.360 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.360 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.360 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.360 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.361 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.361 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.361 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.361 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.361 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools": { 2023-10-16T13:15:07.361 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools", 2023-10-16T13:15:07.362 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.362 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.362 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.362 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.362 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.362 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.363 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.363 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.363 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.363 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.363 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.363 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.364 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-16T13:15:07.364 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-16T13:15:07.364 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.364 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.364 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.364 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "300", 2023-10-16T13:15:07.365 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.365 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.365 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.365 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.365 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.365 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.366 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.366 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.366 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_interval": { 2023-10-16T13:15:07.366 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_interval", 2023-10-16T13:15:07.366 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:07.366 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.367 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.367 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15.0", 2023-10-16T13:15:07.367 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.367 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.367 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.367 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.368 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.368 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.368 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.368 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.368 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2023-10-16T13:15:07.368 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2023-10-16T13:15:07.369 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.369 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.369 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.369 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2023-10-16T13:15:07.369 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.370 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.370 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.370 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-16T13:15:07.370 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.370 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.371 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.371 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.371 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2023-10-16T13:15:07.371 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2023-10-16T13:15:07.371 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.371 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.372 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.372 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "9283", 2023-10-16T13:15:07.372 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.372 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.372 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.372 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-16T13:15:07.373 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.373 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.373 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.373 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.373 INFO:teuthology.orchestra.run.smithi092.stdout: "stale_cache_strategy": { 2023-10-16T13:15:07.373 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stale_cache_strategy", 2023-10-16T13:15:07.374 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.374 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.374 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.374 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "log", 2023-10-16T13:15:07.374 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.374 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.375 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.375 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.375 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.375 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.375 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.375 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.376 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2023-10-16T13:15:07.376 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2023-10-16T13:15:07.376 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.376 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.376 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.376 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "default", 2023-10-16T13:15:07.377 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.377 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.377 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.377 INFO:teuthology.orchestra.run.smithi092.stdout: "default", 2023-10-16T13:15:07.377 INFO:teuthology.orchestra.run.smithi092.stdout: "error" 2023-10-16T13:15:07.378 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.378 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.378 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.378 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.378 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.379 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.379 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2023-10-16T13:15:07.379 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2023-10-16T13:15:07.379 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.379 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.379 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.380 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2023-10-16T13:15:07.380 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2023-10-16T13:15:07.380 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2023-10-16T13:15:07.380 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.380 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.380 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.381 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.381 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.381 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.381 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.381 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.381 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.382 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_support", 2023-10-16T13:15:07.382 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.382 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.382 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.382 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.383 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.383 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.383 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.383 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.383 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.384 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.384 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.384 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.384 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.384 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.385 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.385 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.385 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.385 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.385 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.385 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.386 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.386 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.386 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.386 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.386 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.387 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.387 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.387 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.387 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.387 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.388 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.388 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.388 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.388 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.388 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.389 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.389 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.389 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.389 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.389 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.389 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.390 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.390 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.390 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.390 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.390 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.391 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.391 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.391 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.391 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.391 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.391 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.392 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.392 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.392 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.392 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.392 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.393 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.393 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.393 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.393 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.393 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.393 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.394 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.394 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.394 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.394 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.394 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.395 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.395 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.395 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.395 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.395 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.396 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_snap_create": { 2023-10-16T13:15:07.396 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_snap_create", 2023-10-16T13:15:07.396 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.396 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.396 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.397 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:07.397 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.397 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.397 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.397 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.397 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.398 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.398 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.398 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.398 INFO:teuthology.orchestra.run.smithi092.stdout: "mirror_snapshot_schedule": { 2023-10-16T13:15:07.398 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirror_snapshot_schedule", 2023-10-16T13:15:07.399 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.399 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.399 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.399 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.399 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.400 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.400 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.400 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.400 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.400 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.400 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.401 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.401 INFO:teuthology.orchestra.run.smithi092.stdout: "trash_purge_schedule": { 2023-10-16T13:15:07.401 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "trash_purge_schedule", 2023-10-16T13:15:07.401 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.401 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.402 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.402 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.402 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.402 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.402 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.403 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.403 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.403 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.403 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.403 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.403 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.404 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.404 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.404 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "restful", 2023-10-16T13:15:07.404 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.404 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.405 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.405 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_auth": { 2023-10-16T13:15:07.405 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_auth", 2023-10-16T13:15:07.405 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.405 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.406 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.406 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.406 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.406 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.406 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.407 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.407 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.407 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.407 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.407 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.408 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2023-10-16T13:15:07.408 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2023-10-16T13:15:07.408 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.408 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.408 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.408 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.409 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.409 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.409 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.410 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.410 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.410 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.410 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.410 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.411 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.411 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.411 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.411 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.411 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.412 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.412 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.412 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.412 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.412 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.413 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.413 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.413 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.413 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.413 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.414 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.414 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.414 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.414 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.414 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.415 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.415 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.415 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.415 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.415 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.416 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.416 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.416 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.416 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.416 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.417 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.417 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.417 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.417 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.417 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.417 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.418 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.418 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.418 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.418 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.418 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.419 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.419 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.419 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.419 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.419 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.420 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.420 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.420 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.420 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.421 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.421 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.421 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.421 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.421 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.422 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.422 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.422 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.422 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.422 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.423 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.423 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.423 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.423 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.423 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.423 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.424 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.424 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.424 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.424 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.424 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2023-10-16T13:15:07.425 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2023-10-16T13:15:07.425 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.425 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.425 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.425 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.425 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.426 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.426 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.426 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.426 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.426 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.427 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.427 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.427 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2023-10-16T13:15:07.427 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2023-10-16T13:15:07.427 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.428 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.428 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.428 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.428 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.428 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.428 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.429 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.429 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.429 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.429 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.429 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.430 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.430 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.430 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.430 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rgw", 2023-10-16T13:15:07.431 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.431 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.431 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.431 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.431 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.432 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.432 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.432 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.432 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.432 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.433 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.433 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.433 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.433 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.433 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.434 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.434 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.434 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.434 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.434 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.434 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.435 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.435 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.435 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.435 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.435 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.435 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.436 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.436 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.436 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.436 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.436 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.437 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.437 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.437 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.437 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.438 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.438 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.438 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.438 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.438 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.439 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.439 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.439 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.439 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.439 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.440 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.440 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.440 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.440 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.440 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.440 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.441 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.441 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.441 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.441 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.441 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.442 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.442 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.442 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.442 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.442 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.443 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.443 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.443 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.443 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.443 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.443 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.444 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.444 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.444 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.444 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.444 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.444 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.445 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.445 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.445 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rook", 2023-10-16T13:15:07.445 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.445 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.445 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.446 INFO:teuthology.orchestra.run.smithi092.stdout: "drive_group_interval": { 2023-10-16T13:15:07.446 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "drive_group_interval", 2023-10-16T13:15:07.446 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:07.446 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.446 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.447 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "300.0", 2023-10-16T13:15:07.447 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.447 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.447 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.447 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-16T13:15:07.448 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.448 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.448 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.448 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.448 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.448 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.449 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.449 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.449 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.449 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.449 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.449 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.450 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.450 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.450 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.450 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.450 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.451 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.451 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.451 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.451 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.451 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.452 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.452 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.452 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.452 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.452 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.452 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.453 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.453 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.453 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.453 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.453 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.454 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.454 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.454 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.454 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.454 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.455 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.455 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.455 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.455 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.455 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.456 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.456 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.456 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.456 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.456 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.457 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.457 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.457 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.457 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.457 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.458 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.458 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.458 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.458 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.458 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.458 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.459 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.459 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.459 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.459 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.459 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.460 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.460 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.460 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.460 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.460 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.461 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.461 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.461 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.461 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.461 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.462 INFO:teuthology.orchestra.run.smithi092.stdout: "storage_class": { 2023-10-16T13:15:07.462 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "storage_class", 2023-10-16T13:15:07.462 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.462 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.462 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.463 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "local", 2023-10-16T13:15:07.463 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.463 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.463 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.463 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-16T13:15:07.463 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.464 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.464 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.464 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.464 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.464 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.465 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.465 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "selftest", 2023-10-16T13:15:07.465 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.465 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.465 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.466 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.466 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.466 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.466 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.466 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.467 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.467 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.467 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.467 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.467 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.468 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.468 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.468 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.468 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.468 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.468 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.469 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.469 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.469 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.469 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.469 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.469 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.470 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.470 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.470 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.470 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.470 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.471 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.471 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.471 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.471 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.471 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.471 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.472 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.472 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.472 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.472 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.472 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.473 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.473 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.473 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.473 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.473 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.473 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.474 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.474 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.474 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.474 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.474 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.475 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.475 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.475 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.475 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.475 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.476 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.476 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.476 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.476 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.476 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.477 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.477 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.477 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.477 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.477 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.478 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.478 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.478 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.478 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.478 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.478 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.479 INFO:teuthology.orchestra.run.smithi092.stdout: "roption1": { 2023-10-16T13:15:07.479 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption1", 2023-10-16T13:15:07.479 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.479 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.479 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.480 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.480 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.480 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.480 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.480 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.481 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.481 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.481 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.481 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.481 INFO:teuthology.orchestra.run.smithi092.stdout: "roption2": { 2023-10-16T13:15:07.482 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption2", 2023-10-16T13:15:07.482 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.482 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.482 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.482 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "xyz", 2023-10-16T13:15:07.483 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.483 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.483 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.483 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.483 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.484 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.484 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.484 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.484 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption1": { 2023-10-16T13:15:07.484 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption1", 2023-10-16T13:15:07.484 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.485 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.485 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.485 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.485 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.485 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.486 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.486 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.486 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.486 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.487 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.487 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.487 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption2": { 2023-10-16T13:15:07.487 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption2", 2023-10-16T13:15:07.487 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.488 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.488 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.488 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.488 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.488 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.488 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.489 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.489 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.489 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.489 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.489 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.489 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption3": { 2023-10-16T13:15:07.490 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption3", 2023-10-16T13:15:07.490 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:07.490 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.490 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.490 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.491 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.491 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.491 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.491 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.491 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.492 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.492 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.492 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.492 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption4": { 2023-10-16T13:15:07.492 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption4", 2023-10-16T13:15:07.492 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.493 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.493 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.493 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.493 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.493 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.493 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.494 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.494 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.494 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.494 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.494 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.495 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption5": { 2023-10-16T13:15:07.495 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption5", 2023-10-16T13:15:07.495 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.495 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.495 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.495 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.496 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.496 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.496 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.496 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.496 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.497 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.497 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.497 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.497 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption6": { 2023-10-16T13:15:07.497 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption6", 2023-10-16T13:15:07.497 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.498 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.498 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.498 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.498 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.498 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.499 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.499 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.499 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.499 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.499 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.500 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.500 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption7": { 2023-10-16T13:15:07.500 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption7", 2023-10-16T13:15:07.500 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.500 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.500 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.501 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.501 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2023-10-16T13:15:07.501 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "42", 2023-10-16T13:15:07.501 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.501 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.502 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.502 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.502 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.502 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.502 INFO:teuthology.orchestra.run.smithi092.stdout: "testkey": { 2023-10-16T13:15:07.503 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testkey", 2023-10-16T13:15:07.503 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.503 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.503 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.503 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.504 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.504 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.504 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.504 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.504 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.504 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.505 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.505 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.505 INFO:teuthology.orchestra.run.smithi092.stdout: "testlkey": { 2023-10-16T13:15:07.505 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testlkey", 2023-10-16T13:15:07.505 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.506 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.506 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.506 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.506 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.506 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.507 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.507 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.507 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.507 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.507 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.507 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.508 INFO:teuthology.orchestra.run.smithi092.stdout: "testnewline": { 2023-10-16T13:15:07.508 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testnewline", 2023-10-16T13:15:07.508 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.508 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.508 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.509 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.509 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.509 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.509 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.509 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.510 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.510 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.510 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.510 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.510 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.511 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.511 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.511 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snap_schedule", 2023-10-16T13:15:07.511 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.511 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.512 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.512 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_m_granularity": { 2023-10-16T13:15:07.512 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_m_granularity", 2023-10-16T13:15:07.512 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.512 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.512 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.513 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.513 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.513 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.513 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.513 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow minute scheduled snapshots", 2023-10-16T13:15:07.513 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.514 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.514 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.514 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.514 INFO:teuthology.orchestra.run.smithi092.stdout: "dump_on_update": { 2023-10-16T13:15:07.514 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dump_on_update", 2023-10-16T13:15:07.515 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.515 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.515 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.515 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.515 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.516 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.516 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.516 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "dump database to debug log on update", 2023-10-16T13:15:07.516 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.516 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.516 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.517 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.517 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.517 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.517 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.517 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.517 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.518 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.518 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.518 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.518 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.518 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.519 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.519 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.519 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.519 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.519 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.520 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.520 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.520 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.520 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.520 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.520 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.521 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.521 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.521 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.521 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.521 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.522 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.522 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.522 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.522 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.522 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.523 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.523 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.523 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.523 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.523 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.524 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.524 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.524 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.524 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.524 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.525 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.525 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.525 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.525 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.525 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.525 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.526 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.526 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.526 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.526 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.526 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.527 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.527 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.527 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.527 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.527 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.527 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.528 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.528 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.528 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.528 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.528 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.529 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.529 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.529 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.529 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.529 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.530 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.530 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.530 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.530 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.530 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.531 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stats", 2023-10-16T13:15:07.531 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.531 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.531 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.531 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.532 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.532 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.532 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.532 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.532 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.533 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.533 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.533 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.533 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.533 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.534 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.534 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.534 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.534 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.534 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.534 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.535 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.535 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.535 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.535 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.535 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.536 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.536 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.536 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.536 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.536 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.537 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.537 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.537 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.537 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.537 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.538 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.538 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.538 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.538 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.538 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.539 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.539 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.539 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.539 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.539 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.540 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.540 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.540 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.540 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.540 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.541 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.541 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.541 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.541 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.541 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.542 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.542 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.542 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.542 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.542 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.543 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.543 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.543 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.543 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.543 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.543 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.544 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.544 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.544 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.544 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.544 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.545 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.545 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.545 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.545 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.545 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.545 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "status", 2023-10-16T13:15:07.546 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.546 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.546 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.546 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.546 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.547 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.547 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.547 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.547 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.547 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.548 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.548 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.548 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.548 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.548 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.549 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.549 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.549 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.549 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.549 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.549 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.550 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.550 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.550 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.550 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.551 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.551 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.551 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.551 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.551 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.551 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.552 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.552 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.552 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.552 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.552 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.553 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.553 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.553 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.553 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.553 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.554 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.554 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.554 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.554 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.554 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.555 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.555 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.555 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.555 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.555 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.555 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.556 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.556 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.556 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.556 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.556 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.557 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.557 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.557 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.557 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.557 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.558 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.558 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.558 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.558 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.558 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.559 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.559 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.559 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.559 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.559 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.560 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.560 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.560 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.560 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.560 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telegraf", 2023-10-16T13:15:07.560 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.561 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.561 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.561 INFO:teuthology.orchestra.run.smithi092.stdout: "address": { 2023-10-16T13:15:07.561 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "address", 2023-10-16T13:15:07.561 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.562 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.562 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.562 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-16T13:15:07.562 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.562 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.563 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.563 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.563 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.563 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.563 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.563 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.564 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2023-10-16T13:15:07.564 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2023-10-16T13:15:07.564 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.564 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.565 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.565 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15", 2023-10-16T13:15:07.565 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.565 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.566 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.566 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.566 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.566 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.566 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.566 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.567 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.567 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.567 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.567 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.567 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.568 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.568 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.568 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.568 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.568 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.569 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.569 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.569 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.569 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.569 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.570 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.570 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.570 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.570 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.570 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.570 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.571 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.571 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.571 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.571 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.571 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.572 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.572 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.572 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.572 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.572 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.572 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.573 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.573 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.573 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.573 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.573 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.573 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.574 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.574 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.574 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.574 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.574 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.575 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.575 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.575 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.575 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.575 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.576 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.576 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.576 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.576 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.576 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.576 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.577 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.577 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.577 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.577 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.577 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.578 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.578 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.578 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.578 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.578 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.578 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.579 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.579 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.579 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.579 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.579 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.580 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.580 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.580 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.580 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telemetry", 2023-10-16T13:15:07.580 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.580 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.581 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.581 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_basic": { 2023-10-16T13:15:07.581 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_basic", 2023-10-16T13:15:07.581 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.581 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.582 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.582 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.582 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.582 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.582 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.583 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-16T13:15:07.583 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.583 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.583 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.583 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.584 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_crash": { 2023-10-16T13:15:07.584 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_crash", 2023-10-16T13:15:07.584 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.584 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.584 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.584 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.585 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.585 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.585 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.585 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-16T13:15:07.585 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.586 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.586 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.586 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.586 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_device": { 2023-10-16T13:15:07.586 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_device", 2023-10-16T13:15:07.587 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.587 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.587 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.587 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.587 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.588 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.588 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.588 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-16T13:15:07.588 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.588 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.588 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.589 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.589 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_ident": { 2023-10-16T13:15:07.589 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_ident", 2023-10-16T13:15:07.589 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.589 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.590 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.590 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.590 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.590 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.590 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.591 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-16T13:15:07.591 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.591 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.591 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.591 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.591 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_perf": { 2023-10-16T13:15:07.592 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_perf", 2023-10-16T13:15:07.592 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.592 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.592 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.592 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.593 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.593 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.593 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.593 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-16T13:15:07.593 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.593 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.594 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.594 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.594 INFO:teuthology.orchestra.run.smithi092.stdout: "contact": { 2023-10-16T13:15:07.594 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "contact", 2023-10-16T13:15:07.594 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.595 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.595 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.595 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.595 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.595 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.596 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.596 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.596 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.596 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.596 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.596 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.597 INFO:teuthology.orchestra.run.smithi092.stdout: "description": { 2023-10-16T13:15:07.597 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "description", 2023-10-16T13:15:07.597 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.597 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.597 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.598 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.598 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.598 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.598 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.598 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.598 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.599 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.599 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.599 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.599 INFO:teuthology.orchestra.run.smithi092.stdout: "device_url": { 2023-10-16T13:15:07.599 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_url", 2023-10-16T13:15:07.599 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.600 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.600 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.600 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-16T13:15:07.600 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.600 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.601 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.601 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.601 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.601 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.601 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.602 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.602 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2023-10-16T13:15:07.602 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2023-10-16T13:15:07.602 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.602 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.602 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.603 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.603 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.603 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.603 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.603 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.604 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.604 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.604 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.604 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.604 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2023-10-16T13:15:07.604 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2023-10-16T13:15:07.605 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.605 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.605 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.605 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "24", 2023-10-16T13:15:07.605 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "8", 2023-10-16T13:15:07.606 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.606 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.606 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.606 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.606 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.607 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.607 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.607 INFO:teuthology.orchestra.run.smithi092.stdout: "last_opt_revision": { 2023-10-16T13:15:07.607 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "last_opt_revision", 2023-10-16T13:15:07.607 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.608 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.608 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.608 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1", 2023-10-16T13:15:07.608 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.608 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.608 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.609 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.609 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.609 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.609 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.609 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.610 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard": { 2023-10-16T13:15:07.610 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard", 2023-10-16T13:15:07.610 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.610 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.610 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.611 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.611 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.611 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.611 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.611 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.612 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.612 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.612 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.612 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.612 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard_description": { 2023-10-16T13:15:07.613 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard_description", 2023-10-16T13:15:07.613 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.613 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.613 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.613 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.614 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.614 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.614 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.614 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.614 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.614 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.615 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.615 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.615 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.615 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.615 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.616 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.616 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.616 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.616 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.616 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.617 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.617 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.617 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.617 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.617 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.618 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.618 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.618 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.618 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.618 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.619 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.619 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.619 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.619 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.619 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.620 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.620 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.620 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.620 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.620 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.621 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.621 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.621 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.621 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.621 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.622 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.622 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.622 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.622 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.622 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.623 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.623 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.623 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.623 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.623 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.624 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.624 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.624 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.624 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.624 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.625 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.625 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.625 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.625 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.625 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.625 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.626 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.626 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.626 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.626 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.627 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.627 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.627 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.627 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.627 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.627 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.628 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.628 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.628 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.628 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.628 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.629 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.629 INFO:teuthology.orchestra.run.smithi092.stdout: "organization": { 2023-10-16T13:15:07.629 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "organization", 2023-10-16T13:15:07.629 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.629 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.630 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.630 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.630 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.630 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.630 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.631 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.631 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.631 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.631 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.631 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.632 INFO:teuthology.orchestra.run.smithi092.stdout: "proxy": { 2023-10-16T13:15:07.632 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "proxy", 2023-10-16T13:15:07.632 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.632 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.632 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.633 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.633 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.633 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.633 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.633 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.634 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.634 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.634 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.634 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.634 INFO:teuthology.orchestra.run.smithi092.stdout: "url": { 2023-10-16T13:15:07.635 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url", 2023-10-16T13:15:07.635 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.635 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.635 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.635 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-16T13:15:07.635 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.636 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.636 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.636 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.636 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.636 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.636 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.637 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.637 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.637 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.637 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.637 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "test_orchestrator", 2023-10-16T13:15:07.638 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.638 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.638 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.638 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.638 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.638 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.639 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.639 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.639 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.639 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.639 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.639 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.640 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.640 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.640 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.640 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.640 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.641 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.641 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.641 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.641 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.641 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.641 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.642 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.642 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.642 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.642 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.642 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.643 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.643 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.643 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.643 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.643 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.643 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.644 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.644 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.644 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.644 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.644 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.645 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.645 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.645 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.645 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.645 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.645 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.646 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.646 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.646 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.646 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.646 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.646 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.647 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.647 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.647 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.647 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.647 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.648 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.648 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.648 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.648 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.648 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.648 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.649 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.649 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.649 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.649 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.649 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.649 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.650 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.650 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.650 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.650 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.650 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.651 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.651 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.651 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.651 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "volumes", 2023-10-16T13:15:07.651 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.652 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.652 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.652 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.652 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.652 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.652 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.653 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.653 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.653 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.653 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.653 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.653 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.654 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.654 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.654 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.654 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.654 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.655 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.655 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.655 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.655 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.655 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.655 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.656 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.656 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.656 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.656 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.656 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.656 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.657 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.657 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.657 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.657 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.657 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.658 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.658 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.658 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.658 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.658 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.659 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.659 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.659 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.659 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.659 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.660 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.660 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.660 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.660 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.661 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.661 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.661 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.661 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.661 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.661 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.662 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.662 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.662 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.662 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.662 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.663 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.663 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.663 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.663 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.663 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.663 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.664 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.664 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.664 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.664 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.664 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.665 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.665 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.665 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_clones": { 2023-10-16T13:15:07.665 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_clones", 2023-10-16T13:15:07.665 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.665 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.666 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.666 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4", 2023-10-16T13:15:07.666 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.666 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.666 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.666 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-16T13:15:07.667 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.667 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.667 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.667 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.667 INFO:teuthology.orchestra.run.smithi092.stdout: "periodic_async_work": { 2023-10-16T13:15:07.667 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "periodic_async_work", 2023-10-16T13:15:07.668 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.668 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.668 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.668 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.668 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.668 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.669 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.669 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Periodically check for async work", 2023-10-16T13:15:07.669 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.669 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.669 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.669 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.670 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_delay": { 2023-10-16T13:15:07.670 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_delay", 2023-10-16T13:15:07.670 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.670 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.670 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.671 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2023-10-16T13:15:07.671 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.671 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.671 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.671 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-16T13:15:07.671 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.672 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.672 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.672 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.672 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.672 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.673 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.673 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix", 2023-10-16T13:15:07.673 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.673 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.673 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.673 INFO:teuthology.orchestra.run.smithi092.stdout: "discovery_interval": { 2023-10-16T13:15:07.674 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "discovery_interval", 2023-10-16T13:15:07.674 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2023-10-16T13:15:07.674 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.674 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.674 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "100", 2023-10-16T13:15:07.674 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.675 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.675 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.675 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.675 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.675 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.676 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.676 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.676 INFO:teuthology.orchestra.run.smithi092.stdout: "identifier": { 2023-10-16T13:15:07.676 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "identifier", 2023-10-16T13:15:07.676 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.676 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.677 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.677 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.677 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.677 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.677 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.677 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.678 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.678 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.678 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.678 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.678 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2023-10-16T13:15:07.678 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2023-10-16T13:15:07.679 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.679 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.679 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.679 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2023-10-16T13:15:07.679 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.680 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.680 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.680 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.680 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.680 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.680 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.681 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.681 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.681 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.681 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.681 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.681 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.682 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.682 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.682 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.682 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.682 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.683 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.683 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.683 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.683 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.683 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.683 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.684 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.684 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.684 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.684 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.684 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.684 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.685 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.685 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.685 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.685 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.685 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.685 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.686 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.686 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.686 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.686 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.686 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.687 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.687 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.687 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.687 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.687 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.687 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.687 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.688 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.688 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.688 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.688 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.688 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.688 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.689 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.689 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.689 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.689 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.689 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.689 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.690 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.690 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.690 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.690 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.690 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.691 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.691 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.691 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.691 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.691 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.691 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.692 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.692 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.692 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.692 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.692 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.693 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.693 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.693 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_host": { 2023-10-16T13:15:07.693 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_host", 2023-10-16T13:15:07.693 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.693 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.694 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.694 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.694 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.694 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.695 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.695 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.695 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.695 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.695 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.696 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.696 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_port": { 2023-10-16T13:15:07.696 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_port", 2023-10-16T13:15:07.696 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.696 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.696 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.697 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10051", 2023-10-16T13:15:07.697 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.697 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.697 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.697 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.698 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.698 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.698 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.698 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.698 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_sender": { 2023-10-16T13:15:07.699 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_sender", 2023-10-16T13:15:07.699 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.699 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.699 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.699 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-16T13:15:07.700 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.700 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.700 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.700 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.700 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.701 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.701 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.701 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.701 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.701 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.701 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-10-16T13:15:07.702 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.702 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.702 INFO:teuthology.orchestra.run.smithi092.stdout: "gid": 24107, 2023-10-16T13:15:07.702 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "y", 2023-10-16T13:15:07.702 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr_features": 4540138322906710015, 2023-10-16T13:15:07.703 INFO:teuthology.orchestra.run.smithi092.stdout: "available_modules": [ 2023-10-16T13:15:07.703 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.703 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "alerts", 2023-10-16T13:15:07.703 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.703 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.704 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.704 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2023-10-16T13:15:07.704 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2023-10-16T13:15:07.704 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.704 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.705 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.705 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2023-10-16T13:15:07.705 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.705 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.705 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.706 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How frequently to reexamine health status", 2023-10-16T13:15:07.706 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.706 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.706 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.706 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.707 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.707 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.707 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.707 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.707 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.707 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.708 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.708 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.708 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.708 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.708 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.708 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.709 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.709 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.709 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.709 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.709 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.710 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.710 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.710 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.710 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.710 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.711 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.711 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.711 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.711 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.711 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.711 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.712 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.712 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.712 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.712 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.712 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.713 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.713 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.713 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.713 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.713 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.713 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.714 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.714 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.714 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.714 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.714 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.715 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.715 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.715 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.715 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.715 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.715 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.716 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.716 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.716 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.716 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.716 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.717 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.717 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.717 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.717 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.717 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.717 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.718 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.718 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.718 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.718 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.718 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.718 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.719 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.719 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.719 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.719 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_destination": { 2023-10-16T13:15:07.719 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_destination", 2023-10-16T13:15:07.720 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.720 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.720 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.720 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.720 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.721 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.721 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.721 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email address to send alerts to", 2023-10-16T13:15:07.721 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.721 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.722 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.722 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.722 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_from_name": { 2023-10-16T13:15:07.722 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_from_name", 2023-10-16T13:15:07.722 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.723 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.723 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.723 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "Ceph", 2023-10-16T13:15:07.723 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.723 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.723 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.724 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email From: name", 2023-10-16T13:15:07.724 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.724 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.724 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.724 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.725 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_host": { 2023-10-16T13:15:07.725 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_host", 2023-10-16T13:15:07.725 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.725 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.725 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.725 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.726 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.726 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.726 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.726 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP server", 2023-10-16T13:15:07.726 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.727 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.727 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.727 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.727 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_password": { 2023-10-16T13:15:07.727 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_password", 2023-10-16T13:15:07.728 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.728 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.728 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.728 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.728 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.728 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.729 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.729 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Password to authenticate with", 2023-10-16T13:15:07.729 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.729 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.729 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.729 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.730 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_port": { 2023-10-16T13:15:07.730 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_port", 2023-10-16T13:15:07.730 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.730 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.730 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.731 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "465", 2023-10-16T13:15:07.731 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.731 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.731 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.731 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP port", 2023-10-16T13:15:07.732 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.732 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.732 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.732 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.732 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_sender": { 2023-10-16T13:15:07.732 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_sender", 2023-10-16T13:15:07.733 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.733 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.733 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.733 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.733 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.734 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.734 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.734 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP envelope sender", 2023-10-16T13:15:07.734 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.734 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.734 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.735 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.735 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_ssl": { 2023-10-16T13:15:07.735 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_ssl", 2023-10-16T13:15:07.735 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.735 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.735 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.736 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.736 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.736 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.736 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.736 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-16T13:15:07.736 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.737 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.737 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.737 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.737 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_user": { 2023-10-16T13:15:07.737 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_user", 2023-10-16T13:15:07.737 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.738 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.738 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.738 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.738 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.738 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.739 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.739 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "User to authenticate as", 2023-10-16T13:15:07.739 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.739 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.739 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.739 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.740 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.740 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.740 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.740 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "balancer", 2023-10-16T13:15:07.740 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.740 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.741 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.741 INFO:teuthology.orchestra.run.smithi092.stdout: "active": { 2023-10-16T13:15:07.741 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "active", 2023-10-16T13:15:07.741 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.741 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.741 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.742 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.742 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.742 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.742 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.742 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically balance PGs across cluster", 2023-10-16T13:15:07.743 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.743 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.743 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.743 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.743 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_time": { 2023-10-16T13:15:07.743 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_time", 2023-10-16T13:15:07.744 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.744 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.744 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.744 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0000", 2023-10-16T13:15:07.744 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.744 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.745 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.745 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "beginning time of day to automatically balance", 2023-10-16T13:15:07.745 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-16T13:15:07.745 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.745 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.745 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.746 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_weekday": { 2023-10-16T13:15:07.746 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_weekday", 2023-10-16T13:15:07.746 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2023-10-16T13:15:07.746 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.746 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.747 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2023-10-16T13:15:07.747 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2023-10-16T13:15:07.747 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2023-10-16T13:15:07.747 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.747 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-16T13:15:07.747 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-16T13:15:07.748 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.748 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.748 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.748 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_max_iterations": { 2023-10-16T13:15:07.748 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_max_iterations", 2023-10-16T13:15:07.748 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2023-10-16T13:15:07.749 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.749 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.749 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "25", 2023-10-16T13:15:07.749 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2023-10-16T13:15:07.749 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "250", 2023-10-16T13:15:07.749 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.750 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-16T13:15:07.750 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.750 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.750 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.750 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.751 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_metrics": { 2023-10-16T13:15:07.751 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_metrics", 2023-10-16T13:15:07.751 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.751 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.751 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.752 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "pgs,objects,bytes", 2023-10-16T13:15:07.752 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.752 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.752 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.752 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-16T13:15:07.752 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-16T13:15:07.753 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.753 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.753 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.753 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_step": { 2023-10-16T13:15:07.753 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_step", 2023-10-16T13:15:07.753 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:07.754 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.754 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.754 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.5", 2023-10-16T13:15:07.754 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0.001", 2023-10-16T13:15:07.754 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "0.999", 2023-10-16T13:15:07.754 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.755 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "aggressiveness of optimization", 2023-10-16T13:15:07.755 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-16T13:15:07.755 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.755 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.755 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.756 INFO:teuthology.orchestra.run.smithi092.stdout: "end_time": { 2023-10-16T13:15:07.756 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_time", 2023-10-16T13:15:07.756 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.756 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.756 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.756 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2359", 2023-10-16T13:15:07.757 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.757 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.757 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.757 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ending time of day to automatically balance", 2023-10-16T13:15:07.757 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-16T13:15:07.757 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.758 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.758 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.758 INFO:teuthology.orchestra.run.smithi092.stdout: "end_weekday": { 2023-10-16T13:15:07.758 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_weekday", 2023-10-16T13:15:07.758 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2023-10-16T13:15:07.759 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.759 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.759 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2023-10-16T13:15:07.759 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2023-10-16T13:15:07.759 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2023-10-16T13:15:07.760 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.760 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-16T13:15:07.760 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-16T13:15:07.760 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.760 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.761 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.761 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.761 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.761 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.761 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.762 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.762 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.762 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.762 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.762 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.763 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.763 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.763 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.763 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.763 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.763 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.764 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.764 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.764 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.764 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.764 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.765 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.765 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.765 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.765 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.765 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.765 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.766 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.766 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.766 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.766 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.766 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.766 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.767 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.767 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.767 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.767 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.767 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.768 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.768 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.768 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.768 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.768 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.768 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.769 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.769 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.769 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.769 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.769 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.769 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.770 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.770 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.770 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.770 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.770 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.771 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.771 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.771 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.771 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.771 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.772 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.772 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.772 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.772 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.772 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.772 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.773 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.773 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.773 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.773 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.773 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.773 INFO:teuthology.orchestra.run.smithi092.stdout: "min_score": { 2023-10-16T13:15:07.774 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_score", 2023-10-16T13:15:07.774 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:07.774 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.774 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.775 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2023-10-16T13:15:07.775 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.775 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.775 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.775 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-16T13:15:07.775 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.776 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.776 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.776 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.776 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2023-10-16T13:15:07.776 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2023-10-16T13:15:07.777 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.777 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.777 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.777 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "upmap", 2023-10-16T13:15:07.777 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.778 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.778 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.778 INFO:teuthology.orchestra.run.smithi092.stdout: "crush-compat", 2023-10-16T13:15:07.778 INFO:teuthology.orchestra.run.smithi092.stdout: "none", 2023-10-16T13:15:07.778 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap" 2023-10-16T13:15:07.779 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.779 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Balancer mode", 2023-10-16T13:15:07.779 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.779 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.779 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.779 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.780 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_ids": { 2023-10-16T13:15:07.780 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_ids", 2023-10-16T13:15:07.780 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.780 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.780 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.781 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.781 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.781 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.781 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.781 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-16T13:15:07.782 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.782 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.782 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.782 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.782 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2023-10-16T13:15:07.783 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2023-10-16T13:15:07.783 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.783 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.783 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.783 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2023-10-16T13:15:07.784 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.784 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.784 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.784 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-16T13:15:07.784 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.784 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.785 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.785 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.785 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_deviation": { 2023-10-16T13:15:07.785 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_deviation", 2023-10-16T13:15:07.785 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.785 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.786 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.786 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2023-10-16T13:15:07.786 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2023-10-16T13:15:07.786 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.786 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.787 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-16T13:15:07.787 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-16T13:15:07.787 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.787 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.787 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.787 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_optimizations": { 2023-10-16T13:15:07.788 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_optimizations", 2023-10-16T13:15:07.788 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2023-10-16T13:15:07.788 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.788 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.788 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:07.788 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.789 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.789 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.789 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-16T13:15:07.789 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.789 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.789 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.790 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.790 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.790 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.790 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.790 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm", 2023-10-16T13:15:07.791 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.791 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.791 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.791 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_down_multiplier": { 2023-10-16T13:15:07.791 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_down_multiplier", 2023-10-16T13:15:07.792 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:07.792 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.792 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.792 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2023-10-16T13:15:07.792 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.792 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.793 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.793 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-16T13:15:07.793 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.793 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.793 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.794 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.794 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_refresh_rate": { 2023-10-16T13:15:07.794 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_refresh_rate", 2023-10-16T13:15:07.794 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.794 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.794 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.795 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "20", 2023-10-16T13:15:07.795 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.795 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.795 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.795 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-16T13:15:07.796 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.796 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.796 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.796 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.796 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_starting_port": { 2023-10-16T13:15:07.797 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_starting_port", 2023-10-16T13:15:07.797 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.797 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.797 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.798 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4721", 2023-10-16T13:15:07.798 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.798 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.798 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.798 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-16T13:15:07.799 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.799 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.799 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.799 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.799 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_ptrace": { 2023-10-16T13:15:07.800 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_ptrace", 2023-10-16T13:15:07.800 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.800 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.800 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.800 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.801 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.801 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.801 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.801 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-16T13:15:07.801 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-16T13:15:07.802 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.802 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.802 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.802 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_interval": { 2023-10-16T13:15:07.802 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_interval", 2023-10-16T13:15:07.803 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.803 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.803 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.803 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2023-10-16T13:15:07.803 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.803 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.804 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.804 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-16T13:15:07.804 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.804 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.804 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.804 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.805 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_memory_target_ratio": { 2023-10-16T13:15:07.805 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_memory_target_ratio", 2023-10-16T13:15:07.805 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:07.805 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.805 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.806 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.7", 2023-10-16T13:15:07.806 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.806 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.806 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.806 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-16T13:15:07.807 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.807 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.807 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.807 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.807 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm_log_destination": { 2023-10-16T13:15:07.807 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm_log_destination", 2023-10-16T13:15:07.808 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.808 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.808 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.808 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.808 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.808 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.809 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.809 INFO:teuthology.orchestra.run.smithi092.stdout: "file", 2023-10-16T13:15:07.809 INFO:teuthology.orchestra.run.smithi092.stdout: "file,syslog", 2023-10-16T13:15:07.809 INFO:teuthology.orchestra.run.smithi092.stdout: "syslog" 2023-10-16T13:15:07.809 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.810 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-16T13:15:07.810 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.810 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.810 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.810 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.811 INFO:teuthology.orchestra.run.smithi092.stdout: "cgroups_split": { 2023-10-16T13:15:07.811 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cgroups_split", 2023-10-16T13:15:07.811 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.811 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.811 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.811 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.812 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.812 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.812 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.812 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-16T13:15:07.812 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.812 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.813 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.813 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.813 INFO:teuthology.orchestra.run.smithi092.stdout: "config_checks_enabled": { 2023-10-16T13:15:07.813 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_checks_enabled", 2023-10-16T13:15:07.813 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.814 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.814 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.814 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.814 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.814 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.814 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.815 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-16T13:15:07.815 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.815 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.815 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.815 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.816 INFO:teuthology.orchestra.run.smithi092.stdout: "config_dashboard": { 2023-10-16T13:15:07.816 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_dashboard", 2023-10-16T13:15:07.816 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.816 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.816 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.816 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.817 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.817 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.817 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.817 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-16T13:15:07.817 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.818 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.818 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.818 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.818 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_alertmanager": { 2023-10-16T13:15:07.818 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_alertmanager", 2023-10-16T13:15:07.819 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.819 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.819 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.819 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-16T13:15:07.819 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.820 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.820 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.820 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2023-10-16T13:15:07.820 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.820 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.821 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.821 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.821 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_base": { 2023-10-16T13:15:07.821 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_base", 2023-10-16T13:15:07.821 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.821 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.822 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.822 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-16T13:15:07.822 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.822 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.822 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.823 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Container image name, without the tag", 2023-10-16T13:15:07.823 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.823 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.823 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.823 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.824 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_elasticsearch": { 2023-10-16T13:15:07.824 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_elasticsearch", 2023-10-16T13:15:07.824 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.824 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.824 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.824 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-16T13:15:07.825 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.825 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.825 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.825 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "elasticsearch container image", 2023-10-16T13:15:07.825 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.826 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.826 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.826 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.826 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_grafana": { 2023-10-16T13:15:07.826 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_grafana", 2023-10-16T13:15:07.827 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.827 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.827 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.827 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-16T13:15:07.827 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.827 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.828 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.828 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2023-10-16T13:15:07.828 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.828 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.828 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.829 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.829 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_haproxy": { 2023-10-16T13:15:07.829 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_haproxy", 2023-10-16T13:15:07.829 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.829 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.829 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.830 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-16T13:15:07.830 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.830 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.830 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.830 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "HAproxy container image", 2023-10-16T13:15:07.831 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.831 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.831 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.831 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.831 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_agent": { 2023-10-16T13:15:07.832 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_agent", 2023-10-16T13:15:07.832 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.832 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.832 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.832 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-16T13:15:07.832 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.833 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.833 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.833 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger agent container image", 2023-10-16T13:15:07.833 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.833 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.833 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.834 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.834 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_collector": { 2023-10-16T13:15:07.834 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_collector", 2023-10-16T13:15:07.834 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.834 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.835 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.835 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-16T13:15:07.835 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.835 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.835 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.835 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger collector container image", 2023-10-16T13:15:07.836 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.836 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.836 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.836 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.836 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_query": { 2023-10-16T13:15:07.836 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_query", 2023-10-16T13:15:07.837 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.837 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.837 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.837 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-16T13:15:07.837 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.837 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.838 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.838 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger query container image", 2023-10-16T13:15:07.838 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.838 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.839 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.839 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.839 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_keepalived": { 2023-10-16T13:15:07.839 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_keepalived", 2023-10-16T13:15:07.839 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.839 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.840 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.840 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-16T13:15:07.840 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.840 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.841 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.841 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Keepalived container image", 2023-10-16T13:15:07.841 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.841 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.841 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.841 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.842 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_loki": { 2023-10-16T13:15:07.842 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_loki", 2023-10-16T13:15:07.842 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.842 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.842 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.843 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-16T13:15:07.843 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.843 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.843 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.843 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Loki container image", 2023-10-16T13:15:07.844 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.844 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.844 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.844 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.844 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_node_exporter": { 2023-10-16T13:15:07.845 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_node_exporter", 2023-10-16T13:15:07.845 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.845 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.845 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.845 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-16T13:15:07.846 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.846 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.846 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.846 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2023-10-16T13:15:07.846 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.846 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.847 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.847 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.847 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_nvmeof": { 2023-10-16T13:15:07.847 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_nvmeof", 2023-10-16T13:15:07.847 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.847 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.848 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.848 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-16T13:15:07.848 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.848 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.848 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.849 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Nvme-of container image", 2023-10-16T13:15:07.849 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.849 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.849 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.849 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.849 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_prometheus": { 2023-10-16T13:15:07.850 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_prometheus", 2023-10-16T13:15:07.850 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.850 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.850 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.850 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-16T13:15:07.851 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.851 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.851 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.851 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2023-10-16T13:15:07.851 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.851 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.852 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.852 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.852 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_promtail": { 2023-10-16T13:15:07.852 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_promtail", 2023-10-16T13:15:07.852 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.853 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.853 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.853 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-16T13:15:07.853 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.853 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.853 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.854 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Promtail container image", 2023-10-16T13:15:07.854 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.854 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.854 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.854 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.855 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_snmp_gateway": { 2023-10-16T13:15:07.855 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_snmp_gateway", 2023-10-16T13:15:07.855 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.855 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.855 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.855 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-16T13:15:07.856 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.856 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.856 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.856 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SNMP Gateway container image", 2023-10-16T13:15:07.856 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.856 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.857 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.857 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.857 INFO:teuthology.orchestra.run.smithi092.stdout: "container_init": { 2023-10-16T13:15:07.857 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_init", 2023-10-16T13:15:07.857 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.858 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.858 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.858 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.858 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.858 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.858 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.859 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Run podman/docker with `--init`", 2023-10-16T13:15:07.859 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.859 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.859 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.859 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.860 INFO:teuthology.orchestra.run.smithi092.stdout: "daemon_cache_timeout": { 2023-10-16T13:15:07.860 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "daemon_cache_timeout", 2023-10-16T13:15:07.860 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.860 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.860 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.860 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2023-10-16T13:15:07.861 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.861 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.861 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.861 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-16T13:15:07.861 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.862 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.862 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.862 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.862 INFO:teuthology.orchestra.run.smithi092.stdout: "default_cephadm_command_timeout": { 2023-10-16T13:15:07.862 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_cephadm_command_timeout", 2023-10-16T13:15:07.863 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.863 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.863 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.863 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "900", 2023-10-16T13:15:07.863 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.864 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.864 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.864 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-16T13:15:07.864 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.864 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.865 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.865 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.865 INFO:teuthology.orchestra.run.smithi092.stdout: "default_registry": { 2023-10-16T13:15:07.865 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_registry", 2023-10-16T13:15:07.865 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.865 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.866 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.866 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io", 2023-10-16T13:15:07.866 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.866 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.866 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.867 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-16T13:15:07.867 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.867 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.867 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.867 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.868 INFO:teuthology.orchestra.run.smithi092.stdout: "device_cache_timeout": { 2023-10-16T13:15:07.868 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_cache_timeout", 2023-10-16T13:15:07.868 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.868 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.868 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.868 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1800", 2023-10-16T13:15:07.869 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.869 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.869 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.869 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache device inventory", 2023-10-16T13:15:07.869 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.870 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.870 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.870 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.870 INFO:teuthology.orchestra.run.smithi092.stdout: "device_enhanced_scan": { 2023-10-16T13:15:07.870 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_enhanced_scan", 2023-10-16T13:15:07.871 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.871 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.871 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.871 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.871 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.871 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.872 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.872 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-16T13:15:07.872 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.872 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.872 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.873 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.873 INFO:teuthology.orchestra.run.smithi092.stdout: "facts_cache_timeout": { 2023-10-16T13:15:07.873 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "facts_cache_timeout", 2023-10-16T13:15:07.873 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.873 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.874 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.874 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2023-10-16T13:15:07.874 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.874 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.875 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.875 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache host facts data", 2023-10-16T13:15:07.875 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.875 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.876 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.876 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.876 INFO:teuthology.orchestra.run.smithi092.stdout: "host_check_interval": { 2023-10-16T13:15:07.876 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "host_check_interval", 2023-10-16T13:15:07.876 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.877 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.877 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.877 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2023-10-16T13:15:07.877 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.877 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.877 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.878 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to perform a host check", 2023-10-16T13:15:07.878 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.878 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.878 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.878 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.879 INFO:teuthology.orchestra.run.smithi092.stdout: "inventory_list_all": { 2023-10-16T13:15:07.879 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "inventory_list_all", 2023-10-16T13:15:07.879 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.879 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.879 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.879 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.880 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.880 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.880 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.880 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-16T13:15:07.880 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.881 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.881 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.881 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.881 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.882 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.882 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.882 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.882 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.882 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.882 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.883 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.883 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.883 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.883 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.883 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.884 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.884 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.884 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.884 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.884 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.884 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.885 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.885 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.885 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.885 INFO:teuthology.orchestra.run.smithi092.stdout: "log_refresh_metadata": { 2023-10-16T13:15:07.885 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_refresh_metadata", 2023-10-16T13:15:07.886 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.886 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.886 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.886 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.886 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.887 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.887 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.887 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-16T13:15:07.887 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.887 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.888 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.888 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.888 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.888 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.888 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.888 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.888 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.889 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.889 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.889 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.889 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.889 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-16T13:15:07.890 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.890 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.890 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.890 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.890 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.891 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.891 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.891 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.891 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.891 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.892 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.892 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.892 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.892 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.892 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.893 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.893 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.893 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.893 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.893 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.893 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.894 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.894 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.894 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.894 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.894 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.895 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.895 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.895 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.895 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.895 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.895 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.896 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.896 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.896 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.896 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.896 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.897 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.897 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.897 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-16T13:15:07.897 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-16T13:15:07.897 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.897 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.898 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.898 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.898 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.898 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.898 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.899 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-16T13:15:07.899 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.899 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.899 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.899 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.899 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-16T13:15:07.900 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-16T13:15:07.900 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.900 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.900 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.900 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "*", 2023-10-16T13:15:07.901 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.901 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.901 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.901 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-16T13:15:07.901 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.902 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.902 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.902 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.902 INFO:teuthology.orchestra.run.smithi092.stdout: "max_count_per_host": { 2023-10-16T13:15:07.903 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_count_per_host", 2023-10-16T13:15:07.903 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.903 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.903 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.903 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:07.904 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.904 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.904 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.904 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of daemons per service per host", 2023-10-16T13:15:07.904 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.904 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.905 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.905 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.905 INFO:teuthology.orchestra.run.smithi092.stdout: "max_osd_draining_count": { 2023-10-16T13:15:07.905 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_osd_draining_count", 2023-10-16T13:15:07.905 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.906 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.906 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.906 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:07.906 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.906 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.906 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.907 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-16T13:15:07.907 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.907 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.907 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.907 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.908 INFO:teuthology.orchestra.run.smithi092.stdout: "migration_current": { 2023-10-16T13:15:07.908 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "migration_current", 2023-10-16T13:15:07.908 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.908 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.908 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.908 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.909 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.909 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.909 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.909 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "internal - do not modify", 2023-10-16T13:15:07.909 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.909 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.910 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.910 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.910 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2023-10-16T13:15:07.910 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2023-10-16T13:15:07.910 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.911 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.911 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.911 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "root", 2023-10-16T13:15:07.911 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.911 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.912 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.912 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm-package", 2023-10-16T13:15:07.912 INFO:teuthology.orchestra.run.smithi092.stdout: "root" 2023-10-16T13:15:07.912 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.912 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "mode for remote execution of cephadm", 2023-10-16T13:15:07.912 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.913 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.913 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.913 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.913 INFO:teuthology.orchestra.run.smithi092.stdout: "prometheus_alerts_path": { 2023-10-16T13:15:07.913 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus_alerts_path", 2023-10-16T13:15:07.913 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.914 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.914 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.914 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-16T13:15:07.914 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.914 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.915 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.915 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-16T13:15:07.915 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.915 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.915 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.916 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.916 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_insecure": { 2023-10-16T13:15:07.916 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_insecure", 2023-10-16T13:15:07.916 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.916 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.916 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.917 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.917 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.917 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.917 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.917 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-16T13:15:07.918 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.918 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.918 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.918 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.918 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_password": { 2023-10-16T13:15:07.918 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_password", 2023-10-16T13:15:07.919 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.919 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.919 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.919 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.919 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.920 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.920 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.920 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-16T13:15:07.920 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.920 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.920 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.921 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.921 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_url": { 2023-10-16T13:15:07.921 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_url", 2023-10-16T13:15:07.921 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.921 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.922 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.922 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.922 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.922 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.922 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.923 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-16T13:15:07.923 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.923 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.923 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.923 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.923 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_username": { 2023-10-16T13:15:07.924 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_username", 2023-10-16T13:15:07.924 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.924 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.924 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.924 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.925 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.925 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.925 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.925 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-16T13:15:07.925 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.925 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.926 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.926 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.926 INFO:teuthology.orchestra.run.smithi092.stdout: "secure_monitoring_stack": { 2023-10-16T13:15:07.926 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "secure_monitoring_stack", 2023-10-16T13:15:07.926 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.927 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.927 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.927 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.927 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.927 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.927 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.928 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-16T13:15:07.928 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.928 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.928 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.928 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.929 INFO:teuthology.orchestra.run.smithi092.stdout: "service_discovery_port": { 2023-10-16T13:15:07.929 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "service_discovery_port", 2023-10-16T13:15:07.929 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.929 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.929 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.929 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8765", 2023-10-16T13:15:07.930 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.930 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.930 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.930 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "cephadm service discovery port", 2023-10-16T13:15:07.930 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.931 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.931 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.931 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.931 INFO:teuthology.orchestra.run.smithi092.stdout: "ssh_config_file": { 2023-10-16T13:15:07.931 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssh_config_file", 2023-10-16T13:15:07.932 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.932 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.932 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.932 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.932 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.932 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.933 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.933 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-16T13:15:07.933 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.933 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.933 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.933 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.934 INFO:teuthology.orchestra.run.smithi092.stdout: "use_agent": { 2023-10-16T13:15:07.934 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_agent", 2023-10-16T13:15:07.934 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.934 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.934 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.935 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.935 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.935 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.935 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.935 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-16T13:15:07.936 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.936 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.936 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.936 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.936 INFO:teuthology.orchestra.run.smithi092.stdout: "use_repo_digest": { 2023-10-16T13:15:07.937 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_repo_digest", 2023-10-16T13:15:07.937 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.937 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.937 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.937 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.937 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.938 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.938 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.938 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-16T13:15:07.938 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.938 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.939 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.939 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.939 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_failed_host_check": { 2023-10-16T13:15:07.939 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_failed_host_check", 2023-10-16T13:15:07.939 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.939 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.940 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.940 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.940 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.940 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.940 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.941 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if the host check fails", 2023-10-16T13:15:07.941 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.941 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.941 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.942 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.942 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_daemons": { 2023-10-16T13:15:07.942 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_daemons", 2023-10-16T13:15:07.942 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.942 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.943 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.943 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.943 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.943 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.943 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.943 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-16T13:15:07.944 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.944 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.944 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.944 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.944 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_hosts": { 2023-10-16T13:15:07.945 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_hosts", 2023-10-16T13:15:07.945 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.945 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.945 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.945 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.945 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.946 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.946 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.946 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-16T13:15:07.946 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.946 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.947 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.947 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.947 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.947 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.947 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.948 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crash", 2023-10-16T13:15:07.948 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.948 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.948 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.948 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:07.948 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:07.949 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.949 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.949 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.949 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.949 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.950 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.950 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.950 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.950 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.950 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.950 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.951 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.951 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.951 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.951 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.951 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.952 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.952 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.952 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.952 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:07.952 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:07.953 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.953 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.953 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.953 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.953 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.953 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.954 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.954 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.954 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.954 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.954 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.955 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.955 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:07.955 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:07.955 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.955 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.955 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.956 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:07.956 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.956 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.956 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:07.956 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:07.957 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:07.957 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:07.957 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:07.957 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:07.957 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:07.958 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:07.958 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.958 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.958 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.958 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.959 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.959 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:07.959 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:07.959 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.959 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.960 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.960 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.960 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.960 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.960 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.961 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.961 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.961 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.961 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.962 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.962 INFO:teuthology.orchestra.run.smithi092.stdout: "retain_interval": { 2023-10-16T13:15:07.962 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retain_interval", 2023-10-16T13:15:07.962 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.962 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.963 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.963 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "31536000", 2023-10-16T13:15:07.963 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.963 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.963 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.964 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-16T13:15:07.964 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.964 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.964 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.964 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.964 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_recent_interval": { 2023-10-16T13:15:07.965 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_recent_interval", 2023-10-16T13:15:07.965 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:07.965 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.965 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:07.966 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1209600", 2023-10-16T13:15:07.966 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.966 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.966 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.966 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-16T13:15:07.966 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.967 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.967 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.967 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.967 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:07.967 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.968 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:07.968 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dashboard", 2023-10-16T13:15:07.968 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:07.968 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:07.968 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:07.969 INFO:teuthology.orchestra.run.smithi092.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-16T13:15:07.969 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-16T13:15:07.969 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:07.969 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.970 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.970 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:07.970 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.970 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.970 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.971 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.971 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.971 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.971 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.971 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.972 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_HOST": { 2023-10-16T13:15:07.972 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-16T13:15:07.972 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:07.972 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.972 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.973 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:07.973 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.973 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.973 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.974 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.974 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.974 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.974 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.974 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.975 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-16T13:15:07.975 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-16T13:15:07.975 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.975 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.975 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.976 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.976 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.976 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.976 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.976 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.976 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.977 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.977 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.977 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.977 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_ENABLED": { 2023-10-16T13:15:07.977 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_ENABLED", 2023-10-16T13:15:07.978 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.978 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.978 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.978 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:07.978 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.979 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.979 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.979 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.979 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.979 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.979 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.980 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.980 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-16T13:15:07.980 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-16T13:15:07.980 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.980 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.980 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.981 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.981 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.981 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.981 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.981 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.982 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.982 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.982 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.982 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.982 INFO:teuthology.orchestra.run.smithi092.stdout: "ENABLE_BROWSABLE_API": { 2023-10-16T13:15:07.983 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-16T13:15:07.983 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.983 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.983 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.983 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.984 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.984 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.984 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.984 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.984 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.985 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.985 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.985 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.985 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-16T13:15:07.985 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-16T13:15:07.986 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.986 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.986 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.986 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.986 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.987 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.987 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.987 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.987 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.987 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.987 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.988 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.988 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-16T13:15:07.988 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-16T13:15:07.988 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.988 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.989 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.989 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.989 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.989 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.989 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.989 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.990 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.990 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.990 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.990 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.991 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-16T13:15:07.991 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-16T13:15:07.991 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.991 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.991 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.991 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.992 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.992 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.992 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.992 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.992 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.993 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.993 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.993 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.993 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-16T13:15:07.993 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-16T13:15:07.994 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.994 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.994 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.994 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.994 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.995 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.995 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.995 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.995 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.995 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.996 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.996 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.996 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-16T13:15:07.996 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-16T13:15:07.996 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.997 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.997 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.997 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:07.997 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:07.997 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:07.997 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:07.998 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:07.998 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:07.998 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:07.998 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:07.998 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:07.999 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-16T13:15:07.999 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-16T13:15:07.999 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:07.999 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:07.999 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:07.999 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.000 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.000 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.000 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.000 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.000 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.001 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.001 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.001 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.001 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-16T13:15:08.001 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-16T13:15:08.002 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.002 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.002 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.002 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.002 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.003 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.003 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.003 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.003 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.003 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.003 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.004 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.004 INFO:teuthology.orchestra.run.smithi092.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-16T13:15:08.004 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-16T13:15:08.004 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.004 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.004 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.005 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.005 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.005 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.005 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.005 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.006 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.006 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.006 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.006 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.006 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_PASSWORD": { 2023-10-16T13:15:08.006 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-16T13:15:08.007 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.007 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.007 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.007 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2023-10-16T13:15:08.007 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.007 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.008 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.008 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.008 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.008 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.008 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.009 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.009 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-16T13:15:08.009 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-16T13:15:08.009 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.009 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.009 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.010 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.010 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.010 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.010 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.010 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.011 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.011 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.011 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.011 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.011 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_URL": { 2023-10-16T13:15:08.012 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_URL", 2023-10-16T13:15:08.012 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.012 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.012 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.012 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.012 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.013 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.013 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.013 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.013 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.013 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.013 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.014 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.014 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_USERNAME": { 2023-10-16T13:15:08.014 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-16T13:15:08.014 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.014 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.015 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.015 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2023-10-16T13:15:08.015 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.015 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.015 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.016 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.016 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.016 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.016 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.016 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.017 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-16T13:15:08.017 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-16T13:15:08.017 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.017 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.017 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.017 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.018 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.018 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.018 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.018 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.019 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.019 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.019 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.019 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.019 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-16T13:15:08.019 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-16T13:15:08.020 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.020 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.020 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.020 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.020 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.021 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.021 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.021 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.021 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.021 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.022 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.022 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.022 INFO:teuthology.orchestra.run.smithi092.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-16T13:15:08.022 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-16T13:15:08.022 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.023 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.023 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.023 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.023 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.023 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.024 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.024 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.024 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.024 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.024 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.025 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.025 INFO:teuthology.orchestra.run.smithi092.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-16T13:15:08.025 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-16T13:15:08.025 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.025 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.026 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.026 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.026 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.026 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.026 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.026 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.027 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.027 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.027 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.027 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.027 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_HOST": { 2023-10-16T13:15:08.028 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-16T13:15:08.028 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.028 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.028 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.028 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.029 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.029 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.029 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.029 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.029 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.029 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.030 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.030 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.030 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-16T13:15:08.030 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-16T13:15:08.030 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.031 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.031 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.031 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.031 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.031 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.032 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.032 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.032 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.032 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.032 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.032 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.033 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-16T13:15:08.033 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-16T13:15:08.033 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.033 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.033 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.033 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.034 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.034 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.034 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.034 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.034 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.035 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.035 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.035 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.035 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-16T13:15:08.035 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-16T13:15:08.035 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.036 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.036 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.036 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.036 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.036 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.036 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.037 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.037 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.037 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.037 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.037 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.038 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-16T13:15:08.038 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-16T13:15:08.038 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.038 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.038 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.039 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.039 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.039 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.039 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.039 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.040 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.040 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.040 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.040 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.040 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-16T13:15:08.040 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-16T13:15:08.041 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.041 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.041 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.041 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.041 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.042 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.042 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.042 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.042 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.042 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.042 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.043 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.043 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-16T13:15:08.043 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-16T13:15:08.043 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.043 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.043 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.044 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.044 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.044 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.044 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.044 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.045 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.045 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.045 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.045 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.045 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-16T13:15:08.046 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-16T13:15:08.046 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.046 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.046 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.046 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.047 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.047 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.047 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.047 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.047 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.048 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.048 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.048 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.048 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-16T13:15:08.048 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-16T13:15:08.049 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.049 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.049 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.049 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.049 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.049 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.050 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.050 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.050 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.050 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.051 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.051 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.051 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_ENABLED": { 2023-10-16T13:15:08.051 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-16T13:15:08.051 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.052 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.052 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.052 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.052 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.052 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.053 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.053 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.053 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.053 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.053 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.054 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.054 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-16T13:15:08.054 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-16T13:15:08.054 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.054 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.055 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.055 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-16T13:15:08.055 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.055 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.055 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.055 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.056 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.056 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.056 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.056 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.056 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-16T13:15:08.057 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-16T13:15:08.057 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.057 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.057 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.057 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:08.058 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.058 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.058 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.058 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.058 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.059 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.059 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.059 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.059 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-16T13:15:08.059 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-16T13:15:08.060 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.060 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.060 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.060 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8", 2023-10-16T13:15:08.060 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.060 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.061 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.061 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.061 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.061 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.062 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.062 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.062 INFO:teuthology.orchestra.run.smithi092.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-16T13:15:08.062 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-16T13:15:08.062 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.063 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.063 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.063 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "45", 2023-10-16T13:15:08.063 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.063 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.064 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.064 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.064 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.064 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.064 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.065 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.065 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ACCESS_KEY": { 2023-10-16T13:15:08.065 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-16T13:15:08.065 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.065 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.066 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.066 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.066 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.066 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.067 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.067 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.067 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.067 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.067 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.068 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.068 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-16T13:15:08.068 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-16T13:15:08.068 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.068 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.068 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.069 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2023-10-16T13:15:08.069 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.069 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.069 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.069 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.070 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.070 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.070 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.070 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.070 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SECRET_KEY": { 2023-10-16T13:15:08.071 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-16T13:15:08.071 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.071 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.071 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.071 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.071 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.072 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.072 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.072 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.072 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.072 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.072 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.073 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.073 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SSL_VERIFY": { 2023-10-16T13:15:08.073 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-16T13:15:08.073 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.073 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.074 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.074 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.074 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.074 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.074 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.075 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.075 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.075 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.075 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.075 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.076 INFO:teuthology.orchestra.run.smithi092.stdout: "UNSAFE_TLS_v1_2": { 2023-10-16T13:15:08.076 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-16T13:15:08.076 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.076 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.076 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.077 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.077 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.077 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.077 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.077 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.077 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.078 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.078 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.078 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.078 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-16T13:15:08.079 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-16T13:15:08.079 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.079 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.079 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.079 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2023-10-16T13:15:08.079 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.080 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.080 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.080 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.080 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.080 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.081 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.081 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.081 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-16T13:15:08.081 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-16T13:15:08.081 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.081 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.082 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.082 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:08.082 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.082 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.082 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.083 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.083 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.083 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.083 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.083 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.083 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-16T13:15:08.084 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-16T13:15:08.084 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.084 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.084 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.084 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2023-10-16T13:15:08.085 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.085 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.085 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.085 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.085 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.085 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.086 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.086 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.086 INFO:teuthology.orchestra.run.smithi092.stdout: "cross_origin_url": { 2023-10-16T13:15:08.086 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cross_origin_url", 2023-10-16T13:15:08.086 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.087 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.087 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.087 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.087 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.087 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.087 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.088 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.088 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.088 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.088 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.088 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.088 INFO:teuthology.orchestra.run.smithi092.stdout: "crt_file": { 2023-10-16T13:15:08.089 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crt_file", 2023-10-16T13:15:08.089 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.089 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.089 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.089 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.089 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.090 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.090 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.090 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.090 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.090 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.091 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.091 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.091 INFO:teuthology.orchestra.run.smithi092.stdout: "debug": { 2023-10-16T13:15:08.091 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "debug", 2023-10-16T13:15:08.091 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.092 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.092 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.092 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.092 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.092 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.092 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.093 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable/disable debug options", 2023-10-16T13:15:08.093 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.093 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.093 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.093 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.093 INFO:teuthology.orchestra.run.smithi092.stdout: "jwt_token_ttl": { 2023-10-16T13:15:08.094 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "jwt_token_ttl", 2023-10-16T13:15:08.094 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.094 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.094 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.094 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "28800", 2023-10-16T13:15:08.095 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.095 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.095 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.095 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.095 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.095 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.096 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.096 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.096 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2023-10-16T13:15:08.096 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2023-10-16T13:15:08.096 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.096 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.097 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.097 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.097 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.097 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.097 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.098 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.098 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.098 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.098 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.098 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.098 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.099 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.099 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.099 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.099 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.099 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.099 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.100 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.100 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.100 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.100 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.100 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.100 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.101 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.101 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.101 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.101 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.101 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.102 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.102 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.102 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.102 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.102 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.102 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.103 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.103 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.103 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.103 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.103 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.104 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.104 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.104 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.104 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.104 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.104 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.105 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.105 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.105 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.105 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.105 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.106 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.106 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.106 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.106 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.106 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.107 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.107 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.107 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.107 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.108 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.108 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.108 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.108 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.108 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.109 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.109 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.109 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.109 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.109 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.110 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.110 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.110 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.110 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.111 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.111 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.111 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.111 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.111 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.112 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.112 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.112 INFO:teuthology.orchestra.run.smithi092.stdout: "motd": { 2023-10-16T13:15:08.112 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "motd", 2023-10-16T13:15:08.112 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.113 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.113 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.113 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.113 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.113 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.114 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.114 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "The message of the day", 2023-10-16T13:15:08.114 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.114 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.114 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.115 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.115 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect_resolve_ip_addr": { 2023-10-16T13:15:08.115 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "redirect_resolve_ip_addr", 2023-10-16T13:15:08.115 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.115 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.116 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.116 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.116 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.116 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.116 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.116 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.117 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.117 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.117 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.117 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.117 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2023-10-16T13:15:08.117 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2023-10-16T13:15:08.118 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.118 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.118 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.118 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2023-10-16T13:15:08.118 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.119 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.119 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.119 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.119 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.119 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.121 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.121 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.121 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2023-10-16T13:15:08.121 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2023-10-16T13:15:08.122 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.122 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.122 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.122 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8080", 2023-10-16T13:15:08.122 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.123 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.123 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.123 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.123 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.123 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.123 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.124 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.124 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2023-10-16T13:15:08.124 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2023-10-16T13:15:08.124 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.124 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.124 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.125 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.125 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.125 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.125 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.125 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.125 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.126 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.126 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.126 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.126 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl_server_port": { 2023-10-16T13:15:08.126 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl_server_port", 2023-10-16T13:15:08.127 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.127 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.127 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.127 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8443", 2023-10-16T13:15:08.127 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.127 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.128 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.128 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.128 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.128 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.128 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.129 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.129 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2023-10-16T13:15:08.129 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2023-10-16T13:15:08.129 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.129 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.129 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.130 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "redirect", 2023-10-16T13:15:08.130 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.130 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.131 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.131 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.131 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect" 2023-10-16T13:15:08.131 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.131 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.131 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.132 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.132 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.132 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.132 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2023-10-16T13:15:08.132 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2023-10-16T13:15:08.132 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.133 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.133 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.133 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2023-10-16T13:15:08.133 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2023-10-16T13:15:08.133 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2023-10-16T13:15:08.133 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.134 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.134 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.134 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.134 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.134 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.135 INFO:teuthology.orchestra.run.smithi092.stdout: "url_prefix": { 2023-10-16T13:15:08.135 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url_prefix", 2023-10-16T13:15:08.135 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.135 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.135 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.135 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.136 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.136 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.136 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.136 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.136 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.137 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.137 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.137 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.137 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.137 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.138 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.138 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "devicehealth", 2023-10-16T13:15:08.138 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.138 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.138 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.139 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_monitoring": { 2023-10-16T13:15:08.139 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_monitoring", 2023-10-16T13:15:08.139 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.139 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.139 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.140 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.140 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.140 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.140 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.140 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "monitor device health metrics", 2023-10-16T13:15:08.140 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.141 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.141 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.141 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.141 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.141 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.142 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.142 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.142 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.142 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.142 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.142 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.143 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.143 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.143 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.143 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.143 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.144 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.144 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.144 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.144 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.144 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.145 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.145 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.145 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.145 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.145 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.146 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.146 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.146 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.146 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.146 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.146 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.147 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.147 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.147 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.147 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.147 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.148 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.148 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.148 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.148 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.148 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.149 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.149 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.149 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.149 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.149 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.150 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.150 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.150 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.150 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.150 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.151 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.151 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.151 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.151 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.151 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.152 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.152 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.152 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.152 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.152 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.152 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.153 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.153 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.153 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.153 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.153 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.154 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.154 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.154 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.154 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.154 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.155 INFO:teuthology.orchestra.run.smithi092.stdout: "mark_out_threshold": { 2023-10-16T13:15:08.155 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mark_out_threshold", 2023-10-16T13:15:08.155 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:08.155 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.155 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.155 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2419200", 2023-10-16T13:15:08.156 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.156 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.156 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.156 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-16T13:15:08.156 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.156 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.157 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.157 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.157 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_name": { 2023-10-16T13:15:08.157 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_name", 2023-10-16T13:15:08.157 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.158 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.158 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.158 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "device_health_metrics", 2023-10-16T13:15:08.158 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.158 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.159 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.159 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-16T13:15:08.159 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.159 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.159 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.160 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.160 INFO:teuthology.orchestra.run.smithi092.stdout: "retention_period": { 2023-10-16T13:15:08.160 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retention_period", 2023-10-16T13:15:08.160 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:08.160 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.161 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.161 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15552000", 2023-10-16T13:15:08.161 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.161 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.161 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.161 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain device health metrics", 2023-10-16T13:15:08.162 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.162 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.162 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.162 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.162 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_frequency": { 2023-10-16T13:15:08.163 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_frequency", 2023-10-16T13:15:08.163 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:08.163 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.163 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.163 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2023-10-16T13:15:08.164 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.164 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.164 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.164 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-16T13:15:08.164 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.164 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.165 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.165 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.165 INFO:teuthology.orchestra.run.smithi092.stdout: "self_heal": { 2023-10-16T13:15:08.165 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "self_heal", 2023-10-16T13:15:08.165 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.165 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.166 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.166 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.166 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.166 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.166 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.166 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-16T13:15:08.167 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.167 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.167 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.167 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.167 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2023-10-16T13:15:08.167 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2023-10-16T13:15:08.168 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:08.168 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.168 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.168 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2023-10-16T13:15:08.169 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.169 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.169 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.169 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and check device health", 2023-10-16T13:15:08.169 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.169 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.170 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.170 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.170 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_threshold": { 2023-10-16T13:15:08.170 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_threshold", 2023-10-16T13:15:08.170 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:08.171 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.171 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.171 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7257600", 2023-10-16T13:15:08.171 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.171 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.171 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.172 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-16T13:15:08.172 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.172 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.172 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.172 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.173 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.173 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.173 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.173 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "diskprediction_local", 2023-10-16T13:15:08.173 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.173 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.174 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.174 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.174 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.174 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.174 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.174 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.175 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.175 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.175 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.175 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.175 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.175 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.176 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.176 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.176 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.176 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.176 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.176 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.177 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.177 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.177 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.177 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.177 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.177 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.178 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.178 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.178 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.178 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.178 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.178 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.179 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.179 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.179 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.179 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.179 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.180 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.180 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.180 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.180 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.180 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.180 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.181 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.181 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.181 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.181 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.181 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.181 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.182 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.182 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.182 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.182 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.182 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.182 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.183 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.183 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.183 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.183 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.183 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.184 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.184 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.184 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.184 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.184 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.185 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.185 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.185 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.185 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.185 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.186 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.186 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.186 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.186 INFO:teuthology.orchestra.run.smithi092.stdout: "predict_interval": { 2023-10-16T13:15:08.186 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predict_interval", 2023-10-16T13:15:08.186 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.187 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.187 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.187 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2023-10-16T13:15:08.187 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.187 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.188 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.188 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.188 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.188 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.188 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.188 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.189 INFO:teuthology.orchestra.run.smithi092.stdout: "predictor_model": { 2023-10-16T13:15:08.189 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predictor_model", 2023-10-16T13:15:08.189 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.189 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.189 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.190 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "prophetstor", 2023-10-16T13:15:08.190 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.190 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.190 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.190 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.191 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.191 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.191 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.191 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.191 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2023-10-16T13:15:08.191 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2023-10-16T13:15:08.192 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.192 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.192 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.192 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2023-10-16T13:15:08.192 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.192 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.193 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.193 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.193 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.193 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.193 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.194 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.194 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.194 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.194 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.194 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "influx", 2023-10-16T13:15:08.195 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": false, 2023-10-16T13:15:08.195 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "influxdb python module not found", 2023-10-16T13:15:08.195 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.195 INFO:teuthology.orchestra.run.smithi092.stdout: "batch_size": { 2023-10-16T13:15:08.195 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "batch_size", 2023-10-16T13:15:08.195 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.196 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.196 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.196 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5000", 2023-10-16T13:15:08.196 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.196 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.197 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.197 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-16T13:15:08.197 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.197 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.197 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.198 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.198 INFO:teuthology.orchestra.run.smithi092.stdout: "database": { 2023-10-16T13:15:08.198 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "database", 2023-10-16T13:15:08.198 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.198 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.199 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.199 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "ceph", 2023-10-16T13:15:08.199 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.199 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.199 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.200 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-16T13:15:08.200 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.200 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.200 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.200 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.201 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": { 2023-10-16T13:15:08.201 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hostname", 2023-10-16T13:15:08.201 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.201 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.201 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.201 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.202 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.202 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.202 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.202 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server hostname", 2023-10-16T13:15:08.202 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.203 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.203 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.203 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.203 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2023-10-16T13:15:08.203 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2023-10-16T13:15:08.203 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:08.204 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.204 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.204 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "30", 2023-10-16T13:15:08.204 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "5", 2023-10-16T13:15:08.204 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.205 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.205 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-16T13:15:08.205 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.205 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.205 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.205 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.206 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.206 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.206 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.206 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.206 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.207 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.207 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.207 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.207 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.207 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.207 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.208 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.208 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.208 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.208 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.208 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.208 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.209 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.209 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.209 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.209 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.209 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.209 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.210 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.210 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.210 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.210 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.210 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.210 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.211 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.211 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.211 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.211 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.211 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.212 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.212 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.212 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.212 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.212 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.212 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.213 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.213 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.213 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.213 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.213 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.213 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.213 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.214 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.214 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.214 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.214 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.214 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.215 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.215 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.215 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.215 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.215 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.215 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.216 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.216 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.216 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.216 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.216 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.217 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.217 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.217 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.217 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.217 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.217 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.218 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.218 INFO:teuthology.orchestra.run.smithi092.stdout: "password": { 2023-10-16T13:15:08.218 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "password", 2023-10-16T13:15:08.218 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.218 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.219 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.219 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.219 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.219 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.219 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.219 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "password of InfluxDB server user", 2023-10-16T13:15:08.220 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.220 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.220 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.220 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.220 INFO:teuthology.orchestra.run.smithi092.stdout: "port": { 2023-10-16T13:15:08.220 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "port", 2023-10-16T13:15:08.221 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.221 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.221 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.221 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8086", 2023-10-16T13:15:08.221 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.222 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.222 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.222 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server port", 2023-10-16T13:15:08.222 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.222 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.223 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.223 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.223 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2023-10-16T13:15:08.223 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2023-10-16T13:15:08.223 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.223 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.224 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.224 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "false", 2023-10-16T13:15:08.224 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.224 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.224 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.225 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-16T13:15:08.225 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.225 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.225 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.225 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.226 INFO:teuthology.orchestra.run.smithi092.stdout: "threads": { 2023-10-16T13:15:08.226 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threads", 2023-10-16T13:15:08.226 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.226 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.226 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.227 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2023-10-16T13:15:08.227 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2023-10-16T13:15:08.227 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "32", 2023-10-16T13:15:08.227 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.227 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-16T13:15:08.228 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.228 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.228 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.228 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.228 INFO:teuthology.orchestra.run.smithi092.stdout: "username": { 2023-10-16T13:15:08.229 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "username", 2023-10-16T13:15:08.229 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.229 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.229 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.229 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.230 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.230 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.230 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.230 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "username of InfluxDB server user", 2023-10-16T13:15:08.230 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.231 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.231 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.231 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.231 INFO:teuthology.orchestra.run.smithi092.stdout: "verify_ssl": { 2023-10-16T13:15:08.231 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "verify_ssl", 2023-10-16T13:15:08.232 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.232 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.232 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.232 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "true", 2023-10-16T13:15:08.232 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.232 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.233 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.233 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-16T13:15:08.233 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.233 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.233 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.234 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.234 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.234 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.234 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.234 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "insights", 2023-10-16T13:15:08.235 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.235 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.235 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.235 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.235 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.235 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.236 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.236 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.236 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.236 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.236 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.237 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.237 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.237 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.237 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.237 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.238 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.238 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.238 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.238 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.238 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.239 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.239 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.239 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.239 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.239 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.240 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.240 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.240 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.240 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.240 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.241 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.241 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.241 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.241 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.241 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.241 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.242 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.242 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.242 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.242 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.242 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.243 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.243 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.243 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.243 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.243 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.244 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.244 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.244 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.244 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.244 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.244 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.245 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.245 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.245 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.245 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.245 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.245 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.246 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.246 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.246 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.246 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.246 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.247 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.247 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.247 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.247 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.247 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.247 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.248 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.248 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.248 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.248 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.248 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.248 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.249 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "iostat", 2023-10-16T13:15:08.249 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.249 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.249 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.249 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.250 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.250 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.250 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.250 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.250 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.251 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.251 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.251 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.251 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.251 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.252 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.252 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.252 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.252 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.252 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.252 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.253 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.253 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.253 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.253 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.253 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.254 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.254 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.254 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.254 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.254 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.255 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.255 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.255 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.255 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.255 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.256 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.256 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.256 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.256 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.256 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.257 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.257 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.257 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.257 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.257 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.257 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.258 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.258 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.258 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.258 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.258 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.259 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.259 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.259 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.259 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.259 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.260 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.260 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.260 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.260 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.260 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.261 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.261 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.261 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.261 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.261 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.261 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.262 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.262 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.262 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.262 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.262 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.263 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.263 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.263 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.263 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.263 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "k8sevents", 2023-10-16T13:15:08.264 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.264 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.264 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.264 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_event_retention_days": { 2023-10-16T13:15:08.264 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ceph_event_retention_days", 2023-10-16T13:15:08.264 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.265 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.265 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.265 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7", 2023-10-16T13:15:08.265 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.265 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.266 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.266 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-16T13:15:08.266 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.266 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.266 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.266 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.267 INFO:teuthology.orchestra.run.smithi092.stdout: "config_check_secs": { 2023-10-16T13:15:08.267 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_check_secs", 2023-10-16T13:15:08.267 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.267 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.267 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.268 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:08.268 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "10", 2023-10-16T13:15:08.268 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.268 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.268 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-16T13:15:08.269 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.269 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.269 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.269 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.269 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.269 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.270 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.270 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.270 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.270 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.270 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.271 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.271 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.271 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.271 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.272 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.272 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.272 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.272 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.272 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.272 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.273 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.273 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.273 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.273 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.273 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.274 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.274 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.274 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.274 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.274 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.274 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.275 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.275 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.275 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.275 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.275 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.276 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.276 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.276 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.276 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.276 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.277 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.277 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.277 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.277 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.277 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.277 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.278 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.278 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.278 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.278 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.278 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.279 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.279 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.279 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.279 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.279 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.280 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.280 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.280 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.280 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.280 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.280 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.281 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.281 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.281 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.281 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.281 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.281 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.282 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.282 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.282 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.282 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.282 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.283 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.283 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.283 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "localpool", 2023-10-16T13:15:08.283 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.283 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.283 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.284 INFO:teuthology.orchestra.run.smithi092.stdout: "failure_domain": { 2023-10-16T13:15:08.284 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "failure_domain", 2023-10-16T13:15:08.284 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.284 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.284 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.285 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "host", 2023-10-16T13:15:08.285 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.285 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.285 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.285 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "failure domain for any created local pool", 2023-10-16T13:15:08.286 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-16T13:15:08.286 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.286 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.286 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.286 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.286 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.287 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.287 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.287 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.287 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.287 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.288 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.288 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.288 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.288 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.288 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.289 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.289 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.289 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.289 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.289 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.289 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.290 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.290 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.290 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.290 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.290 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.291 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.291 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.291 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.291 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.291 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.291 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.292 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.292 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.292 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.292 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.292 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.293 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.293 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.293 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.293 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.293 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.294 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.294 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.294 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.294 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.294 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.295 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.295 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.295 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.295 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.295 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.295 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.296 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.296 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.296 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.296 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.296 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.297 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.297 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.297 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.297 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.297 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.298 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.298 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.298 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.298 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.298 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.299 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.299 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.299 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.299 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.299 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.300 INFO:teuthology.orchestra.run.smithi092.stdout: "min_size": { 2023-10-16T13:15:08.300 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_size", 2023-10-16T13:15:08.300 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.300 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.300 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.301 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.301 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.301 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.301 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.301 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default min_size for any created local pool", 2023-10-16T13:15:08.301 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-16T13:15:08.302 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.302 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.302 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.302 INFO:teuthology.orchestra.run.smithi092.stdout: "num_rep": { 2023-10-16T13:15:08.302 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "num_rep", 2023-10-16T13:15:08.303 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.303 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.303 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.303 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3", 2023-10-16T13:15:08.303 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.304 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.304 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.304 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default replica count for any created local pool", 2023-10-16T13:15:08.304 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.304 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.304 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.305 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.305 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_num": { 2023-10-16T13:15:08.305 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_num", 2023-10-16T13:15:08.305 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.306 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.306 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.306 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "128", 2023-10-16T13:15:08.306 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.306 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.306 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.307 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default pg_num for any created local pool", 2023-10-16T13:15:08.307 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.307 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.307 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.307 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.308 INFO:teuthology.orchestra.run.smithi092.stdout: "prefix": { 2023-10-16T13:15:08.308 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prefix", 2023-10-16T13:15:08.308 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.308 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.308 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.309 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.309 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.309 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.309 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.309 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name prefix for any created local pool", 2023-10-16T13:15:08.310 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.310 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.310 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.310 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.310 INFO:teuthology.orchestra.run.smithi092.stdout: "subtree": { 2023-10-16T13:15:08.311 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "subtree", 2023-10-16T13:15:08.311 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.311 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.311 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.311 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "rack", 2023-10-16T13:15:08.312 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.312 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.312 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.312 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-16T13:15:08.312 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-16T13:15:08.313 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.313 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.313 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.313 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.314 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.314 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.314 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mds_autoscaler", 2023-10-16T13:15:08.314 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.315 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.315 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.315 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.315 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.315 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.315 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.316 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.316 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.316 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.316 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.316 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.317 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.317 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.317 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.317 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.317 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.318 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.318 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.318 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.318 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.319 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.319 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.319 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.319 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.319 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.320 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.320 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.320 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.320 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.320 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.321 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.321 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.321 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.321 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.321 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.322 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.322 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.322 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.322 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.322 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.322 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.323 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.323 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.323 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.323 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.323 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.324 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.324 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.324 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.324 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.324 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.325 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.325 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.325 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.325 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.325 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.326 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.326 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.326 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.326 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.327 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.327 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.327 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.327 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.327 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.328 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.329 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.329 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.329 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.329 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.329 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.330 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.330 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.330 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.330 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.330 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirroring", 2023-10-16T13:15:08.331 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.331 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.331 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.331 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.331 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.332 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.332 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.332 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.332 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.332 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.332 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.333 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.333 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.333 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.333 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.333 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.334 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.334 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.334 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.334 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.334 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.335 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.335 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.335 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.335 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.335 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.336 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.336 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.336 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.336 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.336 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.337 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.337 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.337 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.337 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.337 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.337 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.338 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.338 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.338 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.338 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.338 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.339 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.339 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.339 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.339 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.339 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.339 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.340 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.340 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.340 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.340 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.340 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.341 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.341 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.341 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.341 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.341 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.342 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.342 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.342 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.342 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.342 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.343 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.343 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.343 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.343 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.343 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.344 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.344 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.344 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.344 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.344 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.344 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.345 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.345 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.345 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "nfs", 2023-10-16T13:15:08.345 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.345 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.345 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.346 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.346 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.346 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.346 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.346 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.347 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.347 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.347 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.347 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.347 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.348 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.348 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.348 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.348 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.348 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.348 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.349 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.349 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.349 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.349 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.349 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.350 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.350 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.350 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.350 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.350 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.351 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.351 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.351 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.351 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.351 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.352 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.352 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.352 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.352 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.353 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.353 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.353 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.353 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.353 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.354 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.354 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.354 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.354 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.354 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.355 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.355 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.355 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.355 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.355 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.356 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.356 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.356 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.356 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.357 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.357 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.357 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.357 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.357 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.358 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.358 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.358 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.358 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.359 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.359 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.359 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.359 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.359 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.360 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.360 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.360 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.360 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.360 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.361 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2023-10-16T13:15:08.361 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.361 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.361 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.361 INFO:teuthology.orchestra.run.smithi092.stdout: "fail_fs": { 2023-10-16T13:15:08.362 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "fail_fs", 2023-10-16T13:15:08.362 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.362 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.362 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.362 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.363 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.363 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.363 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.363 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-16T13:15:08.363 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.363 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.364 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.364 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.364 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.364 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.364 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.365 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.365 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.365 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.365 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.365 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.365 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.366 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.366 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.366 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.366 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.366 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.367 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.367 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.367 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.367 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.367 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.368 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.368 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.368 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.368 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.368 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.369 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.369 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.369 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.369 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.369 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.370 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.370 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.370 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.370 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.371 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.371 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.371 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.371 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.371 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.371 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.372 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.372 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.372 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.372 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.372 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.373 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.373 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.373 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.373 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.373 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.374 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.374 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.374 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.374 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.375 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.375 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.375 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.375 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.375 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.375 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.376 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.376 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.376 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.376 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.376 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.377 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.377 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.377 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.377 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.377 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.377 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.378 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator": { 2023-10-16T13:15:08.378 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2023-10-16T13:15:08.378 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.378 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.378 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.379 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.379 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.379 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.379 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.379 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm", 2023-10-16T13:15:08.379 INFO:teuthology.orchestra.run.smithi092.stdout: "rook", 2023-10-16T13:15:08.380 INFO:teuthology.orchestra.run.smithi092.stdout: "test_orchestrator" 2023-10-16T13:15:08.380 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.380 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Orchestrator backend", 2023-10-16T13:15:08.380 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.380 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.380 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.381 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.381 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.381 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.381 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.381 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_perf_query", 2023-10-16T13:15:08.381 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.382 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.382 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.382 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.382 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.382 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.383 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.383 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.383 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.383 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.383 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.383 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.383 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.384 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.384 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.384 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.384 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.385 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.385 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.385 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.385 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.385 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.385 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.385 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.386 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.386 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.386 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.386 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.386 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.387 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.387 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.387 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.387 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.387 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.388 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.388 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.388 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.388 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.388 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.389 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.389 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.389 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.389 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.389 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.389 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.390 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.390 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.390 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.390 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.390 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.391 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.391 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.391 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.391 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.391 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.392 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.392 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.392 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.392 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.392 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.393 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.393 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.393 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.393 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.393 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.393 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.394 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.394 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.394 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.394 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.394 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.395 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.395 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.395 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.395 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.395 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.396 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_support", 2023-10-16T13:15:08.396 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.396 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.396 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.396 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.397 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.397 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.397 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.397 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.397 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.397 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.398 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.398 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.398 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.398 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.398 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.399 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.399 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.399 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.399 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.399 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.399 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.400 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.400 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.400 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.400 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.400 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.401 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.401 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.401 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.401 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.401 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.402 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.402 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.402 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.402 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.402 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.402 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.403 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.403 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.403 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.403 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.404 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.404 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.404 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.404 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.404 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.404 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.405 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.405 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.405 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.405 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.405 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.406 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.406 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.406 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.406 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.406 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.406 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.407 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.407 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.407 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.407 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.407 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.407 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.408 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.408 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.408 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.408 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.408 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.408 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.409 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.409 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.409 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.409 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.409 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.409 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.410 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_autoscaler", 2023-10-16T13:15:08.410 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.410 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.410 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.410 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.411 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.411 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.411 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.411 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.411 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.411 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.412 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.412 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.412 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.412 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.412 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.413 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.413 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.413 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.413 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.413 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.413 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.414 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.414 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.414 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.414 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.414 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.415 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.415 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.415 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.415 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.415 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.415 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.416 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.416 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.416 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.416 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.416 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.416 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.417 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.417 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.417 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.417 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.417 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.418 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.418 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.418 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.418 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.418 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.419 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.419 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.419 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.419 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.419 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.419 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.420 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.420 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.420 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.420 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.420 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.421 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.421 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.421 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.421 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.421 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.422 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.422 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.422 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.422 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.422 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.423 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.423 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.423 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.423 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.423 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2023-10-16T13:15:08.424 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2023-10-16T13:15:08.424 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:08.424 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.424 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.424 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2023-10-16T13:15:08.425 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.425 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.425 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.425 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.425 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.426 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.426 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.426 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.426 INFO:teuthology.orchestra.run.smithi092.stdout: "threshold": { 2023-10-16T13:15:08.426 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threshold", 2023-10-16T13:15:08.427 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:08.427 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.427 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.427 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2023-10-16T13:15:08.427 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1.0", 2023-10-16T13:15:08.428 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.428 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.428 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "scaling threshold", 2023-10-16T13:15:08.428 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-16T13:15:08.428 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.428 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.429 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.429 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.429 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.429 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.429 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "progress", 2023-10-16T13:15:08.430 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.430 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.430 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.430 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_pg_recovery_event": { 2023-10-16T13:15:08.430 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_pg_recovery_event", 2023-10-16T13:15:08.431 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.431 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.431 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.431 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.431 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.432 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.432 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.432 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-16T13:15:08.432 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.432 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.433 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.433 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.433 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2023-10-16T13:15:08.433 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2023-10-16T13:15:08.433 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.433 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.434 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.434 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.434 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.434 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.434 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.435 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.435 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.435 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.435 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.435 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.435 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.436 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.436 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.436 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.436 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.436 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.436 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.437 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.437 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.437 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.437 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.437 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.437 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.438 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.438 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.438 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.438 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.438 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.439 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.439 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.439 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.439 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.439 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.440 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.440 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.440 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.440 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.440 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.441 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.441 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.441 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.441 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.441 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.442 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.442 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.442 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.442 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.442 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.442 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.443 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.443 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.443 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.443 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.443 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.444 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.444 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.444 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.444 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.444 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.445 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.445 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.445 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.445 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.445 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.445 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.446 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.446 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.446 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.446 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.446 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.447 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.447 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.447 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.447 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.447 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.447 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.448 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.448 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.448 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.448 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.448 INFO:teuthology.orchestra.run.smithi092.stdout: "max_completed_events": { 2023-10-16T13:15:08.449 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_completed_events", 2023-10-16T13:15:08.449 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.449 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.449 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.449 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "50", 2023-10-16T13:15:08.450 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.450 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.450 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.450 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "number of past completed events to remember", 2023-10-16T13:15:08.450 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.451 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.451 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.451 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.451 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2023-10-16T13:15:08.451 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2023-10-16T13:15:08.452 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:08.452 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.452 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.452 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2023-10-16T13:15:08.452 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.452 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.453 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.453 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long the module is going to sleep", 2023-10-16T13:15:08.453 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.453 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.453 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.454 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.454 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.454 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.454 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.454 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus", 2023-10-16T13:15:08.455 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.455 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.455 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.455 INFO:teuthology.orchestra.run.smithi092.stdout: "cache": { 2023-10-16T13:15:08.455 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cache", 2023-10-16T13:15:08.455 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.456 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.456 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.456 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.456 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.456 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.457 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.457 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.457 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.457 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.457 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.457 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.458 INFO:teuthology.orchestra.run.smithi092.stdout: "exclude_perf_counters": { 2023-10-16T13:15:08.458 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "exclude_perf_counters", 2023-10-16T13:15:08.458 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.458 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.458 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.459 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.459 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.459 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.459 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.459 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-16T13:15:08.460 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-16T13:15:08.460 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.460 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.460 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.460 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.461 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.461 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.461 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.461 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.461 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.461 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.462 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.462 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.462 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.462 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.462 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.463 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.463 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.463 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.463 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.463 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.463 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.464 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.464 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.464 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.464 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.464 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.465 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.465 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.465 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.465 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.465 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.465 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.466 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.466 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.466 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.466 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.466 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.467 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.467 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.467 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.467 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.467 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.467 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.468 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.468 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.468 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.468 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.468 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.468 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.469 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.469 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.469 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.469 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.469 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.470 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.470 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.470 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.470 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.470 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.471 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.471 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.471 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.471 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.471 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.471 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.472 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.472 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.472 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.472 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.472 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.472 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.473 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.473 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.473 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools": { 2023-10-16T13:15:08.473 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools", 2023-10-16T13:15:08.473 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.473 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.474 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.474 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.474 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.474 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.474 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.474 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.475 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.475 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.475 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.475 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.475 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-16T13:15:08.475 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-16T13:15:08.476 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.476 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.476 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.476 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "300", 2023-10-16T13:15:08.476 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.476 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.477 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.477 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.477 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.477 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.477 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.477 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.478 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_interval": { 2023-10-16T13:15:08.478 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_interval", 2023-10-16T13:15:08.478 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:08.478 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.478 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.479 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15.0", 2023-10-16T13:15:08.479 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.479 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.479 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.479 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.479 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.480 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.480 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.480 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.480 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2023-10-16T13:15:08.480 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2023-10-16T13:15:08.480 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.481 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.481 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.481 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2023-10-16T13:15:08.481 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.481 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.481 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.482 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-16T13:15:08.482 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.482 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.482 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.482 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.483 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2023-10-16T13:15:08.483 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2023-10-16T13:15:08.483 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.483 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.483 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.483 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "9283", 2023-10-16T13:15:08.484 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.484 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.484 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.484 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-16T13:15:08.484 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.485 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.485 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.485 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.485 INFO:teuthology.orchestra.run.smithi092.stdout: "stale_cache_strategy": { 2023-10-16T13:15:08.485 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stale_cache_strategy", 2023-10-16T13:15:08.486 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.486 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.486 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.486 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "log", 2023-10-16T13:15:08.486 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.487 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.487 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.487 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.487 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.488 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.488 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.488 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.488 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2023-10-16T13:15:08.488 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2023-10-16T13:15:08.488 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.489 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.489 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.489 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "default", 2023-10-16T13:15:08.489 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.489 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.490 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.490 INFO:teuthology.orchestra.run.smithi092.stdout: "default", 2023-10-16T13:15:08.490 INFO:teuthology.orchestra.run.smithi092.stdout: "error" 2023-10-16T13:15:08.490 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.490 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.491 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.491 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.491 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.491 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.491 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2023-10-16T13:15:08.491 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2023-10-16T13:15:08.492 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.492 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.492 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.492 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2023-10-16T13:15:08.492 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2023-10-16T13:15:08.493 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2023-10-16T13:15:08.493 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.493 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.493 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.493 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.493 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.494 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.494 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.494 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.494 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.494 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_support", 2023-10-16T13:15:08.494 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.495 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.495 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.495 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.495 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.495 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.496 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.496 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.496 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.496 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.496 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.496 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.497 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.497 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.497 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.497 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.497 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.497 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.498 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.498 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.498 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.498 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.498 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.499 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.499 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.499 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.499 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.499 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.499 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.500 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.500 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.500 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.500 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.500 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.500 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.501 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.501 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.501 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.501 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.501 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.502 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.502 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.502 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.502 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.502 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.503 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.503 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.503 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.503 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.503 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.504 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.504 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.504 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.504 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.504 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.504 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.505 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.505 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.505 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.505 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.505 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.506 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.506 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.506 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.506 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.506 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.507 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.507 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.507 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.507 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.507 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.508 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.508 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.508 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_snap_create": { 2023-10-16T13:15:08.508 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_snap_create", 2023-10-16T13:15:08.508 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.508 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.509 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.509 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:08.509 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.509 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.509 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.510 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.510 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.510 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.510 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.510 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.511 INFO:teuthology.orchestra.run.smithi092.stdout: "mirror_snapshot_schedule": { 2023-10-16T13:15:08.511 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirror_snapshot_schedule", 2023-10-16T13:15:08.511 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.511 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.511 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.512 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.512 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.512 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.512 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.512 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.512 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.513 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.513 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.513 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.513 INFO:teuthology.orchestra.run.smithi092.stdout: "trash_purge_schedule": { 2023-10-16T13:15:08.513 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "trash_purge_schedule", 2023-10-16T13:15:08.514 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.514 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.514 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.514 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.514 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.515 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.515 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.515 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.515 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.515 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.516 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.516 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.516 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.516 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.516 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.516 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "restful", 2023-10-16T13:15:08.517 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.517 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.517 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.517 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_auth": { 2023-10-16T13:15:08.517 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_auth", 2023-10-16T13:15:08.517 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.518 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.518 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.518 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.518 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.518 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.519 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.519 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.519 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.519 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.519 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.519 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.520 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2023-10-16T13:15:08.520 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2023-10-16T13:15:08.520 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.520 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.520 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.520 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.521 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.521 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.521 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.521 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.521 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.521 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.522 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.522 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.522 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.522 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.522 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.523 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.523 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.523 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.523 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.523 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.523 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.524 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.524 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.524 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.524 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.524 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.524 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.525 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.525 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.525 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.525 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.525 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.525 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.526 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.526 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.526 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.526 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.526 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.527 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.527 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.527 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.527 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.527 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.528 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.528 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.528 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.528 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.528 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.528 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.529 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.529 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.529 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.529 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.529 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.530 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.530 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.530 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.530 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.531 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.531 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.531 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.531 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.531 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.532 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.532 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.532 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.532 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.532 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.533 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.533 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.533 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.533 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.533 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.533 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.534 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.534 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.534 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.534 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.535 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.535 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.535 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.535 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.535 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2023-10-16T13:15:08.536 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2023-10-16T13:15:08.536 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.536 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.536 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.536 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.537 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.537 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.537 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.537 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.537 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.538 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.538 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.538 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.538 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2023-10-16T13:15:08.538 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2023-10-16T13:15:08.539 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.539 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.539 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.539 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.539 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.539 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.540 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.540 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.540 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.540 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.540 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.541 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.541 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.541 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.541 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.541 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rgw", 2023-10-16T13:15:08.541 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.542 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.542 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.542 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.542 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.542 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.542 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.543 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.543 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.543 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.543 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.543 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.544 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.544 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.544 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.544 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.544 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.545 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.545 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.545 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.545 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.545 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.545 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.546 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.546 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.546 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.546 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.546 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.547 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.547 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.547 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.547 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.547 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.547 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.548 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.548 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.548 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.548 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.548 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.548 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.549 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.549 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.549 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.549 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.549 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.549 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.550 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.550 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.550 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.550 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.550 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.551 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.551 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.551 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.551 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.551 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.551 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.552 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.552 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.552 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.552 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.552 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.553 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.553 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.553 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.553 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.553 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.553 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.554 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.554 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.554 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.554 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.554 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.554 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.555 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.555 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.555 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rook", 2023-10-16T13:15:08.555 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.555 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.556 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.556 INFO:teuthology.orchestra.run.smithi092.stdout: "drive_group_interval": { 2023-10-16T13:15:08.556 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "drive_group_interval", 2023-10-16T13:15:08.556 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:08.556 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.556 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.557 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "300.0", 2023-10-16T13:15:08.557 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.557 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.557 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.557 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-16T13:15:08.558 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.558 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.558 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.558 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.558 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.558 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.559 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.559 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.559 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.559 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.559 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.560 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.560 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.560 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.560 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.560 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.560 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.561 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.561 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.561 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.561 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.561 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.562 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.562 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.562 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.562 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.562 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.563 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.563 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.563 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.563 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.563 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.563 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.564 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.564 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.564 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.564 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.564 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.565 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.565 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.565 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.565 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.565 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.565 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.566 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.566 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.566 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.566 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.566 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.566 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.567 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.567 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.567 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.567 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.567 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.568 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.568 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.568 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.568 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.568 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.568 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.569 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.569 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.569 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.569 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.569 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.569 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.570 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.570 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.570 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.570 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.570 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.571 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.571 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.571 INFO:teuthology.orchestra.run.smithi092.stdout: "storage_class": { 2023-10-16T13:15:08.571 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "storage_class", 2023-10-16T13:15:08.571 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.571 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.572 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.572 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "local", 2023-10-16T13:15:08.572 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.572 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.572 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.572 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-16T13:15:08.573 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.573 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.573 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.573 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.573 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.573 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.574 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.574 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "selftest", 2023-10-16T13:15:08.574 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.574 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.574 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.575 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.575 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.575 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.575 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.575 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.576 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.576 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.576 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.576 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.576 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.577 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.577 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.577 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.577 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.577 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.577 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.578 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.578 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.578 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.578 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.578 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.579 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.579 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.579 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.579 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.579 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.580 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.580 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.580 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.580 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.580 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.580 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.581 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.581 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.581 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.581 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.581 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.581 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.582 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.582 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.582 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.582 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.582 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.583 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.583 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.583 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.583 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.583 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.583 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.584 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.584 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.584 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.584 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.584 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.584 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.585 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.585 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.585 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.585 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.585 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.585 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.586 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.586 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.586 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.586 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.586 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.587 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.587 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.587 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.587 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.587 INFO:teuthology.orchestra.run.smithi092.stdout: "roption1": { 2023-10-16T13:15:08.588 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption1", 2023-10-16T13:15:08.588 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.588 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.588 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.588 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.589 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.589 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.589 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.589 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.589 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.589 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.590 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.590 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.590 INFO:teuthology.orchestra.run.smithi092.stdout: "roption2": { 2023-10-16T13:15:08.590 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption2", 2023-10-16T13:15:08.590 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.591 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.591 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.591 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "xyz", 2023-10-16T13:15:08.591 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.591 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.592 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.592 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.592 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.592 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.592 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.592 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.593 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption1": { 2023-10-16T13:15:08.593 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption1", 2023-10-16T13:15:08.593 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.593 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.593 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.594 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.594 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.594 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.594 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.594 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.595 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.595 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.595 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.595 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.595 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption2": { 2023-10-16T13:15:08.595 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption2", 2023-10-16T13:15:08.596 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.596 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.596 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.596 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.596 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.596 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.597 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.597 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.597 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.597 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.597 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.597 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.598 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption3": { 2023-10-16T13:15:08.598 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption3", 2023-10-16T13:15:08.598 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:08.598 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.598 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.599 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.599 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.599 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.599 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.599 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.599 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.600 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.600 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.600 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.600 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption4": { 2023-10-16T13:15:08.600 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption4", 2023-10-16T13:15:08.600 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.601 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.601 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.601 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.601 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.601 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.602 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.602 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.602 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.602 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.602 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.603 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.603 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption5": { 2023-10-16T13:15:08.603 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption5", 2023-10-16T13:15:08.603 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.603 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.603 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.604 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.604 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.604 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.604 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.604 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.604 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.605 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.605 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.605 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.605 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption6": { 2023-10-16T13:15:08.605 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption6", 2023-10-16T13:15:08.606 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.606 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.606 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.606 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.606 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.607 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.607 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.607 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.607 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.607 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.607 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.608 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.608 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption7": { 2023-10-16T13:15:08.608 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption7", 2023-10-16T13:15:08.608 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.608 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.608 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.609 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.609 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2023-10-16T13:15:08.609 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "42", 2023-10-16T13:15:08.609 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.609 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.610 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.610 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.610 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.610 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.610 INFO:teuthology.orchestra.run.smithi092.stdout: "testkey": { 2023-10-16T13:15:08.610 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testkey", 2023-10-16T13:15:08.611 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.611 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.611 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.611 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.611 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.611 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.612 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.612 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.612 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.612 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.612 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.612 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.613 INFO:teuthology.orchestra.run.smithi092.stdout: "testlkey": { 2023-10-16T13:15:08.613 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testlkey", 2023-10-16T13:15:08.613 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.613 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.613 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.613 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.614 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.614 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.614 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.614 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.614 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.615 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.615 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.615 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.615 INFO:teuthology.orchestra.run.smithi092.stdout: "testnewline": { 2023-10-16T13:15:08.615 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testnewline", 2023-10-16T13:15:08.615 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.616 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.616 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.616 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.616 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.616 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.616 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.617 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.617 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.617 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.617 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.617 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.618 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.618 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.618 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.618 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snap_schedule", 2023-10-16T13:15:08.618 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.618 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.619 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.619 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_m_granularity": { 2023-10-16T13:15:08.619 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_m_granularity", 2023-10-16T13:15:08.619 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.619 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.620 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.620 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.620 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.620 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.620 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.620 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow minute scheduled snapshots", 2023-10-16T13:15:08.621 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.621 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.621 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.621 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.621 INFO:teuthology.orchestra.run.smithi092.stdout: "dump_on_update": { 2023-10-16T13:15:08.621 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dump_on_update", 2023-10-16T13:15:08.622 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.622 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.622 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.622 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.622 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.623 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.623 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.623 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "dump database to debug log on update", 2023-10-16T13:15:08.623 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.623 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.624 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.624 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.624 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.624 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.624 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.624 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.625 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.625 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.625 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.625 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.625 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.625 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.626 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.626 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.626 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.626 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.626 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.627 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.627 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.627 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.627 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.627 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.627 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.628 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.628 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.628 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.628 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.628 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.629 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.629 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.629 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.629 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.629 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.629 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.630 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.630 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.630 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.630 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.630 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.631 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.631 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.631 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.631 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.631 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.632 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.632 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.632 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.632 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.632 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.632 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.633 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.633 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.633 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.633 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.633 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.634 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.634 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.634 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.634 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.634 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.635 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.635 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.635 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.635 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.635 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.636 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.636 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.636 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.636 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.636 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.636 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.637 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.637 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.637 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.637 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.637 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stats", 2023-10-16T13:15:08.637 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.638 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.638 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.638 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.638 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.638 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.638 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.639 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.639 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.639 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.639 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.639 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.640 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.640 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.640 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.640 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.640 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.641 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.641 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.641 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.641 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.641 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.641 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.642 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.642 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.642 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.642 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.642 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.643 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.643 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.643 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.643 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.643 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.643 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.644 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.644 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.644 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.644 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.644 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.645 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.645 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.645 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.645 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.645 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.646 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.646 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.646 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.646 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.646 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.647 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.647 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.647 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.647 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.647 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.647 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.648 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.648 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.648 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.648 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.648 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.649 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.649 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.649 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.649 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.649 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.649 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.650 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.650 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.650 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.650 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.650 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.650 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.651 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.651 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.651 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.651 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.651 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "status", 2023-10-16T13:15:08.651 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.652 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.652 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.652 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.652 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.652 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.653 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.653 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.653 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.653 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.653 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.653 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.654 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.654 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.654 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.654 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.655 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.655 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.655 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.655 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.655 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.656 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.656 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.656 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.656 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.656 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.657 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.657 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.657 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.657 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.657 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.657 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.658 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.658 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.658 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.658 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.658 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.659 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.659 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.659 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.659 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.659 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.660 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.660 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.660 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.660 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.660 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.661 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.661 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.661 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.661 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.661 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.661 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.662 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.662 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.662 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.662 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.662 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.663 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.663 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.663 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.663 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.663 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.664 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.664 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.664 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.664 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.664 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.665 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.665 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.665 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.665 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.665 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.665 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.666 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.666 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.666 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telegraf", 2023-10-16T13:15:08.666 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.666 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.667 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.667 INFO:teuthology.orchestra.run.smithi092.stdout: "address": { 2023-10-16T13:15:08.667 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "address", 2023-10-16T13:15:08.667 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.667 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.667 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.668 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-16T13:15:08.668 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.668 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.668 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.668 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.669 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.669 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.669 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.669 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.669 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2023-10-16T13:15:08.669 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2023-10-16T13:15:08.670 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:08.670 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.670 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.670 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15", 2023-10-16T13:15:08.670 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.671 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.671 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.671 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.671 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.671 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.671 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.672 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.672 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.672 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.672 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.672 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.672 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.672 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.673 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.673 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.673 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.673 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.673 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.673 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.674 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.674 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.674 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.674 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.674 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.675 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.675 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.675 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.675 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.675 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.676 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.676 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.676 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.676 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.676 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.677 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.677 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.677 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.677 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.677 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.677 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.678 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.678 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.678 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.678 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.678 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.679 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.679 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.679 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.679 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.679 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.679 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.680 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.680 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.680 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.680 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.680 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.681 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.681 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.681 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.681 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.681 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.682 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.682 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.682 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.682 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.682 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.683 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.683 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.683 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.683 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.683 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.683 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.684 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.684 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.684 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.684 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.684 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.685 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.685 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.685 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.685 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telemetry", 2023-10-16T13:15:08.685 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.685 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.686 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.686 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_basic": { 2023-10-16T13:15:08.686 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_basic", 2023-10-16T13:15:08.686 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.686 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.687 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.687 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.687 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.687 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.687 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.688 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-16T13:15:08.688 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.688 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.688 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.688 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.688 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_crash": { 2023-10-16T13:15:08.689 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_crash", 2023-10-16T13:15:08.689 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.689 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.689 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.689 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.689 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.690 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.690 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.690 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-16T13:15:08.690 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.690 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.691 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.691 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.691 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_device": { 2023-10-16T13:15:08.691 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_device", 2023-10-16T13:15:08.691 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.692 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.692 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.692 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.692 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.692 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.693 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.693 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-16T13:15:08.693 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.693 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.693 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.693 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.694 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_ident": { 2023-10-16T13:15:08.694 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_ident", 2023-10-16T13:15:08.694 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.694 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.694 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.695 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.695 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.695 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.695 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.695 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-16T13:15:08.695 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.696 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.696 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.696 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.696 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_perf": { 2023-10-16T13:15:08.696 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_perf", 2023-10-16T13:15:08.697 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.697 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.697 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.697 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.697 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.698 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.698 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.698 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-16T13:15:08.698 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.698 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.699 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.699 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.699 INFO:teuthology.orchestra.run.smithi092.stdout: "contact": { 2023-10-16T13:15:08.699 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "contact", 2023-10-16T13:15:08.699 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.700 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.700 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.700 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.700 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.700 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.701 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.701 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.701 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.701 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.701 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.702 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.702 INFO:teuthology.orchestra.run.smithi092.stdout: "description": { 2023-10-16T13:15:08.702 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "description", 2023-10-16T13:15:08.702 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.703 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.703 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.703 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.703 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.703 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.704 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.704 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.704 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.704 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.704 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.704 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.705 INFO:teuthology.orchestra.run.smithi092.stdout: "device_url": { 2023-10-16T13:15:08.705 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_url", 2023-10-16T13:15:08.705 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.705 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.706 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.706 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-16T13:15:08.706 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.706 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.706 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.707 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.707 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.707 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.707 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.707 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.707 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2023-10-16T13:15:08.708 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2023-10-16T13:15:08.708 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.708 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.708 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.708 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.709 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.709 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.709 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.709 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.709 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.710 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.710 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.710 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.710 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2023-10-16T13:15:08.710 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2023-10-16T13:15:08.710 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.711 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.711 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.711 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "24", 2023-10-16T13:15:08.711 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "8", 2023-10-16T13:15:08.711 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.712 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.712 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.712 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.712 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.712 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.712 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.713 INFO:teuthology.orchestra.run.smithi092.stdout: "last_opt_revision": { 2023-10-16T13:15:08.713 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "last_opt_revision", 2023-10-16T13:15:08.713 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.713 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.713 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.714 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1", 2023-10-16T13:15:08.714 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.714 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.714 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.714 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.714 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.715 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.715 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.715 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.715 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard": { 2023-10-16T13:15:08.715 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard", 2023-10-16T13:15:08.715 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.716 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.716 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.716 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.716 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.716 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.716 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.717 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.717 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.717 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.717 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.717 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.717 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard_description": { 2023-10-16T13:15:08.718 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard_description", 2023-10-16T13:15:08.718 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.718 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.718 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.718 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.718 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.719 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.719 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.719 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.719 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.719 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.719 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.720 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.720 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.720 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.720 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.720 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.720 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.721 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.721 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.721 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.721 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.721 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.722 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.722 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.722 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.722 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.722 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.723 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.723 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.723 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.723 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.723 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.723 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.724 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.724 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.724 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.724 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.724 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.724 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.725 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.725 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.725 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.725 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.725 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.726 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.726 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.726 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.726 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.726 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.727 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.727 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.727 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.727 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.727 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.727 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.728 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.728 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.728 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.728 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.728 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.729 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.729 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.729 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.729 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.729 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.730 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.730 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.730 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.730 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.730 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.731 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.731 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.731 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.731 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.731 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.732 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.732 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.732 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.732 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.732 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.732 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.733 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.733 INFO:teuthology.orchestra.run.smithi092.stdout: "organization": { 2023-10-16T13:15:08.733 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "organization", 2023-10-16T13:15:08.733 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.733 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.733 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.733 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.734 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.734 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.734 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.734 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.735 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.735 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.735 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.735 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.735 INFO:teuthology.orchestra.run.smithi092.stdout: "proxy": { 2023-10-16T13:15:08.736 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "proxy", 2023-10-16T13:15:08.736 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.736 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.736 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.736 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.736 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.737 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.737 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.737 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.737 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.737 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.738 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.738 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.738 INFO:teuthology.orchestra.run.smithi092.stdout: "url": { 2023-10-16T13:15:08.738 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url", 2023-10-16T13:15:08.738 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.739 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.739 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.739 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-16T13:15:08.739 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.739 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.740 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.740 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.740 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.740 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.740 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.740 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.741 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.741 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.741 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.741 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "test_orchestrator", 2023-10-16T13:15:08.741 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.741 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.742 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.742 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.742 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.742 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.743 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.743 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.743 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.743 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.743 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.744 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.744 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.744 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.744 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.744 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.745 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.745 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.745 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.745 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.745 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.746 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.746 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.746 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.746 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.746 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.747 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.747 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.747 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.747 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.747 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.747 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.748 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.748 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.748 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.748 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.748 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.749 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.749 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.749 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.749 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.749 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.750 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.750 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.750 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.750 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.750 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.751 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.751 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.751 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.751 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.751 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.751 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.752 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.752 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.752 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.752 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.752 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.752 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.753 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.753 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.753 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.753 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.753 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.754 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.754 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.754 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.754 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.754 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.755 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.755 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.755 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.755 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.755 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.755 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.756 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.756 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "volumes", 2023-10-16T13:15:08.756 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.756 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.756 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.757 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.757 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.757 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.757 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.757 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.757 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.758 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.758 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.758 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.758 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.758 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.759 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.759 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.759 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.759 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.760 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.760 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.760 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.760 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.760 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.761 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.761 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.761 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.761 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.761 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.761 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.762 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.762 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.762 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.762 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.762 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.763 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.763 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.763 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.763 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.763 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.764 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.764 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.764 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.764 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.764 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.765 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.765 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.765 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.765 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.765 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.765 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.766 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.766 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.766 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.766 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.766 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.767 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.767 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.767 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.767 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.767 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.767 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.768 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.768 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.768 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.768 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.768 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.769 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.769 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.769 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.769 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.769 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.769 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.770 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.770 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_clones": { 2023-10-16T13:15:08.770 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_clones", 2023-10-16T13:15:08.770 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.770 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.771 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.771 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4", 2023-10-16T13:15:08.771 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.771 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.771 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.772 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-16T13:15:08.772 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.772 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.772 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.772 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.773 INFO:teuthology.orchestra.run.smithi092.stdout: "periodic_async_work": { 2023-10-16T13:15:08.773 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "periodic_async_work", 2023-10-16T13:15:08.773 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.773 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.773 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.773 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.774 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.774 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.774 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.774 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Periodically check for async work", 2023-10-16T13:15:08.774 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.775 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.775 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.775 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.775 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_delay": { 2023-10-16T13:15:08.775 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_delay", 2023-10-16T13:15:08.776 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.776 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.776 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.776 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2023-10-16T13:15:08.776 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.776 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.777 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.777 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-16T13:15:08.777 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.777 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.777 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.777 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.778 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.778 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.778 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.778 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix", 2023-10-16T13:15:08.778 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.779 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.779 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.779 INFO:teuthology.orchestra.run.smithi092.stdout: "discovery_interval": { 2023-10-16T13:15:08.779 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "discovery_interval", 2023-10-16T13:15:08.779 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2023-10-16T13:15:08.779 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.780 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.780 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "100", 2023-10-16T13:15:08.780 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.780 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.780 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.781 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.781 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.781 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.781 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.781 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.781 INFO:teuthology.orchestra.run.smithi092.stdout: "identifier": { 2023-10-16T13:15:08.782 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "identifier", 2023-10-16T13:15:08.782 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.782 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.782 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.782 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.783 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.783 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.783 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.783 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.784 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.784 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.784 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.784 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.784 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2023-10-16T13:15:08.784 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2023-10-16T13:15:08.785 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:08.785 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.785 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.785 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2023-10-16T13:15:08.785 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.786 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.786 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.786 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.786 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.786 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.787 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.787 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.787 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.787 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.787 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.788 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.788 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.788 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.788 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.788 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.789 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.789 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.789 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.789 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.789 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.790 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.790 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.790 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.790 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.790 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.791 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.791 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.791 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.791 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.791 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.792 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.792 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.792 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.792 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.792 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.793 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.793 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.793 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.793 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.793 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.793 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.794 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.794 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.794 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.794 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.795 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.795 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.795 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.795 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.795 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.796 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.796 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.796 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.796 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.796 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.796 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.797 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.797 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.797 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.797 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.797 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.798 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.798 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.798 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.798 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.798 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.799 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.799 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.799 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.799 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.799 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.800 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.800 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.800 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.800 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.800 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.801 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.801 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_host": { 2023-10-16T13:15:08.801 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_host", 2023-10-16T13:15:08.801 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.801 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.801 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.802 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.802 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.802 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.802 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.802 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.803 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.803 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.803 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.803 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.803 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_port": { 2023-10-16T13:15:08.804 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_port", 2023-10-16T13:15:08.804 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.804 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.804 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.804 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10051", 2023-10-16T13:15:08.805 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.805 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.805 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.805 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.805 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.805 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.806 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.806 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.806 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_sender": { 2023-10-16T13:15:08.806 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_sender", 2023-10-16T13:15:08.806 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.807 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.807 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.807 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-16T13:15:08.807 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.807 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.807 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.808 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.808 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.808 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.808 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.808 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.809 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.809 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.809 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-10-16T13:15:08.809 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.809 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.809 INFO:teuthology.orchestra.run.smithi092.stdout: "modules": [ 2023-10-16T13:15:08.810 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm", 2023-10-16T13:15:08.810 INFO:teuthology.orchestra.run.smithi092.stdout: "dashboard", 2023-10-16T13:15:08.810 INFO:teuthology.orchestra.run.smithi092.stdout: "iostat", 2023-10-16T13:15:08.810 INFO:teuthology.orchestra.run.smithi092.stdout: "nfs", 2023-10-16T13:15:08.810 INFO:teuthology.orchestra.run.smithi092.stdout: "restful" 2023-10-16T13:15:08.811 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.811 INFO:teuthology.orchestra.run.smithi092.stdout: "available_modules": [ 2023-10-16T13:15:08.811 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.811 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "alerts", 2023-10-16T13:15:08.811 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.812 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.812 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.812 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2023-10-16T13:15:08.812 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2023-10-16T13:15:08.812 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:08.813 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.813 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.813 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2023-10-16T13:15:08.813 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.813 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.813 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.814 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How frequently to reexamine health status", 2023-10-16T13:15:08.814 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.814 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.814 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.814 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.815 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.815 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.815 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.815 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.815 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.816 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.816 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.816 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.816 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.816 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.816 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.817 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.817 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.817 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.817 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.817 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.818 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.818 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.818 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.818 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.818 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.819 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.819 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.819 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.819 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.819 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.820 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.820 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.820 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.820 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.820 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.821 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.821 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.821 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.821 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.821 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.822 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.822 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.822 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.822 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.822 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.823 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.823 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.823 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.823 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.823 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.823 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.824 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.824 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.824 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.824 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.824 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.824 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.825 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.825 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.825 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.825 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.825 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.826 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.826 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.826 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.826 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.826 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.827 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.827 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.827 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.827 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.827 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.827 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.828 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.828 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_destination": { 2023-10-16T13:15:08.828 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_destination", 2023-10-16T13:15:08.828 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.828 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.829 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.829 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.829 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.829 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.829 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.830 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email address to send alerts to", 2023-10-16T13:15:08.830 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.830 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.830 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.830 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.831 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_from_name": { 2023-10-16T13:15:08.831 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_from_name", 2023-10-16T13:15:08.831 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.831 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.831 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.831 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "Ceph", 2023-10-16T13:15:08.832 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.832 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.832 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.832 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email From: name", 2023-10-16T13:15:08.833 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.833 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.833 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.833 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.833 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_host": { 2023-10-16T13:15:08.834 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_host", 2023-10-16T13:15:08.834 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.834 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.834 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.834 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.835 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.835 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.835 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.835 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP server", 2023-10-16T13:15:08.835 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.836 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.836 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.836 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.836 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_password": { 2023-10-16T13:15:08.836 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_password", 2023-10-16T13:15:08.837 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.837 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.837 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.837 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.837 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.838 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.838 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.838 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Password to authenticate with", 2023-10-16T13:15:08.838 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.838 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.839 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.839 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.839 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_port": { 2023-10-16T13:15:08.839 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_port", 2023-10-16T13:15:08.839 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.840 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.840 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.840 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "465", 2023-10-16T13:15:08.840 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.840 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.841 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.841 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP port", 2023-10-16T13:15:08.841 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.841 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.841 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.842 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.842 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_sender": { 2023-10-16T13:15:08.842 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_sender", 2023-10-16T13:15:08.842 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.842 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.842 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.843 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.843 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.843 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.843 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.843 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP envelope sender", 2023-10-16T13:15:08.844 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.844 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.844 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.844 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.844 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_ssl": { 2023-10-16T13:15:08.844 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_ssl", 2023-10-16T13:15:08.845 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.845 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.845 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.845 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.845 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.846 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.846 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.846 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-16T13:15:08.846 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.846 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.847 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.847 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.847 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_user": { 2023-10-16T13:15:08.847 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_user", 2023-10-16T13:15:08.847 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.847 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.848 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.848 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.848 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.848 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.848 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.849 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "User to authenticate as", 2023-10-16T13:15:08.849 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.849 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.849 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.849 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.850 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.850 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.850 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.850 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "balancer", 2023-10-16T13:15:08.850 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.851 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.851 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.851 INFO:teuthology.orchestra.run.smithi092.stdout: "active": { 2023-10-16T13:15:08.851 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "active", 2023-10-16T13:15:08.851 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.851 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.852 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.852 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.852 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.852 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.852 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.853 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically balance PGs across cluster", 2023-10-16T13:15:08.853 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.853 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.853 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.853 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.853 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_time": { 2023-10-16T13:15:08.854 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_time", 2023-10-16T13:15:08.854 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.854 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.854 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.854 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0000", 2023-10-16T13:15:08.855 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.855 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.855 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.855 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "beginning time of day to automatically balance", 2023-10-16T13:15:08.855 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-16T13:15:08.856 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.856 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.856 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.856 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_weekday": { 2023-10-16T13:15:08.856 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_weekday", 2023-10-16T13:15:08.856 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2023-10-16T13:15:08.857 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.857 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.857 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2023-10-16T13:15:08.857 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2023-10-16T13:15:08.857 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2023-10-16T13:15:08.858 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.858 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-16T13:15:08.858 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-16T13:15:08.858 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.858 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.859 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.859 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_max_iterations": { 2023-10-16T13:15:08.859 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_max_iterations", 2023-10-16T13:15:08.859 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2023-10-16T13:15:08.859 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.859 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.860 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "25", 2023-10-16T13:15:08.860 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2023-10-16T13:15:08.860 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "250", 2023-10-16T13:15:08.860 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.860 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-16T13:15:08.861 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.861 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.861 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.861 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.861 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_metrics": { 2023-10-16T13:15:08.862 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_metrics", 2023-10-16T13:15:08.862 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.862 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.862 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.863 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "pgs,objects,bytes", 2023-10-16T13:15:08.863 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.863 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.863 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.864 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-16T13:15:08.864 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-16T13:15:08.864 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.865 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.865 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.865 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_step": { 2023-10-16T13:15:08.866 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_step", 2023-10-16T13:15:08.866 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:08.866 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.866 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.867 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.5", 2023-10-16T13:15:08.867 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0.001", 2023-10-16T13:15:08.867 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "0.999", 2023-10-16T13:15:08.867 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.868 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "aggressiveness of optimization", 2023-10-16T13:15:08.868 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-16T13:15:08.868 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.868 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.868 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.868 INFO:teuthology.orchestra.run.smithi092.stdout: "end_time": { 2023-10-16T13:15:08.869 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_time", 2023-10-16T13:15:08.869 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.869 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.869 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.869 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2359", 2023-10-16T13:15:08.870 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.870 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.870 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.870 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ending time of day to automatically balance", 2023-10-16T13:15:08.870 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-16T13:15:08.871 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.871 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.871 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.871 INFO:teuthology.orchestra.run.smithi092.stdout: "end_weekday": { 2023-10-16T13:15:08.871 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_weekday", 2023-10-16T13:15:08.872 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2023-10-16T13:15:08.872 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.872 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.872 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2023-10-16T13:15:08.872 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2023-10-16T13:15:08.872 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2023-10-16T13:15:08.873 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.873 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-16T13:15:08.873 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-16T13:15:08.873 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.873 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.873 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.874 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.874 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.874 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.874 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.874 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.875 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.875 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.875 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.875 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.875 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.876 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.876 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.876 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.876 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.876 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.876 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.877 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.877 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.877 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.877 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.877 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.877 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.878 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.878 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.878 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.878 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.878 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.879 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.879 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.879 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.879 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.879 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.880 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.880 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.880 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.880 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:08.880 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:08.880 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.881 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.881 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.881 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:08.881 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.881 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.882 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.882 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.882 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.882 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.882 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.883 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.883 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.883 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.883 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.883 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.883 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.884 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.884 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.884 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:08.884 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:08.884 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.884 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.885 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.885 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.885 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.885 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.885 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.885 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.886 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.886 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.886 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.886 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.886 INFO:teuthology.orchestra.run.smithi092.stdout: "min_score": { 2023-10-16T13:15:08.887 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_score", 2023-10-16T13:15:08.887 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:08.887 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.887 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.887 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2023-10-16T13:15:08.887 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.888 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.888 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.888 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-16T13:15:08.888 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.888 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.889 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.889 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.889 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2023-10-16T13:15:08.889 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2023-10-16T13:15:08.889 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.890 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.890 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.890 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "upmap", 2023-10-16T13:15:08.890 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.890 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.891 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.891 INFO:teuthology.orchestra.run.smithi092.stdout: "crush-compat", 2023-10-16T13:15:08.891 INFO:teuthology.orchestra.run.smithi092.stdout: "none", 2023-10-16T13:15:08.891 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap" 2023-10-16T13:15:08.891 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.892 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Balancer mode", 2023-10-16T13:15:08.892 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.892 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.892 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.892 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.892 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_ids": { 2023-10-16T13:15:08.893 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_ids", 2023-10-16T13:15:08.893 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.893 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.893 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.893 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.894 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.894 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.894 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.894 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-16T13:15:08.894 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.895 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.895 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.895 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.895 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2023-10-16T13:15:08.895 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2023-10-16T13:15:08.895 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:08.896 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.896 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.896 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2023-10-16T13:15:08.896 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.897 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.897 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.897 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-16T13:15:08.897 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.897 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.897 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.898 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.898 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_deviation": { 2023-10-16T13:15:08.898 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_deviation", 2023-10-16T13:15:08.898 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.898 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.899 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.899 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2023-10-16T13:15:08.899 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2023-10-16T13:15:08.899 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.899 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.899 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-16T13:15:08.900 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-16T13:15:08.900 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.900 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.900 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.900 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_optimizations": { 2023-10-16T13:15:08.901 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_optimizations", 2023-10-16T13:15:08.901 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2023-10-16T13:15:08.901 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.901 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.902 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:08.902 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.902 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.902 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.902 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-16T13:15:08.903 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.903 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.903 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.903 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.903 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:08.904 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.904 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:08.904 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm", 2023-10-16T13:15:08.904 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:08.904 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:08.904 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:08.905 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_down_multiplier": { 2023-10-16T13:15:08.905 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_down_multiplier", 2023-10-16T13:15:08.905 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:08.905 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.905 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.905 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2023-10-16T13:15:08.906 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.906 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.906 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.906 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-16T13:15:08.906 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.907 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.907 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.907 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.907 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_refresh_rate": { 2023-10-16T13:15:08.907 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_refresh_rate", 2023-10-16T13:15:08.908 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:08.908 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.908 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.908 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "20", 2023-10-16T13:15:08.908 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.908 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.909 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.909 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-16T13:15:08.909 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.909 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.909 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.909 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.910 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_starting_port": { 2023-10-16T13:15:08.910 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_starting_port", 2023-10-16T13:15:08.910 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:08.910 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.910 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.911 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4721", 2023-10-16T13:15:08.911 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.911 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.911 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.911 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-16T13:15:08.912 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.912 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.912 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.912 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.912 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_ptrace": { 2023-10-16T13:15:08.912 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_ptrace", 2023-10-16T13:15:08.913 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.913 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.913 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.913 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.913 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.913 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.914 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.914 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-16T13:15:08.914 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-16T13:15:08.914 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.914 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.915 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.915 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_interval": { 2023-10-16T13:15:08.915 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_interval", 2023-10-16T13:15:08.915 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:08.915 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.916 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.916 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2023-10-16T13:15:08.916 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.916 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.916 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.916 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-16T13:15:08.917 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.917 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.917 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.917 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.917 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_memory_target_ratio": { 2023-10-16T13:15:08.917 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_memory_target_ratio", 2023-10-16T13:15:08.918 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:08.918 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.918 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.918 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.7", 2023-10-16T13:15:08.918 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.918 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.919 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.919 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-16T13:15:08.919 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.919 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.919 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.920 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.920 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm_log_destination": { 2023-10-16T13:15:08.920 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm_log_destination", 2023-10-16T13:15:08.920 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.920 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.920 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.921 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.921 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.921 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.921 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.921 INFO:teuthology.orchestra.run.smithi092.stdout: "file", 2023-10-16T13:15:08.921 INFO:teuthology.orchestra.run.smithi092.stdout: "file,syslog", 2023-10-16T13:15:08.922 INFO:teuthology.orchestra.run.smithi092.stdout: "syslog" 2023-10-16T13:15:08.922 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.922 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-16T13:15:08.922 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.922 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.923 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.923 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.923 INFO:teuthology.orchestra.run.smithi092.stdout: "cgroups_split": { 2023-10-16T13:15:08.923 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cgroups_split", 2023-10-16T13:15:08.923 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.923 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.924 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.924 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.924 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.924 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.924 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.924 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-16T13:15:08.924 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.925 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.925 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.925 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.925 INFO:teuthology.orchestra.run.smithi092.stdout: "config_checks_enabled": { 2023-10-16T13:15:08.925 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_checks_enabled", 2023-10-16T13:15:08.926 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.926 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.926 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.926 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.926 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.926 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.927 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.927 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-16T13:15:08.927 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.927 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.927 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.927 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.928 INFO:teuthology.orchestra.run.smithi092.stdout: "config_dashboard": { 2023-10-16T13:15:08.928 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_dashboard", 2023-10-16T13:15:08.928 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.928 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.928 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.928 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.929 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.929 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.929 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.929 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-16T13:15:08.929 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.929 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.930 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.930 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.930 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_alertmanager": { 2023-10-16T13:15:08.930 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_alertmanager", 2023-10-16T13:15:08.930 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.931 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.931 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.931 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-16T13:15:08.931 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.931 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.931 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.932 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2023-10-16T13:15:08.932 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.932 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.932 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.932 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.933 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_base": { 2023-10-16T13:15:08.933 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_base", 2023-10-16T13:15:08.933 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.933 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.933 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.933 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-16T13:15:08.934 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.934 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.934 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.934 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Container image name, without the tag", 2023-10-16T13:15:08.935 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.935 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.935 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.935 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.935 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_elasticsearch": { 2023-10-16T13:15:08.935 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_elasticsearch", 2023-10-16T13:15:08.936 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.936 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.936 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.936 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-16T13:15:08.936 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.936 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.937 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.937 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "elasticsearch container image", 2023-10-16T13:15:08.937 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.937 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.937 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.937 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.938 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_grafana": { 2023-10-16T13:15:08.938 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_grafana", 2023-10-16T13:15:08.938 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.938 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.938 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.938 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-16T13:15:08.939 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.939 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.939 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.939 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2023-10-16T13:15:08.939 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.939 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.940 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.940 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.940 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_haproxy": { 2023-10-16T13:15:08.940 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_haproxy", 2023-10-16T13:15:08.940 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.941 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.941 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.941 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-16T13:15:08.941 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.941 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.941 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.942 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "HAproxy container image", 2023-10-16T13:15:08.942 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.942 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.942 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.942 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.943 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_agent": { 2023-10-16T13:15:08.943 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_agent", 2023-10-16T13:15:08.943 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.943 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.943 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.944 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-16T13:15:08.944 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.944 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.944 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.944 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger agent container image", 2023-10-16T13:15:08.944 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.945 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.945 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.945 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.945 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_collector": { 2023-10-16T13:15:08.945 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_collector", 2023-10-16T13:15:08.946 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.946 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.946 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.946 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-16T13:15:08.946 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.947 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.947 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.947 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger collector container image", 2023-10-16T13:15:08.947 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.947 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.947 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.948 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.948 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_query": { 2023-10-16T13:15:08.948 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_query", 2023-10-16T13:15:08.948 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.948 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.949 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.949 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-16T13:15:08.949 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.949 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.949 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.949 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger query container image", 2023-10-16T13:15:08.950 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.950 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.950 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.950 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.951 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_keepalived": { 2023-10-16T13:15:08.951 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_keepalived", 2023-10-16T13:15:08.951 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.951 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.951 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.952 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-16T13:15:08.952 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.952 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.952 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.952 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Keepalived container image", 2023-10-16T13:15:08.953 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.953 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.953 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.953 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.953 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_loki": { 2023-10-16T13:15:08.954 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_loki", 2023-10-16T13:15:08.954 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.954 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.954 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.954 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-16T13:15:08.955 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.955 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.955 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.955 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Loki container image", 2023-10-16T13:15:08.955 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.956 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.956 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.956 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.956 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_node_exporter": { 2023-10-16T13:15:08.956 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_node_exporter", 2023-10-16T13:15:08.957 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.957 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.957 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.957 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-16T13:15:08.957 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.957 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.958 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.958 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2023-10-16T13:15:08.958 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.958 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.958 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.959 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.959 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_nvmeof": { 2023-10-16T13:15:08.959 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_nvmeof", 2023-10-16T13:15:08.959 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.959 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.960 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.960 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-16T13:15:08.960 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.960 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.960 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.961 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Nvme-of container image", 2023-10-16T13:15:08.961 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.961 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.961 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.961 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.961 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_prometheus": { 2023-10-16T13:15:08.962 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_prometheus", 2023-10-16T13:15:08.962 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.962 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.962 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.962 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-16T13:15:08.963 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.963 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.963 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.963 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2023-10-16T13:15:08.963 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.963 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.964 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.964 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.964 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_promtail": { 2023-10-16T13:15:08.964 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_promtail", 2023-10-16T13:15:08.964 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.965 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.965 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.965 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-16T13:15:08.965 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.965 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.965 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.966 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Promtail container image", 2023-10-16T13:15:08.966 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.966 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.966 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.966 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.967 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_snmp_gateway": { 2023-10-16T13:15:08.967 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_snmp_gateway", 2023-10-16T13:15:08.967 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.967 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.967 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.967 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-16T13:15:08.968 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.968 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.968 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.968 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SNMP Gateway container image", 2023-10-16T13:15:08.968 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.969 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.969 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.969 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.969 INFO:teuthology.orchestra.run.smithi092.stdout: "container_init": { 2023-10-16T13:15:08.969 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_init", 2023-10-16T13:15:08.970 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.970 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.970 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.970 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.970 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.971 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.971 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.971 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Run podman/docker with `--init`", 2023-10-16T13:15:08.971 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.971 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.971 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.972 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.972 INFO:teuthology.orchestra.run.smithi092.stdout: "daemon_cache_timeout": { 2023-10-16T13:15:08.972 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "daemon_cache_timeout", 2023-10-16T13:15:08.972 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:08.972 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.972 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.973 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2023-10-16T13:15:08.973 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.973 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.973 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.973 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-16T13:15:08.973 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.974 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.974 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.974 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.974 INFO:teuthology.orchestra.run.smithi092.stdout: "default_cephadm_command_timeout": { 2023-10-16T13:15:08.974 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_cephadm_command_timeout", 2023-10-16T13:15:08.974 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:08.975 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.975 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.975 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "900", 2023-10-16T13:15:08.975 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.975 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.976 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.976 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-16T13:15:08.976 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.976 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.976 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.976 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.977 INFO:teuthology.orchestra.run.smithi092.stdout: "default_registry": { 2023-10-16T13:15:08.977 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_registry", 2023-10-16T13:15:08.977 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.977 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.977 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.977 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io", 2023-10-16T13:15:08.977 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.978 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.978 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.978 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-16T13:15:08.978 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.978 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.979 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.979 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.979 INFO:teuthology.orchestra.run.smithi092.stdout: "device_cache_timeout": { 2023-10-16T13:15:08.979 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_cache_timeout", 2023-10-16T13:15:08.979 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:08.980 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.980 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.980 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1800", 2023-10-16T13:15:08.980 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.980 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.980 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.981 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache device inventory", 2023-10-16T13:15:08.981 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.981 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.981 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.981 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.981 INFO:teuthology.orchestra.run.smithi092.stdout: "device_enhanced_scan": { 2023-10-16T13:15:08.982 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_enhanced_scan", 2023-10-16T13:15:08.982 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.982 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.982 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.982 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.983 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.983 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.983 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.983 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-16T13:15:08.983 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.984 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.984 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.984 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.984 INFO:teuthology.orchestra.run.smithi092.stdout: "facts_cache_timeout": { 2023-10-16T13:15:08.984 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "facts_cache_timeout", 2023-10-16T13:15:08.984 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:08.985 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.985 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.985 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2023-10-16T13:15:08.985 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.985 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.985 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.986 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache host facts data", 2023-10-16T13:15:08.986 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.986 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.986 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.986 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.987 INFO:teuthology.orchestra.run.smithi092.stdout: "host_check_interval": { 2023-10-16T13:15:08.987 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "host_check_interval", 2023-10-16T13:15:08.987 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:08.987 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.987 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.987 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2023-10-16T13:15:08.988 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.988 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.988 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.988 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to perform a host check", 2023-10-16T13:15:08.988 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.988 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.988 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.989 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.989 INFO:teuthology.orchestra.run.smithi092.stdout: "inventory_list_all": { 2023-10-16T13:15:08.989 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "inventory_list_all", 2023-10-16T13:15:08.989 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.989 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.989 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.990 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.990 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.990 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.990 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.990 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-16T13:15:08.991 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.991 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.991 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.991 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.991 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:08.991 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:08.992 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:08.992 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.992 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:08.992 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:08.992 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.992 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.993 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:08.993 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:08.993 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:08.993 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:08.993 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:08.993 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:08.994 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:08.994 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:08.994 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:08.994 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.994 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.994 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.995 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.995 INFO:teuthology.orchestra.run.smithi092.stdout: "log_refresh_metadata": { 2023-10-16T13:15:08.995 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_refresh_metadata", 2023-10-16T13:15:08.995 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.995 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.996 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.996 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:08.996 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.996 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.996 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.996 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-16T13:15:08.997 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.997 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:08.997 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:08.997 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:08.997 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:08.998 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:08.998 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:08.998 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:08.998 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:08.998 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:08.999 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:08.999 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:08.999 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:08.999 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-16T13:15:08.999 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:08.999 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.000 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.000 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.000 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.000 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.000 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.001 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.001 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.001 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.001 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.001 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.002 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.002 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.002 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.002 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.002 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.002 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.003 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.003 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.003 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.003 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.003 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.003 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.004 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.004 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.004 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.004 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.004 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.005 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.005 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.005 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.005 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.005 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.005 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.006 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.006 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.006 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.006 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.006 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-16T13:15:09.006 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-16T13:15:09.007 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.007 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.007 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.007 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.007 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.007 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.008 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.008 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-16T13:15:09.008 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.008 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.008 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.009 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.009 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-16T13:15:09.009 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-16T13:15:09.009 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.009 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.009 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.010 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "*", 2023-10-16T13:15:09.010 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.010 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.010 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.010 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-16T13:15:09.011 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.011 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.011 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.011 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.011 INFO:teuthology.orchestra.run.smithi092.stdout: "max_count_per_host": { 2023-10-16T13:15:09.011 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_count_per_host", 2023-10-16T13:15:09.012 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.012 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.012 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.012 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:09.012 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.012 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.013 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.013 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of daemons per service per host", 2023-10-16T13:15:09.013 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.013 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.013 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.013 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.014 INFO:teuthology.orchestra.run.smithi092.stdout: "max_osd_draining_count": { 2023-10-16T13:15:09.014 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_osd_draining_count", 2023-10-16T13:15:09.014 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.014 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.014 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.014 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:09.015 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.015 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.015 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.015 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-16T13:15:09.015 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.015 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.016 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.016 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.016 INFO:teuthology.orchestra.run.smithi092.stdout: "migration_current": { 2023-10-16T13:15:09.016 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "migration_current", 2023-10-16T13:15:09.016 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.016 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.017 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.017 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.017 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.017 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.017 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.017 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "internal - do not modify", 2023-10-16T13:15:09.018 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.018 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.018 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.018 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.018 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2023-10-16T13:15:09.019 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2023-10-16T13:15:09.019 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.019 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.019 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.019 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "root", 2023-10-16T13:15:09.019 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.020 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.020 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.020 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm-package", 2023-10-16T13:15:09.020 INFO:teuthology.orchestra.run.smithi092.stdout: "root" 2023-10-16T13:15:09.020 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.020 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "mode for remote execution of cephadm", 2023-10-16T13:15:09.021 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.021 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.021 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.021 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.021 INFO:teuthology.orchestra.run.smithi092.stdout: "prometheus_alerts_path": { 2023-10-16T13:15:09.021 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus_alerts_path", 2023-10-16T13:15:09.022 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.022 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.022 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.022 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-16T13:15:09.022 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.022 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.023 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.023 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-16T13:15:09.023 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.023 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.023 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.023 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.024 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_insecure": { 2023-10-16T13:15:09.024 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_insecure", 2023-10-16T13:15:09.024 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.024 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.024 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.025 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.025 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.025 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.025 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.025 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-16T13:15:09.025 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.026 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.026 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.026 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.026 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_password": { 2023-10-16T13:15:09.026 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_password", 2023-10-16T13:15:09.026 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.027 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.027 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.027 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.027 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.027 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.027 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.028 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-16T13:15:09.028 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.028 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.028 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.028 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.029 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_url": { 2023-10-16T13:15:09.029 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_url", 2023-10-16T13:15:09.029 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.029 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.029 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.029 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.030 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.030 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.030 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.030 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-16T13:15:09.030 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.031 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.031 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.031 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.031 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_username": { 2023-10-16T13:15:09.031 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_username", 2023-10-16T13:15:09.032 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.032 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.032 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.032 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.032 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.033 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.033 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.033 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-16T13:15:09.033 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.033 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.033 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.034 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.034 INFO:teuthology.orchestra.run.smithi092.stdout: "secure_monitoring_stack": { 2023-10-16T13:15:09.034 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "secure_monitoring_stack", 2023-10-16T13:15:09.034 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.034 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.035 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.035 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.035 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.035 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.035 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.036 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-16T13:15:09.036 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.036 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.036 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.036 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.037 INFO:teuthology.orchestra.run.smithi092.stdout: "service_discovery_port": { 2023-10-16T13:15:09.037 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "service_discovery_port", 2023-10-16T13:15:09.037 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.037 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.037 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.038 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8765", 2023-10-16T13:15:09.038 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.038 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.038 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.038 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "cephadm service discovery port", 2023-10-16T13:15:09.039 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.039 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.039 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.039 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.039 INFO:teuthology.orchestra.run.smithi092.stdout: "ssh_config_file": { 2023-10-16T13:15:09.040 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssh_config_file", 2023-10-16T13:15:09.040 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.040 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.040 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.040 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.041 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.041 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.041 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.041 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-16T13:15:09.041 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.042 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.042 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.042 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.042 INFO:teuthology.orchestra.run.smithi092.stdout: "use_agent": { 2023-10-16T13:15:09.042 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_agent", 2023-10-16T13:15:09.043 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.043 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.043 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.043 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.043 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.044 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.044 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.044 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-16T13:15:09.044 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.044 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.044 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.045 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.045 INFO:teuthology.orchestra.run.smithi092.stdout: "use_repo_digest": { 2023-10-16T13:15:09.045 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_repo_digest", 2023-10-16T13:15:09.045 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.045 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.046 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.046 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.046 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.046 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.046 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.047 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-16T13:15:09.047 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.047 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.047 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.048 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.048 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_failed_host_check": { 2023-10-16T13:15:09.048 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_failed_host_check", 2023-10-16T13:15:09.048 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.048 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.049 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.049 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.049 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.049 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.049 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.049 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if the host check fails", 2023-10-16T13:15:09.050 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.050 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.050 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.050 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.050 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_daemons": { 2023-10-16T13:15:09.051 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_daemons", 2023-10-16T13:15:09.051 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.051 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.051 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.051 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.052 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.052 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.052 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.052 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-16T13:15:09.052 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.052 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.053 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.053 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.053 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_hosts": { 2023-10-16T13:15:09.053 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_hosts", 2023-10-16T13:15:09.053 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.054 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.054 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.054 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.054 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.054 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.055 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.055 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-16T13:15:09.055 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.055 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.055 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.056 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.056 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.056 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.056 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.056 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crash", 2023-10-16T13:15:09.057 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.057 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.057 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.057 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.057 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.058 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.058 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.058 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.058 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.058 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.059 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.059 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.059 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.059 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.060 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.060 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.060 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.060 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.060 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.060 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.061 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.061 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.061 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.061 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.061 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.062 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.062 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.062 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.062 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.062 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.063 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.063 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.063 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.063 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.063 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.064 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.064 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.064 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.064 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.064 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.064 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.065 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.065 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.065 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.065 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.065 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.066 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.066 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.066 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.066 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.066 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.067 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.067 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.067 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.067 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.067 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.067 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.068 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.068 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.068 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.068 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.068 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.069 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.069 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.069 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.069 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.069 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.070 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.070 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.070 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.070 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.070 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.070 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.071 INFO:teuthology.orchestra.run.smithi092.stdout: "retain_interval": { 2023-10-16T13:15:09.071 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retain_interval", 2023-10-16T13:15:09.071 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:09.071 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.071 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.072 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "31536000", 2023-10-16T13:15:09.072 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.072 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.072 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.072 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-16T13:15:09.072 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.073 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.073 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.073 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.073 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_recent_interval": { 2023-10-16T13:15:09.073 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_recent_interval", 2023-10-16T13:15:09.074 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:09.074 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.074 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.074 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1209600", 2023-10-16T13:15:09.074 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.075 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.075 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.075 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-16T13:15:09.075 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.075 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.075 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.076 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.076 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.076 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.076 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.076 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dashboard", 2023-10-16T13:15:09.077 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.077 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.077 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.077 INFO:teuthology.orchestra.run.smithi092.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-16T13:15:09.077 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-16T13:15:09.077 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.078 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.078 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.078 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:09.078 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.078 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.079 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.079 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.079 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.079 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.079 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.080 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.080 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_HOST": { 2023-10-16T13:15:09.080 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-16T13:15:09.080 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.080 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.080 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.081 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.081 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.081 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.081 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.081 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.082 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.082 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.082 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.082 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.082 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-16T13:15:09.083 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-16T13:15:09.083 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.083 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.083 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.083 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.084 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.084 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.084 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.084 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.084 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.084 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.085 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.085 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.085 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_ENABLED": { 2023-10-16T13:15:09.085 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_ENABLED", 2023-10-16T13:15:09.085 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.086 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.086 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.086 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.086 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.086 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.087 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.087 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.087 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.087 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.087 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.088 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.088 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-16T13:15:09.088 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-16T13:15:09.088 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.088 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.089 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.089 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.089 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.089 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.089 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.090 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.090 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.090 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.090 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.090 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.091 INFO:teuthology.orchestra.run.smithi092.stdout: "ENABLE_BROWSABLE_API": { 2023-10-16T13:15:09.091 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-16T13:15:09.091 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.091 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.091 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.092 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.092 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.092 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.092 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.092 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.093 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.093 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.093 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.093 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.093 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-16T13:15:09.094 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-16T13:15:09.094 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.094 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.094 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.094 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.095 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.095 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.095 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.095 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.095 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.096 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.096 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.096 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.096 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-16T13:15:09.096 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-16T13:15:09.097 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.097 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.097 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.097 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.097 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.098 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.098 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.098 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.098 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.098 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.099 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.099 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.099 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-16T13:15:09.099 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-16T13:15:09.099 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.100 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.100 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.100 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.100 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.100 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.101 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.101 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.101 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.101 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.101 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.102 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.102 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-16T13:15:09.102 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-16T13:15:09.102 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.102 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.103 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.103 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.103 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.103 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.103 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.104 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.104 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.104 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.104 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.104 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.105 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-16T13:15:09.105 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-16T13:15:09.105 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.105 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.105 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.105 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.106 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.106 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.106 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.106 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.106 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.107 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.107 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.107 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.107 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-16T13:15:09.107 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-16T13:15:09.107 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.108 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.108 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.108 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.108 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.108 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.109 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.109 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.109 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.109 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.110 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.110 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.110 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-16T13:15:09.110 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-16T13:15:09.110 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.111 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.111 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.111 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.111 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.111 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.112 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.112 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.112 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.112 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.112 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.113 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.113 INFO:teuthology.orchestra.run.smithi092.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-16T13:15:09.113 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-16T13:15:09.113 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.113 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.114 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.114 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.114 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.114 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.114 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.115 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.115 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.115 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.115 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.115 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.116 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_PASSWORD": { 2023-10-16T13:15:09.116 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-16T13:15:09.116 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.116 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.116 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.117 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2023-10-16T13:15:09.117 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.117 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.117 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.117 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.118 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.118 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.118 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.118 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.118 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-16T13:15:09.119 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-16T13:15:09.119 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.119 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.119 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.119 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.120 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.120 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.120 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.120 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.120 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.121 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.121 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.121 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.121 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_URL": { 2023-10-16T13:15:09.121 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_URL", 2023-10-16T13:15:09.122 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.122 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.122 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.122 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.122 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.123 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.123 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.123 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.123 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.123 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.124 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.124 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.124 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_USERNAME": { 2023-10-16T13:15:09.124 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-16T13:15:09.124 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.125 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.125 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.125 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2023-10-16T13:15:09.125 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.125 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.126 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.126 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.126 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.126 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.126 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.127 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.127 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-16T13:15:09.127 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-16T13:15:09.127 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.127 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.128 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.128 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.128 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.128 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.128 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.129 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.129 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.129 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.129 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.129 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.129 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-16T13:15:09.130 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-16T13:15:09.130 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.130 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.130 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.130 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.131 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.131 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.131 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.131 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.131 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.131 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.132 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.132 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.132 INFO:teuthology.orchestra.run.smithi092.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-16T13:15:09.132 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-16T13:15:09.133 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.133 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.133 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.133 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.133 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.133 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.134 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.134 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.134 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.134 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.134 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.135 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.135 INFO:teuthology.orchestra.run.smithi092.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-16T13:15:09.135 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-16T13:15:09.135 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.135 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.136 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.136 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.136 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.136 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.136 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.137 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.137 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.137 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.137 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.137 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.138 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_HOST": { 2023-10-16T13:15:09.138 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-16T13:15:09.138 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.138 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.138 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.139 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.139 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.139 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.139 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.139 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.140 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.140 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.140 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.140 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.140 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-16T13:15:09.141 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-16T13:15:09.141 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.141 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.141 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.141 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.142 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.142 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.142 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.142 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.142 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.143 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.143 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.143 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.143 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-16T13:15:09.143 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-16T13:15:09.144 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.144 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.144 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.144 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.144 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.145 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.145 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.145 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.145 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.145 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.146 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.146 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.146 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-16T13:15:09.146 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-16T13:15:09.146 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.147 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.147 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.147 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.147 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.147 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.148 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.148 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.148 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.148 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.148 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.149 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.149 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-16T13:15:09.149 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-16T13:15:09.149 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.149 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.149 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.150 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.150 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.150 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.150 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.151 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.151 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.151 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.151 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.151 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.151 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-16T13:15:09.152 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-16T13:15:09.152 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.152 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.152 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.152 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.153 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.153 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.153 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.153 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.153 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.153 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.154 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.154 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.154 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-16T13:15:09.154 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-16T13:15:09.154 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.155 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.155 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.155 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.155 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.155 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.156 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.156 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.156 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.156 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.156 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.157 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.157 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-16T13:15:09.157 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-16T13:15:09.157 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.157 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.158 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.158 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.158 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.158 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.158 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.159 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.159 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.159 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.159 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.159 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.160 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-16T13:15:09.160 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-16T13:15:09.160 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.160 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.160 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.161 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.161 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.161 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.161 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.161 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.162 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.162 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.162 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.162 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.162 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_ENABLED": { 2023-10-16T13:15:09.162 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-16T13:15:09.163 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.163 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.163 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.163 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.163 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.164 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.164 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.164 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.164 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.164 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.165 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.165 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.165 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-16T13:15:09.165 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-16T13:15:09.165 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.166 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.166 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.166 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-16T13:15:09.166 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.166 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.166 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.167 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.167 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.167 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.167 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.167 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.167 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-16T13:15:09.168 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-16T13:15:09.168 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.168 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.168 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.168 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:09.168 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.169 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.169 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.169 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.169 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.169 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.169 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.170 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.170 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-16T13:15:09.170 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-16T13:15:09.170 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.170 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.171 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.171 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8", 2023-10-16T13:15:09.171 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.171 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.171 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.171 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.172 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.172 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.172 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.172 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.172 INFO:teuthology.orchestra.run.smithi092.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-16T13:15:09.173 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-16T13:15:09.173 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.173 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.173 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.173 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "45", 2023-10-16T13:15:09.173 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.174 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.174 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.174 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.174 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.174 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.175 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.175 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.175 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ACCESS_KEY": { 2023-10-16T13:15:09.175 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-16T13:15:09.175 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.176 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.176 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.176 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.176 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.176 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.177 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.177 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.177 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.177 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.177 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.177 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.178 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-16T13:15:09.178 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-16T13:15:09.178 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.178 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.178 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.179 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2023-10-16T13:15:09.179 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.179 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.179 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.179 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.179 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.180 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.180 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.180 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.180 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SECRET_KEY": { 2023-10-16T13:15:09.180 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-16T13:15:09.181 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.181 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.181 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.181 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.181 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.182 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.182 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.182 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.182 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.182 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.182 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.183 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.183 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SSL_VERIFY": { 2023-10-16T13:15:09.183 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-16T13:15:09.183 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.183 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.184 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.184 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.184 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.184 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.184 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.184 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.185 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.185 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.185 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.185 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.185 INFO:teuthology.orchestra.run.smithi092.stdout: "UNSAFE_TLS_v1_2": { 2023-10-16T13:15:09.185 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-16T13:15:09.186 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.186 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.186 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.186 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.186 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.187 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.187 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.187 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.187 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.187 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.187 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.188 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.188 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-16T13:15:09.188 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-16T13:15:09.188 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.188 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.189 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.189 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2023-10-16T13:15:09.189 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.189 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.189 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.189 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.190 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.190 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.190 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.190 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.190 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-16T13:15:09.191 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-16T13:15:09.191 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.191 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.191 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.191 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:09.191 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.192 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.192 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.192 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.192 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.192 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.193 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.193 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.193 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-16T13:15:09.193 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-16T13:15:09.193 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.193 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.194 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.194 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2023-10-16T13:15:09.194 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.194 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.194 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.195 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.195 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.195 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.195 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.195 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.195 INFO:teuthology.orchestra.run.smithi092.stdout: "cross_origin_url": { 2023-10-16T13:15:09.195 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cross_origin_url", 2023-10-16T13:15:09.196 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.196 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.196 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.196 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.196 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.197 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.197 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.197 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.197 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.197 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.197 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.198 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.198 INFO:teuthology.orchestra.run.smithi092.stdout: "crt_file": { 2023-10-16T13:15:09.198 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crt_file", 2023-10-16T13:15:09.198 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.198 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.199 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.199 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.199 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.199 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.199 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.199 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.200 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.200 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.200 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.200 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.200 INFO:teuthology.orchestra.run.smithi092.stdout: "debug": { 2023-10-16T13:15:09.201 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "debug", 2023-10-16T13:15:09.201 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.201 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.201 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.201 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.202 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.202 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.202 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.202 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable/disable debug options", 2023-10-16T13:15:09.202 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.203 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.203 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.203 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.203 INFO:teuthology.orchestra.run.smithi092.stdout: "jwt_token_ttl": { 2023-10-16T13:15:09.203 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "jwt_token_ttl", 2023-10-16T13:15:09.203 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.204 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.204 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.204 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "28800", 2023-10-16T13:15:09.204 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.204 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.204 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.205 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.205 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.205 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.205 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.205 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.206 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2023-10-16T13:15:09.206 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2023-10-16T13:15:09.206 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.206 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.206 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.207 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.207 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.207 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.207 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.207 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.208 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.208 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.208 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.208 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.208 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.209 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.209 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.209 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.209 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.209 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.209 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.210 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.210 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.210 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.210 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.210 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.211 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.211 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.211 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.211 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.211 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.212 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.212 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.212 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.212 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.212 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.212 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.213 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.213 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.213 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.213 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.213 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.213 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.214 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.214 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.214 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.214 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.214 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.215 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.215 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.215 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.215 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.215 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.216 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.216 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.216 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.216 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.216 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.216 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.217 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.217 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.217 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.217 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.217 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.217 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.218 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.218 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.218 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.218 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.218 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.218 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.219 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.219 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.219 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.219 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.219 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.220 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.220 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.220 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.220 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.220 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.220 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.221 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.221 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.221 INFO:teuthology.orchestra.run.smithi092.stdout: "motd": { 2023-10-16T13:15:09.221 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "motd", 2023-10-16T13:15:09.221 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.222 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.222 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.222 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.222 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.222 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.222 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.223 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "The message of the day", 2023-10-16T13:15:09.223 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.223 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.223 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.223 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.223 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect_resolve_ip_addr": { 2023-10-16T13:15:09.224 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "redirect_resolve_ip_addr", 2023-10-16T13:15:09.224 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.224 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.224 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.224 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.224 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.225 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.225 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.225 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.225 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.225 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.225 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.226 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.226 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2023-10-16T13:15:09.226 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2023-10-16T13:15:09.226 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.226 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.227 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.227 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2023-10-16T13:15:09.227 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.227 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.227 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.227 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.228 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.228 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.228 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.228 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.228 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2023-10-16T13:15:09.229 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2023-10-16T13:15:09.229 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.229 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.229 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.229 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8080", 2023-10-16T13:15:09.229 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.230 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.230 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.230 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.230 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.230 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.231 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.231 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.231 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2023-10-16T13:15:09.231 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2023-10-16T13:15:09.231 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.231 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.232 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.232 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.232 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.232 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.232 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.233 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.233 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.233 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.233 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.233 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.234 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl_server_port": { 2023-10-16T13:15:09.234 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl_server_port", 2023-10-16T13:15:09.234 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.234 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.234 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.235 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8443", 2023-10-16T13:15:09.235 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.235 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.235 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.235 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.235 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.236 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.236 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.236 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.236 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2023-10-16T13:15:09.236 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2023-10-16T13:15:09.237 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.237 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.237 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.237 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "redirect", 2023-10-16T13:15:09.237 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.237 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.238 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.238 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.238 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect" 2023-10-16T13:15:09.238 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.238 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.238 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.239 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.239 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.239 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.239 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2023-10-16T13:15:09.239 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2023-10-16T13:15:09.240 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.240 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.240 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.240 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2023-10-16T13:15:09.240 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2023-10-16T13:15:09.240 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2023-10-16T13:15:09.241 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.241 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.241 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.241 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.241 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.242 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.242 INFO:teuthology.orchestra.run.smithi092.stdout: "url_prefix": { 2023-10-16T13:15:09.242 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url_prefix", 2023-10-16T13:15:09.242 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.242 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.243 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.243 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.243 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.243 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.243 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.243 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.244 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.244 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.244 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.244 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.244 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.244 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.245 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.245 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "devicehealth", 2023-10-16T13:15:09.245 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.245 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.245 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.245 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_monitoring": { 2023-10-16T13:15:09.246 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_monitoring", 2023-10-16T13:15:09.246 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.246 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.246 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.246 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.247 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.247 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.247 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.247 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "monitor device health metrics", 2023-10-16T13:15:09.248 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.248 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.248 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.248 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.248 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.248 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.249 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.249 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.249 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.249 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.249 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.250 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.250 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.250 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.250 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.250 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.250 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.251 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.251 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.251 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.251 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.251 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.252 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.252 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.252 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.252 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.252 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.252 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.253 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.253 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.253 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.253 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.254 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.254 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.254 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.254 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.254 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.255 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.255 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.255 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.255 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.255 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.255 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.256 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.256 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.256 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.256 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.256 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.257 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.257 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.257 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.257 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.257 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.257 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.258 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.258 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.258 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.258 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.258 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.259 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.259 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.259 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.259 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.259 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.260 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.260 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.260 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.260 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.260 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.261 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.261 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.261 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.261 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.261 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.261 INFO:teuthology.orchestra.run.smithi092.stdout: "mark_out_threshold": { 2023-10-16T13:15:09.262 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mark_out_threshold", 2023-10-16T13:15:09.262 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:09.262 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.262 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.262 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2419200", 2023-10-16T13:15:09.263 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.263 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.263 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.263 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-16T13:15:09.263 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.264 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.264 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.264 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.264 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_name": { 2023-10-16T13:15:09.264 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_name", 2023-10-16T13:15:09.264 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.264 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.265 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.265 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "device_health_metrics", 2023-10-16T13:15:09.265 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.265 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.265 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.266 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-16T13:15:09.266 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.266 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.266 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.266 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.266 INFO:teuthology.orchestra.run.smithi092.stdout: "retention_period": { 2023-10-16T13:15:09.267 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retention_period", 2023-10-16T13:15:09.267 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:09.267 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.267 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.267 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15552000", 2023-10-16T13:15:09.267 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.268 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.268 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.268 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain device health metrics", 2023-10-16T13:15:09.268 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.268 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.268 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.269 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.269 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_frequency": { 2023-10-16T13:15:09.269 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_frequency", 2023-10-16T13:15:09.269 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:09.269 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.269 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.270 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2023-10-16T13:15:09.270 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.270 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.270 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.270 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-16T13:15:09.270 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.271 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.271 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.271 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.271 INFO:teuthology.orchestra.run.smithi092.stdout: "self_heal": { 2023-10-16T13:15:09.271 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "self_heal", 2023-10-16T13:15:09.272 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.272 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.272 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.272 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.272 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.272 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.273 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.273 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-16T13:15:09.273 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.273 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.273 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.273 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.274 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2023-10-16T13:15:09.274 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2023-10-16T13:15:09.274 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:09.274 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.274 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.275 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2023-10-16T13:15:09.275 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.275 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.275 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.275 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and check device health", 2023-10-16T13:15:09.275 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.276 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.276 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.276 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.276 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_threshold": { 2023-10-16T13:15:09.276 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_threshold", 2023-10-16T13:15:09.276 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:09.277 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.277 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.277 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7257600", 2023-10-16T13:15:09.277 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.277 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.277 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.278 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-16T13:15:09.278 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.278 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.278 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.278 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.278 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.279 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.279 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.279 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "diskprediction_local", 2023-10-16T13:15:09.279 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.279 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.279 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.280 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.280 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.280 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.280 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.280 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.281 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.281 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.281 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.281 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.281 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.282 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.282 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.282 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.282 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.282 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.282 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.283 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.283 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.283 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.283 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.283 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.284 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.284 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.284 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.284 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.284 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.285 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.285 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.285 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.285 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.285 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.285 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.286 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.286 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.286 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.286 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.286 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.287 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.287 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.287 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.287 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.287 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.287 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.287 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.288 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.288 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.288 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.288 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.288 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.288 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.289 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.289 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.289 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.289 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.289 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.290 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.290 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.290 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.290 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.290 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.291 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.291 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.291 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.291 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.291 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.291 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.292 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.292 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.292 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.292 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.292 INFO:teuthology.orchestra.run.smithi092.stdout: "predict_interval": { 2023-10-16T13:15:09.292 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predict_interval", 2023-10-16T13:15:09.293 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.293 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.293 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.293 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2023-10-16T13:15:09.293 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.294 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.294 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.294 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.294 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.294 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.294 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.295 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.295 INFO:teuthology.orchestra.run.smithi092.stdout: "predictor_model": { 2023-10-16T13:15:09.295 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predictor_model", 2023-10-16T13:15:09.295 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.295 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.296 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.296 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "prophetstor", 2023-10-16T13:15:09.296 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.296 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.297 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.297 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.297 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.297 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.297 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.298 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.298 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2023-10-16T13:15:09.298 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2023-10-16T13:15:09.298 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.298 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.299 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.299 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2023-10-16T13:15:09.299 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.299 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.299 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.300 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.300 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.300 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.300 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.301 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.301 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.301 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.301 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.301 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "influx", 2023-10-16T13:15:09.302 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": false, 2023-10-16T13:15:09.302 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "influxdb python module not found", 2023-10-16T13:15:09.302 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.302 INFO:teuthology.orchestra.run.smithi092.stdout: "batch_size": { 2023-10-16T13:15:09.303 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "batch_size", 2023-10-16T13:15:09.303 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.303 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.303 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.303 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5000", 2023-10-16T13:15:09.304 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.304 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.304 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.304 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-16T13:15:09.304 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.305 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.305 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.305 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.305 INFO:teuthology.orchestra.run.smithi092.stdout: "database": { 2023-10-16T13:15:09.306 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "database", 2023-10-16T13:15:09.306 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.306 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.306 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.307 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "ceph", 2023-10-16T13:15:09.307 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.307 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.307 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.307 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-16T13:15:09.308 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.308 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.308 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.308 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.308 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": { 2023-10-16T13:15:09.309 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hostname", 2023-10-16T13:15:09.309 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.309 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.309 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.309 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.309 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.310 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.310 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.310 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server hostname", 2023-10-16T13:15:09.310 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.310 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.311 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.311 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.311 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2023-10-16T13:15:09.311 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2023-10-16T13:15:09.311 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:09.312 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.312 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.312 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "30", 2023-10-16T13:15:09.312 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "5", 2023-10-16T13:15:09.312 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.313 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.313 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-16T13:15:09.313 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.313 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.313 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.313 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.314 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.314 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.314 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.314 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.315 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.315 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.315 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.315 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.315 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.315 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.316 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.316 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.316 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.316 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.316 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.317 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.317 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.317 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.317 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.317 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.318 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.318 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.318 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.318 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.318 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.318 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.319 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.319 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.319 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.319 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.319 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.320 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.320 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.320 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.320 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.320 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.321 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.321 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.321 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.321 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.321 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.321 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.322 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.322 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.322 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.322 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.322 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.323 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.323 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.323 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.323 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.323 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.323 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.324 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.324 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.324 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.324 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.324 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.324 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.325 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.325 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.325 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.325 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.325 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.325 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.326 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.326 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.326 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.326 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.326 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.327 INFO:teuthology.orchestra.run.smithi092.stdout: "password": { 2023-10-16T13:15:09.327 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "password", 2023-10-16T13:15:09.327 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.327 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.328 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.328 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.328 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.328 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.328 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.329 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "password of InfluxDB server user", 2023-10-16T13:15:09.329 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.329 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.329 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.329 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.330 INFO:teuthology.orchestra.run.smithi092.stdout: "port": { 2023-10-16T13:15:09.330 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "port", 2023-10-16T13:15:09.330 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.330 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.330 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.331 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8086", 2023-10-16T13:15:09.331 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.331 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.331 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.331 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server port", 2023-10-16T13:15:09.332 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.332 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.332 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.332 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.332 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2023-10-16T13:15:09.332 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2023-10-16T13:15:09.333 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.333 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.333 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.333 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "false", 2023-10-16T13:15:09.333 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.333 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.334 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.334 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-16T13:15:09.334 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.334 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.334 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.335 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.335 INFO:teuthology.orchestra.run.smithi092.stdout: "threads": { 2023-10-16T13:15:09.335 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threads", 2023-10-16T13:15:09.335 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.335 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.335 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.336 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2023-10-16T13:15:09.336 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2023-10-16T13:15:09.336 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "32", 2023-10-16T13:15:09.336 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.336 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-16T13:15:09.336 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.337 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.337 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.337 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.337 INFO:teuthology.orchestra.run.smithi092.stdout: "username": { 2023-10-16T13:15:09.337 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "username", 2023-10-16T13:15:09.337 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.338 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.338 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.338 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.338 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.338 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.339 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.339 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "username of InfluxDB server user", 2023-10-16T13:15:09.339 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.339 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.339 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.339 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.340 INFO:teuthology.orchestra.run.smithi092.stdout: "verify_ssl": { 2023-10-16T13:15:09.340 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "verify_ssl", 2023-10-16T13:15:09.340 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.340 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.340 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.341 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "true", 2023-10-16T13:15:09.341 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.341 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.341 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.341 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-16T13:15:09.341 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.342 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.342 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.342 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.342 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.342 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.343 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.343 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "insights", 2023-10-16T13:15:09.343 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.343 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.343 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.343 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.343 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.344 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.344 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.344 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.344 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.344 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.344 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.345 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.345 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.345 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.345 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.345 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.345 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.346 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.346 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.346 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.346 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.346 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.346 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.347 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.347 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.347 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.347 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.347 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.347 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.348 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.348 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.348 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.348 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.348 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.349 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.349 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.349 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.349 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.349 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.349 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.350 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.350 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.350 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.350 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.350 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.351 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.351 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.351 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.351 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.351 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.352 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.352 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.352 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.352 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.352 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.352 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.353 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.353 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.353 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.353 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.353 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.353 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.354 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.354 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.354 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.354 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.354 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.354 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.355 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.355 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.355 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.355 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.355 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.355 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.356 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.356 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.356 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "iostat", 2023-10-16T13:15:09.356 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.356 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.356 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.357 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.357 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.357 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.357 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.357 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.357 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.358 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.358 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.358 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.358 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.358 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.359 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.359 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.359 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.359 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.359 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.359 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.360 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.360 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.360 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.360 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.360 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.361 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.361 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.361 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.361 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.361 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.362 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.362 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.362 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.362 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.362 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.362 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.363 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.363 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.363 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.363 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.363 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.363 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.364 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.364 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.364 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.364 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.364 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.364 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.365 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.365 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.365 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.365 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.365 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.365 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.366 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.366 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.366 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.366 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.366 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.366 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.367 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.367 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.367 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.367 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.367 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.367 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.368 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.368 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.368 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.368 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.368 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.369 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.369 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.369 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.369 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.369 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.369 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "k8sevents", 2023-10-16T13:15:09.370 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.370 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.370 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.370 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_event_retention_days": { 2023-10-16T13:15:09.371 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ceph_event_retention_days", 2023-10-16T13:15:09.371 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.371 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.371 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.371 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7", 2023-10-16T13:15:09.372 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.372 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.372 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.372 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-16T13:15:09.372 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.373 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.373 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.373 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.373 INFO:teuthology.orchestra.run.smithi092.stdout: "config_check_secs": { 2023-10-16T13:15:09.373 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_check_secs", 2023-10-16T13:15:09.374 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.374 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.374 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.374 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:09.375 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "10", 2023-10-16T13:15:09.375 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.375 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.375 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-16T13:15:09.375 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.376 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.376 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.376 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.376 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.376 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.377 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.377 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.377 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.377 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.378 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.378 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.378 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.378 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.379 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.379 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.379 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.379 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.380 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.380 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.380 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.380 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.381 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.381 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.381 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.381 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.381 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.382 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.382 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.382 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.382 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.383 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.383 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.383 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.383 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.383 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.384 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.384 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.384 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.384 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.384 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.384 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.385 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.385 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.385 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.385 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.385 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.385 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.386 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.386 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.386 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.386 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.386 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.386 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.387 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.387 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.387 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.387 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.387 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.388 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.388 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.388 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.388 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.388 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.389 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.389 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.389 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.389 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.389 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.389 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.390 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.390 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.390 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.390 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.390 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.391 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.391 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.391 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "localpool", 2023-10-16T13:15:09.391 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.391 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.391 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.392 INFO:teuthology.orchestra.run.smithi092.stdout: "failure_domain": { 2023-10-16T13:15:09.392 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "failure_domain", 2023-10-16T13:15:09.392 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.392 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.392 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.392 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "host", 2023-10-16T13:15:09.392 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.393 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.393 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.393 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "failure domain for any created local pool", 2023-10-16T13:15:09.393 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-16T13:15:09.393 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.394 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.394 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.394 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.394 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.394 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.395 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.395 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.395 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.395 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.395 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.395 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.396 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.396 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.396 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.396 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.396 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.396 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.397 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.397 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.397 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.397 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.397 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.397 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.398 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.398 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.398 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.398 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.398 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.398 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.399 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.399 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.399 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.399 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.399 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.399 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.400 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.400 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.400 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.400 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.400 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.400 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.401 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.401 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.401 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.401 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.401 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.402 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.402 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.402 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.402 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.402 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.402 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.403 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.403 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.403 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.403 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.403 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.403 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.403 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.404 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.404 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.404 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.404 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.404 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.404 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.405 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.405 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.405 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.405 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.405 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.405 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.406 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.406 INFO:teuthology.orchestra.run.smithi092.stdout: "min_size": { 2023-10-16T13:15:09.406 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_size", 2023-10-16T13:15:09.406 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.406 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.407 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.407 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.407 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.407 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.407 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.408 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default min_size for any created local pool", 2023-10-16T13:15:09.408 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-16T13:15:09.408 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.408 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.408 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.408 INFO:teuthology.orchestra.run.smithi092.stdout: "num_rep": { 2023-10-16T13:15:09.409 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "num_rep", 2023-10-16T13:15:09.409 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.409 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.409 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.409 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3", 2023-10-16T13:15:09.409 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.410 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.410 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.410 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default replica count for any created local pool", 2023-10-16T13:15:09.410 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.410 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.411 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.411 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.411 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_num": { 2023-10-16T13:15:09.411 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_num", 2023-10-16T13:15:09.411 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.411 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.412 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.412 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "128", 2023-10-16T13:15:09.412 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.412 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.412 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.412 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default pg_num for any created local pool", 2023-10-16T13:15:09.413 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.413 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.413 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.413 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.413 INFO:teuthology.orchestra.run.smithi092.stdout: "prefix": { 2023-10-16T13:15:09.413 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prefix", 2023-10-16T13:15:09.414 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.414 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.414 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.414 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.414 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.414 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.415 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.415 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name prefix for any created local pool", 2023-10-16T13:15:09.415 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.415 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.415 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.416 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.416 INFO:teuthology.orchestra.run.smithi092.stdout: "subtree": { 2023-10-16T13:15:09.416 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "subtree", 2023-10-16T13:15:09.416 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.416 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.416 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.417 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "rack", 2023-10-16T13:15:09.417 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.417 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.417 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.417 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-16T13:15:09.418 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-16T13:15:09.418 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.418 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.418 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.418 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.419 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.419 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.419 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mds_autoscaler", 2023-10-16T13:15:09.419 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.419 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.419 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.420 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.420 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.420 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.420 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.420 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.420 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.421 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.421 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.421 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.421 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.421 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.422 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.422 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.422 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.422 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.422 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.422 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.423 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.423 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.423 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.423 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.423 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.423 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.424 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.424 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.424 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.424 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.424 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.424 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.425 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.425 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.425 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.425 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.425 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.427 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.427 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.427 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.427 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.427 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.428 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.428 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.428 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.428 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.428 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.428 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.429 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.429 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.429 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.429 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.429 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.430 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.430 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.430 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.430 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.430 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.431 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.431 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.431 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.431 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.431 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.431 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.432 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.432 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.432 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.432 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.432 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.433 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.433 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirroring", 2023-10-16T13:15:09.433 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.433 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.433 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.433 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.434 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.434 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.434 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.434 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.434 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.435 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.435 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.435 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.435 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.435 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.436 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.436 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.436 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.436 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.436 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.437 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.437 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.437 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.437 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.437 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.437 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.438 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.438 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.438 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.438 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.438 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.439 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.439 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.439 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.439 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.439 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.440 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.440 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.440 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.440 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.440 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.441 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.441 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.441 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.441 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.441 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.441 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.442 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.442 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.442 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.442 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.442 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.443 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.443 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.443 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.443 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.443 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.444 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.444 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.444 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.444 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.444 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.445 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.445 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.445 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.445 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.445 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.445 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.446 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.446 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.446 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.446 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.446 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.446 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.447 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.447 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.447 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.447 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "nfs", 2023-10-16T13:15:09.447 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.447 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.448 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.448 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.448 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.448 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.448 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.449 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.449 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.449 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.449 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.449 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.449 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.450 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.450 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.450 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.450 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.450 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.451 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.451 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.451 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.451 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.451 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.452 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.452 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.452 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.452 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.452 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.453 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.453 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.453 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.453 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.453 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.453 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.454 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.454 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.454 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.454 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.454 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.455 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.455 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.455 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.455 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.455 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.456 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.456 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.456 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.456 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.456 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.457 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.457 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.457 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.457 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.457 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.458 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.458 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.458 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.458 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.458 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.459 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.459 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.459 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.459 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.459 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.460 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.460 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.460 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.460 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.460 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.461 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.461 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.461 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.461 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.461 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.462 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.462 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.462 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2023-10-16T13:15:09.462 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.462 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.463 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.463 INFO:teuthology.orchestra.run.smithi092.stdout: "fail_fs": { 2023-10-16T13:15:09.463 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "fail_fs", 2023-10-16T13:15:09.463 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.463 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.464 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.464 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.464 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.464 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.464 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.464 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-16T13:15:09.465 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.465 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.465 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.465 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.465 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.466 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.466 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.466 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.466 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.466 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.467 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.467 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.467 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.467 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.467 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.468 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.468 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.468 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.468 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.468 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.468 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.469 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.469 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.469 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.469 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.469 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.470 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.470 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.470 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.470 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.470 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.471 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.471 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.471 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.471 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.471 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.471 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.472 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.472 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.472 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.472 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.472 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.473 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.473 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.473 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.473 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.473 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.474 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.474 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.474 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.474 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.474 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.475 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.475 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.475 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.475 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.475 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.476 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.476 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.476 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.476 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.476 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.476 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.477 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.477 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.477 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.477 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.477 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.477 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.478 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.478 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.478 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.478 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.478 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.478 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator": { 2023-10-16T13:15:09.479 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2023-10-16T13:15:09.479 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.479 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.479 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.479 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.479 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.480 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.480 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.480 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm", 2023-10-16T13:15:09.480 INFO:teuthology.orchestra.run.smithi092.stdout: "rook", 2023-10-16T13:15:09.480 INFO:teuthology.orchestra.run.smithi092.stdout: "test_orchestrator" 2023-10-16T13:15:09.481 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.481 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Orchestrator backend", 2023-10-16T13:15:09.481 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.481 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.481 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.481 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.482 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.482 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.482 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.482 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_perf_query", 2023-10-16T13:15:09.482 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.482 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.483 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.483 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.483 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.483 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.483 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.484 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.484 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.484 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.484 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.484 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.485 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.485 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.485 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.485 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.485 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.485 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.486 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.486 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.486 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.486 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.486 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.487 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.487 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.487 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.487 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.487 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.487 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.488 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.488 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.488 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.488 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.488 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.489 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.489 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.489 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.489 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.489 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.489 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.490 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.490 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.490 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.490 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.490 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.491 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.491 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.491 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.491 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.491 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.492 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.492 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.492 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.492 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.492 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.493 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.493 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.493 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.493 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.493 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.494 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.494 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.494 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.494 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.494 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.495 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.495 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.495 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.495 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.495 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.496 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.496 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.496 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.496 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.496 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.496 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.497 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_support", 2023-10-16T13:15:09.497 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.497 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.497 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.497 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.498 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.498 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.498 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.498 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.498 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.498 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.499 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.499 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.499 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.499 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.499 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.500 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.500 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.500 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.500 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.500 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.501 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.501 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.501 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.501 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.501 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.502 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.502 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.502 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.502 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.502 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.502 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.503 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.503 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.503 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.503 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.503 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.504 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.504 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.504 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.504 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.504 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.504 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.505 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.505 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.505 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.505 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.505 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.506 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.506 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.506 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.506 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.506 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.507 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.507 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.507 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.507 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.507 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.507 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.508 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.508 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.508 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.508 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.508 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.509 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.509 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.509 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.509 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.509 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.510 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.510 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.510 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.510 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.510 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.510 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.511 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.511 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.511 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_autoscaler", 2023-10-16T13:15:09.511 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.511 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.512 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.512 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.512 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.512 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.512 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.513 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.513 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.513 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.513 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.513 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.514 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.514 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.514 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.514 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.514 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.515 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.515 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.515 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.515 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.515 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.516 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.516 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.516 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.516 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.516 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.517 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.517 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.517 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.517 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.517 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.517 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.518 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.518 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.518 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.518 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.518 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.519 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.519 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.519 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.519 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.519 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.520 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.520 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.520 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.520 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.520 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.520 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.521 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.521 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.521 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.521 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.521 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.522 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.522 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.522 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.522 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.522 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.522 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.523 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.523 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.523 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.523 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.523 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.524 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.524 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.524 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.524 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.524 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.524 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.525 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.525 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.525 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2023-10-16T13:15:09.525 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2023-10-16T13:15:09.525 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:09.526 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.526 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.526 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2023-10-16T13:15:09.526 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.526 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.527 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.527 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.527 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.527 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.527 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.527 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.528 INFO:teuthology.orchestra.run.smithi092.stdout: "threshold": { 2023-10-16T13:15:09.528 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threshold", 2023-10-16T13:15:09.528 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:09.528 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.528 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.529 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2023-10-16T13:15:09.529 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1.0", 2023-10-16T13:15:09.529 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.529 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.529 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "scaling threshold", 2023-10-16T13:15:09.530 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-16T13:15:09.530 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.530 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.530 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.530 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.531 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.531 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.531 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "progress", 2023-10-16T13:15:09.531 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.532 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.532 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.532 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_pg_recovery_event": { 2023-10-16T13:15:09.532 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_pg_recovery_event", 2023-10-16T13:15:09.532 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.532 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.533 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.533 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.533 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.533 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.533 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.534 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-16T13:15:09.534 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.534 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.534 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.534 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.535 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2023-10-16T13:15:09.535 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2023-10-16T13:15:09.535 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.535 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.535 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.536 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.536 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.536 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.536 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.536 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.537 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.537 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.537 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.537 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.537 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.538 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.538 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.538 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.538 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.538 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.539 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.539 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.539 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.539 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.539 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.539 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.540 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.540 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.540 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.540 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.540 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.541 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.541 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.541 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.541 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.541 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.542 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.542 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.542 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.542 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.542 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.542 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.543 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.543 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.543 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.543 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.543 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.544 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.544 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.544 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.544 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.544 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.544 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.545 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.545 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.545 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.545 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.545 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.545 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.546 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.546 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.546 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.546 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.546 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.547 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.547 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.547 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.547 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.547 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.548 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.548 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.548 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.548 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.548 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.548 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.549 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.549 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.549 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.549 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.549 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.550 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.550 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.550 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.550 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.550 INFO:teuthology.orchestra.run.smithi092.stdout: "max_completed_events": { 2023-10-16T13:15:09.551 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_completed_events", 2023-10-16T13:15:09.551 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.551 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.551 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.551 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "50", 2023-10-16T13:15:09.552 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.552 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.552 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.552 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "number of past completed events to remember", 2023-10-16T13:15:09.552 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.553 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.553 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.553 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.553 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2023-10-16T13:15:09.553 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2023-10-16T13:15:09.554 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:09.554 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.554 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.554 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2023-10-16T13:15:09.554 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.555 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.555 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.555 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long the module is going to sleep", 2023-10-16T13:15:09.555 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.555 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.556 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.556 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.556 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.556 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.556 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.557 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus", 2023-10-16T13:15:09.557 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.557 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.557 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.557 INFO:teuthology.orchestra.run.smithi092.stdout: "cache": { 2023-10-16T13:15:09.558 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cache", 2023-10-16T13:15:09.558 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.558 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.558 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.558 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.559 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.559 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.559 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.559 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.559 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.559 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.560 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.560 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.560 INFO:teuthology.orchestra.run.smithi092.stdout: "exclude_perf_counters": { 2023-10-16T13:15:09.560 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "exclude_perf_counters", 2023-10-16T13:15:09.560 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.561 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.561 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.561 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.561 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.561 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.562 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.562 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-16T13:15:09.562 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-16T13:15:09.562 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.562 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.563 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.563 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.563 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.563 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.563 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.563 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.564 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.564 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.564 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.564 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.564 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.565 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.565 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.565 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.565 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.565 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.565 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.566 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.566 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.566 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.566 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.567 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.567 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.567 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.567 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.567 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.567 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.568 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.568 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.568 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.568 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.568 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.569 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.569 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.569 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.569 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.569 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.569 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.570 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.570 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.570 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.570 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.570 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.571 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.571 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.571 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.571 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.571 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.572 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.572 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.572 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.572 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.572 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.573 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.573 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.573 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.573 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.573 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.573 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.574 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.574 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.574 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.574 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.575 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.575 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.575 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.575 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.575 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.575 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.576 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.576 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.576 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools": { 2023-10-16T13:15:09.576 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools", 2023-10-16T13:15:09.576 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.577 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.577 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.577 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.577 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.577 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.578 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.578 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.578 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.578 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.578 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.579 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.579 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-16T13:15:09.579 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-16T13:15:09.579 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.579 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.579 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.580 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "300", 2023-10-16T13:15:09.580 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.580 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.580 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.580 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.581 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.581 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.581 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.581 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.581 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_interval": { 2023-10-16T13:15:09.582 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_interval", 2023-10-16T13:15:09.582 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:09.582 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.582 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.582 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15.0", 2023-10-16T13:15:09.583 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.583 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.583 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.583 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.583 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.583 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.584 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.584 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.584 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2023-10-16T13:15:09.584 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2023-10-16T13:15:09.584 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.585 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.585 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.585 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2023-10-16T13:15:09.585 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.585 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.585 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.586 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-16T13:15:09.586 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.586 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.586 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.586 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.587 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2023-10-16T13:15:09.587 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2023-10-16T13:15:09.587 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.587 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.587 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.588 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "9283", 2023-10-16T13:15:09.588 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.588 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.588 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.588 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-16T13:15:09.589 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.589 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.589 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.589 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.589 INFO:teuthology.orchestra.run.smithi092.stdout: "stale_cache_strategy": { 2023-10-16T13:15:09.590 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stale_cache_strategy", 2023-10-16T13:15:09.590 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.590 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.590 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.590 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "log", 2023-10-16T13:15:09.591 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.591 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.591 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.591 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.592 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.592 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.592 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.592 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.592 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2023-10-16T13:15:09.593 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2023-10-16T13:15:09.593 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.593 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.593 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.593 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "default", 2023-10-16T13:15:09.593 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.594 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.594 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.594 INFO:teuthology.orchestra.run.smithi092.stdout: "default", 2023-10-16T13:15:09.594 INFO:teuthology.orchestra.run.smithi092.stdout: "error" 2023-10-16T13:15:09.594 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.595 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.595 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.595 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.595 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.595 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.595 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2023-10-16T13:15:09.596 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2023-10-16T13:15:09.596 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.596 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.596 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.596 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2023-10-16T13:15:09.597 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2023-10-16T13:15:09.597 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2023-10-16T13:15:09.597 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.597 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.597 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.598 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.598 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.598 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.598 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.598 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.598 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.599 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_support", 2023-10-16T13:15:09.599 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.599 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.599 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.599 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.600 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.600 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.600 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.600 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.600 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.601 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.601 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.601 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.601 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.601 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.602 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.602 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.602 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.602 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.602 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.602 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.603 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.603 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.603 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.603 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.603 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.604 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.604 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.604 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.604 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.604 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.604 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.605 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.605 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.605 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.605 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.605 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.605 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.606 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.606 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.606 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.606 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.606 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.607 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.607 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.607 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.607 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.607 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.607 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.608 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.608 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.608 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.608 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.608 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.608 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.609 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.609 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.609 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.609 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.609 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.610 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.610 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.610 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.610 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.610 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.611 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.611 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.611 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.611 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.611 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.611 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.612 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.612 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.612 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.612 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_snap_create": { 2023-10-16T13:15:09.612 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_snap_create", 2023-10-16T13:15:09.613 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.613 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.613 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.613 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2023-10-16T13:15:09.613 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.613 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.614 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.614 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.614 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.614 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.614 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.614 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.615 INFO:teuthology.orchestra.run.smithi092.stdout: "mirror_snapshot_schedule": { 2023-10-16T13:15:09.615 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirror_snapshot_schedule", 2023-10-16T13:15:09.615 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.615 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.615 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.616 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.616 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.616 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.616 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.616 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.616 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.617 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.617 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.617 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.617 INFO:teuthology.orchestra.run.smithi092.stdout: "trash_purge_schedule": { 2023-10-16T13:15:09.617 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "trash_purge_schedule", 2023-10-16T13:15:09.617 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.618 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.618 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.618 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.618 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.618 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.618 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.619 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.619 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.619 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.619 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.619 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.619 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.620 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.620 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.620 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "restful", 2023-10-16T13:15:09.620 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.620 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.620 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.621 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_auth": { 2023-10-16T13:15:09.621 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_auth", 2023-10-16T13:15:09.621 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.621 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.621 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.622 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.622 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.622 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.622 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.622 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.622 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.623 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.623 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.623 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.623 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2023-10-16T13:15:09.623 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2023-10-16T13:15:09.624 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.624 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.624 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.624 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.624 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.624 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.625 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.625 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.625 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.625 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.625 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.626 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.626 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.626 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.626 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.626 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.626 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.627 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.627 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.627 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.627 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.627 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.628 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.628 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.628 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.628 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.628 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.628 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.629 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.629 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.629 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.629 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.629 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.629 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.630 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.630 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.630 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.630 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.630 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.631 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.631 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.631 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.631 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.631 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.632 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.632 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.632 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.632 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.632 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.632 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.633 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.633 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.633 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.633 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.633 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.633 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.634 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.634 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.634 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.634 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.634 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.635 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.635 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.635 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.635 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.635 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.635 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.636 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.636 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.636 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.636 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.636 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.636 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.637 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.637 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.637 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.637 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.637 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.637 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.637 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.638 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.638 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.638 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2023-10-16T13:15:09.638 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2023-10-16T13:15:09.638 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.639 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.639 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.639 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.639 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.639 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.639 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.640 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.640 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.640 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.640 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.640 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.640 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2023-10-16T13:15:09.641 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2023-10-16T13:15:09.641 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.641 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.641 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.641 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.641 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.642 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.642 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.642 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.642 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.642 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.643 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.643 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.643 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.643 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.643 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.644 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rgw", 2023-10-16T13:15:09.644 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.644 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.644 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.644 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.644 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.645 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.645 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.645 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.645 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.645 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.646 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.646 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.646 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.646 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.646 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.647 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.647 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.647 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.647 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.647 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.647 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.648 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.648 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.648 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.648 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.648 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.649 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.649 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.649 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.649 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.650 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.650 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.650 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.650 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.650 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.651 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.651 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.651 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.651 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.651 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.652 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.652 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.652 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.652 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.652 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.653 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.653 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.653 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.653 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.653 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.654 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.654 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.654 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.654 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.654 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.654 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.655 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.655 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.655 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.655 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.655 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.656 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.656 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.656 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.656 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.656 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.657 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.657 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.657 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.657 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.657 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.657 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.658 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.658 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.658 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.658 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.658 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rook", 2023-10-16T13:15:09.659 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.659 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.659 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.659 INFO:teuthology.orchestra.run.smithi092.stdout: "drive_group_interval": { 2023-10-16T13:15:09.659 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "drive_group_interval", 2023-10-16T13:15:09.659 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:09.660 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.660 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.660 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "300.0", 2023-10-16T13:15:09.660 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.660 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.661 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.661 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-16T13:15:09.661 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.661 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.661 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.662 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.662 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.662 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.662 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.662 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.663 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.663 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.663 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.663 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.663 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.663 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.664 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.664 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.664 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.664 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.664 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.665 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.665 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.665 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.665 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.665 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.666 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.666 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.666 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.666 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.666 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.667 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.667 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.667 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.667 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.667 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.667 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.668 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.668 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.668 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.668 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.668 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.668 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.668 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.669 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.669 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.669 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.669 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.669 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.669 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.670 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.670 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.670 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.670 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.670 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.671 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.671 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.671 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.671 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.671 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.671 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.672 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.672 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.672 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.672 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.672 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.672 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.673 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.673 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.673 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.673 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.673 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.673 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.674 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.674 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.674 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.674 INFO:teuthology.orchestra.run.smithi092.stdout: "storage_class": { 2023-10-16T13:15:09.674 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "storage_class", 2023-10-16T13:15:09.675 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.675 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.675 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.675 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "local", 2023-10-16T13:15:09.675 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.675 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.676 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.676 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-16T13:15:09.676 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.676 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.676 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.676 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.677 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.677 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.677 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.677 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "selftest", 2023-10-16T13:15:09.677 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.677 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.678 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.678 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.678 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.678 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.678 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.678 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.679 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.679 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.679 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.679 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.679 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.680 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.680 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.680 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.680 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.680 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.681 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.681 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.681 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.681 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.681 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.682 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.682 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.682 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.682 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.682 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.683 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.683 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.683 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.683 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.683 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.683 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.684 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.684 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.684 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.684 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.684 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.684 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.685 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.685 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.685 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.685 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.685 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.686 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.686 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.686 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.686 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.686 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.686 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.687 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.687 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.687 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.687 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.687 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.687 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.688 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.688 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.688 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.688 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.688 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.688 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.689 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.689 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.689 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.689 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.689 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.690 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.690 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.690 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.690 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.690 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.690 INFO:teuthology.orchestra.run.smithi092.stdout: "roption1": { 2023-10-16T13:15:09.691 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption1", 2023-10-16T13:15:09.691 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.691 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.691 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.691 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.692 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.692 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.692 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.692 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.692 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.692 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.693 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.693 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.693 INFO:teuthology.orchestra.run.smithi092.stdout: "roption2": { 2023-10-16T13:15:09.693 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption2", 2023-10-16T13:15:09.693 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.693 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.694 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.694 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "xyz", 2023-10-16T13:15:09.694 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.694 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.694 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.695 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.695 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.695 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.695 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.695 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.695 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption1": { 2023-10-16T13:15:09.695 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption1", 2023-10-16T13:15:09.696 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.696 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.696 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.696 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.696 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.697 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.697 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.697 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.697 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.697 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.697 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.698 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.698 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption2": { 2023-10-16T13:15:09.698 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption2", 2023-10-16T13:15:09.698 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.698 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.698 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.699 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.699 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.699 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.699 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.699 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.699 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.700 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.700 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.700 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.700 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption3": { 2023-10-16T13:15:09.700 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption3", 2023-10-16T13:15:09.700 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2023-10-16T13:15:09.700 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.701 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.701 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.701 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.701 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.701 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.702 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.702 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.702 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.702 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.702 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.703 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption4": { 2023-10-16T13:15:09.703 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption4", 2023-10-16T13:15:09.703 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.703 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.703 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.704 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.704 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.704 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.704 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.704 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.704 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.705 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.705 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.705 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.705 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption5": { 2023-10-16T13:15:09.705 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption5", 2023-10-16T13:15:09.706 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.706 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.706 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.706 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.706 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.706 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.707 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.707 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.707 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.707 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.707 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.708 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.708 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption6": { 2023-10-16T13:15:09.708 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption6", 2023-10-16T13:15:09.708 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.708 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.708 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.709 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.709 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.709 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.709 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.709 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.710 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.710 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.710 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.710 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.710 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption7": { 2023-10-16T13:15:09.711 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption7", 2023-10-16T13:15:09.711 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.711 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.711 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.711 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.712 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2023-10-16T13:15:09.712 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "42", 2023-10-16T13:15:09.712 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.712 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.712 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.712 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.712 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.713 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.713 INFO:teuthology.orchestra.run.smithi092.stdout: "testkey": { 2023-10-16T13:15:09.713 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testkey", 2023-10-16T13:15:09.713 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.713 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.713 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.714 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.714 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.714 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.714 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.714 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.715 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.715 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.715 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.715 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.715 INFO:teuthology.orchestra.run.smithi092.stdout: "testlkey": { 2023-10-16T13:15:09.715 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testlkey", 2023-10-16T13:15:09.716 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.716 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.716 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.716 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.716 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.716 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.716 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.717 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.717 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.717 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.717 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.717 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.717 INFO:teuthology.orchestra.run.smithi092.stdout: "testnewline": { 2023-10-16T13:15:09.718 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testnewline", 2023-10-16T13:15:09.718 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.718 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.718 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.718 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.718 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.719 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.719 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.719 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.719 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.719 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.719 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.720 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.720 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.720 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.720 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.720 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snap_schedule", 2023-10-16T13:15:09.720 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.721 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.721 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.721 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_m_granularity": { 2023-10-16T13:15:09.721 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_m_granularity", 2023-10-16T13:15:09.721 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.722 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.722 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.722 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.722 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.722 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.723 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.723 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow minute scheduled snapshots", 2023-10-16T13:15:09.723 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.723 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.723 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.723 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.724 INFO:teuthology.orchestra.run.smithi092.stdout: "dump_on_update": { 2023-10-16T13:15:09.724 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dump_on_update", 2023-10-16T13:15:09.724 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.724 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.724 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.725 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.725 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.725 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.725 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.725 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "dump database to debug log on update", 2023-10-16T13:15:09.725 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.726 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.726 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.726 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.726 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.726 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.726 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.727 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.727 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.727 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.727 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.727 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.727 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.728 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.728 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.728 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.728 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.728 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.729 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.729 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.729 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.729 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.729 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.729 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.730 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.730 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.730 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.730 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.730 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.731 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.731 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.731 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.731 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.731 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.732 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.732 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.732 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.732 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.732 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.733 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.733 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.733 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.733 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.733 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.734 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.734 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.734 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.734 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.734 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.735 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.735 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.735 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.735 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.735 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.735 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.736 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.736 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.736 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.736 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.736 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.736 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.737 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.737 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.737 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.737 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.737 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.737 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.738 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.738 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.738 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.738 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.738 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.739 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.739 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.739 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.739 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.739 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.739 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stats", 2023-10-16T13:15:09.740 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.740 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.740 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.740 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.740 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.741 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.741 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.741 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.741 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.741 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.742 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.742 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.742 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.742 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.743 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.743 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.743 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.743 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.743 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.743 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.744 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.744 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.744 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.744 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.745 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.745 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.745 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.745 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.745 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.745 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.746 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.746 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.746 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.746 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.746 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.747 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.747 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.747 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.747 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.747 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.748 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.748 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.748 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.748 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.748 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.749 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.749 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.749 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.749 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.749 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.749 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.750 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.750 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.750 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.750 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.750 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.751 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.751 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.751 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.751 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.751 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.751 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.752 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.752 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.752 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.752 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.752 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.753 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.753 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.753 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.753 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.753 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.753 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.754 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.754 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.754 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.754 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "status", 2023-10-16T13:15:09.754 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.755 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.755 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.755 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.755 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.755 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.755 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.756 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.756 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.756 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.756 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.756 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.756 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.757 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.757 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.757 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.757 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.757 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.757 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.758 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.758 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.758 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.758 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.758 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.759 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.759 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.759 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.759 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.759 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.759 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.760 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.760 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.760 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.760 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.760 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.760 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.761 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.761 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.761 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.761 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.761 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.762 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.762 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.762 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.762 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.762 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.763 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.763 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.763 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.763 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.763 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.763 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.764 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.764 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.764 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.764 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.764 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.764 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.765 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.765 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.765 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.765 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.765 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.765 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.766 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.766 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.766 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.766 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.766 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.767 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.767 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.767 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.767 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.767 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.767 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.768 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.768 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telegraf", 2023-10-16T13:15:09.768 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.768 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.768 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.768 INFO:teuthology.orchestra.run.smithi092.stdout: "address": { 2023-10-16T13:15:09.769 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "address", 2023-10-16T13:15:09.769 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.769 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.769 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.769 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-16T13:15:09.769 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.770 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.770 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.770 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.770 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.770 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.770 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.771 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.771 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2023-10-16T13:15:09.771 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2023-10-16T13:15:09.771 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:09.771 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.772 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.772 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15", 2023-10-16T13:15:09.772 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.772 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.772 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.772 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.773 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.773 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.773 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.773 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.773 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.773 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.773 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.774 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.774 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.774 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.774 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.775 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.775 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.775 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.775 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.775 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.776 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.776 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.776 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.776 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.776 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.776 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.776 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.777 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.777 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.777 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.777 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.777 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.777 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.778 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.778 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.778 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.778 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.778 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.779 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.779 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.779 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.779 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.779 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.779 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.780 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.780 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.780 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.780 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.780 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.781 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.781 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.781 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.781 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.781 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.781 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.782 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.782 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.782 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.782 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.782 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.782 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.783 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.783 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.783 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.783 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.783 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.784 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.784 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.784 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.784 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.784 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.785 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.785 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.785 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.785 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.785 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.785 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.786 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.786 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.786 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.786 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.786 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telemetry", 2023-10-16T13:15:09.786 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.787 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.787 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.787 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_basic": { 2023-10-16T13:15:09.787 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_basic", 2023-10-16T13:15:09.787 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.788 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.788 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.788 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.788 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.788 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.788 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.789 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-16T13:15:09.789 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.789 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.789 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.789 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.789 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_crash": { 2023-10-16T13:15:09.790 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_crash", 2023-10-16T13:15:09.790 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.790 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.790 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.790 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.790 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.791 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.791 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.791 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-16T13:15:09.791 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.791 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.792 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.792 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.792 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_device": { 2023-10-16T13:15:09.792 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_device", 2023-10-16T13:15:09.792 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.792 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.792 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.793 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2023-10-16T13:15:09.793 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.793 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.793 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.793 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-16T13:15:09.793 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.794 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.794 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.794 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.794 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_ident": { 2023-10-16T13:15:09.794 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_ident", 2023-10-16T13:15:09.794 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.795 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.795 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.795 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.795 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.795 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.796 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.796 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-16T13:15:09.796 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.796 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.796 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.796 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.797 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_perf": { 2023-10-16T13:15:09.797 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_perf", 2023-10-16T13:15:09.797 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.797 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.797 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.797 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.798 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.798 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.798 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.798 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-16T13:15:09.798 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.798 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.799 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.799 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.799 INFO:teuthology.orchestra.run.smithi092.stdout: "contact": { 2023-10-16T13:15:09.799 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "contact", 2023-10-16T13:15:09.799 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.799 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.800 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.800 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.800 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.800 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.800 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.800 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.801 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.801 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.801 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.801 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.801 INFO:teuthology.orchestra.run.smithi092.stdout: "description": { 2023-10-16T13:15:09.801 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "description", 2023-10-16T13:15:09.802 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.802 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.802 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.802 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.802 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.803 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.803 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.803 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.803 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.803 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.803 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.804 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.804 INFO:teuthology.orchestra.run.smithi092.stdout: "device_url": { 2023-10-16T13:15:09.804 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_url", 2023-10-16T13:15:09.804 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.804 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.804 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.805 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-16T13:15:09.805 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.805 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.805 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.805 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.805 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.806 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.806 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.806 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.806 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2023-10-16T13:15:09.806 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2023-10-16T13:15:09.806 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.807 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.807 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.807 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.807 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.807 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.807 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.808 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.808 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.808 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.808 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.808 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.809 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2023-10-16T13:15:09.809 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2023-10-16T13:15:09.809 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.809 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.809 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.809 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "24", 2023-10-16T13:15:09.810 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "8", 2023-10-16T13:15:09.810 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.810 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.810 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.810 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.810 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.811 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.811 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.811 INFO:teuthology.orchestra.run.smithi092.stdout: "last_opt_revision": { 2023-10-16T13:15:09.811 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "last_opt_revision", 2023-10-16T13:15:09.811 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.812 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.812 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.812 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1", 2023-10-16T13:15:09.812 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.812 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.812 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.812 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.813 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.813 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.813 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.813 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.813 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard": { 2023-10-16T13:15:09.814 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard", 2023-10-16T13:15:09.814 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.814 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.814 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.814 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.814 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.815 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.815 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.815 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.815 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.815 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.815 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.816 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.816 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard_description": { 2023-10-16T13:15:09.816 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard_description", 2023-10-16T13:15:09.816 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.816 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.816 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.817 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.817 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.817 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.817 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.817 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.817 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.818 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.818 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.818 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.818 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.818 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.819 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.819 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.819 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.819 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.819 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.819 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.820 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.820 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.820 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.820 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.820 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.821 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.821 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.821 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.821 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.821 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.821 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.822 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.822 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.822 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.822 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.822 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.823 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.823 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.823 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.823 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.823 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.823 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.824 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.824 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.824 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.824 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.824 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.824 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.825 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.825 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.825 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.825 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.825 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.825 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.826 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.826 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.826 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.826 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.826 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.827 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.827 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.827 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.827 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.827 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.828 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.828 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.828 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.828 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.828 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.829 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.829 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.829 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.829 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.829 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.830 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.830 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.830 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.830 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.830 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.831 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.831 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.831 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.831 INFO:teuthology.orchestra.run.smithi092.stdout: "organization": { 2023-10-16T13:15:09.832 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "organization", 2023-10-16T13:15:09.832 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.832 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.832 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.833 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.833 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.833 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.833 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.833 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.834 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.834 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.834 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.834 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.834 INFO:teuthology.orchestra.run.smithi092.stdout: "proxy": { 2023-10-16T13:15:09.835 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "proxy", 2023-10-16T13:15:09.835 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.835 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.835 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.835 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.836 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.836 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.836 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.836 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.836 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.837 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.837 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.837 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.837 INFO:teuthology.orchestra.run.smithi092.stdout: "url": { 2023-10-16T13:15:09.837 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url", 2023-10-16T13:15:09.837 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.838 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.838 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.838 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-16T13:15:09.838 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.838 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.839 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.839 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.839 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.839 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.839 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.840 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.840 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.840 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.840 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.840 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "test_orchestrator", 2023-10-16T13:15:09.841 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.841 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.841 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.841 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.841 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.842 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.842 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.842 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.842 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.842 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.843 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.843 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.843 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.843 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.844 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.844 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.844 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.844 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.844 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.845 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.845 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.845 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.845 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.845 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.846 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.846 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.846 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.846 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.846 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.846 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.847 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.847 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.847 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.847 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.847 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.848 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.848 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.848 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.848 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.848 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.848 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.849 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.849 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.849 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.849 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.849 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.850 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.850 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.850 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.850 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.850 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.850 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.851 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.851 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.851 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.851 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.851 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.852 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.852 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.852 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.852 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.852 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.852 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.853 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.853 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.853 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.853 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.853 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.854 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.854 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.854 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.854 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.854 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.854 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.855 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.855 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.855 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "volumes", 2023-10-16T13:15:09.855 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.855 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.856 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.856 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.856 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.856 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.856 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.857 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.857 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.857 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.857 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.857 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.857 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.858 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.858 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.858 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.858 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.858 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.859 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.859 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.859 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.859 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.859 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.859 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.860 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.860 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.860 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.860 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.860 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.861 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.861 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.861 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.861 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.861 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.861 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.862 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.862 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.862 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.862 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.862 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.862 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.863 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.863 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.863 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.863 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.863 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.864 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.864 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.864 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.864 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.864 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.865 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.865 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.865 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.865 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.865 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.865 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.866 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.866 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.866 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.866 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.866 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.867 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.867 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.867 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.867 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.867 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.868 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.868 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.868 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.868 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.868 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.868 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.869 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_clones": { 2023-10-16T13:15:09.869 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_clones", 2023-10-16T13:15:09.869 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.869 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.869 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.870 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4", 2023-10-16T13:15:09.870 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.870 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.870 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.870 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-16T13:15:09.871 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.871 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.871 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.871 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.871 INFO:teuthology.orchestra.run.smithi092.stdout: "periodic_async_work": { 2023-10-16T13:15:09.871 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "periodic_async_work", 2023-10-16T13:15:09.872 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.872 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.872 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.872 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.872 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.873 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.873 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.873 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Periodically check for async work", 2023-10-16T13:15:09.873 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.873 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.873 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.874 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.874 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_delay": { 2023-10-16T13:15:09.874 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_delay", 2023-10-16T13:15:09.874 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.874 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.874 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.875 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2023-10-16T13:15:09.875 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.875 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.875 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.875 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-16T13:15:09.876 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.876 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.876 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.876 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.876 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.877 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.877 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.877 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix", 2023-10-16T13:15:09.877 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2023-10-16T13:15:09.877 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2023-10-16T13:15:09.877 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2023-10-16T13:15:09.878 INFO:teuthology.orchestra.run.smithi092.stdout: "discovery_interval": { 2023-10-16T13:15:09.878 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "discovery_interval", 2023-10-16T13:15:09.878 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2023-10-16T13:15:09.878 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.878 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.879 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "100", 2023-10-16T13:15:09.879 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.879 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.879 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.879 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.879 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.880 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.880 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.880 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.880 INFO:teuthology.orchestra.run.smithi092.stdout: "identifier": { 2023-10-16T13:15:09.880 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "identifier", 2023-10-16T13:15:09.881 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.881 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.881 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.881 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.881 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.882 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.882 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.882 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.882 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.882 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.883 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.883 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.883 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2023-10-16T13:15:09.883 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2023-10-16T13:15:09.883 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2023-10-16T13:15:09.884 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.884 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.884 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2023-10-16T13:15:09.884 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.884 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.884 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.885 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.885 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.885 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.885 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.885 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.886 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2023-10-16T13:15:09.886 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2023-10-16T13:15:09.886 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.886 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.886 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.887 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.887 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.887 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.887 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.887 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.887 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.888 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.888 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.888 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.888 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.888 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.889 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.889 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.889 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.889 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.889 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.889 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2023-10-16T13:15:09.890 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2023-10-16T13:15:09.890 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.890 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.890 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.890 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.891 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.891 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.891 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.891 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.891 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.892 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.892 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.892 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.892 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2023-10-16T13:15:09.892 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2023-10-16T13:15:09.893 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.893 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.893 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.893 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2023-10-16T13:15:09.893 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.894 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.894 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2023-10-16T13:15:09.894 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2023-10-16T13:15:09.894 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2023-10-16T13:15:09.894 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2023-10-16T13:15:09.894 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2023-10-16T13:15:09.895 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2023-10-16T13:15:09.895 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2023-10-16T13:15:09.895 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.895 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.895 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.895 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.896 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.896 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.896 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2023-10-16T13:15:09.896 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2023-10-16T13:15:09.896 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2023-10-16T13:15:09.896 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.897 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2023-10-16T13:15:09.897 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2023-10-16T13:15:09.897 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.897 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.897 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.897 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.898 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.898 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.898 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.898 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.898 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_host": { 2023-10-16T13:15:09.899 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_host", 2023-10-16T13:15:09.899 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.899 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.899 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.899 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2023-10-16T13:15:09.900 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.900 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.900 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.900 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.900 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.900 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.901 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.901 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.901 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_port": { 2023-10-16T13:15:09.901 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_port", 2023-10-16T13:15:09.901 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2023-10-16T13:15:09.902 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.902 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.902 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10051", 2023-10-16T13:15:09.902 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.902 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.902 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.903 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.903 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.903 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.903 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.903 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.903 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_sender": { 2023-10-16T13:15:09.904 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_sender", 2023-10-16T13:15:09.904 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2023-10-16T13:15:09.904 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2023-10-16T13:15:09.904 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2023-10-16T13:15:09.904 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-16T13:15:09.904 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2023-10-16T13:15:09.905 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2023-10-16T13:15:09.905 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2023-10-16T13:15:09.905 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2023-10-16T13:15:09.905 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2023-10-16T13:15:09.905 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2023-10-16T13:15:09.905 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2023-10-16T13:15:09.906 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.906 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.906 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.906 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.906 INFO:teuthology.orchestra.run.smithi092.stdout: "services": { 2023-10-16T13:15:09.907 INFO:teuthology.orchestra.run.smithi092.stdout: "dashboard": "https://172.21.15.92:8443/" 2023-10-16T13:15:09.907 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.907 INFO:teuthology.orchestra.run.smithi092.stdout: "always_on_modules": { 2023-10-16T13:15:09.907 INFO:teuthology.orchestra.run.smithi092.stdout: "octopus": [ 2023-10-16T13:15:09.907 INFO:teuthology.orchestra.run.smithi092.stdout: "balancer", 2023-10-16T13:15:09.908 INFO:teuthology.orchestra.run.smithi092.stdout: "crash", 2023-10-16T13:15:09.908 INFO:teuthology.orchestra.run.smithi092.stdout: "devicehealth", 2023-10-16T13:15:09.908 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator", 2023-10-16T13:15:09.908 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_autoscaler", 2023-10-16T13:15:09.908 INFO:teuthology.orchestra.run.smithi092.stdout: "progress", 2023-10-16T13:15:09.909 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_support", 2023-10-16T13:15:09.909 INFO:teuthology.orchestra.run.smithi092.stdout: "status", 2023-10-16T13:15:09.909 INFO:teuthology.orchestra.run.smithi092.stdout: "telemetry", 2023-10-16T13:15:09.909 INFO:teuthology.orchestra.run.smithi092.stdout: "volumes" 2023-10-16T13:15:09.910 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.910 INFO:teuthology.orchestra.run.smithi092.stdout: "pacific": [ 2023-10-16T13:15:09.910 INFO:teuthology.orchestra.run.smithi092.stdout: "balancer", 2023-10-16T13:15:09.910 INFO:teuthology.orchestra.run.smithi092.stdout: "crash", 2023-10-16T13:15:09.911 INFO:teuthology.orchestra.run.smithi092.stdout: "devicehealth", 2023-10-16T13:15:09.911 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator", 2023-10-16T13:15:09.911 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_autoscaler", 2023-10-16T13:15:09.911 INFO:teuthology.orchestra.run.smithi092.stdout: "progress", 2023-10-16T13:15:09.912 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_support", 2023-10-16T13:15:09.912 INFO:teuthology.orchestra.run.smithi092.stdout: "status", 2023-10-16T13:15:09.912 INFO:teuthology.orchestra.run.smithi092.stdout: "telemetry", 2023-10-16T13:15:09.912 INFO:teuthology.orchestra.run.smithi092.stdout: "volumes" 2023-10-16T13:15:09.912 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.913 INFO:teuthology.orchestra.run.smithi092.stdout: "quincy": [ 2023-10-16T13:15:09.913 INFO:teuthology.orchestra.run.smithi092.stdout: "balancer", 2023-10-16T13:15:09.913 INFO:teuthology.orchestra.run.smithi092.stdout: "crash", 2023-10-16T13:15:09.913 INFO:teuthology.orchestra.run.smithi092.stdout: "devicehealth", 2023-10-16T13:15:09.913 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator", 2023-10-16T13:15:09.914 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_autoscaler", 2023-10-16T13:15:09.914 INFO:teuthology.orchestra.run.smithi092.stdout: "progress", 2023-10-16T13:15:09.914 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_support", 2023-10-16T13:15:09.914 INFO:teuthology.orchestra.run.smithi092.stdout: "status", 2023-10-16T13:15:09.914 INFO:teuthology.orchestra.run.smithi092.stdout: "telemetry", 2023-10-16T13:15:09.915 INFO:teuthology.orchestra.run.smithi092.stdout: "volumes" 2023-10-16T13:15:09.915 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2023-10-16T13:15:09.915 INFO:teuthology.orchestra.run.smithi092.stdout: "reef": [ 2023-10-16T13:15:09.915 INFO:teuthology.orchestra.run.smithi092.stdout: "balancer", 2023-10-16T13:15:09.915 INFO:teuthology.orchestra.run.smithi092.stdout: "crash", 2023-10-16T13:15:09.915 INFO:teuthology.orchestra.run.smithi092.stdout: "devicehealth", 2023-10-16T13:15:09.916 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator", 2023-10-16T13:15:09.916 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_autoscaler", 2023-10-16T13:15:09.916 INFO:teuthology.orchestra.run.smithi092.stdout: "progress", 2023-10-16T13:15:09.916 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_support", 2023-10-16T13:15:09.916 INFO:teuthology.orchestra.run.smithi092.stdout: "status", 2023-10-16T13:15:09.916 INFO:teuthology.orchestra.run.smithi092.stdout: "telemetry", 2023-10-16T13:15:09.917 INFO:teuthology.orchestra.run.smithi092.stdout: "volumes" 2023-10-16T13:15:09.917 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-10-16T13:15:09.917 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.917 INFO:teuthology.orchestra.run.smithi092.stdout: "last_failure_osd_epoch": 3, 2023-10-16T13:15:09.917 INFO:teuthology.orchestra.run.smithi092.stdout: "active_clients": [ 2023-10-16T13:15:09.917 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.918 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "devicehealth", 2023-10-16T13:15:09.918 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2023-10-16T13:15:09.918 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.918 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2023-10-16T13:15:09.918 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2023-10-16T13:15:09.919 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 293199301 2023-10-16T13:15:09.919 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.919 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-10-16T13:15:09.919 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.919 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.919 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "libcephsqlite", 2023-10-16T13:15:09.920 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2023-10-16T13:15:09.920 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.920 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2023-10-16T13:15:09.920 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2023-10-16T13:15:09.920 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 1118703259 2023-10-16T13:15:09.921 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.921 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-10-16T13:15:09.921 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.921 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.921 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_support", 2023-10-16T13:15:09.921 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2023-10-16T13:15:09.922 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.922 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2023-10-16T13:15:09.922 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2023-10-16T13:15:09.922 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 4070135528 2023-10-16T13:15:09.922 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.923 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-10-16T13:15:09.923 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:09.923 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.923 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "volumes", 2023-10-16T13:15:09.923 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2023-10-16T13:15:09.923 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-10-16T13:15:09.924 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2023-10-16T13:15:09.924 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2023-10-16T13:15:09.924 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 2515872870 2023-10-16T13:15:09.924 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.925 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-10-16T13:15:09.925 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:09.925 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-10-16T13:15:09.925 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:15:09.927 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:06 smithi118 ceph-mon[103969]: pgmap v360: 97 pgs: 97 active+clean; 42 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 1.2 MiB/s wr, 710 op/s 2023-10-16T13:15:09.927 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:06 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1673793017' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:15:09.927 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:06 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3829663211' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:15:09.928 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:06 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1515011504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:15:09.928 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:07 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1080106705' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-16T13:15:09.928 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:08 smithi118 ceph-mon[103969]: pgmap v361: 97 pgs: 97 active+clean; 39 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 684 op/s 2023-10-16T13:15:09.928 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:08 smithi118 ceph-mon[103969]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:15:09.928 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:06 smithi152 ceph-mon[104423]: pgmap v360: 97 pgs: 97 active+clean; 42 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 1.2 MiB/s wr, 710 op/s 2023-10-16T13:15:09.929 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:06 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1673793017' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:15:09.929 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:06 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3829663211' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:15:09.929 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:06 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1515011504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:15:09.929 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:07 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1080106705' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-16T13:15:09.929 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:08 smithi152 ceph-mon[104423]: pgmap v361: 97 pgs: 97 active+clean; 39 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 684 op/s 2023-10-16T13:15:09.929 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:08 smithi152 ceph-mon[104423]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:15:09.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.571+0000 7f8704a60700 1 -- 172.21.15.92:0/1080106705 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f86ec0a1520 msgr2=0x7f86ec0a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:09.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.571+0000 7f8704a60700 1 --2- 172.21.15.92:0/1080106705 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f86ec0a1520 0x7f86ec0a39e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8700198100 tx=0x7f86f000b410 comp rx=0 tx=0).stop 2023-10-16T13:15:09.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.571+0000 7f8704a60700 1 -- 172.21.15.92:0/1080106705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8700102a50 msgr2=0x7f870019e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:09.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.571+0000 7f8704a60700 1 --2- 172.21.15.92:0/1080106705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8700102a50 0x7f870019e1a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f86f800ada0 tx=0x7f86f800c330 comp rx=0 tx=0).stop 2023-10-16T13:15:09.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.571+0000 7f8704a60700 1 -- 172.21.15.92:0/1080106705 shutdown_connections 2023-10-16T13:15:09.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.571+0000 7f8704a60700 1 --2- 172.21.15.92:0/1080106705 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f86ec0a1520 0x7f86ec0a39e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:09.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.571+0000 7f8704a60700 1 --2- 172.21.15.92:0/1080106705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8700102a50 0x7f870019e1a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:09.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.571+0000 7f8704a60700 1 --2- 172.21.15.92:0/1080106705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8700100eb0 0x7f8700196c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:09.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.571+0000 7f8704a60700 1 --2- 172.21.15.92:0/1080106705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8700102090 0x7f8700197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:09.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.571+0000 7f8704a60700 1 -- 172.21.15.92:0/1080106705 >> 172.21.15.92:0/1080106705 conn(0x7f87000fc430 msgr2=0x7f87000fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:09.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.572+0000 7f8704a60700 1 -- 172.21.15.92:0/1080106705 shutdown_connections 2023-10-16T13:15:09.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:06.572+0000 7f8704a60700 1 -- 172.21.15.92:0/1080106705 wait complete. 2023-10-16T13:15:09.938 DEBUG:tasks.check_counter:Getting stats from a 2023-10-16T13:15:09.939 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph daemon mds.a perf dump 2023-10-16T13:15:09.939 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:07 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1080106705' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-16T13:15:09.940 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:08 smithi092 ceph-mon[99542]: pgmap v361: 97 pgs: 97 active+clean; 39 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 684 op/s 2023-10-16T13:15:09.940 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:08 smithi092 ceph-mon[99542]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-16T13:15:10.509 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:15:10.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:10 smithi152 ceph-mon[104423]: pgmap v362: 97 pgs: 97 active+clean; 37 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 451 op/s 2023-10-16T13:15:10.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:10 smithi092 ceph-mon[99542]: pgmap v362: 97 pgs: 97 active+clean; 37 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 451 op/s 2023-10-16T13:15:10.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:10 smithi118 ceph-mon[103969]: pgmap v362: 97 pgs: 97 active+clean; 37 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 451 op/s 2023-10-16T13:15:11.926 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:15:11.926 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2023-10-16T13:15:11.927 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 422, 2023-10-16T13:15:11.927 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 424, 2023-10-16T13:15:11.927 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 4319589, 2023-10-16T13:15:11.927 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 131243, 2023-10-16T13:15:11.927 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 6, 2023-10-16T13:15:11.928 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 2, 2023-10-16T13:15:11.928 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.034888538, 2023-10-16T13:15:11.928 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.008583537, 2023-10-16T13:15:11.928 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.011906955, 2023-10-16T13:15:11.928 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.010769350, 2023-10-16T13:15:11.929 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:11.929 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 422, 2023-10-16T13:15:11.929 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.017494530, 2023-10-16T13:15:11.929 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000041456 2023-10-16T13:15:11.929 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-16T13:15:11.931 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 0 2023-10-16T13:15:11.931 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.931 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2023-10-16T13:15:11.931 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 214, 2023-10-16T13:15:11.931 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 199, 2023-10-16T13:15:11.932 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 1631073, 2023-10-16T13:15:11.932 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 77910, 2023-10-16T13:15:11.932 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 4, 2023-10-16T13:15:11.932 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 3, 2023-10-16T13:15:11.932 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.023028457, 2023-10-16T13:15:11.933 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.006517224, 2023-10-16T13:15:11.933 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.012808701, 2023-10-16T13:15:11.933 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.005486199, 2023-10-16T13:15:11.933 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:11.933 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 199, 2023-10-16T13:15:11.934 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.014447029, 2023-10-16T13:15:11.934 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000072598 2023-10-16T13:15:11.934 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.934 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:11.934 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.935 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.935 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.935 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.935 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 512176, 2023-10-16T13:15:11.935 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 38656 2023-10-16T13:15:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2023-10-16T13:15:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 7, 2023-10-16T13:15:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 54, 2023-10-16T13:15:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 1658, 2023-10-16T13:15:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 160698, 2023-10-16T13:15:11.937 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 5, 2023-10-16T13:15:11.937 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 4, 2023-10-16T13:15:11.937 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.004741387, 2023-10-16T13:15:11.937 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.002212525, 2023-10-16T13:15:11.937 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.001806285, 2023-10-16T13:15:11.938 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000170214, 2023-10-16T13:15:11.938 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:11.938 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 52, 2023-10-16T13:15:11.938 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.004432915, 2023-10-16T13:15:11.938 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000085248 2023-10-16T13:15:11.939 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.939 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:11.939 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.939 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.939 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-16T13:15:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 158832 2023-10-16T13:15:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2023-10-16T13:15:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 1, 2023-10-16T13:15:11.941 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2023-10-16T13:15:11.941 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.941 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-MDSRank": { 2023-10-16T13:15:11.941 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2023-10-16T13:15:11.941 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2023-10-16T13:15:11.942 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 971, 2023-10-16T13:15:11.942 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.022460350, 2023-10-16T13:15:11.942 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000023131 2023-10-16T13:15:11.942 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:11.942 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.943 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-PurgeQueue": { 2023-10-16T13:15:11.943 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2023-10-16T13:15:11.943 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2023-10-16T13:15:11.943 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.943 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.944 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.944 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:11.944 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.944 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": { 2023-10-16T13:15:11.944 INFO:teuthology.orchestra.run.smithi092.stdout: "request": 0, 2023-10-16T13:15:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: "reply": 0, 2023-10-16T13:15:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: "reply_latency": { 2023-10-16T13:15:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.946 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_reply": 0, 2023-10-16T13:15:11.946 INFO:teuthology.orchestra.run.smithi092.stdout: "forward": 0, 2023-10-16T13:15:11.946 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_complete": 0, 2023-10-16T13:15:11.946 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_keys": 0, 2023-10-16T13:15:11.946 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_commit": 0, 2023-10-16T13:15:11.947 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_split": 0, 2023-10-16T13:15:11.947 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_merge": 0, 2023-10-16T13:15:11.947 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes": 1012, 2023-10-16T13:15:11.947 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_top": 0, 2023-10-16T13:15:11.947 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_bottom": 0, 2023-10-16T13:15:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pin_tail": 1012, 2023-10-16T13:15:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pinned": 1012, 2023-10-16T13:15:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_expired": 0, 2023-10-16T13:15:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_with_caps": 0, 2023-10-16T13:15:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": 0, 2023-10-16T13:15:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: "subtrees": 1, 2023-10-16T13:15:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse": 0, 2023-10-16T13:15:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_hit": 0, 2023-10-16T13:15:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_forward": 0, 2023-10-16T13:15:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_discover": 0, 2023-10-16T13:15:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_dir_fetch": 0, 2023-10-16T13:15:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_remote_ino": 0, 2023-10-16T13:15:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_lock": 0, 2023-10-16T13:15:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: "load_cent": 0, 2023-10-16T13:15:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: "q": 0, 2023-10-16T13:15:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: "exported": 0, 2023-10-16T13:15:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: "exported_inodes": 0, 2023-10-16T13:15:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: "imported": 0, 2023-10-16T13:15:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: "imported_inodes": 0, 2023-10-16T13:15:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_dir_fetch": 0, 2023-10-16T13:15:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_backtrace_fetch": 0, 2023-10-16T13:15:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_peer_discover": 0, 2023-10-16T13:15:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rfiles": 0, 2023-10-16T13:15:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rbytes": 0, 2023-10-16T13:15:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rsnaps": 0, 2023-10-16T13:15:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_fetch": 0, 2023-10-16T13:15:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_set_tag": 0, 2023-10-16T13:15:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_repaired": 0, 2023-10-16T13:15:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_inotable_repaired": 0, 2023-10-16T13:15:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_inodes": 0, 2023-10-16T13:15:11.953 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_base_inodes": 0, 2023-10-16T13:15:11.953 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dirfrag_rstats": 0, 2023-10-16T13:15:11.953 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_file_inodes": 0, 2023-10-16T13:15:11.953 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_inode_file_caps": 0, 2023-10-16T13:15:11.953 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_revoke": 0, 2023-10-16T13:15:11.953 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_grant": 0, 2023-10-16T13:15:11.954 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_trunc": 0, 2023-10-16T13:15:11.954 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-16T13:15:11.954 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-16T13:15:11.954 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps": 0, 2023-10-16T13:15:11.954 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps_dirty": 0, 2023-10-16T13:15:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_cap_release": 0, 2023-10-16T13:15:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: "process_request_cap_release": 0 2023-10-16T13:15:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_cache": { 2023-10-16T13:15:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update": 0, 2023-10-16T13:15:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update_receipt": 0, 2023-10-16T13:15:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_try_discover": 0, 2023-10-16T13:15:11.956 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_send_discover": 0, 2023-10-16T13:15:11.956 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_handle_discover": 0, 2023-10-16T13:15:11.956 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays": 0, 2023-10-16T13:15:11.956 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_delayed": 0, 2023-10-16T13:15:11.956 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_enqueuing": 0, 2023-10-16T13:15:11.957 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_created": 0, 2023-10-16T13:15:11.957 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_enqueued": 0, 2023-10-16T13:15:11.957 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_reintegrated": 0, 2023-10-16T13:15:11.957 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_migrated": 0, 2023-10-16T13:15:11.957 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_processing": 0, 2023-10-16T13:15:11.958 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_enqueued": 0, 2023-10-16T13:15:11.958 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_prioritized": 0, 2023-10-16T13:15:11.958 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_started": 0, 2023-10-16T13:15:11.958 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_completed": 0, 2023-10-16T13:15:11.958 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_enqueue_scrub": 0, 2023-10-16T13:15:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_exportdir": 0, 2023-10-16T13:15:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_flush": 0, 2023-10-16T13:15:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragmentdir": 0, 2023-10-16T13:15:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragstats": 0, 2023-10-16T13:15:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_inodestats": 0 2023-10-16T13:15:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.960 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_log": { 2023-10-16T13:15:11.960 INFO:teuthology.orchestra.run.smithi092.stdout: "evlrg": 0, 2023-10-16T13:15:11.960 INFO:teuthology.orchestra.run.smithi092.stdout: "evadd": 0, 2023-10-16T13:15:11.960 INFO:teuthology.orchestra.run.smithi092.stdout: "evex": 0, 2023-10-16T13:15:11.960 INFO:teuthology.orchestra.run.smithi092.stdout: "evtrm": 0, 2023-10-16T13:15:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: "ev": 2750, 2023-10-16T13:15:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: "evexg": 0, 2023-10-16T13:15:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: "evexd": 0, 2023-10-16T13:15:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: "segadd": 0, 2023-10-16T13:15:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: "segex": 0, 2023-10-16T13:15:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: "segtrm": 0, 2023-10-16T13:15:11.962 INFO:teuthology.orchestra.run.smithi092.stdout: "seg": 5, 2023-10-16T13:15:11.962 INFO:teuthology.orchestra.run.smithi092.stdout: "segmjr": 2, 2023-10-16T13:15:11.962 INFO:teuthology.orchestra.run.smithi092.stdout: "segexg": 0, 2023-10-16T13:15:11.962 INFO:teuthology.orchestra.run.smithi092.stdout: "segexd": 0, 2023-10-16T13:15:11.963 INFO:teuthology.orchestra.run.smithi092.stdout: "expos": 4194304, 2023-10-16T13:15:11.963 INFO:teuthology.orchestra.run.smithi092.stdout: "wrpos": 9475697, 2023-10-16T13:15:11.963 INFO:teuthology.orchestra.run.smithi092.stdout: "rdpos": 9475098, 2023-10-16T13:15:11.963 INFO:teuthology.orchestra.run.smithi092.stdout: "jlat": { 2023-10-16T13:15:11.963 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.963 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.964 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.964 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.964 INFO:teuthology.orchestra.run.smithi092.stdout: "replayed": 2750 2023-10-16T13:15:11.964 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.964 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_mem": { 2023-10-16T13:15:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 7, 2023-10-16T13:15:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: "ino+": 1068, 2023-10-16T13:15:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: "ino-": 1061, 2023-10-16T13:15:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: "dir": 5, 2023-10-16T13:15:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: "dir+": 118, 2023-10-16T13:15:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: "dir-": 113, 2023-10-16T13:15:11.966 INFO:teuthology.orchestra.run.smithi092.stdout: "dn": 1012, 2023-10-16T13:15:11.966 INFO:teuthology.orchestra.run.smithi092.stdout: "dn+": 2077, 2023-10-16T13:15:11.966 INFO:teuthology.orchestra.run.smithi092.stdout: "dn-": 1065, 2023-10-16T13:15:11.966 INFO:teuthology.orchestra.run.smithi092.stdout: "cap": 0, 2023-10-16T13:15:11.966 INFO:teuthology.orchestra.run.smithi092.stdout: "cap+": 0, 2023-10-16T13:15:11.967 INFO:teuthology.orchestra.run.smithi092.stdout: "cap-": 0, 2023-10-16T13:15:11.967 INFO:teuthology.orchestra.run.smithi092.stdout: "rss": 47548, 2023-10-16T13:15:11.967 INFO:teuthology.orchestra.run.smithi092.stdout: "heap": 207152 2023-10-16T13:15:11.967 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.967 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_server": { 2023-10-16T13:15:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_client_request": 0, 2023-10-16T13:15:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_server_request": 0, 2023-10-16T13:15:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_request": 0, 2023-10-16T13:15:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_session": 0, 2023-10-16T13:15:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_peer_request": 0, 2023-10-16T13:15:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: "req_create_latency": { 2023-10-16T13:15:11.969 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.969 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.969 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.969 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.969 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getattr_latency": { 2023-10-16T13:15:11.970 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.970 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.970 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.970 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.970 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getfilelock_latency": { 2023-10-16T13:15:11.971 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.971 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.971 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.971 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.971 INFO:teuthology.orchestra.run.smithi092.stdout: "req_link_latency": { 2023-10-16T13:15:11.971 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.972 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.972 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.972 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.972 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookup_latency": { 2023-10-16T13:15:11.972 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.973 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.973 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.973 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.973 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookuphash_latency": { 2023-10-16T13:15:11.973 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.974 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.974 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.974 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.974 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupino_latency": { 2023-10-16T13:15:11.974 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.975 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.975 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.975 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.975 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupname_latency": { 2023-10-16T13:15:11.975 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.976 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.976 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.976 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.976 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupparent_latency": { 2023-10-16T13:15:11.976 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.977 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.977 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.977 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.977 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupsnap_latency": { 2023-10-16T13:15:11.977 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.978 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.978 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.978 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.978 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lssnap_latency": { 2023-10-16T13:15:11.978 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.979 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.979 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.979 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.979 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mkdir_latency": { 2023-10-16T13:15:11.979 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.979 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.980 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.980 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.980 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mknod_latency": { 2023-10-16T13:15:11.980 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.980 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.981 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.981 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.981 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mksnap_latency": { 2023-10-16T13:15:11.981 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.981 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.982 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.982 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.982 INFO:teuthology.orchestra.run.smithi092.stdout: "req_open_latency": { 2023-10-16T13:15:11.982 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.982 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: "req_readdir_latency": { 2023-10-16T13:15:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rename_latency": { 2023-10-16T13:15:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.985 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.985 INFO:teuthology.orchestra.run.smithi092.stdout: "req_renamesnap_latency": { 2023-10-16T13:15:11.985 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.985 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.985 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: "req_snapdiff_latency": { 2023-10-16T13:15:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmdir_latency": { 2023-10-16T13:15:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmsnap_latency": { 2023-10-16T13:15:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmxattr_latency": { 2023-10-16T13:15:11.989 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.989 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.989 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.989 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.989 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setattr_latency": { 2023-10-16T13:15:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setdirlayout_latency": { 2023-10-16T13:15:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.991 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.991 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.991 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.991 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setfilelock_latency": { 2023-10-16T13:15:11.991 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.992 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.992 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.992 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.992 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setlayout_latency": { 2023-10-16T13:15:11.992 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.993 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.993 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.993 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.993 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setxattr_latency": { 2023-10-16T13:15:11.993 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.994 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.994 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.994 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.994 INFO:teuthology.orchestra.run.smithi092.stdout: "req_symlink_latency": { 2023-10-16T13:15:11.994 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: "req_unlink_latency": { 2023-10-16T13:15:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.996 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.996 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.996 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_revoke_eviction": 0, 2023-10-16T13:15:11.996 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_acquisition_throttle": 0, 2023-10-16T13:15:11.996 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getvxattr_latency": { 2023-10-16T13:15:11.996 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_sessions": { 2023-10-16T13:15:11.998 INFO:teuthology.orchestra.run.smithi092.stdout: "session_count": 1, 2023-10-16T13:15:11.998 INFO:teuthology.orchestra.run.smithi092.stdout: "session_add": 1, 2023-10-16T13:15:11.998 INFO:teuthology.orchestra.run.smithi092.stdout: "session_remove": 0, 2023-10-16T13:15:11.998 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_open": 1, 2023-10-16T13:15:11.998 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_stale": 0, 2023-10-16T13:15:11.998 INFO:teuthology.orchestra.run.smithi092.stdout: "total_load": 0, 2023-10-16T13:15:11.999 INFO:teuthology.orchestra.run.smithi092.stdout: "average_load": 0, 2023-10-16T13:15:11.999 INFO:teuthology.orchestra.run.smithi092.stdout: "avg_session_uptime": 1556, 2023-10-16T13:15:11.999 INFO:teuthology.orchestra.run.smithi092.stdout: "mdthresh_evicted": 0 2023-10-16T13:15:11.999 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:11.999 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2023-10-16T13:15:11.999 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2023-10-16T13:15:12.000 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2023-10-16T13:15:12.000 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2023-10-16T13:15:12.000 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2023-10-16T13:15:12.000 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2023-10-16T13:15:12.000 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2023-10-16T13:15:12.001 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-16T13:15:12.001 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2023-10-16T13:15:12.001 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-16T13:15:12.001 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2023-10-16T13:15:12.001 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2023-10-16T13:15:12.002 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2023-10-16T13:15:12.002 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-16T13:15:12.002 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2023-10-16T13:15:12.002 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2023-10-16T13:15:12.002 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2023-10-16T13:15:12.002 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2023-10-16T13:15:12.003 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2023-10-16T13:15:12.003 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-16T13:15:12.003 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2023-10-16T13:15:12.003 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-16T13:15:12.003 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2023-10-16T13:15:12.004 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2023-10-16T13:15:12.004 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2023-10-16T13:15:12.004 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2023-10-16T13:15:12.004 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2023-10-16T13:15:12.004 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-16T13:15:12.005 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2023-10-16T13:15:12.005 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2023-10-16T13:15:12.005 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2023-10-16T13:15:12.005 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2023-10-16T13:15:12.005 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2023-10-16T13:15:12.005 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2023-10-16T13:15:12.006 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2023-10-16T13:15:12.006 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2023-10-16T13:15:12.006 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2023-10-16T13:15:12.006 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 197399, 2023-10-16T13:15:12.007 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 54, 2023-10-16T13:15:12.007 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2023-10-16T13:15:12.007 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2023-10-16T13:15:12.007 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2023-10-16T13:15:12.007 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2023-10-16T13:15:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2023-10-16T13:15:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2023-10-16T13:15:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2023-10-16T13:15:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2023-10-16T13:15:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 7624, 2023-10-16T13:15:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 160, 2023-10-16T13:15:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2023-10-16T13:15:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2023-10-16T13:15:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2023-10-16T13:15:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2023-10-16T13:15:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 726472, 2023-10-16T13:15:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 4110, 2023-10-16T13:15:12.010 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2023-10-16T13:15:12.010 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2023-10-16T13:15:12.010 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2023-10-16T13:15:12.010 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2023-10-16T13:15:12.010 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:12.011 INFO:teuthology.orchestra.run.smithi092.stdout: "objecter": { 2023-10-16T13:15:12.011 INFO:teuthology.orchestra.run.smithi092.stdout: "op_active": 0, 2023-10-16T13:15:12.011 INFO:teuthology.orchestra.run.smithi092.stdout: "op_laggy": 0, 2023-10-16T13:15:12.011 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send": 554, 2023-10-16T13:15:12.011 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send_bytes": 21, 2023-10-16T13:15:12.012 INFO:teuthology.orchestra.run.smithi092.stdout: "op_resend": 3, 2023-10-16T13:15:12.012 INFO:teuthology.orchestra.run.smithi092.stdout: "op_reply": 554, 2023-10-16T13:15:12.012 INFO:teuthology.orchestra.run.smithi092.stdout: "op_latency": { 2023-10-16T13:15:12.012 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 554, 2023-10-16T13:15:12.012 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.540984128, 2023-10-16T13:15:12.012 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000976505 2023-10-16T13:15:12.013 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:12.013 INFO:teuthology.orchestra.run.smithi092.stdout: "op_inflight": 0, 2023-10-16T13:15:12.013 INFO:teuthology.orchestra.run.smithi092.stdout: "oplen_avg": { 2023-10-16T13:15:12.013 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 554, 2023-10-16T13:15:12.013 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 555 2023-10-16T13:15:12.014 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:12.014 INFO:teuthology.orchestra.run.smithi092.stdout: "op": 554, 2023-10-16T13:15:12.014 INFO:teuthology.orchestra.run.smithi092.stdout: "op_r": 554, 2023-10-16T13:15:12.014 INFO:teuthology.orchestra.run.smithi092.stdout: "op_w": 0, 2023-10-16T13:15:12.014 INFO:teuthology.orchestra.run.smithi092.stdout: "op_rmw": 0, 2023-10-16T13:15:12.015 INFO:teuthology.orchestra.run.smithi092.stdout: "op_pg": 0, 2023-10-16T13:15:12.015 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_stat": 323, 2023-10-16T13:15:12.015 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_create": 0, 2023-10-16T13:15:12.015 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_read": 229, 2023-10-16T13:15:12.015 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_write": 0, 2023-10-16T13:15:12.015 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writefull": 0, 2023-10-16T13:15:12.016 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writesame": 0, 2023-10-16T13:15:12.016 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_append": 0, 2023-10-16T13:15:12.016 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_zero": 0, 2023-10-16T13:15:12.016 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_truncate": 0, 2023-10-16T13:15:12.016 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_delete": 0, 2023-10-16T13:15:12.017 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_mapext": 0, 2023-10-16T13:15:12.017 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_sparse_read": 0, 2023-10-16T13:15:12.017 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_clonerange": 0, 2023-10-16T13:15:12.017 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_getxattr": 1, 2023-10-16T13:15:12.017 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_setxattr": 0, 2023-10-16T13:15:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_cmpxattr": 0, 2023-10-16T13:15:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_rmxattr": 0, 2023-10-16T13:15:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_resetxattrs": 0, 2023-10-16T13:15:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_call": 0, 2023-10-16T13:15:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_watch": 0, 2023-10-16T13:15:12.019 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_notify": 0, 2023-10-16T13:15:12.019 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_src_cmpxattr": 0, 2023-10-16T13:15:12.019 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls": 0, 2023-10-16T13:15:12.019 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls_filter": 0, 2023-10-16T13:15:12.019 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_other": 0, 2023-10-16T13:15:12.019 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_active": 0, 2023-10-16T13:15:12.020 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_send": 0, 2023-10-16T13:15:12.020 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_resend": 0, 2023-10-16T13:15:12.020 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_ping": 0, 2023-10-16T13:15:12.020 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_active": 0, 2023-10-16T13:15:12.020 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_send": 0, 2023-10-16T13:15:12.021 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_resend": 0, 2023-10-16T13:15:12.021 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_active": 0, 2023-10-16T13:15:12.021 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_send": 0, 2023-10-16T13:15:12.021 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_resend": 0, 2023-10-16T13:15:12.021 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_active": 0, 2023-10-16T13:15:12.021 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_send": 0, 2023-10-16T13:15:12.022 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_resend": 0, 2023-10-16T13:15:12.022 INFO:teuthology.orchestra.run.smithi092.stdout: "command_active": 0, 2023-10-16T13:15:12.022 INFO:teuthology.orchestra.run.smithi092.stdout: "command_send": 0, 2023-10-16T13:15:12.022 INFO:teuthology.orchestra.run.smithi092.stdout: "command_resend": 0, 2023-10-16T13:15:12.022 INFO:teuthology.orchestra.run.smithi092.stdout: "map_epoch": 85, 2023-10-16T13:15:12.023 INFO:teuthology.orchestra.run.smithi092.stdout: "map_full": 0, 2023-10-16T13:15:12.023 INFO:teuthology.orchestra.run.smithi092.stdout: "map_inc": 2, 2023-10-16T13:15:12.023 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_sessions": 6, 2023-10-16T13:15:12.023 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_open": 6, 2023-10-16T13:15:12.023 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_close": 0, 2023-10-16T13:15:12.023 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_laggy": 0, 2023-10-16T13:15:12.024 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_wr": 0, 2023-10-16T13:15:12.024 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_rd": 2, 2023-10-16T13:15:12.024 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_del": 0 2023-10-16T13:15:12.024 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:12.024 INFO:teuthology.orchestra.run.smithi092.stdout: "oft": { 2023-10-16T13:15:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_objs": 0, 2023-10-16T13:15:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_kv_pairs": 0, 2023-10-16T13:15:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_updates": 0, 2023-10-16T13:15:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_removes": 0 2023-10-16T13:15:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: "osd-slow-ops": { 2023-10-16T13:15:12.026 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_ops_count": 0 2023-10-16T13:15:12.026 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:12.026 INFO:teuthology.orchestra.run.smithi092.stdout: "purge_queue": { 2023-10-16T13:15:12.026 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops": 0, 2023-10-16T13:15:12.026 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops_high_water": 0, 2023-10-16T13:15:12.026 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing": 0, 2023-10-16T13:15:12.027 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_high_water": 0, 2023-10-16T13:15:12.027 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed": 0, 2023-10-16T13:15:12.029 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_item_in_journal": 0 2023-10-16T13:15:12.029 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-16T13:15:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-16T13:15:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2023-10-16T13:15:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-16T13:15:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 639, 2023-10-16T13:15:12.031 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 5887641, 2023-10-16T13:15:12.031 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:12.031 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 639, 2023-10-16T13:15:12.031 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-16T13:15:12.031 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-16T13:15:12.032 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 639, 2023-10-16T13:15:12.032 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 5887641, 2023-10-16T13:15:12.032 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-16T13:15:12.032 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:12.032 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:12.033 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:12.033 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:12.033 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:12.033 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_bytes": { 2023-10-16T13:15:12.033 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-16T13:15:12.034 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2023-10-16T13:15:12.034 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-16T13:15:12.034 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-16T13:15:12.034 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-16T13:15:12.034 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:12.035 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:12.035 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 554, 2023-10-16T13:15:12.035 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 5281398, 2023-10-16T13:15:12.035 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 554, 2023-10-16T13:15:12.035 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 5281398, 2023-10-16T13:15:12.036 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-16T13:15:12.036 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:12.036 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:12.036 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:12.036 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:12.036 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:12.037 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_ops": { 2023-10-16T13:15:12.037 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-16T13:15:12.037 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 1024, 2023-10-16T13:15:12.037 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-16T13:15:12.037 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-16T13:15:12.038 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-16T13:15:12.038 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:12.038 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:12.038 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 554, 2023-10-16T13:15:12.038 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 554, 2023-10-16T13:15:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 554, 2023-10-16T13:15:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 554, 2023-10-16T13:15:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-16T13:15:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:12.040 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:12.040 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:12.040 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle": { 2023-10-16T13:15:12.040 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-16T13:15:12.040 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2023-10-16T13:15:12.041 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-16T13:15:12.041 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-16T13:15:12.041 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-16T13:15:12.041 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:12.041 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:12.042 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-16T13:15:12.042 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-16T13:15:12.042 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 0, 2023-10-16T13:15:12.042 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 0, 2023-10-16T13:15:12.042 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-16T13:15:12.042 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:12.043 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:12.043 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:12.043 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:12.043 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:12.043 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle-0x55d479e14960": { 2023-10-16T13:15:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-16T13:15:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2023-10-16T13:15:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-16T13:15:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-16T13:15:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-16T13:15:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:12.045 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:12.045 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-16T13:15:12.045 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-16T13:15:12.045 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 0, 2023-10-16T13:15:12.045 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 0, 2023-10-16T13:15:12.046 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-16T13:15:12.046 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:12.046 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:12.046 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:12.046 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:12.046 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:12.047 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:15:12.469 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2023-10-16T13:15:12.470 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2023-10-16T13:15:12.470 DEBUG:tasks.check_counter:Getting stats from d 2023-10-16T13:15:12.471 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph daemon mds.d perf dump 2023-10-16T13:15:12.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:12 smithi152 ceph-mon[104423]: pgmap v363: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 330 op/s 2023-10-16T13:15:12.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:12 smithi092 ceph-mon[99542]: pgmap v363: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 330 op/s 2023-10-16T13:15:12.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:12 smithi118 ceph-mon[103969]: pgmap v363: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 330 op/s 2023-10-16T13:15:13.029 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:15:14.350 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:15:14.351 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2023-10-16T13:15:14.351 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 0, 2023-10-16T13:15:14.351 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 2, 2023-10-16T13:15:14.351 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 0, 2023-10-16T13:15:14.352 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 0, 2023-10-16T13:15:14.352 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 4, 2023-10-16T13:15:14.352 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 0, 2023-10-16T13:15:14.352 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.001191788, 2023-10-16T13:15:14.352 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.000000000, 2023-10-16T13:15:14.352 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.000257452, 2023-10-16T13:15:14.353 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-16T13:15:14.353 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:14.353 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:14.353 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:14.353 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:14.354 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:14.354 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:14.354 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:14.354 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:14.354 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:14.355 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:14.355 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-16T13:15:14.355 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 0 2023-10-16T13:15:14.355 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:14.355 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2023-10-16T13:15:14.356 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 75, 2023-10-16T13:15:14.356 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 70, 2023-10-16T13:15:14.356 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 433200, 2023-10-16T13:15:14.356 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 39968, 2023-10-16T13:15:14.357 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 2, 2023-10-16T13:15:14.357 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 1, 2023-10-16T13:15:14.357 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.012062922, 2023-10-16T13:15:14.357 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.003976477, 2023-10-16T13:15:14.357 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.008893301, 2023-10-16T13:15:14.358 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.001358069, 2023-10-16T13:15:14.358 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:14.358 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 70, 2023-10-16T13:15:14.358 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.004473245, 2023-10-16T13:15:14.358 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000063903 2023-10-16T13:15:14.359 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:14.359 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:14.359 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:14.359 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:14.359 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:14.360 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:14.360 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 433200, 2023-10-16T13:15:14.360 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 39968 2023-10-16T13:15:14.360 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:14.360 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2023-10-16T13:15:14.361 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 1, 2023-10-16T13:15:14.361 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 51, 2023-10-16T13:15:14.361 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 160, 2023-10-16T13:15:14.361 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 85424, 2023-10-16T13:15:14.361 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 3, 2023-10-16T13:15:14.362 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 2, 2023-10-16T13:15:14.362 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.004147181, 2023-10-16T13:15:14.362 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.002431020, 2023-10-16T13:15:14.362 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.001145705, 2023-10-16T13:15:14.362 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-16T13:15:14.363 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:14.363 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 49, 2023-10-16T13:15:14.363 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.003516698, 2023-10-16T13:15:14.363 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000071769 2023-10-16T13:15:14.363 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:14.363 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:14.364 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:14.364 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:14.364 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:14.364 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:14.365 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-16T13:15:14.365 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 85424 2023-10-16T13:15:14.365 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:14.365 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2023-10-16T13:15:14.365 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 0, 2023-10-16T13:15:14.366 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2023-10-16T13:15:14.366 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:14.366 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2023-10-16T13:15:14.366 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2023-10-16T13:15:14.367 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2023-10-16T13:15:14.367 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2023-10-16T13:15:14.367 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2023-10-16T13:15:14.367 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2023-10-16T13:15:14.367 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2023-10-16T13:15:14.368 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-16T13:15:14.368 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2023-10-16T13:15:14.368 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-16T13:15:14.368 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2023-10-16T13:15:14.368 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2023-10-16T13:15:14.369 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2023-10-16T13:15:14.369 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-16T13:15:14.369 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2023-10-16T13:15:14.369 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2023-10-16T13:15:14.370 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2023-10-16T13:15:14.370 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2023-10-16T13:15:14.370 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2023-10-16T13:15:14.370 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-16T13:15:14.370 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2023-10-16T13:15:14.371 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-16T13:15:14.371 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2023-10-16T13:15:14.371 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2023-10-16T13:15:14.371 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2023-10-16T13:15:14.371 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2023-10-16T13:15:14.372 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2023-10-16T13:15:14.372 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-16T13:15:14.372 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2023-10-16T13:15:14.372 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2023-10-16T13:15:14.373 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2023-10-16T13:15:14.373 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2023-10-16T13:15:14.373 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2023-10-16T13:15:14.373 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2023-10-16T13:15:14.373 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2023-10-16T13:15:14.374 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2023-10-16T13:15:14.374 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2023-10-16T13:15:14.374 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 148823, 2023-10-16T13:15:14.374 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 27, 2023-10-16T13:15:14.375 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2023-10-16T13:15:14.375 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2023-10-16T13:15:14.375 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2023-10-16T13:15:14.375 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2023-10-16T13:15:14.375 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2023-10-16T13:15:14.376 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2023-10-16T13:15:14.376 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2023-10-16T13:15:14.376 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2023-10-16T13:15:14.376 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 0, 2023-10-16T13:15:14.376 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 0, 2023-10-16T13:15:14.377 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2023-10-16T13:15:14.377 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2023-10-16T13:15:14.377 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2023-10-16T13:15:14.377 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2023-10-16T13:15:14.377 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 928, 2023-10-16T13:15:14.378 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 2, 2023-10-16T13:15:14.378 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2023-10-16T13:15:14.378 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2023-10-16T13:15:14.378 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2023-10-16T13:15:14.378 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2023-10-16T13:15:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-16T13:15:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-16T13:15:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2023-10-16T13:15:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-16T13:15:14.380 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 72, 2023-10-16T13:15:14.380 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 420263, 2023-10-16T13:15:14.380 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:14.380 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 72, 2023-10-16T13:15:14.380 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-16T13:15:14.381 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-16T13:15:14.381 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 72, 2023-10-16T13:15:14.381 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 420263, 2023-10-16T13:15:14.381 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-16T13:15:14.381 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:14.381 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:14.382 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:14.382 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:14.382 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:14.382 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:15:14.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:14 smithi152 ceph-mon[104423]: pgmap v364: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 949 KiB/s wr, 279 op/s 2023-10-16T13:15:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:14 smithi092 ceph-mon[99542]: pgmap v364: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 949 KiB/s wr, 279 op/s 2023-10-16T13:15:14.779 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-10-16T13:15:14.780 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-10-16T13:15:14.780 DEBUG:tasks.check_counter:Getting stats from g 2023-10-16T13:15:14.780 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph daemon mds.g perf dump 2023-10-16T13:15:14.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:14 smithi118 ceph-mon[103969]: pgmap v364: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 949 KiB/s wr, 279 op/s 2023-10-16T13:15:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:15:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:16 smithi092 ceph-mon[99542]: pgmap v365: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 610 KiB/s wr, 189 op/s 2023-10-16T13:15:16.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:16 smithi152 ceph-mon[104423]: pgmap v365: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 610 KiB/s wr, 189 op/s 2023-10-16T13:15:16.716 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:15:16.717 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2023-10-16T13:15:16.717 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 213, 2023-10-16T13:15:16.717 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 213, 2023-10-16T13:15:16.717 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 73113, 2023-10-16T13:15:16.717 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 65448, 2023-10-16T13:15:16.718 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 6, 2023-10-16T13:15:16.718 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 2, 2023-10-16T13:15:16.718 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.022771085, 2023-10-16T13:15:16.718 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.008553315, 2023-10-16T13:15:16.719 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.005355292, 2023-10-16T13:15:16.719 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.005985446, 2023-10-16T13:15:16.719 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:16.719 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 212, 2023-10-16T13:15:16.719 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.012143710, 2023-10-16T13:15:16.720 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000057281 2023-10-16T13:15:16.720 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.720 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:16.720 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.720 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.721 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.721 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.721 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 2944, 2023-10-16T13:15:16.721 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 448 2023-10-16T13:15:16.721 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.721 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2023-10-16T13:15:16.722 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 434, 2023-10-16T13:15:16.722 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 421, 2023-10-16T13:15:16.722 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 4877418, 2023-10-16T13:15:16.722 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 147428, 2023-10-16T13:15:16.723 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 4, 2023-10-16T13:15:16.723 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 3, 2023-10-16T13:15:16.723 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.035078860, 2023-10-16T13:15:16.723 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.009355647, 2023-10-16T13:15:16.723 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.017625110, 2023-10-16T13:15:16.724 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.009178732, 2023-10-16T13:15:16.724 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:16.724 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 420, 2023-10-16T13:15:16.724 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.012947645, 2023-10-16T13:15:16.724 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000030827 2023-10-16T13:15:16.724 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.725 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:16.725 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.725 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.725 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.725 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.726 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 509504, 2023-10-16T13:15:16.726 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 38832 2023-10-16T13:15:16.726 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.726 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2023-10-16T13:15:16.726 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 4, 2023-10-16T13:15:16.727 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 52, 2023-10-16T13:15:16.727 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 1508, 2023-10-16T13:15:16.727 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 161536, 2023-10-16T13:15:16.727 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 5, 2023-10-16T13:15:16.727 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 4, 2023-10-16T13:15:16.728 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.004619687, 2023-10-16T13:15:16.728 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.002428339, 2023-10-16T13:15:16.728 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.001656783, 2023-10-16T13:15:16.728 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000068888, 2023-10-16T13:15:16.728 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:16.728 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 50, 2023-10-16T13:15:16.729 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.003190678, 2023-10-16T13:15:16.729 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000063813 2023-10-16T13:15:16.729 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.729 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:16.729 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.730 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.730 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.730 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.730 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-16T13:15:16.730 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 160592 2023-10-16T13:15:16.730 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.731 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2023-10-16T13:15:16.731 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 1, 2023-10-16T13:15:16.731 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2023-10-16T13:15:16.731 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.731 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-MDSRank": { 2023-10-16T13:15:16.732 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2023-10-16T13:15:16.732 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2023-10-16T13:15:16.732 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 993, 2023-10-16T13:15:16.732 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.022766043, 2023-10-16T13:15:16.732 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000022926 2023-10-16T13:15:16.733 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:16.733 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.733 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-PurgeQueue": { 2023-10-16T13:15:16.733 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2023-10-16T13:15:16.733 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2023-10-16T13:15:16.734 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.734 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.734 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.734 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:16.734 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.735 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": { 2023-10-16T13:15:16.735 INFO:teuthology.orchestra.run.smithi092.stdout: "request": 0, 2023-10-16T13:15:16.735 INFO:teuthology.orchestra.run.smithi092.stdout: "reply": 0, 2023-10-16T13:15:16.735 INFO:teuthology.orchestra.run.smithi092.stdout: "reply_latency": { 2023-10-16T13:15:16.735 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.735 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.736 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.736 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.736 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_reply": 0, 2023-10-16T13:15:16.736 INFO:teuthology.orchestra.run.smithi092.stdout: "forward": 0, 2023-10-16T13:15:16.736 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_complete": 0, 2023-10-16T13:15:16.736 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_keys": 0, 2023-10-16T13:15:16.737 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_commit": 0, 2023-10-16T13:15:16.737 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_split": 0, 2023-10-16T13:15:16.737 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_merge": 0, 2023-10-16T13:15:16.737 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes": 849, 2023-10-16T13:15:16.737 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_top": 0, 2023-10-16T13:15:16.737 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_bottom": 0, 2023-10-16T13:15:16.738 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pin_tail": 849, 2023-10-16T13:15:16.738 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pinned": 849, 2023-10-16T13:15:16.738 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_expired": 0, 2023-10-16T13:15:16.738 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_with_caps": 0, 2023-10-16T13:15:16.738 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": 0, 2023-10-16T13:15:16.739 INFO:teuthology.orchestra.run.smithi092.stdout: "subtrees": 1, 2023-10-16T13:15:16.739 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse": 0, 2023-10-16T13:15:16.739 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_hit": 0, 2023-10-16T13:15:16.739 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_forward": 0, 2023-10-16T13:15:16.739 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_discover": 0, 2023-10-16T13:15:16.739 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_dir_fetch": 0, 2023-10-16T13:15:16.739 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_remote_ino": 0, 2023-10-16T13:15:16.740 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_lock": 0, 2023-10-16T13:15:16.740 INFO:teuthology.orchestra.run.smithi092.stdout: "load_cent": 0, 2023-10-16T13:15:16.740 INFO:teuthology.orchestra.run.smithi092.stdout: "q": 0, 2023-10-16T13:15:16.740 INFO:teuthology.orchestra.run.smithi092.stdout: "exported": 0, 2023-10-16T13:15:16.740 INFO:teuthology.orchestra.run.smithi092.stdout: "exported_inodes": 0, 2023-10-16T13:15:16.741 INFO:teuthology.orchestra.run.smithi092.stdout: "imported": 0, 2023-10-16T13:15:16.741 INFO:teuthology.orchestra.run.smithi092.stdout: "imported_inodes": 0, 2023-10-16T13:15:16.741 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_dir_fetch": 0, 2023-10-16T13:15:16.741 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_backtrace_fetch": 0, 2023-10-16T13:15:16.741 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_peer_discover": 0, 2023-10-16T13:15:16.741 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rfiles": 0, 2023-10-16T13:15:16.742 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rbytes": 0, 2023-10-16T13:15:16.742 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rsnaps": 0, 2023-10-16T13:15:16.742 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_fetch": 0, 2023-10-16T13:15:16.742 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_set_tag": 0, 2023-10-16T13:15:16.742 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_repaired": 0, 2023-10-16T13:15:16.743 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_inotable_repaired": 0, 2023-10-16T13:15:16.743 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_inodes": 0, 2023-10-16T13:15:16.743 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_base_inodes": 0, 2023-10-16T13:15:16.743 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dirfrag_rstats": 0, 2023-10-16T13:15:16.743 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_file_inodes": 0, 2023-10-16T13:15:16.743 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_inode_file_caps": 0, 2023-10-16T13:15:16.744 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_revoke": 0, 2023-10-16T13:15:16.744 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_grant": 0, 2023-10-16T13:15:16.744 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_trunc": 0, 2023-10-16T13:15:16.744 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-16T13:15:16.744 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-16T13:15:16.745 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps": 0, 2023-10-16T13:15:16.745 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps_dirty": 0, 2023-10-16T13:15:16.745 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_cap_release": 0, 2023-10-16T13:15:16.745 INFO:teuthology.orchestra.run.smithi092.stdout: "process_request_cap_release": 0 2023-10-16T13:15:16.745 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.746 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_cache": { 2023-10-16T13:15:16.746 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update": 0, 2023-10-16T13:15:16.746 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update_receipt": 0, 2023-10-16T13:15:16.746 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_try_discover": 0, 2023-10-16T13:15:16.746 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_send_discover": 0, 2023-10-16T13:15:16.747 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_handle_discover": 0, 2023-10-16T13:15:16.747 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays": 0, 2023-10-16T13:15:16.747 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_delayed": 0, 2023-10-16T13:15:16.747 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_enqueuing": 0, 2023-10-16T13:15:16.747 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_created": 0, 2023-10-16T13:15:16.747 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_enqueued": 0, 2023-10-16T13:15:16.748 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_reintegrated": 0, 2023-10-16T13:15:16.748 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_migrated": 0, 2023-10-16T13:15:16.748 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_processing": 0, 2023-10-16T13:15:16.748 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_enqueued": 0, 2023-10-16T13:15:16.748 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_prioritized": 0, 2023-10-16T13:15:16.749 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_started": 0, 2023-10-16T13:15:16.749 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_completed": 0, 2023-10-16T13:15:16.749 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_enqueue_scrub": 0, 2023-10-16T13:15:16.749 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_exportdir": 0, 2023-10-16T13:15:16.749 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_flush": 0, 2023-10-16T13:15:16.750 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragmentdir": 0, 2023-10-16T13:15:16.750 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragstats": 0, 2023-10-16T13:15:16.750 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_inodestats": 0 2023-10-16T13:15:16.750 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.750 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_log": { 2023-10-16T13:15:16.751 INFO:teuthology.orchestra.run.smithi092.stdout: "evlrg": 0, 2023-10-16T13:15:16.751 INFO:teuthology.orchestra.run.smithi092.stdout: "evadd": 0, 2023-10-16T13:15:16.751 INFO:teuthology.orchestra.run.smithi092.stdout: "evex": 0, 2023-10-16T13:15:16.751 INFO:teuthology.orchestra.run.smithi092.stdout: "evtrm": 0, 2023-10-16T13:15:16.751 INFO:teuthology.orchestra.run.smithi092.stdout: "ev": 2087, 2023-10-16T13:15:16.751 INFO:teuthology.orchestra.run.smithi092.stdout: "evexg": 0, 2023-10-16T13:15:16.752 INFO:teuthology.orchestra.run.smithi092.stdout: "evexd": 0, 2023-10-16T13:15:16.752 INFO:teuthology.orchestra.run.smithi092.stdout: "segadd": 0, 2023-10-16T13:15:16.752 INFO:teuthology.orchestra.run.smithi092.stdout: "segex": 0, 2023-10-16T13:15:16.752 INFO:teuthology.orchestra.run.smithi092.stdout: "segtrm": 0, 2023-10-16T13:15:16.752 INFO:teuthology.orchestra.run.smithi092.stdout: "seg": 4, 2023-10-16T13:15:16.752 INFO:teuthology.orchestra.run.smithi092.stdout: "segmjr": 2, 2023-10-16T13:15:16.753 INFO:teuthology.orchestra.run.smithi092.stdout: "segexg": 0, 2023-10-16T13:15:16.753 INFO:teuthology.orchestra.run.smithi092.stdout: "segexd": 0, 2023-10-16T13:15:16.753 INFO:teuthology.orchestra.run.smithi092.stdout: "expos": 4194304, 2023-10-16T13:15:16.753 INFO:teuthology.orchestra.run.smithi092.stdout: "wrpos": 8472332, 2023-10-16T13:15:16.753 INFO:teuthology.orchestra.run.smithi092.stdout: "rdpos": 8471194, 2023-10-16T13:15:16.754 INFO:teuthology.orchestra.run.smithi092.stdout: "jlat": { 2023-10-16T13:15:16.754 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.754 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.754 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.754 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.755 INFO:teuthology.orchestra.run.smithi092.stdout: "replayed": 2087 2023-10-16T13:15:16.755 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.755 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_mem": { 2023-10-16T13:15:16.755 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 7, 2023-10-16T13:15:16.755 INFO:teuthology.orchestra.run.smithi092.stdout: "ino+": 922, 2023-10-16T13:15:16.755 INFO:teuthology.orchestra.run.smithi092.stdout: "ino-": 915, 2023-10-16T13:15:16.756 INFO:teuthology.orchestra.run.smithi092.stdout: "dir": 5, 2023-10-16T13:15:16.756 INFO:teuthology.orchestra.run.smithi092.stdout: "dir+": 120, 2023-10-16T13:15:16.756 INFO:teuthology.orchestra.run.smithi092.stdout: "dir-": 115, 2023-10-16T13:15:16.756 INFO:teuthology.orchestra.run.smithi092.stdout: "dn": 849, 2023-10-16T13:15:16.756 INFO:teuthology.orchestra.run.smithi092.stdout: "dn+": 1777, 2023-10-16T13:15:16.756 INFO:teuthology.orchestra.run.smithi092.stdout: "dn-": 928, 2023-10-16T13:15:16.757 INFO:teuthology.orchestra.run.smithi092.stdout: "cap": 0, 2023-10-16T13:15:16.757 INFO:teuthology.orchestra.run.smithi092.stdout: "cap+": 0, 2023-10-16T13:15:16.757 INFO:teuthology.orchestra.run.smithi092.stdout: "cap-": 0, 2023-10-16T13:15:16.757 INFO:teuthology.orchestra.run.smithi092.stdout: "rss": 48596, 2023-10-16T13:15:16.757 INFO:teuthology.orchestra.run.smithi092.stdout: "heap": 207152 2023-10-16T13:15:16.757 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.758 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_server": { 2023-10-16T13:15:16.758 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_client_request": 0, 2023-10-16T13:15:16.758 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_server_request": 0, 2023-10-16T13:15:16.758 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_request": 0, 2023-10-16T13:15:16.758 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_session": 0, 2023-10-16T13:15:16.759 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_peer_request": 0, 2023-10-16T13:15:16.759 INFO:teuthology.orchestra.run.smithi092.stdout: "req_create_latency": { 2023-10-16T13:15:16.759 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.759 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.759 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.759 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.760 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getattr_latency": { 2023-10-16T13:15:16.760 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.760 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.760 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.760 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.761 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getfilelock_latency": { 2023-10-16T13:15:16.761 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.761 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.761 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.761 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.761 INFO:teuthology.orchestra.run.smithi092.stdout: "req_link_latency": { 2023-10-16T13:15:16.762 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.762 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.762 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.762 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.762 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookup_latency": { 2023-10-16T13:15:16.762 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.763 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.763 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.763 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.763 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookuphash_latency": { 2023-10-16T13:15:16.763 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.764 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.764 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.764 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.764 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupino_latency": { 2023-10-16T13:15:16.764 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.764 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.765 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.765 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.765 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupname_latency": { 2023-10-16T13:15:16.765 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.765 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.765 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.766 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.766 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupparent_latency": { 2023-10-16T13:15:16.766 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.766 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.766 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.766 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.767 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupsnap_latency": { 2023-10-16T13:15:16.767 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.767 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.767 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.767 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.767 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lssnap_latency": { 2023-10-16T13:15:16.768 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.768 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.768 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.768 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.768 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mkdir_latency": { 2023-10-16T13:15:16.768 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.769 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.769 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.769 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.769 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mknod_latency": { 2023-10-16T13:15:16.769 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.769 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.770 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.770 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.770 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mksnap_latency": { 2023-10-16T13:15:16.770 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.770 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.771 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.771 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.771 INFO:teuthology.orchestra.run.smithi092.stdout: "req_open_latency": { 2023-10-16T13:15:16.771 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.771 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.771 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.772 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.772 INFO:teuthology.orchestra.run.smithi092.stdout: "req_readdir_latency": { 2023-10-16T13:15:16.772 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.772 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.772 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.772 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.773 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rename_latency": { 2023-10-16T13:15:16.773 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.773 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.773 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.773 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.773 INFO:teuthology.orchestra.run.smithi092.stdout: "req_renamesnap_latency": { 2023-10-16T13:15:16.774 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.774 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.774 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.774 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.774 INFO:teuthology.orchestra.run.smithi092.stdout: "req_snapdiff_latency": { 2023-10-16T13:15:16.775 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.775 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.775 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.775 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.775 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmdir_latency": { 2023-10-16T13:15:16.775 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.776 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.776 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.776 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.776 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmsnap_latency": { 2023-10-16T13:15:16.776 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.777 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.777 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.777 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.777 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmxattr_latency": { 2023-10-16T13:15:16.777 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.777 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.778 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.778 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.778 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setattr_latency": { 2023-10-16T13:15:16.778 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.778 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.779 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.779 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.779 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setdirlayout_latency": { 2023-10-16T13:15:16.779 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.779 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.779 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.780 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.780 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setfilelock_latency": { 2023-10-16T13:15:16.780 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.780 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.780 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.781 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.781 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setlayout_latency": { 2023-10-16T13:15:16.781 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.781 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.781 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.782 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.782 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setxattr_latency": { 2023-10-16T13:15:16.782 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.782 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.782 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.782 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.783 INFO:teuthology.orchestra.run.smithi092.stdout: "req_symlink_latency": { 2023-10-16T13:15:16.783 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.783 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.783 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.783 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.784 INFO:teuthology.orchestra.run.smithi092.stdout: "req_unlink_latency": { 2023-10-16T13:15:16.784 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.784 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.784 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.784 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.784 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_revoke_eviction": 0, 2023-10-16T13:15:16.785 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_acquisition_throttle": 0, 2023-10-16T13:15:16.785 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getvxattr_latency": { 2023-10-16T13:15:16.785 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.785 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.785 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.786 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:16.786 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.786 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_sessions": { 2023-10-16T13:15:16.786 INFO:teuthology.orchestra.run.smithi092.stdout: "session_count": 1, 2023-10-16T13:15:16.786 INFO:teuthology.orchestra.run.smithi092.stdout: "session_add": 1, 2023-10-16T13:15:16.787 INFO:teuthology.orchestra.run.smithi092.stdout: "session_remove": 0, 2023-10-16T13:15:16.787 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_open": 1, 2023-10-16T13:15:16.787 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_stale": 0, 2023-10-16T13:15:16.787 INFO:teuthology.orchestra.run.smithi092.stdout: "total_load": 0, 2023-10-16T13:15:16.787 INFO:teuthology.orchestra.run.smithi092.stdout: "average_load": 0, 2023-10-16T13:15:16.787 INFO:teuthology.orchestra.run.smithi092.stdout: "avg_session_uptime": 1559, 2023-10-16T13:15:16.788 INFO:teuthology.orchestra.run.smithi092.stdout: "mdthresh_evicted": 0 2023-10-16T13:15:16.788 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.788 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2023-10-16T13:15:16.788 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2023-10-16T13:15:16.788 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2023-10-16T13:15:16.788 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2023-10-16T13:15:16.789 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2023-10-16T13:15:16.789 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2023-10-16T13:15:16.789 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2023-10-16T13:15:16.789 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-16T13:15:16.789 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2023-10-16T13:15:16.790 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-16T13:15:16.790 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2023-10-16T13:15:16.790 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2023-10-16T13:15:16.790 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2023-10-16T13:15:16.790 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-16T13:15:16.790 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2023-10-16T13:15:16.791 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2023-10-16T13:15:16.791 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2023-10-16T13:15:16.791 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2023-10-16T13:15:16.791 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2023-10-16T13:15:16.791 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-16T13:15:16.792 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2023-10-16T13:15:16.792 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-16T13:15:16.792 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2023-10-16T13:15:16.792 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2023-10-16T13:15:16.792 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2023-10-16T13:15:16.793 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2023-10-16T13:15:16.793 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2023-10-16T13:15:16.793 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-16T13:15:16.793 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2023-10-16T13:15:16.793 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2023-10-16T13:15:16.793 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2023-10-16T13:15:16.794 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2023-10-16T13:15:16.794 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2023-10-16T13:15:16.794 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2023-10-16T13:15:16.794 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2023-10-16T13:15:16.794 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2023-10-16T13:15:16.795 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2023-10-16T13:15:16.795 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 197467, 2023-10-16T13:15:16.795 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 56, 2023-10-16T13:15:16.795 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2023-10-16T13:15:16.795 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2023-10-16T13:15:16.795 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2023-10-16T13:15:16.796 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2023-10-16T13:15:16.796 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2023-10-16T13:15:16.796 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2023-10-16T13:15:16.796 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2023-10-16T13:15:16.796 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2023-10-16T13:15:16.797 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 7624, 2023-10-16T13:15:16.797 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 160, 2023-10-16T13:15:16.797 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2023-10-16T13:15:16.797 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2023-10-16T13:15:16.797 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2023-10-16T13:15:16.798 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2023-10-16T13:15:16.798 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 613703, 2023-10-16T13:15:16.798 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 3771, 2023-10-16T13:15:16.798 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2023-10-16T13:15:16.798 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2023-10-16T13:15:16.798 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2023-10-16T13:15:16.799 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2023-10-16T13:15:16.799 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.799 INFO:teuthology.orchestra.run.smithi092.stdout: "objecter": { 2023-10-16T13:15:16.799 INFO:teuthology.orchestra.run.smithi092.stdout: "op_active": 0, 2023-10-16T13:15:16.799 INFO:teuthology.orchestra.run.smithi092.stdout: "op_laggy": 0, 2023-10-16T13:15:16.799 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send": 561, 2023-10-16T13:15:16.800 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send_bytes": 21, 2023-10-16T13:15:16.800 INFO:teuthology.orchestra.run.smithi092.stdout: "op_resend": 3, 2023-10-16T13:15:16.800 INFO:teuthology.orchestra.run.smithi092.stdout: "op_reply": 561, 2023-10-16T13:15:16.800 INFO:teuthology.orchestra.run.smithi092.stdout: "op_latency": { 2023-10-16T13:15:16.800 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 561, 2023-10-16T13:15:16.800 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.831975580, 2023-10-16T13:15:16.801 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.001483022 2023-10-16T13:15:16.801 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.801 INFO:teuthology.orchestra.run.smithi092.stdout: "op_inflight": 0, 2023-10-16T13:15:16.801 INFO:teuthology.orchestra.run.smithi092.stdout: "oplen_avg": { 2023-10-16T13:15:16.801 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 561, 2023-10-16T13:15:16.802 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 562 2023-10-16T13:15:16.802 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.802 INFO:teuthology.orchestra.run.smithi092.stdout: "op": 561, 2023-10-16T13:15:16.802 INFO:teuthology.orchestra.run.smithi092.stdout: "op_r": 561, 2023-10-16T13:15:16.802 INFO:teuthology.orchestra.run.smithi092.stdout: "op_w": 0, 2023-10-16T13:15:16.803 INFO:teuthology.orchestra.run.smithi092.stdout: "op_rmw": 0, 2023-10-16T13:15:16.803 INFO:teuthology.orchestra.run.smithi092.stdout: "op_pg": 0, 2023-10-16T13:15:16.803 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_stat": 326, 2023-10-16T13:15:16.803 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_create": 0, 2023-10-16T13:15:16.803 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_read": 233, 2023-10-16T13:15:16.803 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_write": 0, 2023-10-16T13:15:16.804 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writefull": 0, 2023-10-16T13:15:16.804 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writesame": 0, 2023-10-16T13:15:16.804 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_append": 0, 2023-10-16T13:15:16.804 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_zero": 0, 2023-10-16T13:15:16.804 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_truncate": 0, 2023-10-16T13:15:16.804 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_delete": 0, 2023-10-16T13:15:16.805 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_mapext": 0, 2023-10-16T13:15:16.805 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_sparse_read": 0, 2023-10-16T13:15:16.805 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_clonerange": 0, 2023-10-16T13:15:16.805 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_getxattr": 1, 2023-10-16T13:15:16.805 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_setxattr": 0, 2023-10-16T13:15:16.806 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_cmpxattr": 0, 2023-10-16T13:15:16.806 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_rmxattr": 0, 2023-10-16T13:15:16.806 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_resetxattrs": 0, 2023-10-16T13:15:16.806 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_call": 0, 2023-10-16T13:15:16.806 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_watch": 0, 2023-10-16T13:15:16.806 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_notify": 0, 2023-10-16T13:15:16.807 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_src_cmpxattr": 0, 2023-10-16T13:15:16.807 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls": 0, 2023-10-16T13:15:16.807 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls_filter": 0, 2023-10-16T13:15:16.807 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_other": 0, 2023-10-16T13:15:16.807 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_active": 0, 2023-10-16T13:15:16.808 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_send": 0, 2023-10-16T13:15:16.808 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_resend": 0, 2023-10-16T13:15:16.808 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_ping": 0, 2023-10-16T13:15:16.808 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_active": 0, 2023-10-16T13:15:16.808 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_send": 0, 2023-10-16T13:15:16.808 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_resend": 0, 2023-10-16T13:15:16.809 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_active": 0, 2023-10-16T13:15:16.809 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_send": 0, 2023-10-16T13:15:16.809 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_resend": 0, 2023-10-16T13:15:16.809 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_active": 0, 2023-10-16T13:15:16.809 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_send": 0, 2023-10-16T13:15:16.810 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_resend": 0, 2023-10-16T13:15:16.810 INFO:teuthology.orchestra.run.smithi092.stdout: "command_active": 0, 2023-10-16T13:15:16.810 INFO:teuthology.orchestra.run.smithi092.stdout: "command_send": 0, 2023-10-16T13:15:16.810 INFO:teuthology.orchestra.run.smithi092.stdout: "command_resend": 0, 2023-10-16T13:15:16.810 INFO:teuthology.orchestra.run.smithi092.stdout: "map_epoch": 85, 2023-10-16T13:15:16.811 INFO:teuthology.orchestra.run.smithi092.stdout: "map_full": 0, 2023-10-16T13:15:16.811 INFO:teuthology.orchestra.run.smithi092.stdout: "map_inc": 2, 2023-10-16T13:15:16.811 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_sessions": 6, 2023-10-16T13:15:16.811 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_open": 6, 2023-10-16T13:15:16.811 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_close": 0, 2023-10-16T13:15:16.811 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_laggy": 0, 2023-10-16T13:15:16.812 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_wr": 0, 2023-10-16T13:15:16.812 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_rd": 2, 2023-10-16T13:15:16.812 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_del": 0 2023-10-16T13:15:16.812 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.812 INFO:teuthology.orchestra.run.smithi092.stdout: "oft": { 2023-10-16T13:15:16.813 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_objs": 0, 2023-10-16T13:15:16.813 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_kv_pairs": 0, 2023-10-16T13:15:16.813 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_updates": 0, 2023-10-16T13:15:16.813 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_removes": 0 2023-10-16T13:15:16.813 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.813 INFO:teuthology.orchestra.run.smithi092.stdout: "osd-slow-ops": { 2023-10-16T13:15:16.814 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_ops_count": 0 2023-10-16T13:15:16.814 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.814 INFO:teuthology.orchestra.run.smithi092.stdout: "purge_queue": { 2023-10-16T13:15:16.814 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops": 0, 2023-10-16T13:15:16.815 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops_high_water": 0, 2023-10-16T13:15:16.815 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing": 0, 2023-10-16T13:15:16.815 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_high_water": 0, 2023-10-16T13:15:16.815 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed": 0, 2023-10-16T13:15:16.815 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_item_in_journal": 0 2023-10-16T13:15:16.815 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.816 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-16T13:15:16.816 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-16T13:15:16.816 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2023-10-16T13:15:16.816 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-16T13:15:16.816 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 647, 2023-10-16T13:15:16.817 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 4886588, 2023-10-16T13:15:16.817 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:16.817 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 647, 2023-10-16T13:15:16.817 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-16T13:15:16.817 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-16T13:15:16.817 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 647, 2023-10-16T13:15:16.818 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 4886588, 2023-10-16T13:15:16.818 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-16T13:15:16.818 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.818 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.818 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.819 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:16.819 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.819 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_bytes": { 2023-10-16T13:15:16.819 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-16T13:15:16.819 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2023-10-16T13:15:16.820 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-16T13:15:16.820 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-16T13:15:16.820 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-16T13:15:16.820 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:16.820 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:16.821 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 561, 2023-10-16T13:15:16.821 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 4278529, 2023-10-16T13:15:16.821 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 561, 2023-10-16T13:15:16.821 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 4278529, 2023-10-16T13:15:16.821 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-16T13:15:16.821 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.822 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.822 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.822 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:16.822 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.822 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_ops": { 2023-10-16T13:15:16.823 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-16T13:15:16.823 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 1024, 2023-10-16T13:15:16.823 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-16T13:15:16.823 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-16T13:15:16.823 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-16T13:15:16.824 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:16.824 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:16.824 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 561, 2023-10-16T13:15:16.824 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 561, 2023-10-16T13:15:16.824 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 561, 2023-10-16T13:15:16.825 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 561, 2023-10-16T13:15:16.825 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-16T13:15:16.825 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.825 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.825 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.825 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:16.826 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.826 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle": { 2023-10-16T13:15:16.826 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-16T13:15:16.826 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2023-10-16T13:15:16.826 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-16T13:15:16.827 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-16T13:15:16.827 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-16T13:15:16.827 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:16.827 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:16.827 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-16T13:15:16.828 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-16T13:15:16.828 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 0, 2023-10-16T13:15:16.828 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 0, 2023-10-16T13:15:16.828 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-16T13:15:16.828 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.828 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.829 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.829 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:16.829 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:16.829 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle-0x55aebab3e960": { 2023-10-16T13:15:16.829 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-16T13:15:16.830 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2023-10-16T13:15:16.830 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-16T13:15:16.830 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-16T13:15:16.830 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-16T13:15:16.830 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:16.830 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:16.831 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-16T13:15:16.831 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-16T13:15:16.831 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 0, 2023-10-16T13:15:16.831 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 0, 2023-10-16T13:15:16.831 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-16T13:15:16.832 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:16.832 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:16.832 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:16.832 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:16.832 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:16.832 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:15:16.833 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:16 smithi118 ceph-mon[103969]: pgmap v365: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 610 KiB/s wr, 189 op/s 2023-10-16T13:15:17.207 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2023-10-16T13:15:17.207 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2023-10-16T13:15:17.207 DEBUG:tasks.check_counter:Getting stats from j 2023-10-16T13:15:17.208 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph daemon mds.j perf dump 2023-10-16T13:15:17.767 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-16T13:15:18.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:18 smithi152 ceph-mon[104423]: pgmap v366: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 402 KiB/s wr, 147 op/s 2023-10-16T13:15:18.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:18 smithi092 ceph-mon[99542]: pgmap v366: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 402 KiB/s wr, 147 op/s 2023-10-16T13:15:18.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:18 smithi118 ceph-mon[103969]: pgmap v366: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 402 KiB/s wr, 147 op/s 2023-10-16T13:15:20.616 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-16T13:15:20.616 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2023-10-16T13:15:20.617 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 77, 2023-10-16T13:15:20.617 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 72, 2023-10-16T13:15:20.617 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 433744, 2023-10-16T13:15:20.617 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 41216, 2023-10-16T13:15:20.617 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 4, 2023-10-16T13:15:20.617 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 0, 2023-10-16T13:15:20.618 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.012946717, 2023-10-16T13:15:20.618 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.003796766, 2023-10-16T13:15:20.618 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.009573983, 2023-10-16T13:15:20.618 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.001308828, 2023-10-16T13:15:20.618 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:20.619 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 72, 2023-10-16T13:15:20.619 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.004571469, 2023-10-16T13:15:20.619 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000063492 2023-10-16T13:15:20.619 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:20.619 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:20.620 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:20.620 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:20.620 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:20.620 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:20.620 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 433744, 2023-10-16T13:15:20.621 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 41216 2023-10-16T13:15:20.621 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:20.621 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2023-10-16T13:15:20.621 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 1, 2023-10-16T13:15:20.621 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 53, 2023-10-16T13:15:20.621 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 160, 2023-10-16T13:15:20.622 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 85776, 2023-10-16T13:15:20.622 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 3, 2023-10-16T13:15:20.622 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 2, 2023-10-16T13:15:20.622 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.004587102, 2023-10-16T13:15:20.622 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.002849797, 2023-10-16T13:15:20.623 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.001198082, 2023-10-16T13:15:20.623 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-16T13:15:20.623 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:20.623 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 51, 2023-10-16T13:15:20.623 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.002226261, 2023-10-16T13:15:20.624 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000043652 2023-10-16T13:15:20.624 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:20.624 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:20.624 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:20.624 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:20.624 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:20.625 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:20.625 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-16T13:15:20.625 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 85776 2023-10-16T13:15:20.625 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:20.625 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2023-10-16T13:15:20.626 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 0, 2023-10-16T13:15:20.626 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 2, 2023-10-16T13:15:20.626 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 0, 2023-10-16T13:15:20.626 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 0, 2023-10-16T13:15:20.626 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 2, 2023-10-16T13:15:20.627 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 1, 2023-10-16T13:15:20.627 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.000413281, 2023-10-16T13:15:20.627 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.000000000, 2023-10-16T13:15:20.627 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.000348921, 2023-10-16T13:15:20.627 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-16T13:15:20.627 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:20.628 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:20.628 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:20.628 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:20.628 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:20.628 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:20.629 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:20.629 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:20.629 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:20.629 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:20.629 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-16T13:15:20.630 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 0 2023-10-16T13:15:20.630 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:20.630 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2023-10-16T13:15:20.630 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 0, 2023-10-16T13:15:20.630 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2023-10-16T13:15:20.631 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:20.631 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2023-10-16T13:15:20.631 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2023-10-16T13:15:20.631 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2023-10-16T13:15:20.631 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2023-10-16T13:15:20.632 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2023-10-16T13:15:20.632 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2023-10-16T13:15:20.632 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2023-10-16T13:15:20.632 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-16T13:15:20.632 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2023-10-16T13:15:20.632 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-16T13:15:20.633 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2023-10-16T13:15:20.633 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2023-10-16T13:15:20.633 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2023-10-16T13:15:20.633 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-16T13:15:20.633 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2023-10-16T13:15:20.633 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2023-10-16T13:15:20.634 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2023-10-16T13:15:20.634 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2023-10-16T13:15:20.634 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2023-10-16T13:15:20.634 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-16T13:15:20.634 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2023-10-16T13:15:20.635 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-16T13:15:20.635 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2023-10-16T13:15:20.635 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2023-10-16T13:15:20.635 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2023-10-16T13:15:20.635 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2023-10-16T13:15:20.635 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2023-10-16T13:15:20.636 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-16T13:15:20.636 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2023-10-16T13:15:20.636 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2023-10-16T13:15:20.636 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2023-10-16T13:15:20.636 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2023-10-16T13:15:20.637 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2023-10-16T13:15:20.637 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2023-10-16T13:15:20.637 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2023-10-16T13:15:20.637 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2023-10-16T13:15:20.637 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2023-10-16T13:15:20.637 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 148863, 2023-10-16T13:15:20.638 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 28, 2023-10-16T13:15:20.638 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2023-10-16T13:15:20.638 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2023-10-16T13:15:20.638 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2023-10-16T13:15:20.638 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2023-10-16T13:15:20.639 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2023-10-16T13:15:20.639 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2023-10-16T13:15:20.639 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2023-10-16T13:15:20.639 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2023-10-16T13:15:20.639 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 0, 2023-10-16T13:15:20.639 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 0, 2023-10-16T13:15:20.640 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2023-10-16T13:15:20.640 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2023-10-16T13:15:20.640 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2023-10-16T13:15:20.640 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2023-10-16T13:15:20.640 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 928, 2023-10-16T13:15:20.641 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 2, 2023-10-16T13:15:20.641 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2023-10-16T13:15:20.641 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2023-10-16T13:15:20.641 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2023-10-16T13:15:20.641 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2023-10-16T13:15:20.642 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-16T13:15:20.642 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-16T13:15:20.642 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-16T13:15:20.642 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2023-10-16T13:15:20.642 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-16T13:15:20.643 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 74, 2023-10-16T13:15:20.643 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 420523, 2023-10-16T13:15:20.643 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:20.643 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 74, 2023-10-16T13:15:20.644 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-16T13:15:20.644 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-16T13:15:20.644 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 74, 2023-10-16T13:15:20.644 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 420523, 2023-10-16T13:15:20.644 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-16T13:15:20.645 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-16T13:15:20.645 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-16T13:15:20.645 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-16T13:15:20.645 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:20.645 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-16T13:15:20.646 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-16T13:15:20.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:20 smithi152 ceph-mon[104423]: pgmap v367: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 74 KiB/s wr, 58 op/s 2023-10-16T13:15:20.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:20 smithi092 ceph-mon[99542]: pgmap v367: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 74 KiB/s wr, 58 op/s 2023-10-16T13:15:20.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:20 smithi118 ceph-mon[103969]: pgmap v367: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 74 KiB/s wr, 58 op/s 2023-10-16T13:15:21.034 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-10-16T13:15:21.035 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-10-16T13:15:21.035 DEBUG:tasks.check_counter:Getting stats from b 2023-10-16T13:15:21.035 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph daemon mds.b perf dump 2023-10-16T13:15:21.620 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-16T13:15:22.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:22 smithi152 ceph-mon[104423]: pgmap v368: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 22 op/s 2023-10-16T13:15:22.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:22 smithi092 ceph-mon[99542]: pgmap v368: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 22 op/s 2023-10-16T13:15:22.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:22 smithi118 ceph-mon[103969]: pgmap v368: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 22 op/s 2023-10-16T13:15:24.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:24 smithi152 ceph-mon[104423]: pgmap v369: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2023-10-16T13:15:24.702 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:24 smithi118 ceph-mon[103969]: pgmap v369: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2023-10-16T13:15:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:24 smithi092 ceph-mon[99542]: pgmap v369: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2023-10-16T13:15:24.947 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-10-16T13:15:24.947 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-0": { 2023-10-16T13:15:24.948 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 11689, 2023-10-16T13:15:24.948 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 10947, 2023-10-16T13:15:24.948 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 4259020, 2023-10-16T13:15:24.948 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 36243908, 2023-10-16T13:15:24.948 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 10, 2023-10-16T13:15:24.949 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 3, 2023-10-16T13:15:24.949 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.689888594, 2023-10-16T13:15:24.949 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.241431999, 2023-10-16T13:15:24.949 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.194356374, 2023-10-16T13:15:24.949 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.255967412, 2023-10-16T13:15:24.950 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:24.950 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 10950, 2023-10-16T13:15:24.950 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 12.117789019, 2023-10-16T13:15:24.950 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.001106647 2023-10-16T13:15:24.950 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.951 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:24.951 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 6594, 2023-10-16T13:15:24.951 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000944956, 2023-10-16T13:15:24.951 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000143 2023-10-16T13:15:24.951 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.952 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 2944, 2023-10-16T13:15:24.952 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 448 2023-10-16T13:15:24.952 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.952 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-1": { 2023-10-16T13:15:24.952 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 13463, 2023-10-16T13:15:24.952 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 12538, 2023-10-16T13:15:24.953 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 5456516, 2023-10-16T13:15:24.953 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 22611046, 2023-10-16T13:15:24.953 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 12, 2023-10-16T13:15:24.953 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 5, 2023-10-16T13:15:24.953 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.738991562, 2023-10-16T13:15:24.953 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.219860820, 2023-10-16T13:15:24.954 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.163812750, 2023-10-16T13:15:24.954 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.342368569, 2023-10-16T13:15:24.954 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:24.954 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 12538, 2023-10-16T13:15:24.954 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 33.859820630, 2023-10-16T13:15:24.955 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.002700575 2023-10-16T13:15:24.955 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.955 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:24.955 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 3926, 2023-10-16T13:15:24.955 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000539221, 2023-10-16T13:15:24.955 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000137 2023-10-16T13:15:24.956 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.956 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-16T13:15:24.956 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 166480 2023-10-16T13:15:24.956 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.956 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-2": { 2023-10-16T13:15:24.957 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 40391, 2023-10-16T13:15:24.957 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 80744, 2023-10-16T13:15:24.957 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 15305752, 2023-10-16T13:15:24.957 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 63673789, 2023-10-16T13:15:24.957 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 51, 2023-10-16T13:15:24.957 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 13, 2023-10-16T13:15:24.958 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 2.359789451, 2023-10-16T13:15:24.958 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 1.111732684, 2023-10-16T13:15:24.958 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 3.410370570, 2023-10-16T13:15:24.958 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.173913327, 2023-10-16T13:15:24.958 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:24.959 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 80737, 2023-10-16T13:15:24.959 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 11.002050296, 2023-10-16T13:15:24.959 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000136270 2023-10-16T13:15:24.959 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.959 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:24.960 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 98826, 2023-10-16T13:15:24.960 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.013726807, 2023-10-16T13:15:24.960 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000138 2023-10-16T13:15:24.960 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.960 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 13050896, 2023-10-16T13:15:24.961 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 37910656 2023-10-16T13:15:24.961 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.961 INFO:teuthology.orchestra.run.smithi118.stdout: "cct": { 2023-10-16T13:15:24.961 INFO:teuthology.orchestra.run.smithi118.stdout: "total_workers": 1, 2023-10-16T13:15:24.961 INFO:teuthology.orchestra.run.smithi118.stdout: "unhealthy_workers": 0 2023-10-16T13:15:24.961 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.962 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-MDSRank": { 2023-10-16T13:15:24.962 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2023-10-16T13:15:24.962 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2023-10-16T13:15:24.962 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 3836, 2023-10-16T13:15:24.962 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 21.804005180, 2023-10-16T13:15:24.963 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.005684047 2023-10-16T13:15:24.963 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:24.963 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.963 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-PurgeQueue": { 2023-10-16T13:15:24.963 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2023-10-16T13:15:24.963 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2023-10-16T13:15:24.964 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 11263, 2023-10-16T13:15:24.964 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 3.312612558, 2023-10-16T13:15:24.964 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000294114 2023-10-16T13:15:24.964 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:24.964 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.965 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2023-10-16T13:15:24.965 INFO:teuthology.orchestra.run.smithi118.stdout: "request": 19100, 2023-10-16T13:15:24.965 INFO:teuthology.orchestra.run.smithi118.stdout: "reply": 19025, 2023-10-16T13:15:24.965 INFO:teuthology.orchestra.run.smithi118.stdout: "reply_latency": { 2023-10-16T13:15:24.965 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 19025, 2023-10-16T13:15:24.965 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 151.109232663, 2023-10-16T13:15:24.966 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.007942666 2023-10-16T13:15:24.966 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.966 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_reply": 0, 2023-10-16T13:15:24.966 INFO:teuthology.orchestra.run.smithi118.stdout: "forward": 75, 2023-10-16T13:15:24.966 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_complete": 0, 2023-10-16T13:15:24.967 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_keys": 0, 2023-10-16T13:15:24.967 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_commit": 1074, 2023-10-16T13:15:24.967 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_split": 15, 2023-10-16T13:15:24.967 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_merge": 3, 2023-10-16T13:15:24.967 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes": 820, 2023-10-16T13:15:24.967 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_top": 418, 2023-10-16T13:15:24.967 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_bottom": 387, 2023-10-16T13:15:24.968 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pin_tail": 15, 2023-10-16T13:15:24.968 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pinned": 222, 2023-10-16T13:15:24.968 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_expired": 5681, 2023-10-16T13:15:24.968 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_with_caps": 2, 2023-10-16T13:15:24.968 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": 2, 2023-10-16T13:15:24.969 INFO:teuthology.orchestra.run.smithi118.stdout: "subtrees": 6, 2023-10-16T13:15:24.969 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse": 19631, 2023-10-16T13:15:24.969 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_hit": 19538, 2023-10-16T13:15:24.969 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_forward": 0, 2023-10-16T13:15:24.969 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_discover": 0, 2023-10-16T13:15:24.969 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_dir_fetch": 0, 2023-10-16T13:15:24.970 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_remote_ino": 0, 2023-10-16T13:15:24.970 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_lock": 0, 2023-10-16T13:15:24.970 INFO:teuthology.orchestra.run.smithi118.stdout: "load_cent": 57, 2023-10-16T13:15:24.970 INFO:teuthology.orchestra.run.smithi118.stdout: "q": 0, 2023-10-16T13:15:24.970 INFO:teuthology.orchestra.run.smithi118.stdout: "exported": 74, 2023-10-16T13:15:24.971 INFO:teuthology.orchestra.run.smithi118.stdout: "exported_inodes": 5514, 2023-10-16T13:15:24.971 INFO:teuthology.orchestra.run.smithi118.stdout: "imported": 81, 2023-10-16T13:15:24.971 INFO:teuthology.orchestra.run.smithi118.stdout: "imported_inodes": 322, 2023-10-16T13:15:24.971 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_dir_fetch": 0, 2023-10-16T13:15:24.971 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_backtrace_fetch": 2857, 2023-10-16T13:15:24.971 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_peer_discover": 0, 2023-10-16T13:15:24.972 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rfiles": 4, 2023-10-16T13:15:24.972 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rbytes": 246, 2023-10-16T13:15:24.972 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rsnaps": 0, 2023-10-16T13:15:24.972 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_fetch": 2857, 2023-10-16T13:15:24.972 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_set_tag": 0, 2023-10-16T13:15:24.972 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_repaired": 0, 2023-10-16T13:15:24.973 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_inotable_repaired": 0, 2023-10-16T13:15:24.973 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_inodes": 271, 2023-10-16T13:15:24.973 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_base_inodes": 3, 2023-10-16T13:15:24.973 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dirfrag_rstats": 268, 2023-10-16T13:15:24.973 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_file_inodes": 2586, 2023-10-16T13:15:24.974 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_inode_file_caps": 121, 2023-10-16T13:15:24.974 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_revoke": 2647, 2023-10-16T13:15:24.974 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_grant": 18621, 2023-10-16T13:15:24.974 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_trunc": 0, 2023-10-16T13:15:24.974 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-16T13:15:24.974 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-16T13:15:24.975 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps": 13485, 2023-10-16T13:15:24.975 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps_dirty": 9695, 2023-10-16T13:15:24.975 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_cap_release": 358, 2023-10-16T13:15:24.975 INFO:teuthology.orchestra.run.smithi118.stdout: "process_request_cap_release": 7927 2023-10-16T13:15:24.975 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.975 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_cache": { 2023-10-16T13:15:24.976 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update": 0, 2023-10-16T13:15:24.976 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update_receipt": 0, 2023-10-16T13:15:24.976 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_try_discover": 0, 2023-10-16T13:15:24.976 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_send_discover": 0, 2023-10-16T13:15:24.976 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_handle_discover": 65, 2023-10-16T13:15:24.977 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays": 6, 2023-10-16T13:15:24.977 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_delayed": 0, 2023-10-16T13:15:24.977 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_enqueuing": 0, 2023-10-16T13:15:24.977 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_created": 6135, 2023-10-16T13:15:24.977 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_enqueued": 6129, 2023-10-16T13:15:24.978 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_reintegrated": 0, 2023-10-16T13:15:24.978 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_migrated": 0, 2023-10-16T13:15:24.978 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_processing": 0, 2023-10-16T13:15:24.978 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_enqueued": 0, 2023-10-16T13:15:24.978 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_prioritized": 0, 2023-10-16T13:15:24.978 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_started": 0, 2023-10-16T13:15:24.979 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_completed": 0, 2023-10-16T13:15:24.979 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_enqueue_scrub": 3, 2023-10-16T13:15:24.979 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_exportdir": 74, 2023-10-16T13:15:24.979 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_flush": 0, 2023-10-16T13:15:24.979 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragmentdir": 18, 2023-10-16T13:15:24.979 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragstats": 0, 2023-10-16T13:15:24.980 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_inodestats": 0 2023-10-16T13:15:24.980 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.980 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_log": { 2023-10-16T13:15:24.980 INFO:teuthology.orchestra.run.smithi118.stdout: "evlrg": 0, 2023-10-16T13:15:24.980 INFO:teuthology.orchestra.run.smithi118.stdout: "evadd": 37447, 2023-10-16T13:15:24.981 INFO:teuthology.orchestra.run.smithi118.stdout: "evex": 35487, 2023-10-16T13:15:24.981 INFO:teuthology.orchestra.run.smithi118.stdout: "evtrm": 35487, 2023-10-16T13:15:24.981 INFO:teuthology.orchestra.run.smithi118.stdout: "ev": 1960, 2023-10-16T13:15:24.981 INFO:teuthology.orchestra.run.smithi118.stdout: "evexg": 0, 2023-10-16T13:15:24.981 INFO:teuthology.orchestra.run.smithi118.stdout: "evexd": 7071, 2023-10-16T13:15:24.981 INFO:teuthology.orchestra.run.smithi118.stdout: "segadd": 49, 2023-10-16T13:15:24.982 INFO:teuthology.orchestra.run.smithi118.stdout: "segex": 46, 2023-10-16T13:15:24.982 INFO:teuthology.orchestra.run.smithi118.stdout: "segtrm": 46, 2023-10-16T13:15:24.982 INFO:teuthology.orchestra.run.smithi118.stdout: "seg": 3, 2023-10-16T13:15:24.982 INFO:teuthology.orchestra.run.smithi118.stdout: "segmjr": 1, 2023-10-16T13:15:24.982 INFO:teuthology.orchestra.run.smithi118.stdout: "segexg": 0, 2023-10-16T13:15:24.982 INFO:teuthology.orchestra.run.smithi118.stdout: "segexd": 8, 2023-10-16T13:15:24.983 INFO:teuthology.orchestra.run.smithi118.stdout: "expos": 76955197, 2023-10-16T13:15:24.983 INFO:teuthology.orchestra.run.smithi118.stdout: "wrpos": 80960011, 2023-10-16T13:15:24.983 INFO:teuthology.orchestra.run.smithi118.stdout: "rdpos": 0, 2023-10-16T13:15:24.983 INFO:teuthology.orchestra.run.smithi118.stdout: "jlat": { 2023-10-16T13:15:24.983 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1258, 2023-10-16T13:15:24.983 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 57.847442033, 2023-10-16T13:15:24.984 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.045983658 2023-10-16T13:15:24.984 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.984 INFO:teuthology.orchestra.run.smithi118.stdout: "replayed": 0 2023-10-16T13:15:24.984 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.984 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_mem": { 2023-10-16T13:15:24.984 INFO:teuthology.orchestra.run.smithi118.stdout: "ino": 36, 2023-10-16T13:15:24.985 INFO:teuthology.orchestra.run.smithi118.stdout: "ino+": 11688, 2023-10-16T13:15:24.985 INFO:teuthology.orchestra.run.smithi118.stdout: "ino-": 11652, 2023-10-16T13:15:24.985 INFO:teuthology.orchestra.run.smithi118.stdout: "dir": 67, 2023-10-16T13:15:24.985 INFO:teuthology.orchestra.run.smithi118.stdout: "dir+": 779, 2023-10-16T13:15:24.985 INFO:teuthology.orchestra.run.smithi118.stdout: "dir-": 712, 2023-10-16T13:15:24.985 INFO:teuthology.orchestra.run.smithi118.stdout: "dn": 820, 2023-10-16T13:15:24.986 INFO:teuthology.orchestra.run.smithi118.stdout: "dn+": 14674, 2023-10-16T13:15:24.986 INFO:teuthology.orchestra.run.smithi118.stdout: "dn-": 13854, 2023-10-16T13:15:24.986 INFO:teuthology.orchestra.run.smithi118.stdout: "cap": 2, 2023-10-16T13:15:24.986 INFO:teuthology.orchestra.run.smithi118.stdout: "cap+": 11662, 2023-10-16T13:15:24.986 INFO:teuthology.orchestra.run.smithi118.stdout: "cap-": 11660, 2023-10-16T13:15:24.986 INFO:teuthology.orchestra.run.smithi118.stdout: "rss": 102000, 2023-10-16T13:15:24.987 INFO:teuthology.orchestra.run.smithi118.stdout: "heap": 207152 2023-10-16T13:15:24.987 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.987 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_server": { 2023-10-16T13:15:24.987 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_client_request": 21178, 2023-10-16T13:15:24.987 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_server_request": 124, 2023-10-16T13:15:24.987 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_request": 19100, 2023-10-16T13:15:24.988 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_session": 80, 2023-10-16T13:15:24.988 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_peer_request": 370, 2023-10-16T13:15:24.988 INFO:teuthology.orchestra.run.smithi118.stdout: "req_create_latency": { 2023-10-16T13:15:24.988 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 11036, 2023-10-16T13:15:24.988 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 123.326753323, 2023-10-16T13:15:24.988 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.011174950 2023-10-16T13:15:24.989 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.989 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getattr_latency": { 2023-10-16T13:15:24.989 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 78, 2023-10-16T13:15:24.989 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.089909963, 2023-10-16T13:15:24.989 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.001152691 2023-10-16T13:15:24.989 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.990 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getfilelock_latency": { 2023-10-16T13:15:24.990 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:24.990 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:24.990 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:24.990 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.990 INFO:teuthology.orchestra.run.smithi118.stdout: "req_link_latency": { 2023-10-16T13:15:24.991 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:24.991 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:24.991 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:24.991 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.991 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookup_latency": { 2023-10-16T13:15:24.991 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 365, 2023-10-16T13:15:24.992 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.374101326, 2023-10-16T13:15:24.992 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.001024935 2023-10-16T13:15:24.992 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.992 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookuphash_latency": { 2023-10-16T13:15:24.992 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:24.992 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:24.993 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:24.993 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.993 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupino_latency": { 2023-10-16T13:15:24.993 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1, 2023-10-16T13:15:24.993 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000344397, 2023-10-16T13:15:24.993 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000344397 2023-10-16T13:15:24.994 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.994 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupname_latency": { 2023-10-16T13:15:24.994 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:24.994 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:24.994 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:24.994 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.995 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupparent_latency": { 2023-10-16T13:15:24.995 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:24.995 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:24.995 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:24.995 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.995 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupsnap_latency": { 2023-10-16T13:15:24.996 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:24.996 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:24.996 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:24.996 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.996 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lssnap_latency": { 2023-10-16T13:15:24.996 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:24.997 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:24.997 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:24.997 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.997 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mkdir_latency": { 2023-10-16T13:15:24.997 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 623, 2023-10-16T13:15:24.997 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 10.852567918, 2023-10-16T13:15:24.998 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.017419852 2023-10-16T13:15:24.998 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.998 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mknod_latency": { 2023-10-16T13:15:24.998 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:24.998 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:24.999 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:24.999 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:24.999 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mksnap_latency": { 2023-10-16T13:15:24.999 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:24.999 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:24.999 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:24.999 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.000 INFO:teuthology.orchestra.run.smithi118.stdout: "req_open_latency": { 2023-10-16T13:15:25.000 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:25.000 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:25.000 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:25.000 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.001 INFO:teuthology.orchestra.run.smithi118.stdout: "req_readdir_latency": { 2023-10-16T13:15:25.001 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 777, 2023-10-16T13:15:25.001 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 1.365626188, 2023-10-16T13:15:25.001 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.001757562 2023-10-16T13:15:25.001 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.002 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rename_latency": { 2023-10-16T13:15:25.002 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 2, 2023-10-16T13:15:25.002 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.002980433, 2023-10-16T13:15:25.002 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.001490216 2023-10-16T13:15:25.002 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.002 INFO:teuthology.orchestra.run.smithi118.stdout: "req_renamesnap_latency": { 2023-10-16T13:15:25.003 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:25.003 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:25.003 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:25.003 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.003 INFO:teuthology.orchestra.run.smithi118.stdout: "req_snapdiff_latency": { 2023-10-16T13:15:25.003 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:25.004 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:25.004 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:25.004 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.004 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmdir_latency": { 2023-10-16T13:15:25.004 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 324, 2023-10-16T13:15:25.004 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 4.723206373, 2023-10-16T13:15:25.005 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.014577797 2023-10-16T13:15:25.005 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.005 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmsnap_latency": { 2023-10-16T13:15:25.005 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:25.005 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:25.005 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:25.006 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.006 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmxattr_latency": { 2023-10-16T13:15:25.006 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:25.006 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:25.006 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:25.006 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.007 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setattr_latency": { 2023-10-16T13:15:25.007 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 2, 2023-10-16T13:15:25.007 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.083443354, 2023-10-16T13:15:25.007 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.041721677 2023-10-16T13:15:25.007 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.007 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setdirlayout_latency": { 2023-10-16T13:15:25.008 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:25.008 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:25.008 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:25.008 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.008 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setfilelock_latency": { 2023-10-16T13:15:25.008 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:25.009 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:25.009 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:25.009 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.009 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setlayout_latency": { 2023-10-16T13:15:25.009 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:25.010 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:25.010 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:25.010 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.010 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setxattr_latency": { 2023-10-16T13:15:25.010 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 6, 2023-10-16T13:15:25.010 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.017448765, 2023-10-16T13:15:25.011 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.002908127 2023-10-16T13:15:25.011 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.011 INFO:teuthology.orchestra.run.smithi118.stdout: "req_symlink_latency": { 2023-10-16T13:15:25.011 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:25.011 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:25.011 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:25.012 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.012 INFO:teuthology.orchestra.run.smithi118.stdout: "req_unlink_latency": { 2023-10-16T13:15:25.012 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 5811, 2023-10-16T13:15:25.012 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 10.272850623, 2023-10-16T13:15:25.012 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.001767828 2023-10-16T13:15:25.012 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.013 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_revoke_eviction": 0, 2023-10-16T13:15:25.013 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_acquisition_throttle": 0, 2023-10-16T13:15:25.013 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getvxattr_latency": { 2023-10-16T13:15:25.013 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:25.013 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:25.014 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:25.014 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:25.014 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.014 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_sessions": { 2023-10-16T13:15:25.014 INFO:teuthology.orchestra.run.smithi118.stdout: "session_count": 1, 2023-10-16T13:15:25.014 INFO:teuthology.orchestra.run.smithi118.stdout: "session_add": 2, 2023-10-16T13:15:25.015 INFO:teuthology.orchestra.run.smithi118.stdout: "session_remove": 1, 2023-10-16T13:15:25.015 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_open": 1, 2023-10-16T13:15:25.015 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_stale": 0, 2023-10-16T13:15:25.015 INFO:teuthology.orchestra.run.smithi118.stdout: "total_load": 12193, 2023-10-16T13:15:25.015 INFO:teuthology.orchestra.run.smithi118.stdout: "average_load": 12193, 2023-10-16T13:15:25.015 INFO:teuthology.orchestra.run.smithi118.stdout: "avg_session_uptime": 132, 2023-10-16T13:15:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: "mdthresh_evicted": 0 2023-10-16T13:15:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: "mempool": { 2023-10-16T13:15:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_bytes": 360, 2023-10-16T13:15:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_items": 360, 2023-10-16T13:15:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_bytes": 0, 2023-10-16T13:15:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_items": 0, 2023-10-16T13:15:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_bytes": 0, 2023-10-16T13:15:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_items": 0, 2023-10-16T13:15:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-16T13:15:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_items": 0, 2023-10-16T13:15:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-16T13:15:25.018 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_items": 0, 2023-10-16T13:15:25.018 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_bytes": 0, 2023-10-16T13:15:25.018 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_items": 0, 2023-10-16T13:15:25.018 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-16T13:15:25.018 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_items": 0, 2023-10-16T13:15:25.019 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_bytes": 0, 2023-10-16T13:15:25.019 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_items": 0, 2023-10-16T13:15:25.019 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_bytes": 0, 2023-10-16T13:15:25.019 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_items": 0, 2023-10-16T13:15:25.019 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-16T13:15:25.019 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_items": 0, 2023-10-16T13:15:25.020 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-16T13:15:25.020 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_items": 0, 2023-10-16T13:15:25.020 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_bytes": 0, 2023-10-16T13:15:25.020 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_items": 0, 2023-10-16T13:15:25.020 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_bytes": 0, 2023-10-16T13:15:25.020 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_items": 0, 2023-10-16T13:15:25.021 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-16T13:15:25.021 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_items": 0, 2023-10-16T13:15:25.021 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_bytes": 0, 2023-10-16T13:15:25.021 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_items": 0, 2023-10-16T13:15:25.021 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_bytes": 0, 2023-10-16T13:15:25.021 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_items": 0, 2023-10-16T13:15:25.022 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_bytes": 0, 2023-10-16T13:15:25.022 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_items": 0, 2023-10-16T13:15:25.022 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_bytes": 0, 2023-10-16T13:15:25.022 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_items": 0, 2023-10-16T13:15:25.022 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_bytes": 288355, 2023-10-16T13:15:25.022 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_items": 115, 2023-10-16T13:15:25.023 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_bytes": 176, 2023-10-16T13:15:25.023 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_items": 2, 2023-10-16T13:15:25.023 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_bytes": 0, 2023-10-16T13:15:25.023 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_items": 0, 2023-10-16T13:15:25.023 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_bytes": 0, 2023-10-16T13:15:25.023 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_items": 0, 2023-10-16T13:15:25.024 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_bytes": 0, 2023-10-16T13:15:25.024 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_items": 0, 2023-10-16T13:15:25.024 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_bytes": 7624, 2023-10-16T13:15:25.024 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_items": 160, 2023-10-16T13:15:25.024 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_bytes": 0, 2023-10-16T13:15:25.025 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_items": 0, 2023-10-16T13:15:25.025 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_bytes": 0, 2023-10-16T13:15:25.025 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_items": 0, 2023-10-16T13:15:25.025 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_bytes": 793928, 2023-10-16T13:15:25.025 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_items": 11066, 2023-10-16T13:15:25.025 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_bytes": 0, 2023-10-16T13:15:25.026 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_items": 0, 2023-10-16T13:15:25.026 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_bytes": 0, 2023-10-16T13:15:25.026 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_items": 0 2023-10-16T13:15:25.026 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.026 INFO:teuthology.orchestra.run.smithi118.stdout: "objecter": { 2023-10-16T13:15:25.026 INFO:teuthology.orchestra.run.smithi118.stdout: "op_active": 0, 2023-10-16T13:15:25.027 INFO:teuthology.orchestra.run.smithi118.stdout: "op_laggy": 0, 2023-10-16T13:15:25.027 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send": 23910, 2023-10-16T13:15:25.027 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send_bytes": 93002094, 2023-10-16T13:15:25.027 INFO:teuthology.orchestra.run.smithi118.stdout: "op_resend": 31, 2023-10-16T13:15:25.027 INFO:teuthology.orchestra.run.smithi118.stdout: "op_reply": 23910, 2023-10-16T13:15:25.028 INFO:teuthology.orchestra.run.smithi118.stdout: "op_latency": { 2023-10-16T13:15:25.028 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 23910, 2023-10-16T13:15:25.028 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 3066.909295050, 2023-10-16T13:15:25.028 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.128268895 2023-10-16T13:15:25.028 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.028 INFO:teuthology.orchestra.run.smithi118.stdout: "op_inflight": 0, 2023-10-16T13:15:25.029 INFO:teuthology.orchestra.run.smithi118.stdout: "oplen_avg": { 2023-10-16T13:15:25.029 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 23910, 2023-10-16T13:15:25.029 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 48504 2023-10-16T13:15:25.029 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.029 INFO:teuthology.orchestra.run.smithi118.stdout: "op": 23910, 2023-10-16T13:15:25.029 INFO:teuthology.orchestra.run.smithi118.stdout: "op_r": 2993, 2023-10-16T13:15:25.029 INFO:teuthology.orchestra.run.smithi118.stdout: "op_w": 20917, 2023-10-16T13:15:25.030 INFO:teuthology.orchestra.run.smithi118.stdout: "op_rmw": 0, 2023-10-16T13:15:25.030 INFO:teuthology.orchestra.run.smithi118.stdout: "op_pg": 0, 2023-10-16T13:15:25.030 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_stat": 417, 2023-10-16T13:15:25.030 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_create": 11531, 2023-10-16T13:15:25.030 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_read": 133, 2023-10-16T13:15:25.031 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_write": 1388, 2023-10-16T13:15:25.031 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writefull": 111, 2023-10-16T13:15:25.031 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writesame": 0, 2023-10-16T13:15:25.031 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_append": 0, 2023-10-16T13:15:25.031 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_zero": 0, 2023-10-16T13:15:25.031 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_truncate": 15, 2023-10-16T13:15:25.032 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_delete": 6762, 2023-10-16T13:15:25.032 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_mapext": 0, 2023-10-16T13:15:25.032 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_sparse_read": 0, 2023-10-16T13:15:25.032 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_clonerange": 0, 2023-10-16T13:15:25.032 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_getxattr": 2860, 2023-10-16T13:15:25.032 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_setxattr": 23062, 2023-10-16T13:15:25.033 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_cmpxattr": 0, 2023-10-16T13:15:25.033 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_rmxattr": 0, 2023-10-16T13:15:25.033 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_resetxattrs": 0, 2023-10-16T13:15:25.033 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_call": 0, 2023-10-16T13:15:25.033 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_watch": 0, 2023-10-16T13:15:25.034 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_notify": 0, 2023-10-16T13:15:25.034 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_src_cmpxattr": 0, 2023-10-16T13:15:25.034 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls": 0, 2023-10-16T13:15:25.034 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls_filter": 0, 2023-10-16T13:15:25.034 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_other": 0, 2023-10-16T13:15:25.035 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_active": 0, 2023-10-16T13:15:25.035 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_send": 0, 2023-10-16T13:15:25.035 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_resend": 0, 2023-10-16T13:15:25.035 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_ping": 0, 2023-10-16T13:15:25.035 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_active": 0, 2023-10-16T13:15:25.035 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_send": 0, 2023-10-16T13:15:25.036 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_resend": 0, 2023-10-16T13:15:25.036 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_active": 0, 2023-10-16T13:15:25.036 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_send": 0, 2023-10-16T13:15:25.036 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_resend": 0, 2023-10-16T13:15:25.036 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_active": 0, 2023-10-16T13:15:25.036 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_send": 0, 2023-10-16T13:15:25.037 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_resend": 0, 2023-10-16T13:15:25.037 INFO:teuthology.orchestra.run.smithi118.stdout: "command_active": 0, 2023-10-16T13:15:25.037 INFO:teuthology.orchestra.run.smithi118.stdout: "command_send": 0, 2023-10-16T13:15:25.037 INFO:teuthology.orchestra.run.smithi118.stdout: "command_resend": 0, 2023-10-16T13:15:25.037 INFO:teuthology.orchestra.run.smithi118.stdout: "map_epoch": 85, 2023-10-16T13:15:25.038 INFO:teuthology.orchestra.run.smithi118.stdout: "map_full": 0, 2023-10-16T13:15:25.038 INFO:teuthology.orchestra.run.smithi118.stdout: "map_inc": 3, 2023-10-16T13:15:25.038 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_sessions": 12, 2023-10-16T13:15:25.038 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_open": 12, 2023-10-16T13:15:25.038 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_close": 0, 2023-10-16T13:15:25.038 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_laggy": 0, 2023-10-16T13:15:25.039 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_wr": 2149, 2023-10-16T13:15:25.039 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_rd": 0, 2023-10-16T13:15:25.039 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_del": 76 2023-10-16T13:15:25.039 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.039 INFO:teuthology.orchestra.run.smithi118.stdout: "oft": { 2023-10-16T13:15:25.040 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_objs": 1, 2023-10-16T13:15:25.040 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_kv_pairs": 0, 2023-10-16T13:15:25.040 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_updates": 0, 2023-10-16T13:15:25.040 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_removes": 0 2023-10-16T13:15:25.040 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.040 INFO:teuthology.orchestra.run.smithi118.stdout: "osd-slow-ops": { 2023-10-16T13:15:25.041 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_ops_count": 0 2023-10-16T13:15:25.041 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.041 INFO:teuthology.orchestra.run.smithi118.stdout: "purge_queue": { 2023-10-16T13:15:25.041 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops": 0, 2023-10-16T13:15:25.041 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops_high_water": 40, 2023-10-16T13:15:25.041 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing": 0, 2023-10-16T13:15:25.042 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_high_water": 6, 2023-10-16T13:15:25.042 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executed": 6129, 2023-10-16T13:15:25.042 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_item_in_journal": 0 2023-10-16T13:15:25.042 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.042 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-16T13:15:25.043 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:25.043 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2023-10-16T13:15:25.043 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:25.043 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 65539, 2023-10-16T13:15:25.043 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 17608524, 2023-10-16T13:15:25.043 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:25.044 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 65539, 2023-10-16T13:15:25.044 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-16T13:15:25.044 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-16T13:15:25.044 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 65539, 2023-10-16T13:15:25.044 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 17608524, 2023-10-16T13:15:25.045 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:25.045 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:25.045 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:25.045 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:25.045 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:25.045 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.046 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_bytes": { 2023-10-16T13:15:25.046 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:25.046 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2023-10-16T13:15:25.046 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:25.046 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-16T13:15:25.047 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-16T13:15:25.047 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:25.047 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:25.047 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 23910, 2023-10-16T13:15:25.047 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 93621139, 2023-10-16T13:15:25.047 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 23910, 2023-10-16T13:15:25.048 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 93621139, 2023-10-16T13:15:25.048 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:25.048 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:25.048 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:25.048 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:25.048 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:25.049 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.049 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_ops": { 2023-10-16T13:15:25.049 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:25.049 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 1024, 2023-10-16T13:15:25.049 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:25.050 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-16T13:15:25.050 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-16T13:15:25.050 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:25.050 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:25.050 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 23910, 2023-10-16T13:15:25.050 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 23910, 2023-10-16T13:15:25.051 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 23910, 2023-10-16T13:15:25.051 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 23910, 2023-10-16T13:15:25.051 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:25.051 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:25.051 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:25.051 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:25.052 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:25.052 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.052 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle": { 2023-10-16T13:15:25.052 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:25.052 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2023-10-16T13:15:25.053 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:25.053 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 6129, 2023-10-16T13:15:25.053 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 619045, 2023-10-16T13:15:25.053 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:25.053 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 6129, 2023-10-16T13:15:25.053 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-16T13:15:25.054 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-16T13:15:25.054 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 130, 2023-10-16T13:15:25.054 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 619045, 2023-10-16T13:15:25.054 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:25.054 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:25.055 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:25.055 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:25.055 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:25.055 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:25.055 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle-0x561d5eb3e6e0": { 2023-10-16T13:15:25.055 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:25.056 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2023-10-16T13:15:25.056 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:25.056 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 37447, 2023-10-16T13:15:25.056 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 76765707, 2023-10-16T13:15:25.056 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:25.057 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 37447, 2023-10-16T13:15:25.057 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-16T13:15:25.057 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-16T13:15:25.057 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 1258, 2023-10-16T13:15:25.057 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 76765707, 2023-10-16T13:15:25.057 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:25.058 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:25.058 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:25.058 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:25.058 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:25.058 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:25.059 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-10-16T13:15:25.395 INFO:tasks.check_counter:Daemon mds.b mds.exported=74 2023-10-16T13:15:25.395 INFO:tasks.check_counter:Daemon mds.b mds.imported=81 2023-10-16T13:15:25.395 DEBUG:tasks.check_counter:Getting stats from e 2023-10-16T13:15:25.396 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph daemon mds.e perf dump 2023-10-16T13:15:25.952 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-16T13:15:26.469 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:26 smithi118 ceph-mon[103969]: pgmap v370: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 12 op/s 2023-10-16T13:15:26.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:26 smithi152 ceph-mon[104423]: pgmap v370: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 12 op/s 2023-10-16T13:15:26.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:26 smithi092 ceph-mon[99542]: pgmap v370: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 12 op/s 2023-10-16T13:15:27.178 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-10-16T13:15:27.179 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-0": { 2023-10-16T13:15:27.179 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 2488, 2023-10-16T13:15:27.179 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 5582, 2023-10-16T13:15:27.179 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 977042, 2023-10-16T13:15:27.179 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 7005368, 2023-10-16T13:15:27.180 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 16, 2023-10-16T13:15:27.180 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 3, 2023-10-16T13:15:27.180 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.195607642, 2023-10-16T13:15:27.180 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.091563711, 2023-10-16T13:15:27.180 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.107201671, 2023-10-16T13:15:27.181 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.012729595, 2023-10-16T13:15:27.181 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:27.181 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 5581, 2023-10-16T13:15:27.181 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.169213574, 2023-10-16T13:15:27.181 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000030319 2023-10-16T13:15:27.182 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.182 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:27.182 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 5859, 2023-10-16T13:15:27.182 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000904940, 2023-10-16T13:15:27.182 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000154 2023-10-16T13:15:27.183 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.183 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 706464, 2023-10-16T13:15:27.183 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 2598912 2023-10-16T13:15:27.183 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.183 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-1": { 2023-10-16T13:15:27.183 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 458, 2023-10-16T13:15:27.184 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 510, 2023-10-16T13:15:27.184 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 153631, 2023-10-16T13:15:27.184 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 1089067, 2023-10-16T13:15:27.184 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 10, 2023-10-16T13:15:27.184 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 7, 2023-10-16T13:15:27.184 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.033752898, 2023-10-16T13:15:27.185 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.010866370, 2023-10-16T13:15:27.185 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.010446346, 2023-10-16T13:15:27.185 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.010152019, 2023-10-16T13:15:27.185 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:27.185 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 508, 2023-10-16T13:15:27.185 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.038115041, 2023-10-16T13:15:27.186 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000075029 2023-10-16T13:15:27.186 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.186 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:27.186 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 37, 2023-10-16T13:15:27.186 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000006540, 2023-10-16T13:15:27.187 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000176 2023-10-16T13:15:27.187 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.187 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-16T13:15:27.187 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 164464 2023-10-16T13:15:27.187 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.187 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-2": { 2023-10-16T13:15:27.188 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 1858, 2023-10-16T13:15:27.188 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 2210, 2023-10-16T13:15:27.188 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 2143841, 2023-10-16T13:15:27.188 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 921321, 2023-10-16T13:15:27.188 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 14, 2023-10-16T13:15:27.189 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 6, 2023-10-16T13:15:27.189 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.127119939, 2023-10-16T13:15:27.189 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.052100837, 2023-10-16T13:15:27.189 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.078202019, 2023-10-16T13:15:27.189 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.009921271, 2023-10-16T13:15:27.189 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:27.190 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 2209, 2023-10-16T13:15:27.190 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.076756700, 2023-10-16T13:15:27.190 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000034747 2023-10-16T13:15:27.190 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.190 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:27.191 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 3112, 2023-10-16T13:15:27.191 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000452297, 2023-10-16T13:15:27.191 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000145 2023-10-16T13:15:27.191 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.191 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 532912, 2023-10-16T13:15:27.192 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 47392 2023-10-16T13:15:27.192 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.192 INFO:teuthology.orchestra.run.smithi118.stdout: "cct": { 2023-10-16T13:15:27.192 INFO:teuthology.orchestra.run.smithi118.stdout: "total_workers": 1, 2023-10-16T13:15:27.192 INFO:teuthology.orchestra.run.smithi118.stdout: "unhealthy_workers": 0 2023-10-16T13:15:27.192 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.193 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-MDSRank": { 2023-10-16T13:15:27.193 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2023-10-16T13:15:27.193 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2023-10-16T13:15:27.193 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 299, 2023-10-16T13:15:27.193 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.980819529, 2023-10-16T13:15:27.193 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.003280332 2023-10-16T13:15:27.194 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:27.194 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.194 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-PurgeQueue": { 2023-10-16T13:15:27.194 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2023-10-16T13:15:27.194 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2023-10-16T13:15:27.195 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1790, 2023-10-16T13:15:27.195 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.143823386, 2023-10-16T13:15:27.195 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000080348 2023-10-16T13:15:27.195 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:27.195 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.196 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2023-10-16T13:15:27.196 INFO:teuthology.orchestra.run.smithi118.stdout: "request": 1410, 2023-10-16T13:15:27.196 INFO:teuthology.orchestra.run.smithi118.stdout: "reply": 1409, 2023-10-16T13:15:27.196 INFO:teuthology.orchestra.run.smithi118.stdout: "reply_latency": { 2023-10-16T13:15:27.196 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1409, 2023-10-16T13:15:27.196 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 2.103174195, 2023-10-16T13:15:27.197 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.001492671 2023-10-16T13:15:27.197 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.197 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_reply": 0, 2023-10-16T13:15:27.197 INFO:teuthology.orchestra.run.smithi118.stdout: "forward": 1, 2023-10-16T13:15:27.197 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_complete": 0, 2023-10-16T13:15:27.198 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_keys": 0, 2023-10-16T13:15:27.198 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_commit": 11, 2023-10-16T13:15:27.198 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_split": 0, 2023-10-16T13:15:27.198 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_merge": 0, 2023-10-16T13:15:27.198 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes": 15, 2023-10-16T13:15:27.199 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_top": 0, 2023-10-16T13:15:27.199 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_bottom": 1, 2023-10-16T13:15:27.199 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pin_tail": 14, 2023-10-16T13:15:27.199 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pinned": 15, 2023-10-16T13:15:27.199 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_expired": 38, 2023-10-16T13:15:27.199 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_with_caps": 1, 2023-10-16T13:15:27.200 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": 1, 2023-10-16T13:15:27.200 INFO:teuthology.orchestra.run.smithi118.stdout: "subtrees": 3, 2023-10-16T13:15:27.200 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse": 1907, 2023-10-16T13:15:27.200 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_hit": 1802, 2023-10-16T13:15:27.200 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_forward": 0, 2023-10-16T13:15:27.201 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_discover": 13, 2023-10-16T13:15:27.201 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_dir_fetch": 0, 2023-10-16T13:15:27.201 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_remote_ino": 0, 2023-10-16T13:15:27.201 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_lock": 0, 2023-10-16T13:15:27.201 INFO:teuthology.orchestra.run.smithi118.stdout: "load_cent": 0, 2023-10-16T13:15:27.202 INFO:teuthology.orchestra.run.smithi118.stdout: "q": 0, 2023-10-16T13:15:27.202 INFO:teuthology.orchestra.run.smithi118.stdout: "exported": 13, 2023-10-16T13:15:27.202 INFO:teuthology.orchestra.run.smithi118.stdout: "exported_inodes": 24, 2023-10-16T13:15:27.202 INFO:teuthology.orchestra.run.smithi118.stdout: "imported": 13, 2023-10-16T13:15:27.202 INFO:teuthology.orchestra.run.smithi118.stdout: "imported_inodes": 1008, 2023-10-16T13:15:27.203 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_dir_fetch": 0, 2023-10-16T13:15:27.203 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_backtrace_fetch": 0, 2023-10-16T13:15:27.203 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_peer_discover": 0, 2023-10-16T13:15:27.203 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rfiles": 3619, 2023-10-16T13:15:27.203 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rbytes": 18416957, 2023-10-16T13:15:27.205 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rsnaps": 0, 2023-10-16T13:15:27.205 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_fetch": 0, 2023-10-16T13:15:27.205 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_set_tag": 0, 2023-10-16T13:15:27.205 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_repaired": 0, 2023-10-16T13:15:27.206 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_inotable_repaired": 0, 2023-10-16T13:15:27.206 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_inodes": 0, 2023-10-16T13:15:27.206 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_base_inodes": 0, 2023-10-16T13:15:27.206 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dirfrag_rstats": 0, 2023-10-16T13:15:27.206 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_file_inodes": 0, 2023-10-16T13:15:27.207 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_inode_file_caps": 0, 2023-10-16T13:15:27.207 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_revoke": 170, 2023-10-16T13:15:27.207 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_grant": 1081, 2023-10-16T13:15:27.207 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_trunc": 0, 2023-10-16T13:15:27.207 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-16T13:15:27.207 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-16T13:15:27.208 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps": 512, 2023-10-16T13:15:27.208 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps_dirty": 351, 2023-10-16T13:15:27.208 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_cap_release": 11, 2023-10-16T13:15:27.208 INFO:teuthology.orchestra.run.smithi118.stdout: "process_request_cap_release": 1409 2023-10-16T13:15:27.208 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.209 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_cache": { 2023-10-16T13:15:27.209 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update": 0, 2023-10-16T13:15:27.209 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update_receipt": 0, 2023-10-16T13:15:27.209 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_try_discover": 0, 2023-10-16T13:15:27.209 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_send_discover": 13, 2023-10-16T13:15:27.210 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_handle_discover": 0, 2023-10-16T13:15:27.210 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays": 0, 2023-10-16T13:15:27.210 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_delayed": 0, 2023-10-16T13:15:27.210 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_enqueuing": 0, 2023-10-16T13:15:27.210 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_created": 1008, 2023-10-16T13:15:27.211 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_enqueued": 1008, 2023-10-16T13:15:27.211 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_reintegrated": 0, 2023-10-16T13:15:27.211 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_migrated": 0, 2023-10-16T13:15:27.211 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_processing": 0, 2023-10-16T13:15:27.211 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_enqueued": 0, 2023-10-16T13:15:27.212 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_prioritized": 0, 2023-10-16T13:15:27.212 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_started": 0, 2023-10-16T13:15:27.212 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_completed": 0, 2023-10-16T13:15:27.212 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_enqueue_scrub": 0, 2023-10-16T13:15:27.212 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_exportdir": 13, 2023-10-16T13:15:27.212 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_flush": 0, 2023-10-16T13:15:27.213 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragmentdir": 0, 2023-10-16T13:15:27.213 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragstats": 0, 2023-10-16T13:15:27.213 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_inodestats": 0 2023-10-16T13:15:27.213 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.213 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_log": { 2023-10-16T13:15:27.213 INFO:teuthology.orchestra.run.smithi118.stdout: "evlrg": 0, 2023-10-16T13:15:27.214 INFO:teuthology.orchestra.run.smithi118.stdout: "evadd": 2751, 2023-10-16T13:15:27.214 INFO:teuthology.orchestra.run.smithi118.stdout: "evex": 0, 2023-10-16T13:15:27.214 INFO:teuthology.orchestra.run.smithi118.stdout: "evtrm": 0, 2023-10-16T13:15:27.214 INFO:teuthology.orchestra.run.smithi118.stdout: "ev": 2751, 2023-10-16T13:15:27.214 INFO:teuthology.orchestra.run.smithi118.stdout: "evexg": 0, 2023-10-16T13:15:27.215 INFO:teuthology.orchestra.run.smithi118.stdout: "evexd": 0, 2023-10-16T13:15:27.215 INFO:teuthology.orchestra.run.smithi118.stdout: "segadd": 5, 2023-10-16T13:15:27.215 INFO:teuthology.orchestra.run.smithi118.stdout: "segex": 0, 2023-10-16T13:15:27.215 INFO:teuthology.orchestra.run.smithi118.stdout: "segtrm": 0, 2023-10-16T13:15:27.215 INFO:teuthology.orchestra.run.smithi118.stdout: "seg": 5, 2023-10-16T13:15:27.215 INFO:teuthology.orchestra.run.smithi118.stdout: "segmjr": 2, 2023-10-16T13:15:27.216 INFO:teuthology.orchestra.run.smithi118.stdout: "segexg": 0, 2023-10-16T13:15:27.216 INFO:teuthology.orchestra.run.smithi118.stdout: "segexd": 0, 2023-10-16T13:15:27.216 INFO:teuthology.orchestra.run.smithi118.stdout: "expos": 4194304, 2023-10-16T13:15:27.216 INFO:teuthology.orchestra.run.smithi118.stdout: "wrpos": 9476835, 2023-10-16T13:15:27.216 INFO:teuthology.orchestra.run.smithi118.stdout: "rdpos": 0, 2023-10-16T13:15:27.216 INFO:teuthology.orchestra.run.smithi118.stdout: "jlat": { 2023-10-16T13:15:27.217 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 123, 2023-10-16T13:15:27.217 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.365035213, 2023-10-16T13:15:27.217 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.002967765 2023-10-16T13:15:27.217 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.217 INFO:teuthology.orchestra.run.smithi118.stdout: "replayed": 0 2023-10-16T13:15:27.218 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.218 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_mem": { 2023-10-16T13:15:27.218 INFO:teuthology.orchestra.run.smithi118.stdout: "ino": 20, 2023-10-16T13:15:27.218 INFO:teuthology.orchestra.run.smithi118.stdout: "ino+": 1048, 2023-10-16T13:15:27.218 INFO:teuthology.orchestra.run.smithi118.stdout: "ino-": 1028, 2023-10-16T13:15:27.219 INFO:teuthology.orchestra.run.smithi118.stdout: "dir": 21, 2023-10-16T13:15:27.219 INFO:teuthology.orchestra.run.smithi118.stdout: "dir+": 101, 2023-10-16T13:15:27.219 INFO:teuthology.orchestra.run.smithi118.stdout: "dir-": 80, 2023-10-16T13:15:27.219 INFO:teuthology.orchestra.run.smithi118.stdout: "dn": 40, 2023-10-16T13:15:27.219 INFO:teuthology.orchestra.run.smithi118.stdout: "dn+": 2070, 2023-10-16T13:15:27.220 INFO:teuthology.orchestra.run.smithi118.stdout: "dn-": 2030, 2023-10-16T13:15:27.220 INFO:teuthology.orchestra.run.smithi118.stdout: "cap": 1, 2023-10-16T13:15:27.220 INFO:teuthology.orchestra.run.smithi118.stdout: "cap+": 1021, 2023-10-16T13:15:27.220 INFO:teuthology.orchestra.run.smithi118.stdout: "cap-": 1020, 2023-10-16T13:15:27.220 INFO:teuthology.orchestra.run.smithi118.stdout: "rss": 61528, 2023-10-16T13:15:27.221 INFO:teuthology.orchestra.run.smithi118.stdout: "heap": 198960 2023-10-16T13:15:27.221 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.221 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_server": { 2023-10-16T13:15:27.221 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_client_request": 1789, 2023-10-16T13:15:27.221 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_server_request": 12, 2023-10-16T13:15:27.221 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_request": 1410, 2023-10-16T13:15:27.222 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_session": 2, 2023-10-16T13:15:27.222 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_peer_request": 44, 2023-10-16T13:15:27.222 INFO:teuthology.orchestra.run.smithi118.stdout: "req_create_latency": { 2023-10-16T13:15:27.222 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.222 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getattr_latency": { 2023-10-16T13:15:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1, 2023-10-16T13:15:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.001221834, 2023-10-16T13:15:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.001221834 2023-10-16T13:15:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getfilelock_latency": { 2023-10-16T13:15:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: "req_link_latency": { 2023-10-16T13:15:27.225 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.225 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.225 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.225 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.225 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookup_latency": { 2023-10-16T13:15:27.225 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 381, 2023-10-16T13:15:27.226 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.122823518, 2023-10-16T13:15:27.226 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000322371 2023-10-16T13:15:27.226 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.226 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookuphash_latency": { 2023-10-16T13:15:27.226 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.227 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.227 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.227 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.227 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupino_latency": { 2023-10-16T13:15:27.227 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.228 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.228 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.228 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.228 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupname_latency": { 2023-10-16T13:15:27.228 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.228 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.229 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.229 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.229 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupparent_latency": { 2023-10-16T13:15:27.229 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.229 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.230 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.230 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.230 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupsnap_latency": { 2023-10-16T13:15:27.230 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.230 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.231 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.231 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.231 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lssnap_latency": { 2023-10-16T13:15:27.231 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.231 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.231 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.232 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.232 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mkdir_latency": { 2023-10-16T13:15:27.232 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.232 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.232 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.233 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.233 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mknod_latency": { 2023-10-16T13:15:27.233 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.233 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.233 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.233 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.234 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mksnap_latency": { 2023-10-16T13:15:27.234 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.234 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.234 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.234 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.235 INFO:teuthology.orchestra.run.smithi118.stdout: "req_open_latency": { 2023-10-16T13:15:27.235 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.235 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.235 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.235 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.235 INFO:teuthology.orchestra.run.smithi118.stdout: "req_readdir_latency": { 2023-10-16T13:15:27.236 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 19, 2023-10-16T13:15:27.236 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.015909682, 2023-10-16T13:15:27.236 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000837351 2023-10-16T13:15:27.236 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.236 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rename_latency": { 2023-10-16T13:15:27.237 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.237 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.237 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.237 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.237 INFO:teuthology.orchestra.run.smithi118.stdout: "req_renamesnap_latency": { 2023-10-16T13:15:27.238 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.238 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.238 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.238 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.238 INFO:teuthology.orchestra.run.smithi118.stdout: "req_snapdiff_latency": { 2023-10-16T13:15:27.239 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.239 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.239 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.239 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.239 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmdir_latency": { 2023-10-16T13:15:27.240 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 49, 2023-10-16T13:15:27.240 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.732313363, 2023-10-16T13:15:27.240 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.014945170 2023-10-16T13:15:27.240 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.240 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmsnap_latency": { 2023-10-16T13:15:27.240 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.241 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.241 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.241 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.241 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmxattr_latency": { 2023-10-16T13:15:27.241 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.242 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.242 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.242 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.242 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setattr_latency": { 2023-10-16T13:15:27.242 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.243 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.243 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.243 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.243 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setdirlayout_latency": { 2023-10-16T13:15:27.243 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.244 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.244 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.244 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.244 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setfilelock_latency": { 2023-10-16T13:15:27.244 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.245 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.245 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.245 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.245 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setlayout_latency": { 2023-10-16T13:15:27.245 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.246 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.246 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.246 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.246 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setxattr_latency": { 2023-10-16T13:15:27.246 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.247 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.247 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.247 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.247 INFO:teuthology.orchestra.run.smithi118.stdout: "req_symlink_latency": { 2023-10-16T13:15:27.247 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.247 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.248 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.248 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.248 INFO:teuthology.orchestra.run.smithi118.stdout: "req_unlink_latency": { 2023-10-16T13:15:27.248 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 959, 2023-10-16T13:15:27.248 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 1.230905798, 2023-10-16T13:15:27.249 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.001283530 2023-10-16T13:15:27.249 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.249 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_revoke_eviction": 0, 2023-10-16T13:15:27.249 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_acquisition_throttle": 0, 2023-10-16T13:15:27.249 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getvxattr_latency": { 2023-10-16T13:15:27.250 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.250 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.250 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.250 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:27.250 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.251 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_sessions": { 2023-10-16T13:15:27.251 INFO:teuthology.orchestra.run.smithi118.stdout: "session_count": 1, 2023-10-16T13:15:27.251 INFO:teuthology.orchestra.run.smithi118.stdout: "session_add": 1, 2023-10-16T13:15:27.251 INFO:teuthology.orchestra.run.smithi118.stdout: "session_remove": 0, 2023-10-16T13:15:27.251 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_open": 1, 2023-10-16T13:15:27.252 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_stale": 0, 2023-10-16T13:15:27.252 INFO:teuthology.orchestra.run.smithi118.stdout: "total_load": 1272, 2023-10-16T13:15:27.252 INFO:teuthology.orchestra.run.smithi118.stdout: "average_load": 1272, 2023-10-16T13:15:27.252 INFO:teuthology.orchestra.run.smithi118.stdout: "avg_session_uptime": 135, 2023-10-16T13:15:27.252 INFO:teuthology.orchestra.run.smithi118.stdout: "mdthresh_evicted": 0 2023-10-16T13:15:27.253 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.253 INFO:teuthology.orchestra.run.smithi118.stdout: "mempool": { 2023-10-16T13:15:27.253 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_bytes": 0, 2023-10-16T13:15:27.253 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_items": 0, 2023-10-16T13:15:27.253 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_bytes": 0, 2023-10-16T13:15:27.254 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_items": 0, 2023-10-16T13:15:27.254 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_bytes": 0, 2023-10-16T13:15:27.254 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_items": 0, 2023-10-16T13:15:27.254 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-16T13:15:27.254 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_items": 0, 2023-10-16T13:15:27.255 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-16T13:15:27.255 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_items": 0, 2023-10-16T13:15:27.255 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_bytes": 0, 2023-10-16T13:15:27.255 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_items": 0, 2023-10-16T13:15:27.255 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-16T13:15:27.256 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_items": 0, 2023-10-16T13:15:27.256 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_bytes": 0, 2023-10-16T13:15:27.256 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_items": 0, 2023-10-16T13:15:27.256 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_bytes": 0, 2023-10-16T13:15:27.256 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_items": 0, 2023-10-16T13:15:27.256 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-16T13:15:27.257 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_items": 0, 2023-10-16T13:15:27.257 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-16T13:15:27.257 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_items": 0, 2023-10-16T13:15:27.257 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_bytes": 0, 2023-10-16T13:15:27.257 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_items": 0, 2023-10-16T13:15:27.258 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_bytes": 0, 2023-10-16T13:15:27.258 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_items": 0, 2023-10-16T13:15:27.258 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-16T13:15:27.258 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_items": 0, 2023-10-16T13:15:27.258 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_bytes": 0, 2023-10-16T13:15:27.259 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_items": 0, 2023-10-16T13:15:27.259 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_bytes": 0, 2023-10-16T13:15:27.259 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_items": 0, 2023-10-16T13:15:27.259 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_bytes": 0, 2023-10-16T13:15:27.259 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_items": 0, 2023-10-16T13:15:27.260 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_bytes": 0, 2023-10-16T13:15:27.260 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_items": 0, 2023-10-16T13:15:27.260 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_bytes": 307241, 2023-10-16T13:15:27.260 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_items": 121, 2023-10-16T13:15:27.260 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_bytes": 0, 2023-10-16T13:15:27.260 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_items": 0, 2023-10-16T13:15:27.261 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_bytes": 0, 2023-10-16T13:15:27.261 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_items": 0, 2023-10-16T13:15:27.261 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_bytes": 0, 2023-10-16T13:15:27.261 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_items": 0, 2023-10-16T13:15:27.261 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_bytes": 0, 2023-10-16T13:15:27.262 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_items": 0, 2023-10-16T13:15:27.262 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_bytes": 7624, 2023-10-16T13:15:27.262 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_items": 160, 2023-10-16T13:15:27.262 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_bytes": 0, 2023-10-16T13:15:27.262 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_items": 0, 2023-10-16T13:15:27.263 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_bytes": 0, 2023-10-16T13:15:27.263 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_items": 0, 2023-10-16T13:15:27.263 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_bytes": 102870, 2023-10-16T13:15:27.263 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_items": 812, 2023-10-16T13:15:27.263 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_bytes": 0, 2023-10-16T13:15:27.263 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_items": 0, 2023-10-16T13:15:27.264 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_bytes": 0, 2023-10-16T13:15:27.264 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_items": 0 2023-10-16T13:15:27.264 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.264 INFO:teuthology.orchestra.run.smithi118.stdout: "objecter": { 2023-10-16T13:15:27.264 INFO:teuthology.orchestra.run.smithi118.stdout: "op_active": 0, 2023-10-16T13:15:27.265 INFO:teuthology.orchestra.run.smithi118.stdout: "op_laggy": 0, 2023-10-16T13:15:27.265 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send": 1272, 2023-10-16T13:15:27.265 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send_bytes": 5473144, 2023-10-16T13:15:27.265 INFO:teuthology.orchestra.run.smithi118.stdout: "op_resend": 27, 2023-10-16T13:15:27.265 INFO:teuthology.orchestra.run.smithi118.stdout: "op_reply": 1272, 2023-10-16T13:15:27.266 INFO:teuthology.orchestra.run.smithi118.stdout: "op_latency": { 2023-10-16T13:15:27.266 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1272, 2023-10-16T13:15:27.266 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 3.295926154, 2023-10-16T13:15:27.266 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.002591136 2023-10-16T13:15:27.266 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.266 INFO:teuthology.orchestra.run.smithi118.stdout: "op_inflight": 0, 2023-10-16T13:15:27.267 INFO:teuthology.orchestra.run.smithi118.stdout: "oplen_avg": { 2023-10-16T13:15:27.267 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1272, 2023-10-16T13:15:27.267 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 1309 2023-10-16T13:15:27.267 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.267 INFO:teuthology.orchestra.run.smithi118.stdout: "op": 1272, 2023-10-16T13:15:27.268 INFO:teuthology.orchestra.run.smithi118.stdout: "op_r": 33, 2023-10-16T13:15:27.268 INFO:teuthology.orchestra.run.smithi118.stdout: "op_w": 1239, 2023-10-16T13:15:27.268 INFO:teuthology.orchestra.run.smithi118.stdout: "op_rmw": 0, 2023-10-16T13:15:27.268 INFO:teuthology.orchestra.run.smithi118.stdout: "op_pg": 0, 2023-10-16T13:15:27.268 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_stat": 0, 2023-10-16T13:15:27.269 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_create": 10, 2023-10-16T13:15:27.269 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_read": 33, 2023-10-16T13:15:27.269 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_write": 156, 2023-10-16T13:15:27.269 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writefull": 21, 2023-10-16T13:15:27.269 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writesame": 0, 2023-10-16T13:15:27.270 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_append": 0, 2023-10-16T13:15:27.270 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_zero": 0, 2023-10-16T13:15:27.270 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_truncate": 0, 2023-10-16T13:15:27.270 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_delete": 1029, 2023-10-16T13:15:27.270 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_mapext": 0, 2023-10-16T13:15:27.271 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_sparse_read": 0, 2023-10-16T13:15:27.271 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_clonerange": 0, 2023-10-16T13:15:27.271 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_getxattr": 0, 2023-10-16T13:15:27.271 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_setxattr": 20, 2023-10-16T13:15:27.271 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_cmpxattr": 0, 2023-10-16T13:15:27.271 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_rmxattr": 0, 2023-10-16T13:15:27.272 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_resetxattrs": 0, 2023-10-16T13:15:27.272 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_call": 0, 2023-10-16T13:15:27.272 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_watch": 0, 2023-10-16T13:15:27.272 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_notify": 0, 2023-10-16T13:15:27.272 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_src_cmpxattr": 0, 2023-10-16T13:15:27.273 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls": 0, 2023-10-16T13:15:27.273 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls_filter": 0, 2023-10-16T13:15:27.273 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_other": 0, 2023-10-16T13:15:27.273 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_active": 0, 2023-10-16T13:15:27.273 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_send": 0, 2023-10-16T13:15:27.273 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_resend": 0, 2023-10-16T13:15:27.274 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_ping": 0, 2023-10-16T13:15:27.274 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_active": 0, 2023-10-16T13:15:27.274 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_send": 0, 2023-10-16T13:15:27.274 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_resend": 0, 2023-10-16T13:15:27.274 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_active": 0, 2023-10-16T13:15:27.275 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_send": 0, 2023-10-16T13:15:27.275 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_resend": 0, 2023-10-16T13:15:27.275 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_active": 0, 2023-10-16T13:15:27.275 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_send": 0, 2023-10-16T13:15:27.275 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_resend": 0, 2023-10-16T13:15:27.276 INFO:teuthology.orchestra.run.smithi118.stdout: "command_active": 0, 2023-10-16T13:15:27.276 INFO:teuthology.orchestra.run.smithi118.stdout: "command_send": 0, 2023-10-16T13:15:27.276 INFO:teuthology.orchestra.run.smithi118.stdout: "command_resend": 0, 2023-10-16T13:15:27.276 INFO:teuthology.orchestra.run.smithi118.stdout: "map_epoch": 85, 2023-10-16T13:15:27.276 INFO:teuthology.orchestra.run.smithi118.stdout: "map_full": 0, 2023-10-16T13:15:27.276 INFO:teuthology.orchestra.run.smithi118.stdout: "map_inc": 2, 2023-10-16T13:15:27.277 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_sessions": 12, 2023-10-16T13:15:27.277 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_open": 12, 2023-10-16T13:15:27.277 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_close": 0, 2023-10-16T13:15:27.277 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_laggy": 0, 2023-10-16T13:15:27.278 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_wr": 33, 2023-10-16T13:15:27.278 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_rd": 0, 2023-10-16T13:15:27.278 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_del": 7 2023-10-16T13:15:27.278 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.278 INFO:teuthology.orchestra.run.smithi118.stdout: "oft": { 2023-10-16T13:15:27.279 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_objs": 1, 2023-10-16T13:15:27.279 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_kv_pairs": 0, 2023-10-16T13:15:27.279 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_updates": 0, 2023-10-16T13:15:27.279 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_removes": 0 2023-10-16T13:15:27.279 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.279 INFO:teuthology.orchestra.run.smithi118.stdout: "osd-slow-ops": { 2023-10-16T13:15:27.280 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_ops_count": 0 2023-10-16T13:15:27.280 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.280 INFO:teuthology.orchestra.run.smithi118.stdout: "purge_queue": { 2023-10-16T13:15:27.280 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops": 0, 2023-10-16T13:15:27.280 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops_high_water": 14, 2023-10-16T13:15:27.281 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing": 0, 2023-10-16T13:15:27.281 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_high_water": 6, 2023-10-16T13:15:27.281 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executed": 1008, 2023-10-16T13:15:27.281 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_item_in_journal": 0 2023-10-16T13:15:27.281 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.282 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-16T13:15:27.282 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:27.282 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2023-10-16T13:15:27.282 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:27.282 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 4800, 2023-10-16T13:15:27.283 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 2748452, 2023-10-16T13:15:27.283 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:27.283 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 4800, 2023-10-16T13:15:27.283 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-16T13:15:27.283 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-16T13:15:27.283 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 4800, 2023-10-16T13:15:27.284 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 2748452, 2023-10-16T13:15:27.284 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:27.284 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.284 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.284 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.284 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:27.285 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.285 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_bytes": { 2023-10-16T13:15:27.285 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:27.285 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2023-10-16T13:15:27.285 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:27.286 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-16T13:15:27.286 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-16T13:15:27.286 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:27.286 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:27.286 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 1272, 2023-10-16T13:15:27.287 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 5574960, 2023-10-16T13:15:27.287 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 1272, 2023-10-16T13:15:27.287 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 5574960, 2023-10-16T13:15:27.287 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:27.287 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.287 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.288 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.288 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:27.288 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.288 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_ops": { 2023-10-16T13:15:27.288 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:27.289 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 1024, 2023-10-16T13:15:27.289 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:27.289 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-16T13:15:27.289 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-16T13:15:27.289 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:27.289 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:27.290 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 1272, 2023-10-16T13:15:27.290 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 1272, 2023-10-16T13:15:27.290 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 1272, 2023-10-16T13:15:27.290 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 1272, 2023-10-16T13:15:27.290 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:27.291 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.291 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.291 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.291 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:27.291 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.291 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle": { 2023-10-16T13:15:27.292 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:27.292 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2023-10-16T13:15:27.292 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:27.292 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 1008, 2023-10-16T13:15:27.292 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 101816, 2023-10-16T13:15:27.293 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:27.293 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 1008, 2023-10-16T13:15:27.293 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-16T13:15:27.293 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-16T13:15:27.293 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 33, 2023-10-16T13:15:27.293 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 101816, 2023-10-16T13:15:27.294 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:27.294 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.294 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.294 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.294 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:27.295 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:27.295 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle-0x564acc2ba6e0": { 2023-10-16T13:15:27.295 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:27.295 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2023-10-16T13:15:27.295 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:27.295 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 2751, 2023-10-16T13:15:27.296 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 5282531, 2023-10-16T13:15:27.296 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:27.296 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 2751, 2023-10-16T13:15:27.296 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-16T13:15:27.296 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-16T13:15:27.297 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 123, 2023-10-16T13:15:27.297 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 5282531, 2023-10-16T13:15:27.297 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:27.297 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:27.297 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:27.297 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:27.298 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:27.298 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:27.298 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-10-16T13:15:27.597 INFO:tasks.check_counter:Daemon mds.e mds.exported=13 2023-10-16T13:15:27.597 INFO:tasks.check_counter:Daemon mds.e mds.imported=13 2023-10-16T13:15:27.597 DEBUG:tasks.check_counter:Getting stats from h 2023-10-16T13:15:27.598 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph daemon mds.h perf dump 2023-10-16T13:15:28.151 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-16T13:15:28.685 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:28 smithi118 ceph-mon[103969]: pgmap v371: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 14 op/s 2023-10-16T13:15:28.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:28 smithi152 ceph-mon[104423]: pgmap v371: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 14 op/s 2023-10-16T13:15:28.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:28 smithi092 ceph-mon[99542]: pgmap v371: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 14 op/s 2023-10-16T13:15:29.361 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-10-16T13:15:29.361 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-0": { 2023-10-16T13:15:29.361 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 588, 2023-10-16T13:15:29.362 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 589, 2023-10-16T13:15:29.362 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 12752532, 2023-10-16T13:15:29.362 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 182564, 2023-10-16T13:15:29.362 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 6, 2023-10-16T13:15:29.362 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 2, 2023-10-16T13:15:29.363 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.054959151, 2023-10-16T13:15:29.363 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.014736320, 2023-10-16T13:15:29.363 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.018508333, 2023-10-16T13:15:29.363 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.016866131, 2023-10-16T13:15:29.363 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:29.363 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 587, 2023-10-16T13:15:29.364 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.032061117, 2023-10-16T13:15:29.364 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000054618 2023-10-16T13:15:29.364 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.364 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:29.364 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.364 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.365 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.365 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.365 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-16T13:15:29.365 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 0 2023-10-16T13:15:29.365 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.365 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-1": { 2023-10-16T13:15:29.366 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 42, 2023-10-16T13:15:29.366 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 91, 2023-10-16T13:15:29.366 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 1505788, 2023-10-16T13:15:29.366 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 176305, 2023-10-16T13:15:29.366 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 5, 2023-10-16T13:15:29.367 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 4, 2023-10-16T13:15:29.367 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.008127213, 2023-10-16T13:15:29.367 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.002707074, 2023-10-16T13:15:29.367 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.003560154, 2023-10-16T13:15:29.367 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.001056065, 2023-10-16T13:15:29.368 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:29.368 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 90, 2023-10-16T13:15:29.368 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.005603355, 2023-10-16T13:15:29.368 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000062259 2023-10-16T13:15:29.368 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.369 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:29.369 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.369 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.369 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.369 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.369 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 3104, 2023-10-16T13:15:29.370 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 164736 2023-10-16T13:15:29.370 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.370 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-2": { 2023-10-16T13:15:29.370 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 98, 2023-10-16T13:15:29.370 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 78, 2023-10-16T13:15:29.371 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 538876, 2023-10-16T13:15:29.371 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 42263, 2023-10-16T13:15:29.371 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 3, 2023-10-16T13:15:29.371 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 2, 2023-10-16T13:15:29.371 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.014229558, 2023-10-16T13:15:29.371 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.004344939, 2023-10-16T13:15:29.372 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.010351143, 2023-10-16T13:15:29.372 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.001807916, 2023-10-16T13:15:29.372 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:29.372 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 77, 2023-10-16T13:15:29.372 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.004905173, 2023-10-16T13:15:29.373 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000063703 2023-10-16T13:15:29.373 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.373 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:29.373 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.373 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.373 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.374 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.374 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 538608, 2023-10-16T13:15:29.374 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 41952 2023-10-16T13:15:29.374 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.374 INFO:teuthology.orchestra.run.smithi118.stdout: "cct": { 2023-10-16T13:15:29.374 INFO:teuthology.orchestra.run.smithi118.stdout: "total_workers": 1, 2023-10-16T13:15:29.375 INFO:teuthology.orchestra.run.smithi118.stdout: "unhealthy_workers": 0 2023-10-16T13:15:29.375 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.375 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-MDSRank": { 2023-10-16T13:15:29.375 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2023-10-16T13:15:29.375 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2023-10-16T13:15:29.375 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1093, 2023-10-16T13:15:29.376 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.027847893, 2023-10-16T13:15:29.376 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000025478 2023-10-16T13:15:29.376 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:29.376 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.376 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-PurgeQueue": { 2023-10-16T13:15:29.377 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2023-10-16T13:15:29.377 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2023-10-16T13:15:29.377 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.377 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.377 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.377 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:29.378 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.378 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2023-10-16T13:15:29.378 INFO:teuthology.orchestra.run.smithi118.stdout: "request": 0, 2023-10-16T13:15:29.378 INFO:teuthology.orchestra.run.smithi118.stdout: "reply": 0, 2023-10-16T13:15:29.378 INFO:teuthology.orchestra.run.smithi118.stdout: "reply_latency": { 2023-10-16T13:15:29.379 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.379 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.379 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.379 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.379 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_reply": 0, 2023-10-16T13:15:29.379 INFO:teuthology.orchestra.run.smithi118.stdout: "forward": 0, 2023-10-16T13:15:29.380 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_complete": 0, 2023-10-16T13:15:29.380 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_keys": 0, 2023-10-16T13:15:29.380 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_commit": 0, 2023-10-16T13:15:29.380 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_split": 0, 2023-10-16T13:15:29.380 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_merge": 0, 2023-10-16T13:15:29.381 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes": 2314, 2023-10-16T13:15:29.381 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_top": 0, 2023-10-16T13:15:29.381 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_bottom": 0, 2023-10-16T13:15:29.381 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pin_tail": 2314, 2023-10-16T13:15:29.381 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pinned": 2314, 2023-10-16T13:15:29.381 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_expired": 0, 2023-10-16T13:15:29.382 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_with_caps": 0, 2023-10-16T13:15:29.382 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": 0, 2023-10-16T13:15:29.382 INFO:teuthology.orchestra.run.smithi118.stdout: "subtrees": 1, 2023-10-16T13:15:29.382 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse": 0, 2023-10-16T13:15:29.382 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_hit": 0, 2023-10-16T13:15:29.383 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_forward": 0, 2023-10-16T13:15:29.383 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_discover": 0, 2023-10-16T13:15:29.383 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_dir_fetch": 0, 2023-10-16T13:15:29.383 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_remote_ino": 0, 2023-10-16T13:15:29.383 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_lock": 0, 2023-10-16T13:15:29.383 INFO:teuthology.orchestra.run.smithi118.stdout: "load_cent": 0, 2023-10-16T13:15:29.384 INFO:teuthology.orchestra.run.smithi118.stdout: "q": 0, 2023-10-16T13:15:29.384 INFO:teuthology.orchestra.run.smithi118.stdout: "exported": 0, 2023-10-16T13:15:29.384 INFO:teuthology.orchestra.run.smithi118.stdout: "exported_inodes": 0, 2023-10-16T13:15:29.384 INFO:teuthology.orchestra.run.smithi118.stdout: "imported": 0, 2023-10-16T13:15:29.384 INFO:teuthology.orchestra.run.smithi118.stdout: "imported_inodes": 0, 2023-10-16T13:15:29.385 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_dir_fetch": 0, 2023-10-16T13:15:29.385 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_backtrace_fetch": 0, 2023-10-16T13:15:29.385 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_peer_discover": 0, 2023-10-16T13:15:29.385 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rfiles": 0, 2023-10-16T13:15:29.385 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rbytes": 0, 2023-10-16T13:15:29.385 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rsnaps": 0, 2023-10-16T13:15:29.386 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_fetch": 0, 2023-10-16T13:15:29.386 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_set_tag": 0, 2023-10-16T13:15:29.386 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_repaired": 0, 2023-10-16T13:15:29.386 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_inotable_repaired": 0, 2023-10-16T13:15:29.386 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_inodes": 0, 2023-10-16T13:15:29.387 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_base_inodes": 0, 2023-10-16T13:15:29.387 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dirfrag_rstats": 0, 2023-10-16T13:15:29.387 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_file_inodes": 0, 2023-10-16T13:15:29.387 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_inode_file_caps": 0, 2023-10-16T13:15:29.387 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_revoke": 0, 2023-10-16T13:15:29.388 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_grant": 0, 2023-10-16T13:15:29.388 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_trunc": 0, 2023-10-16T13:15:29.388 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-16T13:15:29.388 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-16T13:15:29.388 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps": 0, 2023-10-16T13:15:29.388 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps_dirty": 0, 2023-10-16T13:15:29.389 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_cap_release": 0, 2023-10-16T13:15:29.389 INFO:teuthology.orchestra.run.smithi118.stdout: "process_request_cap_release": 0 2023-10-16T13:15:29.389 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.389 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_cache": { 2023-10-16T13:15:29.389 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update": 0, 2023-10-16T13:15:29.390 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update_receipt": 0, 2023-10-16T13:15:29.390 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_try_discover": 0, 2023-10-16T13:15:29.390 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_send_discover": 0, 2023-10-16T13:15:29.390 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_handle_discover": 0, 2023-10-16T13:15:29.390 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays": 0, 2023-10-16T13:15:29.391 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_delayed": 0, 2023-10-16T13:15:29.391 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_enqueuing": 0, 2023-10-16T13:15:29.391 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_created": 0, 2023-10-16T13:15:29.391 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_enqueued": 0, 2023-10-16T13:15:29.391 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_reintegrated": 0, 2023-10-16T13:15:29.392 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_migrated": 0, 2023-10-16T13:15:29.392 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_processing": 0, 2023-10-16T13:15:29.392 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_enqueued": 0, 2023-10-16T13:15:29.392 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_prioritized": 0, 2023-10-16T13:15:29.392 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_started": 0, 2023-10-16T13:15:29.392 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_completed": 0, 2023-10-16T13:15:29.393 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_enqueue_scrub": 0, 2023-10-16T13:15:29.393 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_exportdir": 0, 2023-10-16T13:15:29.393 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_flush": 0, 2023-10-16T13:15:29.393 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragmentdir": 0, 2023-10-16T13:15:29.393 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragstats": 0, 2023-10-16T13:15:29.394 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_inodestats": 0 2023-10-16T13:15:29.394 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.394 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_log": { 2023-10-16T13:15:29.394 INFO:teuthology.orchestra.run.smithi118.stdout: "evlrg": 0, 2023-10-16T13:15:29.394 INFO:teuthology.orchestra.run.smithi118.stdout: "evadd": 0, 2023-10-16T13:15:29.394 INFO:teuthology.orchestra.run.smithi118.stdout: "evex": 0, 2023-10-16T13:15:29.395 INFO:teuthology.orchestra.run.smithi118.stdout: "evtrm": 0, 2023-10-16T13:15:29.395 INFO:teuthology.orchestra.run.smithi118.stdout: "ev": 6810, 2023-10-16T13:15:29.395 INFO:teuthology.orchestra.run.smithi118.stdout: "evexg": 0, 2023-10-16T13:15:29.395 INFO:teuthology.orchestra.run.smithi118.stdout: "evexd": 0, 2023-10-16T13:15:29.395 INFO:teuthology.orchestra.run.smithi118.stdout: "segadd": 0, 2023-10-16T13:15:29.396 INFO:teuthology.orchestra.run.smithi118.stdout: "segex": 0, 2023-10-16T13:15:29.396 INFO:teuthology.orchestra.run.smithi118.stdout: "segtrm": 0, 2023-10-16T13:15:29.396 INFO:teuthology.orchestra.run.smithi118.stdout: "seg": 10, 2023-10-16T13:15:29.396 INFO:teuthology.orchestra.run.smithi118.stdout: "segmjr": 2, 2023-10-16T13:15:29.396 INFO:teuthology.orchestra.run.smithi118.stdout: "segexg": 0, 2023-10-16T13:15:29.396 INFO:teuthology.orchestra.run.smithi118.stdout: "segexd": 0, 2023-10-16T13:15:29.397 INFO:teuthology.orchestra.run.smithi118.stdout: "expos": 4194304, 2023-10-16T13:15:29.397 INFO:teuthology.orchestra.run.smithi118.stdout: "wrpos": 18270270, 2023-10-16T13:15:29.397 INFO:teuthology.orchestra.run.smithi118.stdout: "rdpos": 18269671, 2023-10-16T13:15:29.397 INFO:teuthology.orchestra.run.smithi118.stdout: "jlat": { 2023-10-16T13:15:29.397 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.398 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.398 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.398 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.398 INFO:teuthology.orchestra.run.smithi118.stdout: "replayed": 6810 2023-10-16T13:15:29.398 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.399 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_mem": { 2023-10-16T13:15:29.399 INFO:teuthology.orchestra.run.smithi118.stdout: "ino": 12, 2023-10-16T13:15:29.399 INFO:teuthology.orchestra.run.smithi118.stdout: "ino+": 2366, 2023-10-16T13:15:29.399 INFO:teuthology.orchestra.run.smithi118.stdout: "ino-": 2354, 2023-10-16T13:15:29.399 INFO:teuthology.orchestra.run.smithi118.stdout: "dir": 10, 2023-10-16T13:15:29.399 INFO:teuthology.orchestra.run.smithi118.stdout: "dir+": 229, 2023-10-16T13:15:29.400 INFO:teuthology.orchestra.run.smithi118.stdout: "dir-": 219, 2023-10-16T13:15:29.400 INFO:teuthology.orchestra.run.smithi118.stdout: "dn": 2314, 2023-10-16T13:15:29.400 INFO:teuthology.orchestra.run.smithi118.stdout: "dn+": 4558, 2023-10-16T13:15:29.400 INFO:teuthology.orchestra.run.smithi118.stdout: "dn-": 2244, 2023-10-16T13:15:29.400 INFO:teuthology.orchestra.run.smithi118.stdout: "cap": 0, 2023-10-16T13:15:29.401 INFO:teuthology.orchestra.run.smithi118.stdout: "cap+": 0, 2023-10-16T13:15:29.401 INFO:teuthology.orchestra.run.smithi118.stdout: "cap-": 0, 2023-10-16T13:15:29.401 INFO:teuthology.orchestra.run.smithi118.stdout: "rss": 51884, 2023-10-16T13:15:29.401 INFO:teuthology.orchestra.run.smithi118.stdout: "heap": 207152 2023-10-16T13:15:29.401 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.401 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_server": { 2023-10-16T13:15:29.402 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_client_request": 0, 2023-10-16T13:15:29.402 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_server_request": 0, 2023-10-16T13:15:29.402 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_request": 0, 2023-10-16T13:15:29.402 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_session": 0, 2023-10-16T13:15:29.402 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_peer_request": 0, 2023-10-16T13:15:29.403 INFO:teuthology.orchestra.run.smithi118.stdout: "req_create_latency": { 2023-10-16T13:15:29.403 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.403 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.403 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.403 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.403 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getattr_latency": { 2023-10-16T13:15:29.404 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.404 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.404 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.404 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.404 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getfilelock_latency": { 2023-10-16T13:15:29.404 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.405 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.405 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.405 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.405 INFO:teuthology.orchestra.run.smithi118.stdout: "req_link_latency": { 2023-10-16T13:15:29.405 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.406 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.406 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.406 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.406 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookup_latency": { 2023-10-16T13:15:29.406 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.407 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.407 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.407 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.407 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookuphash_latency": { 2023-10-16T13:15:29.407 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.408 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.408 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.408 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.408 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupino_latency": { 2023-10-16T13:15:29.408 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.408 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.409 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.409 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.409 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupname_latency": { 2023-10-16T13:15:29.409 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.409 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.409 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.410 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.410 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupparent_latency": { 2023-10-16T13:15:29.410 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.410 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.410 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.411 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.411 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupsnap_latency": { 2023-10-16T13:15:29.411 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.411 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.411 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.411 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.412 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lssnap_latency": { 2023-10-16T13:15:29.412 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.412 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.412 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.412 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.412 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mkdir_latency": { 2023-10-16T13:15:29.413 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.413 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.413 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.413 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.413 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mknod_latency": { 2023-10-16T13:15:29.414 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.414 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.414 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.414 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.414 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mksnap_latency": { 2023-10-16T13:15:29.414 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.415 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.415 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.415 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.415 INFO:teuthology.orchestra.run.smithi118.stdout: "req_open_latency": { 2023-10-16T13:15:29.415 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.416 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.416 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.416 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.416 INFO:teuthology.orchestra.run.smithi118.stdout: "req_readdir_latency": { 2023-10-16T13:15:29.416 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.416 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.417 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.417 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.417 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rename_latency": { 2023-10-16T13:15:29.417 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.417 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.418 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.418 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.418 INFO:teuthology.orchestra.run.smithi118.stdout: "req_renamesnap_latency": { 2023-10-16T13:15:29.418 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.418 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.418 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.419 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.419 INFO:teuthology.orchestra.run.smithi118.stdout: "req_snapdiff_latency": { 2023-10-16T13:15:29.419 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.419 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.419 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.420 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.420 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmdir_latency": { 2023-10-16T13:15:29.420 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.420 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.420 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.421 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.421 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmsnap_latency": { 2023-10-16T13:15:29.421 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.421 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.421 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.421 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.422 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmxattr_latency": { 2023-10-16T13:15:29.422 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.422 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.422 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.422 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.423 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setattr_latency": { 2023-10-16T13:15:29.423 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.423 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.423 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.423 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.423 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setdirlayout_latency": { 2023-10-16T13:15:29.424 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.424 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.424 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.424 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.424 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setfilelock_latency": { 2023-10-16T13:15:29.424 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.424 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.425 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.425 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.425 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setlayout_latency": { 2023-10-16T13:15:29.425 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.425 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.425 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.426 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.426 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setxattr_latency": { 2023-10-16T13:15:29.426 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.426 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.426 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.427 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.427 INFO:teuthology.orchestra.run.smithi118.stdout: "req_symlink_latency": { 2023-10-16T13:15:29.427 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.427 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.427 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.427 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.428 INFO:teuthology.orchestra.run.smithi118.stdout: "req_unlink_latency": { 2023-10-16T13:15:29.428 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.428 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.428 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.428 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.428 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_revoke_eviction": 0, 2023-10-16T13:15:29.429 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_acquisition_throttle": 0, 2023-10-16T13:15:29.429 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getvxattr_latency": { 2023-10-16T13:15:29.429 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.429 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.429 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.429 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:29.430 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.430 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_sessions": { 2023-10-16T13:15:29.430 INFO:teuthology.orchestra.run.smithi118.stdout: "session_count": 1, 2023-10-16T13:15:29.430 INFO:teuthology.orchestra.run.smithi118.stdout: "session_add": 2, 2023-10-16T13:15:29.430 INFO:teuthology.orchestra.run.smithi118.stdout: "session_remove": 1, 2023-10-16T13:15:29.431 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_open": 1, 2023-10-16T13:15:29.431 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_stale": 0, 2023-10-16T13:15:29.431 INFO:teuthology.orchestra.run.smithi118.stdout: "total_load": 0, 2023-10-16T13:15:29.431 INFO:teuthology.orchestra.run.smithi118.stdout: "average_load": 0, 2023-10-16T13:15:29.431 INFO:teuthology.orchestra.run.smithi118.stdout: "avg_session_uptime": 1527, 2023-10-16T13:15:29.431 INFO:teuthology.orchestra.run.smithi118.stdout: "mdthresh_evicted": 0 2023-10-16T13:15:29.431 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.432 INFO:teuthology.orchestra.run.smithi118.stdout: "mempool": { 2023-10-16T13:15:29.432 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_bytes": 0, 2023-10-16T13:15:29.432 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_items": 0, 2023-10-16T13:15:29.432 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_bytes": 0, 2023-10-16T13:15:29.432 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_items": 0, 2023-10-16T13:15:29.432 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_bytes": 0, 2023-10-16T13:15:29.433 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_items": 0, 2023-10-16T13:15:29.433 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-16T13:15:29.433 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_items": 0, 2023-10-16T13:15:29.433 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-16T13:15:29.433 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_items": 0, 2023-10-16T13:15:29.434 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_bytes": 0, 2023-10-16T13:15:29.434 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_items": 0, 2023-10-16T13:15:29.434 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-16T13:15:29.434 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_items": 0, 2023-10-16T13:15:29.434 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_bytes": 0, 2023-10-16T13:15:29.434 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_items": 0, 2023-10-16T13:15:29.435 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_bytes": 0, 2023-10-16T13:15:29.435 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_items": 0, 2023-10-16T13:15:29.435 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-16T13:15:29.435 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_items": 0, 2023-10-16T13:15:29.435 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-16T13:15:29.435 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_items": 0, 2023-10-16T13:15:29.436 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_bytes": 0, 2023-10-16T13:15:29.436 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_items": 0, 2023-10-16T13:15:29.436 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_bytes": 0, 2023-10-16T13:15:29.436 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_items": 0, 2023-10-16T13:15:29.436 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-16T13:15:29.436 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_items": 0, 2023-10-16T13:15:29.437 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_bytes": 0, 2023-10-16T13:15:29.437 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_items": 0, 2023-10-16T13:15:29.437 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_bytes": 0, 2023-10-16T13:15:29.437 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_items": 0, 2023-10-16T13:15:29.437 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_bytes": 0, 2023-10-16T13:15:29.438 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_items": 0, 2023-10-16T13:15:29.438 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_bytes": 0, 2023-10-16T13:15:29.438 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_items": 0, 2023-10-16T13:15:29.438 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_bytes": 189319, 2023-10-16T13:15:29.438 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_items": 50, 2023-10-16T13:15:29.438 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_bytes": 0, 2023-10-16T13:15:29.439 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_items": 0, 2023-10-16T13:15:29.439 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_bytes": 0, 2023-10-16T13:15:29.439 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_items": 0, 2023-10-16T13:15:29.439 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_bytes": 0, 2023-10-16T13:15:29.439 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_items": 0, 2023-10-16T13:15:29.439 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_bytes": 0, 2023-10-16T13:15:29.440 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_items": 0, 2023-10-16T13:15:29.440 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_bytes": 7624, 2023-10-16T13:15:29.440 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_items": 160, 2023-10-16T13:15:29.440 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_bytes": 0, 2023-10-16T13:15:29.440 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_items": 0, 2023-10-16T13:15:29.441 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_bytes": 0, 2023-10-16T13:15:29.441 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_items": 0, 2023-10-16T13:15:29.441 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_bytes": 1649864, 2023-10-16T13:15:29.441 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_items": 9373, 2023-10-16T13:15:29.441 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_bytes": 0, 2023-10-16T13:15:29.442 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_items": 0, 2023-10-16T13:15:29.442 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_bytes": 0, 2023-10-16T13:15:29.442 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_items": 0 2023-10-16T13:15:29.442 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.442 INFO:teuthology.orchestra.run.smithi118.stdout: "objecter": { 2023-10-16T13:15:29.442 INFO:teuthology.orchestra.run.smithi118.stdout: "op_active": 0, 2023-10-16T13:15:29.443 INFO:teuthology.orchestra.run.smithi118.stdout: "op_laggy": 0, 2023-10-16T13:15:29.443 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send": 625, 2023-10-16T13:15:29.443 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send_bytes": 21, 2023-10-16T13:15:29.443 INFO:teuthology.orchestra.run.smithi118.stdout: "op_resend": 3, 2023-10-16T13:15:29.443 INFO:teuthology.orchestra.run.smithi118.stdout: "op_reply": 625, 2023-10-16T13:15:29.444 INFO:teuthology.orchestra.run.smithi118.stdout: "op_latency": { 2023-10-16T13:15:29.444 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 625, 2023-10-16T13:15:29.444 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 1.651963241, 2023-10-16T13:15:29.444 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.002643141 2023-10-16T13:15:29.444 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.444 INFO:teuthology.orchestra.run.smithi118.stdout: "op_inflight": 0, 2023-10-16T13:15:29.445 INFO:teuthology.orchestra.run.smithi118.stdout: "oplen_avg": { 2023-10-16T13:15:29.445 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 625, 2023-10-16T13:15:29.445 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 626 2023-10-16T13:15:29.445 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.445 INFO:teuthology.orchestra.run.smithi118.stdout: "op": 625, 2023-10-16T13:15:29.445 INFO:teuthology.orchestra.run.smithi118.stdout: "op_r": 625, 2023-10-16T13:15:29.446 INFO:teuthology.orchestra.run.smithi118.stdout: "op_w": 0, 2023-10-16T13:15:29.446 INFO:teuthology.orchestra.run.smithi118.stdout: "op_rmw": 0, 2023-10-16T13:15:29.446 INFO:teuthology.orchestra.run.smithi118.stdout: "op_pg": 0, 2023-10-16T13:15:29.446 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_stat": 365, 2023-10-16T13:15:29.446 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_create": 0, 2023-10-16T13:15:29.447 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_read": 258, 2023-10-16T13:15:29.447 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_write": 0, 2023-10-16T13:15:29.447 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writefull": 0, 2023-10-16T13:15:29.447 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writesame": 0, 2023-10-16T13:15:29.447 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_append": 0, 2023-10-16T13:15:29.448 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_zero": 0, 2023-10-16T13:15:29.448 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_truncate": 0, 2023-10-16T13:15:29.448 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_delete": 0, 2023-10-16T13:15:29.448 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_mapext": 0, 2023-10-16T13:15:29.448 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_sparse_read": 0, 2023-10-16T13:15:29.448 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_clonerange": 0, 2023-10-16T13:15:29.449 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_getxattr": 1, 2023-10-16T13:15:29.449 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_setxattr": 0, 2023-10-16T13:15:29.449 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_cmpxattr": 0, 2023-10-16T13:15:29.449 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_rmxattr": 0, 2023-10-16T13:15:29.449 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_resetxattrs": 0, 2023-10-16T13:15:29.449 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_call": 0, 2023-10-16T13:15:29.450 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_watch": 0, 2023-10-16T13:15:29.450 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_notify": 0, 2023-10-16T13:15:29.450 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_src_cmpxattr": 0, 2023-10-16T13:15:29.450 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls": 0, 2023-10-16T13:15:29.450 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls_filter": 0, 2023-10-16T13:15:29.451 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_other": 0, 2023-10-16T13:15:29.451 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_active": 0, 2023-10-16T13:15:29.451 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_send": 0, 2023-10-16T13:15:29.451 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_resend": 0, 2023-10-16T13:15:29.451 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_ping": 0, 2023-10-16T13:15:29.451 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_active": 0, 2023-10-16T13:15:29.452 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_send": 0, 2023-10-16T13:15:29.452 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_resend": 0, 2023-10-16T13:15:29.452 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_active": 0, 2023-10-16T13:15:29.452 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_send": 0, 2023-10-16T13:15:29.452 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_resend": 0, 2023-10-16T13:15:29.452 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_active": 0, 2023-10-16T13:15:29.453 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_send": 0, 2023-10-16T13:15:29.453 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_resend": 0, 2023-10-16T13:15:29.453 INFO:teuthology.orchestra.run.smithi118.stdout: "command_active": 0, 2023-10-16T13:15:29.453 INFO:teuthology.orchestra.run.smithi118.stdout: "command_send": 0, 2023-10-16T13:15:29.453 INFO:teuthology.orchestra.run.smithi118.stdout: "command_resend": 0, 2023-10-16T13:15:29.453 INFO:teuthology.orchestra.run.smithi118.stdout: "map_epoch": 85, 2023-10-16T13:15:29.454 INFO:teuthology.orchestra.run.smithi118.stdout: "map_full": 0, 2023-10-16T13:15:29.454 INFO:teuthology.orchestra.run.smithi118.stdout: "map_inc": 2, 2023-10-16T13:15:29.454 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_sessions": 5, 2023-10-16T13:15:29.454 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_open": 5, 2023-10-16T13:15:29.454 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_close": 0, 2023-10-16T13:15:29.454 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_laggy": 0, 2023-10-16T13:15:29.455 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_wr": 0, 2023-10-16T13:15:29.455 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_rd": 2, 2023-10-16T13:15:29.455 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_del": 0 2023-10-16T13:15:29.455 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.455 INFO:teuthology.orchestra.run.smithi118.stdout: "oft": { 2023-10-16T13:15:29.455 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_objs": 0, 2023-10-16T13:15:29.456 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_kv_pairs": 0, 2023-10-16T13:15:29.456 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_updates": 0, 2023-10-16T13:15:29.456 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_removes": 0 2023-10-16T13:15:29.456 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.456 INFO:teuthology.orchestra.run.smithi118.stdout: "osd-slow-ops": { 2023-10-16T13:15:29.456 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_ops_count": 0 2023-10-16T13:15:29.457 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.457 INFO:teuthology.orchestra.run.smithi118.stdout: "purge_queue": { 2023-10-16T13:15:29.457 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops": 0, 2023-10-16T13:15:29.457 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops_high_water": 0, 2023-10-16T13:15:29.457 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing": 0, 2023-10-16T13:15:29.457 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_high_water": 0, 2023-10-16T13:15:29.458 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executed": 0, 2023-10-16T13:15:29.458 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_item_in_journal": 0 2023-10-16T13:15:29.458 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.458 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-16T13:15:29.458 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:29.458 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2023-10-16T13:15:29.459 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:29.459 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 724, 2023-10-16T13:15:29.459 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 14724200, 2023-10-16T13:15:29.459 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:29.459 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 724, 2023-10-16T13:15:29.460 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-16T13:15:29.460 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-16T13:15:29.460 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 724, 2023-10-16T13:15:29.460 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 14724200, 2023-10-16T13:15:29.460 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:29.460 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.461 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.461 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.461 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:29.461 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.461 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_bytes": { 2023-10-16T13:15:29.461 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:29.462 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2023-10-16T13:15:29.462 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:29.462 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-16T13:15:29.462 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-16T13:15:29.462 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:29.462 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:29.463 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 625, 2023-10-16T13:15:29.463 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 14075971, 2023-10-16T13:15:29.463 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 625, 2023-10-16T13:15:29.463 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 14075971, 2023-10-16T13:15:29.463 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:29.463 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.464 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.464 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.464 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:29.464 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.464 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_ops": { 2023-10-16T13:15:29.464 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:29.465 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 1024, 2023-10-16T13:15:29.465 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:29.465 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-16T13:15:29.465 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-16T13:15:29.465 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:29.465 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:29.466 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 625, 2023-10-16T13:15:29.466 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 625, 2023-10-16T13:15:29.466 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 625, 2023-10-16T13:15:29.466 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 625, 2023-10-16T13:15:29.466 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:29.467 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.467 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.467 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.467 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:29.467 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.467 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle": { 2023-10-16T13:15:29.468 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:29.468 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2023-10-16T13:15:29.468 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:29.468 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-16T13:15:29.468 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-16T13:15:29.468 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:29.469 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:29.469 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-16T13:15:29.469 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-16T13:15:29.469 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 0, 2023-10-16T13:15:29.469 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 0, 2023-10-16T13:15:29.469 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:29.470 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.470 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.470 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.470 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:29.470 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:29.470 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle-0x55b8422ca960": { 2023-10-16T13:15:29.471 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:29.471 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2023-10-16T13:15:29.471 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:29.471 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-16T13:15:29.471 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-16T13:15:29.471 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:29.472 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:29.472 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-16T13:15:29.472 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-16T13:15:29.472 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 0, 2023-10-16T13:15:29.472 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 0, 2023-10-16T13:15:29.472 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:29.473 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:29.473 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:29.473 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:29.473 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:29.473 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:29.474 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-10-16T13:15:29.706 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2023-10-16T13:15:29.707 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2023-10-16T13:15:29.707 DEBUG:tasks.check_counter:Getting stats from k 2023-10-16T13:15:29.707 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph daemon mds.k perf dump 2023-10-16T13:15:30.264 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-16T13:15:30.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:30 smithi152 ceph-mon[104423]: pgmap v372: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-16T13:15:30.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:30 smithi092 ceph-mon[99542]: pgmap v372: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-16T13:15:30.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:30 smithi118 ceph-mon[103969]: pgmap v372: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-16T13:15:31.629 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-10-16T13:15:31.630 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-0": { 2023-10-16T13:15:31.630 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 95, 2023-10-16T13:15:31.630 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 82, 2023-10-16T13:15:31.631 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 512786, 2023-10-16T13:15:31.631 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 44765, 2023-10-16T13:15:31.631 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 5, 2023-10-16T13:15:31.631 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 1, 2023-10-16T13:15:31.631 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.015817404, 2023-10-16T13:15:31.632 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.004522913, 2023-10-16T13:15:31.632 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.010844643, 2023-10-16T13:15:31.632 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.002012727, 2023-10-16T13:15:31.632 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:31.632 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 81, 2023-10-16T13:15:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.004820833, 2023-10-16T13:15:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000059516 2023-10-16T13:15:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.634 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.634 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.634 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 511952, 2023-10-16T13:15:31.634 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 44448 2023-10-16T13:15:31.634 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-1": { 2023-10-16T13:15:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 166, 2023-10-16T13:15:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 221, 2023-10-16T13:15:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 3698204, 2023-10-16T13:15:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 217896, 2023-10-16T13:15:31.636 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 5, 2023-10-16T13:15:31.636 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 4, 2023-10-16T13:15:31.636 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.018881373, 2023-10-16T13:15:31.636 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.005460422, 2023-10-16T13:15:31.636 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.006466066, 2023-10-16T13:15:31.637 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.005072344, 2023-10-16T13:15:31.637 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:31.637 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 219, 2023-10-16T13:15:31.637 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.008908602, 2023-10-16T13:15:31.637 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000040678 2023-10-16T13:15:31.637 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.638 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:31.638 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.638 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.638 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.638 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.639 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-16T13:15:31.639 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 166576 2023-10-16T13:15:31.639 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.639 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-2": { 2023-10-16T13:15:31.639 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 462, 2023-10-16T13:15:31.640 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 462, 2023-10-16T13:15:31.640 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 4332917, 2023-10-16T13:15:31.640 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 142944, 2023-10-16T13:15:31.640 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 5, 2023-10-16T13:15:31.640 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 4, 2023-10-16T13:15:31.641 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.044840287, 2023-10-16T13:15:31.641 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.013853936, 2023-10-16T13:15:31.641 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.012421911, 2023-10-16T13:15:31.641 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.014510410, 2023-10-16T13:15:31.641 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:31.642 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 461, 2023-10-16T13:15:31.642 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.020028720, 2023-10-16T13:15:31.642 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000043446 2023-10-16T13:15:31.642 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.642 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 2944, 2023-10-16T13:15:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 448 2023-10-16T13:15:31.644 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.644 INFO:teuthology.orchestra.run.smithi118.stdout: "cct": { 2023-10-16T13:15:31.644 INFO:teuthology.orchestra.run.smithi118.stdout: "total_workers": 1, 2023-10-16T13:15:31.644 INFO:teuthology.orchestra.run.smithi118.stdout: "unhealthy_workers": 0 2023-10-16T13:15:31.644 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-MDSRank": { 2023-10-16T13:15:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2023-10-16T13:15:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2023-10-16T13:15:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1083, 2023-10-16T13:15:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.028917150, 2023-10-16T13:15:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000026700 2023-10-16T13:15:31.646 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:31.646 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.646 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-PurgeQueue": { 2023-10-16T13:15:31.646 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2023-10-16T13:15:31.646 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2023-10-16T13:15:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2023-10-16T13:15:31.648 INFO:teuthology.orchestra.run.smithi118.stdout: "request": 0, 2023-10-16T13:15:31.648 INFO:teuthology.orchestra.run.smithi118.stdout: "reply": 0, 2023-10-16T13:15:31.648 INFO:teuthology.orchestra.run.smithi118.stdout: "reply_latency": { 2023-10-16T13:15:31.648 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.648 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.648 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.649 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.649 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_reply": 0, 2023-10-16T13:15:31.649 INFO:teuthology.orchestra.run.smithi118.stdout: "forward": 0, 2023-10-16T13:15:31.649 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_complete": 0, 2023-10-16T13:15:31.649 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_keys": 0, 2023-10-16T13:15:31.650 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_commit": 0, 2023-10-16T13:15:31.650 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_split": 0, 2023-10-16T13:15:31.650 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_merge": 0, 2023-10-16T13:15:31.650 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes": 1477, 2023-10-16T13:15:31.650 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_top": 0, 2023-10-16T13:15:31.651 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_bottom": 0, 2023-10-16T13:15:31.651 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pin_tail": 1477, 2023-10-16T13:15:31.651 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pinned": 1477, 2023-10-16T13:15:31.651 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_expired": 0, 2023-10-16T13:15:31.651 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_with_caps": 0, 2023-10-16T13:15:31.651 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": 0, 2023-10-16T13:15:31.652 INFO:teuthology.orchestra.run.smithi118.stdout: "subtrees": 1, 2023-10-16T13:15:31.652 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse": 0, 2023-10-16T13:15:31.652 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_hit": 0, 2023-10-16T13:15:31.652 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_forward": 0, 2023-10-16T13:15:31.652 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_discover": 0, 2023-10-16T13:15:31.652 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_dir_fetch": 0, 2023-10-16T13:15:31.653 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_remote_ino": 0, 2023-10-16T13:15:31.653 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_lock": 0, 2023-10-16T13:15:31.653 INFO:teuthology.orchestra.run.smithi118.stdout: "load_cent": 0, 2023-10-16T13:15:31.653 INFO:teuthology.orchestra.run.smithi118.stdout: "q": 0, 2023-10-16T13:15:31.653 INFO:teuthology.orchestra.run.smithi118.stdout: "exported": 0, 2023-10-16T13:15:31.653 INFO:teuthology.orchestra.run.smithi118.stdout: "exported_inodes": 0, 2023-10-16T13:15:31.654 INFO:teuthology.orchestra.run.smithi118.stdout: "imported": 0, 2023-10-16T13:15:31.654 INFO:teuthology.orchestra.run.smithi118.stdout: "imported_inodes": 0, 2023-10-16T13:15:31.654 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_dir_fetch": 0, 2023-10-16T13:15:31.654 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_backtrace_fetch": 0, 2023-10-16T13:15:31.654 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_peer_discover": 0, 2023-10-16T13:15:31.655 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rfiles": 0, 2023-10-16T13:15:31.655 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rbytes": 0, 2023-10-16T13:15:31.655 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rsnaps": 0, 2023-10-16T13:15:31.655 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_fetch": 0, 2023-10-16T13:15:31.655 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_set_tag": 0, 2023-10-16T13:15:31.655 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_repaired": 0, 2023-10-16T13:15:31.656 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_inotable_repaired": 0, 2023-10-16T13:15:31.656 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_inodes": 0, 2023-10-16T13:15:31.656 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_base_inodes": 0, 2023-10-16T13:15:31.656 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dirfrag_rstats": 0, 2023-10-16T13:15:31.656 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_file_inodes": 0, 2023-10-16T13:15:31.657 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_inode_file_caps": 0, 2023-10-16T13:15:31.657 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_revoke": 0, 2023-10-16T13:15:31.657 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_grant": 0, 2023-10-16T13:15:31.657 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_trunc": 0, 2023-10-16T13:15:31.657 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-16T13:15:31.657 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-16T13:15:31.658 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps": 0, 2023-10-16T13:15:31.658 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps_dirty": 0, 2023-10-16T13:15:31.658 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_cap_release": 0, 2023-10-16T13:15:31.658 INFO:teuthology.orchestra.run.smithi118.stdout: "process_request_cap_release": 0 2023-10-16T13:15:31.658 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.659 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_cache": { 2023-10-16T13:15:31.659 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update": 0, 2023-10-16T13:15:31.659 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update_receipt": 0, 2023-10-16T13:15:31.659 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_try_discover": 0, 2023-10-16T13:15:31.659 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_send_discover": 0, 2023-10-16T13:15:31.660 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_handle_discover": 0, 2023-10-16T13:15:31.660 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays": 0, 2023-10-16T13:15:31.660 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_delayed": 0, 2023-10-16T13:15:31.660 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_enqueuing": 0, 2023-10-16T13:15:31.660 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_created": 0, 2023-10-16T13:15:31.661 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_enqueued": 0, 2023-10-16T13:15:31.661 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_reintegrated": 0, 2023-10-16T13:15:31.661 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_migrated": 0, 2023-10-16T13:15:31.661 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_processing": 0, 2023-10-16T13:15:31.661 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_enqueued": 0, 2023-10-16T13:15:31.661 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_prioritized": 0, 2023-10-16T13:15:31.662 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_started": 0, 2023-10-16T13:15:31.662 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_completed": 0, 2023-10-16T13:15:31.662 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_enqueue_scrub": 0, 2023-10-16T13:15:31.662 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_exportdir": 0, 2023-10-16T13:15:31.662 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_flush": 0, 2023-10-16T13:15:31.663 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragmentdir": 0, 2023-10-16T13:15:31.663 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragstats": 0, 2023-10-16T13:15:31.663 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_inodestats": 0 2023-10-16T13:15:31.663 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.663 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_log": { 2023-10-16T13:15:31.663 INFO:teuthology.orchestra.run.smithi118.stdout: "evlrg": 0, 2023-10-16T13:15:31.664 INFO:teuthology.orchestra.run.smithi118.stdout: "evadd": 0, 2023-10-16T13:15:31.664 INFO:teuthology.orchestra.run.smithi118.stdout: "evex": 0, 2023-10-16T13:15:31.664 INFO:teuthology.orchestra.run.smithi118.stdout: "evtrm": 0, 2023-10-16T13:15:31.664 INFO:teuthology.orchestra.run.smithi118.stdout: "ev": 4120, 2023-10-16T13:15:31.664 INFO:teuthology.orchestra.run.smithi118.stdout: "evexg": 0, 2023-10-16T13:15:31.664 INFO:teuthology.orchestra.run.smithi118.stdout: "evexd": 0, 2023-10-16T13:15:31.665 INFO:teuthology.orchestra.run.smithi118.stdout: "segadd": 0, 2023-10-16T13:15:31.665 INFO:teuthology.orchestra.run.smithi118.stdout: "segex": 0, 2023-10-16T13:15:31.665 INFO:teuthology.orchestra.run.smithi118.stdout: "segtrm": 0, 2023-10-16T13:15:31.665 INFO:teuthology.orchestra.run.smithi118.stdout: "seg": 6, 2023-10-16T13:15:31.665 INFO:teuthology.orchestra.run.smithi118.stdout: "segmjr": 2, 2023-10-16T13:15:31.666 INFO:teuthology.orchestra.run.smithi118.stdout: "segexg": 0, 2023-10-16T13:15:31.666 INFO:teuthology.orchestra.run.smithi118.stdout: "segexd": 0, 2023-10-16T13:15:31.666 INFO:teuthology.orchestra.run.smithi118.stdout: "expos": 4194304, 2023-10-16T13:15:31.666 INFO:teuthology.orchestra.run.smithi118.stdout: "wrpos": 12045192, 2023-10-16T13:15:31.666 INFO:teuthology.orchestra.run.smithi118.stdout: "rdpos": 12044054, 2023-10-16T13:15:31.667 INFO:teuthology.orchestra.run.smithi118.stdout: "jlat": { 2023-10-16T13:15:31.667 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.667 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.667 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.667 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.668 INFO:teuthology.orchestra.run.smithi118.stdout: "replayed": 4120 2023-10-16T13:15:31.668 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.668 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_mem": { 2023-10-16T13:15:31.668 INFO:teuthology.orchestra.run.smithi118.stdout: "ino": 7, 2023-10-16T13:15:31.668 INFO:teuthology.orchestra.run.smithi118.stdout: "ino+": 1532, 2023-10-16T13:15:31.669 INFO:teuthology.orchestra.run.smithi118.stdout: "ino-": 1525, 2023-10-16T13:15:31.669 INFO:teuthology.orchestra.run.smithi118.stdout: "dir": 5, 2023-10-16T13:15:31.669 INFO:teuthology.orchestra.run.smithi118.stdout: "dir+": 167, 2023-10-16T13:15:31.669 INFO:teuthology.orchestra.run.smithi118.stdout: "dir-": 162, 2023-10-16T13:15:31.669 INFO:teuthology.orchestra.run.smithi118.stdout: "dn": 1477, 2023-10-16T13:15:31.670 INFO:teuthology.orchestra.run.smithi118.stdout: "dn+": 3005, 2023-10-16T13:15:31.670 INFO:teuthology.orchestra.run.smithi118.stdout: "dn-": 1528, 2023-10-16T13:15:31.670 INFO:teuthology.orchestra.run.smithi118.stdout: "cap": 0, 2023-10-16T13:15:31.670 INFO:teuthology.orchestra.run.smithi118.stdout: "cap+": 0, 2023-10-16T13:15:31.670 INFO:teuthology.orchestra.run.smithi118.stdout: "cap-": 0, 2023-10-16T13:15:31.671 INFO:teuthology.orchestra.run.smithi118.stdout: "rss": 51272, 2023-10-16T13:15:31.671 INFO:teuthology.orchestra.run.smithi118.stdout: "heap": 207152 2023-10-16T13:15:31.671 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.671 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_server": { 2023-10-16T13:15:31.671 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_client_request": 0, 2023-10-16T13:15:31.672 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_server_request": 0, 2023-10-16T13:15:31.672 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_request": 0, 2023-10-16T13:15:31.672 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_session": 0, 2023-10-16T13:15:31.672 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_peer_request": 0, 2023-10-16T13:15:31.672 INFO:teuthology.orchestra.run.smithi118.stdout: "req_create_latency": { 2023-10-16T13:15:31.672 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.673 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.673 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.673 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.673 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getattr_latency": { 2023-10-16T13:15:31.673 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.674 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.674 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.674 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.674 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getfilelock_latency": { 2023-10-16T13:15:31.675 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.675 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.675 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.675 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.675 INFO:teuthology.orchestra.run.smithi118.stdout: "req_link_latency": { 2023-10-16T13:15:31.676 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.676 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.676 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.676 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.676 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookup_latency": { 2023-10-16T13:15:31.676 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.677 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.677 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.677 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.677 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookuphash_latency": { 2023-10-16T13:15:31.677 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.678 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.678 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.678 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.678 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupino_latency": { 2023-10-16T13:15:31.678 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.679 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.679 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.679 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.679 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupname_latency": { 2023-10-16T13:15:31.679 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.680 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.680 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.680 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.680 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupparent_latency": { 2023-10-16T13:15:31.680 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.681 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.681 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.681 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.681 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupsnap_latency": { 2023-10-16T13:15:31.681 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.682 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.682 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.682 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.682 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lssnap_latency": { 2023-10-16T13:15:31.682 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.683 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.683 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.683 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.683 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mkdir_latency": { 2023-10-16T13:15:31.683 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.683 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.684 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.684 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.684 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mknod_latency": { 2023-10-16T13:15:31.684 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.684 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.685 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.685 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.685 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mksnap_latency": { 2023-10-16T13:15:31.685 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.685 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.686 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.686 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.686 INFO:teuthology.orchestra.run.smithi118.stdout: "req_open_latency": { 2023-10-16T13:15:31.686 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.686 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.686 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.687 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.687 INFO:teuthology.orchestra.run.smithi118.stdout: "req_readdir_latency": { 2023-10-16T13:15:31.687 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.687 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.687 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.688 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.688 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rename_latency": { 2023-10-16T13:15:31.688 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.688 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.688 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.689 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.689 INFO:teuthology.orchestra.run.smithi118.stdout: "req_renamesnap_latency": { 2023-10-16T13:15:31.689 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.689 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.689 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.689 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.690 INFO:teuthology.orchestra.run.smithi118.stdout: "req_snapdiff_latency": { 2023-10-16T13:15:31.690 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.690 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.690 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.690 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.691 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmdir_latency": { 2023-10-16T13:15:31.691 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.691 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.691 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.691 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.692 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmsnap_latency": { 2023-10-16T13:15:31.692 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.692 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.692 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.692 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.693 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmxattr_latency": { 2023-10-16T13:15:31.693 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.693 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.693 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.693 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.694 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setattr_latency": { 2023-10-16T13:15:31.694 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.694 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.694 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.694 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.695 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setdirlayout_latency": { 2023-10-16T13:15:31.695 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.695 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.695 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.695 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.695 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setfilelock_latency": { 2023-10-16T13:15:31.696 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.696 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.696 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.696 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.697 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setlayout_latency": { 2023-10-16T13:15:31.697 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.697 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.697 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.697 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.697 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setxattr_latency": { 2023-10-16T13:15:31.698 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.698 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.698 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.698 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.698 INFO:teuthology.orchestra.run.smithi118.stdout: "req_symlink_latency": { 2023-10-16T13:15:31.699 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.699 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.699 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.699 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.699 INFO:teuthology.orchestra.run.smithi118.stdout: "req_unlink_latency": { 2023-10-16T13:15:31.700 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.700 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.700 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.700 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.700 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_revoke_eviction": 0, 2023-10-16T13:15:31.700 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_acquisition_throttle": 0, 2023-10-16T13:15:31.701 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getvxattr_latency": { 2023-10-16T13:15:31.701 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.701 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.701 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.701 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:31.702 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.702 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_sessions": { 2023-10-16T13:15:31.702 INFO:teuthology.orchestra.run.smithi118.stdout: "session_count": 1, 2023-10-16T13:15:31.702 INFO:teuthology.orchestra.run.smithi118.stdout: "session_add": 2, 2023-10-16T13:15:31.702 INFO:teuthology.orchestra.run.smithi118.stdout: "session_remove": 1, 2023-10-16T13:15:31.703 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_open": 1, 2023-10-16T13:15:31.703 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_stale": 0, 2023-10-16T13:15:31.703 INFO:teuthology.orchestra.run.smithi118.stdout: "total_load": 0, 2023-10-16T13:15:31.703 INFO:teuthology.orchestra.run.smithi118.stdout: "average_load": 0, 2023-10-16T13:15:31.703 INFO:teuthology.orchestra.run.smithi118.stdout: "avg_session_uptime": 1528, 2023-10-16T13:15:31.703 INFO:teuthology.orchestra.run.smithi118.stdout: "mdthresh_evicted": 0 2023-10-16T13:15:31.704 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.704 INFO:teuthology.orchestra.run.smithi118.stdout: "mempool": { 2023-10-16T13:15:31.704 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_bytes": 0, 2023-10-16T13:15:31.704 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_items": 0, 2023-10-16T13:15:31.704 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_bytes": 0, 2023-10-16T13:15:31.705 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_items": 0, 2023-10-16T13:15:31.705 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_bytes": 0, 2023-10-16T13:15:31.705 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_items": 0, 2023-10-16T13:15:31.705 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-16T13:15:31.705 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_items": 0, 2023-10-16T13:15:31.706 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-16T13:15:31.706 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_items": 0, 2023-10-16T13:15:31.706 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_bytes": 0, 2023-10-16T13:15:31.706 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_items": 0, 2023-10-16T13:15:31.706 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-16T13:15:31.707 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_items": 0, 2023-10-16T13:15:31.707 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_bytes": 0, 2023-10-16T13:15:31.709 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_items": 0, 2023-10-16T13:15:31.709 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_bytes": 0, 2023-10-16T13:15:31.709 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_items": 0, 2023-10-16T13:15:31.709 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-16T13:15:31.710 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_items": 0, 2023-10-16T13:15:31.710 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-16T13:15:31.710 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_items": 0, 2023-10-16T13:15:31.710 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_bytes": 0, 2023-10-16T13:15:31.710 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_items": 0, 2023-10-16T13:15:31.711 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_bytes": 0, 2023-10-16T13:15:31.711 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_items": 0, 2023-10-16T13:15:31.711 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-16T13:15:31.711 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_items": 0, 2023-10-16T13:15:31.711 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_bytes": 0, 2023-10-16T13:15:31.712 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_items": 0, 2023-10-16T13:15:31.712 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_bytes": 0, 2023-10-16T13:15:31.712 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_items": 0, 2023-10-16T13:15:31.712 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_bytes": 0, 2023-10-16T13:15:31.712 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_items": 0, 2023-10-16T13:15:31.713 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_bytes": 0, 2023-10-16T13:15:31.713 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_items": 0, 2023-10-16T13:15:31.713 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_bytes": 197319, 2023-10-16T13:15:31.713 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_items": 52, 2023-10-16T13:15:31.713 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_bytes": 0, 2023-10-16T13:15:31.714 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_items": 0, 2023-10-16T13:15:31.714 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_bytes": 0, 2023-10-16T13:15:31.714 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_items": 0, 2023-10-16T13:15:31.714 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_bytes": 0, 2023-10-16T13:15:31.715 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_items": 0, 2023-10-16T13:15:31.715 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_bytes": 0, 2023-10-16T13:15:31.715 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_items": 0, 2023-10-16T13:15:31.715 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_bytes": 7624, 2023-10-16T13:15:31.715 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_items": 160, 2023-10-16T13:15:31.715 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_bytes": 0, 2023-10-16T13:15:31.716 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_items": 0, 2023-10-16T13:15:31.716 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_bytes": 0, 2023-10-16T13:15:31.716 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_items": 0, 2023-10-16T13:15:31.716 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_bytes": 1050112, 2023-10-16T13:15:31.716 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_items": 5970, 2023-10-16T13:15:31.717 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_bytes": 0, 2023-10-16T13:15:31.717 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_items": 0, 2023-10-16T13:15:31.717 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_bytes": 0, 2023-10-16T13:15:31.717 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_items": 0 2023-10-16T13:15:31.718 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.718 INFO:teuthology.orchestra.run.smithi118.stdout: "objecter": { 2023-10-16T13:15:31.718 INFO:teuthology.orchestra.run.smithi118.stdout: "op_active": 0, 2023-10-16T13:15:31.718 INFO:teuthology.orchestra.run.smithi118.stdout: "op_laggy": 0, 2023-10-16T13:15:31.718 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send": 624, 2023-10-16T13:15:31.719 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send_bytes": 21, 2023-10-16T13:15:31.719 INFO:teuthology.orchestra.run.smithi118.stdout: "op_resend": 3, 2023-10-16T13:15:31.719 INFO:teuthology.orchestra.run.smithi118.stdout: "op_reply": 624, 2023-10-16T13:15:31.719 INFO:teuthology.orchestra.run.smithi118.stdout: "op_latency": { 2023-10-16T13:15:31.719 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 624, 2023-10-16T13:15:31.719 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.538987941, 2023-10-16T13:15:31.720 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000863762 2023-10-16T13:15:31.720 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.720 INFO:teuthology.orchestra.run.smithi118.stdout: "op_inflight": 0, 2023-10-16T13:15:31.720 INFO:teuthology.orchestra.run.smithi118.stdout: "oplen_avg": { 2023-10-16T13:15:31.720 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 624, 2023-10-16T13:15:31.721 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 625 2023-10-16T13:15:31.721 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.721 INFO:teuthology.orchestra.run.smithi118.stdout: "op": 624, 2023-10-16T13:15:31.721 INFO:teuthology.orchestra.run.smithi118.stdout: "op_r": 624, 2023-10-16T13:15:31.721 INFO:teuthology.orchestra.run.smithi118.stdout: "op_w": 0, 2023-10-16T13:15:31.722 INFO:teuthology.orchestra.run.smithi118.stdout: "op_rmw": 0, 2023-10-16T13:15:31.722 INFO:teuthology.orchestra.run.smithi118.stdout: "op_pg": 0, 2023-10-16T13:15:31.722 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_stat": 369, 2023-10-16T13:15:31.722 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_create": 0, 2023-10-16T13:15:31.722 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_read": 253, 2023-10-16T13:15:31.722 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_write": 0, 2023-10-16T13:15:31.723 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writefull": 0, 2023-10-16T13:15:31.723 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writesame": 0, 2023-10-16T13:15:31.723 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_append": 0, 2023-10-16T13:15:31.723 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_zero": 0, 2023-10-16T13:15:31.723 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_truncate": 0, 2023-10-16T13:15:31.724 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_delete": 0, 2023-10-16T13:15:31.724 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_mapext": 0, 2023-10-16T13:15:31.724 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_sparse_read": 0, 2023-10-16T13:15:31.724 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_clonerange": 0, 2023-10-16T13:15:31.724 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_getxattr": 1, 2023-10-16T13:15:31.725 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_setxattr": 0, 2023-10-16T13:15:31.725 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_cmpxattr": 0, 2023-10-16T13:15:31.725 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_rmxattr": 0, 2023-10-16T13:15:31.725 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_resetxattrs": 0, 2023-10-16T13:15:31.725 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_call": 0, 2023-10-16T13:15:31.725 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_watch": 0, 2023-10-16T13:15:31.726 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_notify": 0, 2023-10-16T13:15:31.726 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_src_cmpxattr": 0, 2023-10-16T13:15:31.726 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls": 0, 2023-10-16T13:15:31.726 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls_filter": 0, 2023-10-16T13:15:31.726 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_other": 0, 2023-10-16T13:15:31.727 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_active": 0, 2023-10-16T13:15:31.727 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_send": 0, 2023-10-16T13:15:31.727 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_resend": 0, 2023-10-16T13:15:31.727 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_ping": 0, 2023-10-16T13:15:31.727 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_active": 0, 2023-10-16T13:15:31.728 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_send": 0, 2023-10-16T13:15:31.728 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_resend": 0, 2023-10-16T13:15:31.728 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_active": 0, 2023-10-16T13:15:31.728 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_send": 0, 2023-10-16T13:15:31.728 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_resend": 0, 2023-10-16T13:15:31.728 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_active": 0, 2023-10-16T13:15:31.729 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_send": 0, 2023-10-16T13:15:31.729 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_resend": 0, 2023-10-16T13:15:31.729 INFO:teuthology.orchestra.run.smithi118.stdout: "command_active": 0, 2023-10-16T13:15:31.729 INFO:teuthology.orchestra.run.smithi118.stdout: "command_send": 0, 2023-10-16T13:15:31.729 INFO:teuthology.orchestra.run.smithi118.stdout: "command_resend": 0, 2023-10-16T13:15:31.730 INFO:teuthology.orchestra.run.smithi118.stdout: "map_epoch": 85, 2023-10-16T13:15:31.730 INFO:teuthology.orchestra.run.smithi118.stdout: "map_full": 0, 2023-10-16T13:15:31.730 INFO:teuthology.orchestra.run.smithi118.stdout: "map_inc": 2, 2023-10-16T13:15:31.730 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_sessions": 6, 2023-10-16T13:15:31.730 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_open": 6, 2023-10-16T13:15:31.731 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_close": 0, 2023-10-16T13:15:31.731 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_laggy": 0, 2023-10-16T13:15:31.731 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_wr": 0, 2023-10-16T13:15:31.731 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_rd": 2, 2023-10-16T13:15:31.731 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_del": 0 2023-10-16T13:15:31.731 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.732 INFO:teuthology.orchestra.run.smithi118.stdout: "oft": { 2023-10-16T13:15:31.732 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_objs": 0, 2023-10-16T13:15:31.732 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_kv_pairs": 0, 2023-10-16T13:15:31.732 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_updates": 0, 2023-10-16T13:15:31.732 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_removes": 0 2023-10-16T13:15:31.733 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.733 INFO:teuthology.orchestra.run.smithi118.stdout: "osd-slow-ops": { 2023-10-16T13:15:31.733 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_ops_count": 0 2023-10-16T13:15:31.733 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.733 INFO:teuthology.orchestra.run.smithi118.stdout: "purge_queue": { 2023-10-16T13:15:31.734 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops": 0, 2023-10-16T13:15:31.734 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops_high_water": 0, 2023-10-16T13:15:31.734 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing": 0, 2023-10-16T13:15:31.734 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_high_water": 0, 2023-10-16T13:15:31.734 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executed": 0, 2023-10-16T13:15:31.735 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_item_in_journal": 0 2023-10-16T13:15:31.735 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.735 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-16T13:15:31.735 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:31.735 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2023-10-16T13:15:31.735 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:31.736 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 719, 2023-10-16T13:15:31.736 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 8471508, 2023-10-16T13:15:31.736 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:31.736 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 719, 2023-10-16T13:15:31.736 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-16T13:15:31.737 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-16T13:15:31.737 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 719, 2023-10-16T13:15:31.737 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 8471508, 2023-10-16T13:15:31.737 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:31.737 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.737 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.738 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.738 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:31.738 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.738 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_bytes": { 2023-10-16T13:15:31.738 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:31.739 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2023-10-16T13:15:31.739 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:31.739 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-16T13:15:31.739 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-16T13:15:31.739 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:31.739 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:31.740 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 624, 2023-10-16T13:15:31.740 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 7850893, 2023-10-16T13:15:31.740 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 624, 2023-10-16T13:15:31.740 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 7850893, 2023-10-16T13:15:31.740 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:31.741 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.741 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.741 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.741 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:31.741 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.742 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_ops": { 2023-10-16T13:15:31.742 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:31.742 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 1024, 2023-10-16T13:15:31.742 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:31.742 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-16T13:15:31.743 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-16T13:15:31.743 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:31.743 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:31.743 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 624, 2023-10-16T13:15:31.743 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 624, 2023-10-16T13:15:31.743 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 624, 2023-10-16T13:15:31.744 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 624, 2023-10-16T13:15:31.744 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:31.744 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.744 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.744 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.745 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:31.745 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.745 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle": { 2023-10-16T13:15:31.745 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:31.745 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2023-10-16T13:15:31.745 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:31.746 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-16T13:15:31.746 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-16T13:15:31.746 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:31.746 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:31.746 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-16T13:15:31.747 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-16T13:15:31.747 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 0, 2023-10-16T13:15:31.747 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 0, 2023-10-16T13:15:31.747 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:31.747 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.747 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.748 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.748 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:31.748 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-16T13:15:31.748 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle-0x557fbfd9c960": { 2023-10-16T13:15:31.748 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-16T13:15:31.748 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2023-10-16T13:15:31.749 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-16T13:15:31.749 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-16T13:15:31.749 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-16T13:15:31.749 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:31.749 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:31.750 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-16T13:15:31.750 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-16T13:15:31.750 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 0, 2023-10-16T13:15:31.750 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 0, 2023-10-16T13:15:31.750 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-16T13:15:31.751 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-16T13:15:31.751 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-16T13:15:31.751 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-16T13:15:31.751 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:31.751 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-16T13:15:31.751 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-10-16T13:15:32.019 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2023-10-16T13:15:32.020 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2023-10-16T13:15:32.020 DEBUG:tasks.check_counter:Getting stats from c 2023-10-16T13:15:32.020 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph daemon mds.c perf dump 2023-10-16T13:15:32.611 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-16T13:15:32.692 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:32 smithi152 ceph-mon[104423]: pgmap v373: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 13 op/s 2023-10-16T13:15:32.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:32 smithi092 ceph-mon[99542]: pgmap v373: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 13 op/s 2023-10-16T13:15:32.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:32 smithi118 ceph-mon[103969]: pgmap v373: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 13 op/s 2023-10-16T13:15:33.953 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-10-16T13:15:33.953 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2023-10-16T13:15:33.953 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 493, 2023-10-16T13:15:33.953 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 494, 2023-10-16T13:15:33.953 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 26584561, 2023-10-16T13:15:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 153022, 2023-10-16T13:15:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 8, 2023-10-16T13:15:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 4, 2023-10-16T13:15:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.064128824, 2023-10-16T13:15:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.014256456, 2023-10-16T13:15:33.955 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.027031109, 2023-10-16T13:15:33.955 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.017328883, 2023-10-16T13:15:33.955 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:33.955 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 492, 2023-10-16T13:15:33.955 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.022938759, 2023-10-16T13:15:33.955 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000046623 2023-10-16T13:15:33.956 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.956 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:33.956 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:33.956 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:33.956 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:33.957 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.957 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-16T13:15:33.957 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 0 2023-10-16T13:15:33.957 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.957 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2023-10-16T13:15:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 117, 2023-10-16T13:15:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 170, 2023-10-16T13:15:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 25196296, 2023-10-16T13:15:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 203950, 2023-10-16T13:15:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 6, 2023-10-16T13:15:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 5, 2023-10-16T13:15:33.959 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.028844512, 2023-10-16T13:15:33.959 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.004858037, 2023-10-16T13:15:33.959 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.019057644, 2023-10-16T13:15:33.959 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.003356272, 2023-10-16T13:15:33.959 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:33.960 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 168, 2023-10-16T13:15:33.960 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.011232735, 2023-10-16T13:15:33.960 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000066861 2023-10-16T13:15:33.960 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.960 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:33.960 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-16T13:15:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 167808 2023-10-16T13:15:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.962 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2023-10-16T13:15:33.962 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 335, 2023-10-16T13:15:33.962 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 313, 2023-10-16T13:15:33.962 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 25768927, 2023-10-16T13:15:33.962 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 115650, 2023-10-16T13:15:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 5, 2023-10-16T13:15:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 4, 2023-10-16T13:15:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.049460864, 2023-10-16T13:15:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.011562320, 2023-10-16T13:15:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.030193935, 2023-10-16T13:15:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.009051979, 2023-10-16T13:15:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 313, 2023-10-16T13:15:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.015156802, 2023-10-16T13:15:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000048424 2023-10-16T13:15:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 542256, 2023-10-16T13:15:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 43808 2023-10-16T13:15:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2023-10-16T13:15:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2023-10-16T13:15:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2023-10-16T13:15:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2023-10-16T13:15:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2023-10-16T13:15:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2023-10-16T13:15:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1345, 2023-10-16T13:15:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.211219404, 2023-10-16T13:15:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000157040 2023-10-16T13:15:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2023-10-16T13:15:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2023-10-16T13:15:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2023-10-16T13:15:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:33.969 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:33.969 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:33.969 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:33.969 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.969 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-10-16T13:15:33.970 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 0, 2023-10-16T13:15:33.970 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 0, 2023-10-16T13:15:33.970 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2023-10-16T13:15:33.970 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:33.970 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2023-10-16T13:15:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 0, 2023-10-16T13:15:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 0, 2023-10-16T13:15:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 0, 2023-10-16T13:15:33.972 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 0, 2023-10-16T13:15:33.972 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 0, 2023-10-16T13:15:33.972 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 0, 2023-10-16T13:15:33.972 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 1661, 2023-10-16T13:15:33.972 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 371, 2023-10-16T13:15:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 1229, 2023-10-16T13:15:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 61, 2023-10-16T13:15:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 1130, 2023-10-16T13:15:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 4984, 2023-10-16T13:15:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 0, 2023-10-16T13:15:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 0, 2023-10-16T13:15:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 2, 2023-10-16T13:15:33.974 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 0, 2023-10-16T13:15:33.974 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 0, 2023-10-16T13:15:33.974 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 0, 2023-10-16T13:15:33.974 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 0, 2023-10-16T13:15:33.974 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 0, 2023-10-16T13:15:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2023-10-16T13:15:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 0, 2023-10-16T13:15:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 0, 2023-10-16T13:15:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 0, 2023-10-16T13:15:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 0, 2023-10-16T13:15:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 0, 2023-10-16T13:15:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 0, 2023-10-16T13:15:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 0, 2023-10-16T13:15:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2023-10-16T13:15:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 0, 2023-10-16T13:15:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 0, 2023-10-16T13:15:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 4, 2023-10-16T13:15:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 246, 2023-10-16T13:15:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 0, 2023-10-16T13:15:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 0, 2023-10-16T13:15:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2023-10-16T13:15:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2023-10-16T13:15:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2023-10-16T13:15:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 0, 2023-10-16T13:15:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 0, 2023-10-16T13:15:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 0, 2023-10-16T13:15:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 0, 2023-10-16T13:15:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 0, 2023-10-16T13:15:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 0, 2023-10-16T13:15:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 0, 2023-10-16T13:15:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 0, 2023-10-16T13:15:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-16T13:15:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-16T13:15:33.980 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 0, 2023-10-16T13:15:33.980 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 0, 2023-10-16T13:15:33.980 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 0, 2023-10-16T13:15:33.980 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 0 2023-10-16T13:15:33.980 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2023-10-16T13:15:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 0, 2023-10-16T13:15:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 0, 2023-10-16T13:15:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 0, 2023-10-16T13:15:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 0, 2023-10-16T13:15:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 0, 2023-10-16T13:15:33.982 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 0, 2023-10-16T13:15:33.982 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2023-10-16T13:15:33.982 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2023-10-16T13:15:33.982 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 0, 2023-10-16T13:15:33.982 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 0, 2023-10-16T13:15:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 0, 2023-10-16T13:15:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2023-10-16T13:15:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2023-10-16T13:15:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2023-10-16T13:15:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2023-10-16T13:15:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2023-10-16T13:15:33.984 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2023-10-16T13:15:33.984 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 0, 2023-10-16T13:15:33.984 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 0, 2023-10-16T13:15:33.984 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2023-10-16T13:15:33.984 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 0, 2023-10-16T13:15:33.984 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2023-10-16T13:15:33.985 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2023-10-16T13:15:33.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.985 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2023-10-16T13:15:33.985 INFO:teuthology.orchestra.run.smithi152.stdout: "evlrg": 0, 2023-10-16T13:15:33.985 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 0, 2023-10-16T13:15:33.985 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 0, 2023-10-16T13:15:33.986 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 0, 2023-10-16T13:15:33.986 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 37448, 2023-10-16T13:15:33.986 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2023-10-16T13:15:33.986 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 0, 2023-10-16T13:15:33.986 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 0, 2023-10-16T13:15:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 0, 2023-10-16T13:15:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 0, 2023-10-16T13:15:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 3, 2023-10-16T13:15:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: "segmjr": 9, 2023-10-16T13:15:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2023-10-16T13:15:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 0, 2023-10-16T13:15:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 76955197, 2023-10-16T13:15:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 80962514, 2023-10-16T13:15:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 80960011, 2023-10-16T13:15:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2023-10-16T13:15:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 37448 2023-10-16T13:15:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2023-10-16T13:15:33.990 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 29, 2023-10-16T13:15:33.990 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 11672, 2023-10-16T13:15:33.990 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 11643, 2023-10-16T13:15:33.990 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 56, 2023-10-16T13:15:33.990 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 766, 2023-10-16T13:15:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 710, 2023-10-16T13:15:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 1661, 2023-10-16T13:15:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 14525, 2023-10-16T13:15:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 12864, 2023-10-16T13:15:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 0, 2023-10-16T13:15:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 0, 2023-10-16T13:15:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 0, 2023-10-16T13:15:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 63024, 2023-10-16T13:15:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 207152 2023-10-16T13:15:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2023-10-16T13:15:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 0, 2023-10-16T13:15:33.993 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 0, 2023-10-16T13:15:33.993 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 0, 2023-10-16T13:15:33.993 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 0, 2023-10-16T13:15:33.993 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 0, 2023-10-16T13:15:33.993 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2023-10-16T13:15:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2023-10-16T13:15:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2023-10-16T13:15:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:33.996 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:33.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.996 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2023-10-16T13:15:33.996 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:33.996 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2023-10-16T13:15:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:33.998 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.998 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2023-10-16T13:15:33.998 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:33.998 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:33.998 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:33.999 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:33.999 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2023-10-16T13:15:33.999 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:33.999 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:33.999 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.000 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.000 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2023-10-16T13:15:34.000 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.000 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.000 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2023-10-16T13:15:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2023-10-16T13:15:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.003 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2023-10-16T13:15:34.003 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.003 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.003 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.003 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2023-10-16T13:15:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2023-10-16T13:15:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2023-10-16T13:15:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2023-10-16T13:15:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2023-10-16T13:15:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2023-10-16T13:15:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2023-10-16T13:15:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.010 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.010 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2023-10-16T13:15:34.010 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.010 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.010 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2023-10-16T13:15:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.012 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2023-10-16T13:15:34.012 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.012 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.012 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.012 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.013 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2023-10-16T13:15:34.013 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.013 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.013 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.013 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2023-10-16T13:15:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2023-10-16T13:15:34.015 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.015 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.015 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.015 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.015 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2023-10-16T13:15:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2023-10-16T13:15:34.017 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.017 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.017 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.017 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.017 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2023-10-16T13:15:34.017 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2023-10-16T13:15:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2023-10-16T13:15:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.020 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.020 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.020 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2023-10-16T13:15:34.020 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2023-10-16T13:15:34.020 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2023-10-16T13:15:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2023-10-16T13:15:34.022 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 1, 2023-10-16T13:15:34.022 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 2, 2023-10-16T13:15:34.022 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 1, 2023-10-16T13:15:34.022 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 1, 2023-10-16T13:15:34.022 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2023-10-16T13:15:34.023 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 0, 2023-10-16T13:15:34.023 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 0, 2023-10-16T13:15:34.023 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 1550, 2023-10-16T13:15:34.023 INFO:teuthology.orchestra.run.smithi152.stdout: "mdthresh_evicted": 0 2023-10-16T13:15:34.023 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.023 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2023-10-16T13:15:34.024 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2023-10-16T13:15:34.024 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2023-10-16T13:15:34.024 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2023-10-16T13:15:34.024 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2023-10-16T13:15:34.024 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2023-10-16T13:15:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2023-10-16T13:15:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-16T13:15:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2023-10-16T13:15:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-16T13:15:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2023-10-16T13:15:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2023-10-16T13:15:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2023-10-16T13:15:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-16T13:15:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2023-10-16T13:15:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2023-10-16T13:15:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2023-10-16T13:15:34.027 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2023-10-16T13:15:34.027 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2023-10-16T13:15:34.027 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-16T13:15:34.027 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2023-10-16T13:15:34.027 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-16T13:15:34.028 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2023-10-16T13:15:34.028 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2023-10-16T13:15:34.028 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2023-10-16T13:15:34.028 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2023-10-16T13:15:34.028 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2023-10-16T13:15:34.028 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-16T13:15:34.029 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2023-10-16T13:15:34.029 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2023-10-16T13:15:34.029 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2023-10-16T13:15:34.029 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2023-10-16T13:15:34.029 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2023-10-16T13:15:34.029 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2023-10-16T13:15:34.030 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2023-10-16T13:15:34.030 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2023-10-16T13:15:34.030 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2023-10-16T13:15:34.030 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 229843, 2023-10-16T13:15:34.030 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 74, 2023-10-16T13:15:34.031 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2023-10-16T13:15:34.031 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2023-10-16T13:15:34.031 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2023-10-16T13:15:34.031 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2023-10-16T13:15:34.031 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2023-10-16T13:15:34.031 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2023-10-16T13:15:34.032 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2023-10-16T13:15:34.032 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2023-10-16T13:15:34.032 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 7624, 2023-10-16T13:15:34.032 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 160, 2023-10-16T13:15:34.032 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2023-10-16T13:15:34.032 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2023-10-16T13:15:34.033 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2023-10-16T13:15:34.033 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2023-10-16T13:15:34.033 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 1296845, 2023-10-16T13:15:34.033 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 9467, 2023-10-16T13:15:34.033 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2023-10-16T13:15:34.034 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2023-10-16T13:15:34.034 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2023-10-16T13:15:34.034 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2023-10-16T13:15:34.034 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.034 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2023-10-16T13:15:34.034 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2023-10-16T13:15:34.035 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2023-10-16T13:15:34.035 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 839, 2023-10-16T13:15:34.035 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 26, 2023-10-16T13:15:34.035 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 4, 2023-10-16T13:15:34.035 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 839, 2023-10-16T13:15:34.035 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2023-10-16T13:15:34.036 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 839, 2023-10-16T13:15:34.036 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 2.991959801, 2023-10-16T13:15:34.036 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.003566102 2023-10-16T13:15:34.036 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.036 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2023-10-16T13:15:34.036 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2023-10-16T13:15:34.037 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 839, 2023-10-16T13:15:34.037 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 840 2023-10-16T13:15:34.037 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.037 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 839, 2023-10-16T13:15:34.037 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 839, 2023-10-16T13:15:34.038 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 0, 2023-10-16T13:15:34.038 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2023-10-16T13:15:34.038 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2023-10-16T13:15:34.038 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 514, 2023-10-16T13:15:34.038 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 0, 2023-10-16T13:15:34.039 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 322, 2023-10-16T13:15:34.039 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 0, 2023-10-16T13:15:34.039 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 0, 2023-10-16T13:15:34.039 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2023-10-16T13:15:34.039 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2023-10-16T13:15:34.039 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2023-10-16T13:15:34.040 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 0, 2023-10-16T13:15:34.040 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 0, 2023-10-16T13:15:34.040 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2023-10-16T13:15:34.040 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2023-10-16T13:15:34.040 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2023-10-16T13:15:34.040 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 2, 2023-10-16T13:15:34.041 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 0, 2023-10-16T13:15:34.041 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2023-10-16T13:15:34.041 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2023-10-16T13:15:34.041 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2023-10-16T13:15:34.041 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2023-10-16T13:15:34.041 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2023-10-16T13:15:34.042 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2023-10-16T13:15:34.042 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2023-10-16T13:15:34.042 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2023-10-16T13:15:34.042 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2023-10-16T13:15:34.042 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 0, 2023-10-16T13:15:34.043 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2023-10-16T13:15:34.043 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2023-10-16T13:15:34.043 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2023-10-16T13:15:34.043 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2023-10-16T13:15:34.043 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2023-10-16T13:15:34.043 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2023-10-16T13:15:34.044 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2023-10-16T13:15:34.044 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2023-10-16T13:15:34.044 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2023-10-16T13:15:34.044 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2023-10-16T13:15:34.044 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2023-10-16T13:15:34.044 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2023-10-16T13:15:34.045 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2023-10-16T13:15:34.045 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2023-10-16T13:15:34.045 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2023-10-16T13:15:34.045 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2023-10-16T13:15:34.045 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 85, 2023-10-16T13:15:34.045 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2023-10-16T13:15:34.046 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 2, 2023-10-16T13:15:34.046 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 10, 2023-10-16T13:15:34.046 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 10, 2023-10-16T13:15:34.046 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 0, 2023-10-16T13:15:34.046 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2023-10-16T13:15:34.046 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 0, 2023-10-16T13:15:34.047 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 2, 2023-10-16T13:15:34.047 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 0 2023-10-16T13:15:34.047 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.047 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2023-10-16T13:15:34.047 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 0, 2023-10-16T13:15:34.047 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2023-10-16T13:15:34.048 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2023-10-16T13:15:34.048 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2023-10-16T13:15:34.048 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.048 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2023-10-16T13:15:34.048 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 0 2023-10-16T13:15:34.048 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.049 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2023-10-16T13:15:34.049 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2023-10-16T13:15:34.049 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 0, 2023-10-16T13:15:34.049 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2023-10-16T13:15:34.049 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 0, 2023-10-16T13:15:34.049 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 0, 2023-10-16T13:15:34.050 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2023-10-16T13:15:34.050 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.050 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-16T13:15:34.050 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:34.050 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2023-10-16T13:15:34.051 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:34.051 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 941, 2023-10-16T13:15:34.051 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 77457108, 2023-10-16T13:15:34.051 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:34.051 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 941, 2023-10-16T13:15:34.051 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-10-16T13:15:34.052 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-10-16T13:15:34.052 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 941, 2023-10-16T13:15:34.052 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 77457108, 2023-10-16T13:15:34.052 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:34.052 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.052 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.053 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.053 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:34.053 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.053 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2023-10-16T13:15:34.053 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:34.054 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2023-10-16T13:15:34.054 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:34.054 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2023-10-16T13:15:34.054 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2023-10-16T13:15:34.054 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:34.054 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:34.055 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 839, 2023-10-16T13:15:34.055 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 76773383, 2023-10-16T13:15:34.055 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 839, 2023-10-16T13:15:34.055 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 76773383, 2023-10-16T13:15:34.055 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:34.055 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.056 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.056 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.056 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:34.056 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.056 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2023-10-16T13:15:34.056 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:34.057 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2023-10-16T13:15:34.057 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:34.057 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2023-10-16T13:15:34.057 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2023-10-16T13:15:34.057 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:34.058 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:34.058 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 839, 2023-10-16T13:15:34.058 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 839, 2023-10-16T13:15:34.058 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 839, 2023-10-16T13:15:34.058 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 839, 2023-10-16T13:15:34.058 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:34.059 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.059 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.059 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.059 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:34.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.059 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2023-10-16T13:15:34.060 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:34.060 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2023-10-16T13:15:34.060 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:34.060 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2023-10-16T13:15:34.060 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2023-10-16T13:15:34.060 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:34.061 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:34.061 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-10-16T13:15:34.061 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-10-16T13:15:34.061 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 0, 2023-10-16T13:15:34.061 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 0, 2023-10-16T13:15:34.061 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:34.062 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.062 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.062 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.062 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:34.062 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:34.063 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x56311b91e960": { 2023-10-16T13:15:34.063 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:34.063 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2023-10-16T13:15:34.063 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:34.063 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2023-10-16T13:15:34.063 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2023-10-16T13:15:34.064 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:34.064 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:34.064 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-10-16T13:15:34.064 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-10-16T13:15:34.064 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 0, 2023-10-16T13:15:34.064 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 0, 2023-10-16T13:15:34.065 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:34.065 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:34.065 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:34.065 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:34.065 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:34.065 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:34.065 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-10-16T13:15:34.354 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2023-10-16T13:15:34.354 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2023-10-16T13:15:34.354 DEBUG:tasks.check_counter:Getting stats from f 2023-10-16T13:15:34.355 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph daemon mds.f perf dump 2023-10-16T13:15:34.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:34 smithi152 ceph-mon[104423]: pgmap v374: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-16T13:15:34.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:34 smithi092 ceph-mon[99542]: pgmap v374: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-16T13:15:34.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:34 smithi118 ceph-mon[103969]: pgmap v374: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-16T13:15:34.915 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-16T13:15:36.278 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-10-16T13:15:36.279 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2023-10-16T13:15:36.279 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 3346, 2023-10-16T13:15:36.279 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 7940, 2023-10-16T13:15:36.279 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 1195185, 2023-10-16T13:15:36.279 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 8386041, 2023-10-16T13:15:36.280 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 15, 2023-10-16T13:15:36.280 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 3, 2023-10-16T13:15:36.280 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.252947720, 2023-10-16T13:15:36.280 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.118567902, 2023-10-16T13:15:36.280 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.140016722, 2023-10-16T13:15:36.281 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.014245127, 2023-10-16T13:15:36.281 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:36.281 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 7939, 2023-10-16T13:15:36.281 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.655653318, 2023-10-16T13:15:36.281 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000082586 2023-10-16T13:15:36.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.282 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:36.282 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 7805, 2023-10-16T13:15:36.282 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.001151278, 2023-10-16T13:15:36.282 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000147 2023-10-16T13:15:36.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.283 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 1014928, 2023-10-16T13:15:36.283 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 3987312 2023-10-16T13:15:36.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.283 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2023-10-16T13:15:36.283 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 762, 2023-10-16T13:15:36.284 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 815, 2023-10-16T13:15:36.284 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 223033, 2023-10-16T13:15:36.284 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 3876499, 2023-10-16T13:15:36.284 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 16, 2023-10-16T13:15:36.284 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 6, 2023-10-16T13:15:36.285 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.060736034, 2023-10-16T13:15:36.285 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.022494797, 2023-10-16T13:15:36.285 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.017100140, 2023-10-16T13:15:36.285 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.017610297, 2023-10-16T13:15:36.285 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:36.286 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 813, 2023-10-16T13:15:36.286 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.069152722, 2023-10-16T13:15:36.286 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000085058 2023-10-16T13:15:36.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.286 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:36.287 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 52, 2023-10-16T13:15:36.287 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000010162, 2023-10-16T13:15:36.287 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000195 2023-10-16T13:15:36.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.287 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-16T13:15:36.287 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 169568 2023-10-16T13:15:36.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.288 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2023-10-16T13:15:36.288 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 2178, 2023-10-16T13:15:36.288 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 3135, 2023-10-16T13:15:36.288 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 2861242, 2023-10-16T13:15:36.289 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 1348036, 2023-10-16T13:15:36.289 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 10, 2023-10-16T13:15:36.289 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 6, 2023-10-16T13:15:36.289 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.146843341, 2023-10-16T13:15:36.289 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.051552671, 2023-10-16T13:15:36.290 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.109560260, 2023-10-16T13:15:36.290 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.013959276, 2023-10-16T13:15:36.290 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:36.290 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 3134, 2023-10-16T13:15:36.290 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.095470040, 2023-10-16T13:15:36.291 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000030462 2023-10-16T13:15:36.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.291 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:36.291 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 3943, 2023-10-16T13:15:36.291 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000689280, 2023-10-16T13:15:36.291 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000174 2023-10-16T13:15:36.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.292 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 541248, 2023-10-16T13:15:36.292 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 48800 2023-10-16T13:15:36.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.292 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2023-10-16T13:15:36.293 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2023-10-16T13:15:36.293 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2023-10-16T13:15:36.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.293 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2023-10-16T13:15:36.293 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2023-10-16T13:15:36.294 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2023-10-16T13:15:36.294 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 395, 2023-10-16T13:15:36.294 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.216422135, 2023-10-16T13:15:36.294 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.003079549 2023-10-16T13:15:36.294 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:36.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.295 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2023-10-16T13:15:36.295 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2023-10-16T13:15:36.295 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2023-10-16T13:15:36.295 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2569, 2023-10-16T13:15:36.295 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.220301242, 2023-10-16T13:15:36.296 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000085753 2023-10-16T13:15:36.296 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:36.296 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.296 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-10-16T13:15:36.296 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 2072, 2023-10-16T13:15:36.296 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 2071, 2023-10-16T13:15:36.297 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2023-10-16T13:15:36.297 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2071, 2023-10-16T13:15:36.297 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 3.165899832, 2023-10-16T13:15:36.297 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001528681 2023-10-16T13:15:36.297 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.298 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2023-10-16T13:15:36.298 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 1, 2023-10-16T13:15:36.298 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 0, 2023-10-16T13:15:36.298 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 0, 2023-10-16T13:15:36.298 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 11, 2023-10-16T13:15:36.299 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 0, 2023-10-16T13:15:36.299 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 0, 2023-10-16T13:15:36.299 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 16, 2023-10-16T13:15:36.299 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 1, 2023-10-16T13:15:36.299 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 2, 2023-10-16T13:15:36.300 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 13, 2023-10-16T13:15:36.300 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 13, 2023-10-16T13:15:36.300 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 140, 2023-10-16T13:15:36.300 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 0, 2023-10-16T13:15:36.300 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 0, 2023-10-16T13:15:36.301 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 3, 2023-10-16T13:15:36.301 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 2688, 2023-10-16T13:15:36.301 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 2590, 2023-10-16T13:15:36.301 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 0, 2023-10-16T13:15:36.301 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 9, 2023-10-16T13:15:36.301 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 0, 2023-10-16T13:15:36.302 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2023-10-16T13:15:36.302 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 0, 2023-10-16T13:15:36.302 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 1000, 2023-10-16T13:15:36.302 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 1, 2023-10-16T13:15:36.302 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 12, 2023-10-16T13:15:36.302 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 100, 2023-10-16T13:15:36.303 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 12, 2023-10-16T13:15:36.303 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 1473, 2023-10-16T13:15:36.303 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2023-10-16T13:15:36.303 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 0, 2023-10-16T13:15:36.303 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 1, 2023-10-16T13:15:36.304 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 3619, 2023-10-16T13:15:36.304 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 18416957, 2023-10-16T13:15:36.304 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 0, 2023-10-16T13:15:36.304 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 0, 2023-10-16T13:15:36.304 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2023-10-16T13:15:36.305 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2023-10-16T13:15:36.305 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2023-10-16T13:15:36.305 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 0, 2023-10-16T13:15:36.305 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 0, 2023-10-16T13:15:36.305 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 0, 2023-10-16T13:15:36.305 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 0, 2023-10-16T13:15:36.306 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 0, 2023-10-16T13:15:36.306 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 314, 2023-10-16T13:15:36.306 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 1656, 2023-10-16T13:15:36.306 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 0, 2023-10-16T13:15:36.306 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-16T13:15:36.307 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-16T13:15:36.307 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 660, 2023-10-16T13:15:36.307 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 352, 2023-10-16T13:15:36.307 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 14, 2023-10-16T13:15:36.307 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 2070 2023-10-16T13:15:36.307 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.308 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2023-10-16T13:15:36.308 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 0, 2023-10-16T13:15:36.308 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 0, 2023-10-16T13:15:36.308 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 0, 2023-10-16T13:15:36.308 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 9, 2023-10-16T13:15:36.309 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 0, 2023-10-16T13:15:36.309 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 0, 2023-10-16T13:15:36.309 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2023-10-16T13:15:36.309 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2023-10-16T13:15:36.309 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 1473, 2023-10-16T13:15:36.310 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 1473, 2023-10-16T13:15:36.310 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 0, 2023-10-16T13:15:36.310 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2023-10-16T13:15:36.310 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2023-10-16T13:15:36.310 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2023-10-16T13:15:36.310 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2023-10-16T13:15:36.311 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2023-10-16T13:15:36.311 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2023-10-16T13:15:36.311 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 0, 2023-10-16T13:15:36.311 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 12, 2023-10-16T13:15:36.311 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2023-10-16T13:15:36.312 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 0, 2023-10-16T13:15:36.312 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2023-10-16T13:15:36.312 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2023-10-16T13:15:36.312 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.312 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2023-10-16T13:15:36.312 INFO:teuthology.orchestra.run.smithi152.stdout: "evlrg": 0, 2023-10-16T13:15:36.313 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 4120, 2023-10-16T13:15:36.313 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 0, 2023-10-16T13:15:36.313 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 0, 2023-10-16T13:15:36.313 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 4120, 2023-10-16T13:15:36.313 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2023-10-16T13:15:36.314 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 0, 2023-10-16T13:15:36.314 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 6, 2023-10-16T13:15:36.314 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 0, 2023-10-16T13:15:36.314 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 0, 2023-10-16T13:15:36.314 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 6, 2023-10-16T13:15:36.315 INFO:teuthology.orchestra.run.smithi152.stdout: "segmjr": 2, 2023-10-16T13:15:36.315 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2023-10-16T13:15:36.315 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 0, 2023-10-16T13:15:36.315 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 4194304, 2023-10-16T13:15:36.315 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 12045192, 2023-10-16T13:15:36.315 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 0, 2023-10-16T13:15:36.316 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2023-10-16T13:15:36.316 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 169, 2023-10-16T13:15:36.316 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.364306886, 2023-10-16T13:15:36.316 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002155662 2023-10-16T13:15:36.316 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.316 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 0 2023-10-16T13:15:36.317 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.317 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2023-10-16T13:15:36.317 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 20, 2023-10-16T13:15:36.317 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 1515, 2023-10-16T13:15:36.317 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 1495, 2023-10-16T13:15:36.318 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 19, 2023-10-16T13:15:36.318 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 159, 2023-10-16T13:15:36.318 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 140, 2023-10-16T13:15:36.318 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 16, 2023-10-16T13:15:36.318 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 3002, 2023-10-16T13:15:36.319 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 2986, 2023-10-16T13:15:36.319 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 0, 2023-10-16T13:15:36.319 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 1483, 2023-10-16T13:15:36.319 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 1483, 2023-10-16T13:15:36.319 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 59232, 2023-10-16T13:15:36.319 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 198960 2023-10-16T13:15:36.320 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.320 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2023-10-16T13:15:36.320 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 2616, 2023-10-16T13:15:36.320 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 10, 2023-10-16T13:15:36.321 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 2072, 2023-10-16T13:15:36.321 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 6, 2023-10-16T13:15:36.321 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 37, 2023-10-16T13:15:36.321 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2023-10-16T13:15:36.321 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.322 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.322 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.322 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.322 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2023-10-16T13:15:36.322 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.323 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.323 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.323 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.323 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2023-10-16T13:15:36.323 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.324 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.324 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.324 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.324 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2023-10-16T13:15:36.324 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.325 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.325 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.325 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.325 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2023-10-16T13:15:36.325 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 509, 2023-10-16T13:15:36.325 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.156965524, 2023-10-16T13:15:36.326 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000308380 2023-10-16T13:15:36.326 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.326 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2023-10-16T13:15:36.326 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.326 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.327 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.327 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.327 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2023-10-16T13:15:36.327 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.327 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.327 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.328 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.328 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2023-10-16T13:15:36.328 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.328 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.328 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.329 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.329 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2023-10-16T13:15:36.329 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.329 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.329 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.329 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.330 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2023-10-16T13:15:36.330 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.330 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.330 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.330 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.331 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2023-10-16T13:15:36.331 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.331 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.331 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.331 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.332 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2023-10-16T13:15:36.332 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.332 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.332 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.332 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.332 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2023-10-16T13:15:36.333 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.333 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.333 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.333 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.333 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2023-10-16T13:15:36.333 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.334 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.334 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.334 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.334 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2023-10-16T13:15:36.334 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.335 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.335 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.335 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.335 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2023-10-16T13:15:36.335 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 89, 2023-10-16T13:15:36.335 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.054998095, 2023-10-16T13:15:36.336 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000617956 2023-10-16T13:15:36.336 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.336 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2023-10-16T13:15:36.336 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.336 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.336 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.337 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.337 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2023-10-16T13:15:36.337 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.337 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.337 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.337 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.338 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2023-10-16T13:15:36.338 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.338 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.338 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.338 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.338 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2023-10-16T13:15:36.339 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 98, 2023-10-16T13:15:36.339 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.362392470, 2023-10-16T13:15:36.339 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.013901963 2023-10-16T13:15:36.339 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.339 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2023-10-16T13:15:36.340 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.340 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.340 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.340 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.340 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2023-10-16T13:15:36.340 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.341 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.341 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.341 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.341 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2023-10-16T13:15:36.341 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.342 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.342 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.342 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.342 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2023-10-16T13:15:36.342 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.342 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.343 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.343 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.343 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2023-10-16T13:15:36.343 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.343 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.343 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.344 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2023-10-16T13:15:36.344 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.344 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.344 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.345 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2023-10-16T13:15:36.345 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.345 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.345 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.345 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.346 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2023-10-16T13:15:36.346 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.346 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.346 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.346 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.347 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2023-10-16T13:15:36.347 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1375, 2023-10-16T13:15:36.347 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.591543743, 2023-10-16T13:15:36.347 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001157486 2023-10-16T13:15:36.347 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.347 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2023-10-16T13:15:36.348 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2023-10-16T13:15:36.348 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2023-10-16T13:15:36.348 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.348 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.348 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.348 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:36.349 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.349 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2023-10-16T13:15:36.349 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 1, 2023-10-16T13:15:36.349 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 2, 2023-10-16T13:15:36.349 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 1, 2023-10-16T13:15:36.349 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 1, 2023-10-16T13:15:36.350 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2023-10-16T13:15:36.350 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 1751, 2023-10-16T13:15:36.350 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 1751, 2023-10-16T13:15:36.350 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 136, 2023-10-16T13:15:36.350 INFO:teuthology.orchestra.run.smithi152.stdout: "mdthresh_evicted": 0 2023-10-16T13:15:36.351 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.351 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2023-10-16T13:15:36.351 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2023-10-16T13:15:36.351 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2023-10-16T13:15:36.351 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2023-10-16T13:15:36.352 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2023-10-16T13:15:36.352 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2023-10-16T13:15:36.352 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2023-10-16T13:15:36.352 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-16T13:15:36.352 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2023-10-16T13:15:36.352 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-16T13:15:36.353 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2023-10-16T13:15:36.353 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2023-10-16T13:15:36.353 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2023-10-16T13:15:36.353 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-16T13:15:36.353 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2023-10-16T13:15:36.354 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2023-10-16T13:15:36.354 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2023-10-16T13:15:36.354 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2023-10-16T13:15:36.354 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2023-10-16T13:15:36.354 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-16T13:15:36.355 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2023-10-16T13:15:36.355 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-16T13:15:36.355 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2023-10-16T13:15:36.355 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2023-10-16T13:15:36.355 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2023-10-16T13:15:36.355 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2023-10-16T13:15:36.356 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2023-10-16T13:15:36.356 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-16T13:15:36.356 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2023-10-16T13:15:36.356 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2023-10-16T13:15:36.356 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2023-10-16T13:15:36.357 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2023-10-16T13:15:36.357 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2023-10-16T13:15:36.357 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2023-10-16T13:15:36.357 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2023-10-16T13:15:36.357 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2023-10-16T13:15:36.357 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2023-10-16T13:15:36.358 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 314887, 2023-10-16T13:15:36.358 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 123, 2023-10-16T13:15:36.358 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2023-10-16T13:15:36.358 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2023-10-16T13:15:36.358 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2023-10-16T13:15:36.359 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2023-10-16T13:15:36.359 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2023-10-16T13:15:36.359 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2023-10-16T13:15:36.359 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2023-10-16T13:15:36.359 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2023-10-16T13:15:36.360 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 7624, 2023-10-16T13:15:36.360 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 160, 2023-10-16T13:15:36.360 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2023-10-16T13:15:36.360 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2023-10-16T13:15:36.360 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2023-10-16T13:15:36.361 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2023-10-16T13:15:36.361 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 80133, 2023-10-16T13:15:36.361 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 367, 2023-10-16T13:15:36.361 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2023-10-16T13:15:36.361 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2023-10-16T13:15:36.361 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2023-10-16T13:15:36.362 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2023-10-16T13:15:36.362 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.362 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2023-10-16T13:15:36.362 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2023-10-16T13:15:36.362 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2023-10-16T13:15:36.363 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 1795, 2023-10-16T13:15:36.363 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 8087896, 2023-10-16T13:15:36.363 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 33, 2023-10-16T13:15:36.363 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 1795, 2023-10-16T13:15:36.363 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2023-10-16T13:15:36.364 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1795, 2023-10-16T13:15:36.364 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 4.269942392, 2023-10-16T13:15:36.364 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002378797 2023-10-16T13:15:36.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.364 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2023-10-16T13:15:36.364 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2023-10-16T13:15:36.365 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1795, 2023-10-16T13:15:36.365 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1830 2023-10-16T13:15:36.365 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.365 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 1795, 2023-10-16T13:15:36.365 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 38, 2023-10-16T13:15:36.366 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 1757, 2023-10-16T13:15:36.366 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2023-10-16T13:15:36.366 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2023-10-16T13:15:36.366 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 0, 2023-10-16T13:15:36.366 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 10, 2023-10-16T13:15:36.366 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 38, 2023-10-16T13:15:36.367 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 207, 2023-10-16T13:15:36.367 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 25, 2023-10-16T13:15:36.367 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2023-10-16T13:15:36.367 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2023-10-16T13:15:36.367 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2023-10-16T13:15:36.368 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 0, 2023-10-16T13:15:36.368 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 1494, 2023-10-16T13:15:36.368 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2023-10-16T13:15:36.368 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2023-10-16T13:15:36.368 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2023-10-16T13:15:36.368 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 0, 2023-10-16T13:15:36.369 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 20, 2023-10-16T13:15:36.369 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2023-10-16T13:15:36.369 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2023-10-16T13:15:36.369 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2023-10-16T13:15:36.369 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2023-10-16T13:15:36.370 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2023-10-16T13:15:36.370 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2023-10-16T13:15:36.370 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2023-10-16T13:15:36.370 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2023-10-16T13:15:36.370 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2023-10-16T13:15:36.371 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 0, 2023-10-16T13:15:36.371 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2023-10-16T13:15:36.371 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2023-10-16T13:15:36.371 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2023-10-16T13:15:36.371 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2023-10-16T13:15:36.371 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2023-10-16T13:15:36.372 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2023-10-16T13:15:36.372 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2023-10-16T13:15:36.372 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2023-10-16T13:15:36.372 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2023-10-16T13:15:36.372 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2023-10-16T13:15:36.373 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2023-10-16T13:15:36.373 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2023-10-16T13:15:36.373 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2023-10-16T13:15:36.373 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2023-10-16T13:15:36.373 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2023-10-16T13:15:36.373 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2023-10-16T13:15:36.374 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 85, 2023-10-16T13:15:36.374 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2023-10-16T13:15:36.374 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 2, 2023-10-16T13:15:36.374 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 12, 2023-10-16T13:15:36.374 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 12, 2023-10-16T13:15:36.374 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 0, 2023-10-16T13:15:36.375 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2023-10-16T13:15:36.375 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 29, 2023-10-16T13:15:36.375 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 0, 2023-10-16T13:15:36.375 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 7 2023-10-16T13:15:36.375 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.376 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2023-10-16T13:15:36.376 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 1, 2023-10-16T13:15:36.376 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2023-10-16T13:15:36.376 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2023-10-16T13:15:36.376 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2023-10-16T13:15:36.376 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.377 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2023-10-16T13:15:36.377 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 0 2023-10-16T13:15:36.377 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.377 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2023-10-16T13:15:36.377 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2023-10-16T13:15:36.378 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 14, 2023-10-16T13:15:36.378 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2023-10-16T13:15:36.378 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 6, 2023-10-16T13:15:36.378 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 1473, 2023-10-16T13:15:36.378 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2023-10-16T13:15:36.379 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.379 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-16T13:15:36.379 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:36.379 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2023-10-16T13:15:36.379 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:36.379 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 6282, 2023-10-16T13:15:36.380 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 3582835, 2023-10-16T13:15:36.380 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:36.380 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 6282, 2023-10-16T13:15:36.380 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-10-16T13:15:36.380 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-10-16T13:15:36.381 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 6282, 2023-10-16T13:15:36.381 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 3582835, 2023-10-16T13:15:36.381 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:36.381 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.381 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.382 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.382 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:36.382 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.382 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2023-10-16T13:15:36.382 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:36.382 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2023-10-16T13:15:36.383 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:36.383 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2023-10-16T13:15:36.383 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2023-10-16T13:15:36.383 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:36.383 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:36.384 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 1795, 2023-10-16T13:15:36.384 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 8236677, 2023-10-16T13:15:36.384 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 1795, 2023-10-16T13:15:36.384 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 8236677, 2023-10-16T13:15:36.384 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:36.384 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.385 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.385 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.385 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:36.385 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.385 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2023-10-16T13:15:36.386 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:36.386 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2023-10-16T13:15:36.386 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:36.386 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2023-10-16T13:15:36.386 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2023-10-16T13:15:36.387 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:36.387 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:36.387 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 1795, 2023-10-16T13:15:36.387 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 1795, 2023-10-16T13:15:36.387 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 1795, 2023-10-16T13:15:36.387 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 1795, 2023-10-16T13:15:36.388 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:36.388 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.388 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.388 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.388 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:36.389 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.389 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2023-10-16T13:15:36.389 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:36.389 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2023-10-16T13:15:36.389 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:36.390 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 1473, 2023-10-16T13:15:36.390 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 148781, 2023-10-16T13:15:36.390 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:36.390 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 1473, 2023-10-16T13:15:36.390 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-10-16T13:15:36.391 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-10-16T13:15:36.391 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 38, 2023-10-16T13:15:36.391 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 148781, 2023-10-16T13:15:36.391 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:36.391 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.391 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.392 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.392 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:36.392 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:36.392 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x561d644666e0": { 2023-10-16T13:15:36.392 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:36.393 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2023-10-16T13:15:36.393 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:36.393 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 4120, 2023-10-16T13:15:36.393 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 7850888, 2023-10-16T13:15:36.393 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:36.394 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 4120, 2023-10-16T13:15:36.394 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-10-16T13:15:36.394 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-10-16T13:15:36.394 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 169, 2023-10-16T13:15:36.394 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 7850888, 2023-10-16T13:15:36.394 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:36.395 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:36.395 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:36.395 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:36.395 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:36.395 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:36.396 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-10-16T13:15:36.664 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:36 smithi152 ceph-mon[104423]: pgmap v375: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-16T13:15:36.669 INFO:tasks.check_counter:Daemon mds.f mds.exported=12 2023-10-16T13:15:36.669 INFO:tasks.check_counter:Daemon mds.f mds.imported=12 2023-10-16T13:15:36.669 DEBUG:tasks.check_counter:Getting stats from i 2023-10-16T13:15:36.670 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph daemon mds.i perf dump 2023-10-16T13:15:36.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:36 smithi092 ceph-mon[99542]: pgmap v375: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-16T13:15:36.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:36 smithi118 ceph-mon[103969]: pgmap v375: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-16T13:15:37.225 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-16T13:15:38.601 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-10-16T13:15:38.601 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2023-10-16T13:15:38.601 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 2800, 2023-10-16T13:15:38.602 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 3178, 2023-10-16T13:15:38.602 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 3212920, 2023-10-16T13:15:38.602 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 13872719, 2023-10-16T13:15:38.602 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 10, 2023-10-16T13:15:38.602 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 4, 2023-10-16T13:15:38.603 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.200494882, 2023-10-16T13:15:38.603 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.078733279, 2023-10-16T13:15:38.603 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.091499782, 2023-10-16T13:15:38.603 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.029950777, 2023-10-16T13:15:38.603 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:38.603 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 3178, 2023-10-16T13:15:38.604 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.185848318, 2023-10-16T13:15:38.604 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000058479 2023-10-16T13:15:38.604 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.604 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:38.604 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 3560, 2023-10-16T13:15:38.605 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000569719, 2023-10-16T13:15:38.605 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000160 2023-10-16T13:15:38.605 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.605 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-16T13:15:38.605 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 0 2023-10-16T13:15:38.605 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.606 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2023-10-16T13:15:38.606 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 1762, 2023-10-16T13:15:38.606 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 1742, 2023-10-16T13:15:38.606 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 1035530, 2023-10-16T13:15:38.606 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 858147, 2023-10-16T13:15:38.607 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 11, 2023-10-16T13:15:38.607 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 6, 2023-10-16T13:15:38.607 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.109054703, 2023-10-16T13:15:38.607 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.034483610, 2023-10-16T13:15:38.607 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.038537216, 2023-10-16T13:15:38.607 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.033715225, 2023-10-16T13:15:38.608 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:38.608 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1742, 2023-10-16T13:15:38.608 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.134249119, 2023-10-16T13:15:38.608 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000077066 2023-10-16T13:15:38.608 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.608 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:38.609 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 57, 2023-10-16T13:15:38.609 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000011752, 2023-10-16T13:15:38.609 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000206 2023-10-16T13:15:38.609 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.609 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 550208, 2023-10-16T13:15:38.609 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 81152 2023-10-16T13:15:38.610 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.610 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2023-10-16T13:15:38.610 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 6375, 2023-10-16T13:15:38.610 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 13685, 2023-10-16T13:15:38.611 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 2472305, 2023-10-16T13:15:38.611 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 8992716, 2023-10-16T13:15:38.611 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 20, 2023-10-16T13:15:38.611 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 8, 2023-10-16T13:15:38.611 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.435091201, 2023-10-16T13:15:38.612 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.201915063, 2023-10-16T13:15:38.612 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.309483000, 2023-10-16T13:15:38.612 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.027144227, 2023-10-16T13:15:38.612 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:38.612 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 13681, 2023-10-16T13:15:38.612 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 4.301876044, 2023-10-16T13:15:38.613 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000314441 2023-10-16T13:15:38.613 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.613 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:38.613 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 13765, 2023-10-16T13:15:38.613 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.002151807, 2023-10-16T13:15:38.613 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000156 2023-10-16T13:15:38.614 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.614 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 1892560, 2023-10-16T13:15:38.614 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 6639128 2023-10-16T13:15:38.614 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.614 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2023-10-16T13:15:38.615 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2023-10-16T13:15:38.615 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2023-10-16T13:15:38.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.615 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2023-10-16T13:15:38.615 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2023-10-16T13:15:38.616 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2023-10-16T13:15:38.616 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1066, 2023-10-16T13:15:38.616 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 3.096797735, 2023-10-16T13:15:38.616 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002905063 2023-10-16T13:15:38.616 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:38.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.617 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2023-10-16T13:15:38.617 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2023-10-16T13:15:38.617 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2023-10-16T13:15:38.617 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 4045, 2023-10-16T13:15:38.617 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.620696399, 2023-10-16T13:15:38.618 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000153447 2023-10-16T13:15:38.618 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:38.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.618 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-10-16T13:15:38.618 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 3064, 2023-10-16T13:15:38.619 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 3062, 2023-10-16T13:15:38.619 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2023-10-16T13:15:38.619 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 3062, 2023-10-16T13:15:38.619 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 5.644901235, 2023-10-16T13:15:38.619 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001843534 2023-10-16T13:15:38.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.620 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2023-10-16T13:15:38.620 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 2, 2023-10-16T13:15:38.620 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 0, 2023-10-16T13:15:38.620 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 0, 2023-10-16T13:15:38.621 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 20, 2023-10-16T13:15:38.621 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 1, 2023-10-16T13:15:38.621 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 0, 2023-10-16T13:15:38.621 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 16, 2023-10-16T13:15:38.621 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 1, 2023-10-16T13:15:38.622 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 2, 2023-10-16T13:15:38.622 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 13, 2023-10-16T13:15:38.622 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 13, 2023-10-16T13:15:38.622 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 234, 2023-10-16T13:15:38.622 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 0, 2023-10-16T13:15:38.623 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 0, 2023-10-16T13:15:38.623 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 3, 2023-10-16T13:15:38.623 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 3692, 2023-10-16T13:15:38.623 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 3591, 2023-10-16T13:15:38.623 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 0, 2023-10-16T13:15:38.624 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 10, 2023-10-16T13:15:38.624 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 0, 2023-10-16T13:15:38.624 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2023-10-16T13:15:38.624 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 0, 2023-10-16T13:15:38.624 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 1000, 2023-10-16T13:15:38.624 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 1, 2023-10-16T13:15:38.625 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 17, 2023-10-16T13:15:38.625 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 190, 2023-10-16T13:15:38.625 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 10, 2023-10-16T13:15:38.625 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 2193, 2023-10-16T13:15:38.625 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2023-10-16T13:15:38.626 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 1204, 2023-10-16T13:15:38.626 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 0, 2023-10-16T13:15:38.626 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 3619, 2023-10-16T13:15:38.626 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 18416957, 2023-10-16T13:15:38.626 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 0, 2023-10-16T13:15:38.627 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 1204, 2023-10-16T13:15:38.627 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2023-10-16T13:15:38.627 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2023-10-16T13:15:38.627 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2023-10-16T13:15:38.627 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 62, 2023-10-16T13:15:38.628 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 0, 2023-10-16T13:15:38.628 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 62, 2023-10-16T13:15:38.628 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 1142, 2023-10-16T13:15:38.628 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 0, 2023-10-16T13:15:38.628 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 411, 2023-10-16T13:15:38.628 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 2716, 2023-10-16T13:15:38.629 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 0, 2023-10-16T13:15:38.629 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-16T13:15:38.629 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-16T13:15:38.629 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 1996, 2023-10-16T13:15:38.629 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 1590, 2023-10-16T13:15:38.630 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 75, 2023-10-16T13:15:38.630 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 2961 2023-10-16T13:15:38.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.630 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2023-10-16T13:15:38.630 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 0, 2023-10-16T13:15:38.631 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 0, 2023-10-16T13:15:38.631 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 0, 2023-10-16T13:15:38.631 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 9, 2023-10-16T13:15:38.631 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 0, 2023-10-16T13:15:38.631 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 0, 2023-10-16T13:15:38.632 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2023-10-16T13:15:38.632 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2023-10-16T13:15:38.632 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 2305, 2023-10-16T13:15:38.632 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 2305, 2023-10-16T13:15:38.632 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 0, 2023-10-16T13:15:38.632 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2023-10-16T13:15:38.633 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2023-10-16T13:15:38.633 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2023-10-16T13:15:38.633 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2023-10-16T13:15:38.633 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2023-10-16T13:15:38.633 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2023-10-16T13:15:38.633 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 0, 2023-10-16T13:15:38.634 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 17, 2023-10-16T13:15:38.634 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2023-10-16T13:15:38.634 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 1, 2023-10-16T13:15:38.634 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2023-10-16T13:15:38.634 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2023-10-16T13:15:38.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.635 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2023-10-16T13:15:38.635 INFO:teuthology.orchestra.run.smithi152.stdout: "evlrg": 0, 2023-10-16T13:15:38.635 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 6810, 2023-10-16T13:15:38.635 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 0, 2023-10-16T13:15:38.635 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 0, 2023-10-16T13:15:38.636 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 6810, 2023-10-16T13:15:38.636 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2023-10-16T13:15:38.636 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 0, 2023-10-16T13:15:38.636 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 10, 2023-10-16T13:15:38.636 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 0, 2023-10-16T13:15:38.636 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 0, 2023-10-16T13:15:38.637 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 10, 2023-10-16T13:15:38.637 INFO:teuthology.orchestra.run.smithi152.stdout: "segmjr": 2, 2023-10-16T13:15:38.637 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2023-10-16T13:15:38.637 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 0, 2023-10-16T13:15:38.637 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 4194304, 2023-10-16T13:15:38.637 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 18270270, 2023-10-16T13:15:38.638 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 0, 2023-10-16T13:15:38.638 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2023-10-16T13:15:38.638 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 218, 2023-10-16T13:15:38.638 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.339652549, 2023-10-16T13:15:38.638 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.006145195 2023-10-16T13:15:38.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.639 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 0 2023-10-16T13:15:38.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.639 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2023-10-16T13:15:38.639 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 20, 2023-10-16T13:15:38.639 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 2353, 2023-10-16T13:15:38.640 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 2333, 2023-10-16T13:15:38.640 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 19, 2023-10-16T13:15:38.640 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 218, 2023-10-16T13:15:38.640 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 199, 2023-10-16T13:15:38.640 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 16, 2023-10-16T13:15:38.641 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 4558, 2023-10-16T13:15:38.641 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 4542, 2023-10-16T13:15:38.641 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 0, 2023-10-16T13:15:38.641 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 2314, 2023-10-16T13:15:38.641 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 2314, 2023-10-16T13:15:38.641 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 73276, 2023-10-16T13:15:38.642 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 198960 2023-10-16T13:15:38.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.642 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2023-10-16T13:15:38.642 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 3736, 2023-10-16T13:15:38.642 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 8, 2023-10-16T13:15:38.643 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 3064, 2023-10-16T13:15:38.643 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 6, 2023-10-16T13:15:38.643 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 34, 2023-10-16T13:15:38.643 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2023-10-16T13:15:38.643 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 112, 2023-10-16T13:15:38.644 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.287900160, 2023-10-16T13:15:38.644 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002570537 2023-10-16T13:15:38.644 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.644 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2023-10-16T13:15:38.644 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1, 2023-10-16T13:15:38.644 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000177547, 2023-10-16T13:15:38.645 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000177547 2023-10-16T13:15:38.645 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.645 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2023-10-16T13:15:38.645 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.645 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.645 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.646 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2023-10-16T13:15:38.646 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.646 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.646 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.647 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2023-10-16T13:15:38.647 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 520, 2023-10-16T13:15:38.647 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.237236586, 2023-10-16T13:15:38.647 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000456224 2023-10-16T13:15:38.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.648 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2023-10-16T13:15:38.648 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.648 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.648 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.649 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2023-10-16T13:15:38.649 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.649 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.649 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.649 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2023-10-16T13:15:38.650 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.650 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.650 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.650 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.651 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2023-10-16T13:15:38.651 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.651 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.651 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.652 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2023-10-16T13:15:38.652 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.652 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.652 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.652 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2023-10-16T13:15:38.653 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.653 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.653 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.653 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2023-10-16T13:15:38.654 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.654 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.654 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.654 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2023-10-16T13:15:38.655 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.655 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.655 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.655 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.655 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2023-10-16T13:15:38.655 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.656 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.656 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.656 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2023-10-16T13:15:38.656 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.657 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.657 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.657 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2023-10-16T13:15:38.657 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 124, 2023-10-16T13:15:38.657 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.096332201, 2023-10-16T13:15:38.658 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000776872 2023-10-16T13:15:38.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.658 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2023-10-16T13:15:38.658 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.658 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.659 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.659 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2023-10-16T13:15:38.659 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.659 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.660 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.660 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.660 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2023-10-16T13:15:38.660 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.660 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.660 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.661 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2023-10-16T13:15:38.661 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 122, 2023-10-16T13:15:38.661 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 2.048553423, 2023-10-16T13:15:38.661 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.016791421 2023-10-16T13:15:38.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.662 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2023-10-16T13:15:38.662 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.662 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.662 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.663 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2023-10-16T13:15:38.663 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.663 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.663 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.664 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2023-10-16T13:15:38.664 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.664 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.664 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.664 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.664 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2023-10-16T13:15:38.665 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.665 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.665 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.665 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.665 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2023-10-16T13:15:38.666 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.666 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.666 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.666 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2023-10-16T13:15:38.666 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.667 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.667 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.667 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2023-10-16T13:15:38.667 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.667 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.668 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.668 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.668 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2023-10-16T13:15:38.668 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.668 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.668 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.669 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2023-10-16T13:15:38.669 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2183, 2023-10-16T13:15:38.669 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 2.974701318, 2023-10-16T13:15:38.669 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001362666 2023-10-16T13:15:38.670 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.670 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2023-10-16T13:15:38.670 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2023-10-16T13:15:38.670 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2023-10-16T13:15:38.670 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.671 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.671 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.671 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:38.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.671 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2023-10-16T13:15:38.671 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 1, 2023-10-16T13:15:38.672 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 2, 2023-10-16T13:15:38.672 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 1, 2023-10-16T13:15:38.672 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 1, 2023-10-16T13:15:38.672 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2023-10-16T13:15:38.672 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 2582, 2023-10-16T13:15:38.672 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 2582, 2023-10-16T13:15:38.673 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 1554, 2023-10-16T13:15:38.673 INFO:teuthology.orchestra.run.smithi152.stdout: "mdthresh_evicted": 0 2023-10-16T13:15:38.673 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.673 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2023-10-16T13:15:38.673 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2023-10-16T13:15:38.673 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2023-10-16T13:15:38.674 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2023-10-16T13:15:38.674 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2023-10-16T13:15:38.674 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2023-10-16T13:15:38.674 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2023-10-16T13:15:38.674 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-16T13:15:38.674 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2023-10-16T13:15:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-16T13:15:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2023-10-16T13:15:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2023-10-16T13:15:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2023-10-16T13:15:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-16T13:15:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2023-10-16T13:15:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2023-10-16T13:15:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2023-10-16T13:15:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2023-10-16T13:15:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2023-10-16T13:15:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-16T13:15:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2023-10-16T13:15:38.677 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-16T13:15:38.677 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2023-10-16T13:15:38.677 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2023-10-16T13:15:38.677 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2023-10-16T13:15:38.677 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2023-10-16T13:15:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2023-10-16T13:15:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-16T13:15:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2023-10-16T13:15:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2023-10-16T13:15:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2023-10-16T13:15:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2023-10-16T13:15:38.679 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2023-10-16T13:15:38.679 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2023-10-16T13:15:38.679 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2023-10-16T13:15:38.679 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2023-10-16T13:15:38.679 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2023-10-16T13:15:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 298695, 2023-10-16T13:15:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 117, 2023-10-16T13:15:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2023-10-16T13:15:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2023-10-16T13:15:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2023-10-16T13:15:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2023-10-16T13:15:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2023-10-16T13:15:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2023-10-16T13:15:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2023-10-16T13:15:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2023-10-16T13:15:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 7624, 2023-10-16T13:15:38.682 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 160, 2023-10-16T13:15:38.682 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2023-10-16T13:15:38.682 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2023-10-16T13:15:38.682 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2023-10-16T13:15:38.682 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2023-10-16T13:15:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 80661, 2023-10-16T13:15:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 397, 2023-10-16T13:15:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2023-10-16T13:15:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2023-10-16T13:15:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2023-10-16T13:15:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2023-10-16T13:15:38.684 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.684 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2023-10-16T13:15:38.684 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2023-10-16T13:15:38.684 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2023-10-16T13:15:38.684 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 3944, 2023-10-16T13:15:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 14687700, 2023-10-16T13:15:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 27, 2023-10-16T13:15:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 3944, 2023-10-16T13:15:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2023-10-16T13:15:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 3944, 2023-10-16T13:15:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 11.024851055, 2023-10-16T13:15:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002795347 2023-10-16T13:15:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2023-10-16T13:15:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2023-10-16T13:15:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 3944, 2023-10-16T13:15:38.687 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 3993 2023-10-16T13:15:38.687 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.687 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 3944, 2023-10-16T13:15:38.687 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 1254, 2023-10-16T13:15:38.687 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 2690, 2023-10-16T13:15:38.688 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2023-10-16T13:15:38.688 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2023-10-16T13:15:38.688 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 0, 2023-10-16T13:15:38.688 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 10, 2023-10-16T13:15:38.688 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 50, 2023-10-16T13:15:38.689 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 268, 2023-10-16T13:15:38.689 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 27, 2023-10-16T13:15:38.689 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2023-10-16T13:15:38.689 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2023-10-16T13:15:38.689 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2023-10-16T13:15:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 1, 2023-10-16T13:15:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 2352, 2023-10-16T13:15:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2023-10-16T13:15:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2023-10-16T13:15:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2023-10-16T13:15:38.691 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 1204, 2023-10-16T13:15:38.691 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 20, 2023-10-16T13:15:38.691 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2023-10-16T13:15:38.691 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2023-10-16T13:15:38.691 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2023-10-16T13:15:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2023-10-16T13:15:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2023-10-16T13:15:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2023-10-16T13:15:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2023-10-16T13:15:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2023-10-16T13:15:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2023-10-16T13:15:38.693 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 0, 2023-10-16T13:15:38.693 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2023-10-16T13:15:38.693 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2023-10-16T13:15:38.693 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2023-10-16T13:15:38.693 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2023-10-16T13:15:38.693 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2023-10-16T13:15:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2023-10-16T13:15:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2023-10-16T13:15:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2023-10-16T13:15:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2023-10-16T13:15:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2023-10-16T13:15:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2023-10-16T13:15:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2023-10-16T13:15:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2023-10-16T13:15:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2023-10-16T13:15:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2023-10-16T13:15:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2023-10-16T13:15:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 85, 2023-10-16T13:15:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2023-10-16T13:15:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 2, 2023-10-16T13:15:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 12, 2023-10-16T13:15:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 12, 2023-10-16T13:15:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 0, 2023-10-16T13:15:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2023-10-16T13:15:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 51, 2023-10-16T13:15:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 0, 2023-10-16T13:15:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 10 2023-10-16T13:15:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2023-10-16T13:15:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 1, 2023-10-16T13:15:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2023-10-16T13:15:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2023-10-16T13:15:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2023-10-16T13:15:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2023-10-16T13:15:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 0 2023-10-16T13:15:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2023-10-16T13:15:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2023-10-16T13:15:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 14, 2023-10-16T13:15:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2023-10-16T13:15:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 6, 2023-10-16T13:15:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 2305, 2023-10-16T13:15:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2023-10-16T13:15:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-16T13:15:38.701 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:38.701 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2023-10-16T13:15:38.701 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:38.701 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 10933, 2023-10-16T13:15:38.701 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 5499749, 2023-10-16T13:15:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 10933, 2023-10-16T13:15:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-10-16T13:15:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-10-16T13:15:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 10933, 2023-10-16T13:15:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 5499749, 2023-10-16T13:15:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2023-10-16T13:15:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2023-10-16T13:15:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2023-10-16T13:15:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2023-10-16T13:15:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 3944, 2023-10-16T13:15:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 14920537, 2023-10-16T13:15:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 3944, 2023-10-16T13:15:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 14920537, 2023-10-16T13:15:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2023-10-16T13:15:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2023-10-16T13:15:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2023-10-16T13:15:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2023-10-16T13:15:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 3944, 2023-10-16T13:15:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 3944, 2023-10-16T13:15:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 3944, 2023-10-16T13:15:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 3944, 2023-10-16T13:15:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2023-10-16T13:15:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2023-10-16T13:15:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 2305, 2023-10-16T13:15:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 232837, 2023-10-16T13:15:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 2305, 2023-10-16T13:15:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-10-16T13:15:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-10-16T13:15:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 50, 2023-10-16T13:15:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 232837, 2023-10-16T13:15:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x560119efe6e0": { 2023-10-16T13:15:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2023-10-16T13:15:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 6810, 2023-10-16T13:15:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 14075966, 2023-10-16T13:15:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 6810, 2023-10-16T13:15:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-10-16T13:15:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-10-16T13:15:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 218, 2023-10-16T13:15:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 14075966, 2023-10-16T13:15:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:38.717 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:38.717 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-10-16T13:15:38.717 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:38 smithi152 ceph-mon[104423]: pgmap v376: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 341 B/s wr, 13 op/s 2023-10-16T13:15:38.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:38 smithi092 ceph-mon[99542]: pgmap v376: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 341 B/s wr, 13 op/s 2023-10-16T13:15:38.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:38 smithi118 ceph-mon[103969]: pgmap v376: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 341 B/s wr, 13 op/s 2023-10-16T13:15:38.980 INFO:tasks.check_counter:Daemon mds.i mds.exported=17 2023-10-16T13:15:38.981 INFO:tasks.check_counter:Daemon mds.i mds.imported=10 2023-10-16T13:15:38.981 DEBUG:tasks.check_counter:Getting stats from l 2023-10-16T13:15:38.981 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 -- ceph daemon mds.l perf dump 2023-10-16T13:15:39.538 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-16T13:15:40.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:40 smithi092 ceph-mon[99542]: pgmap v377: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-16T13:15:40.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:40 smithi118 ceph-mon[103969]: pgmap v377: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-16T13:15:40.796 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-10-16T13:15:40.796 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2023-10-16T13:15:40.796 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 2289, 2023-10-16T13:15:40.797 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 4885, 2023-10-16T13:15:40.797 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 867561, 2023-10-16T13:15:40.797 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 6542209, 2023-10-16T13:15:40.797 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 17, 2023-10-16T13:15:40.797 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 7, 2023-10-16T13:15:40.798 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.173310451, 2023-10-16T13:15:40.798 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.080290370, 2023-10-16T13:15:40.798 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.082877427, 2023-10-16T13:15:40.798 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.014927114, 2023-10-16T13:15:40.798 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:40.798 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 4879, 2023-10-16T13:15:40.799 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.433778346, 2023-10-16T13:15:40.799 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000088907 2023-10-16T13:15:40.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.799 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:40.799 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 4624, 2023-10-16T13:15:40.800 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000707405, 2023-10-16T13:15:40.800 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000152 2023-10-16T13:15:40.800 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.800 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 593920, 2023-10-16T13:15:40.801 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 2380304 2023-10-16T13:15:40.801 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.801 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2023-10-16T13:15:40.801 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 2342, 2023-10-16T13:15:40.801 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 2055, 2023-10-16T13:15:40.802 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 2140530, 2023-10-16T13:15:40.802 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 669227, 2023-10-16T13:15:40.802 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 8, 2023-10-16T13:15:40.802 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 5, 2023-10-16T13:15:40.802 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.126680031, 2023-10-16T13:15:40.802 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.044578193, 2023-10-16T13:15:40.803 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.096230984, 2023-10-16T13:15:40.803 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.009414681, 2023-10-16T13:15:40.803 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:40.803 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2059, 2023-10-16T13:15:40.803 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.100735811, 2023-10-16T13:15:40.804 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000048924 2023-10-16T13:15:40.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.804 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:40.804 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 3467, 2023-10-16T13:15:40.804 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000529656, 2023-10-16T13:15:40.805 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000152 2023-10-16T13:15:40.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.805 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 529920, 2023-10-16T13:15:40.805 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 51744 2023-10-16T13:15:40.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.806 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2023-10-16T13:15:40.806 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 333, 2023-10-16T13:15:40.806 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 390, 2023-10-16T13:15:40.806 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 115317, 2023-10-16T13:15:40.806 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 525637, 2023-10-16T13:15:40.806 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 15, 2023-10-16T13:15:40.807 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 7, 2023-10-16T13:15:40.807 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.029106023, 2023-10-16T13:15:40.807 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.009808131, 2023-10-16T13:15:40.807 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.010289077, 2023-10-16T13:15:40.808 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.007118959, 2023-10-16T13:15:40.808 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-10-16T13:15:40.808 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 388, 2023-10-16T13:15:40.810 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.035844993, 2023-10-16T13:15:40.810 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000092384 2023-10-16T13:15:40.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.810 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-10-16T13:15:40.811 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 45, 2023-10-16T13:15:40.811 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000008350, 2023-10-16T13:15:40.811 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000185 2023-10-16T13:15:40.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.811 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-16T13:15:40.811 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 170096 2023-10-16T13:15:40.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.812 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2023-10-16T13:15:40.812 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2023-10-16T13:15:40.812 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2023-10-16T13:15:40.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.813 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2023-10-16T13:15:40.813 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2023-10-16T13:15:40.813 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2023-10-16T13:15:40.813 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 429, 2023-10-16T13:15:40.813 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.746499367, 2023-10-16T13:15:40.813 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001740091 2023-10-16T13:15:40.814 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:40.814 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.814 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2023-10-16T13:15:40.814 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2023-10-16T13:15:40.814 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2023-10-16T13:15:40.815 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1497, 2023-10-16T13:15:40.815 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.177213720, 2023-10-16T13:15:40.815 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000118379 2023-10-16T13:15:40.815 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:40.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.815 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-10-16T13:15:40.816 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 1368, 2023-10-16T13:15:40.816 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 1368, 2023-10-16T13:15:40.816 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2023-10-16T13:15:40.816 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1368, 2023-10-16T13:15:40.816 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 6.332266643, 2023-10-16T13:15:40.817 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.004628849 2023-10-16T13:15:40.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.817 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2023-10-16T13:15:40.817 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 0, 2023-10-16T13:15:40.817 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 0, 2023-10-16T13:15:40.817 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 0, 2023-10-16T13:15:40.818 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 11, 2023-10-16T13:15:40.819 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 0, 2023-10-16T13:15:40.819 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 0, 2023-10-16T13:15:40.819 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 23, 2023-10-16T13:15:40.819 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 4, 2023-10-16T13:15:40.819 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 7, 2023-10-16T13:15:40.820 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 12, 2023-10-16T13:15:40.820 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 15, 2023-10-16T13:15:40.820 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 87, 2023-10-16T13:15:40.820 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 1, 2023-10-16T13:15:40.820 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 1, 2023-10-16T13:15:40.821 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 3, 2023-10-16T13:15:40.821 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 2016, 2023-10-16T13:15:40.821 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 1876, 2023-10-16T13:15:40.821 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 0, 2023-10-16T13:15:40.821 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 32, 2023-10-16T13:15:40.822 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 0, 2023-10-16T13:15:40.822 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2023-10-16T13:15:40.822 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 0, 2023-10-16T13:15:40.822 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 1000, 2023-10-16T13:15:40.822 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 1, 2023-10-16T13:15:40.823 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 39, 2023-10-16T13:15:40.823 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 8, 2023-10-16T13:15:40.823 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 39, 2023-10-16T13:15:40.823 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 840, 2023-10-16T13:15:40.823 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2023-10-16T13:15:40.823 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 0, 2023-10-16T13:15:40.824 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 0, 2023-10-16T13:15:40.824 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 3619, 2023-10-16T13:15:40.824 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 18416957, 2023-10-16T13:15:40.824 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 0, 2023-10-16T13:15:40.824 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 0, 2023-10-16T13:15:40.825 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2023-10-16T13:15:40.825 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2023-10-16T13:15:40.825 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2023-10-16T13:15:40.825 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 0, 2023-10-16T13:15:40.825 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 0, 2023-10-16T13:15:40.826 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 0, 2023-10-16T13:15:40.826 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 0, 2023-10-16T13:15:40.826 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 0, 2023-10-16T13:15:40.826 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 118, 2023-10-16T13:15:40.826 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 910, 2023-10-16T13:15:40.827 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 0, 2023-10-16T13:15:40.827 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-16T13:15:40.827 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-16T13:15:40.827 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 274, 2023-10-16T13:15:40.827 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 169, 2023-10-16T13:15:40.828 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 13, 2023-10-16T13:15:40.828 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 1367 2023-10-16T13:15:40.828 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.828 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2023-10-16T13:15:40.828 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 0, 2023-10-16T13:15:40.829 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 0, 2023-10-16T13:15:40.829 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 0, 2023-10-16T13:15:40.829 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 34, 2023-10-16T13:15:40.829 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 0, 2023-10-16T13:15:40.829 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 2, 2023-10-16T13:15:40.830 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2023-10-16T13:15:40.830 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2023-10-16T13:15:40.830 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 840, 2023-10-16T13:15:40.830 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 838, 2023-10-16T13:15:40.830 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 0, 2023-10-16T13:15:40.830 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2023-10-16T13:15:40.831 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2023-10-16T13:15:40.831 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2023-10-16T13:15:40.831 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2023-10-16T13:15:40.831 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2023-10-16T13:15:40.831 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2023-10-16T13:15:40.832 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 0, 2023-10-16T13:15:40.832 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 39, 2023-10-16T13:15:40.832 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2023-10-16T13:15:40.832 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 0, 2023-10-16T13:15:40.832 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2023-10-16T13:15:40.833 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2023-10-16T13:15:40.833 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.833 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2023-10-16T13:15:40.833 INFO:teuthology.orchestra.run.smithi152.stdout: "evlrg": 0, 2023-10-16T13:15:40.833 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 2087, 2023-10-16T13:15:40.833 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 0, 2023-10-16T13:15:40.834 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 0, 2023-10-16T13:15:40.834 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 2087, 2023-10-16T13:15:40.834 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2023-10-16T13:15:40.834 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 0, 2023-10-16T13:15:40.834 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 4, 2023-10-16T13:15:40.834 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 0, 2023-10-16T13:15:40.835 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 0, 2023-10-16T13:15:40.835 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 4, 2023-10-16T13:15:40.835 INFO:teuthology.orchestra.run.smithi152.stdout: "segmjr": 2, 2023-10-16T13:15:40.835 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2023-10-16T13:15:40.835 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 0, 2023-10-16T13:15:40.836 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 4194304, 2023-10-16T13:15:40.836 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 8472332, 2023-10-16T13:15:40.836 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 0, 2023-10-16T13:15:40.836 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2023-10-16T13:15:40.836 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 212, 2023-10-16T13:15:40.836 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.338026440, 2023-10-16T13:15:40.837 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.006311445 2023-10-16T13:15:40.837 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.837 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 0 2023-10-16T13:15:40.837 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.837 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2023-10-16T13:15:40.838 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 23, 2023-10-16T13:15:40.838 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 903, 2023-10-16T13:15:40.838 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 880, 2023-10-16T13:15:40.838 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 22, 2023-10-16T13:15:40.838 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 105, 2023-10-16T13:15:40.839 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 83, 2023-10-16T13:15:40.839 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 23, 2023-10-16T13:15:40.839 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 1776, 2023-10-16T13:15:40.839 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 1753, 2023-10-16T13:15:40.839 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 1, 2023-10-16T13:15:40.840 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 871, 2023-10-16T13:15:40.840 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 870, 2023-10-16T13:15:40.840 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 59336, 2023-10-16T13:15:40.840 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 198960 2023-10-16T13:15:40.840 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.841 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2023-10-16T13:15:40.841 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 1592, 2023-10-16T13:15:40.841 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 31, 2023-10-16T13:15:40.841 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 1368, 2023-10-16T13:15:40.841 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 2, 2023-10-16T13:15:40.842 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 131, 2023-10-16T13:15:40.842 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2023-10-16T13:15:40.842 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.842 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.842 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.842 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.843 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2023-10-16T13:15:40.843 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.843 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.843 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.844 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2023-10-16T13:15:40.844 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.844 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.844 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.845 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2023-10-16T13:15:40.845 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.845 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.845 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.845 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.846 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2023-10-16T13:15:40.846 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 478, 2023-10-16T13:15:40.846 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.139023670, 2023-10-16T13:15:40.846 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000290844 2023-10-16T13:15:40.846 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.847 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2023-10-16T13:15:40.847 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.847 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.847 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.847 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.848 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2023-10-16T13:15:40.848 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1, 2023-10-16T13:15:40.848 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000287937, 2023-10-16T13:15:40.848 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000287937 2023-10-16T13:15:40.848 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.848 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2023-10-16T13:15:40.849 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.849 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.849 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.849 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2023-10-16T13:15:40.850 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.850 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.850 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.850 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.850 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2023-10-16T13:15:40.851 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.851 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.851 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.851 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.851 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2023-10-16T13:15:40.851 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.852 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.852 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.852 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.852 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2023-10-16T13:15:40.852 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.853 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.853 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.853 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.853 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2023-10-16T13:15:40.853 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.853 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.854 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.854 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.854 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2023-10-16T13:15:40.854 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.854 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.855 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.855 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.855 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2023-10-16T13:15:40.855 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.855 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.856 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.856 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.856 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2023-10-16T13:15:40.856 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 49, 2023-10-16T13:15:40.856 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.031602228, 2023-10-16T13:15:40.857 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000644943 2023-10-16T13:15:40.857 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.857 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2023-10-16T13:15:40.857 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.857 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.857 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.858 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.858 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2023-10-16T13:15:40.858 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.858 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.858 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.859 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2023-10-16T13:15:40.859 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.859 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.859 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.860 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.860 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2023-10-16T13:15:40.860 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 24, 2023-10-16T13:15:40.860 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.479672775, 2023-10-16T13:15:40.860 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.019986365 2023-10-16T13:15:40.861 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.861 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2023-10-16T13:15:40.861 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.861 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.861 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.862 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.862 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2023-10-16T13:15:40.862 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.862 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.862 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.863 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.863 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2023-10-16T13:15:40.863 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.863 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.863 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.864 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.864 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2023-10-16T13:15:40.864 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.864 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.864 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.865 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2023-10-16T13:15:40.865 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.865 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.865 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.866 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.866 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2023-10-16T13:15:40.866 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.866 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.866 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.867 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.867 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2023-10-16T13:15:40.867 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.867 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.867 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.867 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.868 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2023-10-16T13:15:40.868 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.868 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.868 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.868 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.869 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2023-10-16T13:15:40.869 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 816, 2023-10-16T13:15:40.869 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 5.681680033, 2023-10-16T13:15:40.869 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.006962843 2023-10-16T13:15:40.869 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.870 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2023-10-16T13:15:40.870 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2023-10-16T13:15:40.870 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2023-10-16T13:15:40.870 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.870 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.871 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.871 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:40.871 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.871 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2023-10-16T13:15:40.871 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 1, 2023-10-16T13:15:40.872 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 1, 2023-10-16T13:15:40.872 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 0, 2023-10-16T13:15:40.872 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 1, 2023-10-16T13:15:40.872 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2023-10-16T13:15:40.872 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 1295, 2023-10-16T13:15:40.872 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 1295, 2023-10-16T13:15:40.873 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 140, 2023-10-16T13:15:40.873 INFO:teuthology.orchestra.run.smithi152.stdout: "mdthresh_evicted": 0 2023-10-16T13:15:40.873 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.873 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2023-10-16T13:15:40.873 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2023-10-16T13:15:40.873 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2023-10-16T13:15:40.874 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2023-10-16T13:15:40.874 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2023-10-16T13:15:40.874 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2023-10-16T13:15:40.874 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2023-10-16T13:15:40.874 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-16T13:15:40.875 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2023-10-16T13:15:40.875 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-16T13:15:40.875 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2023-10-16T13:15:40.875 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2023-10-16T13:15:40.875 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2023-10-16T13:15:40.875 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-16T13:15:40.876 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2023-10-16T13:15:40.876 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2023-10-16T13:15:40.876 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2023-10-16T13:15:40.876 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2023-10-16T13:15:40.876 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2023-10-16T13:15:40.877 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-16T13:15:40.877 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2023-10-16T13:15:40.877 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-16T13:15:40.877 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2023-10-16T13:15:40.877 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2023-10-16T13:15:40.877 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2023-10-16T13:15:40.878 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2023-10-16T13:15:40.878 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2023-10-16T13:15:40.878 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-16T13:15:40.878 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2023-10-16T13:15:40.878 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2023-10-16T13:15:40.879 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2023-10-16T13:15:40.879 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2023-10-16T13:15:40.879 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2023-10-16T13:15:40.879 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2023-10-16T13:15:40.879 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2023-10-16T13:15:40.880 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2023-10-16T13:15:40.880 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2023-10-16T13:15:40.880 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 282363, 2023-10-16T13:15:40.880 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 111, 2023-10-16T13:15:40.880 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2023-10-16T13:15:40.881 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2023-10-16T13:15:40.881 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2023-10-16T13:15:40.881 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2023-10-16T13:15:40.881 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2023-10-16T13:15:40.881 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2023-10-16T13:15:40.881 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2023-10-16T13:15:40.882 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2023-10-16T13:15:40.882 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 7624, 2023-10-16T13:15:40.882 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 160, 2023-10-16T13:15:40.882 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2023-10-16T13:15:40.882 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2023-10-16T13:15:40.882 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2023-10-16T13:15:40.883 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2023-10-16T13:15:40.883 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 96612, 2023-10-16T13:15:40.883 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 785, 2023-10-16T13:15:40.883 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2023-10-16T13:15:40.883 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2023-10-16T13:15:40.883 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2023-10-16T13:15:40.884 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2023-10-16T13:15:40.884 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.884 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2023-10-16T13:15:40.884 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2023-10-16T13:15:40.884 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2023-10-16T13:15:40.884 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 1185, 2023-10-16T13:15:40.885 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 4453510, 2023-10-16T13:15:40.885 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 33, 2023-10-16T13:15:40.885 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 1185, 2023-10-16T13:15:40.885 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2023-10-16T13:15:40.885 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1185, 2023-10-16T13:15:40.885 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 3.583951660, 2023-10-16T13:15:40.886 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.003024431 2023-10-16T13:15:40.886 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.886 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2023-10-16T13:15:40.886 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2023-10-16T13:15:40.886 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1185, 2023-10-16T13:15:40.887 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1217 2023-10-16T13:15:40.887 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.887 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 1185, 2023-10-16T13:15:40.887 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 31, 2023-10-16T13:15:40.887 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 1154, 2023-10-16T13:15:40.888 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2023-10-16T13:15:40.888 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2023-10-16T13:15:40.888 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 0, 2023-10-16T13:15:40.888 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 10, 2023-10-16T13:15:40.888 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 31, 2023-10-16T13:15:40.888 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 243, 2023-10-16T13:15:40.889 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 23, 2023-10-16T13:15:40.889 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2023-10-16T13:15:40.889 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2023-10-16T13:15:40.889 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2023-10-16T13:15:40.889 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 0, 2023-10-16T13:15:40.890 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 859, 2023-10-16T13:15:40.890 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2023-10-16T13:15:40.890 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2023-10-16T13:15:40.890 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2023-10-16T13:15:40.890 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 0, 2023-10-16T13:15:40.891 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 20, 2023-10-16T13:15:40.891 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2023-10-16T13:15:40.891 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2023-10-16T13:15:40.891 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2023-10-16T13:15:40.891 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2023-10-16T13:15:40.891 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2023-10-16T13:15:40.892 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2023-10-16T13:15:40.892 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2023-10-16T13:15:40.892 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2023-10-16T13:15:40.892 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2023-10-16T13:15:40.892 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 0, 2023-10-16T13:15:40.893 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2023-10-16T13:15:40.893 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2023-10-16T13:15:40.893 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2023-10-16T13:15:40.893 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2023-10-16T13:15:40.893 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2023-10-16T13:15:40.894 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2023-10-16T13:15:40.894 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2023-10-16T13:15:40.894 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2023-10-16T13:15:40.894 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2023-10-16T13:15:40.894 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2023-10-16T13:15:40.894 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2023-10-16T13:15:40.895 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2023-10-16T13:15:40.895 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2023-10-16T13:15:40.895 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2023-10-16T13:15:40.895 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2023-10-16T13:15:40.895 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2023-10-16T13:15:40.896 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 85, 2023-10-16T13:15:40.896 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2023-10-16T13:15:40.896 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 2, 2023-10-16T13:15:40.896 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 12, 2023-10-16T13:15:40.896 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 12, 2023-10-16T13:15:40.897 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 0, 2023-10-16T13:15:40.897 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2023-10-16T13:15:40.897 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 25, 2023-10-16T13:15:40.897 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 0, 2023-10-16T13:15:40.897 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 6 2023-10-16T13:15:40.897 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.898 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2023-10-16T13:15:40.898 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 1, 2023-10-16T13:15:40.898 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2023-10-16T13:15:40.898 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2023-10-16T13:15:40.898 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2023-10-16T13:15:40.899 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.899 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2023-10-16T13:15:40.899 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 0 2023-10-16T13:15:40.899 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.899 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2023-10-16T13:15:40.899 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2023-10-16T13:15:40.900 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 14, 2023-10-16T13:15:40.900 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2023-10-16T13:15:40.900 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 6, 2023-10-16T13:15:40.900 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 838, 2023-10-16T13:15:40.900 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2023-10-16T13:15:40.901 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.901 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-16T13:15:40.901 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:40.901 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2023-10-16T13:15:40.901 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:40.902 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 4960, 2023-10-16T13:15:40.902 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 2593965, 2023-10-16T13:15:40.902 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:40.902 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 4960, 2023-10-16T13:15:40.902 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-10-16T13:15:40.903 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-10-16T13:15:40.903 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 4960, 2023-10-16T13:15:40.903 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 2593965, 2023-10-16T13:15:40.903 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:40.903 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.903 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.904 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.904 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:40.904 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.904 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2023-10-16T13:15:40.904 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:40.905 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2023-10-16T13:15:40.905 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:40.905 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2023-10-16T13:15:40.905 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2023-10-16T13:15:40.905 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:40.906 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:40.906 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 1185, 2023-10-16T13:15:40.906 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 4538156, 2023-10-16T13:15:40.906 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 1185, 2023-10-16T13:15:40.906 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 4538156, 2023-10-16T13:15:40.907 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:40.907 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.907 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.907 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.907 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:40.908 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.908 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2023-10-16T13:15:40.908 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:40.908 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2023-10-16T13:15:40.908 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:40.909 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2023-10-16T13:15:40.909 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2023-10-16T13:15:40.909 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:40.909 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2023-10-16T13:15:40.909 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 1185, 2023-10-16T13:15:40.909 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 1185, 2023-10-16T13:15:40.910 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 1185, 2023-10-16T13:15:40.910 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 1185, 2023-10-16T13:15:40.910 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:40.910 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.910 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.911 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.911 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:40.911 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.911 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2023-10-16T13:15:40.911 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:40.912 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2023-10-16T13:15:40.912 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:40.912 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 838, 2023-10-16T13:15:40.912 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 84646, 2023-10-16T13:15:40.912 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:40.913 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 838, 2023-10-16T13:15:40.913 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-10-16T13:15:40.913 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-10-16T13:15:40.913 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 31, 2023-10-16T13:15:40.913 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 84646, 2023-10-16T13:15:40.914 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:40.914 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.914 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.914 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.914 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:40.914 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T13:15:40.915 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x55fca3d3e6e0": { 2023-10-16T13:15:40.915 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-10-16T13:15:40.915 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2023-10-16T13:15:40.915 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-10-16T13:15:40.916 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 2087, 2023-10-16T13:15:40.916 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 4278028, 2023-10-16T13:15:40.916 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-10-16T13:15:40.916 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 2087, 2023-10-16T13:15:40.916 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-10-16T13:15:40.916 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-10-16T13:15:40.917 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 212, 2023-10-16T13:15:40.917 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 4278028, 2023-10-16T13:15:40.917 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-10-16T13:15:40.917 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-10-16T13:15:40.917 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-10-16T13:15:40.917 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-10-16T13:15:40.918 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:40.918 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T13:15:40.918 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-10-16T13:15:40.919 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:40 smithi152 ceph-mon[104423]: pgmap v377: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-16T13:15:41.194 INFO:tasks.check_counter:Daemon mds.l mds.exported=39 2023-10-16T13:15:41.195 INFO:tasks.check_counter:Daemon mds.l mds.imported=39 2023-10-16T13:15:41.195 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-16T13:15:41.207 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-16T13:15:41.207 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T13:15:41.208 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:15:41.232 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T13:15:41.233 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:15:41.294 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:15:41.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.476+0000 7f888d59a700 1 -- 172.21.15.92:0/3301004120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88881042d0 msgr2=0x7f88881066c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:41.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.476+0000 7f888d59a700 1 --2- 172.21.15.92:0/3301004120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88881042d0 0x7f88881066c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f887c009990 tx=0x7f887c009ca0 comp rx=0 tx=0).stop 2023-10-16T13:15:41.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.476+0000 7f888d59a700 1 -- 172.21.15.92:0/3301004120 shutdown_connections 2023-10-16T13:15:41.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.476+0000 7f888d59a700 1 --2- 172.21.15.92:0/3301004120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8888106c00 0x7f8888109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:41.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.476+0000 7f888d59a700 1 --2- 172.21.15.92:0/3301004120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88881019a0 0x7f8888103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:41.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.476+0000 7f888d59a700 1 --2- 172.21.15.92:0/3301004120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88881042d0 0x7f88881066c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:41.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.476+0000 7f888d59a700 1 -- 172.21.15.92:0/3301004120 >> 172.21.15.92:0/3301004120 conn(0x7f88880fb310 msgr2=0x7f88880fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:41.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.476+0000 7f888d59a700 1 -- 172.21.15.92:0/3301004120 shutdown_connections 2023-10-16T13:15:41.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.476+0000 7f888d59a700 1 -- 172.21.15.92:0/3301004120 wait complete. 2023-10-16T13:15:41.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.476+0000 7f888d59a700 1 Processor -- start 2023-10-16T13:15:41.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.477+0000 7f888d59a700 1 -- start start 2023-10-16T13:15:41.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.477+0000 7f888d59a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88881019a0 0x7f8888196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:41.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.477+0000 7f888d59a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88881042d0 0x7f88881970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:41.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.477+0000 7f888d59a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8888106c00 0x7f888819e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:41.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.477+0000 7f888d59a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888819e6f0 con 0x7f88881019a0 2023-10-16T13:15:41.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.477+0000 7f888d59a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888819e830 con 0x7f88881042d0 2023-10-16T13:15:41.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.477+0000 7f888d59a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888819e9c0 con 0x7f8888106c00 2023-10-16T13:15:41.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.477+0000 7f8886ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88881019a0 0x7f8888196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:41.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.477+0000 7f8886ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88881019a0 0x7f8888196b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38400/0 (socket says 172.21.15.92:38400) 2023-10-16T13:15:41.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.477+0000 7f8886ffd700 1 -- 172.21.15.92:0/318947463 learned_addr learned my addr 172.21.15.92:0/318947463 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:15:41.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.477+0000 7f88877fe700 1 --2- 172.21.15.92:0/318947463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8888106c00 0x7f888819e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:41.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.477+0000 7f88867fc700 1 --2- 172.21.15.92:0/318947463 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88881042d0 0x7f88881970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:41.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.477+0000 7f8886ffd700 1 -- 172.21.15.92:0/318947463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8888106c00 msgr2=0x7f888819e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:41.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.477+0000 7f8886ffd700 1 --2- 172.21.15.92:0/318947463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8888106c00 0x7f888819e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:41.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.477+0000 7f8886ffd700 1 -- 172.21.15.92:0/318947463 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88881042d0 msgr2=0x7f88881970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:41.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.477+0000 7f8886ffd700 1 --2- 172.21.15.92:0/318947463 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88881042d0 0x7f88881970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:41.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.477+0000 7f8886ffd700 1 -- 172.21.15.92:0/318947463 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c0095f0 con 0x7f88881019a0 2023-10-16T13:15:41.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.478+0000 7f8886ffd700 1 --2- 172.21.15.92:0/318947463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88881019a0 0x7f8888196b70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f887800d950 tx=0x7f887800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:41.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.478+0000 7f886ffff700 1 -- 172.21.15.92:0/318947463 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8878009940 con 0x7f88881019a0 2023-10-16T13:15:41.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.478+0000 7f886ffff700 1 -- 172.21.15.92:0/318947463 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8878010460 con 0x7f88881019a0 2023-10-16T13:15:41.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.478+0000 7f888d59a700 1 -- 172.21.15.92:0/318947463 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888819eca0 con 0x7f88881019a0 2023-10-16T13:15:41.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.478+0000 7f886ffff700 1 -- 172.21.15.92:0/318947463 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887800f620 con 0x7f88881019a0 2023-10-16T13:15:41.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.478+0000 7f888d59a700 1 -- 172.21.15.92:0/318947463 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888819f1b0 con 0x7f88881019a0 2023-10-16T13:15:41.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.479+0000 7f888d59a700 1 -- 172.21.15.92:0/318947463 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88880fce90 con 0x7f88881019a0 2023-10-16T13:15:41.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.480+0000 7f886ffff700 1 -- 172.21.15.92:0/318947463 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8878010960 con 0x7f88881019a0 2023-10-16T13:15:41.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.480+0000 7f886ffff700 1 --2- 172.21.15.92:0/318947463 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f88700a1520 0x7f88700a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:41.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.481+0000 7f88867fc700 1 --2- 172.21.15.92:0/318947463 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f88700a1520 0x7f88700a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:41.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.481+0000 7f886ffff700 1 -- 172.21.15.92:0/318947463 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f88780ccbf0 con 0x7f88881019a0 2023-10-16T13:15:41.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.481+0000 7f88867fc700 1 --2- 172.21.15.92:0/318947463 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f88700a1520 0x7f88700a39e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f887c006010 tx=0x7f887c003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:41.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.484+0000 7f886ffff700 1 -- 172.21.15.92:0/318947463 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8878096250 con 0x7f88881019a0 2023-10-16T13:15:41.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.678+0000 7f888d59a700 1 -- 172.21.15.92:0/318947463 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f888810cb10 con 0x7f88881019a0 2023-10-16T13:15:41.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.679+0000 7f886ffff700 1 -- 172.21.15.92:0/318947463 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22598 (secure 0 0 0) 0x7f8878020090 con 0x7f88881019a0 2023-10-16T13:15:41.681 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:15:41.682 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":85,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:12:36.335213+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:11:38.345035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:11:39.549912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:15:41.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.681+0000 7f888d59a700 1 -- 172.21.15.92:0/318947463 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f88700a1520 msgr2=0x7f88700a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:41.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.681+0000 7f888d59a700 1 --2- 172.21.15.92:0/318947463 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f88700a1520 0x7f88700a39e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f887c006010 tx=0x7f887c003680 comp rx=0 tx=0).stop 2023-10-16T13:15:41.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.681+0000 7f888d59a700 1 -- 172.21.15.92:0/318947463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88881019a0 msgr2=0x7f8888196b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:41.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.681+0000 7f888d59a700 1 --2- 172.21.15.92:0/318947463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88881019a0 0x7f8888196b70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f887800d950 tx=0x7f887800dc60 comp rx=0 tx=0).stop 2023-10-16T13:15:41.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.681+0000 7f888d59a700 1 -- 172.21.15.92:0/318947463 shutdown_connections 2023-10-16T13:15:41.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.681+0000 7f888d59a700 1 --2- 172.21.15.92:0/318947463 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f88700a1520 0x7f88700a39e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:41.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.681+0000 7f888d59a700 1 --2- 172.21.15.92:0/318947463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88881019a0 0x7f8888196b70 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:41.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.681+0000 7f888d59a700 1 --2- 172.21.15.92:0/318947463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8888106c00 0x7f888819e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:41.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.681+0000 7f888d59a700 1 --2- 172.21.15.92:0/318947463 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88881042d0 0x7f88881970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:41.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.681+0000 7f888d59a700 1 -- 172.21.15.92:0/318947463 >> 172.21.15.92:0/318947463 conn(0x7f88880fb310 msgr2=0x7f8888102690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:41.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.681+0000 7f888d59a700 1 -- 172.21.15.92:0/318947463 shutdown_connections 2023-10-16T13:15:41.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.681+0000 7f888d59a700 1 -- 172.21.15.92:0/318947463 wait complete. 2023-10-16T13:15:41.696 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:07:45.516334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:11:38.345035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:11:39.549912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:15:41.696 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:15:41.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.820+0000 7f316e96c700 1 -- 172.21.15.92:0/172058454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3168101130 msgr2=0x7f31681079e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:41.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.820+0000 7f316e96c700 1 --2- 172.21.15.92:0/172058454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3168101130 0x7f31681079e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f316000c240 tx=0x7f316000c550 comp rx=0 tx=0).stop 2023-10-16T13:15:41.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.820+0000 7f316e96c700 1 -- 172.21.15.92:0/172058454 shutdown_connections 2023-10-16T13:15:41.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.820+0000 7f316e96c700 1 --2- 172.21.15.92:0/172058454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3168101130 0x7f31681079e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:41.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.820+0000 7f316e96c700 1 --2- 172.21.15.92:0/172058454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31680ff5a0 0x7f31680ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:41.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.820+0000 7f316e96c700 1 --2- 172.21.15.92:0/172058454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3168100790 0x7f3168100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:41.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.820+0000 7f316e96c700 1 -- 172.21.15.92:0/172058454 >> 172.21.15.92:0/172058454 conn(0x7f31680fab10 msgr2=0x7f31680fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:41.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.820+0000 7f316e96c700 1 -- 172.21.15.92:0/172058454 shutdown_connections 2023-10-16T13:15:41.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.820+0000 7f316e96c700 1 -- 172.21.15.92:0/172058454 wait complete. 2023-10-16T13:15:41.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.821+0000 7f316e96c700 1 Processor -- start 2023-10-16T13:15:41.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.821+0000 7f316e96c700 1 -- start start 2023-10-16T13:15:41.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.821+0000 7f316e96c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31680ff5a0 0x7f3168194b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:41.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.821+0000 7f316e96c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3168100790 0x7f31681950c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:41.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.821+0000 7f316e96c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3168101130 0x7f316819c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:41.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.821+0000 7f316e96c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316819c700 con 0x7f3168101130 2023-10-16T13:15:41.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.821+0000 7f316e96c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316819c840 con 0x7f31680ff5a0 2023-10-16T13:15:41.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.821+0000 7f316e96c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316819c9d0 con 0x7f3168100790 2023-10-16T13:15:41.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.821+0000 7f316cf09700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3168101130 0x7f316819c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:41.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.821+0000 7f316cf09700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3168101130 0x7f316819c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38418/0 (socket says 172.21.15.92:38418) 2023-10-16T13:15:41.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.821+0000 7f3167fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31680ff5a0 0x7f3168194b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:41.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.821+0000 7f316cf09700 1 -- 172.21.15.92:0/4044391235 learned_addr learned my addr 172.21.15.92:0/4044391235 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:15:41.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.822+0000 7f315ffff700 1 --2- 172.21.15.92:0/4044391235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3168100790 0x7f31681950c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:41.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.822+0000 7f316cf09700 1 -- 172.21.15.92:0/4044391235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3168100790 msgr2=0x7f31681950c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:41.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.822+0000 7f316cf09700 1 --2- 172.21.15.92:0/4044391235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3168100790 0x7f31681950c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:41.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.822+0000 7f316cf09700 1 -- 172.21.15.92:0/4044391235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31680ff5a0 msgr2=0x7f3168194b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:41.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.822+0000 7f316cf09700 1 --2- 172.21.15.92:0/4044391235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31680ff5a0 0x7f3168194b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:41.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.822+0000 7f316cf09700 1 -- 172.21.15.92:0/4044391235 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316000ae10 con 0x7f3168101130 2023-10-16T13:15:41.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.822+0000 7f316cf09700 1 --2- 172.21.15.92:0/4044391235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3168101130 0x7f316819c130 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3160008b80 tx=0x7f3160004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:41.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.822+0000 7f3165ffb700 1 -- 172.21.15.92:0/4044391235 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316000f040 con 0x7f3168101130 2023-10-16T13:15:41.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.822+0000 7f3165ffb700 1 -- 172.21.15.92:0/4044391235 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f316000a560 con 0x7f3168101130 2023-10-16T13:15:41.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.822+0000 7f3165ffb700 1 -- 172.21.15.92:0/4044391235 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160005570 con 0x7f3168101130 2023-10-16T13:15:41.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.822+0000 7f316e96c700 1 -- 172.21.15.92:0/4044391235 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316819cc50 con 0x7f3168101130 2023-10-16T13:15:41.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.822+0000 7f316e96c700 1 -- 172.21.15.92:0/4044391235 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316819d020 con 0x7f3168101130 2023-10-16T13:15:41.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.823+0000 7f316e96c700 1 -- 172.21.15.92:0/4044391235 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31681069e0 con 0x7f3168101130 2023-10-16T13:15:41.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.824+0000 7f3165ffb700 1 -- 172.21.15.92:0/4044391235 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f316001ec60 con 0x7f3168101130 2023-10-16T13:15:41.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.825+0000 7f3165ffb700 1 --2- 172.21.15.92:0/4044391235 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f31540a1480 0x7f31540a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:41.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.825+0000 7f3165ffb700 1 -- 172.21.15.92:0/4044391235 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f31600cf7b0 con 0x7f3168101130 2023-10-16T13:15:41.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.825+0000 7f3167fff700 1 --2- 172.21.15.92:0/4044391235 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f31540a1480 0x7f31540a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:41.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.825+0000 7f3167fff700 1 --2- 172.21.15.92:0/4044391235 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f31540a1480 0x7f31540a3940 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f31681005f0 tx=0x7f3158007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:41.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:41.828+0000 7f3165ffb700 1 -- 172.21.15.92:0/4044391235 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3160098ea0 con 0x7f3168101130 2023-10-16T13:15:42.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.017+0000 7f316e96c700 1 -- 172.21.15.92:0/4044391235 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f316810a8f0 con 0x7f3168101130 2023-10-16T13:15:42.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.017+0000 7f3165ffb700 1 -- 172.21.15.92:0/4044391235 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f316002f330 con 0x7f3168101130 2023-10-16T13:15:42.020 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2023-10-16T13:15:42.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.019+0000 7f316e96c700 1 -- 172.21.15.92:0/4044391235 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f31540a1480 msgr2=0x7f31540a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:42.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.019+0000 7f316e96c700 1 --2- 172.21.15.92:0/4044391235 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f31540a1480 0x7f31540a3940 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f31681005f0 tx=0x7f3158007400 comp rx=0 tx=0).stop 2023-10-16T13:15:42.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.019+0000 7f316e96c700 1 -- 172.21.15.92:0/4044391235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3168101130 msgr2=0x7f316819c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:42.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.019+0000 7f316e96c700 1 --2- 172.21.15.92:0/4044391235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3168101130 0x7f316819c130 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3160008b80 tx=0x7f3160004dc0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.019+0000 7f316e96c700 1 -- 172.21.15.92:0/4044391235 shutdown_connections 2023-10-16T13:15:42.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.019+0000 7f316e96c700 1 --2- 172.21.15.92:0/4044391235 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f31540a1480 0x7f31540a3940 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.019+0000 7f316e96c700 1 --2- 172.21.15.92:0/4044391235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3168101130 0x7f316819c130 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.019+0000 7f316e96c700 1 --2- 172.21.15.92:0/4044391235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31680ff5a0 0x7f3168194b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.019+0000 7f316e96c700 1 --2- 172.21.15.92:0/4044391235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3168100790 0x7f31681950c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.019+0000 7f316e96c700 1 -- 172.21.15.92:0/4044391235 >> 172.21.15.92:0/4044391235 conn(0x7f31680fab10 msgr2=0x7f3168103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:42.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.019+0000 7f316e96c700 1 -- 172.21.15.92:0/4044391235 shutdown_connections 2023-10-16T13:15:42.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.019+0000 7f316e96c700 1 -- 172.21.15.92:0/4044391235 wait complete. 2023-10-16T13:15:42.033 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:15:42.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.155+0000 7f7ec84c1700 1 -- 172.21.15.92:0/536736819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec01042c0 msgr2=0x7f7ec01066b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:42.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.155+0000 7f7ec84c1700 1 --2- 172.21.15.92:0/536736819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec01042c0 0x7f7ec01066b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009990 tx=0x7f7eb4009ca0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.155+0000 7f7ec84c1700 1 -- 172.21.15.92:0/536736819 shutdown_connections 2023-10-16T13:15:42.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.155+0000 7f7ec84c1700 1 --2- 172.21.15.92:0/536736819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec0106bf0 0x7f7ec0109000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.155+0000 7f7ec84c1700 1 --2- 172.21.15.92:0/536736819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ec0101990 0x7f7ec0103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.155+0000 7f7ec84c1700 1 --2- 172.21.15.92:0/536736819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec01042c0 0x7f7ec01066b0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.155+0000 7f7ec84c1700 1 -- 172.21.15.92:0/536736819 >> 172.21.15.92:0/536736819 conn(0x7f7ec00fb320 msgr2=0x7f7ec00fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:42.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.155+0000 7f7ec84c1700 1 -- 172.21.15.92:0/536736819 shutdown_connections 2023-10-16T13:15:42.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.155+0000 7f7ec84c1700 1 -- 172.21.15.92:0/536736819 wait complete. 2023-10-16T13:15:42.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.156+0000 7f7ec84c1700 1 Processor -- start 2023-10-16T13:15:42.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.156+0000 7f7ec84c1700 1 -- start start 2023-10-16T13:15:42.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.156+0000 7f7ec84c1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec0101990 0x7f7ec0196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:42.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.156+0000 7f7ec84c1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ec01042c0 0x7f7ec01971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:42.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.156+0000 7f7ec84c1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec0106bf0 0x7f7ec019e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:42.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.156+0000 7f7ec84c1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec019e7f0 con 0x7f7ec0101990 2023-10-16T13:15:42.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.156+0000 7f7ec84c1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec019e960 con 0x7f7ec01042c0 2023-10-16T13:15:42.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.156+0000 7f7ec84c1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec019eb20 con 0x7f7ec0106bf0 2023-10-16T13:15:42.162 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.156+0000 7f7ec625d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec0101990 0x7f7ec0196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:42.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.156+0000 7f7ec625d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec0101990 0x7f7ec0196c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38428/0 (socket says 172.21.15.92:38428) 2023-10-16T13:15:42.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.156+0000 7f7ec625d700 1 -- 172.21.15.92:0/545427201 learned_addr learned my addr 172.21.15.92:0/545427201 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:15:42.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.156+0000 7f7ec5a5c700 1 --2- 172.21.15.92:0/545427201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ec01042c0 0x7f7ec01971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:42.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.156+0000 7f7ec625d700 1 -- 172.21.15.92:0/545427201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec0106bf0 msgr2=0x7f7ec019e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:42.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.156+0000 7f7ec625d700 1 --2- 172.21.15.92:0/545427201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec0106bf0 0x7f7ec019e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.156+0000 7f7ec625d700 1 -- 172.21.15.92:0/545427201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ec01042c0 msgr2=0x7f7ec01971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:42.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.156+0000 7f7ec625d700 1 --2- 172.21.15.92:0/545427201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ec01042c0 0x7f7ec01971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.156+0000 7f7ec625d700 1 -- 172.21.15.92:0/545427201 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb40095f0 con 0x7f7ec0101990 2023-10-16T13:15:42.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.156+0000 7f7ec5a5c700 1 --2- 172.21.15.92:0/545427201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ec01042c0 0x7f7ec01971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:15:42.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.157+0000 7f7ec625d700 1 --2- 172.21.15.92:0/545427201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec0101990 0x7f7ec0196c80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00e9a0 tx=0x7f7ebc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:42.164 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.157+0000 7f7eb37fe700 1 -- 172.21.15.92:0/545427201 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc009790 con 0x7f7ec0101990 2023-10-16T13:15:42.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.157+0000 7f7eb37fe700 1 -- 172.21.15.92:0/545427201 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7ebc00cbd0 con 0x7f7ec0101990 2023-10-16T13:15:42.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.157+0000 7f7ec84c1700 1 -- 172.21.15.92:0/545427201 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec019ee00 con 0x7f7ec0101990 2023-10-16T13:15:42.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.157+0000 7f7eb37fe700 1 -- 172.21.15.92:0/545427201 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc018730 con 0x7f7ec0101990 2023-10-16T13:15:42.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.157+0000 7f7ec84c1700 1 -- 172.21.15.92:0/545427201 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec019f220 con 0x7f7ec0101990 2023-10-16T13:15:42.166 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.158+0000 7f7ec84c1700 1 -- 172.21.15.92:0/545427201 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec010c880 con 0x7f7ec0101990 2023-10-16T13:15:42.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.159+0000 7f7eb37fe700 1 -- 172.21.15.92:0/545427201 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7ebc010430 con 0x7f7ec0101990 2023-10-16T13:15:42.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.159+0000 7f7eb37fe700 1 --2- 172.21.15.92:0/545427201 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7eac0a1480 0x7f7eac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:42.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.159+0000 7f7ec5a5c700 1 --2- 172.21.15.92:0/545427201 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7eac0a1480 0x7f7eac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:42.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.159+0000 7f7eb37fe700 1 -- 172.21.15.92:0/545427201 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f7ebc014070 con 0x7f7ec0101990 2023-10-16T13:15:42.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.160+0000 7f7ec5a5c700 1 --2- 172.21.15.92:0/545427201 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7eac0a1480 0x7f7eac0a3940 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0198180 tx=0x7f7eb4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:42.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.163+0000 7f7eb37fe700 1 -- 172.21.15.92:0/545427201 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7ebc096b30 con 0x7f7ec0101990 2023-10-16T13:15:42.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.352+0000 7f7ec84c1700 1 -- 172.21.15.92:0/545427201 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ec019f640 con 0x7f7ec0101990 2023-10-16T13:15:42.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.352+0000 7f7eb37fe700 1 -- 172.21.15.92:0/545427201 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ebc09a150 con 0x7f7ec0101990 2023-10-16T13:15:42.355 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2023-10-16T13:15:42.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.354+0000 7f7ec84c1700 1 -- 172.21.15.92:0/545427201 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7eac0a1480 msgr2=0x7f7eac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:42.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.354+0000 7f7ec84c1700 1 --2- 172.21.15.92:0/545427201 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7eac0a1480 0x7f7eac0a3940 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0198180 tx=0x7f7eb4005fb0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.354+0000 7f7ec84c1700 1 -- 172.21.15.92:0/545427201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec0101990 msgr2=0x7f7ec0196c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:42.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.354+0000 7f7ec84c1700 1 --2- 172.21.15.92:0/545427201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec0101990 0x7f7ec0196c80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00e9a0 tx=0x7f7ebc00ed60 comp rx=0 tx=0).stop 2023-10-16T13:15:42.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.354+0000 7f7ec84c1700 1 -- 172.21.15.92:0/545427201 shutdown_connections 2023-10-16T13:15:42.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.355+0000 7f7ec84c1700 1 --2- 172.21.15.92:0/545427201 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f7eac0a1480 0x7f7eac0a3940 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.355+0000 7f7ec84c1700 1 --2- 172.21.15.92:0/545427201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec0101990 0x7f7ec0196c80 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.355+0000 7f7ec84c1700 1 --2- 172.21.15.92:0/545427201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec0106bf0 0x7f7ec019e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.355+0000 7f7ec84c1700 1 --2- 172.21.15.92:0/545427201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ec01042c0 0x7f7ec01971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.355+0000 7f7ec84c1700 1 -- 172.21.15.92:0/545427201 >> 172.21.15.92:0/545427201 conn(0x7f7ec00fb320 msgr2=0x7f7ec0102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:42.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.355+0000 7f7ec84c1700 1 -- 172.21.15.92:0/545427201 shutdown_connections 2023-10-16T13:15:42.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.355+0000 7f7ec84c1700 1 -- 172.21.15.92:0/545427201 wait complete. 2023-10-16T13:15:42.369 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:15:42.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.494+0000 7feafedf7700 1 -- 172.21.15.92:0/1873643201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaf80ff540 msgr2=0x7feaf80ff960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:42.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.494+0000 7feafedf7700 1 --2- 172.21.15.92:0/1873643201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaf80ff540 0x7feaf80ff960 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7feaec0099c0 tx=0x7feaec009cd0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.494+0000 7feafedf7700 1 -- 172.21.15.92:0/1873643201 shutdown_connections 2023-10-16T13:15:42.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.494+0000 7feafedf7700 1 --2- 172.21.15.92:0/1873643201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaf80ff540 0x7feaf80ff960 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.494+0000 7feafedf7700 1 --2- 172.21.15.92:0/1873643201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf81010d0 0x7feaf8107980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.494+0000 7feafedf7700 1 --2- 172.21.15.92:0/1873643201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaf8100730 0x7feaf8100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.494+0000 7feafedf7700 1 -- 172.21.15.92:0/1873643201 >> 172.21.15.92:0/1873643201 conn(0x7feaf80faa90 msgr2=0x7feaf80fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:42.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.494+0000 7feafedf7700 1 -- 172.21.15.92:0/1873643201 shutdown_connections 2023-10-16T13:15:42.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.494+0000 7feafedf7700 1 -- 172.21.15.92:0/1873643201 wait complete. 2023-10-16T13:15:42.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.494+0000 7feafedf7700 1 Processor -- start 2023-10-16T13:15:42.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feafedf7700 1 -- start start 2023-10-16T13:15:42.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feafedf7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaf80ff540 0x7feaf8194a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:42.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feafedf7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf8100730 0x7feaf8194f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:42.500 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feafedf7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaf81010d0 0x7feaf819bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:42.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feafedf7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf819c5c0 con 0x7feaf81010d0 2023-10-16T13:15:42.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feafedf7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf819c700 con 0x7feaf80ff540 2023-10-16T13:15:42.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feafedf7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf819c890 con 0x7feaf8100730 2023-10-16T13:15:42.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feafd394700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaf81010d0 0x7feaf819bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:42.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feafd394700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaf81010d0 0x7feaf819bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38446/0 (socket says 172.21.15.92:38446) 2023-10-16T13:15:42.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feafd394700 1 -- 172.21.15.92:0/506931926 learned_addr learned my addr 172.21.15.92:0/506931926 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:15:42.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feafcb93700 1 --2- 172.21.15.92:0/506931926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaf80ff540 0x7feaf8194a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:42.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feaf7fff700 1 --2- 172.21.15.92:0/506931926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf8100730 0x7feaf8194f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:42.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feafd394700 1 -- 172.21.15.92:0/506931926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf8100730 msgr2=0x7feaf8194f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:42.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feafd394700 1 --2- 172.21.15.92:0/506931926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf8100730 0x7feaf8194f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feafd394700 1 -- 172.21.15.92:0/506931926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaf80ff540 msgr2=0x7feaf8194a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:42.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feafd394700 1 --2- 172.21.15.92:0/506931926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaf80ff540 0x7feaf8194a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feafd394700 1 -- 172.21.15.92:0/506931926 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaec0095f0 con 0x7feaf81010d0 2023-10-16T13:15:42.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feaf7fff700 1 --2- 172.21.15.92:0/506931926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf8100730 0x7feaf8194f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:15:42.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feafd394700 1 --2- 172.21.15.92:0/506931926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaf81010d0 0x7feaf819bff0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7feaf00111f0 tx=0x7feaf0011500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:42.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feaf5ffb700 1 -- 172.21.15.92:0/506931926 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0004db0 con 0x7feaf81010d0 2023-10-16T13:15:42.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.495+0000 7feaf5ffb700 1 -- 172.21.15.92:0/506931926 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7feaf0013040 con 0x7feaf81010d0 2023-10-16T13:15:42.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.496+0000 7feafedf7700 1 -- 172.21.15.92:0/506931926 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf819cb70 con 0x7feaf81010d0 2023-10-16T13:15:42.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.496+0000 7feaf5ffb700 1 -- 172.21.15.92:0/506931926 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0019660 con 0x7feaf81010d0 2023-10-16T13:15:42.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.496+0000 7feafedf7700 1 -- 172.21.15.92:0/506931926 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf819d030 con 0x7feaf81010d0 2023-10-16T13:15:42.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.497+0000 7feafedf7700 1 -- 172.21.15.92:0/506931926 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf8106a90 con 0x7feaf81010d0 2023-10-16T13:15:42.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.498+0000 7feaf5ffb700 1 -- 172.21.15.92:0/506931926 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7feaf0005000 con 0x7feaf81010d0 2023-10-16T13:15:42.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.498+0000 7feaf5ffb700 1 --2- 172.21.15.92:0/506931926 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7feae80a1480 0x7feae80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:42.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.498+0000 7feaf5ffb700 1 -- 172.21.15.92:0/506931926 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7feaf00d1330 con 0x7feaf81010d0 2023-10-16T13:15:42.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.498+0000 7feafcb93700 1 --2- 172.21.15.92:0/506931926 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7feae80a1480 0x7feae80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:42.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.499+0000 7feafcb93700 1 --2- 172.21.15.92:0/506931926 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7feae80a1480 0x7feae80a3940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7feaec00b580 tx=0x7feaec005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:42.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.502+0000 7feaf5ffb700 1 -- 172.21.15.92:0/506931926 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7feaf009a990 con 0x7feaf81010d0 2023-10-16T13:15:42.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.695+0000 7feafedf7700 1 -- 172.21.15.92:0/506931926 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feaf810a7d0 con 0x7feaf81010d0 2023-10-16T13:15:42.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.695+0000 7feaf5ffb700 1 -- 172.21.15.92:0/506931926 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7feaf0027020 con 0x7feaf81010d0 2023-10-16T13:15:42.697 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2023-10-16T13:15:42.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.697+0000 7feafedf7700 1 -- 172.21.15.92:0/506931926 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7feae80a1480 msgr2=0x7feae80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:42.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.697+0000 7feafedf7700 1 --2- 172.21.15.92:0/506931926 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7feae80a1480 0x7feae80a3940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7feaec00b580 tx=0x7feaec005fb0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.697+0000 7feafedf7700 1 -- 172.21.15.92:0/506931926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaf81010d0 msgr2=0x7feaf819bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:42.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.697+0000 7feafedf7700 1 --2- 172.21.15.92:0/506931926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaf81010d0 0x7feaf819bff0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7feaf00111f0 tx=0x7feaf0011500 comp rx=0 tx=0).stop 2023-10-16T13:15:42.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.697+0000 7feafedf7700 1 -- 172.21.15.92:0/506931926 shutdown_connections 2023-10-16T13:15:42.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.697+0000 7feafedf7700 1 --2- 172.21.15.92:0/506931926 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7feae80a1480 0x7feae80a3940 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.697+0000 7feafedf7700 1 --2- 172.21.15.92:0/506931926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaf81010d0 0x7feaf819bff0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.697+0000 7feafedf7700 1 --2- 172.21.15.92:0/506931926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaf80ff540 0x7feaf8194a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.697+0000 7feafedf7700 1 --2- 172.21.15.92:0/506931926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf8100730 0x7feaf8194f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.697+0000 7feafedf7700 1 -- 172.21.15.92:0/506931926 >> 172.21.15.92:0/506931926 conn(0x7feaf80faa90 msgr2=0x7feaf8103bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:42.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.697+0000 7feafedf7700 1 -- 172.21.15.92:0/506931926 shutdown_connections 2023-10-16T13:15:42.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.697+0000 7feafedf7700 1 -- 172.21.15.92:0/506931926 wait complete. 2023-10-16T13:15:42.710 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:42 smithi092 ceph-mon[99542]: pgmap v378: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 341 B/s wr, 13 op/s 2023-10-16T13:15:42.710 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:42 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/318947463' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:15:42.711 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:42 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/4044391235' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:15:42.711 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:42 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/545427201' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:15:42.712 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:15:42.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:42 smithi118 ceph-mon[103969]: pgmap v378: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 341 B/s wr, 13 op/s 2023-10-16T13:15:42.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:42 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/318947463' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:15:42.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:42 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/4044391235' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:15:42.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:42 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/545427201' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:15:42.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.832+0000 7f5af9bd8700 1 -- 172.21.15.92:0/894418032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af4101960 msgr2=0x7f5af4108210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:42.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.832+0000 7f5af9bd8700 1 --2- 172.21.15.92:0/894418032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af4101960 0x7f5af4108210 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00b0d0 tx=0x7f5aec00b3e0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.832+0000 7f5af9bd8700 1 -- 172.21.15.92:0/894418032 shutdown_connections 2023-10-16T13:15:42.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.832+0000 7f5af9bd8700 1 --2- 172.21.15.92:0/894418032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af4101960 0x7f5af4108210 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.832+0000 7f5af9bd8700 1 --2- 172.21.15.92:0/894418032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5af40ffdd0 0x7f5af41001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.832+0000 7f5af9bd8700 1 --2- 172.21.15.92:0/894418032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af4100fc0 0x7f5af4101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.832+0000 7f5af9bd8700 1 -- 172.21.15.92:0/894418032 >> 172.21.15.92:0/894418032 conn(0x7f5af40fb300 msgr2=0x7f5af40fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:42.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.832+0000 7f5af9bd8700 1 -- 172.21.15.92:0/894418032 shutdown_connections 2023-10-16T13:15:42.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.832+0000 7f5af9bd8700 1 -- 172.21.15.92:0/894418032 wait complete. 2023-10-16T13:15:42.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.833+0000 7f5af9bd8700 1 Processor -- start 2023-10-16T13:15:42.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.833+0000 7f5af9bd8700 1 -- start start 2023-10-16T13:15:42.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.833+0000 7f5af9bd8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af40ffdd0 0x7f5af4195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:42.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.833+0000 7f5af9bd8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af4100fc0 0x7f5af4196130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:42.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.833+0000 7f5af9bd8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5af4101960 0x7f5af419d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:42.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.833+0000 7f5af9bd8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af419d770 con 0x7f5af40ffdd0 2023-10-16T13:15:42.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.833+0000 7f5af9bd8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af419d8b0 con 0x7f5af4101960 2023-10-16T13:15:42.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.833+0000 7f5af9bd8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af419da40 con 0x7f5af4100fc0 2023-10-16T13:15:42.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.833+0000 7f5af37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af40ffdd0 0x7f5af4195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:42.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.833+0000 7f5af37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af40ffdd0 0x7f5af4195bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38456/0 (socket says 172.21.15.92:38456) 2023-10-16T13:15:42.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.833+0000 7f5af37fe700 1 -- 172.21.15.92:0/1530673972 learned_addr learned my addr 172.21.15.92:0/1530673972 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:15:42.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.833+0000 7f5af3fff700 1 --2- 172.21.15.92:0/1530673972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5af4101960 0x7f5af419d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:42.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.833+0000 7f5af2ffd700 1 --2- 172.21.15.92:0/1530673972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af4100fc0 0x7f5af4196130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:42.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.834+0000 7f5af37fe700 1 -- 172.21.15.92:0/1530673972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af4100fc0 msgr2=0x7f5af4196130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:42.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.834+0000 7f5af37fe700 1 --2- 172.21.15.92:0/1530673972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af4100fc0 0x7f5af4196130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.834+0000 7f5af37fe700 1 -- 172.21.15.92:0/1530673972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5af4101960 msgr2=0x7f5af419d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:42.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.834+0000 7f5af37fe700 1 --2- 172.21.15.92:0/1530673972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5af4101960 0x7f5af419d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:42.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.834+0000 7f5af37fe700 1 -- 172.21.15.92:0/1530673972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec009d00 con 0x7f5af40ffdd0 2023-10-16T13:15:42.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.834+0000 7f5af3fff700 1 --2- 172.21.15.92:0/1530673972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5af4101960 0x7f5af419d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:15:42.842 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.834+0000 7f5af37fe700 1 --2- 172.21.15.92:0/1530673972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af40ffdd0 0x7f5af4195bf0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40098f0 tx=0x7f5ae4009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:42.842 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.834+0000 7f5af0ff9700 1 -- 172.21.15.92:0/1530673972 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4012070 con 0x7f5af40ffdd0 2023-10-16T13:15:42.842 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.834+0000 7f5af9bd8700 1 -- 172.21.15.92:0/1530673972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af40690d0 con 0x7f5af40ffdd0 2023-10-16T13:15:42.842 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.834+0000 7f5af0ff9700 1 -- 172.21.15.92:0/1530673972 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5ae4004500 con 0x7f5af40ffdd0 2023-10-16T13:15:42.842 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.834+0000 7f5af0ff9700 1 -- 172.21.15.92:0/1530673972 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4007e20 con 0x7f5af40ffdd0 2023-10-16T13:15:42.843 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.834+0000 7f5af9bd8700 1 -- 172.21.15.92:0/1530673972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af4069630 con 0x7f5af40ffdd0 2023-10-16T13:15:42.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.835+0000 7f5af9bd8700 1 -- 172.21.15.92:0/1530673972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af410b730 con 0x7f5af40ffdd0 2023-10-16T13:15:42.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.836+0000 7f5af0ff9700 1 -- 172.21.15.92:0/1530673972 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5ae4016030 con 0x7f5af40ffdd0 2023-10-16T13:15:42.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.837+0000 7f5af0ff9700 1 --2- 172.21.15.92:0/1530673972 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5adc0a14d0 0x7f5adc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:42.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.837+0000 7f5af2ffd700 1 --2- 172.21.15.92:0/1530673972 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5adc0a14d0 0x7f5adc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:42.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.837+0000 7f5af0ff9700 1 -- 172.21.15.92:0/1530673972 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5ae40cdf90 con 0x7f5af40ffdd0 2023-10-16T13:15:42.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.837+0000 7f5af2ffd700 1 --2- 172.21.15.92:0/1530673972 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5adc0a14d0 0x7f5adc0a3990 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8005950 tx=0x7f5ae80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:42.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:42.841+0000 7f5af0ff9700 1 -- 172.21.15.92:0/1530673972 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5ae40975b0 con 0x7f5af40ffdd0 2023-10-16T13:15:42.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:42 smithi152 ceph-mon[104423]: pgmap v378: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 341 B/s wr, 13 op/s 2023-10-16T13:15:42.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:42 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/318947463' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:15:42.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:42 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/4044391235' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-16T13:15:42.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:42 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/545427201' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-16T13:15:43.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.049+0000 7f5af9bd8700 1 -- 172.21.15.92:0/1530673972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5af4106e40 con 0x7f5af40ffdd0 2023-10-16T13:15:43.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.050+0000 7f5af0ff9700 1 -- 172.21.15.92:0/1530673972 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v85) v1 ==== 81+0+590 (secure 0 0 0) 0x7f5ae409abd0 con 0x7f5af40ffdd0 2023-10-16T13:15:43.052 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/1517475646 2023-10-17T13:05:35.186467+0000 2023-10-16T13:15:43.052 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6801/1487044137 2023-10-17T13:05:35.186467+0000 2023-10-16T13:15:43.053 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/1407513743 2023-10-17T13:05:35.186467+0000 2023-10-16T13:15:43.053 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/1513871374 2023-10-17T13:05:11.104167+0000 2023-10-16T13:15:43.053 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6800/184191966 2023-10-17T13:05:11.104167+0000 2023-10-16T13:15:43.053 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/1527476864 2023-10-17T13:05:11.104167+0000 2023-10-16T13:15:43.053 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/1790054192 2023-10-17T13:05:35.186467+0000 2023-10-16T13:15:43.054 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/3362128136 2023-10-17T13:05:11.104167+0000 2023-10-16T13:15:43.054 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6801/184191966 2023-10-17T13:05:11.104167+0000 2023-10-16T13:15:43.054 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6800/1487044137 2023-10-17T13:05:35.186467+0000 2023-10-16T13:15:43.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.052+0000 7f5af9bd8700 1 -- 172.21.15.92:0/1530673972 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5adc0a14d0 msgr2=0x7f5adc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:43.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.052+0000 7f5af9bd8700 1 --2- 172.21.15.92:0/1530673972 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5adc0a14d0 0x7f5adc0a3990 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8005950 tx=0x7f5ae80058e0 comp rx=0 tx=0).stop 2023-10-16T13:15:43.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.052+0000 7f5af9bd8700 1 -- 172.21.15.92:0/1530673972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af40ffdd0 msgr2=0x7f5af4195bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:43.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.052+0000 7f5af9bd8700 1 --2- 172.21.15.92:0/1530673972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af40ffdd0 0x7f5af4195bf0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40098f0 tx=0x7f5ae4009cb0 comp rx=0 tx=0).stop 2023-10-16T13:15:43.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.052+0000 7f5af9bd8700 1 -- 172.21.15.92:0/1530673972 shutdown_connections 2023-10-16T13:15:43.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.052+0000 7f5af9bd8700 1 --2- 172.21.15.92:0/1530673972 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5adc0a14d0 0x7f5adc0a3990 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:43.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.052+0000 7f5af9bd8700 1 --2- 172.21.15.92:0/1530673972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af40ffdd0 0x7f5af4195bf0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:43.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.052+0000 7f5af9bd8700 1 --2- 172.21.15.92:0/1530673972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5af4101960 0x7f5af419d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:43.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.052+0000 7f5af9bd8700 1 --2- 172.21.15.92:0/1530673972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af4100fc0 0x7f5af4196130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:43.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.052+0000 7f5af9bd8700 1 -- 172.21.15.92:0/1530673972 >> 172.21.15.92:0/1530673972 conn(0x7f5af40fb300 msgr2=0x7f5af4104360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:43.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.052+0000 7f5af9bd8700 1 -- 172.21.15.92:0/1530673972 shutdown_connections 2023-10-16T13:15:43.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.052+0000 7f5af9bd8700 1 -- 172.21.15.92:0/1530673972 wait complete. 2023-10-16T13:15:43.058 INFO:teuthology.orchestra.run.smithi092.stderr:listed 10 entries 2023-10-16T13:15:43.066 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-16T13:15:43.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:15:43.067 DEBUG:teuthology.orchestra.run.smithi092:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-16T13:15:43.144 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2023-10-16T13:15:43.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:15:43.145 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T13:15:43.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:15:43.214 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-10-16T13:15:43.231 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T13:15:43.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:15:43.232 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T13:15:43.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:15:43.314 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2023-10-16T13:15:43.425 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-16T13:15:43.426 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-16T13:15:43.426 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:15:43.445 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20121 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/8182924ba93b49295573fa5306d325acb7f0014d3cd69ab847d001ab48a41b39/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQ5U7HDJ53H5JFYDIB6HWNL2HL:/var/lib/containers/storage/overlay/l/HHWSBVANOWH3ZZ45S3OTUOP6DK,upperdir=/var/lib/containers/storage/overlay/8182924ba93b49295573fa5306d325acb7f0014d3cd69ab847d001ab48a41b39/diff,workdir=/var/lib/containers/storage/overlay/8182924ba93b49295573fa5306d325acb7f0014d3cd69ab847d001ab48a41b39/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/93ec9967e72a88e75a1847fd7030359f815505a9e7478e76cc62ec10dfcc2f65/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQ5U7HDJ53H5JFYDIB6HWNL2HL:/var/lib/containers/storage/overlay/l/HHWSBVANOWH3ZZ45S3OTUOP6DK,upperdir=/var/lib/containers/storage/overlay/93ec9967e72a88e75a1847fd7030359f815505a9e7478e76cc62ec10dfcc2f65/diff,workdir=/var/lib/containers/storage/overlay/93ec9967e72a88e75a1847fd7030359f815505a9e7478e76cc62ec10dfcc2f65/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0 overlay /var/lib/containers/storage/overlay/d11b645c31a4774ca7c69d59f722c0d2c049ff67725daa5b926382b9d5b9c755/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQ5U7HDJ53H5JFYDIB6HWNL2HL:/var/lib/containers/storage/overlay/l/HHWSBVANOWH3ZZ45S3OTUOP6DK,upperdir=/var/lib/containers/storage/overlay/d11b645c31a4774ca7c69d59f722c0d2c049ff67725daa5b926382b9d5b9c755/diff,workdir=/var/lib/containers/storage/overlay/d11b645c31a4774ca7c69d59f722c0d2c049ff67725daa5b926382b9d5b9c755/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/943adc929e09caeae3b0b8777dd19171f2132a7fed51b7f5138c760e212cef4d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQ5U7HDJ53H5JFYDIB6HWNL2HL:/var/lib/containers/storage/overlay/l/HHWSBVANOWH3ZZ45S3OTUOP6DK,upperdir=/var/lib/containers/storage/overlay/943adc929e09caeae3b0b8777dd19171f2132a7fed51b7f5138c760e212cef4d/diff,workdir=/var/lib/containers/storage/overlay/943adc929e09caeae3b0b8777dd19171f2132a7fed51b7f5138c760e212cef4d/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/942550ed7025149e9239816ac68076ef5fa879dafc631e1123b19849a9b9a198/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQ5U7HDJ53H5JFYDIB6HWNL2HL:/var/lib/containers/storage/overlay/l/HHWSBVANOWH3ZZ45S3OTUOP6DK,upperdir=/var/lib/containers/storage/overlay/942550ed7025149e9239816ac68076ef5fa879dafc631e1123b19849a9b9a198/diff,workdir=/var/lib/containers/storage/overlay/942550ed7025149e9239816ac68076ef5fa879dafc631e1123b19849a9b9a198/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/fccae946687f554f4ded2ab912ad25dc7fe9a61b22173950eb42b28f133a92db/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQ5U7HDJ53H5JFYDIB6HWNL2HL:/var/lib/containers/storage/overlay/l/HHWSBVANOWH3ZZ45S3OTUOP6DK,upperdir=/var/lib/containers/storage/overlay/fccae946687f554f4ded2ab912ad25dc7fe9a61b22173950eb42b28f133a92db/diff,workdir=/var/lib/containers/storage/overlay/fccae946687f554f4ded2ab912ad25dc7fe9a61b22173950eb42b28f133a92db/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/327271f3e8f6b1d6e7d134280b8ecb03a09cbe256eb48edf4bd8d260b32e3974/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQ5U7HDJ53H5JFYDIB6HWNL2HL:/var/lib/containers/storage/overlay/l/HHWSBVANOWH3ZZ45S3OTUOP6DK,upperdir=/var/lib/containers/storage/overlay/327271f3e8f6b1d6e7d134280b8ecb03a09cbe256eb48edf4bd8d260b32e3974/diff,workdir=/var/lib/containers/storage/overlay/327271f3e8f6b1d6e7d134280b8ecb03a09cbe256eb48edf4bd8d260b32e3974/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/2c15c301607f0759e8dbedd675e4d7151624e7bf9dcc07f2f0edf5ec85eb23ac/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQ5U7HDJ53H5JFYDIB6HWNL2HL:/var/lib/containers/storage/overlay/l/HHWSBVANOWH3ZZ45S3OTUOP6DK,upperdir=/var/lib/containers/storage/overlay/2c15c301607f0759e8dbedd675e4d7151624e7bf9dcc07f2f0edf5ec85eb23ac/diff,workdir=/var/lib/containers/storage/overlay/2c15c301607f0759e8dbedd675e4d7151624e7bf9dcc07f2f0edf5ec85eb23ac/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/fc8aef1a3d6a946c08241e5a40bef98fae73ff9241d503b834fe070340f663b8/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQ5U7HDJ53H5JFYDIB6HWNL2HL:/var/lib/containers/storage/overlay/l/HHWSBVANOWH3ZZ45S3OTUOP6DK,upperdir=/var/lib/containers/storage/overlay/fc8aef1a3d6a946c08241e5a40bef98fae73ff9241d503b834fe070340f663b8/diff,workdir=/var/lib/containers/storage/overlay/fc8aef1a3d6a946c08241e5a40bef98fae73ff9241d503b834fe070340f663b8/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/679fe8c8de42f114478cc82933c011aa899b45720c0479c33b2d0bb0bdae20e0/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQ5U7HDJ53H5JFYDIB6HWNL2HL:/var/lib/containers/storage/overlay/l/HHWSBVANOWH3ZZ45S3OTUOP6DK,upperdir=/var/lib/containers/storage/overlay/679fe8c8de42f114478cc82933c011aa899b45720c0479c33b2d0bb0bdae20e0/diff,workdir=/var/lib/containers/storage/overlay/679fe8c8de42f114478cc82933c011aa899b45720c0479c33b2d0bb0bdae20e0/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2023-10-16T13:15:43.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:15:43.446 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-10-16T13:15:43.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:15:43.503 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2023-10-16T13:15:43.572 INFO:teuthology.orchestra.run.smithi092.stderr:Cannot find device "ceph-brx" 2023-10-16T13:15:43.572 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:43 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/506931926' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:15:43.573 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:43 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1530673972' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-16T13:15:43.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:15:43.577 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-10-16T13:15:43.590 INFO:tasks.cephadm:Teardown begin 2023-10-16T13:15:43.591 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T13:15:43.591 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:15:43.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.735+0000 7fba14386700 1 -- 172.21.15.92:0/3110630660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba0c100020 msgr2=0x7fba0c1004a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:43.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.735+0000 7fba14386700 1 --2- 172.21.15.92:0/3110630660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba0c100020 0x7fba0c1004a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fba08009990 tx=0x7fba08009ca0 comp rx=0 tx=0).stop 2023-10-16T13:15:43.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.735+0000 7fba14386700 1 -- 172.21.15.92:0/3110630660 shutdown_connections 2023-10-16T13:15:43.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.735+0000 7fba14386700 1 --2- 172.21.15.92:0/3110630660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba0c1009e0 0x7fba0c108280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:43.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.735+0000 7fba14386700 1 --2- 172.21.15.92:0/3110630660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba0c101460 0x7fba0c101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:43.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.735+0000 7fba14386700 1 --2- 172.21.15.92:0/3110630660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba0c100020 0x7fba0c1004a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:43.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.735+0000 7fba14386700 1 -- 172.21.15.92:0/3110630660 >> 172.21.15.92:0/3110630660 conn(0x7fba0c0faab0 msgr2=0x7fba0c0fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:43.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.735+0000 7fba14386700 1 -- 172.21.15.92:0/3110630660 shutdown_connections 2023-10-16T13:15:43.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.735+0000 7fba14386700 1 -- 172.21.15.92:0/3110630660 wait complete. 2023-10-16T13:15:43.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.736+0000 7fba14386700 1 Processor -- start 2023-10-16T13:15:43.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.736+0000 7fba14386700 1 -- start start 2023-10-16T13:15:43.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.736+0000 7fba14386700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba0c100020 0x7fba0c195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:43.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.736+0000 7fba14386700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba0c1009e0 0x7fba0c195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:43.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.736+0000 7fba14386700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba0c101460 0x7fba0c19d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:43.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.736+0000 7fba14386700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c19d610 con 0x7fba0c1009e0 2023-10-16T13:15:43.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.736+0000 7fba14386700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c19d750 con 0x7fba0c100020 2023-10-16T13:15:43.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.736+0000 7fba14386700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c19d8e0 con 0x7fba0c101460 2023-10-16T13:15:43.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.736+0000 7fba11921700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba0c1009e0 0x7fba0c195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:43.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.736+0000 7fba11921700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba0c1009e0 0x7fba0c195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38472/0 (socket says 172.21.15.92:38472) 2023-10-16T13:15:43.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.736+0000 7fba11921700 1 -- 172.21.15.92:0/3795441804 learned_addr learned my addr 172.21.15.92:0/3795441804 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:15:43.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.736+0000 7fba12122700 1 --2- 172.21.15.92:0/3795441804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba0c100020 0x7fba0c195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:43.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.736+0000 7fba12923700 1 --2- 172.21.15.92:0/3795441804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba0c101460 0x7fba0c19d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:43.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.736+0000 7fba11921700 1 -- 172.21.15.92:0/3795441804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba0c101460 msgr2=0x7fba0c19d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:43.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.736+0000 7fba11921700 1 --2- 172.21.15.92:0/3795441804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba0c101460 0x7fba0c19d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:43.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.736+0000 7fba11921700 1 -- 172.21.15.92:0/3795441804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba0c100020 msgr2=0x7fba0c195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:43.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.736+0000 7fba11921700 1 --2- 172.21.15.92:0/3795441804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba0c100020 0x7fba0c195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:43.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.736+0000 7fba11921700 1 -- 172.21.15.92:0/3795441804 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba080095f0 con 0x7fba0c1009e0 2023-10-16T13:15:43.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.736+0000 7fba12923700 1 --2- 172.21.15.92:0/3795441804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba0c101460 0x7fba0c19d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:15:43.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.737+0000 7fba11921700 1 --2- 172.21.15.92:0/3795441804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba0c1009e0 0x7fba0c195fd0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fba080059d0 tx=0x7fba0800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:43.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.737+0000 7fba037fe700 1 -- 172.21.15.92:0/3795441804 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0801d070 con 0x7fba0c1009e0 2023-10-16T13:15:43.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.737+0000 7fba037fe700 1 -- 172.21.15.92:0/3795441804 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fba0800fe20 con 0x7fba0c1009e0 2023-10-16T13:15:43.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.737+0000 7fba14386700 1 -- 172.21.15.92:0/3795441804 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0c19db60 con 0x7fba0c1009e0 2023-10-16T13:15:43.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.737+0000 7fba037fe700 1 -- 172.21.15.92:0/3795441804 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08017650 con 0x7fba0c1009e0 2023-10-16T13:15:43.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.737+0000 7fba14386700 1 -- 172.21.15.92:0/3795441804 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0c19df80 con 0x7fba0c1009e0 2023-10-16T13:15:43.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.738+0000 7fba14386700 1 -- 172.21.15.92:0/3795441804 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0c10b790 con 0x7fba0c1009e0 2023-10-16T13:15:43.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.739+0000 7fba037fe700 1 -- 172.21.15.92:0/3795441804 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fba08022470 con 0x7fba0c1009e0 2023-10-16T13:15:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.739+0000 7fba037fe700 1 --2- 172.21.15.92:0/3795441804 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb9f80a1520 0x7fb9f80a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.739+0000 7fba12122700 1 --2- 172.21.15.92:0/3795441804 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb9f80a1520 0x7fb9f80a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.740+0000 7fba037fe700 1 -- 172.21.15.92:0/3795441804 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fba080ce500 con 0x7fba0c1009e0 2023-10-16T13:15:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.740+0000 7fba12122700 1 --2- 172.21.15.92:0/3795441804 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb9f80a1520 0x7fb9f80a39e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009c60 tx=0x7fb9fc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.744+0000 7fba037fe700 1 -- 172.21.15.92:0/3795441804 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fba08097cd0 con 0x7fba0c1009e0 2023-10-16T13:15:43.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:43 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/506931926' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:15:43.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:43 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1530673972' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-16T13:15:43.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:43 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/506931926' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-16T13:15:43.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:43 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1530673972' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-16T13:15:43.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.977+0000 7fba14386700 1 -- 172.21.15.92:0/3795441804 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba0c106c20 con 0x7fba0c1009e0 2023-10-16T13:15:43.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.978+0000 7fba037fe700 1 -- 172.21.15.92:0/3795441804 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+11395 (secure 0 0 0) 0x7fba08027020 con 0x7fba0c1009e0 2023-10-16T13:15:43.980 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:15:43.980 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-16T13:11:40.343309+0000","modified":"2023-10-16T13:15:07.109346+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24460,"mds_3":24428,"mds_4":24412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1790514945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1790514945},{"type":"v1","addr":"172.21.15.92:6839","nonce":1790514945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/1016260236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1016260236},{"type":"v1","addr":"172.21.15.92:6841","nonce":1016260236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24410":{"gid":24410,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/2133613540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":2133613540},{"type":"v1","addr":"172.21.15.118:6837","nonce":2133613540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6837/2403096460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":2403096460},{"type":"v1","addr":"172.21.15.152:6837","nonce":2403096460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":47,"addr":"172.21.15.152:6839/1821921588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1821921588},{"type":"v1","addr":"172.21.15.152:6839","nonce":1821921588}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6839/1577355936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":1577355936},{"type":"v1","addr":"172.21.15.118:6839","nonce":1577355936}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:15:43.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.980+0000 7fba14386700 1 -- 172.21.15.92:0/3795441804 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb9f80a1520 msgr2=0x7fb9f80a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:43.982 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.980+0000 7fba14386700 1 --2- 172.21.15.92:0/3795441804 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb9f80a1520 0x7fb9f80a39e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009c60 tx=0x7fb9fc009260 comp rx=0 tx=0).stop 2023-10-16T13:15:43.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.980+0000 7fba14386700 1 -- 172.21.15.92:0/3795441804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba0c1009e0 msgr2=0x7fba0c195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:43.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.980+0000 7fba14386700 1 --2- 172.21.15.92:0/3795441804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba0c1009e0 0x7fba0c195fd0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fba080059d0 tx=0x7fba0800f690 comp rx=0 tx=0).stop 2023-10-16T13:15:43.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.980+0000 7fba14386700 1 -- 172.21.15.92:0/3795441804 shutdown_connections 2023-10-16T13:15:43.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.980+0000 7fba14386700 1 --2- 172.21.15.92:0/3795441804 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb9f80a1520 0x7fb9f80a39e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:43.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.980+0000 7fba14386700 1 --2- 172.21.15.92:0/3795441804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba0c101460 0x7fba0c19d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:43.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.980+0000 7fba14386700 1 --2- 172.21.15.92:0/3795441804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba0c100020 0x7fba0c195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:43.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.980+0000 7fba14386700 1 --2- 172.21.15.92:0/3795441804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba0c1009e0 0x7fba0c195fd0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:43.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.980+0000 7fba14386700 1 -- 172.21.15.92:0/3795441804 >> 172.21.15.92:0/3795441804 conn(0x7fba0c0faab0 msgr2=0x7fba0c0fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:43.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.980+0000 7fba14386700 1 -- 172.21.15.92:0/3795441804 shutdown_connections 2023-10-16T13:15:43.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:43.980+0000 7fba14386700 1 -- 172.21.15.92:0/3795441804 wait complete. 2023-10-16T13:15:43.985 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 37 2023-10-16T13:15:43.994 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:15:44.117 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.113+0000 7fb8a7637700 1 -- 172.21.15.92:0/2423941320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a01013f0 msgr2=0x7fb8a0101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:44.118 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.113+0000 7fb8a7637700 1 --2- 172.21.15.92:0/2423941320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a01013f0 0x7fb8a0101810 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009990 tx=0x7fb89c009ca0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.118 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.114+0000 7fb8a7637700 1 -- 172.21.15.92:0/2423941320 shutdown_connections 2023-10-16T13:15:44.118 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.114+0000 7fb8a7637700 1 --2- 172.21.15.92:0/2423941320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a01013f0 0x7fb8a0101810 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.118 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.114+0000 7fb8a7637700 1 --2- 172.21.15.92:0/2423941320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a0100a00 0x7fb8a01082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.114+0000 7fb8a7637700 1 --2- 172.21.15.92:0/2423941320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8a0100040 0x7fb8a01004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.114+0000 7fb8a7637700 1 -- 172.21.15.92:0/2423941320 >> 172.21.15.92:0/2423941320 conn(0x7fb8a00faab0 msgr2=0x7fb8a00fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:44.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.114+0000 7fb8a7637700 1 -- 172.21.15.92:0/2423941320 shutdown_connections 2023-10-16T13:15:44.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.114+0000 7fb8a7637700 1 -- 172.21.15.92:0/2423941320 wait complete. 2023-10-16T13:15:44.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.114+0000 7fb8a7637700 1 Processor -- start 2023-10-16T13:15:44.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.114+0000 7fb8a7637700 1 -- start start 2023-10-16T13:15:44.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.114+0000 7fb8a7637700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0100040 0x7fb8a00ffaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:44.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.114+0000 7fb8a7637700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8a0100a00 0x7fb8a019b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:44.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.114+0000 7fb8a7637700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a01013f0 0x7fb8a019dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:44.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.114+0000 7fb8a7637700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a019e750 con 0x7fb8a0100040 2023-10-16T13:15:44.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.114+0000 7fb8a7637700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a019e8c0 con 0x7fb8a01013f0 2023-10-16T13:15:44.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.114+0000 7fb8a7637700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a019ea80 con 0x7fb8a0100a00 2023-10-16T13:15:44.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.114+0000 7fb8a53d3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0100040 0x7fb8a00ffaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:44.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.115+0000 7fb8a53d3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0100040 0x7fb8a00ffaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38484/0 (socket says 172.21.15.92:38484) 2023-10-16T13:15:44.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.115+0000 7fb8a53d3700 1 -- 172.21.15.92:0/1699125323 learned_addr learned my addr 172.21.15.92:0/1699125323 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:15:44.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.115+0000 7fb8a5bd4700 1 --2- 172.21.15.92:0/1699125323 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a01013f0 0x7fb8a019dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:44.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.115+0000 7fb8a4bd2700 1 --2- 172.21.15.92:0/1699125323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8a0100a00 0x7fb8a019b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:44.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.115+0000 7fb8a53d3700 1 -- 172.21.15.92:0/1699125323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8a0100a00 msgr2=0x7fb8a019b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:44.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.115+0000 7fb8a53d3700 1 --2- 172.21.15.92:0/1699125323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8a0100a00 0x7fb8a019b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.115+0000 7fb8a53d3700 1 -- 172.21.15.92:0/1699125323 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a01013f0 msgr2=0x7fb8a019dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:44.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.115+0000 7fb8a53d3700 1 --2- 172.21.15.92:0/1699125323 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a01013f0 0x7fb8a019dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.115+0000 7fb8a53d3700 1 -- 172.21.15.92:0/1699125323 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c0095f0 con 0x7fb8a0100040 2023-10-16T13:15:44.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.115+0000 7fb8a53d3700 1 --2- 172.21.15.92:0/1699125323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0100040 0x7fb8a00ffaa0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00b5c0 tx=0x7fb89c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:44.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.115+0000 7fb8967fc700 1 -- 172.21.15.92:0/1699125323 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c01d070 con 0x7fb8a0100040 2023-10-16T13:15:44.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.115+0000 7fb8a7637700 1 -- 172.21.15.92:0/1699125323 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a019ed00 con 0x7fb8a0100040 2023-10-16T13:15:44.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.115+0000 7fb8967fc700 1 -- 172.21.15.92:0/1699125323 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb89c004cb0 con 0x7fb8a0100040 2023-10-16T13:15:44.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.115+0000 7fb8967fc700 1 -- 172.21.15.92:0/1699125323 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c005490 con 0x7fb8a0100040 2023-10-16T13:15:44.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.115+0000 7fb8a7637700 1 -- 172.21.15.92:0/1699125323 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a019f120 con 0x7fb8a0100040 2023-10-16T13:15:44.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.116+0000 7fb8a7637700 1 -- 172.21.15.92:0/1699125323 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a010b730 con 0x7fb8a0100040 2023-10-16T13:15:44.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.117+0000 7fb8967fc700 1 -- 172.21.15.92:0/1699125323 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb89c0047d0 con 0x7fb8a0100040 2023-10-16T13:15:44.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.118+0000 7fb8967fc700 1 --2- 172.21.15.92:0/1699125323 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb88c0a1520 0x7fb88c0a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:44.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.118+0000 7fb8a4bd2700 1 --2- 172.21.15.92:0/1699125323 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb88c0a1520 0x7fb88c0a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:44.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.118+0000 7fb8967fc700 1 -- 172.21.15.92:0/1699125323 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb89c0ce110 con 0x7fb8a0100040 2023-10-16T13:15:44.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.118+0000 7fb8a4bd2700 1 --2- 172.21.15.92:0/1699125323 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb88c0a1520 0x7fb88c0a39e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb890005950 tx=0x7fb8900058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:44.126 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.122+0000 7fb8967fc700 1 -- 172.21.15.92:0/1699125323 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb89c097800 con 0x7fb8a0100040 2023-10-16T13:15:44.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.359+0000 7fb8a7637700 1 -- 172.21.15.92:0/1699125323 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8a010b9e0 con 0x7fb8a0100040 2023-10-16T13:15:44.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.359+0000 7fb8967fc700 1 -- 172.21.15.92:0/1699125323 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+11395 (secure 0 0 0) 0x7fb89c09ae20 con 0x7fb8a0100040 2023-10-16T13:15:44.362 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:15:44.362 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/1011037392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":1011037392},{"type":"v1","addr":"172.21.15.92:6835","nonce":1011037392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4269964747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":4269964747},{"type":"v1","addr":"172.21.15.92:6837","nonce":4269964747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-16T13:11:40.343309+0000","modified":"2023-10-16T13:15:07.109346+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24490,"mds_2":24460,"mds_3":24428,"mds_4":24412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1790514945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1790514945},{"type":"v1","addr":"172.21.15.92:6839","nonce":1790514945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/1016260236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1016260236},{"type":"v1","addr":"172.21.15.92:6841","nonce":1016260236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24410":{"gid":24410,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/1243983806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1243983806},{"type":"v1","addr":"172.21.15.118:6833","nonce":1243983806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6833/1273074399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1273074399},{"type":"v1","addr":"172.21.15.152:6833","nonce":1273074399}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.118:6835/2381374755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2381374755},{"type":"v1","addr":"172.21.15.118:6835","nonce":2381374755}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1393840132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1393840132},{"type":"v1","addr":"172.21.15.152:6835","nonce":1393840132}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/2133613540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":2133613540},{"type":"v1","addr":"172.21.15.118:6837","nonce":2133613540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6837/2403096460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":2403096460},{"type":"v1","addr":"172.21.15.152:6837","nonce":2403096460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":47,"addr":"172.21.15.152:6839/1821921588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1821921588},{"type":"v1","addr":"172.21.15.152:6839","nonce":1821921588}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6839/1577355936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":1577355936},{"type":"v1","addr":"172.21.15.118:6839","nonce":1577355936}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:15:44.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.362+0000 7fb8a7637700 1 -- 172.21.15.92:0/1699125323 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb88c0a1520 msgr2=0x7fb88c0a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:44.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.362+0000 7fb8a7637700 1 --2- 172.21.15.92:0/1699125323 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb88c0a1520 0x7fb88c0a39e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb890005950 tx=0x7fb8900058e0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.362+0000 7fb8a7637700 1 -- 172.21.15.92:0/1699125323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0100040 msgr2=0x7fb8a00ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:44.364 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.362+0000 7fb8a7637700 1 --2- 172.21.15.92:0/1699125323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0100040 0x7fb8a00ffaa0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00b5c0 tx=0x7fb89c00f690 comp rx=0 tx=0).stop 2023-10-16T13:15:44.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.362+0000 7fb8a7637700 1 -- 172.21.15.92:0/1699125323 shutdown_connections 2023-10-16T13:15:44.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.362+0000 7fb8a7637700 1 --2- 172.21.15.92:0/1699125323 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7fb88c0a1520 0x7fb88c0a39e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.362+0000 7fb8a7637700 1 --2- 172.21.15.92:0/1699125323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0100040 0x7fb8a00ffaa0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.362+0000 7fb8a7637700 1 --2- 172.21.15.92:0/1699125323 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a01013f0 0x7fb8a019dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.362+0000 7fb8a7637700 1 --2- 172.21.15.92:0/1699125323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8a0100a00 0x7fb8a019b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.362+0000 7fb8a7637700 1 -- 172.21.15.92:0/1699125323 >> 172.21.15.92:0/1699125323 conn(0x7fb8a00faab0 msgr2=0x7fb8a00fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:44.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.362+0000 7fb8a7637700 1 -- 172.21.15.92:0/1699125323 shutdown_connections 2023-10-16T13:15:44.366 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.362+0000 7fb8a7637700 1 -- 172.21.15.92:0/1699125323 wait complete. 2023-10-16T13:15:44.367 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 37 2023-10-16T13:15:44.376 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:15:44.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.497+0000 7f766ccec700 1 -- 172.21.15.92:0/1273550787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76680ffe30 msgr2=0x7f7668100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:44.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.497+0000 7f766ccec700 1 --2- 172.21.15.92:0/1273550787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76680ffe30 0x7f7668100250 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7658009990 tx=0x7f7658009ca0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.497+0000 7f766ccec700 1 -- 172.21.15.92:0/1273550787 shutdown_connections 2023-10-16T13:15:44.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.497+0000 7f766ccec700 1 --2- 172.21.15.92:0/1273550787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76680ffe30 0x7f7668100250 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.497+0000 7f766ccec700 1 --2- 172.21.15.92:0/1273550787 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7668101940 0x7f7668108260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.497+0000 7f766ccec700 1 --2- 172.21.15.92:0/1273550787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7668100f80 0x7f7668101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.497+0000 7f766ccec700 1 -- 172.21.15.92:0/1273550787 >> 172.21.15.92:0/1273550787 conn(0x7f76680fb380 msgr2=0x7f76680fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:44.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.497+0000 7f766ccec700 1 -- 172.21.15.92:0/1273550787 shutdown_connections 2023-10-16T13:15:44.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.497+0000 7f766ccec700 1 -- 172.21.15.92:0/1273550787 wait complete. 2023-10-16T13:15:44.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.498+0000 7f766ccec700 1 Processor -- start 2023-10-16T13:15:44.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.498+0000 7f766ccec700 1 -- start start 2023-10-16T13:15:44.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.498+0000 7f766ccec700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76680ffe30 0x7f7668069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:44.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.498+0000 7f766ccec700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7668100f80 0x7f766819b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:44.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.498+0000 7f766ccec700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7668101940 0x7f766819df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:44.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.498+0000 7f766ccec700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766819e6e0 con 0x7f7668101940 2023-10-16T13:15:44.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.498+0000 7f766ccec700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766819e850 con 0x7f7668100f80 2023-10-16T13:15:44.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.498+0000 7f766ccec700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766819ea10 con 0x7f76680ffe30 2023-10-16T13:15:44.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.498+0000 7f7666d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7668101940 0x7f766819df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:44.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.498+0000 7f7666d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7668101940 0x7f766819df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38502/0 (socket says 172.21.15.92:38502) 2023-10-16T13:15:44.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.498+0000 7f7666d9d700 1 -- 172.21.15.92:0/926026289 learned_addr learned my addr 172.21.15.92:0/926026289 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:15:44.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.498+0000 7f7665d9b700 1 --2- 172.21.15.92:0/926026289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7668100f80 0x7f766819b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:44.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.498+0000 7f766659c700 1 --2- 172.21.15.92:0/926026289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76680ffe30 0x7f7668069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:44.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.498+0000 7f7666d9d700 1 -- 172.21.15.92:0/926026289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76680ffe30 msgr2=0x7f7668069dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:44.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.498+0000 7f7666d9d700 1 --2- 172.21.15.92:0/926026289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76680ffe30 0x7f7668069dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.498+0000 7f7666d9d700 1 -- 172.21.15.92:0/926026289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7668100f80 msgr2=0x7f766819b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:44.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.498+0000 7f7666d9d700 1 --2- 172.21.15.92:0/926026289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7668100f80 0x7f766819b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.498+0000 7f7666d9d700 1 -- 172.21.15.92:0/926026289 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76580095f0 con 0x7f7668101940 2023-10-16T13:15:44.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.498+0000 7f7666d9d700 1 --2- 172.21.15.92:0/926026289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7668101940 0x7f766819df10 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7660007ee0 tx=0x7f766000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:44.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.499+0000 7f76577fe700 1 -- 172.21.15.92:0/926026289 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766000ddd0 con 0x7f7668101940 2023-10-16T13:15:44.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.499+0000 7f76577fe700 1 -- 172.21.15.92:0/926026289 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f766000f040 con 0x7f7668101940 2023-10-16T13:15:44.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.499+0000 7f766ccec700 1 -- 172.21.15.92:0/926026289 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766819ecf0 con 0x7f7668101940 2023-10-16T13:15:44.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.499+0000 7f76577fe700 1 -- 172.21.15.92:0/926026289 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660015400 con 0x7f7668101940 2023-10-16T13:15:44.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.499+0000 7f766ccec700 1 -- 172.21.15.92:0/926026289 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766819f1b0 con 0x7f7668101940 2023-10-16T13:15:44.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.500+0000 7f766ccec700 1 -- 172.21.15.92:0/926026289 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766810b7d0 con 0x7f7668101940 2023-10-16T13:15:44.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.500+0000 7f76577fe700 1 -- 172.21.15.92:0/926026289 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7660003a00 con 0x7f7668101940 2023-10-16T13:15:44.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.501+0000 7f76577fe700 1 --2- 172.21.15.92:0/926026289 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f76500a1520 0x7f76500a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:44.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.501+0000 7f766659c700 1 --2- 172.21.15.92:0/926026289 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f76500a1520 0x7f76500a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:44.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.501+0000 7f76577fe700 1 -- 172.21.15.92:0/926026289 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f76600cc5e0 con 0x7f7668101940 2023-10-16T13:15:44.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.502+0000 7f766659c700 1 --2- 172.21.15.92:0/926026289 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f76500a1520 0x7f76500a39e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f765800b5c0 tx=0x7f7658005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:44.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.506+0000 7f76577fe700 1 -- 172.21.15.92:0/926026289 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f766004f100 con 0x7f7668101940 2023-10-16T13:15:44.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.700+0000 7f766ccec700 1 -- 172.21.15.92:0/926026289 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f766819f340 con 0x7f7668101940 2023-10-16T13:15:44.703 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.701+0000 7f76577fe700 1 -- 172.21.15.92:0/926026289 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22598 (secure 0 0 0) 0x7f7660095c40 con 0x7f7668101940 2023-10-16T13:15:44.704 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-16T13:15:44.704 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":85,"fsid":"6c276d7e-6c24-11ee-8db6-212e2dc638e7","created":"2023-10-16T13:04:39.975522+0000","modified":"2023-10-16T13:12:36.335213+0000","last_up_change":"2023-10-16T13:10:56.821461+0000","last_in_change":"2023-10-16T13:10:38.792061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:07:45.516334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:11:38.345035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:11:39.549912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6aa1b3b6-7395-4c31-84e7-9a68dbed218e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6803","nonce":209585261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6805","nonce":209585261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6809","nonce":209585261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":209585261},{"type":"v1","addr":"172.21.15.92:6807","nonce":209585261}]},"public_addr":"172.21.15.92:6803/209585261","cluster_addr":"172.21.15.92:6805/209585261","heartbeat_back_addr":"172.21.15.92:6809/209585261","heartbeat_front_addr":"172.21.15.92:6807/209585261","state":["exists","up"]},{"osd":1,"uuid":"ee68f65f-99c2-4bb9-9a7d-a6239cf9660e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6801","nonce":106427465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6803","nonce":106427465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6807","nonce":106427465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":106427465},{"type":"v1","addr":"172.21.15.118:6805","nonce":106427465}]},"public_addr":"172.21.15.118:6801/106427465","cluster_addr":"172.21.15.118:6803/106427465","heartbeat_back_addr":"172.21.15.118:6807/106427465","heartbeat_front_addr":"172.21.15.118:6805/106427465","state":["exists","up"]},{"osd":2,"uuid":"094dbf98-7978-4174-a403-1df4105a77e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6801","nonce":304464027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6803","nonce":304464027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6807","nonce":304464027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":304464027},{"type":"v1","addr":"172.21.15.152:6805","nonce":304464027}]},"public_addr":"172.21.15.152:6801/304464027","cluster_addr":"172.21.15.152:6803/304464027","heartbeat_back_addr":"172.21.15.152:6807/304464027","heartbeat_front_addr":"172.21.15.152:6805/304464027","state":["exists","up"]},{"osd":3,"uuid":"7e6002e4-6baa-435a-90e2-34092f9548e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6811","nonce":1274183450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6813","nonce":1274183450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6817","nonce":1274183450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1274183450},{"type":"v1","addr":"172.21.15.92:6815","nonce":1274183450}]},"public_addr":"172.21.15.92:6811/1274183450","cluster_addr":"172.21.15.92:6813/1274183450","heartbeat_back_addr":"172.21.15.92:6817/1274183450","heartbeat_front_addr":"172.21.15.92:6815/1274183450","state":["exists","up"]},{"osd":4,"uuid":"ea9862ef-7323-44e2-bed6-191f1a01b94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6809","nonce":3903514094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6811","nonce":3903514094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6815","nonce":3903514094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3903514094},{"type":"v1","addr":"172.21.15.118:6813","nonce":3903514094}]},"public_addr":"172.21.15.118:6809/3903514094","cluster_addr":"172.21.15.118:6811/3903514094","heartbeat_back_addr":"172.21.15.118:6815/3903514094","heartbeat_front_addr":"172.21.15.118:6813/3903514094","state":["exists","up"]},{"osd":5,"uuid":"cb550e84-333c-4c46-b1c8-5bc29237fd34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6809","nonce":3958877515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6811","nonce":3958877515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6815","nonce":3958877515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3958877515},{"type":"v1","addr":"172.21.15.152:6813","nonce":3958877515}]},"public_addr":"172.21.15.152:6809/3958877515","cluster_addr":"172.21.15.152:6811/3958877515","heartbeat_back_addr":"172.21.15.152:6815/3958877515","heartbeat_front_addr":"172.21.15.152:6813/3958877515","state":["exists","up"]},{"osd":6,"uuid":"9f93ad94-3117-44cc-ab85-5fbee3f68f56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6819","nonce":3198015740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6821","nonce":3198015740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6825","nonce":3198015740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3198015740},{"type":"v1","addr":"172.21.15.92:6823","nonce":3198015740}]},"public_addr":"172.21.15.92:6819/3198015740","cluster_addr":"172.21.15.92:6821/3198015740","heartbeat_back_addr":"172.21.15.92:6825/3198015740","heartbeat_front_addr":"172.21.15.92:6823/3198015740","state":["exists","up"]},{"osd":7,"uuid":"5b32e20e-f395-41b8-aafe-7455c630490c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6817","nonce":3103702893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6819","nonce":3103702893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6823","nonce":3103702893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3103702893},{"type":"v1","addr":"172.21.15.118:6821","nonce":3103702893}]},"public_addr":"172.21.15.118:6817/3103702893","cluster_addr":"172.21.15.118:6819/3103702893","heartbeat_back_addr":"172.21.15.118:6823/3103702893","heartbeat_front_addr":"172.21.15.118:6821/3103702893","state":["exists","up"]},{"osd":8,"uuid":"0ee11b20-7519-44ad-aa47-53df8dea3a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6817","nonce":3968044260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6819","nonce":3968044260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6823","nonce":3968044260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3968044260},{"type":"v1","addr":"172.21.15.152:6821","nonce":3968044260}]},"public_addr":"172.21.15.152:6817/3968044260","cluster_addr":"172.21.15.152:6819/3968044260","heartbeat_back_addr":"172.21.15.152:6823/3968044260","heartbeat_front_addr":"172.21.15.152:6821/3968044260","state":["exists","up"]},{"osd":9,"uuid":"bf985086-cb42-4def-9d17-317345e66f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6827","nonce":3153036271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6829","nonce":3153036271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6833","nonce":3153036271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3153036271},{"type":"v1","addr":"172.21.15.92:6831","nonce":3153036271}]},"public_addr":"172.21.15.92:6827/3153036271","cluster_addr":"172.21.15.92:6829/3153036271","heartbeat_back_addr":"172.21.15.92:6833/3153036271","heartbeat_front_addr":"172.21.15.92:6831/3153036271","state":["exists","up"]},{"osd":10,"uuid":"835ac2f9-3615-42f3-bb6d-037f3c1fc192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6825","nonce":3622143535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6827","nonce":3622143535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6831","nonce":3622143535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3622143535},{"type":"v1","addr":"172.21.15.118:6829","nonce":3622143535}]},"public_addr":"172.21.15.118:6825/3622143535","cluster_addr":"172.21.15.118:6827/3622143535","heartbeat_back_addr":"172.21.15.118:6831/3622143535","heartbeat_front_addr":"172.21.15.118:6829/3622143535","state":["exists","up"]},{"osd":11,"uuid":"30d2e40e-290f-48a0-bf74-f6f7b5ff659c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6825","nonce":3082644763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6827","nonce":3082644763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6831","nonce":3082644763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3082644763},{"type":"v1","addr":"172.21.15.152:6829","nonce":3082644763}]},"public_addr":"172.21.15.152:6825/3082644763","cluster_addr":"172.21.15.152:6827/3082644763","heartbeat_back_addr":"172.21.15.152:6831/3082644763","heartbeat_front_addr":"172.21.15.152:6829/3082644763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:06:59.251432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:20.330897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:07:42.087410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:03.838021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:24.778534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:08:46.133640+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:08.085111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:29.625298+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:09:50.742578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:12.337417+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:33.663673+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:10:54.947924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/1517475646":"2023-10-17T13:05:35.186467+0000","172.21.15.92:6801/1487044137":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1407513743":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/1513871374":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1527476864":"2023-10-17T13:05:11.104167+0000","172.21.15.92:0/1790054192":"2023-10-17T13:05:35.186467+0000","172.21.15.92:0/3362128136":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6801/184191966":"2023-10-17T13:05:11.104167+0000","172.21.15.92:6800/1487044137":"2023-10-17T13:05:35.186467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:15:44.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.704+0000 7f766ccec700 1 -- 172.21.15.92:0/926026289 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f76500a1520 msgr2=0x7f76500a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:44.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.704+0000 7f766ccec700 1 --2- 172.21.15.92:0/926026289 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f76500a1520 0x7f76500a39e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f765800b5c0 tx=0x7f7658005fb0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.704+0000 7f766ccec700 1 -- 172.21.15.92:0/926026289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7668101940 msgr2=0x7f766819df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:44.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.704+0000 7f766ccec700 1 --2- 172.21.15.92:0/926026289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7668101940 0x7f766819df10 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7660007ee0 tx=0x7f766000d3b0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.704+0000 7f766ccec700 1 -- 172.21.15.92:0/926026289 shutdown_connections 2023-10-16T13:15:44.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.704+0000 7f766ccec700 1 --2- 172.21.15.92:0/926026289 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f76500a1520 0x7f76500a39e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.704+0000 7f766ccec700 1 --2- 172.21.15.92:0/926026289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7668101940 0x7f766819df10 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.704+0000 7f766ccec700 1 --2- 172.21.15.92:0/926026289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76680ffe30 0x7f7668069dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.704+0000 7f766ccec700 1 --2- 172.21.15.92:0/926026289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7668100f80 0x7f766819b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.704+0000 7f766ccec700 1 -- 172.21.15.92:0/926026289 >> 172.21.15.92:0/926026289 conn(0x7f76680fb380 msgr2=0x7f76680fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:44.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.704+0000 7f766ccec700 1 -- 172.21.15.92:0/926026289 shutdown_connections 2023-10-16T13:15:44.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.704+0000 7f766ccec700 1 -- 172.21.15.92:0/926026289 wait complete. 2023-10-16T13:15:44.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:44 smithi092 ceph-mon[99542]: pgmap v379: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2023-10-16T13:15:44.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:44 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3795441804' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:15:44.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:44 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1699125323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:15:44.719 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-16T13:15:44.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:44 smithi118 ceph-mon[103969]: pgmap v379: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2023-10-16T13:15:44.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:44 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3795441804' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:15:44.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:44 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1699125323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:15:44.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.840+0000 7f5ddda15700 1 -- 172.21.15.92:0/3749699160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dd8100a30 msgr2=0x7f5dd81082f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:44.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.840+0000 7f5ddda15700 1 --2- 172.21.15.92:0/3749699160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dd8100a30 0x7f5dd81082f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000b0a0 tx=0x7f5dd000b3b0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.840+0000 7f5ddda15700 1 -- 172.21.15.92:0/3749699160 shutdown_connections 2023-10-16T13:15:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.840+0000 7f5ddda15700 1 --2- 172.21.15.92:0/3749699160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dd8100a30 0x7f5dd81082f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.840+0000 7f5ddda15700 1 --2- 172.21.15.92:0/3749699160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dd8101360 0x7f5dd8101780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.840+0000 7f5ddda15700 1 --2- 172.21.15.92:0/3749699160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd8100090 0x7f5dd81004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.840+0000 7f5ddda15700 1 -- 172.21.15.92:0/3749699160 >> 172.21.15.92:0/3749699160 conn(0x7f5dd80faac0 msgr2=0x7f5dd80fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.840+0000 7f5ddda15700 1 -- 172.21.15.92:0/3749699160 shutdown_connections 2023-10-16T13:15:44.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.840+0000 7f5ddda15700 1 -- 172.21.15.92:0/3749699160 wait complete. 2023-10-16T13:15:44.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.841+0000 7f5ddda15700 1 Processor -- start 2023-10-16T13:15:44.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.841+0000 7f5ddda15700 1 -- start start 2023-10-16T13:15:44.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.841+0000 7f5ddda15700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dd8100090 0x7f5dd80ffb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:44.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.841+0000 7f5ddda15700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd8100a30 0x7f5dd819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:44.847 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.841+0000 7f5ddda15700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dd8101360 0x7f5dd819e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:44.847 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.841+0000 7f5ddda15700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd819e7e0 con 0x7f5dd8100090 2023-10-16T13:15:44.847 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.841+0000 7f5ddda15700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd819e950 con 0x7f5dd8100a30 2023-10-16T13:15:44.847 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.841+0000 7f5ddda15700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd819eb10 con 0x7f5dd8101360 2023-10-16T13:15:44.847 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.841+0000 7f5dd6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dd8100090 0x7f5dd80ffb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:44.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.841+0000 7f5dd6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dd8100090 0x7f5dd80ffb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38512/0 (socket says 172.21.15.92:38512) 2023-10-16T13:15:44.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.841+0000 7f5dd6ffd700 1 -- 172.21.15.92:0/2150983600 learned_addr learned my addr 172.21.15.92:0/2150983600 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:15:44.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.841+0000 7f5dd77fe700 1 --2- 172.21.15.92:0/2150983600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dd8101360 0x7f5dd819e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:44.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.841+0000 7f5dd6ffd700 1 -- 172.21.15.92:0/2150983600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dd8101360 msgr2=0x7f5dd819e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:44.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.841+0000 7f5dd6ffd700 1 --2- 172.21.15.92:0/2150983600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dd8101360 0x7f5dd819e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.841+0000 7f5dd6ffd700 1 -- 172.21.15.92:0/2150983600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd8100a30 msgr2=0x7f5dd819b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:44.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.841+0000 7f5dd67fc700 1 --2- 172.21.15.92:0/2150983600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd8100a30 0x7f5dd819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:44.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.841+0000 7f5dd6ffd700 1 --2- 172.21.15.92:0/2150983600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd8100a30 0x7f5dd819b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:44.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.841+0000 7f5dd6ffd700 1 -- 172.21.15.92:0/2150983600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd0009d00 con 0x7f5dd8100090 2023-10-16T13:15:44.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.841+0000 7f5dd77fe700 1 --2- 172.21.15.92:0/2150983600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dd8101360 0x7f5dd819e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:15:44.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.842+0000 7f5dd6ffd700 1 --2- 172.21.15.92:0/2150983600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dd8100090 0x7f5dd80ffb10 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00c990 tx=0x7f5dcc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:44.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.842+0000 7f5ddca13700 1 -- 172.21.15.92:0/2150983600 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc007b00 con 0x7f5dd8100090 2023-10-16T13:15:44.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.842+0000 7f5ddda15700 1 -- 172.21.15.92:0/2150983600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd819edf0 con 0x7f5dd8100090 2023-10-16T13:15:44.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.842+0000 7f5ddca13700 1 -- 172.21.15.92:0/2150983600 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5dcc007c60 con 0x7f5dd8100090 2023-10-16T13:15:44.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.842+0000 7f5ddca13700 1 -- 172.21.15.92:0/2150983600 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc018660 con 0x7f5dd8100090 2023-10-16T13:15:44.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.842+0000 7f5ddda15700 1 -- 172.21.15.92:0/2150983600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd819f270 con 0x7f5dd8100090 2023-10-16T13:15:44.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.843+0000 7f5ddda15700 1 -- 172.21.15.92:0/2150983600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd8107310 con 0x7f5dd8100090 2023-10-16T13:15:44.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.844+0000 7f5ddca13700 1 -- 172.21.15.92:0/2150983600 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5dcc00f450 con 0x7f5dd8100090 2023-10-16T13:15:44.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.844+0000 7f5ddca13700 1 --2- 172.21.15.92:0/2150983600 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5dc00a14d0 0x7f5dc00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:44.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.844+0000 7f5dd67fc700 1 --2- 172.21.15.92:0/2150983600 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5dc00a14d0 0x7f5dc00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:44.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.844+0000 7f5ddca13700 1 -- 172.21.15.92:0/2150983600 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5dcc0cccf0 con 0x7f5dd8100090 2023-10-16T13:15:44.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.845+0000 7f5dd67fc700 1 --2- 172.21.15.92:0/2150983600 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5dc00a14d0 0x7f5dc00a3990 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5dd80ff880 tx=0x7f5dc8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:44.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:44.848+0000 7f5ddca13700 1 -- 172.21.15.92:0/2150983600 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5dcc096350 con 0x7f5dd8100090 2023-10-16T13:15:44.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:44 smithi152 ceph-mon[104423]: pgmap v379: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2023-10-16T13:15:44.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:44 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3795441804' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:15:44.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:44 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1699125323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-16T13:15:45.086 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.082+0000 7f5ddda15700 1 -- 172.21.15.92:0/2150983600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5dd802d240 con 0x7f5dd8100090 2023-10-16T13:15:45.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.085+0000 7f5ddca13700 1 -- 172.21.15.92:0/2150983600 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5dcc099970 con 0x7f5dd8100090 2023-10-16T13:15:45.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.088+0000 7f5ddda15700 1 -- 172.21.15.92:0/2150983600 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5dc00a14d0 msgr2=0x7f5dc00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:45.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.088+0000 7f5ddda15700 1 --2- 172.21.15.92:0/2150983600 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5dc00a14d0 0x7f5dc00a3990 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5dd80ff880 tx=0x7f5dc8009260 comp rx=0 tx=0).stop 2023-10-16T13:15:45.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.088+0000 7f5ddda15700 1 -- 172.21.15.92:0/2150983600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dd8100090 msgr2=0x7f5dd80ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:45.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.088+0000 7f5ddda15700 1 --2- 172.21.15.92:0/2150983600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dd8100090 0x7f5dd80ffb10 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00c990 tx=0x7f5dcc00cd50 comp rx=0 tx=0).stop 2023-10-16T13:15:45.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.089+0000 7f5ddda15700 1 -- 172.21.15.92:0/2150983600 shutdown_connections 2023-10-16T13:15:45.092 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.089+0000 7f5ddda15700 1 --2- 172.21.15.92:0/2150983600 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f5dc00a14d0 0x7f5dc00a3990 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:45.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.089+0000 7f5ddda15700 1 --2- 172.21.15.92:0/2150983600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dd8100090 0x7f5dd80ffb10 secure :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00c990 tx=0x7f5dcc00cd50 comp rx=0 tx=0).stop 2023-10-16T13:15:45.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.089+0000 7f5ddda15700 1 --2- 172.21.15.92:0/2150983600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dd8101360 0x7f5dd819e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:45.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.089+0000 7f5ddda15700 1 --2- 172.21.15.92:0/2150983600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd8100a30 0x7f5dd819b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:45.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.089+0000 7f5ddda15700 1 -- 172.21.15.92:0/2150983600 >> 172.21.15.92:0/2150983600 conn(0x7f5dd80faac0 msgr2=0x7f5dd8104450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:45.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.089+0000 7f5ddda15700 1 -- 172.21.15.92:0/2150983600 shutdown_connections 2023-10-16T13:15:45.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.089+0000 7f5ddda15700 1 -- 172.21.15.92:0/2150983600 wait complete. 2023-10-16T13:15:45.094 INFO:teuthology.orchestra.run.smithi092.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-16T13:15:45.105 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-16T13:15:45.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.231+0000 7f48a643e700 1 -- 172.21.15.92:0/3765086712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a0102bb0 msgr2=0x7f48a0109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:45.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.231+0000 7f48a643e700 1 --2- 172.21.15.92:0/3765086712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a0102bb0 0x7f48a0109460 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f489800b0a0 tx=0x7f489800b3b0 comp rx=0 tx=0).stop 2023-10-16T13:15:45.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.231+0000 7f48a643e700 1 -- 172.21.15.92:0/3765086712 shutdown_connections 2023-10-16T13:15:45.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.231+0000 7f48a643e700 1 --2- 172.21.15.92:0/3765086712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a0102bb0 0x7f48a0109460 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:45.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.231+0000 7f48a643e700 1 --2- 172.21.15.92:0/3765086712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48a00ff1a0 0x7f48a00ff5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:45.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.231+0000 7f48a643e700 1 --2- 172.21.15.92:0/3765086712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48a0102210 0x7f48a0102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:45.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.231+0000 7f48a643e700 1 -- 172.21.15.92:0/3765086712 >> 172.21.15.92:0/3765086712 conn(0x7f48a00faa90 msgr2=0x7f48a00fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:45.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.231+0000 7f48a643e700 1 -- 172.21.15.92:0/3765086712 shutdown_connections 2023-10-16T13:15:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.231+0000 7f48a643e700 1 -- 172.21.15.92:0/3765086712 wait complete. 2023-10-16T13:15:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.232+0000 7f48a643e700 1 Processor -- start 2023-10-16T13:15:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.232+0000 7f48a643e700 1 -- start start 2023-10-16T13:15:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.232+0000 7f48a643e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a00ff1a0 0x7f48a0196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.232+0000 7f48a643e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48a0102210 0x7f48a01972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.232+0000 7f48a643e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48a0102bb0 0x7f48a019e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.232+0000 7f48a643e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a019e8e0 con 0x7f48a00ff1a0 2023-10-16T13:15:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.232+0000 7f48a643e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a019ea20 con 0x7f48a0102bb0 2023-10-16T13:15:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.232+0000 7f48a643e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a019ebb0 con 0x7f48a0102210 2023-10-16T13:15:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.232+0000 7f489ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a00ff1a0 0x7f48a0196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.232+0000 7f489ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a00ff1a0 0x7f48a0196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38550/0 (socket says 172.21.15.92:38550) 2023-10-16T13:15:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.232+0000 7f489ffff700 1 -- 172.21.15.92:0/3820198269 learned_addr learned my addr 172.21.15.92:0/3820198269 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:15:45.242 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.232+0000 7f48a49db700 1 --2- 172.21.15.92:0/3820198269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48a0102bb0 0x7f48a019e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:45.242 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.233+0000 7f489f7fe700 1 --2- 172.21.15.92:0/3820198269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48a0102210 0x7f48a01972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:45.242 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.233+0000 7f489ffff700 1 -- 172.21.15.92:0/3820198269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48a0102210 msgr2=0x7f48a01972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:45.242 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.233+0000 7f489ffff700 1 --2- 172.21.15.92:0/3820198269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48a0102210 0x7f48a01972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.233+0000 7f489ffff700 1 -- 172.21.15.92:0/3820198269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48a0102bb0 msgr2=0x7f48a019e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.233+0000 7f489ffff700 1 --2- 172.21.15.92:0/3820198269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48a0102bb0 0x7f48a019e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.233+0000 7f489ffff700 1 -- 172.21.15.92:0/3820198269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4898009d00 con 0x7f48a00ff1a0 2023-10-16T13:15:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.233+0000 7f489ffff700 1 --2- 172.21.15.92:0/3820198269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a00ff1a0 0x7f48a0196d60 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f489000e970 tx=0x7f489000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.233+0000 7f489d7fa700 1 -- 172.21.15.92:0/3820198269 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890009790 con 0x7f48a00ff1a0 2023-10-16T13:15:45.244 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.233+0000 7f489d7fa700 1 -- 172.21.15.92:0/3820198269 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f489000eec0 con 0x7f48a00ff1a0 2023-10-16T13:15:45.244 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.233+0000 7f48a643e700 1 -- 172.21.15.92:0/3820198269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a019ee90 con 0x7f48a00ff1a0 2023-10-16T13:15:45.244 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.233+0000 7f489d7fa700 1 -- 172.21.15.92:0/3820198269 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890003d90 con 0x7f48a00ff1a0 2023-10-16T13:15:45.244 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.233+0000 7f48a643e700 1 -- 172.21.15.92:0/3820198269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a019f2b0 con 0x7f48a00ff1a0 2023-10-16T13:15:45.244 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.234+0000 7f48a643e700 1 -- 172.21.15.92:0/3820198269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a0108560 con 0x7f48a00ff1a0 2023-10-16T13:15:45.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.235+0000 7f489d7fa700 1 -- 172.21.15.92:0/3820198269 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4890004000 con 0x7f48a00ff1a0 2023-10-16T13:15:45.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.235+0000 7f489d7fa700 1 --2- 172.21.15.92:0/3820198269 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f48880a1480 0x7f48880a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:45.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.236+0000 7f489d7fa700 1 -- 172.21.15.92:0/3820198269 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8670+0+0 (secure 0 0 0) 0x7f4890014070 con 0x7f48a00ff1a0 2023-10-16T13:15:45.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.236+0000 7f489f7fe700 1 --2- 172.21.15.92:0/3820198269 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f48880a1480 0x7f48880a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:45.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.236+0000 7f489f7fe700 1 --2- 172.21.15.92:0/3820198269 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f48880a1480 0x7f48880a3940 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4894009bf0 tx=0x7f4894009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:45.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.240+0000 7f489d7fa700 1 -- 172.21.15.92:0/3820198269 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4890096580 con 0x7f48a00ff1a0 2023-10-16T13:15:45.443 INFO:journalctl@ceph.mds.c.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-c[142011]: ignoring --setuser ceph since I am not root 2023-10-16T13:15:45.443 INFO:journalctl@ceph.mds.c.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-c[142011]: ignoring --setgroup ceph since I am not root 2023-10-16T13:15:45.443 INFO:journalctl@ceph.mds.c.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-mds[142035]: -- 172.21.15.152:0/1521742543 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564ce09031e0 con 0x564ce08d8c00 2023-10-16T13:15:45.444 INFO:journalctl@ceph.mds.c.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-c[142011]: starting mds.c at 2023-10-16T13:15:45.444 INFO:journalctl@ceph.mds.f.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-f[141669]: ignoring --setuser ceph since I am not root 2023-10-16T13:15:45.444 INFO:journalctl@ceph.mds.f.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-f[141669]: ignoring --setgroup ceph since I am not root 2023-10-16T13:15:45.445 INFO:journalctl@ceph.mds.f.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-mds[141693]: -- 172.21.15.152:0/2789139926 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562172d1f1e0 con 0x562172cf4c00 2023-10-16T13:15:45.445 INFO:journalctl@ceph.mds.f.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-f[141669]: starting mds.f at 2023-10-16T13:15:45.445 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: ignoring --setuser ceph since I am not root 2023-10-16T13:15:45.446 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: ignoring --setgroup ceph since I am not root 2023-10-16T13:15:45.446 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-mds[142373]: -- 172.21.15.152:0/1375421609 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b5de8991e0 con 0x55b5de86e800 2023-10-16T13:15:45.446 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: starting mds.i at 2023-10-16T13:15:45.446 INFO:journalctl@ceph.mds.l.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-l[141328]: ignoring --setuser ceph since I am not root 2023-10-16T13:15:45.447 INFO:journalctl@ceph.mds.l.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-l[141328]: ignoring --setgroup ceph since I am not root 2023-10-16T13:15:45.447 INFO:journalctl@ceph.mds.l.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-l[141328]: starting mds.l at 2023-10-16T13:15:45.462 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:45 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mon-a[99518]: 2023-10-16T13:15:45.083+0000 7f1a175f7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T13:15:45.462 INFO:journalctl@ceph.mds.a.smithi092.stdout:Oct 16 13:15:45 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-a[150771]: ignoring --setuser ceph since I am not root 2023-10-16T13:15:45.463 INFO:journalctl@ceph.mds.a.smithi092.stdout:Oct 16 13:15:45 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-a[150771]: ignoring --setgroup ceph since I am not root 2023-10-16T13:15:45.463 INFO:journalctl@ceph.mds.a.smithi092.stdout:Oct 16 13:15:45 smithi092 ceph-mds[150795]: -- 172.21.15.92:0/1414736506 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e3ca0e11e0 con 0x55e3ca0b6c00 2023-10-16T13:15:45.463 INFO:journalctl@ceph.mds.a.smithi092.stdout:Oct 16 13:15:45 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-a[150771]: starting mds.a at 2023-10-16T13:15:45.463 INFO:journalctl@ceph.mds.g.smithi092.stdout:Oct 16 13:15:45 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-g[150383]: ignoring --setuser ceph since I am not root 2023-10-16T13:15:45.464 INFO:journalctl@ceph.mds.g.smithi092.stdout:Oct 16 13:15:45 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-g[150383]: ignoring --setgroup ceph since I am not root 2023-10-16T13:15:45.464 INFO:journalctl@ceph.mds.g.smithi092.stdout:Oct 16 13:15:45 smithi092 ceph-mds[150408]: -- 172.21.15.92:0/1679693819 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561b81ab51e0 con 0x561b81a8ac00 2023-10-16T13:15:45.465 INFO:journalctl@ceph.mds.g.smithi092.stdout:Oct 16 13:15:45 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-g[150383]: starting mds.g at 2023-10-16T13:15:45.465 INFO:journalctl@ceph.mds.h.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-h[141071]: ignoring --setuser ceph since I am not root 2023-10-16T13:15:45.465 INFO:journalctl@ceph.mds.h.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-h[141071]: ignoring --setgroup ceph since I am not root 2023-10-16T13:15:45.466 INFO:journalctl@ceph.mds.h.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-h[141071]: starting mds.h at 2023-10-16T13:15:45.466 INFO:journalctl@ceph.mds.b.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-b[141414]: ignoring --setuser ceph since I am not root 2023-10-16T13:15:45.467 INFO:journalctl@ceph.mds.b.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-b[141414]: ignoring --setgroup ceph since I am not root 2023-10-16T13:15:45.467 INFO:journalctl@ceph.mds.b.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-mds[141438]: -- 172.21.15.118:0/2551734737 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55faa8c311e0 con 0x55faa8c06800 2023-10-16T13:15:45.467 INFO:journalctl@ceph.mds.b.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-b[141414]: starting mds.b at 2023-10-16T13:15:45.467 INFO:journalctl@ceph.mds.k.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-k[140380]: ignoring --setuser ceph since I am not root 2023-10-16T13:15:45.468 INFO:journalctl@ceph.mds.k.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-k[140380]: ignoring --setgroup ceph since I am not root 2023-10-16T13:15:45.468 INFO:journalctl@ceph.mds.k.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-mds[140404]: -- 172.21.15.118:0/2179275855 <== mon.2 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55711cfaf1e0 con 0x55711cf84800 2023-10-16T13:15:45.468 INFO:journalctl@ceph.mds.k.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-k[140380]: starting mds.k at 2023-10-16T13:15:45.468 INFO:journalctl@ceph.mds.e.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-e[140730]: ignoring --setuser ceph since I am not root 2023-10-16T13:15:45.469 INFO:journalctl@ceph.mds.e.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-e[140730]: ignoring --setgroup ceph since I am not root 2023-10-16T13:15:45.469 INFO:journalctl@ceph.mds.e.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-mds[140754]: -- 172.21.15.118:0/200786475 <== mon.2 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558136b5f1e0 con 0x558136b34c00 2023-10-16T13:15:45.469 INFO:journalctl@ceph.mds.e.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-e[140730]: starting mds.e at 2023-10-16T13:15:45.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:45.478+0000 7f48a643e700 1 -- 172.21.15.92:0/3820198269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f48a002cf70 con 0x7f48a00ff1a0 2023-10-16T13:15:45.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:45 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/926026289' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:15:45.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:45 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2150983600' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-16T13:15:45.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:45 smithi092 ceph-mon[99542]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-16T13:15:45.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:45 smithi092 ceph-mon[99542]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T13:15:45.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:45 smithi092 ceph-mon[99542]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-10-16T13:15:45.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:45 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/2150983600' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-16T13:15:45.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:45 smithi092 ceph-mon[99542]: osdmap e86: 12 total, 12 up, 12 in 2023-10-16T13:15:45.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:45 smithi092 ceph-mon[99542]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-16T13:15:45.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/926026289' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:15:45.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2150983600' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-16T13:15:45.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-mon[103969]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-16T13:15:45.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-mon[103969]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T13:15:45.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-mon[103969]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-10-16T13:15:45.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/2150983600' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-16T13:15:45.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-mon[103969]: osdmap e86: 12 total, 12 up, 12 in 2023-10-16T13:15:45.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:45 smithi118 ceph-mon[103969]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-16T13:15:45.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/926026289' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-16T13:15:45.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2150983600' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-16T13:15:45.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-mon[104423]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-16T13:15:45.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-mon[104423]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T13:15:45.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-mon[104423]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-10-16T13:15:45.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/2150983600' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-16T13:15:45.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-mon[104423]: osdmap e86: 12 total, 12 up, 12 in 2023-10-16T13:15:45.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:45 smithi152 ceph-mon[104423]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-16T13:15:46.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.092+0000 7f489d7fa700 1 -- 172.21.15.92:0/3820198269 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4890099ba0 con 0x7f48a00ff1a0 2023-10-16T13:15:46.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.095+0000 7f48a643e700 1 -- 172.21.15.92:0/3820198269 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f48880a1480 msgr2=0x7f48880a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:46.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.095+0000 7f48a643e700 1 --2- 172.21.15.92:0/3820198269 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f48880a1480 0x7f48880a3940 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4894009bf0 tx=0x7f4894009260 comp rx=0 tx=0).stop 2023-10-16T13:15:46.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.095+0000 7f48a643e700 1 -- 172.21.15.92:0/3820198269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a00ff1a0 msgr2=0x7f48a0196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:46.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.095+0000 7f48a643e700 1 --2- 172.21.15.92:0/3820198269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a00ff1a0 0x7f48a0196d60 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f489000e970 tx=0x7f489000ec80 comp rx=0 tx=0).stop 2023-10-16T13:15:46.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.095+0000 7f48a643e700 1 -- 172.21.15.92:0/3820198269 shutdown_connections 2023-10-16T13:15:46.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.095+0000 7f48a643e700 1 --2- 172.21.15.92:0/3820198269 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f48880a1480 0x7f48880a3940 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:46.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.095+0000 7f48a643e700 1 --2- 172.21.15.92:0/3820198269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a00ff1a0 0x7f48a0196d60 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:46.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.095+0000 7f48a643e700 1 --2- 172.21.15.92:0/3820198269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48a0102bb0 0x7f48a019e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:46.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.095+0000 7f48a643e700 1 --2- 172.21.15.92:0/3820198269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48a0102210 0x7f48a01972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:46.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.095+0000 7f48a643e700 1 -- 172.21.15.92:0/3820198269 >> 172.21.15.92:0/3820198269 conn(0x7f48a00faa90 msgr2=0x7f48a01056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:46.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.095+0000 7f48a643e700 1 -- 172.21.15.92:0/3820198269 shutdown_connections 2023-10-16T13:15:46.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.095+0000 7f48a643e700 1 -- 172.21.15.92:0/3820198269 wait complete. 2023-10-16T13:15:46.116 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-16T13:15:46.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.244+0000 7f80ddb85700 1 -- 172.21.15.92:0/3118849521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80d8104270 msgr2=0x7f80d8106660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:46.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.244+0000 7f80ddb85700 1 --2- 172.21.15.92:0/3118849521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80d8104270 0x7f80d8106660 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f80c8009990 tx=0x7f80c8009ca0 comp rx=0 tx=0).stop 2023-10-16T13:15:46.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.244+0000 7f80ddb85700 1 -- 172.21.15.92:0/3118849521 shutdown_connections 2023-10-16T13:15:46.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.244+0000 7f80ddb85700 1 --2- 172.21.15.92:0/3118849521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d8106ba0 0x7f80d8109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:46.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.244+0000 7f80ddb85700 1 --2- 172.21.15.92:0/3118849521 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80d8101940 0x7f80d8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:46.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.244+0000 7f80ddb85700 1 --2- 172.21.15.92:0/3118849521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80d8104270 0x7f80d8106660 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:46.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.244+0000 7f80ddb85700 1 -- 172.21.15.92:0/3118849521 >> 172.21.15.92:0/3118849521 conn(0x7f80d80fb2f0 msgr2=0x7f80d80fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:46.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.244+0000 7f80ddb85700 1 -- 172.21.15.92:0/3118849521 shutdown_connections 2023-10-16T13:15:46.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.244+0000 7f80ddb85700 1 -- 172.21.15.92:0/3118849521 wait complete. 2023-10-16T13:15:46.249 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80ddb85700 1 Processor -- start 2023-10-16T13:15:46.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80ddb85700 1 -- start start 2023-10-16T13:15:46.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80ddb85700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d8101940 0x7f80d8196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:46.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80ddb85700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80d8104270 0x7f80d8197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:46.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80ddb85700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80d8106ba0 0x7f80d819e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:46.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80ddb85700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d819e780 con 0x7f80d8104270 2023-10-16T13:15:46.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80ddb85700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d819e8f0 con 0x7f80d8106ba0 2023-10-16T13:15:46.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80ddb85700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d819eab0 con 0x7f80d8101940 2023-10-16T13:15:46.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80d6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80d8104270 0x7f80d8197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:46.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80d6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80d8104270 0x7f80d8197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38568/0 (socket says 172.21.15.92:38568) 2023-10-16T13:15:46.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80d6ffd700 1 -- 172.21.15.92:0/1989029603 learned_addr learned my addr 172.21.15.92:0/1989029603 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:15:46.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80d77fe700 1 --2- 172.21.15.92:0/1989029603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d8101940 0x7f80d8196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:46.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80d7fff700 1 --2- 172.21.15.92:0/1989029603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80d8106ba0 0x7f80d819e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:46.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80d6ffd700 1 -- 172.21.15.92:0/1989029603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d8101940 msgr2=0x7f80d8196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:46.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80d6ffd700 1 --2- 172.21.15.92:0/1989029603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d8101940 0x7f80d8196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:46.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80d6ffd700 1 -- 172.21.15.92:0/1989029603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80d8106ba0 msgr2=0x7f80d819e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:46.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80d6ffd700 1 --2- 172.21.15.92:0/1989029603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80d8106ba0 0x7f80d819e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:46.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80d6ffd700 1 -- 172.21.15.92:0/1989029603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c80095f0 con 0x7f80d8104270 2023-10-16T13:15:46.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80d77fe700 1 --2- 172.21.15.92:0/1989029603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d8101940 0x7f80d8196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:15:46.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.245+0000 7f80d7fff700 1 --2- 172.21.15.92:0/1989029603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80d8106ba0 0x7f80d819e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:15:46.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.246+0000 7f80d6ffd700 1 --2- 172.21.15.92:0/1989029603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80d8104270 0x7f80d8197180 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f80c80036f0 tx=0x7f80c800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:46.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.246+0000 7f80d4ff9700 1 -- 172.21.15.92:0/1989029603 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c801d070 con 0x7f80d8104270 2023-10-16T13:15:46.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.246+0000 7f80d4ff9700 1 -- 172.21.15.92:0/1989029603 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f80c800fb80 con 0x7f80d8104270 2023-10-16T13:15:46.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.246+0000 7f80ddb85700 1 -- 172.21.15.92:0/1989029603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d819ed30 con 0x7f80d8104270 2023-10-16T13:15:46.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.246+0000 7f80d4ff9700 1 -- 172.21.15.92:0/1989029603 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c8017650 con 0x7f80d8104270 2023-10-16T13:15:46.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.246+0000 7f80ddb85700 1 -- 172.21.15.92:0/1989029603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d819f150 con 0x7f80d8104270 2023-10-16T13:15:46.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.247+0000 7f80ddb85700 1 -- 172.21.15.92:0/1989029603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d80fce70 con 0x7f80d8104270 2023-10-16T13:15:46.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.248+0000 7f80d4ff9700 1 -- 172.21.15.92:0/1989029603 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f80c8022470 con 0x7f80d8104270 2023-10-16T13:15:46.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.248+0000 7f80d4ff9700 1 --2- 172.21.15.92:0/1989029603 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f80c00a1480 0x7f80c00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:46.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.248+0000 7f80d77fe700 1 --2- 172.21.15.92:0/1989029603 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f80c00a1480 0x7f80c00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:46.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.248+0000 7f80d4ff9700 1 -- 172.21.15.92:0/1989029603 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8670+0+0 (secure 0 0 0) 0x7f80c80ce4c0 con 0x7f80d8104270 2023-10-16T13:15:46.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.249+0000 7f80d77fe700 1 --2- 172.21.15.92:0/1989029603 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f80c00a1480 0x7f80c00a3940 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f80cc005950 tx=0x7f80cc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:46.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.253+0000 7f80d4ff9700 1 -- 172.21.15.92:0/1989029603 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f80c8097a00 con 0x7f80d8104270 2023-10-16T13:15:46.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:46.445+0000 7f80ddb85700 1 -- 172.21.15.92:0/1989029603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f80d810c800 con 0x7f80d8104270 2023-10-16T13:15:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: pgmap v381: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 12 op/s 2023-10-16T13:15:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3820198269' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-16T13:15:46.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-16T13:15:46.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-16T13:15:46.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: Cluster is now healthy 2023-10-16T13:15:46.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/3820198269' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-16T13:15:46.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.92:6839/59452793,v1:172.21.15.92:6841/59452793] up:boot 2023-10-16T13:15:46.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.118:6834/2184974890,v1:172.21.15.118:6835/2184974890] up:boot 2023-10-16T13:15:46.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.92:6838/317759522,v1:172.21.15.92:6840/317759522] up:boot 2023-10-16T13:15:46.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.118:6836/504769652,v1:172.21.15.118:6838/504769652] up:boot 2023-10-16T13:15:46.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.118:6837/1209774779,v1:172.21.15.118:6839/1209774779] up:boot 2023-10-16T13:15:46.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.152:6832/515599226,v1:172.21.15.152:6834/515599226] up:boot 2023-10-16T13:15:46.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.118:6832/3617288977,v1:172.21.15.118:6833/3617288977] up:boot 2023-10-16T13:15:46.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.152:6833/2554959365,v1:172.21.15.152:6835/2554959365] up:boot 2023-10-16T13:15:46.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.152:6837/1833492820,v1:172.21.15.152:6839/1833492820] up:boot 2023-10-16T13:15:46.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: mds.? [v2:172.21.15.152:6836/474257964,v1:172.21.15.152:6838/474257964] up:boot 2023-10-16T13:15:46.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: fsmap 12 up:standby 2023-10-16T13:15:46.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-16T13:15:46.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-16T13:15:46.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-16T13:15:46.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-16T13:15:46.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-16T13:15:46.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-16T13:15:46.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-16T13:15:46.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-16T13:15:46.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-16T13:15:46.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-16T13:15:46.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:46 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1989029603' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-16T13:15:46.783 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: pgmap v381: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 12 op/s 2023-10-16T13:15:46.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3820198269' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-16T13:15:46.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-16T13:15:46.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-16T13:15:46.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: Cluster is now healthy 2023-10-16T13:15:46.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/3820198269' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-16T13:15:46.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.92:6839/59452793,v1:172.21.15.92:6841/59452793] up:boot 2023-10-16T13:15:46.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.118:6834/2184974890,v1:172.21.15.118:6835/2184974890] up:boot 2023-10-16T13:15:46.785 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.92:6838/317759522,v1:172.21.15.92:6840/317759522] up:boot 2023-10-16T13:15:46.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.118:6836/504769652,v1:172.21.15.118:6838/504769652] up:boot 2023-10-16T13:15:46.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.118:6837/1209774779,v1:172.21.15.118:6839/1209774779] up:boot 2023-10-16T13:15:46.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.152:6832/515599226,v1:172.21.15.152:6834/515599226] up:boot 2023-10-16T13:15:46.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.118:6832/3617288977,v1:172.21.15.118:6833/3617288977] up:boot 2023-10-16T13:15:46.786 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.152:6833/2554959365,v1:172.21.15.152:6835/2554959365] up:boot 2023-10-16T13:15:46.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.152:6837/1833492820,v1:172.21.15.152:6839/1833492820] up:boot 2023-10-16T13:15:46.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: mds.? [v2:172.21.15.152:6836/474257964,v1:172.21.15.152:6838/474257964] up:boot 2023-10-16T13:15:46.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: fsmap 12 up:standby 2023-10-16T13:15:46.787 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-16T13:15:46.788 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-16T13:15:46.788 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-16T13:15:46.788 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-16T13:15:46.788 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-16T13:15:46.789 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-16T13:15:46.789 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-16T13:15:46.789 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-16T13:15:46.790 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-16T13:15:46.790 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-16T13:15:46.790 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:46 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1989029603' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-16T13:15:46.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: pgmap v381: 97 pgs: 97 active+clean; 37 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 12 op/s 2023-10-16T13:15:46.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3820198269' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-16T13:15:46.943 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-16T13:15:46.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-16T13:15:46.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: Cluster is now healthy 2023-10-16T13:15:46.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/3820198269' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-16T13:15:46.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.92:6839/59452793,v1:172.21.15.92:6841/59452793] up:boot 2023-10-16T13:15:46.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.118:6834/2184974890,v1:172.21.15.118:6835/2184974890] up:boot 2023-10-16T13:15:46.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.92:6838/317759522,v1:172.21.15.92:6840/317759522] up:boot 2023-10-16T13:15:46.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.118:6836/504769652,v1:172.21.15.118:6838/504769652] up:boot 2023-10-16T13:15:46.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.118:6837/1209774779,v1:172.21.15.118:6839/1209774779] up:boot 2023-10-16T13:15:46.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.152:6832/515599226,v1:172.21.15.152:6834/515599226] up:boot 2023-10-16T13:15:46.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.118:6832/3617288977,v1:172.21.15.118:6833/3617288977] up:boot 2023-10-16T13:15:46.945 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.152:6833/2554959365,v1:172.21.15.152:6835/2554959365] up:boot 2023-10-16T13:15:46.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.152:6837/1833492820,v1:172.21.15.152:6839/1833492820] up:boot 2023-10-16T13:15:46.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: mds.? [v2:172.21.15.152:6836/474257964,v1:172.21.15.152:6838/474257964] up:boot 2023-10-16T13:15:46.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: fsmap 12 up:standby 2023-10-16T13:15:46.946 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-16T13:15:46.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-16T13:15:46.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-16T13:15:46.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-16T13:15:46.947 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-16T13:15:46.948 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-16T13:15:46.948 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-16T13:15:46.948 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-16T13:15:46.949 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-16T13:15:46.949 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-16T13:15:46.949 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:46 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1989029603' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-16T13:15:47.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.093+0000 7f80d4ff9700 1 -- 172.21.15.92:0/1989029603 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v87) v1 ==== 181+0+0 (secure 0 0 0) 0x7f80c809b020 con 0x7f80d8104270 2023-10-16T13:15:47.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.096+0000 7f80ddb85700 1 -- 172.21.15.92:0/1989029603 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f80c00a1480 msgr2=0x7f80c00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:47.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.096+0000 7f80ddb85700 1 --2- 172.21.15.92:0/1989029603 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f80c00a1480 0x7f80c00a3940 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f80cc005950 tx=0x7f80cc0058e0 comp rx=0 tx=0).stop 2023-10-16T13:15:47.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.096+0000 7f80ddb85700 1 -- 172.21.15.92:0/1989029603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80d8104270 msgr2=0x7f80d8197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:47.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.096+0000 7f80ddb85700 1 --2- 172.21.15.92:0/1989029603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80d8104270 0x7f80d8197180 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f80c80036f0 tx=0x7f80c800f690 comp rx=0 tx=0).stop 2023-10-16T13:15:47.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.096+0000 7f80ddb85700 1 -- 172.21.15.92:0/1989029603 shutdown_connections 2023-10-16T13:15:47.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.096+0000 7f80ddb85700 1 --2- 172.21.15.92:0/1989029603 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f80c00a1480 0x7f80c00a3940 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:47.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.096+0000 7f80ddb85700 1 --2- 172.21.15.92:0/1989029603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80d8106ba0 0x7f80d819e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:47.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.096+0000 7f80ddb85700 1 --2- 172.21.15.92:0/1989029603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d8101940 0x7f80d8196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:47.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.096+0000 7f80ddb85700 1 --2- 172.21.15.92:0/1989029603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80d8104270 0x7f80d8197180 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:47.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.096+0000 7f80ddb85700 1 -- 172.21.15.92:0/1989029603 >> 172.21.15.92:0/1989029603 conn(0x7f80d80fb2f0 msgr2=0x7f80d81025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:47.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.097+0000 7f80ddb85700 1 -- 172.21.15.92:0/1989029603 shutdown_connections 2023-10-16T13:15:47.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.097+0000 7f80ddb85700 1 -- 172.21.15.92:0/1989029603 wait complete. 2023-10-16T13:15:47.102 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_metadata' removed 2023-10-16T13:15:47.118 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-16T13:15:47.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.248+0000 7f83a3b56700 1 -- 172.21.15.92:0/1271833864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839c102150 msgr2=0x7f839c1025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:47.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.248+0000 7f83a3b56700 1 --2- 172.21.15.92:0/1271833864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839c102150 0x7f839c1025b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8398009990 tx=0x7f8398009ca0 comp rx=0 tx=0).stop 2023-10-16T13:15:47.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.248+0000 7f83a3b56700 1 -- 172.21.15.92:0/1271833864 shutdown_connections 2023-10-16T13:15:47.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.248+0000 7f83a3b56700 1 --2- 172.21.15.92:0/1271833864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f839c102af0 0x7f839c1093a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:47.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.248+0000 7f83a3b56700 1 --2- 172.21.15.92:0/1271833864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c0ff180 0x7f839c0ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:47.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.248+0000 7f83a3b56700 1 --2- 172.21.15.92:0/1271833864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839c102150 0x7f839c1025b0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:47.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.248+0000 7f83a3b56700 1 -- 172.21.15.92:0/1271833864 >> 172.21.15.92:0/1271833864 conn(0x7f839c0faa90 msgr2=0x7f839c0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:47.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.248+0000 7f83a3b56700 1 -- 172.21.15.92:0/1271833864 shutdown_connections 2023-10-16T13:15:47.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.248+0000 7f83a3b56700 1 -- 172.21.15.92:0/1271833864 wait complete. 2023-10-16T13:15:47.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.248+0000 7f83a3b56700 1 Processor -- start 2023-10-16T13:15:47.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f83a3b56700 1 -- start start 2023-10-16T13:15:47.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f83a3b56700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f839c0ff180 0x7f839c196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:47.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f83a3b56700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c102150 0x7f839c197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:47.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f83a3b56700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839c102af0 0x7f839c19e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:47.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f83a3b56700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c19e830 con 0x7f839c102af0 2023-10-16T13:15:47.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f83a3b56700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c19e9a0 con 0x7f839c102150 2023-10-16T13:15:47.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f83a3b56700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c19eb60 con 0x7f839c0ff180 2023-10-16T13:15:47.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f83a20f3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839c102af0 0x7f839c19e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:47.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f83a20f3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839c102af0 0x7f839c19e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38584/0 (socket says 172.21.15.92:38584) 2023-10-16T13:15:47.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f83a20f3700 1 -- 172.21.15.92:0/1687548862 learned_addr learned my addr 172.21.15.92:0/1687548862 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-16T13:15:47.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f83a10f1700 1 --2- 172.21.15.92:0/1687548862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c102150 0x7f839c197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:47.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f83a18f2700 1 --2- 172.21.15.92:0/1687548862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f839c0ff180 0x7f839c196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:47.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f83a20f3700 1 -- 172.21.15.92:0/1687548862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f839c0ff180 msgr2=0x7f839c196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:47.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f83a20f3700 1 --2- 172.21.15.92:0/1687548862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f839c0ff180 0x7f839c196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:47.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f83a20f3700 1 -- 172.21.15.92:0/1687548862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c102150 msgr2=0x7f839c197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:47.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f83a20f3700 1 --2- 172.21.15.92:0/1687548862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c102150 0x7f839c197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:47.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f83a20f3700 1 -- 172.21.15.92:0/1687548862 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83980095f0 con 0x7f839c102af0 2023-10-16T13:15:47.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f83a18f2700 1 --2- 172.21.15.92:0/1687548862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f839c0ff180 0x7f839c196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:15:47.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f83a20f3700 1 --2- 172.21.15.92:0/1687548862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839c102af0 0x7f839c19e260 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f839400b970 tx=0x7f839400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:47.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.249+0000 7f8392ffd700 1 -- 172.21.15.92:0/1687548862 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839400c930 con 0x7f839c102af0 2023-10-16T13:15:47.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.250+0000 7f8392ffd700 1 -- 172.21.15.92:0/1687548862 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8394014440 con 0x7f839c102af0 2023-10-16T13:15:47.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.250+0000 7f83a3b56700 1 -- 172.21.15.92:0/1687548862 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839c19ee40 con 0x7f839c102af0 2023-10-16T13:15:47.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.250+0000 7f8392ffd700 1 -- 172.21.15.92:0/1687548862 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83940075d0 con 0x7f839c102af0 2023-10-16T13:15:47.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.250+0000 7f83a3b56700 1 -- 172.21.15.92:0/1687548862 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839c19f210 con 0x7f839c102af0 2023-10-16T13:15:47.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.250+0000 7f83a3b56700 1 -- 172.21.15.92:0/1687548862 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839c10c880 con 0x7f839c102af0 2023-10-16T13:15:47.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.251+0000 7f8392ffd700 1 -- 172.21.15.92:0/1687548862 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f83940145b0 con 0x7f839c102af0 2023-10-16T13:15:47.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.252+0000 7f8392ffd700 1 --2- 172.21.15.92:0/1687548862 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f83880a1480 0x7f83880a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:15:47.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.252+0000 7f83a18f2700 1 --2- 172.21.15.92:0/1687548862 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f83880a1480 0x7f83880a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:15:47.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.252+0000 7f8392ffd700 1 -- 172.21.15.92:0/1687548862 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8116+0+0 (secure 0 0 0) 0x7f8394006e40 con 0x7f839c102af0 2023-10-16T13:15:47.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.252+0000 7f83a18f2700 1 --2- 172.21.15.92:0/1687548862 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f83880a1480 0x7f83880a3940 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f838c005950 tx=0x7f838c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:15:47.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.255+0000 7f8392ffd700 1 -- 172.21.15.92:0/1687548862 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8394095de0 con 0x7f839c102af0 2023-10-16T13:15:47.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:47.446+0000 7f83a3b56700 1 -- 172.21.15.92:0/1687548862 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f839c107e40 con 0x7f839c102af0 2023-10-16T13:15:48.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:48.098+0000 7f8392ffd700 1 -- 172.21.15.92:0/1687548862 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v88) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8394099400 con 0x7f839c102af0 2023-10-16T13:15:48.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:48.103+0000 7f83a3b56700 1 -- 172.21.15.92:0/1687548862 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f83880a1480 msgr2=0x7f83880a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:48.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:48.103+0000 7f83a3b56700 1 --2- 172.21.15.92:0/1687548862 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f83880a1480 0x7f83880a3940 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f838c005950 tx=0x7f838c0058e0 comp rx=0 tx=0).stop 2023-10-16T13:15:48.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:48.103+0000 7f83a3b56700 1 -- 172.21.15.92:0/1687548862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839c102af0 msgr2=0x7f839c19e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:15:48.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:48.103+0000 7f83a3b56700 1 --2- 172.21.15.92:0/1687548862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839c102af0 0x7f839c19e260 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f839400b970 tx=0x7f839400bc80 comp rx=0 tx=0).stop 2023-10-16T13:15:48.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:48.105+0000 7f83a3b56700 1 -- 172.21.15.92:0/1687548862 shutdown_connections 2023-10-16T13:15:48.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:48.105+0000 7f83a3b56700 1 --2- 172.21.15.92:0/1687548862 >> [v2:172.21.15.92:6800/2605982588,v1:172.21.15.92:6801/2605982588] conn(0x7f83880a1480 0x7f83880a3940 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:48.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:48.105+0000 7f83a3b56700 1 --2- 172.21.15.92:0/1687548862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839c102af0 0x7f839c19e260 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:48.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:48.105+0000 7f83a3b56700 1 --2- 172.21.15.92:0/1687548862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f839c0ff180 0x7f839c196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:48.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:48.105+0000 7f83a3b56700 1 --2- 172.21.15.92:0/1687548862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c102150 0x7f839c197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:15:48.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:48.105+0000 7f83a3b56700 1 -- 172.21.15.92:0/1687548862 >> 172.21.15.92:0/1687548862 conn(0x7f839c0faa90 msgr2=0x7f839c0fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:15:48.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:48.105+0000 7f83a3b56700 1 -- 172.21.15.92:0/1687548862 shutdown_connections 2023-10-16T13:15:48.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-16T13:15:48.107+0000 7f83a3b56700 1 -- 172.21.15.92:0/1687548862 wait complete. 2023-10-16T13:15:48.114 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data' removed 2023-10-16T13:15:48.128 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-16T13:15:48.154 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-16T13:15:48.184 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-16T13:15:48.214 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-10-16T13:15:48.215 DEBUG:teuthology.orchestra.run.smithi092:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-16T13:15:48.232 DEBUG:teuthology.orchestra.run.smithi118:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-16T13:15:48.270 DEBUG:teuthology.orchestra.run.smithi152:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-16T13:15:48.287 INFO:tasks.cephadm:Stopping all daemons... 2023-10-16T13:15:48.287 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-10-16T13:15:48.287 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mon.a 2023-10-16T13:15:48.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:48 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1989029603' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-16T13:15:48.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:48 smithi152 ceph-mon[104423]: osdmap e87: 12 total, 12 up, 12 in 2023-10-16T13:15:48.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:48 smithi152 ceph-mon[104423]: pgmap v383: 65 pgs: 65 active+clean; 577 KiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:15:48.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:48 smithi152 ceph-mon[104423]: from='client.? 172.21.15.92:0/1687548862' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-16T13:15:48.443 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:48 smithi152 ceph-mon[104423]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:15:48.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:48 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1989029603' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-16T13:15:48.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:48 smithi092 ceph-mon[99542]: osdmap e87: 12 total, 12 up, 12 in 2023-10-16T13:15:48.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:48 smithi092 ceph-mon[99542]: pgmap v383: 65 pgs: 65 active+clean; 577 KiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:15:48.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:48 smithi092 ceph-mon[99542]: from='client.? 172.21.15.92:0/1687548862' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-16T13:15:48.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:48 smithi092 ceph-mon[99542]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:15:48.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:48 smithi092 systemd[1]: Stopping Ceph mon.a for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:15:48.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:48 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1989029603' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-16T13:15:48.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:48 smithi118 ceph-mon[103969]: osdmap e87: 12 total, 12 up, 12 in 2023-10-16T13:15:48.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:48 smithi118 ceph-mon[103969]: pgmap v383: 65 pgs: 65 active+clean; 577 KiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-16T13:15:48.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:48 smithi118 ceph-mon[103969]: from='client.? 172.21.15.92:0/1687548862' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-16T13:15:48.534 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:48 smithi118 ceph-mon[103969]: from='mgr.14152 172.21.15.92:0/4080922601' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-16T13:15:48.950 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:48 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mon-a[99518]: 2023-10-16T13:15:48.620+0000 7f1a1ce02700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:15:48.950 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:48 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mon-a[99518]: 2023-10-16T13:15:48.620+0000 7f1a1ce02700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-10-16T13:15:49.180 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mon.a.service' 2023-10-16T13:15:49.205 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:48 smithi092 bash[170141]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mon-a 2023-10-16T13:15:49.206 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:49 smithi092 systemd[1]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mon.a.service: Succeeded. 2023-10-16T13:15:49.206 INFO:journalctl@ceph.mon.a.smithi092.stdout:Oct 16 13:15:49 smithi092 systemd[1]: Stopped Ceph mon.a for 6c276d7e-6c24-11ee-8db6-212e2dc638e7. 2023-10-16T13:15:49.236 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:15:49.236 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-10-16T13:15:49.237 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-10-16T13:15:49.237 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mon.b 2023-10-16T13:15:49.533 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:49 smithi118 systemd[1]: Stopping Ceph mon.b for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:15:49.883 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:49 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mon-b[103945]: 2023-10-16T13:15:49.623+0000 7fc7efa2b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:15:49.883 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:49 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mon-b[103945]: 2023-10-16T13:15:49.623+0000 7fc7efa2b700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-10-16T13:15:50.283 INFO:journalctl@ceph.mon.b.smithi118.stdout:Oct 16 13:15:49 smithi118 bash[144651]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mon-b 2023-10-16T13:15:50.295 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mon.b.service' 2023-10-16T13:15:50.346 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:15:50.346 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-10-16T13:15:50.347 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-10-16T13:15:50.347 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mon.c 2023-10-16T13:15:50.693 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:50 smithi152 systemd[1]: Stopping Ceph mon.c for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:15:51.003 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:50 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mon-c[104383]: 2023-10-16T13:15:50.734+0000 7f894eefa700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:15:51.003 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:50 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mon-c[104383]: 2023-10-16T13:15:50.734+0000 7f894eefa700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-10-16T13:15:51.549 INFO:journalctl@ceph.mon.c.smithi152.stdout:Oct 16 13:15:51 smithi152 bash[145638]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mon-c 2023-10-16T13:15:51.556 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mon.c.service' 2023-10-16T13:15:51.613 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:15:51.613 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-10-16T13:15:51.614 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-10-16T13:15:51.614 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mgr.x 2023-10-16T13:15:51.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:15:51 smithi092 systemd[1]: Stopping Ceph mgr.x for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:15:52.247 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Oct 16 13:15:51 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-x[99788]: 2023-10-16T13:15:51.989+0000 7f2a30fc6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:15:52.510 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mgr.x.service' 2023-10-16T13:15:52.548 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:15:52.549 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-10-16T13:15:52.549 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-10-16T13:15:52.550 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mgr.y 2023-10-16T13:15:52.987 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:15:52 smithi118 systemd[1]: Stopping Ceph mgr.y for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:15:53.261 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:15:53 smithi118 bash[144808]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-y 2023-10-16T13:15:53.442 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Oct 16 13:15:53 smithi118 systemd[1]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-10-16T13:15:53.446 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mgr.y.service' 2023-10-16T13:15:53.483 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:15:53.484 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-10-16T13:15:53.484 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-10-16T13:15:53.484 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mgr.z 2023-10-16T13:15:53.906 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:15:53 smithi152 systemd[1]: Stopping Ceph mgr.z for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:15:54.192 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:15:54 smithi152 bash[145797]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mgr-z 2023-10-16T13:15:54.373 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Oct 16 13:15:54 smithi152 systemd[1]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-10-16T13:15:54.376 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mgr.z.service' 2023-10-16T13:15:54.414 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:15:54.415 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-10-16T13:15:54.415 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-10-16T13:15:54.416 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.0 2023-10-16T13:15:54.747 INFO:journalctl@ceph.osd.0.smithi092.stdout:Oct 16 13:15:54 smithi092 systemd[1]: Stopping Ceph osd.0 for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:15:55.247 INFO:journalctl@ceph.osd.0.smithi092.stdout:Oct 16 13:15:54 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-0[117459]: 2023-10-16T13:15:54.821+0000 7f20cca20700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:15:55.247 INFO:journalctl@ceph.osd.0.smithi092.stdout:Oct 16 13:15:54 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-0[117459]: 2023-10-16T13:15:54.821+0000 7f20cca20700 -1 osd.0 88 *** Got signal Terminated *** 2023-10-16T13:15:55.247 INFO:journalctl@ceph.osd.0.smithi092.stdout:Oct 16 13:15:54 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-0[117459]: 2023-10-16T13:15:54.821+0000 7f20cca20700 -1 osd.0 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-16T13:16:00.747 INFO:journalctl@ceph.osd.0.smithi092.stdout:Oct 16 13:16:00 smithi092 bash[170457]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-0 2023-10-16T13:16:01.957 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.0.service' 2023-10-16T13:16:01.998 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:16:01.998 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-10-16T13:16:01.998 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-10-16T13:16:01.999 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.1 2023-10-16T13:16:02.283 INFO:journalctl@ceph.osd.1.smithi118.stdout:Oct 16 13:16:02 smithi118 systemd[1]: Stopping Ceph osd.1 for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:16:02.784 INFO:journalctl@ceph.osd.1.smithi118.stdout:Oct 16 13:16:02 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-1[109050]: 2023-10-16T13:16:02.353+0000 7f1f81360700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:16:02.784 INFO:journalctl@ceph.osd.1.smithi118.stdout:Oct 16 13:16:02 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-1[109050]: 2023-10-16T13:16:02.353+0000 7f1f81360700 -1 osd.1 88 *** Got signal Terminated *** 2023-10-16T13:16:02.785 INFO:journalctl@ceph.osd.1.smithi118.stdout:Oct 16 13:16:02 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-1[109050]: 2023-10-16T13:16:02.353+0000 7f1f81360700 -1 osd.1 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-16T13:16:08.033 INFO:journalctl@ceph.osd.1.smithi118.stdout:Oct 16 13:16:07 smithi118 bash[144950]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-1 2023-10-16T13:16:09.299 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.1.service' 2023-10-16T13:16:09.340 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:16:09.341 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-10-16T13:16:09.341 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-10-16T13:16:09.341 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.2 2023-10-16T13:16:09.693 INFO:journalctl@ceph.osd.2.smithi152.stdout:Oct 16 13:16:09 smithi152 systemd[1]: Stopping Ceph osd.2 for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:16:10.192 INFO:journalctl@ceph.osd.2.smithi152.stdout:Oct 16 13:16:09 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-2[110270]: 2023-10-16T13:16:09.735+0000 7fdc94a66700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:16:10.193 INFO:journalctl@ceph.osd.2.smithi152.stdout:Oct 16 13:16:09 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-2[110270]: 2023-10-16T13:16:09.735+0000 7fdc94a66700 -1 osd.2 88 *** Got signal Terminated *** 2023-10-16T13:16:10.193 INFO:journalctl@ceph.osd.2.smithi152.stdout:Oct 16 13:16:09 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-2[110270]: 2023-10-16T13:16:09.735+0000 7fdc94a66700 -1 osd.2 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-16T13:16:15.582 INFO:journalctl@ceph.osd.2.smithi152.stdout:Oct 16 13:16:15 smithi152 bash[145943]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-2 2023-10-16T13:16:16.847 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.2.service' 2023-10-16T13:16:16.887 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:16:16.888 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-10-16T13:16:16.888 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-10-16T13:16:16.888 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.3 2023-10-16T13:16:17.237 INFO:journalctl@ceph.osd.3.smithi092.stdout:Oct 16 13:16:16 smithi092 systemd[1]: Stopping Ceph osd.3 for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:16:17.497 INFO:journalctl@ceph.osd.3.smithi092.stdout:Oct 16 13:16:17 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-3[125409]: 2023-10-16T13:16:17.235+0000 7f7bc7320700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:16:17.497 INFO:journalctl@ceph.osd.3.smithi092.stdout:Oct 16 13:16:17 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-3[125409]: 2023-10-16T13:16:17.235+0000 7f7bc7320700 -1 osd.3 88 *** Got signal Terminated *** 2023-10-16T13:16:17.497 INFO:journalctl@ceph.osd.3.smithi092.stdout:Oct 16 13:16:17 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-3[125409]: 2023-10-16T13:16:17.235+0000 7f7bc7320700 -1 osd.3 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-16T13:16:21.693 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:21 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:21.340+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:22.693 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:22 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:22.322+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:23.193 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:22 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:22.840+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.314039+0000 front 2023-10-16T13:15:57.314015+0000 (oldest deadline 2023-10-16T13:16:22.014227+0000) 2023-10-16T13:16:23.247 INFO:journalctl@ceph.osd.3.smithi092.stdout:Oct 16 13:16:22 smithi092 bash[170731]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-3 2023-10-16T13:16:23.693 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:23 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:23.370+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:24.192 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:23 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:23.820+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.314039+0000 front 2023-10-16T13:15:57.314015+0000 (oldest deadline 2023-10-16T13:16:22.014227+0000) 2023-10-16T13:16:24.202 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:23 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:23.940+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:24.454 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:24 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:24.399+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:24.460 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.3.service' 2023-10-16T13:16:24.502 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:16:24.502 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-10-16T13:16:24.502 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-10-16T13:16:24.503 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.4 2023-10-16T13:16:24.692 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:24 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:24.381+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:24.869 INFO:journalctl@ceph.osd.4.smithi118.stdout:Oct 16 13:16:24 smithi118 systemd[1]: Stopping Ceph osd.4 for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:16:25.192 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:24 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:24.806+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.314039+0000 front 2023-10-16T13:15:57.314015+0000 (oldest deadline 2023-10-16T13:16:22.014227+0000) 2023-10-16T13:16:25.247 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:24 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:24.976+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:25.283 INFO:journalctl@ceph.osd.4.smithi118.stdout:Oct 16 13:16:24 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-4[117604]: 2023-10-16T13:16:24.866+0000 7f7cdcafd700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:16:25.283 INFO:journalctl@ceph.osd.4.smithi118.stdout:Oct 16 13:16:24 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-4[117604]: 2023-10-16T13:16:24.866+0000 7f7cdcafd700 -1 osd.4 88 *** Got signal Terminated *** 2023-10-16T13:16:25.284 INFO:journalctl@ceph.osd.4.smithi118.stdout:Oct 16 13:16:24 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-4[117604]: 2023-10-16T13:16:24.866+0000 7f7cdcafd700 -1 osd.4 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-16T13:16:25.692 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:25 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:25.408+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:25.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:25 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:25.420+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:26.192 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:25 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:25.784+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.314039+0000 front 2023-10-16T13:15:57.314015+0000 (oldest deadline 2023-10-16T13:16:22.014227+0000) 2023-10-16T13:16:26.449 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:25 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:25.997+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:26.693 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:26.361+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:26.746 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:26 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:26.446+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:27.192 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:26 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:26.812+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.314039+0000 front 2023-10-16T13:15:57.314015+0000 (oldest deadline 2023-10-16T13:16:22.014227+0000) 2023-10-16T13:16:27.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:26 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:26.893+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:27.414 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:27 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:27.411+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:27.414 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:27 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:27.001+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:27.692 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:27.400+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:28.193 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:27 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:27.767+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.314039+0000 front 2023-10-16T13:15:57.314015+0000 (oldest deadline 2023-10-16T13:16:22.014227+0000) 2023-10-16T13:16:28.247 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:27 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:27.963+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:28.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:27 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:27.938+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:28.693 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:28 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:28.519+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:28.693 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:28 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:28.398+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:28.693 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:28 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:28.398+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:28.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:28 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:28.383+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:28.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:28 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:28.383+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.325298+0000 front 2023-10-16T13:16:05.325474+0000 (oldest deadline 2023-10-16T13:16:28.125827+0000) 2023-10-16T13:16:29.192 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:28 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:28.782+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.314039+0000 front 2023-10-16T13:15:57.314015+0000 (oldest deadline 2023-10-16T13:16:22.014227+0000) 2023-10-16T13:16:29.193 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:28 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:28.782+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.616306+0000 front 2023-10-16T13:16:03.616257+0000 (oldest deadline 2023-10-16T13:16:28.316246+0000) 2023-10-16T13:16:29.247 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:28 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:28.982+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:29.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:28 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:28.921+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:29.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:28 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:28.921+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:29.692 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:29 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:29.536+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:29.693 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:29 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:29.372+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:29.693 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:29 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:29.372+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:29.746 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:29 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:29.382+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:29.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:29 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:29.382+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.325298+0000 front 2023-10-16T13:16:05.325474+0000 (oldest deadline 2023-10-16T13:16:28.125827+0000) 2023-10-16T13:16:30.192 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:29 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:29.748+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.314039+0000 front 2023-10-16T13:15:57.314015+0000 (oldest deadline 2023-10-16T13:16:22.014227+0000) 2023-10-16T13:16:30.193 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:29 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:29.748+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.616306+0000 front 2023-10-16T13:16:03.616257+0000 (oldest deadline 2023-10-16T13:16:28.316246+0000) 2023-10-16T13:16:30.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:29 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:29.903+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:30.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:29 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:29.903+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:30.364 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:30 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:30.010+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:30.693 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:30 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:30.571+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:30.693 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:30 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:30.389+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:30.693 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:30 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:30.389+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:30.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:30 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:30.362+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:30.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:30 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:30.362+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.325298+0000 front 2023-10-16T13:16:05.325474+0000 (oldest deadline 2023-10-16T13:16:28.125827+0000) 2023-10-16T13:16:30.861 INFO:journalctl@ceph.osd.4.smithi118.stdout:Oct 16 13:16:30 smithi118 bash[145228]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-4 2023-10-16T13:16:30.861 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:30 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:30.537+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:30.862 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:30 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:30.858+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:31.192 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:30 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:30.722+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.314039+0000 front 2023-10-16T13:15:57.314015+0000 (oldest deadline 2023-10-16T13:16:22.014227+0000) 2023-10-16T13:16:31.193 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:30 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:30.722+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.616306+0000 front 2023-10-16T13:16:03.616257+0000 (oldest deadline 2023-10-16T13:16:28.316246+0000) 2023-10-16T13:16:31.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:30 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:30.858+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:31.358 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:31 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:31.046+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:31.358 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:31 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:31.046+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:31.693 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:31 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:31.607+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:31.693 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:31 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:31.403+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:31.693 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:31 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:31.403+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:31.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:31 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:31.355+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:31.748 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:31 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:31.355+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.325298+0000 front 2023-10-16T13:16:05.325474+0000 (oldest deadline 2023-10-16T13:16:28.125827+0000) 2023-10-16T13:16:31.784 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:31 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:31.581+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:32.192 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:31 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:31.828+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:32.193 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:31 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:31.828+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:32.193 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:31 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:31.732+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.314039+0000 front 2023-10-16T13:15:57.314015+0000 (oldest deadline 2023-10-16T13:16:22.014227+0000) 2023-10-16T13:16:32.193 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:31 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:31.732+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.616306+0000 front 2023-10-16T13:16:03.616257+0000 (oldest deadline 2023-10-16T13:16:28.316246+0000) 2023-10-16T13:16:32.199 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.4.service' 2023-10-16T13:16:32.238 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:16:32.239 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-10-16T13:16:32.239 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-10-16T13:16:32.239 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.5 2023-10-16T13:16:32.342 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:32 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:32.062+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:32.342 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:32 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:32.062+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:32.601 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:32 smithi152 systemd[1]: Stopping Ceph osd.5 for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:16:32.601 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:32 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:32.431+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:32.601 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:32 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:32.431+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:32.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:32 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:32.339+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:32.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:32 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:32.339+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.325298+0000 front 2023-10-16T13:16:05.325474+0000 (oldest deadline 2023-10-16T13:16:28.125827+0000) 2023-10-16T13:16:32.880 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:32 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:32.539+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:32.942 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:32 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:32.598+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:32.943 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:32 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:32.623+0000 7f4c5be33700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:16:32.943 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:32 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:32.623+0000 7f4c5be33700 -1 osd.5 88 *** Got signal Terminated *** 2023-10-16T13:16:32.943 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:32 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:32.623+0000 7f4c5be33700 -1 osd.5 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-16T13:16:32.943 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:32 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:32.695+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.314039+0000 front 2023-10-16T13:15:57.314015+0000 (oldest deadline 2023-10-16T13:16:22.014227+0000) 2023-10-16T13:16:32.944 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:32 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:32.695+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.616306+0000 front 2023-10-16T13:16:03.616257+0000 (oldest deadline 2023-10-16T13:16:28.316246+0000) 2023-10-16T13:16:33.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:32 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:32.878+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:33.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:32 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:32.878+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:33.380 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:33 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:33.025+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:33.381 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:33 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:33.025+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:33.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:33 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:33.377+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:33.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:33 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:33.377+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.325298+0000 front 2023-10-16T13:16:05.325474+0000 (oldest deadline 2023-10-16T13:16:28.125827+0000) 2023-10-16T13:16:33.783 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:33 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:33.520+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:33.942 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:33 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:33.664+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.314039+0000 front 2023-10-16T13:15:57.314015+0000 (oldest deadline 2023-10-16T13:16:22.014227+0000) 2023-10-16T13:16:33.943 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:33 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:33.664+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.616306+0000 front 2023-10-16T13:16:03.616257+0000 (oldest deadline 2023-10-16T13:16:28.316246+0000) 2023-10-16T13:16:33.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:33 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:33.614+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:33.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:33 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:33.443+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:33.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:33 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:33.443+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:34.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:33 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:33.833+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:34.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:33 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:33.833+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:34.376 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:34 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:34.043+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:34.377 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:34 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:34.043+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:34.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:34 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:34.374+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:34.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:34 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:34.374+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.325298+0000 front 2023-10-16T13:16:05.325474+0000 (oldest deadline 2023-10-16T13:16:28.125827+0000) 2023-10-16T13:16:34.783 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:34 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:34.476+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:34.943 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:34 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:34.690+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.314039+0000 front 2023-10-16T13:15:57.314015+0000 (oldest deadline 2023-10-16T13:16:22.014227+0000) 2023-10-16T13:16:34.943 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:34 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:34.690+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.616306+0000 front 2023-10-16T13:16:03.616257+0000 (oldest deadline 2023-10-16T13:16:28.316246+0000) 2023-10-16T13:16:34.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:34 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:34.574+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:34.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:34 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:34.450+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:34.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:34 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:34.450+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:35.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:34 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:34.874+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:35.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:34 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:34.874+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:35.336 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:35 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:35.031+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:35.336 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:35 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:35.031+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:35.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:35 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:35.333+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:35.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:35 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:35.333+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.325298+0000 front 2023-10-16T13:16:05.325474+0000 (oldest deadline 2023-10-16T13:16:28.125827+0000) 2023-10-16T13:16:35.783 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:35 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:35.490+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:35.942 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:35 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:35.645+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.314039+0000 front 2023-10-16T13:15:57.314015+0000 (oldest deadline 2023-10-16T13:16:22.014227+0000) 2023-10-16T13:16:35.943 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:35 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:35.645+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.616306+0000 front 2023-10-16T13:16:03.616257+0000 (oldest deadline 2023-10-16T13:16:28.316246+0000) 2023-10-16T13:16:35.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:35 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:35.546+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:35.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:35 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:35.500+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:35.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:35 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:35.500+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:36.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:35 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:35.909+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:36.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:35 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:35.909+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:36.369 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:36 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:36.057+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:36.369 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:36 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:36.057+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:36.369 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:36 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:36.057+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:36.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:36 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:36.366+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:36.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:36 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:36.366+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.325298+0000 front 2023-10-16T13:16:05.325474+0000 (oldest deadline 2023-10-16T13:16:28.125827+0000) 2023-10-16T13:16:36.892 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:36 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:36.534+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:36.893 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:36 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:36.534+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:11.884873+0000 front 2023-10-16T13:16:11.885108+0000 (oldest deadline 2023-10-16T13:16:36.485528+0000) 2023-10-16T13:16:36.942 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:36 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:36.505+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:36.943 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:36 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:36.606+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.314039+0000 front 2023-10-16T13:15:57.314015+0000 (oldest deadline 2023-10-16T13:16:22.014227+0000) 2023-10-16T13:16:36.943 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:36 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5[118223]: 2023-10-16T13:16:36.606+0000 7f4c57427700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.616306+0000 front 2023-10-16T13:16:03.616257+0000 (oldest deadline 2023-10-16T13:16:28.316246+0000) 2023-10-16T13:16:36.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:36 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:36.492+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:36.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:36 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:36.492+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:37.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:36 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:36.891+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:37.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:36 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:36.891+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:37.381 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:37 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:37.102+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:37.381 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:37 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:37.102+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:37.382 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:37 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:37.102+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:37.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:37 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:37.379+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:37.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:37 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:37.379+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.325298+0000 front 2023-10-16T13:16:05.325474+0000 (oldest deadline 2023-10-16T13:16:28.125827+0000) 2023-10-16T13:16:37.912 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:37 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:37.581+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:37.912 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:37 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:37.581+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:11.884873+0000 front 2023-10-16T13:16:11.885108+0000 (oldest deadline 2023-10-16T13:16:36.485528+0000) 2023-10-16T13:16:37.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:37 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:37.476+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:37.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:37 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:37.471+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:37.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:37 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:37.471+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:38.279 INFO:journalctl@ceph.osd.5.smithi152.stdout:Oct 16 13:16:38 smithi152 bash[146200]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-5 2023-10-16T13:16:38.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:37 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:37.910+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:38.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:37 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:37.910+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:38.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:37 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:37.910+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:38.393 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:38 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:38.067+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:38.394 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:38 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:38.067+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:38.394 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:38 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:38.067+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:38.692 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:38 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:38.510+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:38.693 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:38 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:38.510+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:38.693 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:38 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:38.435+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:38.693 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:38 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:38.435+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:38.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:38 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:38.391+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:38.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:38 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:38.391+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.325298+0000 front 2023-10-16T13:16:05.325474+0000 (oldest deadline 2023-10-16T13:16:28.125827+0000) 2023-10-16T13:16:38.952 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:38 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:38.538+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:38.952 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:38 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:38.538+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:11.884873+0000 front 2023-10-16T13:16:11.885108+0000 (oldest deadline 2023-10-16T13:16:36.485528+0000) 2023-10-16T13:16:39.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:38 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:38.949+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:39.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:38 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:38.949+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:39.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:38 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:38.949+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:39.391 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:39 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:39.110+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:39.391 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:39 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:39.110+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:39.392 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:39 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:39.110+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:39.547 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.5.service' 2023-10-16T13:16:39.587 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:16:39.587 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-10-16T13:16:39.588 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-10-16T13:16:39.588 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.6 2023-10-16T13:16:39.623 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:39 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:39.389+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:39.623 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:39 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:39.389+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.325298+0000 front 2023-10-16T13:16:05.325474+0000 (oldest deadline 2023-10-16T13:16:28.125827+0000) 2023-10-16T13:16:39.623 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:39 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:39.389+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.427061+0000 front 2023-10-16T13:16:10.426957+0000 (oldest deadline 2023-10-16T13:16:38.627421+0000) 2023-10-16T13:16:39.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:39 smithi092 systemd[1]: Stopping Ceph osd.6 for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:16:39.942 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:39 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:39.470+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:39.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:39 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:39.470+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:39.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:39 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:39.549+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:39.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:39 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:39.549+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:39.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:39 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:39.549+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:39.951 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:39 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:39.578+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:39.951 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:39 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:39.578+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:11.884873+0000 front 2023-10-16T13:16:11.885108+0000 (oldest deadline 2023-10-16T13:16:36.485528+0000) 2023-10-16T13:16:40.247 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:39 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:39.954+0000 7fa196201700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:16:40.247 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:39 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:39.954+0000 7fa196201700 -1 osd.6 88 *** Got signal Terminated *** 2023-10-16T13:16:40.247 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:39 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:39.954+0000 7fa196201700 -1 osd.6 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-16T13:16:40.248 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:40 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:40.155+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:40.248 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:40 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:40.155+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:40.248 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:40 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:40.155+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:40.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:39 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:39.948+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:40.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:39 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:39.948+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:40.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:39 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:39.948+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:40.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:40 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:40.378+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:40.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:40 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:40.378+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.325298+0000 front 2023-10-16T13:16:05.325474+0000 (oldest deadline 2023-10-16T13:16:28.125827+0000) 2023-10-16T13:16:40.747 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:40 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:40.378+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.427061+0000 front 2023-10-16T13:16:10.426957+0000 (oldest deadline 2023-10-16T13:16:38.627421+0000) 2023-10-16T13:16:40.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:40 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:40.505+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:40.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:40 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:40.505+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:40.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:40 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:40.532+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:40.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:40 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:40.532+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:40.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:40 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:40.532+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:40.969 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:40 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:40.572+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:40.969 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:40 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:40.572+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:11.884873+0000 front 2023-10-16T13:16:11.885108+0000 (oldest deadline 2023-10-16T13:16:36.485528+0000) 2023-10-16T13:16:41.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:40 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:40.967+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:41.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:40 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:40.967+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:41.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:40 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:40.967+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:41.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:41 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:41.147+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:41.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:41 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:41.147+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:41.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:41 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:41.147+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:41.498 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:41 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:41.329+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:41.498 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:41 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:41.329+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.325298+0000 front 2023-10-16T13:16:05.325474+0000 (oldest deadline 2023-10-16T13:16:28.125827+0000) 2023-10-16T13:16:41.498 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:41 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:41.329+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.427061+0000 front 2023-10-16T13:16:10.426957+0000 (oldest deadline 2023-10-16T13:16:38.627421+0000) 2023-10-16T13:16:41.942 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:41 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:41.529+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:41.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:41 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:41.529+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:41.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:41 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:41.502+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:41.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:41 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:41.502+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:41.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:41 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:41.502+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:41.991 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:41 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:41.571+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:41.991 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:41 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:41.571+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:11.884873+0000 front 2023-10-16T13:16:11.885108+0000 (oldest deadline 2023-10-16T13:16:36.485528+0000) 2023-10-16T13:16:42.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:41 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:41.988+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:42.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:41 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:41.988+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:42.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:41 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:41.988+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:42.497 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:42 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:42.286+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:42.497 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:42 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:42.286+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.325298+0000 front 2023-10-16T13:16:05.325474+0000 (oldest deadline 2023-10-16T13:16:28.125827+0000) 2023-10-16T13:16:42.497 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:42 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:42.286+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.427061+0000 front 2023-10-16T13:16:10.426957+0000 (oldest deadline 2023-10-16T13:16:38.627421+0000) 2023-10-16T13:16:42.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:42 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:42.138+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:42.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:42 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:42.138+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:42.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:42 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:42.138+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:42.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:42 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:42.562+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:42.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:42 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:42.562+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:42.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:42 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:42.511+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:42.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:42 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:42.511+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:42.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:42 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:42.511+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:42.962 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:42 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:42.583+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:42.963 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:42 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:42.583+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:11.884873+0000 front 2023-10-16T13:16:11.885108+0000 (oldest deadline 2023-10-16T13:16:36.485528+0000) 2023-10-16T13:16:43.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:42 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:42.960+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:43.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:42 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:42.960+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:43.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:42 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:42.960+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:43.497 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:43 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:43.333+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:43.497 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:43 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:43.333+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.325298+0000 front 2023-10-16T13:16:05.325474+0000 (oldest deadline 2023-10-16T13:16:28.125827+0000) 2023-10-16T13:16:43.497 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:43 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:43.333+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.427061+0000 front 2023-10-16T13:16:10.426957+0000 (oldest deadline 2023-10-16T13:16:38.627421+0000) 2023-10-16T13:16:43.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:43 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:43.126+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:43.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:43 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:43.126+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:43.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:43 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:43.126+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:43.926 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:43 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:43.633+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:43.926 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:43 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:43.633+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:11.884873+0000 front 2023-10-16T13:16:11.885108+0000 (oldest deadline 2023-10-16T13:16:36.485528+0000) 2023-10-16T13:16:43.942 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:43 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:43.573+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:43.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:43 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:43.573+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:43.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:43 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:43.545+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:43.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:43 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:43.545+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:43.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:43 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:43.545+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:44.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:43 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:43.923+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:44.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:43 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:43.923+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:44.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:43 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:43.923+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:44.497 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:44 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:44.303+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:59.523926+0000 front 2023-10-16T13:15:59.523957+0000 (oldest deadline 2023-10-16T13:16:23.624108+0000) 2023-10-16T13:16:44.497 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:44 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:44.303+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.325298+0000 front 2023-10-16T13:16:05.325474+0000 (oldest deadline 2023-10-16T13:16:28.125827+0000) 2023-10-16T13:16:44.497 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:44 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6[134010]: 2023-10-16T13:16:44.303+0000 7fa192ff8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.427061+0000 front 2023-10-16T13:16:10.426957+0000 (oldest deadline 2023-10-16T13:16:38.627421+0000) 2023-10-16T13:16:44.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:44 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:44.167+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:44.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:44 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:44.167+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:44.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:44 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:44.167+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:44.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:44 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:44.167+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:16:44.930 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:44 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:44.598+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:44.931 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:44 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:44.598+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:11.884873+0000 front 2023-10-16T13:16:11.885108+0000 (oldest deadline 2023-10-16T13:16:36.485528+0000) 2023-10-16T13:16:44.942 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:44 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:44.582+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:44.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:44 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:44.582+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:44.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:44 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:44.556+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:44.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:44 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:44.556+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:44.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:44 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:44.556+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:45.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:44 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:44.928+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:45.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:44 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:44.928+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:45.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:44 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:44.928+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:45.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:45 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:45.179+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:45.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:45 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:45.179+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:45.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:45 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:45.179+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:45.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:45 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:45.179+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:16:45.893 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:45 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:45.550+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:45.893 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:45 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:45.550+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:11.884873+0000 front 2023-10-16T13:16:11.885108+0000 (oldest deadline 2023-10-16T13:16:36.485528+0000) 2023-10-16T13:16:45.894 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:45 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:45.550+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.887374+0000 front 2023-10-16T13:16:19.887361+0000 (oldest deadline 2023-10-16T13:16:45.187515+0000) 2023-10-16T13:16:45.942 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:45 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:45.626+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:45.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:45 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:45.626+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:45.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:45 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:45.560+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:45.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:45 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:45.560+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:45.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:45 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:45.560+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:45.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:45 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:45.560+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:16:45.997 INFO:journalctl@ceph.osd.6.smithi092.stdout:Oct 16 13:16:45 smithi092 bash[171010]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-6 2023-10-16T13:16:46.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:45 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:45.891+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:46.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:45 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:45.891+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:46.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:45 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:45.891+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:46.458 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:46 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:46.135+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:46.458 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:46 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:46.135+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:46.458 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:46 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:46.135+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:46.458 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:46 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:46.135+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:16:46.885 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:46 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:46.541+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:46.885 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:46 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:46.541+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:11.884873+0000 front 2023-10-16T13:16:11.885108+0000 (oldest deadline 2023-10-16T13:16:36.485528+0000) 2023-10-16T13:16:46.885 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:46 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:46.541+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.887374+0000 front 2023-10-16T13:16:19.887361+0000 (oldest deadline 2023-10-16T13:16:45.187515+0000) 2023-10-16T13:16:46.942 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:46 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:46.630+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:46.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:46 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:46.630+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:46.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:46 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:46.630+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.644789+0000 front 2023-10-16T13:16:21.644902+0000 (oldest deadline 2023-10-16T13:16:45.744748+0000) 2023-10-16T13:16:46.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:46 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:46.541+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:46.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:46 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:46.541+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:46.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:46 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:46.541+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:46.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:46 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:46.541+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:16:47.238 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.6.service' 2023-10-16T13:16:47.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:46 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:46.882+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:47.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:46 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:46.882+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:47.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:46 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:46.882+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:47.319 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:16:47.320 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-10-16T13:16:47.320 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-10-16T13:16:47.320 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.7 2023-10-16T13:16:47.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:47 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:47.131+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:47.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:47 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:47.132+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:47.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:47 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:47.132+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:47.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:47 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:47.132+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:16:47.682 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:47 smithi118 systemd[1]: Stopping Ceph osd.7 for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:16:47.682 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:47 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:47.569+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:47.683 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:47 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:47.569+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:11.884873+0000 front 2023-10-16T13:16:11.885108+0000 (oldest deadline 2023-10-16T13:16:36.485528+0000) 2023-10-16T13:16:47.683 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:47 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:47.569+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.887374+0000 front 2023-10-16T13:16:19.887361+0000 (oldest deadline 2023-10-16T13:16:45.187515+0000) 2023-10-16T13:16:47.683 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:47 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:47.679+0000 7ff049a8e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:16:47.683 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:47 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:47.679+0000 7ff049a8e700 -1 osd.7 88 *** Got signal Terminated *** 2023-10-16T13:16:47.683 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:47 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:47.679+0000 7ff049a8e700 -1 osd.7 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-16T13:16:47.942 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:47 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:47.596+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:47.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:47 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:47.596+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:47.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:47 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:47.596+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.644789+0000 front 2023-10-16T13:16:21.644902+0000 (oldest deadline 2023-10-16T13:16:45.744748+0000) 2023-10-16T13:16:47.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:47 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:47.544+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:47.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:47 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:47.544+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:47.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:47 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:47.544+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:47.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:47 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:47.544+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:16:48.033 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:47 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:47.893+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:48.033 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:47 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:47.893+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:48.034 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:47 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:47.893+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:48.034 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:47 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:47.893+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:16:48.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:48 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:48.109+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:48.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:48 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:48.109+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:48.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:48 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:48.109+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:48.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:48 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:48.109+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:16:48.892 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:48 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:48.535+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:48.892 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:48 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:48.535+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:11.884873+0000 front 2023-10-16T13:16:11.885108+0000 (oldest deadline 2023-10-16T13:16:36.485528+0000) 2023-10-16T13:16:48.893 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:48 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:48.535+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.887374+0000 front 2023-10-16T13:16:19.887361+0000 (oldest deadline 2023-10-16T13:16:45.187515+0000) 2023-10-16T13:16:48.942 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:48 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:48.578+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:48.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:48 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:48.578+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:48.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:48 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:48.578+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:48.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:48 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:48.578+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:16:48.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:48 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:48.576+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:48.944 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:48 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:48.576+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:48.944 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:48 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:48.576+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.644789+0000 front 2023-10-16T13:16:21.644902+0000 (oldest deadline 2023-10-16T13:16:45.744748+0000) 2023-10-16T13:16:49.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:48 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:48.889+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:49.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:48 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:48.889+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:49.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:48 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:48.889+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:49.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:48 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:48.889+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:16:49.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:49 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:49.149+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:49.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:49 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:49.149+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:49.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:49 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:49.149+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:49.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:49 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:49.149+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:16:49.883 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:49 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:49.574+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:49.883 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:49 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:49.574+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:11.884873+0000 front 2023-10-16T13:16:11.885108+0000 (oldest deadline 2023-10-16T13:16:36.485528+0000) 2023-10-16T13:16:49.883 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:49 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:49.574+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.887374+0000 front 2023-10-16T13:16:19.887361+0000 (oldest deadline 2023-10-16T13:16:45.187515+0000) 2023-10-16T13:16:49.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:49 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:49.551+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:49.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:49 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:49.551+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:49.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:49 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:49.551+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.644789+0000 front 2023-10-16T13:16:21.644902+0000 (oldest deadline 2023-10-16T13:16:45.744748+0000) 2023-10-16T13:16:49.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:49 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:49.567+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:49.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:49 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:49.567+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:49.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:49 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:49.567+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:49.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:49 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:49.567+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:16:50.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:49 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:49.880+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:50.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:49 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:49.880+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:50.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:49 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:49.880+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:50.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:49 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:49.880+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:16:50.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:50 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:50.126+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:50.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:50 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:50.126+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:50.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:50 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:50.126+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:50.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:50 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:50.126+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:16:50.917 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:50 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:50.561+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:50.917 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:50 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:50.561+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:11.884873+0000 front 2023-10-16T13:16:11.885108+0000 (oldest deadline 2023-10-16T13:16:36.485528+0000) 2023-10-16T13:16:50.918 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:50 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:50.561+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.887374+0000 front 2023-10-16T13:16:19.887361+0000 (oldest deadline 2023-10-16T13:16:45.187515+0000) 2023-10-16T13:16:50.942 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:50 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:50.598+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:50.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:50 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:50.598+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:50.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:50 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:50.598+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.644789+0000 front 2023-10-16T13:16:21.644902+0000 (oldest deadline 2023-10-16T13:16:45.744748+0000) 2023-10-16T13:16:50.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:50 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:50.549+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:50.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:50 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:50.549+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:50.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:50 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:50.549+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:50.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:50 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:50.549+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:16:51.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:50 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:50.915+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:51.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:50 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:50.915+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:51.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:50 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:50.915+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:51.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:50 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:50.915+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:16:51.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:51 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:51.080+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:51.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:51 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:51.080+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:51.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:51 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:51.080+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:51.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:51 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:51.080+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:16:51.925 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:51 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:51.602+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:51.925 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:51 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:51.602+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:11.884873+0000 front 2023-10-16T13:16:11.885108+0000 (oldest deadline 2023-10-16T13:16:36.485528+0000) 2023-10-16T13:16:51.925 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:51 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:51.602+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.887374+0000 front 2023-10-16T13:16:19.887361+0000 (oldest deadline 2023-10-16T13:16:45.187515+0000) 2023-10-16T13:16:51.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:51 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:51.600+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:51.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:51 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:51.600+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:51.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:51 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:51.600+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.644789+0000 front 2023-10-16T13:16:21.644902+0000 (oldest deadline 2023-10-16T13:16:45.744748+0000) 2023-10-16T13:16:51.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:51 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:51.583+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:51.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:51 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:51.583+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:51.945 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:51 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:51.583+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:51.945 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:51 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:51.583+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:16:52.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:51 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:51.922+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:52.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:51 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:51.922+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:52.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:51 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:51.922+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:52.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:51 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:51.922+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:16:52.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:51 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:51.922+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:16:52.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:52 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:52.031+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:52.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:52 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:52.031+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:52.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:52 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:52.031+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:52.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:52 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:52.031+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:16:52.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:52 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:52.557+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:52.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:52 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:52.557+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:52.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:52 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:52.557+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.644789+0000 front 2023-10-16T13:16:21.644902+0000 (oldest deadline 2023-10-16T13:16:45.744748+0000) 2023-10-16T13:16:52.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:52 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:52.618+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:52.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:52 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:52.618+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:52.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:52 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:52.618+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:52.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:52 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:52.618+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:16:52.945 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:52 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:52.618+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:16:52.945 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:52 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:52.563+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:04.283646+0000 front 2023-10-16T13:16:04.283665+0000 (oldest deadline 2023-10-16T13:16:29.583859+0000) 2023-10-16T13:16:52.945 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:52 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:52.563+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:11.884873+0000 front 2023-10-16T13:16:11.885108+0000 (oldest deadline 2023-10-16T13:16:36.485528+0000) 2023-10-16T13:16:52.946 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:52 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7[126372]: 2023-10-16T13:16:52.563+0000 7ff04287d700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.887374+0000 front 2023-10-16T13:16:19.887361+0000 (oldest deadline 2023-10-16T13:16:45.187515+0000) 2023-10-16T13:16:53.281 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:52 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:52.941+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:53.281 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:52 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:52.941+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:53.281 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:52 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:52.941+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:53.281 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:52 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:52.941+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:16:53.282 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:52 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:52.941+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:16:53.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:53 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:53.057+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:53.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:53 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:53.057+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:53.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:53 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:53.057+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:53.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:53 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:53.057+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:16:53.534 INFO:journalctl@ceph.osd.7.smithi118.stdout:Oct 16 13:16:53 smithi118 bash[145501]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-7 2023-10-16T13:16:53.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:53 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:53.533+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:53.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:53 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:53.533+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:53.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:53 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:53.533+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.644789+0000 front 2023-10-16T13:16:21.644902+0000 (oldest deadline 2023-10-16T13:16:45.744748+0000) 2023-10-16T13:16:53.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:53 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:53.533+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:28.046041+0000 front 2023-10-16T13:16:28.045933+0000 (oldest deadline 2023-10-16T13:16:53.345900+0000) 2023-10-16T13:16:53.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:53 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:53.627+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:53.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:53 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:53.627+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:53.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:53 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:53.627+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:53.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:53 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:53.627+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:16:53.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:53 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:53.627+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:16:54.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:53 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:53.901+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:54.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:53 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:53.901+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:54.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:53 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:53.901+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:54.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:53 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:53.901+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:16:54.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:53 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:53.901+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:16:54.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:54 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:54.046+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:54.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:54 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:54.046+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:54.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:54 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:54.046+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:54.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:54 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:54.046+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:16:54.863 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.7.service' 2023-10-16T13:16:54.903 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:16:54.904 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-10-16T13:16:54.904 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-10-16T13:16:54.905 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.8 2023-10-16T13:16:54.937 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:54 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:54.486+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:54.937 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:54 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:54.486+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:54.937 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:54 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:54.486+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.644789+0000 front 2023-10-16T13:16:21.644902+0000 (oldest deadline 2023-10-16T13:16:45.744748+0000) 2023-10-16T13:16:54.938 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:54 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:54.486+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:28.046041+0000 front 2023-10-16T13:16:28.045933+0000 (oldest deadline 2023-10-16T13:16:53.345900+0000) 2023-10-16T13:16:54.938 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:54 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:54.649+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:54.938 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:54 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:54.649+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:54.939 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:54 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:54.649+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:54.939 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:54 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:54.649+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:16:54.939 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:54 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:54.649+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:16:55.193 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:54 smithi152 systemd[1]: Stopping Ceph osd.8 for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:16:55.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:54 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:54.858+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:55.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:54 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:54.858+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:55.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:54 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:54.858+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:55.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:54 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:54.858+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:16:55.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:54 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:54.858+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:16:55.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:55 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:55.020+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:55.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:55 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:55.020+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:55.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:55 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:55.020+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:55.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:55 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:55.020+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:16:55.679 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:55 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:55.260+0000 7f447c310700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:16:55.680 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:55 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:55.260+0000 7f447c310700 -1 osd.8 88 *** Got signal Terminated *** 2023-10-16T13:16:55.680 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:55 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:55.260+0000 7f447c310700 -1 osd.8 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-16T13:16:55.680 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:55 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:55.492+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:55.681 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:55 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:55.492+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:55.681 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:55 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:55.492+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.644789+0000 front 2023-10-16T13:16:21.644902+0000 (oldest deadline 2023-10-16T13:16:45.744748+0000) 2023-10-16T13:16:55.681 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:55 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:55.492+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:28.046041+0000 front 2023-10-16T13:16:28.045933+0000 (oldest deadline 2023-10-16T13:16:53.345900+0000) 2023-10-16T13:16:55.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:55 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:55.677+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:55.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:55 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:55.677+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:55.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:55 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:55.677+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:55.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:55 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:55.677+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:16:55.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:55 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:55.677+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:16:56.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:55 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:55.858+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:56.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:55 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:55.858+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:56.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:55 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:55.858+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:56.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:55 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:55.858+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:16:56.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:55 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:55.858+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:16:56.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:56 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:56.023+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:56.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:56 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:56.023+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:56.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:56 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:56.023+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:56.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:56 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:56.023+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:16:56.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:56 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:56.023+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.808026+0000 front 2023-10-16T13:16:29.807864+0000 (oldest deadline 2023-10-16T13:16:55.608122+0000) 2023-10-16T13:16:56.726 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:56 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:56.457+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:56.727 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:56 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:56.457+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:56.727 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:56 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:56.457+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.644789+0000 front 2023-10-16T13:16:21.644902+0000 (oldest deadline 2023-10-16T13:16:45.744748+0000) 2023-10-16T13:16:56.728 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:56 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:56.457+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:28.046041+0000 front 2023-10-16T13:16:28.045933+0000 (oldest deadline 2023-10-16T13:16:53.345900+0000) 2023-10-16T13:16:57.192 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:56 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:56.723+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:57.193 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:56 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:56.723+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:57.193 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:56 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:56.723+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:57.193 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:56 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:56.723+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:16:57.193 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:56 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:56.723+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:16:57.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:56 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:56.877+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:57.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:56 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:56.877+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:57.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:56 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:56.877+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:57.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:56 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:56.877+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:16:57.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:56 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:56.877+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:16:57.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:57 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:57.044+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:57.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:57 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:57.044+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:57.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:57 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:57.044+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:57.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:57 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:57.044+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:16:57.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:57 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:57.044+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.808026+0000 front 2023-10-16T13:16:29.807864+0000 (oldest deadline 2023-10-16T13:16:55.608122+0000) 2023-10-16T13:16:57.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:57 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:57.674+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:57.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:57 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:57.674+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:57.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:57 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:57.674+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:57.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:57 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:57.674+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:16:57.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:57 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:57.674+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:16:57.944 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:57 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:57.476+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:57.944 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:57 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:57.476+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:57.944 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:57 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:57.476+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.644789+0000 front 2023-10-16T13:16:21.644902+0000 (oldest deadline 2023-10-16T13:16:45.744748+0000) 2023-10-16T13:16:57.945 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:57 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:57.476+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:28.046041+0000 front 2023-10-16T13:16:28.045933+0000 (oldest deadline 2023-10-16T13:16:53.345900+0000) 2023-10-16T13:16:58.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:57 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:57.896+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:58.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:57 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:57.896+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:58.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:57 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:57.896+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:58.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:57 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:57.896+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:16:58.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:57 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:57.896+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:16:58.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:58 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:58.035+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:58.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:58 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:58.035+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:58.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:58 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:58.035+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:58.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:58 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:58.035+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:16:58.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:58 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:58.035+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.808026+0000 front 2023-10-16T13:16:29.807864+0000 (oldest deadline 2023-10-16T13:16:55.608122+0000) 2023-10-16T13:16:58.942 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:58 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:58.506+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:58.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:58 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:58.506+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:58.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:58 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:58.506+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.644789+0000 front 2023-10-16T13:16:21.644902+0000 (oldest deadline 2023-10-16T13:16:45.744748+0000) 2023-10-16T13:16:58.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:58 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:58.506+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:28.046041+0000 front 2023-10-16T13:16:28.045933+0000 (oldest deadline 2023-10-16T13:16:53.345900+0000) 2023-10-16T13:16:58.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:58 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:58.655+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:58.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:58 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:58.655+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:58.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:58 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:58.655+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:58.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:58 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:58.655+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:16:58.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:58 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:58.655+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:16:59.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:58 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:58.882+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:16:59.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:58 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:58.882+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:16:59.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:58 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:58.882+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:16:59.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:58 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:58.882+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:16:59.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:58 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:58.882+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:16:59.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:59 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:59.010+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:16:59.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:59 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:59.010+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:16:59.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:59 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:59.010+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:16:59.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:59 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:59.010+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:16:59.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:16:59 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:16:59.010+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.808026+0000 front 2023-10-16T13:16:29.807864+0000 (oldest deadline 2023-10-16T13:16:55.608122+0000) 2023-10-16T13:16:59.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:59 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:59.529+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:03.041235+0000 front 2023-10-16T13:16:03.041114+0000 (oldest deadline 2023-10-16T13:16:28.341188+0000) 2023-10-16T13:16:59.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:59 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:59.529+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.242234+0000 front 2023-10-16T13:16:14.242263+0000 (oldest deadline 2023-10-16T13:16:37.742433+0000) 2023-10-16T13:16:59.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:59 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:59.529+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.644789+0000 front 2023-10-16T13:16:21.644902+0000 (oldest deadline 2023-10-16T13:16:45.744748+0000) 2023-10-16T13:16:59.943 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:16:59 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8[126983]: 2023-10-16T13:16:59.529+0000 7f4475900700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:28.046041+0000 front 2023-10-16T13:16:28.045933+0000 (oldest deadline 2023-10-16T13:16:53.345900+0000) 2023-10-16T13:16:59.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:59 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:59.640+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:16:59.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:59 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:59.640+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:16:59.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:59 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:59.640+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:16:59.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:59 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:59.640+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:16:59.945 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:16:59 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:16:59.640+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:00.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:59 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:59.834+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:17:00.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:59 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:59.834+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:17:00.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:59 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:59.834+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:17:00.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:59 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:59.834+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:17:00.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:16:59 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:16:59.834+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:17:00.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:00 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:00.007+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:17:00.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:00 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:00.007+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:17:00.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:00 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:00.007+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:17:00.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:00 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:00.007+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:17:00.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:00 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:00.007+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.808026+0000 front 2023-10-16T13:16:29.807864+0000 (oldest deadline 2023-10-16T13:16:55.608122+0000) 2023-10-16T13:17:00.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:00 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:00.007+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.309033+0000 front 2023-10-16T13:16:37.309065+0000 (oldest deadline 2023-10-16T13:16:59.608874+0000) 2023-10-16T13:17:00.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:00 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:00.606+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:00.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:00 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:00.606+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:00.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:00 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:00.606+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:00.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:00 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:00.606+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:00.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:00 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:00.606+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:01.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:00 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:00.846+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:17:01.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:00 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:00.846+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:17:01.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:00 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:00.846+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:17:01.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:00 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:00.846+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:17:01.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:00 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:00.846+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:17:01.442 INFO:journalctl@ceph.osd.8.smithi152.stdout:Oct 16 13:17:01 smithi152 bash[146474]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-8 2023-10-16T13:17:01.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:01 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:01.025+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:17:01.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:01 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:01.025+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:17:01.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:01 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:01.025+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:17:01.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:01 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:01.025+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:17:01.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:01 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:01.025+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.808026+0000 front 2023-10-16T13:16:29.807864+0000 (oldest deadline 2023-10-16T13:16:55.608122+0000) 2023-10-16T13:17:01.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:01 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:01.025+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.309033+0000 front 2023-10-16T13:16:37.309065+0000 (oldest deadline 2023-10-16T13:16:59.608874+0000) 2023-10-16T13:17:01.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:01 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:01.642+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:01.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:01 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:01.642+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:01.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:01 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:01.642+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:01.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:01 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:01.642+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:01.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:01 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:01.642+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:02.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:01 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:01.822+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:17:02.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:01 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:01.822+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:17:02.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:01 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:01.822+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:17:02.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:01 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:01.822+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:17:02.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:01 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:01.822+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:17:02.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:02 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:02.054+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:17:02.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:02 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:02.054+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:17:02.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:02 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:02.054+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:17:02.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:02 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:02.054+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:17:02.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:02 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:02.054+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.808026+0000 front 2023-10-16T13:16:29.807864+0000 (oldest deadline 2023-10-16T13:16:55.608122+0000) 2023-10-16T13:17:02.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:02 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:02.054+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.309033+0000 front 2023-10-16T13:16:37.309065+0000 (oldest deadline 2023-10-16T13:16:59.608874+0000) 2023-10-16T13:17:02.509 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.8.service' 2023-10-16T13:17:02.589 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:17:02.589 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-10-16T13:17:02.590 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-10-16T13:17:02.590 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.9 2023-10-16T13:17:02.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:02 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:02.646+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:02.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:02 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:02.646+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:02.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:02 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:02.646+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:02.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:02 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:02.646+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:02.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:02 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:02.646+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:02.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:02 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:02.646+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:02.960 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:02 smithi092 systemd[1]: Stopping Ceph osd.9 for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:17:03.247 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:02 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:02.957+0000 7f693fa0e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:17:03.247 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:02 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:02.957+0000 7f693fa0e700 -1 osd.9 88 *** Got signal Terminated *** 2023-10-16T13:17:03.247 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:02 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:02.957+0000 7f693fa0e700 -1 osd.9 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-16T13:17:03.248 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:03 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:03.038+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:17:03.248 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:03 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:03.038+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:17:03.248 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:03 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:03.038+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:17:03.248 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:03 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:03.038+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:17:03.248 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:03 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:03.038+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.808026+0000 front 2023-10-16T13:16:29.807864+0000 (oldest deadline 2023-10-16T13:16:55.608122+0000) 2023-10-16T13:17:03.249 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:03 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:03.038+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.309033+0000 front 2023-10-16T13:16:37.309065+0000 (oldest deadline 2023-10-16T13:16:59.608874+0000) 2023-10-16T13:17:03.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:02 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:02.871+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:17:03.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:02 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:02.871+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:17:03.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:02 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:02.871+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:17:03.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:02 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:02.871+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:17:03.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:02 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:02.871+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:17:03.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:02 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:02.871+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.480163+0000 front 2023-10-16T13:16:37.480117+0000 (oldest deadline 2023-10-16T13:17:02.780047+0000) 2023-10-16T13:17:03.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:03 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:03.648+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:03.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:03 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:03.648+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:03.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:03 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:03.648+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:03.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:03 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:03.648+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:03.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:03 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:03.648+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:03.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:03 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:03.648+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:04.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:03 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:03.828+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:17:04.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:03 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:03.828+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:17:04.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:03 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:03.828+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:17:04.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:03 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:03.828+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:17:04.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:03 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:03.828+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:17:04.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:03 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:03.828+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.480163+0000 front 2023-10-16T13:16:37.480117+0000 (oldest deadline 2023-10-16T13:17:02.780047+0000) 2023-10-16T13:17:04.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:04 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:04.045+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:17:04.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:04 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:04.045+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:17:04.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:04 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:04.045+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:17:04.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:04 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:04.045+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:17:04.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:04 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:04.045+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.808026+0000 front 2023-10-16T13:16:29.807864+0000 (oldest deadline 2023-10-16T13:16:55.608122+0000) 2023-10-16T13:17:04.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:04 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:04.045+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.309033+0000 front 2023-10-16T13:16:37.309065+0000 (oldest deadline 2023-10-16T13:16:59.608874+0000) 2023-10-16T13:17:04.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:04 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:04.632+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:04.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:04 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:04.632+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:04.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:04 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:04.632+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:04.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:04 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:04.632+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:04.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:04 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:04.632+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:04.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:04 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:04.632+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:05.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:04 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:04.845+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:17:05.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:04 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:04.845+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:17:05.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:04 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:04.845+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:17:05.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:04 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:04.845+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:17:05.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:04 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:04.845+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:17:05.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:04 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:04.845+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.480163+0000 front 2023-10-16T13:16:37.480117+0000 (oldest deadline 2023-10-16T13:17:02.780047+0000) 2023-10-16T13:17:05.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:05 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:05.036+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:17:05.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:05 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:05.036+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:17:05.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:05 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:05.036+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:17:05.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:05 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:05.036+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:17:05.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:05 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:05.036+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.808026+0000 front 2023-10-16T13:16:29.807864+0000 (oldest deadline 2023-10-16T13:16:55.608122+0000) 2023-10-16T13:17:05.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:05 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:05.036+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.309033+0000 front 2023-10-16T13:16:37.309065+0000 (oldest deadline 2023-10-16T13:16:59.608874+0000) 2023-10-16T13:17:05.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:05 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:05.626+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:05.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:05 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:05.626+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:05.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:05 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:05.626+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:05.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:05 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:05.626+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:05.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:05 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:05.626+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:05.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:05 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:05.626+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:06.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:05 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:05.812+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:17:06.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:05 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:05.812+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:17:06.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:05 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:05.812+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:17:06.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:05 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:05.812+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:17:06.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:05 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:05.812+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:17:06.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:05 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:05.812+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.480163+0000 front 2023-10-16T13:16:37.480117+0000 (oldest deadline 2023-10-16T13:17:02.780047+0000) 2023-10-16T13:17:06.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:05 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:05.812+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2023-10-16T13:16:44.481153+0000 front 2023-10-16T13:16:44.481262+0000 (oldest deadline 2023-10-16T13:17:05.580975+0000) 2023-10-16T13:17:06.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:06 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:06.032+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:17:06.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:06 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:06.032+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:17:06.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:06 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:06.032+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:17:06.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:06 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:06.032+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:17:06.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:06 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:06.032+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.808026+0000 front 2023-10-16T13:16:29.807864+0000 (oldest deadline 2023-10-16T13:16:55.608122+0000) 2023-10-16T13:17:06.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:06 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:06.032+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.309033+0000 front 2023-10-16T13:16:37.309065+0000 (oldest deadline 2023-10-16T13:16:59.608874+0000) 2023-10-16T13:17:06.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:06 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:06.577+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:06.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:06 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:06.577+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:06.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:06 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:06.577+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:06.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:06 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:06.577+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:06.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:06 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:06.577+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:06.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:06 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:06.577+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:07.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:06 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:06.848+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:17:07.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:06 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:06.848+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:17:07.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:06 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:06.848+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:17:07.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:06 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:06.848+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:17:07.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:06 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:06.848+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:17:07.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:06 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:06.848+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.480163+0000 front 2023-10-16T13:16:37.480117+0000 (oldest deadline 2023-10-16T13:17:02.780047+0000) 2023-10-16T13:17:07.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:06 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:06.848+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2023-10-16T13:16:44.481153+0000 front 2023-10-16T13:16:44.481262+0000 (oldest deadline 2023-10-16T13:17:05.580975+0000) 2023-10-16T13:17:07.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:07 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:07.054+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:57.801935+0000 front 2023-10-16T13:15:57.802060+0000 (oldest deadline 2023-10-16T13:16:23.102085+0000) 2023-10-16T13:17:07.497 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:07 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:07.054+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:06.503706+0000 front 2023-10-16T13:16:06.503640+0000 (oldest deadline 2023-10-16T13:16:30.603693+0000) 2023-10-16T13:17:07.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:07 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:07.054+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:10.604179+0000 front 2023-10-16T13:16:10.604164+0000 (oldest deadline 2023-10-16T13:16:35.304286+0000) 2023-10-16T13:17:07.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:07 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:07.054+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:19.405164+0000 front 2023-10-16T13:16:19.405201+0000 (oldest deadline 2023-10-16T13:16:44.105256+0000) 2023-10-16T13:17:07.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:07 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:07.054+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.808026+0000 front 2023-10-16T13:16:29.807864+0000 (oldest deadline 2023-10-16T13:16:55.608122+0000) 2023-10-16T13:17:07.498 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:07 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9[142153]: 2023-10-16T13:17:07.054+0000 7f693a000700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.309033+0000 front 2023-10-16T13:16:37.309065+0000 (oldest deadline 2023-10-16T13:16:59.608874+0000) 2023-10-16T13:17:07.942 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:07 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:07.569+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:07.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:07 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:07.569+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:07.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:07 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:07.569+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:07.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:07 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:07.569+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:07.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:07 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:07.569+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:07.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:07 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:07.569+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:08.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:07 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:07.807+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:17:08.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:07 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:07.807+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:17:08.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:07 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:07.807+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:17:08.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:07 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:07.807+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:17:08.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:07 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:07.807+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:17:08.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:07 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:07.807+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.480163+0000 front 2023-10-16T13:16:37.480117+0000 (oldest deadline 2023-10-16T13:17:02.780047+0000) 2023-10-16T13:17:08.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:07 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:07.807+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2023-10-16T13:16:44.481153+0000 front 2023-10-16T13:16:44.481262+0000 (oldest deadline 2023-10-16T13:17:05.580975+0000) 2023-10-16T13:17:08.726 INFO:journalctl@ceph.osd.9.smithi092.stdout:Oct 16 13:17:08 smithi092 bash[171281]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-9 2023-10-16T13:17:08.942 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:08 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:08.568+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:08.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:08 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:08.568+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:08.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:08 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:08.568+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:08.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:08 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:08.568+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:08.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:08 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:08.568+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:08.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:08 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:08.568+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:09.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:08 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:08.842+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:17:09.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:08 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:08.842+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:17:09.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:08 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:08.842+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:17:09.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:08 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:08.842+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:17:09.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:08 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:08.842+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:17:09.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:08 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:08.842+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.480163+0000 front 2023-10-16T13:16:37.480117+0000 (oldest deadline 2023-10-16T13:17:02.780047+0000) 2023-10-16T13:17:09.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:08 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:08.842+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2023-10-16T13:16:44.481153+0000 front 2023-10-16T13:16:44.481262+0000 (oldest deadline 2023-10-16T13:17:05.580975+0000) 2023-10-16T13:17:09.942 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:09 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:09.612+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:09.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:09 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:09.612+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:09.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:09 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:09.612+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:09.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:09 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:09.612+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:09.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:09 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:09.612+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:09.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:09 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:09.612+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:10.088 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.9.service' 2023-10-16T13:17:10.129 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:17:10.130 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-10-16T13:17:10.130 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-10-16T13:17:10.130 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.10 2023-10-16T13:17:10.161 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:09 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:09.831+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:17:10.161 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:09 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:09.831+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:17:10.162 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:09 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:09.831+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:17:10.162 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:09 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:09.831+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:17:10.162 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:09 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:09.831+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:17:10.162 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:09 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:09.831+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.480163+0000 front 2023-10-16T13:16:37.480117+0000 (oldest deadline 2023-10-16T13:17:02.780047+0000) 2023-10-16T13:17:10.162 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:09 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:09.831+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2023-10-16T13:16:44.481153+0000 front 2023-10-16T13:16:44.481262+0000 (oldest deadline 2023-10-16T13:17:05.580975+0000) 2023-10-16T13:17:10.502 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:10 smithi118 systemd[1]: Stopping Ceph osd.10 for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:17:10.783 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:10 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:10.500+0000 7f2e07a5b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:17:10.784 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:10 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:10.500+0000 7f2e07a5b700 -1 osd.10 88 *** Got signal Terminated *** 2023-10-16T13:17:10.784 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:10 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:10.500+0000 7f2e07a5b700 -1 osd.10 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-16T13:17:10.942 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:10 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:10.601+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:10.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:10 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:10.601+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:10.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:10 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:10.601+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:10.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:10 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:10.601+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:10.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:10 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:10.601+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:10.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:10 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:10.601+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:11.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:10 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:10.869+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:17:11.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:10 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:10.869+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:17:11.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:10 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:10.869+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:17:11.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:10 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:10.869+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:17:11.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:10 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:10.869+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:17:11.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:10 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:10.869+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.480163+0000 front 2023-10-16T13:16:37.480117+0000 (oldest deadline 2023-10-16T13:17:02.780047+0000) 2023-10-16T13:17:11.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:10 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:10.869+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2023-10-16T13:16:44.481153+0000 front 2023-10-16T13:16:44.481262+0000 (oldest deadline 2023-10-16T13:17:05.580975+0000) 2023-10-16T13:17:11.942 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:11 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:11.583+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:11.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:11 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:11.583+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:11.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:11 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:11.583+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:11.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:11 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:11.583+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:11.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:11 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:11.583+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:11.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:11 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:11.583+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:12.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:11 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:11.826+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:17:12.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:11 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:11.826+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:17:12.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:11 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:11.826+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:17:12.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:11 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:11.826+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:17:12.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:11 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:11.826+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:17:12.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:11 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:11.826+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.480163+0000 front 2023-10-16T13:16:37.480117+0000 (oldest deadline 2023-10-16T13:17:02.780047+0000) 2023-10-16T13:17:12.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:11 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:11.826+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2023-10-16T13:16:44.481153+0000 front 2023-10-16T13:16:44.481262+0000 (oldest deadline 2023-10-16T13:17:05.580975+0000) 2023-10-16T13:17:12.942 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:12 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:12.562+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:12.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:12 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:12.562+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:12.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:12 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:12.562+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:12.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:12 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:12.562+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:12.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:12 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:12.562+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:12.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:12 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:12.562+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:13.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:12 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:12.782+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:17:13.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:12 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:12.782+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:17:13.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:12 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:12.782+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:17:13.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:12 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:12.782+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:17:13.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:12 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:12.782+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:17:13.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:12 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:12.782+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.480163+0000 front 2023-10-16T13:16:37.480117+0000 (oldest deadline 2023-10-16T13:17:02.780047+0000) 2023-10-16T13:17:13.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:12 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:12.782+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2023-10-16T13:16:44.481153+0000 front 2023-10-16T13:16:44.481262+0000 (oldest deadline 2023-10-16T13:17:05.580975+0000) 2023-10-16T13:17:13.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:13 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:13.585+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:13.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:13 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:13.585+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:13.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:13 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:13.585+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:13.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:13 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:13.585+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:13.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:13 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:13.585+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:13.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:13 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:13.585+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:14.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:13 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:13.807+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:17:14.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:13 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:13.807+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:17:14.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:13 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:13.807+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:17:14.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:13 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:13.807+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:17:14.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:13 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:13.807+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:17:14.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:13 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:13.807+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.480163+0000 front 2023-10-16T13:16:37.480117+0000 (oldest deadline 2023-10-16T13:17:02.780047+0000) 2023-10-16T13:17:14.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:13 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:13.807+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2023-10-16T13:16:44.481153+0000 front 2023-10-16T13:16:44.481262+0000 (oldest deadline 2023-10-16T13:17:05.580975+0000) 2023-10-16T13:17:14.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:14 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:14.593+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:14.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:14 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:14.593+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:14.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:14 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:14.593+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:14.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:14 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:14.593+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:14.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:14 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:14.593+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:14.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:14 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:14.593+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:14.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:14 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:14.593+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6820 osd.7 since back 2023-10-16T13:16:49.457930+0000 front 2023-10-16T13:16:49.457960+0000 (oldest deadline 2023-10-16T13:17:14.157854+0000) 2023-10-16T13:17:15.283 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:14 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:14.836+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:54.273837+0000 front 2023-10-16T13:15:54.273941+0000 (oldest deadline 2023-10-16T13:16:26.074360+0000) 2023-10-16T13:17:15.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:14 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:14.836+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:07.175563+0000 front 2023-10-16T13:16:07.175585+0000 (oldest deadline 2023-10-16T13:16:28.875714+0000) 2023-10-16T13:17:15.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:14 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:14.836+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:14.176840+0000 front 2023-10-16T13:16:14.176798+0000 (oldest deadline 2023-10-16T13:16:37.076854+0000) 2023-10-16T13:17:15.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:14 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:14.836+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:21.777813+0000 front 2023-10-16T13:16:21.777726+0000 (oldest deadline 2023-10-16T13:16:47.677617+0000) 2023-10-16T13:17:15.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:14 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:14.836+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:27.677942+0000 front 2023-10-16T13:16:27.677972+0000 (oldest deadline 2023-10-16T13:16:51.678507+0000) 2023-10-16T13:17:15.284 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:14 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:14.836+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:37.480163+0000 front 2023-10-16T13:16:37.480117+0000 (oldest deadline 2023-10-16T13:17:02.780047+0000) 2023-10-16T13:17:15.285 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:14 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10[135140]: 2023-10-16T13:17:14.836+0000 7f2e0204d700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2023-10-16T13:16:44.481153+0000 front 2023-10-16T13:16:44.481262+0000 (oldest deadline 2023-10-16T13:17:05.580975+0000) 2023-10-16T13:17:15.942 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:15 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:15.554+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:15.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:15 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:15.554+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:15.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:15 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:15.554+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:15.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:15 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:15.554+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:15.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:15 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:15.554+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:15.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:15 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:15.554+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:15.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:15 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:15.554+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6820 osd.7 since back 2023-10-16T13:16:49.457930+0000 front 2023-10-16T13:16:49.457960+0000 (oldest deadline 2023-10-16T13:17:14.157854+0000) 2023-10-16T13:17:16.533 INFO:journalctl@ceph.osd.10.smithi118.stdout:Oct 16 13:17:16 smithi118 bash[145771]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-10 2023-10-16T13:17:16.942 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:16 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:16.555+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:16.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:16 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:16.555+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:16.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:16 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:16.555+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:16.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:16 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:16.555+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:16.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:16 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:16.555+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:16.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:16 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:16.555+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:16.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:16 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:16.555+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6820 osd.7 since back 2023-10-16T13:16:49.457930+0000 front 2023-10-16T13:16:49.457960+0000 (oldest deadline 2023-10-16T13:17:14.157854+0000) 2023-10-16T13:17:17.529 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.10.service' 2023-10-16T13:17:17.609 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:17:17.610 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-10-16T13:17:17.610 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-10-16T13:17:17.611 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.11 2023-10-16T13:17:17.942 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:17 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:17.556+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:17.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:17 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:17.556+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:17.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:17 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:17.556+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:17.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:17 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:17.556+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:17.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:17 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:17.556+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:17.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:17 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:17.556+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:17.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:17 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:17.556+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6820 osd.7 since back 2023-10-16T13:16:49.457930+0000 front 2023-10-16T13:16:49.457960+0000 (oldest deadline 2023-10-16T13:17:14.157854+0000) 2023-10-16T13:17:17.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:17 smithi152 systemd[1]: Stopping Ceph osd.11 for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:17:18.442 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:17 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:17.965+0000 7fca00380700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:17:18.443 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:17 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:17.965+0000 7fca00380700 -1 osd.11 88 *** Got signal Terminated *** 2023-10-16T13:17:18.443 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:17 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:17.965+0000 7fca00380700 -1 osd.11 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-16T13:17:18.942 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:18 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:18.529+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:18.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:18 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:18.529+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:18.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:18 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:18.529+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:18.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:18 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:18.529+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:18.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:18 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:18.529+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:18.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:18 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:18.529+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:18.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:18 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:18.529+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6820 osd.7 since back 2023-10-16T13:16:49.457930+0000 front 2023-10-16T13:16:49.457960+0000 (oldest deadline 2023-10-16T13:17:14.157854+0000) 2023-10-16T13:17:19.942 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:19 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:19.519+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:19.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:19 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:19.519+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:19.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:19 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:19.519+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:19.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:19 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:19.519+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:19.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:19 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:19.519+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:19.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:19 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:19.519+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:19.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:19 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:19.519+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6820 osd.7 since back 2023-10-16T13:16:49.457930+0000 front 2023-10-16T13:16:49.457960+0000 (oldest deadline 2023-10-16T13:17:14.157854+0000) 2023-10-16T13:17:20.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:20 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:20.491+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:20.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:20 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:20.491+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:20.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:20 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:20.491+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:20.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:20 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:20.491+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:20.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:20 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:20.491+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:20.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:20 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:20.491+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:20.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:20 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:20.491+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6820 osd.7 since back 2023-10-16T13:16:49.457930+0000 front 2023-10-16T13:16:49.457960+0000 (oldest deadline 2023-10-16T13:17:14.157854+0000) 2023-10-16T13:17:21.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:21 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:21.476+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:21.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:21 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:21.476+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:21.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:21 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:21.476+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:21.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:21 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:21.476+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:21.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:21 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:21.476+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:21.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:21 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:21.476+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:21.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:21 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:21.476+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6820 osd.7 since back 2023-10-16T13:16:49.457930+0000 front 2023-10-16T13:16:49.457960+0000 (oldest deadline 2023-10-16T13:17:14.157854+0000) 2023-10-16T13:17:22.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:22 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:22.487+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2023-10-16T13:15:58.949317+0000 front 2023-10-16T13:15:58.949384+0000 (oldest deadline 2023-10-16T13:16:20.649409+0000) 2023-10-16T13:17:22.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:22 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:22.487+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2023-10-16T13:16:05.350681+0000 front 2023-10-16T13:16:05.350708+0000 (oldest deadline 2023-10-16T13:16:28.250528+0000) 2023-10-16T13:17:22.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:22 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:22.487+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2023-10-16T13:16:13.451715+0000 front 2023-10-16T13:16:13.451743+0000 (oldest deadline 2023-10-16T13:16:38.751926+0000) 2023-10-16T13:17:22.943 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:22 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:22.487+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2023-10-16T13:16:18.752575+0000 front 2023-10-16T13:16:18.752543+0000 (oldest deadline 2023-10-16T13:16:44.652450+0000) 2023-10-16T13:17:22.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:22 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:22.487+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2023-10-16T13:16:29.854283+0000 front 2023-10-16T13:16:29.854214+0000 (oldest deadline 2023-10-16T13:16:52.154097+0000) 2023-10-16T13:17:22.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:22 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:22.487+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2023-10-16T13:16:36.656205+0000 front 2023-10-16T13:16:36.656140+0000 (oldest deadline 2023-10-16T13:17:01.956167+0000) 2023-10-16T13:17:22.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:22 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:22.487+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.118:6820 osd.7 since back 2023-10-16T13:16:49.457930+0000 front 2023-10-16T13:16:49.457960+0000 (oldest deadline 2023-10-16T13:17:14.157854+0000) 2023-10-16T13:17:22.944 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:22 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11[135766]: 2023-10-16T13:17:22.487+0000 7fc9fd177700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.152:6820 osd.8 since back 2023-10-16T13:16:59.259790+0000 front 2023-10-16T13:16:59.259823+0000 (oldest deadline 2023-10-16T13:17:21.559938+0000) 2023-10-16T13:17:23.942 INFO:journalctl@ceph.osd.11.smithi152.stdout:Oct 16 13:17:23 smithi152 bash[146742]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-osd-11 2023-10-16T13:17:24.872 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@osd.11.service' 2023-10-16T13:17:24.914 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:17:24.915 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-10-16T13:17:24.915 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-10-16T13:17:24.916 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.a 2023-10-16T13:17:25.247 INFO:journalctl@ceph.mds.a.smithi092.stdout:Oct 16 13:17:24 smithi092 systemd[1]: Stopping Ceph mds.a for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:17:25.747 INFO:journalctl@ceph.mds.a.smithi092.stdout:Oct 16 13:17:25 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-a[150771]: 2023-10-16T13:17:25.295+0000 7fc6f614e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:17:25.747 INFO:journalctl@ceph.mds.a.smithi092.stdout:Oct 16 13:17:25 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-a[150771]: 2023-10-16T13:17:25.295+0000 7fc6f614e700 -1 mds.a *** got signal Terminated *** 2023-10-16T13:17:29.441 INFO:journalctl@ceph.mds.a.smithi092.stdout:Oct 16 13:17:29 smithi092 bash[171546]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-a 2023-10-16T13:17:29.628 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.a.service' 2023-10-16T13:17:29.666 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:17:29.667 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-10-16T13:17:29.667 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-10-16T13:17:29.668 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.d 2023-10-16T13:17:29.997 INFO:journalctl@ceph.mds.d.smithi092.stdout:Oct 16 13:17:29 smithi092 systemd[1]: Stopping Ceph mds.d for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:17:30.497 INFO:journalctl@ceph.mds.d.smithi092.stdout:Oct 16 13:17:30 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-d[149808]: 2023-10-16T13:17:30.051+0000 7f211eb92700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:17:30.497 INFO:journalctl@ceph.mds.d.smithi092.stdout:Oct 16 13:17:30 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-d[149808]: 2023-10-16T13:17:30.051+0000 7f211eb92700 -1 mds.d *** got signal Terminated *** 2023-10-16T13:17:34.497 INFO:journalctl@ceph.mds.d.smithi092.stdout:Oct 16 13:17:34 smithi092 bash[171692]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-d 2023-10-16T13:17:34.663 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.d.service' 2023-10-16T13:17:34.697 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:17:34.698 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-10-16T13:17:34.698 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-10-16T13:17:34.698 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.g 2023-10-16T13:17:34.997 INFO:journalctl@ceph.mds.g.smithi092.stdout:Oct 16 13:17:34 smithi092 systemd[1]: Stopping Ceph mds.g for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:17:35.497 INFO:journalctl@ceph.mds.g.smithi092.stdout:Oct 16 13:17:35 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-g[150383]: 2023-10-16T13:17:35.065+0000 7fecee48d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:17:35.497 INFO:journalctl@ceph.mds.g.smithi092.stdout:Oct 16 13:17:35 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-g[150383]: 2023-10-16T13:17:35.065+0000 7fecee48d700 -1 mds.g *** got signal Terminated *** 2023-10-16T13:17:37.747 INFO:journalctl@ceph.mds.g.smithi092.stdout:Oct 16 13:17:37 smithi092 bash[171842]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-g 2023-10-16T13:17:37.758 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.g.service' 2023-10-16T13:17:37.793 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:17:37.793 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-10-16T13:17:37.793 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-10-16T13:17:37.794 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.j 2023-10-16T13:17:38.176 INFO:journalctl@ceph.mds.j.smithi092.stdout:Oct 16 13:17:37 smithi092 systemd[1]: Stopping Ceph mds.j for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:17:38.497 INFO:journalctl@ceph.mds.j.smithi092.stdout:Oct 16 13:17:38 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-j[149425]: 2023-10-16T13:17:38.173+0000 7f0c7fd9b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:17:38.497 INFO:journalctl@ceph.mds.j.smithi092.stdout:Oct 16 13:17:38 smithi092 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-j[149425]: 2023-10-16T13:17:38.173+0000 7f0c7fd9b700 -1 mds.j *** got signal Terminated *** 2023-10-16T13:17:40.935 INFO:journalctl@ceph.mds.j.smithi092.stdout:Oct 16 13:17:40 smithi092 bash[171990]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-j 2023-10-16T13:17:41.136 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.j.service' 2023-10-16T13:17:41.169 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:17:41.170 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-10-16T13:17:41.170 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-10-16T13:17:41.170 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.b 2023-10-16T13:17:41.532 INFO:journalctl@ceph.mds.b.smithi118.stdout:Oct 16 13:17:41 smithi118 systemd[1]: Stopping Ceph mds.b for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:17:41.783 INFO:journalctl@ceph.mds.b.smithi118.stdout:Oct 16 13:17:41 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-b[141414]: 2023-10-16T13:17:41.529+0000 7fc193eed700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:17:41.784 INFO:journalctl@ceph.mds.b.smithi118.stdout:Oct 16 13:17:41 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-b[141414]: 2023-10-16T13:17:41.529+0000 7fc193eed700 -1 mds.b *** got signal Terminated *** 2023-10-16T13:17:45.533 INFO:journalctl@ceph.mds.b.smithi118.stdout:Oct 16 13:17:45 smithi118 bash[146046]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-b 2023-10-16T13:17:45.597 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.b.service' 2023-10-16T13:17:45.633 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:17:45.634 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-10-16T13:17:45.634 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-10-16T13:17:45.634 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.e 2023-10-16T13:17:46.030 INFO:journalctl@ceph.mds.e.smithi118.stdout:Oct 16 13:17:45 smithi118 systemd[1]: Stopping Ceph mds.e for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:17:46.283 INFO:journalctl@ceph.mds.e.smithi118.stdout:Oct 16 13:17:46 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-e[140730]: 2023-10-16T13:17:46.027+0000 7f721ef4d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:17:46.283 INFO:journalctl@ceph.mds.e.smithi118.stdout:Oct 16 13:17:46 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-e[140730]: 2023-10-16T13:17:46.027+0000 7f721ef4d700 -1 mds.e *** got signal Terminated *** 2023-10-16T13:17:49.478 INFO:journalctl@ceph.mds.e.smithi118.stdout:Oct 16 13:17:49 smithi118 bash[146186]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-e 2023-10-16T13:17:49.664 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.e.service' 2023-10-16T13:17:49.699 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:17:49.699 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-10-16T13:17:49.700 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-10-16T13:17:49.700 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.h 2023-10-16T13:17:50.033 INFO:journalctl@ceph.mds.h.smithi118.stdout:Oct 16 13:17:49 smithi118 systemd[1]: Stopping Ceph mds.h for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:17:50.533 INFO:journalctl@ceph.mds.h.smithi118.stdout:Oct 16 13:17:50 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-h[141071]: 2023-10-16T13:17:50.086+0000 7f9ac9189700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:17:50.534 INFO:journalctl@ceph.mds.h.smithi118.stdout:Oct 16 13:17:50 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-h[141071]: 2023-10-16T13:17:50.086+0000 7f9ac9189700 -1 mds.h *** got signal Terminated *** 2023-10-16T13:17:53.533 INFO:journalctl@ceph.mds.h.smithi118.stdout:Oct 16 13:17:53 smithi118 bash[146327]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-h 2023-10-16T13:17:53.630 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.h.service' 2023-10-16T13:17:53.663 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:17:53.664 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-10-16T13:17:53.664 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-10-16T13:17:53.664 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.k 2023-10-16T13:17:54.033 INFO:journalctl@ceph.mds.k.smithi118.stdout:Oct 16 13:17:53 smithi118 systemd[1]: Stopping Ceph mds.k for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:17:54.533 INFO:journalctl@ceph.mds.k.smithi118.stdout:Oct 16 13:17:54 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-k[140380]: 2023-10-16T13:17:54.034+0000 7f08f85d6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:17:54.533 INFO:journalctl@ceph.mds.k.smithi118.stdout:Oct 16 13:17:54 smithi118 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-k[140380]: 2023-10-16T13:17:54.034+0000 7f08f85d6700 -1 mds.k *** got signal Terminated *** 2023-10-16T13:17:57.533 INFO:journalctl@ceph.mds.k.smithi118.stdout:Oct 16 13:17:57 smithi118 bash[146464]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-k 2023-10-16T13:17:57.604 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.k.service' 2023-10-16T13:17:57.637 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:17:57.637 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-10-16T13:17:57.638 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-10-16T13:17:57.638 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.c 2023-10-16T13:17:57.943 INFO:journalctl@ceph.mds.c.smithi152.stdout:Oct 16 13:17:57 smithi152 systemd[1]: Stopping Ceph mds.c for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:17:58.442 INFO:journalctl@ceph.mds.c.smithi152.stdout:Oct 16 13:17:58 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-c[142011]: 2023-10-16T13:17:58.009+0000 7efedcf2c700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:17:58.443 INFO:journalctl@ceph.mds.c.smithi152.stdout:Oct 16 13:17:58 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-c[142011]: 2023-10-16T13:17:58.009+0000 7efedcf2c700 -1 mds.c *** got signal Terminated *** 2023-10-16T13:18:01.467 INFO:journalctl@ceph.mds.c.smithi152.stdout:Oct 16 13:18:01 smithi152 bash[147024]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-c 2023-10-16T13:18:01.659 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.c.service' 2023-10-16T13:18:01.696 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:18:01.697 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-10-16T13:18:01.697 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-10-16T13:18:01.697 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.f 2023-10-16T13:18:01.943 INFO:journalctl@ceph.mds.f.smithi152.stdout:Oct 16 13:18:01 smithi152 systemd[1]: Stopping Ceph mds.f for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:18:02.442 INFO:journalctl@ceph.mds.f.smithi152.stdout:Oct 16 13:18:02 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-f[141669]: 2023-10-16T13:18:02.099+0000 7fd8ff383700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:18:02.443 INFO:journalctl@ceph.mds.f.smithi152.stdout:Oct 16 13:18:02 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-f[141669]: 2023-10-16T13:18:02.099+0000 7fd8ff383700 -1 mds.f *** got signal Terminated *** 2023-10-16T13:18:05.626 INFO:journalctl@ceph.mds.f.smithi152.stdout:Oct 16 13:18:05 smithi152 bash[147165]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-f 2023-10-16T13:18:05.632 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.f.service' 2023-10-16T13:18:05.666 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:18:05.667 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-10-16T13:18:05.667 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-10-16T13:18:05.667 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.i 2023-10-16T13:18:05.942 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:18:05 smithi152 systemd[1]: Stopping Ceph mds.i for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:18:06.442 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:18:06 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:18:06.030+0000 7f1cf96ef700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:18:06.443 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:18:06 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i[142349]: 2023-10-16T13:18:06.030+0000 7f1cf96ef700 -1 mds.i *** got signal Terminated *** 2023-10-16T13:18:09.590 INFO:journalctl@ceph.mds.i.smithi152.stdout:Oct 16 13:18:09 smithi152 bash[147308]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-i 2023-10-16T13:18:09.597 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.i.service' 2023-10-16T13:18:09.630 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:18:09.631 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-10-16T13:18:09.631 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-10-16T13:18:09.631 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.l 2023-10-16T13:18:09.942 INFO:journalctl@ceph.mds.l.smithi152.stdout:Oct 16 13:18:09 smithi152 systemd[1]: Stopping Ceph mds.l for 6c276d7e-6c24-11ee-8db6-212e2dc638e7... 2023-10-16T13:18:10.442 INFO:journalctl@ceph.mds.l.smithi152.stdout:Oct 16 13:18:10 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-l[141328]: 2023-10-16T13:18:10.022+0000 7ff204c9d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-16T13:18:10.443 INFO:journalctl@ceph.mds.l.smithi152.stdout:Oct 16 13:18:10 smithi152 ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-l[141328]: 2023-10-16T13:18:10.022+0000 7ff204c9d700 -1 mds.l *** got signal Terminated *** 2023-10-16T13:18:13.476 INFO:journalctl@ceph.mds.l.smithi152.stdout:Oct 16 13:18:13 smithi152 bash[147448]: ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7-mds-l 2023-10-16T13:18:13.676 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c276d7e-6c24-11ee-8db6-212e2dc638e7@mds.l.service' 2023-10-16T13:18:13.711 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T13:18:13.711 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-10-16T13:18:13.712 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 --force --keep-logs 2023-10-16T13:18:14.021 INFO:teuthology.orchestra.run.smithi092.stdout:Deleting cluster with fsid: 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:18:15.574 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 --force --keep-logs 2023-10-16T13:18:15.882 INFO:teuthology.orchestra.run.smithi118.stdout:Deleting cluster with fsid: 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:18:17.450 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 --force --keep-logs 2023-10-16T13:18:17.758 INFO:teuthology.orchestra.run.smithi152.stdout:Deleting cluster with fsid: 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:18:19.353 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-16T13:18:19.392 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-16T13:18:19.430 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-16T13:18:19.460 INFO:tasks.cephadm:Archiving crash dumps... 2023-10-16T13:18:19.462 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/crash to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428999/remote/smithi092/crash 2023-10-16T13:18:19.463 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/crash -- . 2023-10-16T13:18:19.495 INFO:teuthology.orchestra.run.smithi092.stderr:tar: /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-16T13:18:19.495 INFO:teuthology.orchestra.run.smithi092.stderr:tar: Error is not recoverable: exiting now 2023-10-16T13:18:19.497 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/crash to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428999/remote/smithi118/crash 2023-10-16T13:18:19.498 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/crash -- . 2023-10-16T13:18:19.542 INFO:teuthology.orchestra.run.smithi118.stderr:tar: /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-16T13:18:19.542 INFO:teuthology.orchestra.run.smithi118.stderr:tar: Error is not recoverable: exiting now 2023-10-16T13:18:19.544 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/crash to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428999/remote/smithi152/crash 2023-10-16T13:18:19.545 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/crash -- . 2023-10-16T13:18:19.583 INFO:teuthology.orchestra.run.smithi152.stderr:tar: /var/lib/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-16T13:18:19.584 INFO:teuthology.orchestra.run.smithi152.stderr:tar: Error is not recoverable: exiting now 2023-10-16T13:18:19.584 INFO:tasks.cephadm:Checking cluster log for badness... 2023-10-16T13:18:19.585 DEBUG:teuthology.orchestra.run.smithi092:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-10-16T13:18:19.622 INFO:teuthology.orchestra.run.smithi092.stderr:grep: /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph.log: No such file or directory 2023-10-16T13:18:19.625 INFO:tasks.cephadm:Compressing logs... 2023-10-16T13:18:19.625 DEBUG:teuthology.orchestra.run.smithi092:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-16T13:18:19.667 DEBUG:teuthology.orchestra.run.smithi118:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-16T13:18:19.669 DEBUG:teuthology.orchestra.run.smithi152:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-16T13:18:19.699 INFO:teuthology.orchestra.run.smithi092.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-16T13:18:19.700 INFO:teuthology.orchestra.run.smithi092.stderr:: No such file or directory 2023-10-16T13:18:19.700 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.0.log 2023-10-16T13:18:19.701 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.g.log 2023-10-16T13:18:19.701 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.a.log 2023-10-16T13:18:19.701 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.0.log: /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.6.log 2023-10-16T13:18:19.702 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.3.log 2023-10-16T13:18:19.705 INFO:teuthology.orchestra.run.smithi152.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose : No such file or directory-- 2023-10-16T13:18:19.705 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/cephadm.log 2023-10-16T13:18:19.706 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.5.log 2023-10-16T13:18:19.706 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.2.log 2023-10-16T13:18:19.706 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.11.log 2023-10-16T13:18:19.706 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.5.log: /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mgr.z.log 2023-10-16T13:18:19.707 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.8.log 2023-10-16T13:18:19.707 INFO:teuthology.orchestra.run.smithi152.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-16T13:18:19.707 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.f.log 2023-10-16T13:18:19.707 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.c.log 2023-10-16T13:18:19.707 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.f.log: /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.c.log: 91.9% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mgr.z.log.gz 2023-10-16T13:18:19.708 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.i.log 2023-10-16T13:18:19.708 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mon.c.log 2023-10-16T13:18:19.708 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-volume.log 2023-10-16T13:18:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.d.log 2023-10-16T13:18:19.709 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.3.log: /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.d.log: 94.6% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.d.log.gz 2023-10-16T13:18:19.709 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mgr.x.log 2023-10-16T13:18:19.709 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mgr.x.log: 93.4% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-16T13:18:19.710 INFO:teuthology.orchestra.run.smithi118.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-16T13:18:19.713 INFO:teuthology.orchestra.run.smithi118.stderr:: No such file or directory 2023-10-16T13:18:19.713 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.10.log 2023-10-16T13:18:19.713 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.h.log 2023-10-16T13:18:19.713 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.e.log 2023-10-16T13:18:19.714 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.4.log 2023-10-16T13:18:19.714 INFO:teuthology.orchestra.run.smithi118.stderr: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-16T13:18:19.714 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.1.log 2023-10-16T13:18:19.714 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.k.log 2023-10-16T13:18:19.714 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-volume.log 2023-10-16T13:18:19.716 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.9.log 2023-10-16T13:18:19.716 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-volume.log 2023-10-16T13:18:19.716 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.k.log: /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-volume.log: 91.0% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-volume.log.gz 2023-10-16T13:18:19.716 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.7.log 2023-10-16T13:18:19.716 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mon.b.log 2023-10-16T13:18:19.718 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.b.log 2023-10-16T13:18:19.720 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.j.log 2023-10-16T13:18:19.721 INFO:teuthology.orchestra.run.smithi092.stderr: 91.0% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-volume.log.gz 2023-10-16T13:18:19.724 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.l.log 2023-10-16T13:18:19.724 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mon.a.log 2023-10-16T13:18:19.726 INFO:teuthology.orchestra.run.smithi092.stderr: 94.7% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.j.log.gz 2023-10-16T13:18:19.740 INFO:teuthology.orchestra.run.smithi152.stderr: 91.0% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-volume.log.gz 2023-10-16T13:18:19.740 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mgr.y.log 2023-10-16T13:18:19.760 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mgr.y.log: 91.8% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mgr.y.log.gz 2023-10-16T13:18:19.879 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mon.a.log: 89.3% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mgr.x.log.gz 2023-10-16T13:18:19.918 INFO:teuthology.orchestra.run.smithi092.stderr: 94.8% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.g.log.gz 2023-10-16T13:18:19.957 INFO:teuthology.orchestra.run.smithi092.stderr: 95.0% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.a.log.gz 2023-10-16T13:18:19.970 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.l.log: 92.0% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mon.c.log.gz 2023-10-16T13:18:20.045 INFO:teuthology.orchestra.run.smithi118.stderr: 92.0% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mon.b.log.gz 2023-10-16T13:18:20.077 INFO:teuthology.orchestra.run.smithi118.stderr: 95.2% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.k.log.gz 2023-10-16T13:18:20.421 INFO:teuthology.orchestra.run.smithi118.stderr: 95.2% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.h.log.gz 2023-10-16T13:18:20.454 INFO:teuthology.orchestra.run.smithi092.stderr: 90.8% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mon.a.log.gz 2023-10-16T13:18:20.882 INFO:teuthology.orchestra.run.smithi092.stderr: 94.0% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.9.log.gz 2023-10-16T13:18:21.106 INFO:teuthology.orchestra.run.smithi118.stderr: 93.9% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.10.log.gz 2023-10-16T13:18:21.144 INFO:teuthology.orchestra.run.smithi118.stderr: 94.1% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.4.log.gz 2023-10-16T13:18:21.184 INFO:teuthology.orchestra.run.smithi092.stderr: 93.8% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.6.log.gz 2023-10-16T13:18:21.513 INFO:teuthology.orchestra.run.smithi092.stderr: 93.8% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.0.log.gz 2023-10-16T13:18:21.516 INFO:teuthology.orchestra.run.smithi092.stderr: 93.7% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.3.log.gz 2023-10-16T13:18:21.518 INFO:teuthology.orchestra.run.smithi092.stderr: 2023-10-16T13:18:21.518 INFO:teuthology.orchestra.run.smithi092.stderr:real 0m1.835s 2023-10-16T13:18:21.518 INFO:teuthology.orchestra.run.smithi092.stderr:user 0m7.422s 2023-10-16T13:18:21.519 INFO:teuthology.orchestra.run.smithi092.stderr:sys 0m0.285s 2023-10-16T13:18:21.550 INFO:teuthology.orchestra.run.smithi152.stderr: 93.9% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.8.log.gz 2023-10-16T13:18:21.643 INFO:teuthology.orchestra.run.smithi152.stderr: 93.8% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.2.log.gz 2023-10-16T13:18:21.785 INFO:teuthology.orchestra.run.smithi118.stderr: 93.9% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.1.log.gz 2023-10-16T13:18:21.819 INFO:teuthology.orchestra.run.smithi118.stderr: 93.9% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.e.log.gz 2023-10-16T13:18:21.832 INFO:teuthology.orchestra.run.smithi152.stderr: 93.9% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.11.log.gz 2023-10-16T13:18:21.901 INFO:teuthology.orchestra.run.smithi118.stderr: 93.8% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.7.log.gz 2023-10-16T13:18:22.012 INFO:teuthology.orchestra.run.smithi152.stderr: 93.8% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.l.log.gz 2023-10-16T13:18:22.112 INFO:teuthology.orchestra.run.smithi152.stderr: 93.8% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-osd.5.log.gz 2023-10-16T13:18:22.419 INFO:teuthology.orchestra.run.smithi152.stderr: 95.3% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.c.log.gz 2023-10-16T13:18:22.712 INFO:teuthology.orchestra.run.smithi152.stderr: 93.9% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.f.log.gz 2023-10-16T13:18:24.413 INFO:teuthology.orchestra.run.smithi152.stderr: 93.8% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.i.log.gz 2023-10-16T13:18:24.415 INFO:teuthology.orchestra.run.smithi152.stderr: 2023-10-16T13:18:24.416 INFO:teuthology.orchestra.run.smithi152.stderr:real 0m4.730s 2023-10-16T13:18:24.416 INFO:teuthology.orchestra.run.smithi152.stderr:user 0m20.448s 2023-10-16T13:18:24.416 INFO:teuthology.orchestra.run.smithi152.stderr:sys 0m0.628s 2023-10-16T13:18:40.594 INFO:teuthology.orchestra.run.smithi118.stderr: 93.1% -- replaced with /var/log/ceph/6c276d7e-6c24-11ee-8db6-212e2dc638e7/ceph-mds.b.log.gz 2023-10-16T13:18:40.596 INFO:teuthology.orchestra.run.smithi118.stderr: 2023-10-16T13:18:40.596 INFO:teuthology.orchestra.run.smithi118.stderr:real 0m20.910s 2023-10-16T13:18:40.596 INFO:teuthology.orchestra.run.smithi118.stderr:user 0m30.232s 2023-10-16T13:18:40.597 INFO:teuthology.orchestra.run.smithi118.stderr:sys 0m0.961s 2023-10-16T13:18:40.597 INFO:tasks.cephadm:Archiving logs... 2023-10-16T13:18:40.598 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428999/remote/smithi092/log 2023-10-16T13:18:40.599 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-16T13:18:41.526 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428999/remote/smithi118/log 2023-10-16T13:18:41.528 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-16T13:18:45.588 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428999/remote/smithi152/log 2023-10-16T13:18:45.589 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-16T13:18:47.713 INFO:tasks.cephadm:Removing cluster... 2023-10-16T13:18:47.713 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 --force 2023-10-16T13:18:48.024 INFO:teuthology.orchestra.run.smithi092.stdout:Deleting cluster with fsid: 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:18:48.486 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 --force 2023-10-16T13:18:48.792 INFO:teuthology.orchestra.run.smithi118.stdout:Deleting cluster with fsid: 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:18:49.287 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6c276d7e-6c24-11ee-8db6-212e2dc638e7 --force 2023-10-16T13:18:49.593 INFO:teuthology.orchestra.run.smithi152.stdout:Deleting cluster with fsid: 6c276d7e-6c24-11ee-8db6-212e2dc638e7 2023-10-16T13:18:50.072 INFO:tasks.cephadm:Removing cephadm ... 2023-10-16T13:18:50.073 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-16T13:18:50.096 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-16T13:18:50.117 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-16T13:18:50.134 INFO:tasks.cephadm:Teardown complete 2023-10-16T13:18:50.134 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-16T13:18:50.151 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-16T13:18:50.151 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T13:18:50.154 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T13:18:50.160 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T13:18:50.276 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-16T13:18:50.287 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-16T13:18:50.287 DEBUG:teuthology.orchestra.run.smithi092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T13:18:50.290 DEBUG:teuthology.orchestra.run.smithi118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T13:18:50.293 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T13:18:50.307 INFO:teuthology.orchestra.run.smithi092.stderr:bash: ntpq: command not found 2023-10-16T13:18:50.309 INFO:teuthology.orchestra.run.smithi152.stderr:bash: ntpq: command not found 2023-10-16T13:18:50.310 INFO:teuthology.orchestra.run.smithi118.stderr:bash: ntpq: command not found 2023-10-16T13:18:50.312 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T13:18:50.313 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2023-10-16T13:18:50.313 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 26 +849us[ +859us] +/- 80ms 2023-10-16T13:18:50.313 INFO:teuthology.orchestra.run.smithi092.stdout:^* hv02.front.sepia.ceph.com 3 7 377 24 -447us[ -437us] +/- 73ms 2023-10-16T13:18:50.313 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 21 -112us[ -112us] +/- 73ms 2023-10-16T13:18:50.314 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:18:50.315 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T13:18:50.315 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2023-10-16T13:18:50.315 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 24 +796us[ +798us] +/- 80ms 2023-10-16T13:18:50.316 INFO:teuthology.orchestra.run.smithi152.stdout:^* hv02.front.sepia.ceph.com 3 6 377 20 -454us[ -451us] +/- 73ms 2023-10-16T13:18:50.316 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 -187us[ -185us] +/- 73ms 2023-10-16T13:18:50.316 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:18:50.317 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T13:18:50.317 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2023-10-16T13:18:50.318 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 22 +770us[ +770us] +/- 80ms 2023-10-16T13:18:50.318 INFO:teuthology.orchestra.run.smithi118.stdout:^* hv02.front.sepia.ceph.com 3 6 377 23 -490us[ -501us] +/- 73ms 2023-10-16T13:18:50.318 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 23 -212us[ -212us] +/- 73ms 2023-10-16T13:18:50.318 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:18:50.319 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-16T13:18:50.330 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-16T13:18:50.331 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-16T13:18:50.347 DEBUG:teuthology.orchestra.run.smithi092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-16T13:18:50.464 DEBUG:teuthology.orchestra.run.smithi118:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-16T13:18:50.564 DEBUG:teuthology.orchestra.run.smithi152:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-16T13:18:50.658 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T13:18:50.698 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:18:50.699 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T13:18:50.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:18:50.732 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T13:18:50.764 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:18:50.765 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-16T13:18:50.775 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-16T13:18:50.790 INFO:teuthology.task.internal:Duration was 1666.983058 seconds 2023-10-16T13:18:50.791 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-16T13:18:50.806 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-16T13:18:50.806 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T13:18:50.809 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T13:18:50.812 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T13:18:50.857 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T13:18:50.858 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T13:18:50.861 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T13:18:51.297 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-16T13:18:51.297 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi092.front.sepia.ceph.com 2023-10-16T13:18:51.298 DEBUG:teuthology.orchestra.run.smithi092:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T13:18:51.324 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi118.front.sepia.ceph.com 2023-10-16T13:18:51.325 DEBUG:teuthology.orchestra.run.smithi118:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T13:18:51.349 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2023-10-16T13:18:51.349 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T13:18:51.371 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-16T13:18:51.371 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T13:18:51.374 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T13:18:51.392 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T13:18:51.460 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-16T13:18:51.460 DEBUG:teuthology.orchestra.run.smithi092:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T13:18:51.463 DEBUG:teuthology.orchestra.run.smithi118:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T13:18:51.465 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T13:18:51.573 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-16T13:18:51.584 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-16T13:18:51.585 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T13:18:51.613 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T13:18:51.640 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T13:18:51.667 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-16T13:18:51.679 DEBUG:teuthology.orchestra.run.smithi092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T13:18:51.681 DEBUG:teuthology.orchestra.run.smithi118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T13:18:51.684 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T13:18:51.706 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = core 2023-10-16T13:18:51.708 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = core 2023-10-16T13:18:51.734 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2023-10-16T13:18:51.772 DEBUG:teuthology.orchestra.run.smithi092:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-16T13:18:51.789 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:18:51.790 DEBUG:teuthology.orchestra.run.smithi118:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-16T13:18:51.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:18:51.807 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-16T13:18:51.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:18:51.829 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-16T13:18:51.841 INFO:teuthology.task.internal:Transferring archived files... 2023-10-16T13:18:51.842 DEBUG:teuthology.misc:Transferring archived files from smithi092:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428999/remote/smithi092 2023-10-16T13:18:51.842 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T13:18:51.883 DEBUG:teuthology.misc:Transferring archived files from smithi118:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428999/remote/smithi118 2023-10-16T13:18:51.884 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T13:18:51.922 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428999/remote/smithi152 2023-10-16T13:18:51.923 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T13:18:51.962 INFO:teuthology.task.internal:Removing archive directory... 2023-10-16T13:18:51.962 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-16T13:18:51.964 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-16T13:18:51.967 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-16T13:18:52.013 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-16T13:18:52.029 INFO:teuthology.task.internal:Not uploading archives. 2023-10-16T13:18:52.029 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-16T13:18:52.043 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-16T13:18:52.043 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T13:18:52.046 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T13:18:52.048 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T13:18:52.060 INFO:teuthology.orchestra.run.smithi092.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 16 13:18 /home/ubuntu/cephtest 2023-10-16T13:18:52.062 INFO:teuthology.orchestra.run.smithi118.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 16 13:18 /home/ubuntu/cephtest 2023-10-16T13:18:52.069 INFO:teuthology.orchestra.run.smithi152.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 16 13:18 /home/ubuntu/cephtest 2023-10-16T13:18:52.071 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-16T13:18:52.082 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-16T13:18:52.111 INFO:teuthology.nuke:Checking targets against current locks 2023-10-16T13:18:52.142 DEBUG:teuthology.nuke:shortname: smithi092 2023-10-16T13:18:52.143 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T13:18:52.165 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428999', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 12:45:19.455333', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T13:18:52.170 DEBUG:teuthology.nuke:shortname: smithi118 2023-10-16T13:18:52.170 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T13:18:52.194 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428999', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 12:45:19.457355', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T13:18:52.195 DEBUG:teuthology.nuke:shortname: smithi152 2023-10-16T13:18:52.196 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T13:18:52.221 INFO:teuthology.orchestra.console.smithi092:Power off 2023-10-16T13:18:52.222 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T13:18:52.233 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428999', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 12:45:19.458539', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T13:18:52.245 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-10-16T13:18:52.246 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T13:18:52.270 INFO:teuthology.orchestra.console.smithi118:Power off 2023-10-16T13:18:52.271 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T13:18:52.280 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-16T13:18:52.291 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2023-10-16T13:18:52.292 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T13:18:52.306 INFO:teuthology.orchestra.console.smithi152:Power off 2023-10-16T13:18:52.306 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T13:18:52.315 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-10-16T13:18:52.328 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-10-16T13:18:52.329 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T13:18:52.351 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-10-16T13:18:56.282 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T13:18:56.317 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T13:18:56.352 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T13:18:56.391 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-16T13:18:56.427 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-10-16T13:18:56.462 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-10-16T13:19:00.396 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T13:19:00.428 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T13:19:00.463 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T13:19:00.507 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-10-16T13:19:00.538 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-10-16T13:19:00.573 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-10-16T13:19:00.608 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-10-16T13:19:00.639 INFO:teuthology.orchestra.console.smithi118:Power off completed 2023-10-16T13:19:04.574 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T13:19:04.683 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-10-16T13:19:04.784 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-10-16T13:19:04.889 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/norstats}} duration: 1666.9830582141876 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_rishabh@teuthology status: fail success: false 2023-10-16T13:19:04.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T13:19:04.966 INFO:teuthology.run:FAIL